VP @ REPAY | The AI in Payments Playbook: Accuracy, Human Review, and Guardrails

September 17, 2026

A logic error in payments can cost millions, so every AI agent decision requires human approval first.

Kish Khemani runs AI architecture for B2B payments at REPAY. He's led distributed engineering teams for 30+ years, starting in 1993 on a C++ compiler.

VP @ REPAY | The AI in Payments Playbook: Accuracy, Human Review, and Guardrails

Guest

Kish Khemani

Kish Khemani

Connect on LinkedIn

VP of AI Architecture for B2B Payments

REPAY

Kish Khemani has led distributed engineering teams for 30+ years, starting in 1993 on a C++ compiler at a Silicon Valley startup. He now runs AI architecture inside a payments platform at REPAY.

Host

Josh Anderson

Connect on LinkedIn

Field CTO, Revelo

Josh Anderson is Revelo's Field CTO and the host of Tech Teams Today. He is also CTO at Reclaim and co-hosts The Meta-Cast podcast, and he has spent his career building and leading engineering teams.

About this episode

Kish Khemani runs AI architecture for B2B payments at REPAY with a team of about 20 people spread across the US, South America, and India. He kept it as one team on purpose. The modules are too interdependent to split cleanly, and his experience at a previous company bears that out: 3 teams of 6 created so much duplication in standups and planning meetings that they eventually landed on 2 teams of 9 as a compromise. His rule of thumb is to give any structure at least 3 months before deciding whether it's working.

Managing across cultures taught him one pattern he now names upfront with every new team: contractors in many nearshore cultures won't tell you a deadline is wrong until the week before it's due. He tells them directly that raising a concern early won't cost them the project, and he's found that once someone speaks up and sees their concern actually heard, they do it again.

On AI in payments, his approach comes down to two things: maximize accuracy over creativity, and keep a human in the loop before any agent takes action. His team also runs outputs from one AI model through a second model from a different family before a human ever sees it. The goal is catching what a single model misses.

Peer reviews are where he sees AI quietly eroding something. Every code check-in at REPAY requires at least 2 peer reviews. The reviews still happen, but team members are running them through AI tools instead of reading the code themselves. The basic issues get caught, but the unexpected edge cases that come from experience don't, and the learning that used to pass between engineers in those reviews isn't happening.

Everything now has a human in the loop. So no decisions are made just by AI agents.

Kish Khemani

VP of AI Architecture for B2B Payments

REPAY

Chapters

  • 00:00 Intro
  • 01:29 Team size and structure at REPAY
  • 05:39 Why 3 teams of 6 became 2 teams of 9
  • 08:57 How the team went global: offshoring and acquisitions
  • 15:32 Managing across cultures and time zones
  • 20:05 Why contractors don't say no until the week before
  • 26:17 Running AI inside a payments platform
  • 31:18 Human-in-the-loop guardrails and multi-model review
  • 33:18 How AI is changing leadership and peer code reviews
  • 38:27 Closing questions

Topics

  • Why 3 teams of 6 collapsed back into 2 teams of 9 at a previous company
  • Why it takes about 3 months to know if a team structure is working
  • Why nearshore contractors won't flag a missed deadline until the week before it's due
  • How REPAY runs AI agent decisions through human approval before any action executes
  • Using two different AI model families to review each other's output before a human sees it
  • How peer code reviews are happening but the learning between engineers is quietly disappearing
  • Why Kish ties every AI and architecture decision directly to business and revenue objectives

Be our next guest

Leading an engineering team? Come tell us what you've learned.

Apply to be a guest