Want smarter insights in your inbox? Sign up for our weekly newsletters to get only what matters to enterprise AI, data, and security leaders. Subscribe Now
Inspiration can come from different places, even for architecting and designing agentic systems.
At VB Transform, Capital One explained how it built its agentic platform for its auto business. Milind Naphade, SVP of Technology and Head of AI Foundations at Capital One, said during VB Transform that the company wanted its agents to function similarly to human agents, in that they problem-solve alongside customers.
Naphade said Capital One began designing its agentic offerings 15 months ago, “before agentic became a buzzword.” For Capital One, it was crucial that, in building its agent systems, they learn from how their human agents ask customers for information to identify their problems.
Capital One also looked to another source of organizational structure for its agents: itself.
“We took inspiration from how Capital One itself functions,” Naphade said. “Within Capital One, as I’m sure within other financial services, you have to manage risk, and then there are other entities that you also observe, evaluate, question and audit.”
>>See all our Transform 2025 coverage here<<This same structure applies to agents that Capital One wants to monitor. They created an agent that evaluates existing agents, which was trained on Capital One’s policies and regulations. This evaluator agent can kick back the process if it detects a problem. Naphade said to think of it as “a team of experts where each of them has a different expertise and comes together to solve a problem.”
Financial services organizations recognize the potential of agents to provide their human agents with information to resolve customer issues, manage customer service, and attract more people to their products. Other banks like BNY have deployed agents this year.
Auto dealership agents
Capital One deployed agents to its auto business to assist the bank’s dealership clients in helping their customers find the right car and car loan. Consumers can look at the vehicle inventories of dealerships that are ready for test drives. Naphade said their dealership customers reported a 55% improvement in metrics such as engagement and serious sales leads.
“They’re able to generate much better serious leads through this more conversational, natural conversation,” he said. “They can have 24/7 agents working, and if the car breaks down at midnight, the chat is there for you.”
Naphade said Capital One would love to bring this type of agent to its travel business, especially for its customer-facing engagements. Capital One, which opened a new lounge in New York’s JFK Airport, offers a very popular credit card for travel points. However, Naphade pointed out that the bank needs to conduct extensive internal testing.
Data and models for bank agents
Like many enterprises, Capital One has a lot of data for its AI systems, but it has to figure out the best way to bring that context to its agents. It also has to experiment with the best model architecture for its agents.
Naphade and Capital One’s team of applied researchers, engineers and data scientists used methods like model distillation for more efficient architectures.
“The understanding agent is the bulk of our cost because that’s the one that has to disambiguate,” he said. “It’s a bigger model, so we try to distribute it down and get a lot of bang for our buck. Then there’s also multi-token prediction and aggregated pre-fill, a lot of interesting ways we can optimize this.”
In terms of data, Naphade said his team had undergone several “iterations of experimentation, testing, evaluation, human in the loop and all the right guardrails” before releasing its AI applications.
“But one of the biggest challenges we faced was that we didn’t have any precedents. We couldn’t go and say, oh somebody else did it this way, so we couldn’t ask how it worked out for them?” Naphade said.
Editor’s Note: As a thank-you to our readers, we’ve opened up early bird registration for VB Transform 2026 — just $200. This is where AI ambition meets operational reality, and you’re going to want to be in the room. Reserve your spot now.
[ad_2]
Source link
