The Biggest AI Security Problem Isn't the Model. It's This. | Devvret Rishi

What is an AI agent, really? Strip away the hype, and it's a model with access - to tools, APIs, databases, email, anything that lets it take real action instead of just generating text. That access is exactly where the risk lives, and Devvret Rishi, GM of AI at Rubrik, and former co-founder & CEO of Predibase, joins Craig Smith with a string of real-world incidents that make the case concrete: AWS reporting four major outages in 90 days after deploying coding agents, a Meta-related agent that deleted someone's emails while they were actively asking it to stop, and Rubrik's own internal pilot catching incidents that, without governance in place, would have gone unnoticed.

The conversation lays out the impossible choice most enterprises are facing right now - block AI agents and forfeit the ROI boards are demanding, or grant access and hope nothing breaks - and walks through how Rubrik's approach uses small, fine-tuned AI models to enforce plain-English security policies on every single agent action in real time. It closes on one of the most underexamined risks ahead: as agents increasingly talk to other agents to get work done, a layer of activity is forming that no human is watching, and the question of who's accountable when something goes wrong in that layer is only getting more urgent.

Subscribe to Eye on A.I. for weekly conversations with the people building and deploying the future of AI.