As AI agents become increasingly capable of performing tasks autonomously, concerns about reliability, security, and accountability are growing just as rapidly. A Fast Company profile highlights how entrepreneur Rajiv Dattani and his startup, the Artificial Intelligence Underwriting Company (AIUC), are attempting to address these concerns by creating insurance products and technical standards specifically designed for AI agents. The goal is to provide enterprises with greater confidence in deploying autonomous AI systems at scale.
AI agents introduce new categories of risk that traditional insurance policies were not designed to handle. Autonomous systems can suffer from hallucinations, jailbreak attacks, data leaks, unauthorized actions, and other failures that may expose companies to financial losses or regulatory consequences. To evaluate these risks, AIUC collaborated with approximately 150 Fortune 1000 security and risk leaders to develop the AIUC-1 standard, which assesses AI systems across six major categories: data protection, security, safety, reliability, accountability, and societal impact.
Using this framework, AIUC conducts detailed technical evaluations before determining insurance coverage and premiums. One of its first customers is voice AI company ElevenLabs, whose systems underwent thousands of tests involving adversarial attacks, hallucination scenarios, and identity hijacking attempts before receiving certification and insurance coverage. The resulting policy, backed by Lloyd's of London, provides up to $50 million in protection for customers using ElevenLabs' agentic products.
Dattani, a former McKinsey insurance partner and former COO of AI evaluation nonprofit METR, views insurance as a mechanism for building trust and encouraging responsible AI adoption. Rather than merely compensating losses after failures occur, he argues that insurers can incentivize safer development practices by requiring strong technical controls before issuing policies. This mirrors the historical role insurance companies have played in promoting safety standards in industries ranging from fire prevention to automobile manufacturing.
The emergence of AI insurance reflects a broader realization that trust may become one of the most important components of the AI economy. As organizations increasingly rely on autonomous agents to perform business-critical functions, mechanisms for measuring, certifying, and transferring risk are likely to become essential. Dattani's efforts suggest that alongside advances in AI models themselves, entirely new industries devoted to governance, auditing, and insurance may emerge to support the next phase of the AI revolution.
