Governing AI Before It Outpaces Us: Safety for Critical Infrastructure
March 5, 2026
As generative AI systems move from novelty to infrastructure, questions of safety, trust, and governance are becoming urgent. In this episode of TechSurge, host Sriram Viswanathan is joined by Dr. Rumman Chowdhury, CEO of Humane Intelligence PBC and responsible AI Pioneer, about what AI safety really means and why the industry may be focusing on the wrong problems.
Rumman argues that the most overlooked lever in AI development is evaluation. While companies emphasize model training and capabilities, far less attention is paid to how systems are assessed in real-world contexts, who defines “good,” what risks are measured, and how societal impacts are accounted for at scale. She distinguishes between technical assurance and broader sociotechnical risk, from misinformation and bias to over-reliance and erosion of institutional trust.
Drawing on her experience at Twitter (X) and in global policy circles, Rumman highlights a fundamental governance gap: unlike finance, aviation, or healthcare, AI lacks a mature, independent ecosystem of auditors and evaluators. Today, the same companies building AI systems often define what counts as harm. She also challenges the belief that stronger guardrails alone will solve the problem, noting that cultural context, language differences, and human behavior complicate any notion of “neutral” or fully objective AI.
Rather than focusing solely on speculative existential threats, Rumman urges attention to the harms already visible from AI-enabled misinformation to mental health risks and shifts in how younger generations relate to knowledge and authority. The future of AI, she suggests, will be determined not just by technological breakthroughs, but by whether we build credible systems of accountability, evaluation, and global cooperation around them.
If you enjoy this episode, please subscribe and leave us a review on your favorite podcast platform.
Sign up for our newsletter at techsurgepodcast.com for updates on upcoming TechSurge Live Summits and future Season 2 episodes.
Chapters
- 02:50 Why AI Evaluations Matter: Defining “Good” Models in Context
- 04:25 What Is AI Safety? From Product Performance to Societal Harm
- 11:30 Regulation Reality Check: EU AI Act, Conformance Assessments & Checklists
- 15:25 Building the AI Evaluation Profession: Audits, Red Teaming & Legal Protections
- 23:00 When It’s OK to Outsource Judgment and When It’s Dangerous
- 39:38Who’s Responsible When AI Outcomes Go Wrong?
- 52:37 Design vs Governance: Complex Systems, System-Level Evaluation, and Regulating Horizontally
- 44:11 AI Psychosis, Youth Harm, and What’s Already Here
- 47:27 What Keeps Rumman Up at Night: Kids, Algorithms, and Hope from Global Governance
- 54:00 Bringing Sci-Fi to the Real World
Episode Links
- Connect with Rumman: https://www.linkedin.com/in/rumman
- Learn more about Humane Intelligence: https://humane-intelligence.org/
India: The Next Tech Global Superpower?
As global supply chains fracture, AI reshapes productivity, and technology becomes a core instrument of national power, India is making an ambitious push to redefine its role in the world economy from IT services provider to deep tech superpower.
In the season 2 premiere of TechSurge, host Sriram Viswanathan brings together three defining perspectives to examine how India is positioned to become a global leader in frontier technologies, and what must go right for that vision to succeed.
The episode begins with S. Krishnan, Secretary at India’s Ministry of Electronics and Information Technology, who outlines how India is treating deep tech as national infrastructure. From the India Semiconductor Mission and AI compute investments to the new RDI (Research, Development & Innovation) framework, Krishnan explains how long-horizon industrial policy is being used to derisk private capital, strengthen domestic design and manufacturing, and accelerate commercialization.
Next, former G20 Sherpa Amitabh Kant places India’s technology ambitions in a global context. As post-WWII institutions weaken and supply chains are redrawn, Amitabh argues that India’s decade of structural reforms, digital public infrastructure, and global partnerships has created a historic opening, if India can sustain free enterprise, execution discipline, and state-level reform.
Finally, T.K. Kurien, CEO and Managing Partner of Premji Inves, brings the investor and operator lens. Kurien explores why India has excelled at services and business-model innovation but lagged in core technology creation and what it will take to build globally dominant deep tech companies. From patient capital and university-led innovation to focused national bets in AI applications, biotech, and semiconductors, he outlines the path from ambition to execution.
Across policy, geopolitics, and capital, one message is clear: India’s deep tech future will not be decided by vision alone but by alignment between government direction, private risk-taking, and long-term discipline.
If you enjoy this episode, please subscribe and leave us a review on your favorite podcast platform.
Sign up for our newsletter at techsurgepodcast.com for updates on upcoming TechSurge Live Summits and future Season 2 episodes.
Open vs. Closed AI: Risks, Rewards, and Realities of Open Source Innovation
In TechSurge’s Season 1 Finale episode, we explore an important debate: should AI development be open source or closed?
AI technology leader and UN Senior Fellow Senthil Kumar joins Michael Marks for a deep dive into one of the most consequential debates in artificial intelligence, exploring the fundamental tensions between democratizing AI access and maintaining safety controls.
Sparked by DeepSeek's recent model release that delivered GPT-4 class performance at a fraction of the cost and compute, the discussion spans the economics of AI development, trust and transparency concerns, regulatory approaches across different countries, and the unique opportunities AI presents for developing nations.
From Meta's shift from closed to open and OpenAI's evolution from open to closed, to practical examples of guardrails and the geopolitical implications of AI governance, this episode provides essential insights into how the future of artificial intelligence will be shaped not just by technological breakthroughs, but by the choices we make as a global community.
If you enjoy this episode, please subscribe and leave us a review on your favorite podcast platform. Sign up for our newsletter at techsurgepodcast.com for updates on upcoming TechSurge Live Summits and news about Season 2 of the TechSurge podcast. Thanks for listening!
Betting Early on Zoom, Canva, and Crypto: Inside the Playbook of Visionary Solo VC Bill Tai
Legendary technologist and investor Bill Tai joins our latest episode for a wide-ranging conversation spanning decades of Silicon Valley innovation. Bill shares his remarkable journey from being employee #1 at TSMC to becoming one of the first seed investors in Zoom and Canva, and his early embrace of Bitcoin when it was priced at just 7 cents.
The conversation explores Bill's unique investment philosophy shaped by mentorship from Don Valentine of Sequoia Capital, his innovative approach to building entrepreneurial communities through kiteboarding, and his insights into the intersection of AI, energy infrastructure, and cryptocurrency. Bill discusses the massive energy crisis facing AI data centers, drawing parallels to the telecom infrastructure buildout of the 1980s.
From his early days as a kid reverse-engineering electronics to his current role as Chairman of Hut Eight Mining and his partnership with the Trump organization on American Bitcoin Corp, Bill provides invaluable insights into recognizing structural market changes and backing the right entrepreneurs and emerging technologies at the right time.