In this conversation, Jannah Patchay and Simran Singh discuss the evolving landscape of AI regulation, focusing on the risks, governance frameworks and challenges posed by accountability and tech sovereignty. Simran shares her journey into the field of AI and regulation, highlighting the importance of understanding AI-related risks, including black swan events and the complexities of accountability in AI systems. They explore the implications of concentration risks in technology and the need for international cooperation to address regulatory fragmentation. The discussion culminates in a vision for future governance frameworks that prioritise ethical considerations and user-centered design.

Takeaways

Simran's journey into AI regulation began at the UK Financial Conduct Authority in 2020.
AI risks are complex and often analysed locally, but they materialise systemically.
Policymakers should consider fragmentation as a significant risk in AI governance.
Black swan events in AI can lead to catastrophic consequences, if not addressed.
AI can be a tool for detecting and managing risks effectively.
Accountability in AI is shifting from prediction to preparation for failures.
Sovereignty in AI should not lead to isolation but rather to shared insights.
Regulatory frameworks must evolve to address the complexities of AI.
User-centered design is crucial in AI governance to ensure ethical outcomes.
No governance framework will be perfect from the start; it must adapt over time.

Chapters

00:00 - Journey into AI and Regulation

05:08 - Understanding AI Risks and Governance

10:00 - Black Swan Events and Regulatory Challenges

15:13 - Accountability in AI Systems

19:51 - Tech Sovereignty and Concentration Risks

25:10 - Regulatory Fragmentation and International Cooperation

29:49 - Future Governance Frameworks for AI

Further Resources:

https://www.theguardian.com/news/2026/jun/18/can-ecosystems-malfunction

https://www.amazon.co.uk/Future-Humanity-Terraforming-Interstellar-Immortality/dp/0241304849

https://www.amazon.co.uk/Seeds-Time-J-Wyndham/dp/B000GRK03E

Message us and tell us what you think of this episode, or share your ideas for future episodes - we’d love to hear from you!