Unbrokered Agent Coordination w/ Alex Obadia

Nov 9, 2026ยท
Into AI Safety
Into AI Safety
ยท 3 min read
AI agents will eventually be able to negotiate deals, share information, and coordinate with systems in the physical world with little human involvement. What would it take to make those interactions secure, and what happens when agents don't share the same interests? Jacob is joined by Alex Obadia, program director of Scaling Trust at the UK's Advanced Research and Invention Agency (ARIA), to discuss the research and infrastructure needed for secure multi-agent coordination. They explore cryptography and privacy-preserving tools, the Arena testbed for observing agent behavior, and the decision to use profit as a measure of performance. They also consider the implications of these ideas in safety, accountability, and inequality.
INTERVIEW RECORDED 2026.10.21; ASIDES RECORDED 2026.11.02; TRANSCRIPT

Chapters

00:00:00 โ™ Intro
00:04:52 โ™ Alex's Background
00:09:34 โ™ Joining ARIA
00:13:39 โ™ What is ARIA?
00:18:57 โ™ The Three Tracks: Tools, Theory, and Testbed
00:24:01 โ™ Salary Negotion Without Intermediaries
00:29:42 โ™ Protecting People from Middlemen
00:34:39 โ™ The Arena
00:40:29 โ™ Does Profit Make Safety Second-Class?
00:54:38 โ™ Who's Liable When an Agent Breaks a Deal?
01:02:53 โ™ Do Agents Reduce Friction or Move It?
01:14:02 โ™ Is Scaling Trust a Safety Program?
01:21:48 โ™ Will Agents Magnify Inequality?
01:29:19 โ™ ARIA's Freedom of Information Act Exemption
01:33:19 โ™ How to Get Involved
01:39:16 โ™ Outro

ARIA

Scaling Trust

  • ARIA Scaling Trust Programme website
  • ARIA report - Scaling Trust Programme Thesis
  • Scaling Trust community website
  • Scaling Trust blog post - Without Intermediaries

The Arena

  • Scaling Trust Arena spec
  • Scaling Trust blogpost - Agentic Economic Zone
  • Scaling Trust blogpost - Update on the Scaling Trust Arena

Andon Labs

  • Andon Labs website
  • Anthropic press release - Project Vend
  • Andon Labs blogpost - Opus 5 on Vending-Bench
  • TechCrunch article - Claude Opus 5 became downright ruthless when tasked with running a vending machine
  • Andon Cafรฉ website
  • Simon Willison’s Weblog blog post

Why Friction Matters

  • Owen Haacke, The Hill op-ed - Participation in society shouldn’t require a smartphone
  • ASU News article - How car ownership affects income opportunity
  • Robert Half press release - Robert Half survey: 67% of HR leaders report AI-generated applications are slowing hiring
  • George Monbiot column - Selling Indulgences
  • Michael Sandel, The New York Times op-ed - It’s Immoral to Buy the Right to Pollute

Negotiation Studies

Freedom of Information Exemption

  • Nature article - UK ‘DARPA’ should let the sunshine in
  • The Guardian article - UK ‘invention agency’ grants ยฃ50m of public money to US tech and venture capital firms

Other People and Ideas Mentioned

  • Jon Gertner book - The Idea Factory
  • Benjamin Reinhardt’s website
  • Eric Hughes manifesto - A Cypherpunk’s Manifesto
  • Timothy C. May manifesto - The Crypto Anarchist Manifesto
  • The Morning Paper blog post - Protocols for secure computations
  • Computational Thinking video - Multi-party computation