Preamble

The preamble is less useful for the typical AlignmentForum/LessWrong reader, who may want to skip to Adversaria vs Basinland section.

On 28th of October 2025, Geoffrey Irving, Chief Scientist of the UK AI Security Institute, gave a keynote talk (slides) at the Alignment Conference. The conference was organised by the UK AISI and FAR.AI as part of the Alignment Project, which aims to bring experts from relevant fields to make progress on the alignment problem.

TLDR:

Adversaria vs Basinland. We might be in one of two worlds. One where alignment is adversarial (a security problem), one where it is navigational (a search for good basins of training behaviour). We don't know which world we are in, and how we train and deploy AIs may determine this.
We need new disciplines. The field is small, thinly resourced and approached from only a handful of angles. A few well-placed ideas from other disciplines could disproportionately shift what's achievable.
Even if this all fails, evidence of hardness is valuable.

Moving past broad framing to details

Alignment means ensuring that AI systems do what humans want. This is the broad framing. There is, of course, a lot of complexity [...]

---

Outline:

(00:12) Preamble

(01:25) Moving past broad framing to details

(02:15) We should plan for superintelligence

(03:33) Adversaria vs Basinland

(07:04) Which world are we in?

(08:39) Why a few ideas might be enough

(10:38) Write down problems

(11:25) Multiple new ideas, fitting together