Claude Mythos is different.

This is the first model other than GPT-2 that is at first not being released for public use at all.

With GPT-2 the delay was due to a general precautionary principle. OpenAI did not know what they had, or what effect on demand text would have on various systems. It sounds funny now, GPT-2 was harmless, but at the time the concern was highly reasonable.

The decision not to release Claude Mythos is not about an amorphous fear. If given to anyone with a credit card, Claude Mythos would give attackers a cornucopia of zero-day exploits for essentially all the software on Earth, including every major operating system and browser. It would be chaos.

Or, in theory, if Anthropic had chosen to do so, it could have used those exploits. Great power was on offer, and that power was refused. This does not happen often.

Instead Anthropic has created Project Glasswing. Mythos is being given only to cybersecurity firms, so they can patch the world's most important software. Based on how that goes, we can then decide if and when it will become reasonable to give access to a broader [...]

---

Outline:

(03:24) Mundane Alignment Is Excellent

(05:01) Would This Process Be Sufficient To Find A Dangerous Model?

(06:27) Introductory Warning About Superficial Mundane Alignment

(15:12) Model Training (1.1)

(15:25) Release Decision Process (1.2)

(17:50) RSP Evaluations (2.1 and 2.2)

(22:17) Autonomy Evaluations (2.3)

(25:56) The Alignment Risk Update Document

(26:39) The Threat Model

(29:18) Misalignment As Failure Mode

“Claude Mythos: The System Card” by Zvi