Anthropic just called for a global way to slow frontier AI because its own models may be approaching recursive self-improvement， where a system helps build a stronger version of itself without direct human control.

Future models will become so good at research， experiments， debugging， and training design that humans will stop being the main bottleneck.

Once that loop starts， progress could shift from human-paced engineering to machine-assisted improvement， which makes every safety test， law， and lab policy feel late by default.

Anthropic says this has not happened yet， but warns that the jump may arrive before governments， companies， and researchers have a trusted way to measure or restrain it.

The hard part is verification， because a huge AI training run is easier to hide than a weapons site， and any lab that secretly keeps training while others pause could gain the lead.

Anthropic is now ~$1T， may reach $50B annualized revenue， and competes fiercely with OpenAI， so every safety claim also lands inside a giant business fight.

---

anthropic .com/institute/recursive-self-improvement