Anthropic CEO Dario Amodei 发表新文,罕见坦诚警告 AI 发展速度远超政策制定。若缩放定律再持续一两年,将出现“数据中心里的天才之国”。他以自家模型 Claude Mythos Preview 的网络风险为例,证明 AI 已是全球战略工具。他提议类似 FAA 的约束性规则:强制第三方测试前沿模型,政府有权阻止或撤销不安全发布。经济上 AI 可带来极快增长,但也存在持久失业可能,需考虑 UBI 和资本利得税。他警告 AI 或成专制工具,且不能完全信任政府或公司(包括 Anthropic)。他认为公众恐惧合理,非公关问题。强调民意、证据和政治意愿正汇聚,但已迟约一年。
Dario Amodei just now wrote published unusually candid essay about where AI is heading
The tl;dr with quotes.
His new piece, Policy on the AI Exponential, reads more like a warning from the person building the thing.
The core problem is timing. AI moves on an exponential. He is very clear about it. Lawmaking moves like Tolkien's Treebeard, the tree so slow it takes a full day just to say hello to another tree. By the time Congress acts, Amodei writes, AI can go from "an amusing toy to the full country of geniuses."
His timeline is short: "If these scaling laws continue for only a year or two longer, we are likely to get what I've called Powerful AI, or 'a country of geniuses in a datacenter'."
And he thinks the evidence has already turned. Pointing to the cyber risks of Claude Mythos Preview, he writes that "its broader significance is that it proves beyond doubt that AI models are now tools of global and national strategic consequence." So he wants binding rules modeled on the FAA. Mandatory third-party testing of frontier models. Government power to block or reverse a release it judges unsafe. This from the man whose own models would be the ones getting blocked.
The part I keep rereading:
He's genuinely split on the economics. The upside he describes is enormous: "If AI achieves the ability to do most cognitive tasks far better than humans, it stands to reason that it could result in extremely rapid and robust economic growth via the acceleration of science, technology, and operational efficiency. The iterative ability of AI to build even better AI may supercharge that growth even further."
But he won't wish the other side away: "there's a decent possibility that, despite all our efforts, AI still causes significant enduring job loss- and that this may be an intrinsic property of the technology and the way it broadly replicates human cognition." His fixes run all the way to UBI and higher capital gains taxes.