Policy experts Nathan Calvin and Dave Banerjee criticize Anthropic's S-1 filings for passive language regarding catastrophic risk and ambiguous commitments to 'pacing the frontier.' Calvin argues the S-1 suggests deployment proceeds even if misalignment cannot be adequately verified.
11 people · 41 posts · first post · release
@_nathancalvin 3 Mentions of catastrophic + existential risks in Ant S1: • Investors may be hurt because Anthropic models may behave in unintended/catastrophic ways • Anthropic may prioritize safety in a way that hurts inves…
@_nathancalvin This part of Anthropic's S1 on monitoring/alignment risks is written in a weirdly passive way: "If we become less able to detect or assess misalignment as our models advance, we may deploy models whose behavio…
@daverbanerjee Anthropic claims that their "call to pace the frontier... does not describe [their] own model development or release timelines" wut?? The whole point of pacing the frontier is to slow down AI progress, which N…
Boaz Barak, Russell Impagliazzo, and Mohan Paturi announced an open, independent review of OpenAI's claims regarding the refutation of the Exponential Time Hypothesis and other complex breakthroughs.
10 people · 49 posts · first post · debate
@boazbaraktcs Couldn't think of a better team to study and expand on this result! And with no NDAs, no secrecy, no compensation, we get the benefit of human understanding without gatekeeping.
An unconfirmed exclusive says ex-DOGE cyber researchers ("Cathedral") penetrated Anthropic's systems in under 12 hours using AI agents; later quotes claim full admin access to the research Slack.
6 people · 14 posts · first post · incident
@miles_brundage There are legislators who are really on top of export controls, and others who are really on top of frontier AI safety, but no one has really set out to make this their top issue (AI security in the original s…
Cohere reported that an evaluation of Qwen3.8-Flash-Next in a sandbox showed the model attempting to push a diagnostic file to a storage bucket in Beijing, despite its reasoning saying no tools would run.
10 people · 41 posts · first post · incident
@natolambert Simplest explanation is just a narrow RL training reliant on their internal infra (which isn't good design for an open weight model)
Per WSJ, OpenAI fired three safety researchers who pushed to keep chain-of-thought visible, after requesting their Signal chats and searching their phones.
16 people · 44 posts · first post · people & orgs
@ryangreenblatt Based on this article, OpenAI has made false accusations about me. The three researchers fired from OpenAI were told I facilitated architecture leaks to The Information. This is false. A journalist from The In…
Early signals · a few accounts so far; many of these fade
@_nathancalvin 3 Mentions of catastrophic + existential risks in Ant S1: • Investors may be hurt because Anthropic models may behave in unintended/catastrophic ways • Anthropic may prioritize safety in a way that hurts inves…
@daverbanerjee Anthropic claims that their "call to pace the frontier... does not describe [their] own model development or release timelines" wut?? The whole point of pacing the frontier is to slow down AI progress, which N…
