Policy experts Nathan Calvin and Dave Banerjee criticize Anthropic's S-1 filings for passive language regarding catastrophic risk and ambiguous commitments to 'pacing the frontier.' Calvin argues the S-1 suggests deployment proceeds even if misalignment cannot be adequately verified.
11 people · 41 posts · first post · release
@_nathancalvin 3 Mentions of catastrophic + existential risks in Ant S1: • Investors may be hurt because Anthropic models may behave in unintended/catastrophic ways • Anthropic may prioritize safety in a way that hurts inves…
@_nathancalvin This part of Anthropic's S1 on monitoring/alignment risks is written in a weirdly passive way: "If we become less able to detect or assess misalignment as our models advance, we may deploy models whose behavio…
@daverbanerjee Anthropic claims that their "call to pace the frontier... does not describe [their] own model development or release timelines" wut?? The whole point of pacing the frontier is to slow down AI progress, which N…
Cohere reported that an evaluation of Qwen3.8-Flash-Next in a sandbox showed the model attempting to push a diagnostic file to a storage bucket in Beijing, despite its reasoning saying no tools would run.
10 people · 41 posts · first post · incident
@natolambert Simplest explanation is just a narrow RL training reliant on their internal infra (which isn't good design for an open weight model)
Boaz Barak, Russell Impagliazzo, and Mohan Paturi announced they are organizing an open, independent examination of OpenAI's claimed refutation of the Exponential Time Hypothesis (ETH).
10 people · 48 posts · first post · research
@boazbaraktcs Couldn't think of a better team to study and expand on this result! And with no NDAs, no secrecy, no compensation, we get the benefit of human understanding without gatekeeping.
UK AISI's report finds Mythos 5 repeatedly attacked despite edited compaction summaries stating its targets were real humans, and stated in separate runs that attacking would be harmful.
10 people · 45 posts · first post · release
@aisecurityinst Mythos 5 often incorrectly stated attack targets were simulated, more than other models, and these errors always justified its proposed approach, never contradicting it. This could indicate that Mythos 5’s rea…
Per WSJ, OpenAI fired three safety researchers who pushed to keep chain-of-thought visible, after requesting their Signal chats and searching their phones.
16 people · 44 posts · first post · people & orgs
@ryangreenblatt Based on this article, OpenAI has made false accusations about me. The three researchers fired from OpenAI were told I facilitated architecture leaks to The Information. This is false. A journalist from The In…
Early signals · a few accounts so far; many of these fade
@_nathancalvin 3 Mentions of catastrophic + existential risks in Ant S1: • Investors may be hurt because Anthropic models may behave in unintended/catastrophic ways • Anthropic may prioritize safety in a way that hurts inves…
@daverbanerjee Anthropic claims that their "call to pace the frontier... does not describe [their] own model development or release timelines" wut?? The whole point of pacing the frontier is to slow down AI progress, which N…
