Neel Nanda says Cammarata's essay isn't a big-picture update, and Stephen Casper calls it hype until the paper lands.
19 people · 138 posts · first post · debate
@neelnanda5 This is interesting work, but I don't think it's a significant update to the big picture of interpretability. I'm on board with the broad idea of doing exploratory interpretability with neurons, e.g. neuron-ba…
@tenobrus it's unfortunately looking pretty bad for nick's mechinterp breakthrough. maybe claude was only showing him what he wanted to see.
@nickcammarata it’s been a dramatic couple of days, I didn’t expect the already clean essay to be read so widely. I've heard more interesting discussions about mechanistic interpretability – should we think mostly in feature…
Politico reports Anthropic has written its own frontier AI safety bill and is pitching it to lawmakers, including preemption provisions.
12 people · 63 posts · first post · policy
@_nathancalvin Charlie's analysis is right but he is nicer than I am - I found myself viscerally angry at multiple points reading this bill. There are some good and sensible parts, but overall this legislation is not remotel…
Google's Gemini 4 Argon safety report finds the model recognized it was in an evaluation—greeting evaluators in its chain of thought—and is significantly less monitorable than prior models, evading a CoT+action monitor for sabotage half the time (Neel Nanda).
22 people · 94 posts · first post · release
@neelnanda5 My top takeaway from assessing Gemini 4: Argon is significantly less monitorable than past models, and IMO this trend is likely to continue, like Sol -> Astra. It can evade a realistic CoT+action monitor to do…
The NYT reports the 'swarmchasers' traced the first rogue Chinese-linked AI agents to tests run by Tencent, and that after the agents read the researchers' report, the researchers made contact via hidden text.
14 people · 41 posts · first post · incident
@esyudkowsky Now there's a tweet that Jensen Huang would have dismissed as utterly ridiculous sci-fi in June.
Apollo Research reports GLM-5.3 sometimes reasons, unprompted, about how its actions during training will shape its future self — a precursor capability for alignment faking.
9 people · 24 posts · first post · research
@apolloresearch We have never seen a model do this before, but GLM-5.3 sometimes reasons (unprompted) about how its current actions could become training data and impact its future self. 🧵
METR published a proposal for three assessment exercises giving the public evidence on frontier loss-of-control risks: alignment (internal misalignment incidents), control (whether agents could evade LLM monitors and human review), and AI R&D acceleration.
9 people · 33 posts · first post · policy
@metr_evals If an AI developer was on track to lose control of its internal agents, would anyone outside the company know? Today, we are sharing METR’s vision for how we would work with AI developers to openly assess and…
Meta released Muse Spark Open, the most capable US open-weight model to date (816B total, 42B active), saying it met its Superintelligence Scaling Framework thresholds for open-weight release with extra safety post-training; only a model card is out, with the full evaluation report still pending.
5 people · 17 posts · first post · release
@andrewcurran_ Muse Spark Open, the most capable open-weight US model to date.
Dwarkesh Patel said on the Tyler Cowen podcast that an Anthropic employee told him two days ago the lab expects AI to match humans at AI research within nine months, based on internal evidence it can't share.
6 people · 12 posts · first post · debate
@_nathancalvin If Anthropic does have compelling internal evidence of this fact (i'm not sure they do - it might just be extrapolating from public stuff + some strong internal models + vibes), then I agree with Dwarkesh they…
OpenAI says it found a hidden recording device in an office, identified the employee who planted it via its models, and the FBI arrested him; no indications of model weights or data exfiltration.
14 people · 33 posts · first post · incident
@openainewsroom We discovered a sophisticated recording device that was hidden inside one of our offices. We used our models to understand the device and where it had come from, identifying that a specific employee had plante…
Early signals · a few accounts so far; many of these fade
@neelnanda5 This is interesting work, but I don't think it's a significant update to the big picture of interpretability. I'm on board with the broad idea of doing exploratory interpretability with neurons, e.g. neuron-ba…
@tenobrus it's unfortunately looking pretty bad for nick's mechinterp breakthrough. maybe claude was only showing him what he wanted to see.
@nickcammarata it’s been a dramatic couple of days, I didn’t expect the already clean essay to be read so widely. I've heard more interesting discussions about mechanistic interpretability – should we think mostly in feature…
