AI SAFETY TWITTER UPDATES

← Front page

Kelsey Piper visits Anthropic colloquium on bioweapons risk: 'interesting, but not very reassuring'

3 people · 11 posts · first post · latest

Kelsey Piper reports on an Anthropic colloquium on AI-enabled bioweapons risk, writing that Anthropic's plan for preventing worst-case outcomes "looks more like hope and guesswork." She describes a chart showing Claude, acting alone, outperforming a human-with-Claude at planning a mass terror event since early 2026. Anthropic's Séb Krier pushed back on her framing, though he agreed it wasn't reassuring. In follow-up posts, Piper says the colloquiums are a "pretty costly" but only partly successful effort to avoid insularity from outside perspectives.

All posts · 10, most important first

  1. @kelseytuoc press ·
    I visited Anthropic for a colloquium on where they see us headed. It was very interesting. But not very reassuring.
    image
    28 likes · 3 reposts
  2. @kelseytuoc press ·
    3 likes · 1 reposts
  3. @sebkrier lab ·
    I didn't conclude it was reassuring!
    1 likes · 0 reposts
  4. @kelseytuoc press ·
    would bad outcomes require us to do dumb things? maybe, but, bad news:
    image
    25 likes · 3 reposts
  5. @kelseytuoc press ·
    My article in The Argument today is about how they've been hosting colloquiums where they bring lots of external people in and give them serious senior researcher time. This is clearly a pretty costly effort to avoid doing this.
    5 likes · 0 reposts
  6. @kelseytuoc press ·
    I don't think it totally succeeds, as an effort to avoid doing this. Most people from a cold start just can't actually say anything unexpected on a topic where there's so much inside info (not actually that much secret info, but it's certainly not widely known).
    5 likes · 0 reposts
  7. @kelseytuoc press ·
    I think the dynamics around secrecy, intensity, shared assumptions, etc. do create a sense of most of the world as unreal, out of the loop, foreign, but I think they're in fact trying pretty hard to avoid this. Just not quite hard enough they succeed
    4 likes · 0 reposts
  8. @kelseytuoc press ·
    living in the shadow of annihilation is bad for people. even if they're right.
    image
    17 likes · 1 reposts
  9. @kelseytuoc press ·
    6 likes · 0 reposts
  10. @kelseytuoc press ·
    5 likes · 0 reposts

Reposted by @dkokotajlo.