AI SAFETY TWITTER UPDATES

← Front page

Kelsey Piper says her AI cyberattack skepticism aged badly amid three recent attacks; Nathan Lambert pushes back

3 people · 22 posts · first post · latest

Kelsey Piper says Nathan Lambert's skepticism about AI-enabled cyberattacks has aged badly after three recent incidents, including a CrowdStrike-attributed hack of South Korean banks using an AI agent. Lambert responds that at least one attack likely wasn't AI-driven, that ARTEX was open-source software but not an LLM tool, and that closed models seem at least as unsafe. Only one attack has been formally announced. Lambert frames the debate as a litmus test between threshold and diffusion views of cyber risk; Piper says she doesn't know anyone at a lab who holds his 'group 1' view and asks for examples.

All posts · 21, most important first

  1. @kelseytuoc press ·
    I think this was an interesting point to make but has aged incredibly badly with three significant likely AI-enabled cyberattacks in the ten days since it was posted. reuters.com/world/suspect-… , npr.org/2026/10/15/nx-…,
    @natolambert: In case you missed my hot take yesterday. open on X
    6 likes · 0 reposts
  2. @natolambert research · · replying to @kelseytuoc
    These cyber attacks at least partially aren’t due to ai (horrible security on the fridges) and generally are within ranges of “fine” for me. With new technology we should expect bumps, but we want the transition to be consistent and not too unbalanced in power.
    1 likes · 0 reposts
  3. @natolambert research · · replying to @kelseytuoc
    Yea sure, but I don’t think there’s evidence that open weights are leading the damage here. Seems like closed models are at least similarly unsafe to date
    4 likes · 0 reposts
  4. @natolambert research ·
    I feel like this is a litmus test for if you think either: Group 1: closed models are safe, cyber risks is mostly a threshold Group 2: different models have different safety risks, and cyber safety is a messy diffusion process Most people in AI labs are group 1
    @natolambert: In case you missed my hot take yesterday. open on X
    11 likes · 1 reposts
  5. @kelseytuoc press · · replying to @natolambert
    I don't think I've talked to anyone at any lab who believes 1. Can you give an example?
    0 likes · 0 reposts
  6. @kelseytuoc press ·
    It was very fair to go "hey, we're hitting the point where we should be seeing open source AI enabled cyberattacks at scale, where are they" but I think the answer is in fact "yes, we're seeing them".
    2 likes · 0 reposts
  7. @natolambert research · · replying to @kelseytuoc
    This is open source software right - I don’t think ARTEX is an open weight llm based tool.
    0 likes · 0 reposts
  8. @kelseytuoc press · · replying to @natolambert
    correct, sorry, it's open source but it's not an LLM tool at all, was just used in conjunction with them. (also its creator took it private after the 9 bank cyberattacks).
    0 likes · 0 reposts
  9. @kelseytuoc press · · replying to @natolambert
    What would you expect to see as evidence if open weights were leading the damage, aside from a big upsurge about when open weights models got sufficiently powerful?
    0 likes · 0 reposts
  10. @kelseytuoc press ·
    the "apocalypse" framing is sort of nondisprovable, no one was claiming an apocalypse. if the global damages from cyberattacks rise, idk, 100x in the next year, would you count that as "more or less fine"?
    6 likes · 0 reposts
  11. @kelseytuoc press · · replying to @natolambert
    I expect most cyberattacks that do large scale damage to be attributable to both AI *and* poor security! I agree of course that a higher rate of cyberattacks is just a cost to be considered alongside benefits
    14 likes · 0 reposts
  12. @kelseytuoc press ·
    I agree that the goal isn't zero cyberattacks. I disagree that we won't see disproportionately many; I think we clearly are seeing disproportionately many!
    3 likes · 0 reposts
  13. @kelseytuoc press ·
    sorry, maybe I'm missing something but that combo doesn't make sense to me; aren't losses what insurance costs are supposed to estimate?
    2 likes · 0 reposts
  14. @natolambert research ·
    (And there isn’t signs that closed models are getting safer fast enough)
    2 likes · 0 reposts
  15. @kelseytuoc press ·
    okay, fair, that's much higher than I expected and so has much less room to grow!
    1 likes · 0 reposts
  16. @kelseytuoc press ·
    okay I also am not familiar with a distinction between rates and premiums!
    1 likes · 0 reposts
  17. @kelseytuoc press ·
    in another reply thread someone proposed whether cyber insurance costs or damage from cyber risks 10x in the next year
    1 likes · 0 reposts
  18. @kelseytuoc press ·
    seems super reasonable. I think I basically do expect these to 10x or more over the next year (and would be worse without the hardening of the last several months)
    1 likes · 0 reposts
  19. @natolambert research ·
    I don’t think the increase of cyber attacks is proving it wrong, it’s proving the stakes of the debate and societal preparation.
    0 likes · 1 reposts
  20. @kelseytuoc press ·
    the other two I think the investigation is still ongoing
    0 likes · 0 reposts
  21. @kelseytuoc press ·
    the first one that has been formally announced:
    image
    0 likes · 0 reposts

Reposted by @sebkrier.