AI SAFETY TWITTER UPDATES

← Front page

Belfer Center paper forecasts AI-enabled terrorism possible by 2027/2028

3 people · 16 posts · first post · latest

Stephen Casper and colleagues published a pre-mortem arguing a major AI-enabled terrorism event could occur as early as 2027/2028. The researchers argue that both poorly guarded closed-weight models and open-weight models susceptible to tampering pose credible threats across cyber, bio, and chemical domains.

All posts · 12, most important first

  1. @stephenlcasper research ·
    🚨New paper (possibly the most important one I have written yet). We think that as early as 2027 or 2028, there might be a major AI-enabled terrorism event. We conducted a pre-mortem, made 9 falsifiable predictions, and wrote 2 concrete scenarios. Led by @KamacheeMax.
    imageimage
    19 likes · 8 reposts
  2. @stephenlcasper research ·
    We hope that this paper can help ground serious discussions about mitigating AI-enabled terrorism risk. Paper (coming to arXiv/SSRN soon): belfercenter.org/research-analy…
    1 likes · 0 reposts
  3. @stephenlcasper research ·
    Props to @KamacheeMax for the extraordinary talent, persistence, and vision in leading this paper. And a big thanks to other coauthors: Jordi Weinstock, @AntoniaJuelich, Jonas Raedler, & Elise Racine. Work done at @MATSprogram and @BelferCenter at @Kennedy_School.
    3 likes · 0 reposts
  4. @stephenlcasper research ·
    And a piece by the Harvard Gazette: news.harvard.edu/gazette/story/…
    3 likes · 0 reposts
  5. @stephenlcasper research ·
    The threat isn't hypothetical. There have already been a number of violent and deadly incidents involving small-scale terror and criminal misuse of AI. Frontier AI companies and world governments treat the threat of a bio/chem/cyber attack enabled by AI as a credible concern.
    image
    2 likes · 1 reposts
  6. @stephenlcasper research ·
    The paper is now on SSRN: papers.ssrn.com/sol3/papers.cf…
    @stephenlcasper: 🚨New paper (possibly the most important one I have written yet). We think that as early as 2027 or 2028, there might be a major AI-enabled terrorism event. We conducted a pre-mortem, made 9 falsifiable predictions, and wrote 2 concrete scenarios. Led by @KamacheeMax. open on X
    1 likes · 0 reposts
  7. @stephenlcasper research ·
    Finally, we describe two grounded, realistic illustrative scenarios for how such an attack might occur, involving: 1. A non-state group, a closed-weight model, and a biological attack 2. A state-sponsored group, an open-weight model, and a cyberattack
    1 likes · 0 reposts
  8. @stephenlcasper research ·
    We make 8 other predictions as well: three about the closed-weight model pathway to harm, three about the open-weight model pathway to harm, and two about either pathway.
    1 likes · 0 reposts
  9. @stephenlcasper research ·
    This leads us to our central prediction: Such an event will trace to either a closed-weight model deployed without state-of-the-art safeguards or an open-weight model.
    1 likes · 0 reposts
  10. @stephenlcasper research ·
    We also look at how harmful capabilities have proliferated and been misused in the past several years, involving (1) non-consensual AI nudification, (2) AI-assisted cybercrime, and (3) AI-uplifted small-scale terrorism events.
    1 likes · 0 reposts
  11. @stephenlcasper research ·
    From an AI safety science perspective, this paper considers how (1) these harmful capabilities would be developed, (2) they would be deployed, (3) the dangerous capability would be elicited, (4) safeguards would fail, and (5) detection would fail.
    1 likes · 0 reposts
  12. @stephenlcasper research ·
    Think anthrax. Anthrax outbreaks typically kill double or triple digits numbers of people.
    0 likes · 0 reposts

Reposted by @_nathancalvin, @stephenlcasper, @tim_hua_.