Nathan Calvin critiques OpenAI standards, citing risk before 'Fully autonomous RSI'
Nathan Calvin critiques OpenAI's standards, noting that heightened loss of control risks escalate long before achieving 'Fully autonomous RSI.' He acknowledges the value of OpenAI suggesting that 'informed democratic choices' should be a prerequisite for certain development paths.
All posts · 1, most important first
- I didn't initially notice this paragraph from OpenAI's September post on "Building standards for the next phase of AI." Its a good sentiment, even though "Fully autonomous RSI" seems like too high a bar - heightened loss of control risks would happen well before that point. Of course OpenAI's invocation of democratic principles has been much more frequent than its follow through on operationalization of those principles, but I like them at least saying that "informed democratic choices" should be a prerequisite to proceeding with certain AI development paths. A very good start for OpenAI and other companies to operationalize this oversight would be share their current compute allocations being spent on internal AI R&D vs external inference vs security hardening etc.
7 likes · 1 reposts
@_nathancalvin policy ·