AI Firms Warned Over Lack of Preparedness for Human-Level Systems

AI Firms Warned Over Lack of Preparedness for Human-Level Systems

Artificial intelligence companies are "fundamentally unprepared" for the consequences of creating systems with human-level intellectual performance, according to a report by the Future of Life Institute (FLI). The FLI's AI safety index evaluated seven AI developers, including Google DeepMind, OpenAI, Anthropic, Meta, xAI, and China's Zhipu AI and DeepSeek, across six areas, including "current harms" and "existential safety". None of the firms scored higher than a D for "existential safety planning".

The report warns that advanced AI companies have "weak to very weak risk management practices" and labels their current approach "unacceptable". Safety campaigners warn that artificial general intelligence (AGI) could pose an existential threat by evading human control and triggering a catastrophic event.

Max Tegmark, co-founder of FLI, compares the current state of AI safety to building a gigantic nuclear power plant without a plan to prevent meltdowns. Stuart Russell, a British computer scientist, and Sneha Revanur, founder of Encode Justice, reviewed the FLI's report and expressed concerns about the industry's preparedness.

Google DeepMind disputes the findings, stating that their comprehensive approach to AI safety extends beyond what's captured in the report. Other companies, including OpenAI, Anthropic, Meta, xAI, Zhipu AI, and DeepSeek, have also been approached for comment.

The lack of preparedness among AI firms raises concerns about the potential risks associated with developing human-level AI systems. As the industry continues to push the boundaries of AI capabilities, it is essential to prioritize safety and develop robust protocols to mitigate potential threats.

About the author

TOOLHUNT

Effortlessly find the right tools for the job.

TOOLHUNT

Great! You’ve successfully signed up.

Welcome back! You've successfully signed in.

You've successfully subscribed to TOOLHUNT.

Success! Check your email for magic link to sign-in.

Success! Your billing info has been updated.

Your billing was not updated.