Anthropic, a prominent AI startup, has thrown its weight behind California Senator Scott Wiener's proposed bill, SB 1047, which aims to regulate the development and deployment of high-level artificial intelligence models. The bill has been a subject of intense debate, with some tech giants like OpenAI, Google, and Meta expressing concerns.
The bill mandates standardized safety testing for advanced AI models that cost over $100 million to develop or require significant computing power. It also requires AI developers to provide outlines for turning off AI models in case of emergencies and grants the state attorney general the authority to take legal action against non-compliant developers.
Anthropic's CEO, Dario Amodei, believes the bill's benefits likely outweigh its costs, although some aspects remain "concerning or ambiguous". The company had some influence on the bill's recent revisions, which removed the creation of a government-led AI oversight committee.
The bill's future remains uncertain, with Governor Gavin Newsom yet to decide on its fate. If passed, it would be a significant step towards regulating AI in California. The debate surrounding the bill highlights the ongoing discussion about the role of government in regulating AI and the need for safety measures to mitigate potential risks.
As the bill moves forward, it will be important to balance the need for innovation with the need for safety and accountability. The outcome will likely have significant implications for the future of AI development in California and beyond.