A bill aimed at regulating powerful artificial intelligence models is currently being debated in California’s legislature, despite concerns that it may stifle the very technology it aims to control.

Democratic state senator Scott Wiener of San Francisco, the bill’s sponsor, stated, “With Congress gridlocked over AI regulation… California must act to get ahead of the foreseeable risks presented by rapidly advancing AI while also fostering innovation.” However, critics, including some Democratic members of Congress, argue that imposing punitive measures on developers in this emerging field could hinder innovation.

Influential Democratic congresswoman Nancy Pelosi expressed her concerns, stating, “The view of many of us in Congress is that SB 1047 is well-intentioned but ill-informed,” highlighting that prominent party members have shared their worries with Wiener. She emphasized the importance of leading in AI while ensuring consumer protection, stating, “SB 1047 is more harmful than helpful in that pursuit.” Notably, Stanford University professor Fei-Fei Li, often referred to as the “Godmother of AI,” has also voiced opposition to the bill.

Harm or help?

The proposed legislation, known as the Safe and Secure Innovation for Frontier Artificial Intelligence Models Act, is criticized for potentially failing to address the issues it intends to solve. Li argues that it could “deeply harm AI academia, little tech, and the open-source community.” Little tech refers to startups, small companies, and independent researchers.

Wiener asserts that the legislation aims to ensure the safe development of large-scale AI models by establishing safety standards for developers of systems costing over $100 million to train. The bill mandates precautions such as pre-deployment testing, simulating hacker attacks, and implementing cybersecurity measures, along with protections for whistleblowers.

Recent amendments to the bill have replaced criminal penalties for violations with civil penalties, such as fines.

Wiener believes that AI safety and innovation can coexist, claiming that modifications to the bill have addressed some critics’ concerns. OpenAI, the creator of ChatGPT, has also opposed the bill, advocating for national regulations to avoid a chaotic patchwork of state laws.

According to The National Conference of State Legislatures, at least 40 states have introduced bills this year to regulate AI, with several enacting legislation aimed at the technology. OpenAI warns that the California bill could drive innovators out of Silicon Valley.

Conversely, Anthropic, another generative AI company, has stated that the bill, following some adjustments, offers more benefits than drawbacks.

The bill has garnered support from notable figures in the AI community. Computer scientist Geoffrey Hinton, known as the “Godfather of AI,” remarked in a Fortune op-ed, “Powerful AI systems bring incredible promise, but the risks are also very real and should be taken extremely seriously.” He believes that “SB 1047 takes a very sensible approach to balance those concerns.” Hinton emphasized the necessity of AI regulation with “real teeth,” asserting that California is an ideal starting point due to its history as a launchpad for technology.

Meanwhile, students and professors at the California Institute of Technology are urging the public to sign a letter opposing the bill. CalTech professor Anima Anandkumar stated, “We believe that this proposed legislation poses a significant threat to our ability to advance research by imposing burdensome and unrealistic regulations on AI development.”

© 2024 AFP