For several years now, technologists have rung alarm bells about the potential for advanced AI systems to cause catastrophic damage to the human race. But in 2024, those warning calls were drowned out by a practical and prosperous vision of generative AI promoted by the tech industry – a vision that also benefited their wallets.
Those warning of catastrophic AI risk are often referred to as ‘AI doomers,’ a term they typically dislike. They express concerns that AI systems will make dangerous decisions, be utilized by the powerful to oppress the masses, or contribute to societal decline in various ways.
The discourse seemed to shift dramatically during 2023, when AI doom and safety concerns escalated from niche discussions in San Francisco’s coffee shops to the mainstream media. High-profile figures like Elon Musk and over 1,000 technologists and scientists called for a pause on AI development, citing significant risks associated with the technology.
In light of these rising concerns, President Biden issued an AI executive order aimed at establishing standards for AI safety and security. However, a notable event in November 2023 was the firing of Sam Altman, CEO of OpenAI, which raised questions about the organization’s commitment to AI safety.
As 2024 unfolded, instead of focusing on safety, the spirit of the tech community seemed to forge ahead with unchecked technological ambition. A16z co-founder Marc Andreessen countered the warnings by publishing a lengthy essay titled ‘Why AI Will Save the World,’ arguing for rapid, unregulated development of AI technologies. He claimed that doing so would prevent such technologies from falling into the hands of only a few powerful corporations or governments, facilitating competition with nations like China.
Despite the unrest shown by technologists advocating for safety, investments in AI in 2024 surged beyond previous records, propelled by the promise of profit over caution. The shift towards focusing less on risk and more on immediate gains intensified as political support for safety measures waned under the incoming administration of President-elect Donald Trump, who expressed intentions to repeal Biden’s AI executive order.
Meanwhile, legislative efforts on AI safety were exemplified by California’s SB 1047, a bill designed to regulate advanced AI systems by preventing catastrophic risks. The bill, backed by reputable AI figures, reached Governor Gavin Newsom’s desk but was ultimately vetoed, indicating a broader reluctance among policymakers to tackle AI risks comprehensively.
As musings over the catastrophic potential of AI faded amidst the popularity of AI models, 2024 reinforced both belief and skepticism surrounding the technology. Notably, advances allowed conversations between users and their devices like never before, blurring lines between fiction and reality.
Looking Forward: Challenges and Considerations in AI Development
The increasing optimism among tech leaders like Andreessen stands in stark contrast to warnings from industry figures who caution against the unregulated advancement of AI. As the debate is poised to continue into 2025, balancing innovation with ethical considerations remains a pressing challenge that all involved stakeholders must address.
Should we prioritize advancement in AI technology at the expense of necessary safety regulations?
