NY Passes AI Safety Bill to Prevent Disasters
New York Takes Major Step in AI Regulation
New York has become the first U.S. state to pass comprehensive AI safety legislation designed to prevent catastrophic scenarios involving advanced artificial intelligence systems. The RAISE Act, approved by state lawmakers this week, specifically targets frontier AI models from tech giants like OpenAI, Google, and Anthropic that could potentially cause mass casualties exceeding 100 people or economic damages over $1 billion.
Key Provisions of the RAISE Act
The landmark legislation establishes America’s first legally mandated transparency framework for AI developers:
Safety Reporting Requirements
- Mandatory disclosure of detailed safety and security assessments for high-risk AI models
- Immediate reporting of safety incidents, including unauthorized model access or concerning behaviors
- Civil penalties up to $30 million for non-compliance
Targeted Regulation
The bill strategically focuses on large corporations developing models trained with over $100 million in computing resources – a threshold that currently applies primarily to industry leaders. This targeted approach aims to avoid stifling innovation at smaller firms and research institutions.
Balancing Innovation and Safety
State Senator Andrew Gounardes, the bill’s co-sponsor, emphasized the urgent need for “guardrails” as AI technology advances at breakneck speed. “The people that know AI the best say these risks are incredibly likely,” Gounardes warned during TechCrunch interviews.
The legislation represents a compromise between full industry opposition seen in California (where Governor Newsom vetoed similar bill SB 1047) and the complete absence of AI oversight at federal levels. Notably, the RAISE Act omits controversial provisions like mandatory “kill switches” that drew criticism toward California’s proposal.
Industry Pushback and Political Outlook
Silicon Valley investors have already voiced strong opposition. Andreessen Horowitz’s Anjney Midha called the bill “stupid” in a public post, echoing criticism that state-level regulations could hinder U.S. competitiveness against global rivals.
The RAISE Act now awaits Governor Kathy Hochul’s signature. If enacted, it could establish New York as the national leader in AI governance while setting a precedent other states might follow. As Assemblymember Alex Bores noted, “New York has the third largest GDP in the U.S…there is no economic reason for AI companies to not make their models available here.”
With AI capabilities advancing exponentially, this legislation marks a pivotal moment in the debate over how to harness transformative technology while protecting public safety.