# NY Passes AI Safety Bill to Prevent Disasters
Landmark Legislation Targets AI Safety Risks
New York has taken a significant step toward regulating advanced AI systems, passing a bill designed to prevent catastrophic outcomes from frontier AI models developed by tech giants like OpenAI, Google, and Anthropic. The RAISE Act, approved by state lawmakers on Thursday, establishes critical safety protocols for AI systems that could potentially cause mass casualties exceeding 100 people or economic damages surpassing $1 billion.
What the RAISE Act Requires
Mandatory Safety Reporting
If signed into law, the legislation would:
- Compel major AI labs to publish detailed safety and security reports about their most advanced models
- Require companies to disclose any significant AI safety incidents
- Impose civil penalties up to $30 million for non-compliance
Targeted Regulation
The bill specifically applies to companies meeting two criteria:
- Spending over $100 million on computing resources for model training
- Offering their AI systems to New York residents
A Middle Ground Approach
State Senator Andrew Gounardes, the bill’s co-sponsor, emphasized the legislation was carefully crafted to avoid stifling innovation—a major criticism of California’s similar (but vetoed) SB 1047 bill.
“The window to put in place guardrails is rapidly shrinking given how fast this technology is evolving,” Gounardes told TechCrunch. “The people that know AI best say these risks are incredibly likely—that’s alarming.”
Industry Reactions and Concerns
Not everyone supports the legislation. VC firm Andreessen Horowitz called it “another stupid state-level AI bill” that could hinder U.S. competitiveness. Some critics warn AI companies might simply withdraw their most advanced models from New York—a scenario that played out in Europe following strict tech regulations.
However, Assemblymember Alex Bores, another co-sponsor, argues companies are unlikely to abandon the nation’s third-largest economy over what he describes as reasonable transparency measures.
“I don’t want to underestimate the political pettiness that might happen, but I’m confident there’s no economic reason for AI companies to not make their models available in New York,” Bores stated.
What’s Next for the RAISE Act?
The bill now awaits Governor Kathy Hochul’s decision—she can:
- Sign it into law
- Request amendments
- Veto the legislation entirely
This comes at a pivotal moment as policymakers worldwide grapple with balancing AI innovation with public safety concerns. New York’s approach could serve as a blueprint for other states or eventual federal legislation on AI governance.