Skip to main content

CA SB 1047

California SB 1047 (Safe and Secure Innovation for Frontier AI)

Would have required safety testing and "kill switch" capabilities for frontier AI models above certain compute thresholds. Governor vetoed citing concerns about threshold-based approach.

Jurisdiction

California

US-CA

Enacted

Unknown

Effective

Unknown

Enforcement

Not specified

Vetoed September 2024

Who Must Comply

This law applies to:

  • Would have applied to frontier AI models exceeding compute thresholds

Who bears obligations:

This regulation places direct obligations on deployers (organizations using AI systems).

Safety Provisions

  • Would have required: safety testing before deployment
  • Would have required: ability to shut down models
  • Would have required: third-party audits for largest models

Quick Facts

Binding
No
Mental Health Focus
No
Child Safety Focus
No
Algorithmic Scope
No

Why It Matters

Clearest US example of attempted frontier model safety regulation. Veto reasoning (prefer risk-based over size-based) may shape future attempts.

Recent Developments

Governor Newsom's veto message cited concerns that size-based thresholds were not risk-informed and could create false security.

Cite This

APA

California. (n.d.). California SB 1047 (Safe and Secure Innovation for Frontier AI). Retrieved from https://nope.net/regs/us-ca-sb1047

BibTeX

@misc{us_ca_sb1047,
  title = {California SB 1047 (Safe and Secure Innovation for Frontier AI)},
  author = {California},
  year = {n.d.},
  url = {https://nope.net/regs/us-ca-sb1047}
}

Related Regulations

Enacted US-CA AI Safety

CA SB 942

Requires large GenAI providers (1M+ monthly users) to provide free AI detection tools, embed latent disclosures (watermarks/metadata) in AI-generated content, and offer optional manifest (visible) disclosures to users.

In Effect US-CA AI Safety

CA CPPA ADMT

California Privacy Protection Agency regulations establishing consumer rights and business obligations for Automated Decision-Making Technology (ADMT) that makes significant decisions including healthcare. Requires pre-use notice, opt-out rights, access rights, appeal rights, and risk assessments.

In Effect US-NY AI Safety

NY S 8420-A

Requires disclosure when advertisements use AI-generated 'synthetic performers.' Penalties of $1,000 for first offense, $5,000 for subsequent violations.

Enacted US-AR Child Protection

AR HB 1071

Amends Arkansas publicity rights law to explicitly include AI-generated reproductions of voice and likeness. Covers simulated voices and 3D generation.

In Effect US-NY Online Safety

NY S 7676-B

Protects performers from exploitative digital replica contracts. Contracts for AI-generated digital replicas are void unless they describe use, performer has legal counsel or union representation, and contract doesn't replace work performer would have done.

In Effect US-TX Data Protection

TX TDPSA + SCOPE

Texas AG Paxton is the MOST AGGRESSIVE enforcer against AI companion companies. December 2024 investigations launched against Character.AI, Reddit, Instagram, Discord.