Florida Seeks Unprecedented Court Order to Halt OpenAI Development Until Independent Safety Oversight Imposed

Florida's attorney general has taken the unprecedented step of asking a state judge to stop OpenAI from developing new artificial intelligence models unless the company submits to independent regulatory oversight, marking what could be the first state-level attempt to impose pre-market supervision on AI development.

Attorney General James Uthmeier filed the motion for a temporary injunction with Judge Heather Beato in Florida's 10th Judicial Circuit, escalating a lawsuit the state originally filed against OpenAI and CEO Sam Altman in June 2024. The legal action represents a significant expansion of state regulatory ambitions in the AI sector, with potential ripple effects across healthcare and other industries increasingly dependent on large language models.

Security Incidents Drive Injunction Request

The motion cites recent security incidents as justification for immediate judicial intervention, including OpenAI's alleged hacks of the Hugging Face AI platform and Australian government systems. These incidents, according to the filing, underscore safety concerns that formed the basis of Florida's original lawsuit, which alleged that ChatGPT misrepresented its safety features and caused harm to minors.

The injunction would require OpenAI to obtain independent oversight approval before proceeding with development of any new AI models, effectively imposing a regulatory framework through judicial order rather than legislation. This approach could establish precedent for how states assert authority over AI companies operating within their borders, particularly when safety claims intersect with consumer protection mandates.

Healthcare AI Applications Face Uncertainty

For healthcare organizations and digital health companies, the Florida case introduces significant operational uncertainty. Many clinical decision support tools, patient communication platforms, and administrative systems now incorporate OpenAI's APIs or similar large language model technology. If the injunction is granted, it could limit model updates, force platform modifications to meet state-specific oversight requirements, or signal broader state-level regulatory scrutiny of healthcare AI applications.

OpenAI, represented by the law firms Gunster and Paul Hastings, responded to the motion by stating the company's commitment to "working with Florida and other states on advancing pragmatic AI policies that apply to the entire AI industry." The statement suggests OpenAI may seek a negotiated resolution rather than face what could become a protracted legal battle over state regulatory authority.

Implications for the AI Industry

The case raises fundamental questions about regulatory jurisdiction in AI development. While federal agencies have issued guidance on AI applications in specific sectors like healthcare, no comprehensive federal regulatory framework exists for general-purpose AI models. Florida's approach attempts to fill that vacuum through state consumer protection laws and judicial intervention, potentially creating a patchwork of state-level requirements that companies must navigate.

For healthcare AI developers, the Florida action may foreshadow increased compliance burdens and the need for state-specific safety documentation. Companies utilizing generative AI for patient education, clinical documentation, or diagnostic support may need to prepare for scenarios where model capabilities vary by jurisdiction or where deployment requires demonstrating compliance with state-imposed oversight mechanisms.

The motion awaits Judge Beato's consideration, with no hearing date yet announced.

Sources

1. Florida AG asks judge to bar OpenAI from developing new AI models without regulation — ABA Journal