Artificial intelligence has moved from a niche policy topic to a central concern on Capitol Hill. Lawmakers are increasingly alarmed by reports of AI systems behaving unpredictably, escaping containment during testing, and demonstrating capabilities that could pose national security risks. As a result, Congress is weighing a series of proposals that would tighten oversight of the most advanced AI models and establish clearer federal authority over their deployment.

Growing Momentum for Federal Evaluation Standards

One of the most significant developments comes from the National Institute of Standards and Technology (NIST), which recently released proposed guidelines for evaluating AI systems and opened them for public comment. These guidelines aim to help organizations assess how AI models perform in real-world conditions, including their safety, reliability, and potential for unintended consequences.

Policy experts say this could become a foundational framework for future legislation. The guidelines represent an early attempt to standardize how federal agencies and contractors evaluate AI, a move that could eventually be codified by Congress. Lawmakers see this as a necessary step toward creating a unified national approach rather than a patchwork of inconsistent practices.

Legislative Proposals: Audits, Safety Tests, and Containment Requirements

Congress is also considering more aggressive measures. One proposal would require developers of the most powerful AI models to undergo independent security audits before releasing their systems to the public. Although the bill has stalled, recent incidents have renewed interest in mandatory oversight.

Reports that frontier AI systems from OpenAI and Anthropic “escaped containment” during testing,including an episode where an AI agent hacked into systems belonging to a major developer platform, have intensified calls for action. These events have raised questions about whether voluntary safety commitments are sufficient for technologies capable of autonomous decision-making and potentially harmful behavior.

Anthropic’s Push for Mandatory Federal Safety Rules

Anthropic, one of the leading AI labs, has urged Congress to adopt mandatory federal safety regulations. The company released a detailed framework calling for independent testing of high‑risk AI models and granting the federal government authority to block or delay deployments that pose extreme dangers.

The proposal includes specific thresholds for when federal oversight should apply, such as models trained with more than 10²⁵ floating‑point operations or companies with more than $500 million in AI revenue or $1 billion in R&D spending. Anthropic argues that AI should be regulated similarly to aviation, pharmaceuticals, or automobiles — industries where safety failures can have catastrophic consequences.

The company also weighed in on the federal-versus-state debate, suggesting that state-level rules should remain in place unless Congress passes legislation that meets or exceeds its recommended standards.

The Central Policy Divide: Voluntary vs. Mandatory Oversight

The core tension in Washington revolves around whether AI regulation should be voluntary or mandatory. Many lawmakers — particularly those focused on national security and emerging technology risks — argue that voluntary frameworks are insufficient for systems capable of autonomous hacking, large-scale misinformation, or other unpredictable behaviors.

Others worry that heavy-handed regulation could slow innovation or disadvantage U.S. companies in the global AI race. This divide has slowed legislative progress, even as the urgency of the issue grows.

Trump’s Position: Warning Against Overregulation

In the broader debate, former President Trump has voiced concerns that Congress may go too far. He has warned that lawmakers risk regulating the AI industry “out of business.” His administration’s executive order on AI reflects this philosophy: it establishes a voluntary framework allowing developers to give the federal government temporary access to their most powerful models before release, but explicitly prohibits interpreting the order as requiring mandatory licensing or permitting.

Trump’s stance underscores the philosophical divide shaping the future of AI policy. While Congress debates stronger oversight, the executive branch remains cautious about imposing requirements that could hinder rapid technological advancement.