Anthropic called for a pause or freeze of development of advanced AI systems and warned that AI could outpace human control or oversight, potentially causing humanity to lose control of the technology.

The company said it would be willing to suspend work on more capable AI systems if its rivals also did so, according to gdelt, and called for a coordinated system to halt development of advanced AI models if necessary, as reported by dailysabah. France24 noted that if only one company stopped AI development, rivals would simply race ahead. The Guardian reported that Anthropic plans to convene policymakers to discuss the risks of advanced AI.

Anthropic has withheld its most powerful system, Mythos, from public release over fears it could be used for cyberattacks, according to gdelt. In 2023, the firm turned down contracts with the U.S. Department of Defense for autonomous weapons systems and citizen surveillance applications, as reported by mindstudio.ai. Gdelt also noted that Anthropic is the world’s most valuable AI company, valued at about $965 billion.