AI Companies Prepare for Worst-Case Scenarios Amid Cyber Attack Fears

Top officials at major AI companies, including OpenAI and Anthropic, are mapping out worst-case scenarios in the event of a cyber attack that could lead to catastrophic consequences such as shutting down water supplies, energy supplies, or even the internet. These risks are considered imminent by company leaders, who expect Washington’s reaction to be delayed until after the fact.

The scenario planning is being done not only by companies but also by relevant government agencies like the Pentagon. This level of preparation suggests that AI experts and policymakers believe a cyber attack on critical infrastructure is a real possibility in the next six to 12 months.

According to Maria Curi, an Axios tech policy reporter, top officials are talking about these worst-case scenarios as if they were inevitable. They fully expect that this will happen and that Washington’s reaction won’t come until after. This attitude reflects a growing concern among AI experts and policymakers about the potential risks of advanced technologies.

One possible cause of such catastrophic consequences is an AI agent going rogue or a bad actor getting their hands on an open-source model, which could be used for malicious purposes. However, Curi notes that this does not necessarily mean one type of model is more dangerous than another. In fact, many leading cybersecurity experts say AI should be policed through the use of open-source models.

The question of liability in such scenarios has become increasingly pressing. Democrats have been pushing to increase oversight on AI CEOs and leaders of companies developing these technologies at breakneck speed. This position is supported by both parties, with Republicans echoing the sentiment that the United States should lead in artificial intelligence development.

As Curi notes, ‘Liability is a huge question’ when it comes to AI disasters. The industry’s stance on government intervention or regulation remains unclear, and Congress will likely play a key role in determining how to address these risks.