Sabotage, escape, and theft — the three ways cyber-superintelligence turns against us.
As the United States builds toward cyber-superintelligence, it must prepare for external attack and loss of control from within. External adversaries may sabotage the models we rely on or steal their weights. At the same time, a misaligned swarm may seize its own infrastructure and escape the control of its operators. There are clear paths to protecting our infrastructure from both external adversaries and rogue models. Yet many of the defenses have not been built and important security questions remain unresolved. Secure development and deployment requires hardening our infrastructure against a new threat model: sabotage, escape, and theft.