Robust Control of Software to Prevent Proliferation and Evasion

Establish robust, general methods for controlling software to prevent self-proliferation and evasion of detection, addressing the longstanding unsolved problem exemplified by computer worms.

Background

To explain the difficulty of maintaining control over autonomous AI, the paper points to the broader, longstanding challenge of controlling software. It notes that computer worms have historically been able to proliferate and evade detection, framing this as an unsolved control problem.

This contextualizes the need for advancements in software control mechanisms, which are relevant for constraining future autonomous AI systems that might replicate or hide in ways similar to malware.