The Five Levels: from Spicy Autocomplete to the Dark Factory
- •Dan Shapiro introduces a six-stage taxonomy for AI-driven software engineering inspired by autonomous driving levels
- •Framework predicts a shift from manual code reviews to humans acting as high-level system architects and validators
- •Stealth teams are currently building 'dark software factories' where AI agents generate fully unreviewed, self-testing codebases
Dan Shapiro, the founder of Glowforge, has proposed a provocative framework for the evolution of software development, mapping the transition from simple 'spicy autocomplete' to the fully autonomous 'dark software factory.' This six-tier model (indexed 0-5) parallels the levels of driving automation, beginning with basic code snippets and progressing toward a future where human developers operate more like product managers or system architects. At the lower levels, humans still painstakingly review every line of code produced by a Large Language Model, treating the AI as a junior intern or a pair-programming partner. The true paradigm shift occurs at Level 4 and Level 5, where the traditional coding process is essentially discarded. In Level 5, dubbed the 'Dark Factory,' AI agents handle the entire development lifecycle—writing, testing, and deploying code without any direct human inspection of the source files. Instead of reading code, human engineers focus on designing robust testing environments and simulation tools that prove the software works as intended. This approach treats the software as a black box, where the output's reliability is guaranteed by automated validation rather than manual oversight. Simon Willison highlights that this autonomous future isn't merely theoretical; small, highly experienced stealth teams are already using these patterns to build complex systems at incredible speeds. These teams leverage the concept of an AI Agent to handle the heavy lifting of implementation. By focusing on 'proving' the system through high-fidelity simulations rather than reviewing individual scripts, these developers are redefining what it means to build reliable software in the age of generative AI.