The Replaceability Test
From The AI Survival Guide by Ace Eddleman
The Replaceability Test is the heuristic I use for judging how likely a job is to be automated. Ask three questions about the work (Is it predictable? Does a framework for it already exist? Is data about it easy to collect?), then a fourth that can override the first three: how ambiguous is it?
The four questions
- Does the work involve predictable patterns of activity? Very predictable work is a prime target for every kind of automation.
- Are there already frameworks for handling it? Frameworks translate into structures that can be fed into an algorithm.
- How hard is it to gather data about what’s being done? Easy data means it may be easy to train a machine learning system. A quick proxy: count how many machines and pieces of software the job touches every day. Tech-heavy jobs leak data.
- How ambiguous is the work? Even with piles of data, a job is hard to automate when it’s full of human-induced ambiguity: lots of human-to-human interaction, built around systems that resist clean definitions.
More “yes” answers to the first three, plus low ambiguity, means more exposure.
What the test predicted
When I first wrote this book in 2017, the framework flagged programming as a target. I caught flak for it, and most programmers were confident their jobs were safe. They were wrong. Software turned out to be one of the most data-rich, pattern-heavy professions in existence (open source code, documentation, Stack Overflow), and AI coding tools went from novelty to near-necessity in a few years.
Other jobs, run through the same test:
- Copywriters: already being automated. The job is drifting into copyediting machine output.
- Lawyers: more exposed than I originally thought, and I used to put them in the “probably safe” category. Drafting and research are going fast. Counseling clients, negotiating and reading a jury are steeped in ambiguity and still human.
- Truckers: eventually, but slower than everyone predicted. Driving looks mechanical and turns out to be deeply embodied (see Moravec’s paradox).
- Police officers: hard to automate. The job is split-second judgment in ambiguous, high-stakes human situations.
Run it on yourself
The chapter has an interactive version of the test. Answer five questions about your work and watch the meter score your replaceability, from defensible to prime target.
Common questions
How can I tell if AI will replace my job?
Run it through the Replaceability Test. Jobs with predictable patterns, existing frameworks and easily collected data are the most exposed. Jobs heavy on ambiguity and human-to-human judgment are the hardest to automate.
Which jobs are safest from AI?
Jobs drenched in ambiguity and interpersonal judgment, and hands-on physical work in unpredictable settings, like plumbing or police work. Ambiguity protects a job far more than creativity does.
Is there an online version of the test?
Yes. The Are You Replaceable? chapter includes an interactive version that scores your job from defensible to prime target.