Should Robots Have Rules?

A famous science fiction writer tried to answer this almost 100 years before it became a real question.

Robots that clean floors, assemble cars, and even perform surgery already exist. As robots get more capable, a question that used to feel like pure science fiction has become genuinely practical: what rules should robots have to follow?

A famous early attempt

In 1942, science fiction author Isaac Asimov proposed three simple rules for robots in his stories, which became hugely influential:

1. A robot may not harm a human, or allow a human to come to harm through inaction.
2. A robot must obey human orders, unless doing so would break the first rule.
3. A robot must protect its own existence, unless doing so would break the first or second rule.

These rules were designed to always prioritize human safety above everything else, in a strict order.

Why simple rules aren't actually simple

Asimov's own stories, cleverly, kept showing how these tidy rules break down in messy real situations. What if obeying one human would harm another human? What if "harm" is unclear — like a small risk that prevents a bigger one? The rules sound clean in theory but get complicated fast in practice, which is exactly Asimov's point.

Why this matters right now, not just in the future

Today's robots and AI systems already have to make judgment calls — a self-driving car deciding how to react in a dangerous situation, for example. Engineers and ethicists now work together to try to build in safety principles, but Asimov's fiction from over 80 years ago already predicted the core challenge: writing rules that hold up cleanly in every messy, real-world situation is much harder than it sounds.

A question to think about

Can you think of a situation where Asimov's first rule (never let a human come to harm) might conflict with itself — where protecting one person could mean risking another?