How humans judge machines

Sign up for our newsletter, Artificiality, to get our latest AI insights delivered directly to your email inbox.

As AI diffuses through everything and deployed on a micro scale with multiple, small interactions, understanding how humans judge machine decisions before systems are designed will be an important skill and step in the process.

Humans judge machines according to a simple principle:

People judge humans by their intentionsPeople judge machines by their consequences

The implications of this principle are far reaching. It means that people using AI need to be able to intuit the human intent behind it. It means that humans are forgiven for mistakes, as long as their intentions are good, while machines are not forgiven if a decision results in an unfair outcome, even if this outcome was accepted as possible right from the outset.

Because humans attribute agency (and therefore, a degree of intent) to anything that is "active," mental models of how people understand the intent of the machine and the humans behind it are just as important as anticipating consequences.

For AI de...

- - - - -


The rest of this post is available for our Pro Members. Please login if you're a member. And, if you're not, subscribe now to get access to all of our Pro Member content!

Subscribe here.

Email us with any questions.



About Sonder Scheme: We are on a mission to help humans win in the age of AI by making AI design easier, more inclusive, more ethical and more human. Through our workshops, learning journeys and the Sonder Scheme Studio, we enable people to use design thinking-based tools to create innovative, effective and ethical human-machine systems. Both offline and online, Sonder Scheme empowers companies around the world to design human-centered AI.

Share on email
Share on facebook
Share on linkedin
Share on twitter