AI should account for what humans want

Sign up for our newsletter, Artificiality, to get our latest AI insights delivered directly to your email inbox.

What makes us human not robots is the collective social knowledge that people build together. People want to be valued for their intuition, want to discover causality not just see patterns or correlations, want to connect with one another and share insights. Humans need agency. Humans will work around robots in order to have it. Design that fits human psychology takes account of a human’s motivation to find workarounds and do what a machine can’t do.

Suboptimal building of jobs can also block potential productivity gains from AI. Theoretically, if AI tasks and non-AI tasks are bundled, this could prevent specialization and lock up productivity gains. This is because workers will always choose to do something that AI cannot. There’s an opportunity cost of foregone potential non-AI (human) labor if the capital cost of AI is zero and firms give workers jobs where AI tasks and non-AI tasks are preset. That is, if there is no incentive or opportunity for humans to be creative and figure out what the AI can’t do as well and act accordingly, then the AI is also unable to be used to its best economic advantage.

If the AI is only used to replace humans, systems will become more precise over time but won’t allow for knowledge to evolve outside the algorithmic box. Conversely, when AI is used to nudge and augment human performance, there is no break in the link between doing and understanding.

The future of work is successful integration of both humans and machines. Humans will take responsibility for shaping how to tackle a problem or an opportunity; what data are needed, how to create the data, defining success, deciding on the acceptability of failure, designing what to do with outliers and responding when things go wrong.

The combination of human and machine intelligence is powerful — machines can help alert, nudge or correct a human and enhance people’s performance. But we have to account for the fact that humans need to feel a sense of control over machine interactions or risk either inefficiency, workarounds or rebellion.

About Sonder Scheme: We are on a mission to help humans win in the age of AI by making AI design easier, more inclusive, more ethical and more human. Through our workshops, learning journeys and the Sonder Scheme Studio, we enable people to use design thinking-based tools to create innovative, effective and ethical human-machine systems. Both offline and online, Sonder Scheme empowers companies around the world to design human-centered AI.

Share on email
Share on facebook
Share on linkedin
Share on twitter

1 thought on “AI should account for what humans want”

  1. Pingback: AI accuracy is confusing for most people — Sonder Scheme

Comments are closed.