Designed for evil: How to make bad technologies better

Alexis Hiniker
Alexis Hiniker

Many of today’s technologies leave users feeling like they got lost in a time vortex — they resurface hours later with no memory of what just happened to them.

But it doesn’t have to be that way, according to Alexis Hiniker, an assistant professor at the University of Washington’s Information School.

That’s why she developed a new upper-level class that gives informatics majors a crash course on ethics. Then they can use these ideas to combat potentially problematic new technologies.

Through Designing for Evil, which is unique to the UW, Hiniker’s students have identified “emerging evils” and redesigned these technologies so that they are more likely to enhance — not detract from — users’ lives. They’ll present their findings in a May 23 mini-symposium from 1:45-3:15 p.m. in the Mary Gates Hall atrium.

Even well-intentioned designers will make mistakes, and when you create technologies that millions or even billions of people use, every design decision has far-reaching impact,” Hiniker said. “We want to better prepare our students to design products with a more robust definition of what it means to do the right thing. That goes beyond thinking: ‘I would like using this.'”

Hiniker divided her course into two sections. In the first half, the students surveyed a variety of political philosophies, like consequentialism and deontology, to learn about moral reasoning and then translate it into building ethical technologies.During the second half, the students applied their knowledge to a variety of case studies, including artificial intelligence, surveillance technology and technology that’s designed to be addictive. For each topic, they discussed potential pitfalls and then practiced making better technologies.

“In our studio exercises, students worked through design challenges, like taking a particular ethical idea and using it to redesign Reddit,” Hiniker said.

In addition to the case studies, the students have been working in groups on their final projects. Each group has selected a technology, ranging from the seemingly benign WebMD website to the potentially sketchy social credit score that China’s rolling out.

“The first goal of the project is to scare people: Hey! You haven’t thought about how bad this is and it’s already happening,” Hiniker said. “And then the second goal is show people that we can take that scary thing and redesign it in a way that’s grounded in both philosophy and user input. Then you can do a lot better.”

Hiniker hopes that the class will help her students think more about the bigger picture as they enter the tech industry after graduation.

“We need to design technology so that people can access its value without opening a Pandora’s box that they can’t control,” she said. “And if you want to shift the design approach, you need to understand what it is you want to stand up for and why. Otherwise it’s really easy for the status quo to win.”

This story was originally published by UW News.