89
Usability testing Anywhere Ballot: before & after University of Baltimore Drew Davies Dana Chisnell Kathryn Summers Megan McKeever

Anywhere Ballot iterations

Embed Size (px)

DESCRIPTION

For a talk I gave with Whitney Quesenbery at EVN 2013 in Atlanta, GA.

Citation preview

Page 1: Anywhere Ballot iterations

Usability testing Anywhere Ballot:before & after

University of BaltimoreDrew DaviesDana ChisnellKathryn SummersMegan McKeever

Page 2: Anywhere Ballot iterations

PremiseEveryone should vote on the same ballot

Page 3: Anywhere Ballot iterations

BackgroundAVTI workshops in 2012

Page 4: Anywhere Ballot iterations

How might we design an accessible election experience for everyone?Open IDEOAVTI workshops in 2012

Page 5: Anywhere Ballot iterations

What if you could vote anywhere, any time, on any device?

Page 6: Anywhere Ballot iterations

Effective Designs for the Administration of Elections, 2007

Design for Democracy

Page 7: Anywhere Ballot iterations

NIST IR 7556 Report: Language of Instructions on Ballots, 2008

Redish, Chisnell, Newby, Laskowski, & Lowry

Page 8: Anywhere Ballot iterations

NIST medium complexity ballotmodified, slightly18 pages

Page 9: Anywhere Ballot iterations

Paper prototype18 participants4 days16 versions

Page 10: Anywhere Ballot iterations

Digital prototype15 participants3 days3-4 versions

Page 11: Anywhere Ballot iterations

Iteration 1

Page 12: Anywhere Ballot iterations

Iteration 3

Page 13: Anywhere Ballot iterations

Instructions to voters

Page 14: Anywhere Ballot iterations

Iteration 1

Page 15: Anywhere Ballot iterations

Help version, paper final

Page 16: Anywhere Ballot iterations

QuickTime™ and aPhoto - JPEG decompressor

are needed to see this picture.

How to vote, final digital

Page 17: Anywhere Ballot iterations

Straight party voting

Page 18: Anywhere Ballot iterations

Iteration 1

Page 19: Anywhere Ballot iterations

Iteration 5

Page 20: Anywhere Ballot iterations

QuickTime™ and aPhoto - JPEG decompressor

are needed to see this picture.

Final digital

Page 21: Anywhere Ballot iterations

Vote for 1

Page 22: Anywhere Ballot iterations

Iteration 1, selected state

Page 23: Anywhere Ballot iterations

Iteration 4

Page 24: Anywhere Ballot iterations

QuickTime™ and aPhoto - JPEG decompressor

are needed to see this picture.

Final digital

Page 25: Anywhere Ballot iterations

Supplemental content, iteration 1

Page 26: Anywhere Ballot iterations

Supplemental content, iteration 1

Page 27: Anywhere Ballot iterations

Supplemental content, iteration 1

Page 28: Anywhere Ballot iterations

Supplemental content, iteration 2

Page 29: Anywhere Ballot iterations

Supplemental content, iteration 2

Page 30: Anywhere Ballot iterations

QuickTime™ and aPhoto - JPEG decompressor

are needed to see this picture.

Supplemental content, digital final

Page 31: Anywhere Ballot iterations

Multi-candidate contests

Page 32: Anywhere Ballot iterations

Iteration 1

Page 33: Anywhere Ballot iterations

Iteration 1, selected state

Page 34: Anywhere Ballot iterations

Iteration 4

Page 35: Anywhere Ballot iterations

Iteration 4, scrolled

Page 36: Anywhere Ballot iterations

QuickTime™ and aPhoto - JPEG decompressor

are needed to see this picture.

Digital final

Page 37: Anywhere Ballot iterations

Judge retention contests

Page 38: Anywhere Ballot iterations

Iteration 1

Page 39: Anywhere Ballot iterations

Iteration 3

Page 40: Anywhere Ballot iterations

QuickTime™ and aPhoto - JPEG decompressor

are needed to see this picture.

Digital final

Page 41: Anywhere Ballot iterations

Referenda

Page 42: Anywhere Ballot iterations

Iteration 1

Page 43: Anywhere Ballot iterations

Iteration 4

Page 44: Anywhere Ballot iterations

QuickTime™ and aPhoto - JPEG decompressor

are needed to see this picture.

Digital final

Page 45: Anywhere Ballot iterations

Ballot measures

Page 46: Anywhere Ballot iterations

Iteration 1

Page 47: Anywhere Ballot iterations

Iteration 4

Page 48: Anywhere Ballot iterations

QuickTime™ and aPhoto - JPEG decompressor

are needed to see this picture.

Digital final

Page 49: Anywhere Ballot iterations

Write-ins

Page 50: Anywhere Ballot iterations

Iteration 1

Page 51: Anywhere Ballot iterations

Iteration 1

Page 52: Anywhere Ballot iterations

Iteration 2

Page 53: Anywhere Ballot iterations

Iteration 2

Page 54: Anywhere Ballot iterations

Supplemental content, iteration 1

Page 55: Anywhere Ballot iterations

QuickTime™ and aPhoto - JPEG decompressor

are needed to see this picture.

Digital final

Page 56: Anywhere Ballot iterations

Reviewing votes

Page 57: Anywhere Ballot iterations

Iteration 1

Page 58: Anywhere Ballot iterations

Iteration 1, scrolled down (page 2)

Page 59: Anywhere Ballot iterations

Iteration 1, scrolled down (page 3)

Page 60: Anywhere Ballot iterations

Iteration 1, scrolled to the end

Page 61: Anywhere Ballot iterations

Iteration 4, scrolled down (page 2)

Page 62: Anywhere Ballot iterations

Iteration 4, scrolled down (page 3)

Page 63: Anywhere Ballot iterations

Supplemental content, iteration 1

Page 64: Anywhere Ballot iterations

QuickTime™ and aPhoto - JPEG decompressor

are needed to see this picture.

Digital final

Page 65: Anywhere Ballot iterations

QuickTime™ and aPhoto - JPEG decompressor

are needed to see this picture.

Digital final

Page 66: Anywhere Ballot iterations

QuickTime™ and aPhoto - JPEG decompressor

are needed to see this picture.

Digital final

Page 67: Anywhere Ballot iterations

Changing a vote

Page 68: Anywhere Ballot iterations

Iteration 1

Page 69: Anywhere Ballot iterations

Iteration 2

Page 70: Anywhere Ballot iterations

Iteration 3

Page 71: Anywhere Ballot iterations

Iteration 4

Page 72: Anywhere Ballot iterations

QuickTime™ and aPhoto - JPEG decompressor

are needed to see this picture.

Changing votes, digital iteration 1

Page 73: Anywhere Ballot iterations

QuickTime™ and aPhoto - JPEG decompressor

are needed to see this picture.

Changing votes, digital iteration 2

Page 74: Anywhere Ballot iterations

QuickTime™ and aPhoto - JPEG decompressor

are needed to see this picture.

Changing votes, digital final

Page 75: Anywhere Ballot iterations

Casting the vote

Page 76: Anywhere Ballot iterations

Iteration 1

Page 77: Anywhere Ballot iterations

Iteration 2

Page 78: Anywhere Ballot iterations

QuickTime™ and aPhoto - JPEG decompressor

are needed to see this picture.

Digital final

Page 79: Anywhere Ballot iterations

Iteration 1

Page 80: Anywhere Ballot iterations

Iteration 2

Page 81: Anywhere Ballot iterations

Digital final

Page 82: Anywhere Ballot iterations

2 prototypes33 participants7 days20+ versions

Page 83: Anywhere Ballot iterations

Responsivegood for devicesgood for UOCAVAgood for accessibility standards

Page 84: Anywhere Ballot iterations

Prevents user errors

error managementtyped write-inhelps voters see impact of straight-party voting

Page 85: Anywhere Ballot iterations

Focuses on ballot marking

connect to any EMSoutput in an appropriate format

Page 86: Anywhere Ballot iterations

Can run on COTS devices

more accessible (own pointer, own screen reader)software independent

Page 87: Anywhere Ballot iterations

Not “voting over the Internet”

assume appropriate election systemcan produce printed ballot to castlogic is local (no trips to the server)

Page 88: Anywhere Ballot iterations

Anywhere ballotdesigned to be responsive to different formatsworks on any deviceaccessible for voters with disabilities

Page 89: Anywhere Ballot iterations

How can it be part of a secure, verifiable election system?

Who will it help? How will it help them? What voter need does it meet?