Democracy is a design problem

Democracy is a design problemHow changes in design change the outcome of elections

Dana Chisnell

1

Democracy is a design problem

Design affects world peace.

Why voting is harder than it seems

8

Legislation9

Voting

10

Systems

Costs

In Maryland, cost per voter increased by 179% going from paper-based systems to touchscreens

11

Costs

Paper has costs, too

printing

postage

storage

12

History13

Skills14

There are 3,247 counties (or equivalent) in the US

Secretaries of state issue ballot templates

Counties design, print, and distribute ballots

There are many more elections every year than you realize

15

Voting is still hard

16

17

Poor ballot design

frustrates voters

undermines confidence

contributes to Election Day problems

18

All voters are affected

thousands of votes are lost or miscast

all voting technologies are affected

greater risk for some groups of voters

19

Instructions

Contests

Questions

splitting contests into different columns

placing different contests on the same screen

placing response options on both sides of names

using arrows rather than bubbles on paper ballots

leaving in disqualified candidates

20

Classic problems

Better Ballots: Re-designed Ballot, Kewaunee County

Keep contests in same column

Better Ballots: Sarasota County, FL (2006)



inconsistency in format and style

not using shading, bold text

not writing short, simple instructions

placing instructions too far away

not telling voters how to correct paper ballots

25

Classic problems

Better Ballots: Los Angeles County

Format consistently

Top 10 design principles

27

Use lowercase letters

Avoid centered text

Pick one sans-serif font

Use big enough type

Support process and navigation

Use clear, simple language

Use accurate instructional illustrations

Use informational icons (only)

Use contrast and color functionally

Decide what’s most important

Before and after

28

Cedar County: May 2006 for ES&S optical scanners

Cedar County: November 2006 for ES&S optical scanners

TEST BALLOTGENERAL ELECTIONNOVEMBER 4, 2008

MARIN COUNTY, CALIFORNIAINSTRUCTIONS TO VOTERS:• Use only the marking pen provided, or a ball-point pen with black ink.• To vote for a candidate, completely blacken the oval next to your choice, like this . Do not vote for more than the

number of candidates to be elected.• When there are two (2) or more candidates to be elected for the same office, blacken the ovals next to each of your choices.• To vote on a measure, blacken the oval next to the word YES or next to the word NO.• Write-in candidates: To vote for a qualified write-in candidate, blacken the oval next to the blank line for the office and write

the name of the person on the line. Do not vote for both a write-in candidate and a candidate whose name is on the ballot for the same office.

• All distingushing marks on the ballot are forbidden and void the ballot.• If you make a mistake, tear your ballot, or want to change your vote, return it to the election official and obtain another.

VOTE ON BOTH SIDES OF BALLOT

FEDERAL

BOB BARR WAYNE A. ROOT

Libertarian

JOHN MCCAIN SARAH PALIN

Republican

CYNTHIA MCKINNEY ROSA CLEMENTE

Green

ALAN KEYES WILEY S. DRAKE, SR.

American Independent

RALPH NADER MATT GONZALEZ

Peace And Freedom

BARACK OBAMA JOE BIDEN

Democratic

PRESIDENT AND VICE PRESIDENTVote for One Party (1)

JOEL R. SMOLEN Registered Investment Advisor

Libertarian

MIKE HALLIWELL College Professor

Republican

LYNN WOOLSEY U.S. Representative

Democratic

UNITED STATES REPRESENTATIVE, 6TH DISTRICT

Vote for One (1)

STATE

MARK LENO California State Legislator

Democratic

SASHI MCENTEE Small Business Consultant

Republican

STATE SENATOR, 3RD DISTRICTVote for One (1)

PAUL LAVERY Businessman/Father

Republican

JARED HUFFMAN Incumbent

Democratic

TIMOTHY J. HANNAN Attorney/Mediator/Arbitrator

Libertarian

MEMBER OF THE STATE ASSEMBLY,6TH DISTRICT

Vote for One (1)

DISTRICT

ARCHIMEDES RAMIREZ NeurosurgeonPETER CHRISTIAN ROMANOWSKY Minister/Entertainer/ArtistHARRIS (HANK) SIMMONDS Retired PhysicianSHARON J. JACKSON IncumbentFRANK PARNELL Physician/Businessman

MARIN HEALTHCARE DISTRICT, DIRECTOR

Vote for no more than Two (2)

MEASURES SUBMITTEDTO THE VOTERS

STATE

YES NO

PROPOSITION 2: STANDARDS FOR CONFINING FARM ANIMALS. INITIATIVE STATUTE. Requires that certain farm animals be allowed, for the majority of every day, to fully extend their limbs or wings, lie down, stand up and turn around. Limited exceptions apply. Fiscal Impact: Potential unknown decrease in state and local tax revenues from farm businesses, possibly in the range of several million dollars annually. Potential minor local and state enforcement and prosecution costs, partly offset by increased fine revenue.

YES NO

PROPOSITION 1A: SAFE, RELIABLE HIGH-SPEED PASSENGER TRAIN. To provide Californians a safe, convenient, affordable, and reliable alternative to driving and high gas prices; to provide good-paying jobs and improve California’s economy while reducing air pollution, global warming greenhouse gases, and our dependence on foreign oil, shall $9.95 billion in bonds be issued to establish a clean, efficient high-speed train service linking southern California, the Sacramento/San Joaquin Valley, and the San Francisco Bay Area, with at least 90 percent of bond funds subject to independent audits? Fiscal Impact: State costs of $19.4 billion, assuming 30 years to pay both principal and interest costs of the bonds. Payments would average about $647 million per year. When constructed, unknown operation and maintenance costs, probably over $1 billion annually; at least partially, and potentially fully, offset by passenger fares.

YES NO

PROPOSITION 3: CHILDREN’S HOSPITAL BOND ACT. GRANT PROGRAM. INITIATIVE STATUTE.Authorizes $980,000,000 in general obligation bonds for construction, expansion, remodeling, renovation, furnishing and equipping of eligible children’s hospitals. Fiscal Impact: State cost of about $2 billion over 30 years to pay off both the principal ($980 million) and interest ($933 million) costs of the bonds. Payments of about $64 million per year.

YES NO

PROPOSITION 4: WAITING PERIOD AND PARENTAL NOTIFICATION BEFORE TERMINATION OF MINOR’S PREGNANCY. INITIATIVE CONSTITUTIONAL AMENDMENT. Changes California Constitution, prohibiting abortion for unemancipated minor until 48 hours after physician notifies minor’s parent, legal guardian, or, in limited cases, substitute adult relative. Provides an exception for medical emergency or parental waiver. Fiscal Impact: Potential unknown net state costs of several million dollars annually for health and social services programs, court administration, and state health agency administration combined.

YES NO

PROPOSITION 5: NONVIOLENT DRUG OFFENSES. SENTENCING, PAROLE AND REHABILITATION. INITIATIVE STATUTE. Allocates $460,000,000 annually to improve and expand treatment programs. Limits court authority to incarcerate offenders who commit certain drug crimes, break drug treatment rules or violate parole. Fiscal Impact: Increased state costs potentially exceeding $1 billion annually primarily for expansion of offender treatment programs. State savings potentially exceeding $1 billion annually on corrections operations. Net one-time state prison capital outlay savings potentially exceeding $2.5 billion.

FRONT Card 1 RptPct 1001-1100 "0001100" FOR PROOF ONLY 08/29/08 12:41:52

NOVEMBER 4, 2008MARIN COUNTY, CALIFORNIA

INSTRUCTIONS TO VOTERS:• Use only the marking pen provided or a ball point pen with black ink.

• To vote for a candidate, completely blacken the oval to the left of the name, like this . Where two or more candidates for the same office are to be elected, blacken the oval to the left of each of your choices.

• To vote on a measure, completely blacken the oval next to YES or NO.

• To vote for a qualified write-in candidate, completely blacken the oval next to the blank line for that office and write the name of the person on the line.

• If you make a mistake, damage your ballot, or you want to change a vote, take your ballot to an election worker and get another. All distinguishing marks are forbidden and void the ballot.

FEDERAL

BOB BARR WAYNE A. ROOT

Libertarian

JOHN MCCAIN SARAH PALIN

Republican

CYNTHIA MCKINNEY ROSA CLEMENTE

Green

ALAN KEYES WILEY S. DRAKE, SR.

American Independent

RALPH NADER MATT GONZALEZ

Peace And Freedom

BARACK OBAMA JOE BIDEN

Democratic

PRESIDENT AND VICE PRESIDENTVote for One Party (1)

JOEL R. SMOLEN Registered Investment Advisor

Libertarian

MIKE HALLIWELL College Professor

Republican

UNITED STATES REPRESENTATIVE, 6TH DISTRICT

Vote for One (1)

DISTRICT

ARCHIMEDES RAMIREZ NeurosurgeonPETER CHRISTIAN ROMANOWSKY Minister/Entertainer/ArtistHARRIS (HANK) SIMMONDS Retired PhysicianSHARON J. JACKSON IncumbentFRANK PARNELL Physician/Businessman

MARIN HEALTHCARE DISTRICT, DIRECTOR

Vote for no more than Two (2)

MEASURES SUBMITTEDTO THE VOTERS

STATEPROPOSITION 1A: SAFE, RELIABLE HIGH-SPEED PASSENGER TRAIN BOND ACT.

PROPOSITION 3: CHILDREN’S HOSPITAL BOND ACT. GRANT PROGRAM. INITIATIVE STATUTE.Authorizes $980,000,000 in general obligation bonds for construction, expansion, remodeling, renovation, furnishing and equipping of eligible children’s hospitals.Fiscal Impact: State cost of about $2

YES NO

PROPOSITION 2: STANDARDS FOR CONFINING FARM ANIMALS. INITIATIVE STATUTE. Requires that certain farm animals be allowed, for the majority of every day, to fully extend their limbs or wings, lie down, stand up and turn around. Limited exceptions apply.Fiscal Impact: Potential unknown decrease in state and local tax revenues from farm businesses, possibly in the range of several million dollars annually. Potential minor local and state enforcement and prosecution costs, partly offset by increased fine revenue.

ProgressLessons from crises

Sarasota

34

No testing = lost votesKing Co. 2009 undervotes were disproportionate to other counties

resulted in legislation about ballot design

35

Ensuring franchiseMinnesota SoS tests vote-by-mail after 2008 senate recounts

Before

Ensuring franchiseMinnesota SoS tests vote-by-mail after 2008 senate recounts

After

DEMONSTRATION BALLOTSAMPLE BALLOT FOR THE GENERAL ELECTION - City of New York - County of Kings - November 2, 2010

1. BEFORE VOTING THIS BALLOT, PLEASE READ THE INSTRUCTIONS ON THE OTHER SIDE OF THIS BALLOT.

1. ANTES DE EMITIR SU VOTO CON ESTA PAPELETA, SÍRVASE LEER LAS INSTRUCCIONES EN EL DORSO DE ESTA PAPELETA.

2. BALLOT PROPOSALS ARE LOCATED ON THE OTHE SIDE OF THIS BALLOT.

2. LAS PROPUESTAS DE PAPELETA APARECEN EN EL DORO DE ESTA PAPELETA.

MARKINGINSTRUCTIONS:INSTRUCCIONESDE MARCADO:

Correct Mark:Marca Correcta:

[Insert Chinese Translation][Insert Korean Translation]

Electors forGovernor and

LieutenantGovernor

[Spanish]

[Chinese]

[Korean]

Vote OnceVote una vez

[Chinese][Korean]

Comptroller[Spanish][Chinese][Korean]Vote Once

Vote una vez[Chinese][Korean]

Attorney General[Spanish][Chinese][Korean]Vote Once


United StatesSenator

[Spanish][Chinese][Korean]Vote Once


United StatesSenator



Supreme CourtJustice

[Spanish][Chinese][Korean]

Vote for any FIVE[Spanish][Chinese][Korean]

Representative inCongress[Spanish][Chinese][Korean]Vote Once


StateSenator



Member ofAssembly[Spanish][Chinese][Korean]Vote Once


1

2

3

4

5

6

7

8

9

10

11

12

13

1A 1B 1C 1D 1E 1F 1G 1H

1K 1J 1I

2A 2B 2C 2D 2E 2F 2G

3G3F3E3D3C3B3A

4I4K 4J

4G4F4E4D4C4B4A

5A 5B 5C 5D 5E 5F 5G

6E6D6C6B6A

7A 7B 7C 7D 7E

8E8D8C8B8A

9E9D9C9B9A

10D10C10B10A

13D13C13B13A

12C12B12A

11C11B11A

4H

WRITE-INCANDIDATO POR

ESCRITO

WRITE-IN

WRITE-IN

WRITE-IN

WRITE-IN

WRITE-IN

WRITE-IN

WRITE-IN

WRITE-IN

WRITE-IN

WRITE-IN

WRITE-IN

WRITE-IN

WRITE-IN

A B C D E F G H

K J I

A B C D E F G

A B C D E F G

A B C D E F G H

K J I

A B C D E F G

EDCBA

A B C

CBA

DCBA

Democratic[Chinese][Korean]









Republican[Chinese][Korean]

Independence[Chinese][Korean]

Conservative[Chinese][Korean]

Working Families[Chinese][Korean]

Green[Chinese][Korean]

Rent is 2 DamnHigh

[Chinese][Korean]

Libertarian[Chinese][Korean]

Taxpayers[Chinese][Korean]

Freedom[Chinese][Korean]

Anti-Prohibition[Chinese][Korean]












Freedom[Chinese][Korean]






Rent is 2 DamnHigh

[Chinese][Korean]


Tax Revolt[Chinese][Korean]

Taxpayers[Chinese][Korean]

Anti-Prohibition[Chinese][Korean]


















HAnti-Prohibition

[Chinese][Korean]

5H

HarryWilson[Chinese][Chinese][Korean][Korean]

Andrew M.Cuomo[Chinese][Chinese][Korean][Korean]

Carl P.Paladino

[Chinese][Chinese][Korean][Korean]


Carl P.Paladino



HowieHawkins


JimmyMcMillan


WarrenRedlich[Chinese][Chinese][Korean][Korean]

Carl P.Paladino


CharlesBarron[Chinese][Chinese][Korean][Korean]

Kristin M.Davis


Thomas P.DiNapoli




Thomas P.DiNapoli


Julia A.Willebrand


JohnGaetani[Chinese][Chinese][Korean][Korean]

Eric T.Schneiderman


BruceBlakeman


Eric T.Schneiderman


DanDonovan


Eric T.Schneiderman


Carl E.Person[Chinese][Chinese][Korean][Korean]

Ramon J.Jimenez


Kristen E.Gillibrand


Joseph J.DioGuardi




Joseph J.DioGuardi




Cecile A.Lawrence


JosephHuff


JohnClifton[Chinese][Chinese][Korean][Korean]

DanDonovan


Joseph J.DioGuardi


VivaMorgan[Chinese][Chinese][Korean][Korean]

Charles E.Schumer


Eugene M.Fahey


Charles E.Schumer


JayTownsend


Charles E.Schumer


ColiaClark


Randy A.Credico[Chinese][Chinese][Korean][Korean]

Randy A.Credico[Chinese][Chinese][Korean][Korean]

Kevin M.Dillon


Cheryl A.Green


Kevin M.Dillon


Kevin M.Dillon


Kevin M.Dillon


Eugene M.Fahey


Mark C.Rodgers


Eugene M.Fahey


JayTownsend


Eugene M.Fahey


Mark A.Montour


Deborah A.Chimes[Chinese][Chinese][Korean][Korean]

Mark A.Montour


Deborah A.Chimes[Chinese][Chinese][Korean][Korean]

Cathrine NugentPanepinto


Nydia M.Velazquez


Nydia M.Velazquez


Henry J.Nowak[Chinese][Chinese][Korean][Korean]

AliceGaffney[Chinese][Chinese][Korean][Korean]

Paul B.Wojtaszek



Paul B.Wojtaszek




Jeffrey F.Voelkl







Daniel L.Squadron


Joseph A.Nardiello


Daniel L.Squadron


John L.Millman[Chinese][Chinese][Korean][Korean]

John A.Jasilli, Jr.


John A.Jasilli, Jr.


John L.Millman[Chinese][Chinese][Korean][Korean]

Robert J.Duffy


Gregory J.Edwards


Robert J.Duffy


Gregory J.Edwards


Robert J.Duffy


GloriaMattera[Chinese][Chinese][Korean][Korean]

AldenLink


Gregory J.Edwards


Eva M.Doyle


TanyaGendelman


RDH

RDH

�

�

✺

✺

a

a

a

:;

New York sued for usability problemsTestingTraining

38

39

Return'your'ballot'Get$your$ballot$back$to$correct$it.$Ask$a$poll$worker$for$a$new$one.$

Ignore'message.'Cast'ballot'Ignore$this$message$and$cast$your$ballot$with$votes$that$will$not$count.$

You'filled'in'too'many'ovals'in'3'contests.'These'votes'will'not'count:'

03/08/2011$03:47:00pm$

Return'Ballot' Cast'

40

Recommended

Unsettled

Election Assistance Commission and National Institute of Standards and Technology Voluntary Voting System Guidelines - VVSG 2.5

Research and standards

42

Brennan Center

Design for Democracy

Research commissioned by NIST, bookfunded by Kickstarter

SOP and Usability and Civic Life Project, bookfunded by Kickstarter

Research commissioned by NIST, bookfunded by Kickstarter

Research commissioned by EAC, bookfunded by Kickstarter

Field Guides series

Research sponsored by John D. & Catherine T. MacArthur Foundation

Research sponsored by John D. & Catherine T. MacArthur Foundation

Coming soon

Effective election department web sites

Delivering useful voter education

Effective design for vote-by-mail

Funding yet to be secured

Designing multi-language ballots

Funding yet to be secured

Field Guides To Ensuring Voter Intent

civicdesigning.org/fieldguides

Be an election worker

Observe elections

47

HUGE PROJECT on poll worker security!

We need participants everywhere

Volunteer to proofread

Use the accessible

system

49http://trace.wisc.edu/voting/

Join our projects

AIGA Design for Democracy

UPA Usability in Civic Life

Epilogue

51

Why can’t I vote on the internet?Secrecy

Error tolerance

Security

Disagreement about the level of risk

52

53

Why aren’t all voters using the same voting system?

The 10th AmendmentIt’s a states rights issue.

54

[email protected]

www.usabilityworks.net 415.519.1148

@danachis

Dana Chisnell