89
Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for Information Technology Policy Princeton University

Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

  • Upload
    others

  • View
    3

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

Machine Learning Meets Public Policy

Edward W. FeltenKahn Professor of Computer Science and Public Affairs

Director, Center for Information Technology PolicyPrinceton University

Page 2: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for
Page 3: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for
Page 4: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for
Page 5: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for
Page 6: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for
Page 7: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

"AI is probably the most important thing humanity has ever worked on. I think of it as something more profound than electricity or fire.”

Sundar Pichai, Google CEO24 Jan 2018

7

Page 8: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

People who are affected by AI/MLdeserve some say in how it is used.

Page 9: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

Decisions will be made.What is our role in the decisions?

Page 10: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for
Page 11: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for
Page 12: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for
Page 13: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for
Page 14: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for
Page 15: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for
Page 16: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

Truth

Page 17: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

Truth

Page 18: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for
Page 19: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

Politics is not a search for truth.

Page 20: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

a feature, not a bug

Page 21: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

Democracy is not a search for truth.

Page 22: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

an algorithm for resolving disagreements

Page 23: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

no question is undecidable

Page 24: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

all questions are decidable in O(1) time

Page 25: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

no need to decide underlying facts

Page 26: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

no need for a coherent explanation

Page 27: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

and yet …

Page 28: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

individual legislators seem

Page 29: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

individual legislators seem

logically inconsistent

Page 30: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

individual legislators seem

logically inconsistent

indifferent to truth

Page 31: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

Politicians behave that way for a reason.

Page 32: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

Consider the following model …

Page 33: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

P = universe of proposals = {p0, p1, p2, …}

Assume proposals are independent.

A bill is a subset of P.

Page 34: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

Voter vi supports proposal pj iff Ui(pj) > 0

Voter i has utility function Ui(.)

Define: pj passes iffmajority of voters support pj

Page 35: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

Given two disjoint bills B1, B2:

Ui(B1 U B2) = Ui(B1) + Ui(B2)

Assumption:

Page 36: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

Given two disjoint bills B1, B2:

If Vi supports B1 and Vi supports B2,Then Vi supports B1 U B2

Corollary:

Page 37: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

Given two disjoint bills B1, B2:

If B1 passes and B2 passes,Then B1 U B2 passes

Theorem:

Page 38: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

Given two disjoint bills B1, B2:

If B1 passes and B2 passes,Then B1 U B2 passes

Non-Theorem:

Page 39: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

Voter B1 B2 B1 U B2

Alice 1 -2 -1

Bob -2 1 -1

Charlie 1 1 2

Page 40: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

outputs not logically consistent

Page 41: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

Let’s generalize the model …

Page 42: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

partition voters into districts

Page 43: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

partition voters into districts

legislature: one rep per district

Page 44: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

partition voters into districts

legislature: one rep per district

rep supports B iffmajority of constituents support B

Page 45: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

implications

Page 46: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

legislator not logically consistent

Page 47: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

legislator not logically consistent

supports B1, supports B2

Page 48: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

legislator not logically consistent

supports B1, supports B2

might not support B1 U B2

Page 49: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

legislator doesn’t care about the facts

Page 50: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

individual legislators seem

logically inconsistent

indifferent to truth

Page 51: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

legislative strategy

Page 52: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

Consider the following problem…

Page 53: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

Given:bill Bamendments A1, …, An

(mutually disjoint)

Amendment Problem

Can you add a subset of the Ai to B, to make an amended proposal that will pass?

Page 54: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

Given:bill Bamendments A1, …, An

(mutually disjoint)

Amendment Problem

Can you add a subset of the Ai to B, to make an amended proposal that will pass?

NP-complete!

Page 55: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

Ted Stevens

Nobody knew this could be so complicated.

Page 56: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

real world: even more complicated

Page 57: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

voters not self-consistent

Page 58: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

legislators make deals

Page 59: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

administrative agencies

Page 60: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

indirectly accountable to voters

Page 61: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

locally, system will look irrational

Page 62: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

It’s complicated.

Page 63: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

what to do?

Page 64: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

“It’s not okay to not know how the Internet works.”

Page 65: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

“It’s not okay to not know how government works.”

Page 66: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

good decisions

Page 67: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for
Page 68: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for
Page 69: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for
Page 70: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

just the facts

Page 71: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for
Page 72: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for
Page 73: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

dictate the decision

Page 74: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for
Page 75: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

Who elected you?

Page 76: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

download your brain

Page 77: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

be useful

Page 78: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

your knowledge+

their preferences

Page 79: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

your knowledge+

their knowledge and preferences

Page 80: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

get their knowledge and preferences

structure the decision space

Page 81: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

KnowledgeKnowledgePreferences

Page 82: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

engagement over time

mutual trust

Page 83: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

role of our community

Page 84: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

need boots on the ground

Page 85: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

create a career path

Page 86: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

build incentives

Page 87: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

This is important!

Page 88: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

We need to be in the room.

Page 89: Machine Learning Meets Public Policy - NeurIPS · Machine Learning Meets Public Policy Edward W. Felten Kahn Professor of Computer Science and Public Affairs Director, Center for

Machine Learning Meets Public Policy

Edward W. FeltenKahn Professor of Computer Science and Public Affairs

Director, Center for Information Technology PolicyPrinceton University