86
Hackin’ on Government

Open Government: An Overview

Embed Size (px)

DESCRIPTION

We know that the Internet can be used to donate to political candidates. Or make fun of them. But, with a little help from citizens, it can also make government work better. First, we’ll look at a handful of sites that aggregate government data and present it in useful ways. Then we’ll explore the process of distilling government data dumps and APIs to build our own sites.

Citation preview

Page 1: Open Government: An Overview

Hackin’ onGovernment

Page 2: Open Government: An Overview

“How can the webmake government

better?”

Page 3: Open Government: An Overview

…what does “better”mean?

Page 4: Open Government: An Overview

My definition:

Page 5: Open Government: An Overview

More transparency

Page 6: Open Government: An Overview

Shorter feedback loops

Page 7: Open Government: An Overview

Better identificationof signal

within the noise

Page 8: Open Government: An Overview

What has the politicalblogosphere (ugh)

already donefor politics?

Page 9: Open Government: An Overview

What suitsthe web

to politics?

Page 10: Open Government: An Overview

It’s great at archiving

Page 11: Open Government: An Overview

It’s easy to reach

Page 12: Open Government: An Overview

It can supportgreater depth

Page 13: Open Government: An Overview

Examples:

Page 14: Open Government: An Overview

FactCheck.org

Page 15: Open Government: An Overview

PolitiFact: Truth-O-Meter

Page 16: Open Government: An Overview

PolitiFact: The Obameter

Page 17: Open Government: An Overview
Page 18: Open Government: An Overview

OpenCongress

Page 19: Open Government: An Overview

Full text of bills(comment on individual paragraphs!)

Page 20: Open Government: An Overview

The world ofgovernment

can accommodatemore developers

Page 21: Open Government: An Overview

Open-source softwareadvocates

will feel at home with theideals

Page 22: Open Government: An Overview

The public sector doesn’t havethe talent or resources

to do it themselves

Page 23: Open Government: An Overview

You don’t need anyone’spermission

Page 24: Open Government: An Overview

So how do Ibuild my own?

Page 25: Open Government: An Overview

Getting data

Page 26: Open Government: An Overview

A vast amountof government data

is available…

Page 27: Open Government: An Overview

…but it’s sloppy

Page 28: Open Government: An Overview

THOMAS

Page 29: Open Government: An Overview

Enter GovTrack

Page 30: Open Government: An Overview

http://govtrack.us

Page 31: Open Government: An Overview

Makescongressional datamachine-readable

Page 32: Open Government: An Overview

XML data dumps

Page 33: Open Government: An Overview

open-sourceand

non-profit

Page 34: Open Government: An Overview

Sunlight Foundation

Page 35: Open Government: An Overview

Sunlight Labs

Page 36: Open Government: An Overview

Case study:

Page 37: Open Government: An Overview

Filibusted http://filibusted.us

Page 38: Open Government: An Overview

The U.S. Senate allowsfor a stall tactic

called the filibuster

Page 39: Open Government: An Overview

To end a filibuster,you need a successful

cloture vote

Page 40: Open Government: An Overview

The number of cloture votesis on a major upswing

in recent decades…

Page 41: Open Government: An Overview

…reflecting increasing useof the filibuster

Page 42: Open Government: An Overview

Methodology:

Page 43: Open Government: An Overview

Keep a list of current senators(using Sunlight Labs’

Congressional Data API)

Page 44: Open Government: An Overview

Every night, check GovTrackfor new Senate votes

(http://www.govtrack.us/data/us/111/votes.all.index.xml)

Page 45: Open Government: An Overview

Any new cloture votes? If so…

Page 46: Open Government: An Overview

Get information about the billand how each senator voted

Page 47: Open Government: An Overview

Put it all on a page

Page 48: Open Government: An Overview

Tweet about it!

Page 49: Open Government: An Overview

Keep stats on senators

Page 50: Open Government: An Overview

Keep stats on the 111th Congress

Page 51: Open Government: An Overview

Present interesting data views

Page 52: Open Government: An Overview

Ingredients:

Page 53: Open Government: An Overview

Rails, a tiny database,and a bit of Ruby for parsing

XML.

Page 54: Open Government: An Overview

Read the code:https://github.com/savetheclocktower/filibusted

Page 55: Open Government: An Overview

Now it’s your turn

Page 56: Open Government: An Overview

Data sources:

Page 57: Open Government: An Overview

GovTrack data dumps:http://govtrack.us/data/

The Drumbone API:http://services.sunlightlabs.com/docs/Drumbone_API/

Page 58: Open Government: An Overview

OpenCongress API:http://www.opencongress.org/api

Legislator information,bill trends,

most-blogged-about items

Page 59: Open Government: An Overview

Sunlight Labs APIs:http://services.sunlightlabs.com/

Legislator information,campaign contributions,

state-by-state legislative data

Page 60: Open Government: An Overview

New York Times Congress API:http://developer.nytimes.com/docs/congress_api

Legislator information,nominees, bills, votes

Page 61: Open Government: An Overview

data.gov

Page 62: Open Government: An Overview

Launched in May 2009

Page 63: Open Government: An Overview

Drinking from the firehose

Page 64: Open Government: An Overview

What aboutstate government?

Page 65: Open Government: An Overview

The Open StateProject

http://openstates.sunlightlabs.com/

Page 66: Open Government: An Overview

Things to consider:

Page 67: Open Government: An Overview

Is it OK to havea point of view?

Page 68: Open Government: An Overview

(of course)

Page 69: Open Government: An Overview

Everyone has bias

Page 70: Open Government: An Overview

Data-based methodologycan defend againstaccusations of bias

Page 71: Open Government: An Overview

Your conclusionsmay be opinionated,

but the underlying data isn’t

Page 72: Open Government: An Overview

Argue in good faithand play devil’s advocate

Page 73: Open Government: An Overview

User participation?

Page 74: Open Government: An Overview

sure, but be careful of:

Page 75: Open Government: An Overview

1. spam

Page 76: Open Government: An Overview

(you'll get spammed,even if you rel='nofollow',

and even if you escape HTML)

Page 77: Open Government: An Overview

Use Akismetor something like it

Page 78: Open Government: An Overview

2. sampling bias

Page 79: Open Government: An Overview

Who visits web sites aboutgovernment?

Page 80: Open Government: An Overview

OpenCongress’s pagefor the HCR bill:

Page 81: Open Government: An Overview

Don’t use data from your usersto draw conclusions

about the general public

Page 82: Open Government: An Overview

3. vitriol

Page 83: Open Government: An Overview

anonymity + political passion =angry rhetoric

Page 84: Open Government: An Overview

About the HCR bill:

Page 85: Open Government: An Overview

Be tolerant, butknow what you’re in for

Page 86: Open Government: An Overview

“ Politics is a strongand slow boringof hard boards. ”

— Max Weber