Civic CrowdAnalytics: Making sense of crowdsourced civic input with big data tools

Preview:

Citation preview

Civic CrowdAnalytics:Making sense of crowdsourced civic input

with big data tools !!

Tanja Aitamurto Kaiping Chen Ahmed Cherif

Jorge Saldivar Galli Luis Santana

1!

2!

3!

Vote

Crowdsourcing ideas and solutions

for policy

4!

Crowdsourced urban planning strategy

5!

Hillary Gitelman, Urban planner, City of Palo Alto 6!

Piles of unstructured data

7!

Civic data overload

8!

Bottleneck in participatory channel

Citizens’ input

Policy

Lack of data analytics tools 9!

x!What if our votes were not counted?

10!

Civic CrowdAnalytics Web application for analyzing civic data with Natural Language Processing and machine

learning

Sentiment analysis; Find related concepts

Categorization

11!

12!

Dashboard

13!

Categorization

14!

Dig deeper

15!

Sentiment analysis

16!

Crowd’s impact on policy

Key findings

•  The more (categorization) and the stronger (sentiment analysis) the crowd’s demands are, the more likely to make it to the policy

•  CAC’ agenda reflects less the crowd’s suggestions than the policy

•  High frequency terms (concept occurrences) reflect the level of expertise in policymaking

17!

18!

Top key terms and occurrences(Subcategory: Big picture infrastructure)

Crowd’s input Cars (19), driving (16), road (12)

CAC input Development (16), traffic congestion(15), traffic safety (10)

Policy!

Traffic (22), improvement (14), safety (12)

From piles of unstructured data to structured results

19!

NLP for civic use !•  80% accuracy rate at best

•  Disproportionally laborious training for small datasets

•  Larger datasets for improved accuracy

•  Using the best of NLP for civic purposes

•  Training algorithms across cases à “Cross-training” crowdsourced policymaking efforts in several countries

20!

Open Government Partnership countries

Commitment for civic engagement and transparency

21!

Thank you! Questions, comments?

Dr. Tanja Aitamurto

tanjaa@stanford.edu

22!

Crowdsourced constitution in Chile

Over 30,000 submissions

23!

24!