25
Argentina’s Senate Expenses: Opening Public Data and Data Journalism

Senate expensesslideshare

  • Upload
    lndata

  • View
    7.415

  • Download
    1

Embed Size (px)

Citation preview

Page 1: Senate expensesslideshare

Argentina’s Senate Expenses:Opening Public Data and Data Journalism

Page 2: Senate expensesslideshare

1

4

3

Argentina´s Senate Site (www.senado.gov.ar) – Senate

Expenses

2

Page 3: Senate expensesslideshare

Site Descriptionwww.senado.gov.ar

The identified links are:

1. Procurement Tenders (1320 PDF’s)

2. Administrative decisions (14.205 PDF’s)

3. Accounting decisions (6.817 PDF’s)

4. Presidential Decrees (11.315 PDF’s)

TOTAL : 33.657

PDF’s

Feb 8, 2013

Page 4: Senate expensesslideshare

2) Processing Data - PDF’s Password Protected - Password Removal

Files are PDF´s generated from paper scanned documents….

But….. Password Protected PDF’s (against copy and printing).

So, before executing OCR process, we need to remove the Password

Protection.

Page 5: Senate expensesslideshare

3) Transforming Data - Run OCR 33.000 TXT documents

Page 6: Senate expensesslideshare

3) Transforming Data - OCR issues“Noisy” or unevenly scaned documents produce unpredictable results….

Page 7: Senate expensesslideshare

4) Processing Data I:Insert 33.000 TXT files in Excel worksheet, identifying entities, (persons and Companies),

amounts (money or bodyguards) and customizable Keywords) Analyze applying Filtering

Page 8: Senate expensesslideshare

Travel Expenses requested by the President of the Senate (Vicepresident of

Argentina), Mr. Amado Boudou, for 4 Security Agents for his trip to the United

States of America from 10/04/2012 to 10/05/2012.

$ 154.864,90 (~USD 35.000)

Who

When

What

Where

5) Identifying Patterns and Entities

How much

Page 9: Senate expensesslideshare

Security Agents expenses :

15

Agents

$49,737

6/18/2012-

6/21/2012

OCR mistakes

5) Identifying Patterns and Entities

Santa Fe

Page 10: Senate expensesslideshare

{

6) Processing Data II :Detecting dates interval, destination, number of security agents, and ammount of money

Page 11: Senate expensesslideshare

Journalistic Case : Show Service Company - Direct Purchases

Page 12: Senate expensesslideshare

1) Getting Data

Application to download

+ 33.000 Documents !!!

Page 13: Senate expensesslideshare

Senate’sPresident Decree

Page 14: Senate expensesslideshare

Senate Administration Department E.g

Page 15: Senate expensesslideshare

Senate Accountant Department E.g.

Page 16: Senate expensesslideshare

Senate Expensed StructuredDataset in Excel

Page 17: Senate expensesslideshare

Sunday Print editionand Infography

Page 18: Senate expensesslideshare

Sunday Print Editon infography

Page 19: Senate expensesslideshare

TABLEAU: filters per amount & destiny

Page 20: Senate expensesslideshare

IMPACT: VP takes to TV a stack of decrees in print

Page 21: Senate expensesslideshare

IMPACT: Judge reopens investigationon VP’s expenses

Page 22: Senate expensesslideshare
Page 23: Senate expensesslideshare

Interactive Gantt with overlapped orinexesistent trips reimboursed

Page 24: Senate expensesslideshare

Print Edition

Page 25: Senate expensesslideshare

Senate Expenses TAG gathersstories origitated in this database