KALEV LEETRAU Real Clear Media - olc.worldbank.org Global... · Geotagged Tweets 2012- 2018 GPS...

Preview:

Citation preview

KALEV LEETRAUReal Clear Media

GDELT: Mapping The Twitter Decahose By Language Nov 2012

GDELT: June 2015 Yemeni Scud Launch Through Tweets (Note Low Presence in Yemen)

Total Tweets 2012-2018 Distinct Users 2012-2018

Retweet Rate 2012-2018 Hashtag Density 2012-2018

Avg Account Age 2012-2018

Geotagged Tweets 2012-2018

GPS Geotagged Tweets 2012-2018 Bytes Per Day Unique Tweets 2012-2018

GDELT: CNN+MSNBC+FOX News (2009-2018) (Orange) vs BBC (2017-2018) (Blue)

GDELT: Mentions Of Each Country On US TV News 2009-2016

US Google Searches About Each Country In 2016 (Google Trends)

Global NewsThe GDELT Project: Seeing The World Through Data

Worldwide local print, broadcast and online news coverage in 100 languages (65 live translated) – online news preserved via Internet Archive

Human RightsBooksCollaboration with

Internet Archive and HathiTrust to process 3.5

million books1800-2015

Half century of worldwide human rights reports

American TV

Collaboration with the Internet Archive to process more than 100 television stations across the US,

updating daily

Global Imagery

Quarter billion global news images processed via deep learning

Academic Lit

21 billion words covering 70 years (JSTOR/DTIC/CORE/CITESEER/IA)

GDELT: Mapping Nigeria

GDELT: Culturomics 2.0, Correctly Predicting Bin Laden’s Location to 200km

GDELT: Geography Of GDELT 2015-2018

GDELT: Linguistic Geography Of GDELT 2015-2018

Blue = English (centered around major cities), Red = Arabic (much broader coverage)GDELT: English vs Arabic Coverage of Yemen

Physical Events Narratives/Emotions

GDELT: From Data To Psychohistory

GDELT Event Database GDELT Global Knowledge Graph (GKG) GDELT Global Visual Knowledge Graph

GDELT Global Frontpage Graph GDELT Global Difference Graph GDELT Summary

GDELT DOC & GEO & TV APIs GDELT TV-NGrams GDELT AI TV News Experiment

GDELT: Burundi Instability Score December 2015

GDELT: Refugee Migration

US Ebola News Coverage

Number American television news broadcasts per week mentioning "ebola"

• March 2014 WHO announcement

• First American infections• Eric Duncan arrives in Dallas

Average “tone” of English language media coverage of “ebola”

• Steady ascent towards more and more positive coverage as “Western medicine miracles to the rescue” theme dominates coverage

Physical Unrest

Anxiety

Positive/Negative: “Cautiously Optimistic” Trending

GDELT: Turkey

Positive/Negative Tone New York Times

Positive/Negative Tone BBC Monitoring

‘Us’ Vs ‘Them’ & The Post-Recession And ‘Mueller Moment’

‘Us’ Vs ‘Them’ On Twitter

Academic Literature (US Army CERL)• 21 billion words of academic literature, unclassified/declassified reports, and

dissertations on Africa and Middle East (JSTOR, DTIC, CIA, CORE, CiteSeerX, InternetArchive) 1945-present, Global Knowledge Graph

USGOV Academic Lit News Baseline

Food Security 1950-2014

Amnesty International 1960-2014

Cloud Vision API For Video

GDELT: Visual Topic Network From A Quarter Billion News Photos

GDELT: % Violent Imagery

GDELT: % Imagery With Human Face

Geolocation

GDELT: Global “Civilizations”

GDELT: “The Global Conversation” (Person Network Circa 2013)

GDELT: Mapping Influencers In Global Conversation of Carbon Capture & Sequestration (CCS)

Inference API + NLP API• Top Persons Linked With Robert Mueller

• Paul Manafort, Rod Rosenstein, William Barr, Rick Gates, Jerrold Nadler, James Comey, Don McGahn and Michael Cohen

• Top Persons Linked With Uber• Travis Kalanick, Dara Khosrowshahi, Garrett Camp, Elaine Herzberg, Anthony Levandowski

and Emil Michael• Top Companies With Elon Musk

• SpaceX, Tesla, Boring Company, SolarCity and Blue Origin• Top Locations With Elon Musk

• Hawthorne (the location of Boring Company's tunnel), Kennedy Space Center, Gigafactory, Cape Canaveral Air Force Station, Mars and the International Space Station

• Top Dates Associated With SpaceX• August 13, 2017 (Dragon ISS resupply mission press kit release prior to launch), February 6,

2018 (Falcon Heavy launch) and September 17, 2018 (announcement of first lunar mission passenger).

• Most Important People On March 24, 2019• William Barr, Robert Mueller, Jerrold Nadler and Rod Rosenstein

Global Wildlife Crime: February 19 – June 2, 2015

Global Climate Change Narratives Dataset

• 95,000 Television Mentions 2009-2020: CNN, MSNBC, Fox News, BBC• 4.1 Million Non-English Online Articles 2015-2020 In 63 Languages

• 6 Million Word Annotations• 6.3 Million English Articles 2015-2020 With 200 Character Snippets

select * from [CLIMATECHANGENARRATIVESDATASET] where Context like '%Trump%' and Context like '%Al Gore%' and (LOWER(Context) like '%met%' OR LOWER(Context) like '%meet%’)

"…U.S. President-elect Donald Trump on Monday met with former Vice President Al Gore, an environmental activist who has devoted years to fighting climate change, Gore told reporters. 'I had a lengthy and very productive session with the president-elect,' said Gore, who met earlier with Trump's daughter…"

select * from [CLIMATECHANGENARRATIVESDATASET] where Context like '%Australian%' and (Context like '%fires%' OR Context like '%fire%') and (LOWER(Context) like '%contribute%' OR LOWER(Context) like '%contributed%')

• CLEAR LINKAGE: "Richard Betts, a professor with the Met Office and the University of Exeter, said human-induced climate change and local weather patterns had contributed to the hot, dry weather that played a key role in the severity of the Australian bushfires" and "… Hemisphere's summer have contributed in recent years to an increase in fires in Australia, a situation that scientists say is due, in part, to global warming caused by climate change. On Dec. 23, an Australian court approved the payment of an indemnity of more than $400 million for people whose…“

• GOVERNMENT OPPOSITION: "Scott Morrison has hit back at claims his climate change policies have contributed to the fire season, declaring it "doesn't bear up to credible scientific evidence"." and "Australia's conservative government has refused to be drawn on whether climate change could have contributed to the fires, in a response that has drawn criticism. Is this linked to climate change?“

• ITS COMPLICATED: "So are bushfires getting worse? Many Australians are asking that very question and whether these fires are linked to climate change – but the science is complicated. Scientists have long warned that a hotter, drier climate will contribute to fires becoming more frequent…"

GDELT: Global Happiness/Sadness 2016

Machine Learning

Vision API Speech API

Natural Language API

Translation API

Storage

Cloud Storage

Persistent Disk Local SSD

Compute

Compute Engine

Big Data

BigQuery

GDELT

Video API

www.gdeltproject.org

Recommended