Embed Size (px)
Citation preview
University of Southern California
Background Photo by NASA, date unknown
Texas A&M University
Big GeoData Problems – High Volume Transactions and
National DatasetsPresented to: TAMU Big Data Workshop
College Station, TX
Dr. Daniel W. Goldberg
Department of Geography,Department of Computer Science & Engineering
Texas A&M University
http://[email protected]
Texas A&M University
2
Simple Problem - Geocoding
Texas A&M University
3
Who Cares
Address Data
GeocodeAddress Data
Calculate Exposure
Locational
Spatially Referenced
Spatial Analysis
Values
Conclusions
HotSpots
Incomplete / incorrect
Inaccurate location
Incorrect assignment
Invalid association
Misguided actions
Error Propagation
Relative Magnitude
Texas A&M University
4
Challenges
• Geographic processes are complex, and there are lots of them
500 m radius
0.1 ppm4.5 ppm9.0 ppm
13.5 ppm18.0 ppm27.0 ppm45.0 ppm
1000 m radius
a)
b)
c)
• Discretizing continuous phenomena
Texas A&M University
5
Challenges
• Geography is everywhere, and there is lots of it
• 390 Million US Addresses
• Updated Quarterly
Texas A&M University
6
Challenges
• Geographic processing is complex, and it is done all the time
• Computing continuous phenomena
Texas A&M University
7
Challenges
• 1M transactions per day
Texas A&M University
8
Challenges• High variety of access patterns, and all need to be fast
ReferenceDate
TransactionLogs
AccountBalance
READ WRITE R/W
Texas A&M University
9
Challenges
• Infrastructure is complex, and there is lots of it
• 75+ VMs
Texas A&M University
10
Solutions
• Lots of interesting challenges
• Ripe for research opportunities
• Let’s get started
Texas A&M University
THANKS FOR LISTENINGQuestions?
Contact Information
Dr. Daniel GoldbergDepartments of Geography and Computer Science & Engineering
Texas A&M University
http://[email protected]
