HBaseCon 2012 | Scaling GIS In Three Acts

Preview:

DESCRIPTION

Scaling geospatial data is hard. State of the art GIS technologies available to the general public are locked in the realm of relational databases with PostGIS as the prominent leader. Though a number of location-based startups have walked this path before, few have marked their trail along the way. Act one proveds a survey of the landscape, defining terms, and highlighting pitfalls. Act two explores the world of open source, horizontally scalable GIS and outlines the problems they solve. Act three explores implementations backed by HBase. No previous GIS knowledge is required.

Citation preview

SCALING GIS IN 3 ACTS

presented by:

Nick Dimiduk

May 22, 2012

1

SCALING GIS IN 3 ACTS- Lightning Edition! -

presented by:

Nick Dimiduk

May 22, 2012

2

© 2012 The Climate Corporation. All Rights Reserved. Policies are underwritten by State National Insurance Company, Inc. and administered by The Climate Insurance Agency LLC.

HBase in ActionManning Press, Fall 2012

0

1

2

3

4

5

6

7

8

9

10Thousands

MULTI-BAR CHART TITLE, LEFT ALIGNED

Series 1 Series 2 Series 3 Series 4

3

hbaseinaction.com

Discount code: 12hb10

Act I: What is GIS?

© 2012 The Climate Corporation. All Rights Reserved. Policies are underwritten by State National Insurance Company, Inc. and administered by The Climate Insurance Agency LLC.

GIS: Data (on maps!)

0

1

2

3

4

5

6

7

8

9

10Thousands

MULTI-BAR CHART TITLE, LEFT ALIGNED

Series 1 Series 2 Series 3 Series 4

5

0

1

2

3

4

5

6

7

8

9

10Thousands

MULTI-BAR CHART TITLE, LEFT ALIGNED

Series 1 Series 2 Series 3 Series 4

© 2012 The Climate Corporation. All Rights Reserved. Policies are underwritten by State National Insurance Company, Inc. and administered by The Climate Insurance Agency LLC.

HC SVNT DRAGONES

“Here are Dragons”

0

1

2

3

4

5

6

7

8

9

10Thousands

MULTI-BAR CHART TITLE, LEFT ALIGNED

Series 1 Series 2 Series 3 Series 4

6

DRAGONES!!!

Image: Psalter World Map, 1265

http://en.wikipedia.org/wiki/Here_be_dragons

Act II: What to do with GIS?

© 2012 The Climate Corporation. All Rights Reserved. Policies are underwritten by State National Insurance Company, Inc. and administered by The Climate Insurance Agency LLC.

Geospatial Queries

8

© 2012 The Climate Corporation. All Rights Reserved. Policies are underwritten by State National Insurance Company, Inc. and administered by The Climate Insurance Agency LLC.

Non-Euclidean Geometry

9

Image: Trigonometry on a Spehere

http://en.wikipedia.org/wiki/Non-Euclidean_geometry

“Know thy surface”

Act III: GIS on HBase

© 2012 The Climate Corporation. All Rights Reserved. Policies are underwritten by State National Insurance Company, Inc. and administered by The Climate Insurance Agency LLC.

The devil is in the Indices

12

Image: Six iterations of the Hilbert curve

http://en.wikipedia.org/wiki/Space-filling_curve

© 2012 The Climate Corporation. All Rights Reserved. Policies are underwritten by State National Insurance Company, Inc. and administered by The Climate Insurance Agency LLC.

Spatial Partitioning

14

Image: USA night lights

http://www.noaanews.noaa.gov/stories/s2015.htm

© 2012 The Climate Corporation. All Rights Reserved. Policies are underwritten by State National Insurance Company, Inc. and administered by The Climate Insurance Agency LLC.

The devil is in the (Spatial) Indices

16

Image: German zipcodes, R*Tree

http://en.wikipedia.org/wiki/R*_tree

Thank you!

Recommended