Oracle Spatial Summit · 2015-02-24 · 2015 . The Spatial & Graph SIG • The SIG promotes interaction and communication that can drive the market for spatial technology and data

Oracle Spatial Summit 2015

Performance Gains with Spatial & Graph Using Oracle Database 12c Steve Pierce, CEO Think Huddle

Nick Salem, Distinguished Engineer Neustar

Think Huddle and Neustar Performance Gains with 12c /

OVERVIEW • “Big Data” and its impact on Spatial performance • Testing configurations • Use cases / techniques for improving performance • Performance improvement data

CHALLENGES / OPPORTUNITIES • With 11g, performance sometimes limited interactions

with Big Data • Making improvements was time-consuming

SOLUTIONS • Oracle Database 12c Enterprise Edition

• Spatial Option with GeoRaster, Network Data Model • Partitioning

• Oracle Fusion Middleware 11.1.1.7 • MapViewer

• Oracle Business Intelligence Enterprise Edition

RESULTS • Achieving at least 2x performance improvement – in

some cases up to 300x improvement • Only small configuration changes are needed • Time to develop and maintain these solutions is reduced

0 500

1,000 1,500 2,000 2,500 3,000 3,500 4,000 4,500 5,000

11g 12c 12c SVA

6.5x faster performance 11m 53s vs 1hr 17m 26s


Speaker Bio

• Oracle Spatial and MapViewer • Big Data and BI for Spatial • Fortune 500 clients

• Steve Pierce • Chair – Oracle Spatial SIG • 15 years Oracle

• Internet, telco, information services, retail, media and advertising industries

• Publicly held - $902M+ company • Extensive data assets (4 billion phone

numbers, 2.8 billion IP addresses, etc.) • 20 billion requests a day (DNS, text

messages, phone) • Nick Salem

• Technical Chair – Oracle Spatial SIG • 16 years Oracle


The Spatial & Graph SIG • The SIG promotes interaction

and communication that can drive the market for spatial technology and data

• Members connect and

exchange knowledge via online communities and at annual conferences and events

• Meet us at the Summit

Morning Reception Tuesday and Wednesday 7:45 to 8:30 a.m. Registration Area

Social Hour Wednesday 6 to 7 p.m. Registration Area

• Join us online – LinkedIn (search for “LinkedIn Oracle Spatial”) – Google+ (search for “Google+ Oracle Spatial”) – IOUG SIG (sign up for free membership through

www.ioug.org) – OTN Spatial – Communities (search for “Oracle Spatial and

Graph Community”) • Contact the Board at [email protected]

http://www.linkedin.com/groups/Oracle-Spatial-Graph-1848520?gid=1848520&trk=skills

https://plus.google.com/communities/108078829007193480508

http://www.ioug.org/

http://www.ioug.org/

http://www.oracle.com/technetwork/database/options/spatialandgraph/community




mailto:[email protected]


Agenda • Big Data: What’s the big deal? • Testing configurations • Use cases and performance data • Q&A


What’s the Big Deal? • Data growing

• Big Data systems for spatial processing

• Fundamental changes in 12c • Faster vector algorithms • Better caching • Improved memory management

• 12c works for Big Data • (and maintains data integrity • … and keeps data secure • … and supports relational integrity • … and your users can access it)

BIG DATA


Test Environment Environment

Oracle 11g

Oracle 12c

OS Oracle Linux 6.5 Oracle Linux 6.5

Processor E5 Xeon 2.9Ghz x 2

E5 Xeon 2.9Ghz x 2

Disk Intel SSD s Intel SSD s

Memory 32GB 32GB

Huge Pages Yes Yes

SGA/PGA 8GB/2GB 8GB/2GB

Source data Census / Generated

Census / Generated

• 1 Server – 2 Oracle Databases


Aggregation of census tracts into larger geometries based on neighbor relationships

INTERACT UNION

Use Case: Geometry Aggregation


• Each Census tract in Virginia • Aggregate Union of Neighbors

• SDO_ANY_INTERACT + SDO_AGGR_UNION • 2,000 Aggregations • Tracts have 7 neighbors = 14,000 tracts • 280 tracts processed per second

0

50

100

150

200

250

300

350

11g 12c 12c SVA

Elapsed Time (s)

Use Case: Geometry Aggregation


Use Case: Joins Which objects are in which region?

And there?

What’s in there? And here?


Use Case: Joins

• SDO_JOIN – For bulk joins • sdo_join('LARGE', 'GEOM', 'STATES',

'GEOM', 'mask=anyinteract'

• Works in 11g

• Faster in 12c

0

100

200

300

400

500

600

700

11g 12c 12c SVA

Elapsed Time (s)


Neustar’s ElementOne Platform Geospatial Analytics in the Cloud

• Highly flexible and high performance mapping

• Rich market and trade area capability • Road network / drive time analysis • Heat themes • GeoRaster images • Aerials / terrain map overlays • Scalable and high performance data

retrieval • Centralized secure data repository


• Oracle VM Server 3.0 (Xen version 4.1 PVM) • Created 2 identical VMs with Oracle Linux 6.5

• Installed Oracle 11g on one and 12c on the other

• Database configuration • 8G of SGA / 2G of PGA • 4 x 8 Core CPUs (Intel Xeon 2.70GHz)

• Loaded core ElementOne database on each • Compare 11g to 12c w/ & w/o spatial vector acceleration

Neustar’s ElementOne Platform 11g vs. 12c Test Benchmark Environment


Neustar’s ElementOne on 12c SDO_AGGR_UNION – CA ZIPs

• Use case consisted of aggregating all ZIP Codes in California using plain SDO_AGGR_UNION and with mod/group by functions

• Achieved up to 300x faster performance w\ SDO_AGGR_UNION and 40x faster with mod/group by method in12c with SVA enabled vs 11g

• Reduced elapsed time from 1 hour 54 seconds to just 12 seconds

0 500

1,000 1,500 2,000 2,500 3,000 3,500 4,000

11g 12c 12c SVA

Elapsed Time In Seconds

Using SDO AGGR UNION

SDO AGGR UNION + Mod/Group


Neustar’s ElementOne on 12c SDO_TOUCH – CA ZIPs touch BGs

• For all California ZIP codes, retrieve the block groups that they touch

0

50

100

150

200

250

11g 12c 12c SVA

8x faster performance 25s vs 3m 23s

SDO_TOUCH


Neustar’s ElementOne on 12c SDO_WITHIN_DISTANCE Benchmarks

• For 544 super regional shopping centers, retrieve all businesses with a 10-mile radius

0 100 200 300 400 500 600 700 800 900

1,000

11g 12c 12c SVA

6x faster 2m 17s vs 14m 32s

SDO WITHIN DISTANCE


Neustar’s ElementOne on 12c SDO_JOIN – ZIP & Block Group Tables

• Join using mask=anyinteract

0 500

1,000 1,500 2,000 2,500 3,000 3,500 4,000 4,500 5,000

11g 12c 12c SVA

6.5x faster performance 11m 53s vs 1hr 17m 26s

SDO_JOIN


Neustar’s ElementOne on 12c SDO_CS.TRANSFORM – US block groups

0 200 400 600 800

1,000 1,200 1,400 1,600

11g 12c 12c SVA

10x faster performance 2m 10s vs 22m 26s

SDO CS Coordinate Transform


Neustar’s ElementOne on 12c Oracle Spatial - 12c Benchmarks

• 3x faster using SDO_GEOM.RELATE to determine topological relationship for CA ZIPs and surrounding BGs

• 2.6x faster using SDO_GEOM.DISTANCE to calculate distances between a site and surrounding 112k sites

• 2.1x faster using SDO_INSIDE to retrieve all businesses inside NY block groups

• 1.8x faster using VALIDATE_GEOM to validate all US county geometries



Documents

Oracle Spatial Summit · 2015-02-24 · 2015 . The Spatial & Graph SIG • The SIG promotes interaction and communication that can drive the market for spatial technology and data