16
FME & AWS RDS Michael Kieser Senior Systems Engineer

FME for ESRI Geodatabase Replication to Amazon RDS

Embed Size (px)

Citation preview

Page 1: FME for ESRI Geodatabase Replication to Amazon RDS

FME & AWS RDSMichael Kieser Senior Systems Engineer

Page 2: FME for ESRI Geodatabase Replication to Amazon RDS

Amazon Web Services

corporate data center

Page 3: FME for ESRI Geodatabase Replication to Amazon RDS

RMWB - GIS Portal

Page 4: FME for ESRI Geodatabase Replication to Amazon RDS

RMWB - Municipal Viewer

Page 5: FME for ESRI Geodatabase Replication to Amazon RDS

RMWB - Architecture

Page 6: FME for ESRI Geodatabase Replication to Amazon RDS

Problem - Enderman

Page 7: FME for ESRI Geodatabase Replication to Amazon RDS

Solution - FME & AWS

Page 8: FME for ESRI Geodatabase Replication to Amazon RDS

FME Geodatabase R/W

▪ ESRI Geodatabase (GEODATABASE_SDE): ▪ support for Feature Dataset/Feature Class

hierarchy ▪ ArcObjects-based writer

▪ ESRI ArcSDE (SDE30): ▪ no support for FD/FC hierarchy ▪ increase performance

Page 9: FME for ESRI Geodatabase Replication to Amazon RDS

Benchmarking - FME Replication - ESRI Geodatabase Writer

▪ 1 Feature Class of ~100 ▪ 40k Features: 20 minutes

▪ 1 Feature Dataset of ~10 ▪ ~8 hours to replicate

▪ Entire Geodatabase ▪ estimated 20 hours to replicate ▪ Feature Dataset / Feature Class hierarchy

Page 10: FME for ESRI Geodatabase Replication to Amazon RDS

Benchmarking - FME Replication - ESRI SDE Writer

▪ 1 Feature Class of ~100 ▪ 40k Features: 4 minutes

▪ 1 Feature Dataset of ~10 ▪ 12 minutes to replicate

▪ Entire Geodatabase ▪ 30 minutes to replicate ▪ No FD/FC hierarchy

Page 11: FME for ESRI Geodatabase Replication to Amazon RDS

Combined ESRI Geodatabase & SDE Writers - Runner WB

1.2.

3.

Page 12: FME for ESRI Geodatabase Replication to Amazon RDS

Benchmarking - FME Replication - Combined Writers

▪ 1 Feature Class of ~100 ▪ 40k Features: 10 minutes

▪ 1 Feature Dataset of ~10 ▪ 20 minutes to replicate

▪ Entire Geodatabase ▪ 3 hours to replicate ▪ Feature Dataset / Feature Class hierarchy

Page 13: FME for ESRI Geodatabase Replication to Amazon RDS

Benchmarking - ESRI Replication

▪ 1 Feature Class of ~100 ▪ 40k Features: 40 minutes

▪ 1 Feature Dataset of ~10 ▪ ~60 hours to replicate

▪ Entire Geodatabase ▪ estimated >100 hours to replicate

Page 14: FME for ESRI Geodatabase Replication to Amazon RDS

Conclusion

▪ Local/AWS Architecture: 3 levels of security ▪ separate environments (optional VPN) ▪ AWS Identity and Access Management ▪ Proxy node

▪ FME: ▪ universal tool in our toolbox ▪ combining readers/writers for flexibility

▪ Amazon RDS: SQL Server, MySQL, PostgreSQL, Oracle ▪ resource level permissions ▪ maintenance free ▪ easily scaled, replication

1

2

3VPN

Page 15: FME for ESRI Geodatabase Replication to Amazon RDS

Go Flames!

Page 16: FME for ESRI Geodatabase Replication to Amazon RDS

Thank You!

▪ Questions?

▪ For more information: ▪ Michael Kieser ▪ [email protected] ▪ @geoengis ▪ Tesera Systems, Calgary