30
Using Amazon Cloud Server in a pinch, with a little help form ArcGIS Online Matt Eitrem GIS Coordinator City of Ashland Wisconsin

Amazon Cloud Server in a Pinch, with a little help form ArcGIS Online

Embed Size (px)

DESCRIPTION

In 2012 the City of Ashland Public Works Utility department required field crew workers access to utility GIS data sets in the field and on their android tablets. Within one week of making the decision to go with Amazon Elastic Cloud Computing (EC2), ArcGIS Server was up and running serving out dynamic and tiled map services to client apps deployed through ArcGIS Online. In a couple of weeks an editing feature service was deployed for redline field markups. Everything was going good until I was asked to make the actual GIS datasets available for editing. This required several weeks of planning, development and troubleshooting, and a bunch of support phone calls to get everything working right. I have a lot successes stories and a few failures to share with you. This presentation will cover; Deploying a small scale Amazon EC2 server, Configuring ArcGIS server in the cloud for web map and editing services, Using ArcGIS Online to author web maps for web browser and mobile client access, Using python and AWS API scripts for automating EC2 machine control and geodatabase replication and synchronization.

Citation preview

Page 1: Amazon Cloud Server in a Pinch, with a little help form ArcGIS Online

Using Amazon Cloud Server in a pinch, with a little help form ArcGIS OnlineMatt EitremGIS CoordinatorCity of Ashland Wisconsin

Page 2: Amazon Cloud Server in a Pinch, with a little help form ArcGIS Online

Back ground info

Matt Eitrem, GIS Coordinator since 2008

City GIS Program since 2003

Focus on Public Works and Utility Data

Development

Utilizing ArcGIS Server since 2010

Spring of 2012 signed a SUELA with ESRI

Page 3: Amazon Cloud Server in a Pinch, with a little help form ArcGIS Online

Project InfoUtility crew were issued Verizon Android tabletsNeeded access to GIS mapping in the field ASAPUsers were accustomed to rich intranet web mappingIT issues and barriers to running our own serverAfter a phone call to the ever friendly folks at ESRI, I decided to look into hosting an Amazon cloud server for pushing our utility info out to the field crews.Within a week we had an Amazon EC2 server setup and serving map services to three Android tablets using the ArcGIS for Android app.

Page 4: Amazon Cloud Server in a Pinch, with a little help form ArcGIS Online

Amazon Cloud ServicesDocumentation Research and Testing

Page 5: Amazon Cloud Server in a Pinch, with a little help form ArcGIS Online

Amazon Cloud ServicesDocumentation Research and Testing

Page 6: Amazon Cloud Server in a Pinch, with a little help form ArcGIS Online

Amazon Cloud ServicesEC2 Pricing

Page 7: Amazon Cloud Server in a Pinch, with a little help form ArcGIS Online

Amazon Cloud ServicesEC2 Cost Estimating

Page 8: Amazon Cloud Server in a Pinch, with a little help form ArcGIS Online

Amazon EC2 setupEC2 Dashboard

Page 9: Amazon Cloud Server in a Pinch, with a little help form ArcGIS Online

Amazon EC2 setupClick Launch InstanceRequest AMI sharing from ESRI Customer Services

Page 10: Amazon Cloud Server in a Pinch, with a little help form ArcGIS Online

Amazon EC2 setupSelect your region and availability zonesCreate and download a key pair fileConfigure security groups and add security rulesClick Launch and wait about five minutesVerify the instance is ready and wait another five mins

Page 11: Amazon Cloud Server in a Pinch, with a little help form ArcGIS Online

Instance ManagementInstance Management

Generates RDP File

Key Pair Validation

Page 12: Amazon Cloud Server in a Pinch, with a little help form ArcGIS Online

Remote Instance ControlAmazon API Tools – Java command line toolsConfigure Local System to run API tools

Set a few environment variables- %Java_Home%, %EC2_HOME%, %AWS_ACCESS_KEY%, % EC2_URL % - https://ec2.us-east-1.amazonaws.com

Blogs.esri.com-Intro to Scripting Amazon EC2Daily Startup and Shutdown Window Scheduler

Run as service-no logon req. Separate account

Page 13: Amazon Cloud Server in a Pinch, with a little help form ArcGIS Online

Remote Instance ControlAndroid Mobile applications

Page 14: Amazon Cloud Server in a Pinch, with a little help form ArcGIS Online

Setting up EC2 ArcGIS ServerAuthorize ArcMap and Server (Workgroup)

Page 15: Amazon Cloud Server in a Pinch, with a little help form ArcGIS Online

Setting up EC2 ArcGIS ServerGetting data to the EC2 Instance for free

Dropbox(2-5GB) MS SkyDrive(25GB)

Slick User InterfaceCan run as serviceHandles Large Files >2GBBit for Bit File CompareGreat for small changes to larger files

Buggy InterfaceFile size limit of <2GBFull file copy when changedGreat for large file sets like image cache’s or large numbers of ref docs

Page 16: Amazon Cloud Server in a Pinch, with a little help form ArcGIS Online

Setting up EC2 ArcGIS ServerWeekly File Geodatabase updates workflow

One-way Sync Model

Page 17: Amazon Cloud Server in a Pinch, with a little help form ArcGIS Online

Setting up EC2 ArcGIS ServerWeekly File Geodatabase updates workflow

Copy to Dropbox Model

Page 18: Amazon Cloud Server in a Pinch, with a little help form ArcGIS Online

Setting up EC2 ArcGIS ServerWeekly File Geodatabase updates workflow

EC2 Stop\Start Services Script

Page 19: Amazon Cloud Server in a Pinch, with a little help form ArcGIS Online

Setting up EC2 ArcGIS ServerWeekly File Geodatabase updates workflow

Set Dropbox.exe to run as a service

Page 20: Amazon Cloud Server in a Pinch, with a little help form ArcGIS Online

Setting up EC2 ArcGIS ServerMap service publishing on EC2 is pretty much the same as it would be locally. Work within the constraints of the Instance

Page 21: Amazon Cloud Server in a Pinch, with a little help form ArcGIS Online

Enable Field to Office GIS EditsSet up Geodatabase replication to EC21. Extract and move data to EC2 2. Publish geodata service 3. Synchronize data changes

Publish Feature Service

Page 22: Amazon Cloud Server in a Pinch, with a little help form ArcGIS Online

Enable Field to Office GIS Edits1. Extract and move data to EC2

Extract dataset to an xml workspace document

Transfer xml file to EC2 with DropboxCreate SQL GDB on EC2Import xml workspace

Page 23: Amazon Cloud Server in a Pinch, with a little help form ArcGIS Online

Enable Field to Office GIS Edits2. Publish a geodata service

Save GDB connection *.sde file to folder with ArcSOC user permissions.

From ArcCatalog publish geodata service from saved GDB connection fileEnable replication on published geodata service

Default LocationC:\Users\<name>\AppData\Roaming\ESRI\Desktop10.0\ArcCatalog

ArcSOC LocationD:\GIS\Data\Connections

Page 24: Amazon Cloud Server in a Pinch, with a little help form ArcGIS Online

Enable Field to Office GIS Edits3. Synchronize data changes through the service

Create local GIS server connection to EC2

EC2 Server

connection

Create replica on source GDB using option to register existing data

Page 25: Amazon Cloud Server in a Pinch, with a little help form ArcGIS Online

Enable Field to Office GIS Edits

Author and Publish Feature ServicesScripting Synchronization

Synchronize Changes Tool

Synchronization ConflictsExport / Import Change Messages

Software bugsFailed geodata service startupHost name and IP configuration

Page 26: Amazon Cloud Server in a Pinch, with a little help form ArcGIS Online

Using ArcGIS OnlineAuthored web maps using EC2 services

Used HTML Arcgis.com map viewer

Shared web maps through private groupsSetup accounts for Android tablets and shared the groups.

Page 27: Amazon Cloud Server in a Pinch, with a little help form ArcGIS Online

Using ArcGIS OnlineRecent changes to private group sharing and Arcgis Online for Organizations

Page 28: Amazon Cloud Server in a Pinch, with a little help form ArcGIS Online

Successes & Failures

Missed spring hydrant flushingTree Inventory Updates

Contractor declined using Android app.Fall hydrant flushing success

Instant operational awareness for FDUtility Locates

Diggers Hotline requests sped upRepairs and Installs Documentation

Locations recordedRecent retirees

Page 29: Amazon Cloud Server in a Pinch, with a little help form ArcGIS Online

Take Home Points

Small Amazon Instances can be useful for light weight focused applications at a low cost.($45) Balancing the capabilities of the EC2 machine with appropriate services and loads.Leveraging your enterprise licensing to extend your reach.The fun of pushing technology to its limits and working through issues.

Page 30: Amazon Cloud Server in a Pinch, with a little help form ArcGIS Online

Matt [email protected]

Thank You