7/23/2019 Data integration using cloud technologies

1/2

Data integration using cloud technologies

Nguyen Thai Binh

November 24, 2014

Abstract

Data integration using cloud-based solutions like Google Drive or Drop-

box combining with existing Web-Services.

1 Introduction

Historical Map Geolocator is a web-application for storing non-georeferencedmaps. Metadata and related pre-scaled versions of a map are stored within onecentralized server. What if an institute or individuals would like to contributetheir maps into Geolocator web-application, without uploading pre-scaled ver-sions of their map or the original digitalized version of the map, but only itsmetadata?

2 High level requirements

It should be light-weight multi-platform application (GUI-based or Console-based) capable of

1. login and check for user credentials by comminucating with Geolocatorweb-service endpoint.

2. create pre-scaled vresions of an image.

3. upload data to Google Drive or Dropbox.

4. transform user metadata to Geolocator metadata schema.

5. push metadata to Geolocator web-service endpoint.

3 Technologies involved

1. Selected programming language should be platform-independent.

2. Using Google Drive API.

3. Using Dropbox API.

4. OAuth for authentication with above mentioned API services.

5. JSON or XML for data-transformation.

6. Optionally a GUI.

1

7/23/2019 Data integration using cloud technologies

2/2

4 Development requirements

This application should be opensource, due to the fact that Geolocator is alsoopensourced, using components like PostgreSQL and PostGIS extension, basedon Ruby on Rails MVC web framework.

We are using Github as code versioning system and built in issue reportsystem.

Code coverage should be over 70

Coding should follow Clean Code techniques.

Snapshots can be executed on all three major platforms: Linux, OSX andWindows.

2