1with OpenDataSoft

think bigdata. start smartdata. scale fastdata

From Open Data to Open APIsFuture plants of sustainable innovation

David Thoumas – CTO12/4/2012

2

WHO ARE WE ?

Full featured cloud-based platform for

• operating ones own data driven innovation hubs

• speeding-up new data-centric services go-to-market

• leverage both cloud elasticity & big data fields

OpenDataSoftthe data driven innovation company

Smart metering, M2M, data API … thanks to its integrated platform of Data Management & Data Publishing, OpenDataSoft helps its customers to set up and operate their own data open platform dedicated to new services go-to-market, leveraging cloud computing & big data technologies.

3

4

OpenDataSoft builds a services centric platform

OpenDataSoftthe data driven innovation company

5

The 3 main platform pillars

• Big Data Management

• Data Smart Publishing

• Data API Factory

OpenDataSoftthe data driven innovation company

6

FROM [OPEN] DATA TO OPEN APIS

7

Open Data Strategy ?

« Open data strategy should be a top priority for any organization that uses the Web as a channel for delivering goods and services … Open data APIs are a

lightweight approach to data exchange. Their use is now considered a best practice for opening data and functionality to developers and other businesses. »(Gartner – août 2012)

8

What problem do we solve ?

Removing the barriers between Data and Applications.

• For Business users / analysts• Who know their data• To think and design their applications• With a quick Go To Live• Without needing to instantiate a complex IT project

Building applications in days, no more in months or years

9

How do we solve this problem ?Functionalities

Data procurement• File extraction• Pulling from remote sources (Web, DB, …)• Pushing through APIs• And sometimes, MDM

Data preparation• Fields mapping• Simple transformations (geo coords, text, …)• Complex transformations (geocoding, analytics, …)

Data publishing• Simple Web UI (navigate into the data)• API Factory (search, facetting, aggregation)

10

How do we solve this problem ?Technologies

… and Python …because it’s cool !• Sustained by a brilliant and huge community• Allows for multi-facets development patterns

NoSQL• Schema less• Highly scalable

Search• New flavor of applications• Mixing

– Traditionnal search approach– And Big Data analyticsIn the Cloud

11

How do we solve this problem ?Performances

Store datasets of tens of millions of records or even hundreds of millions of records.

With sub-second response time in simple real-time analytical processing tasks.

One platform for any scale use case.

12

And, at the end ?API factory => Application factory

Smart Metering …

… Mobile applications

…

13

DEEP DIVE INTOOPENDATASOFT’S API FACTORY

14

API FactoryDemo

[DEMO …]

15

API FactoryFunctionalities for rich modern applications

Full Text Search

Field search

Cross datasets search

Geographical filtering Analytical processing

Streaming of large results sets

Using standards

Numerical and rangesearch

16

API FactoryDeveloper oriented

Documentation

Test console

17

QUESTIONS ?

www.opendatasoft.comtwitter: @opendatasoftFacebook: http://www.facebook.com/opendatasoftLinkedIn: http://www.linkedin.com/company/opendatasoft