Hana Co- Innovation Lab and Eco-System - Meetupfiles.meetup.com/8995352/SAP_EcoSystem_OCS_July2013_Mike...SAP HANA Spatial Reference Architecture Data Sources Data Integration Tools

Hana Co- Innovation Lab and Eco-System

Mike Kemelmakher, July 2013

SAP HANA Co-Innovation Lab

HPAi, SAP Labs Israel

© 2013 SAP AG. All rights reserved. 3


Fast Facts

Established – March 2012

Full time members - 6

HANA deployed and operational in the LAB –

• Large Size HANA Cluster ( 900 cores, 6 TB RAM, Infiniband )

• 1TB RAM VMware server in DMZ for POCs with startups

• Advanced HW – GPGU/FPGA Accelerators from NVidia, Intel, etc



Business Development Focus

Promotion of HANA as a generic real-time analytics

platform – integrations and POCs with non-SAP traditional

applications in various industries

• Identify local ISVs with strong use-cases for low latency

analytics and high potential for integration with HANA aiming

at bundling it as part of their solution

• Collaborate with SAP sales organizations on HANA OEM

customer cases – with strong focus on Telecom, Security

and Financial Services markets

• Develop close relationship with Israeli Startup eco-system


HANA stack optimization by evaluation and integration of 3rd

party SW/HW components

• Use of Accelerators GPGPU, FPGA for performance optimization

of CPU intensive parts of HANA – machine learning, compression

• Low Latency Interconnects and RDMA – for performance

optimization of inter-node communication in HANA scale-out

setups

• Performance, Availability, Resource Monitoring Solutions


Technology Focus



Achievements

Accomplished advanced due-diligence for HANA stack

• 2 storage vendors, 1 DB security vendor, 1 Predictive Analytics vendor

Ongoing technology due-diligence

• Low Latency Interconnects , Accelerators, Machine Learning

Investment Rounds closed by SAPV

• Advanced storage infrastructure Startup

HANA Startup Forum and Israeli ISV eco-system

• 15 startups participated in 1st Israeli HANA SUF event in July 2012

• 5 startups presented their HANA based solution during SAPPHIRE Madrid 2012

• 6 startups presented their HANA based solution during SAPPHIRE Orlando 2013

• 2 startups provide their HANA based solution via SAP STORE on HANA One SaaS platform



Inside SAP

• Collaborate with HANA R&D around Architecture, HW platform and

Performance strategy

• Collaborate with HANA Solution and Product organizations on

customer requirements and Product Roadmaps and Strategy

• Collaborate with Field and Marketing Organizations on Hana OEM

cases in Israel



Inside SAP

We partner with:

• SAP Ventures

• Support technology and business due-diligence activities around startups

relevant for HANA

• SAP Corporate Development

• Support M&A process in cases of technology acquisitions

• HANA Startup Forum

• Access to SAP eco-system marketing events (SAPPHIRE, TECHED)

• SAP Developer Experience Organization

• Free and Early access to SAP Software ( HANA, Sybase, Business

Objects)

• SAP Field and Sales

• Promotion of joint ISV/SAP HANA solutions



First Israeli SUF cycles included following participants:

Local Industry Partners and Technology Vendors

SAP HANA Overview

© 2011 SAP AG. All rights reserved. / Executive Board Meeting

11 Confidential

SAP Real-time Data Platform Vision

Business

Warehouse

Business

Intelligence

Mobile &

Embedded ERP

Hadoop

Big Data

In-memory/real-time

SAP HANA

SAP Real-time Data Platform

SAP Sybase ESP streams

SAP Sybase SQL Anywhere mobile and embedded

SAP Sybase IQ EDW

SAP Sybase ASE transactions

SAP Data Services / SAP Information Steward information management

Common programming APIs

SA

P S

ybas

e P

ow

erD

esig

ner

m

od

elin

g

SA

P S

ybase C

on

trol C

enter

mo

nito

ring

Hadoop

Big Data

SAP RTDP Foundations

● Cross-application data management &

access for new models of value

discovery.

● High-performance on all classes of

application and usage scenarios

Benefits

● Store, analyze, optimize, transact and

mobilize without system limitations.

● Embrace and extend across variations of

data forms and processing models.

● Common modeling, integrated

development environment, shared

systems management infrastructure and

deployment independent solutions.


SAP Real-Time Data Platform Unified open software platform for real-time business

SAP Real-Time Data Platform foundations

● Cross-paradigm data access for new models of

value discovery.

● Hyper-performance on all classes of application

and usage scenarios

● Price-Performance value across all use cases

Benefits

● Execute, record, analyze, and optimize without

system limitations

● Embrace and extend across variations of data

forms and processing models

● Common modeling, integrated development

environment, shared systems management

infrastructure, and deployment-independent

solutions

● Trusted and unified data environment

Business

Warehouse

Business

Intelligence

Mobile &

Embedded ERP

In-Memory / Realtime

SAP HANA

SAP Real Time Data Platform

Stream Analytics Mobile &

Embedded

Open EDW High Performance

OLTP

Information and Real-time Data Movement

Inte

gra

ted

Mo

del

ing

and

Met

adat

a

Integ

rated S

ystems

Man

agem

ent an

d

Lan

dscap

e

Common Programming APIs

Hadoop Big Data

Purpose

Built


HANA smart data access

In-Memory / Realtime

SAP HANA

SAP Real Time Data Platform

Open EDW High Performance

OLTP

Information and Real-time Data Movement

Inte

gra

ted

Mo

del

ing

and

Met

adat

a

Integ

rated S

ystems

Man

agem

ent an

d

Lan

dscap

e

Common Programming APIs

Business

Warehouse

Business

Intelligence

Mobile &

Embedded ERP SAP RTDP Foundations

● Smart Data Acces between DB’s

● SAP HANA to Sybase ASE

● SAP HANA to SAP IQ

● SAP HANA to SQL Anywhere

● SAP HANA to Hadoop (HIVE)

Benefits ● Utilize servers that are most optimized for that

type of processing, while accessing data from

any other RTDP server

● All data stores benefit from the superlative in-

memory performance and ensuing simplification

translating to simpler and iterative application

design models

● Faster application development time.

HANA Federation

Stream Analytics Mobile &

Embedded

Business

Warehouse

Business

Intelligence

Mobile &

Embedded ERP

Purpose

Built

Hadoop Big Data


14 Confidential

Supported Options for Customers/Partners

to Build Application User Interfaces on HANA Today

BW schema

SA

P H

AN

A

Column Tables

AnalyticView CalcView

Customer Defined Schema

ODBC/JDBC DBSQL ODBO

BI 4.0 MS Excel

BICS

SAP BW 7.3

BOE SDK Excel Runtime Services NW 7.3

HANA Application

.NET/JAVA/Flash/HTML5/Mobile or any other UI Application Technology

Database

Database Interfaces

Certified HANA Application Platforms

Application SDK

HANA Applications


15 Confidential

SAP HANA Operations


16 Confidential

SAP HANA Spatial Reference Architecture

Data Sources

Data Integration Tools Load tools: • SAP Data Services

• SAP Event Stream Processor

• Partner ETL Tools

Types & Functions:

• Point

• Linestring

• Polygon

• SRID metadata

• Spatial function library

• Clustering

• Spatial Joins

Engines:

• Indexserver

• Calc

• Spatial

• Attribute

• XS

Analytics GIS Visualization

Interfaces / Services

SQL / Calculation Models

SAP Info Access

(HTML5)

Internal

Geo-Services:

• Geoservices

• Geocontent

odbc, jdbc, XS (InA, geoJSON, mapping services API)

Views:

• Analytical

• Attribute

• Calculation

Geospatial Import/Export:

• Shapefile, csv, binary

• WKT / WKB Support

Data Access

SAP HANA

(OGC Compliant)

Applications

SAP Data Spatial Data Non-SAP Data Real-Time Data

Mobility


17 Confidential

Capabilities:

SAP HANA spatial application development components include: Location Services (on-premises or cloud), Geo-Content, Application Interfaces, Services

Allows for visualization, interaction, and exploration of spatial data in SAP HANA via maps

Supports HTML5 deployments for browser or iPad

Consumes SAP HANA models

NOT a general purpose BI or GIS tool!

Benefits:

Quick development and deployment time

Low TCO & TCD and fast response times with 2-tier architecture

All components, content, and services included with SAP HANA license

SAP HANA Spatial Application Development

Quickly develop and deploy SAP HANA based spatial applications with

provided geo-content and map services via the native XS engine

SAP HANA XS

iPad/

Browser

SAP

HANA

HTML5

Application

Location

Services Maps

Geo-

coding Routing

Spatial

Engine

Geo-

content


18 Confidential

HANA Search Services

text indexing and search service

out-of-the box trend spotting

built-in Entity extraction

metadata service

suggestion service (for search term

suggestions, aka type-ahead)

HANA UI

UI Toolkit (documentation, services, HTML5

controls)

HANA Studio

create a search view with graphical modeler

SAP HANA Text Search & Sentiment Analysis


19 Confidential

SAP HANA In-Database Text Analysis

The text analysis process runs inside the HANA database.

Technically, the text analysis is performed by the TA SDK, the same natural

language processing technology found in Text Data Processing on Data

Services ( formally known as “Inxight”).

There is no data replication, no transformation outside the HANA database.

• Text analysis feeds from and writes to HANA tables


20 Confidential

SAP HANA Text Analysis

Language support

Up to 31 languages

New or improved language coverage e.g.:

New major fact types for certain languages for Voice of customer option:

Profanity: defines a set of pejorative vocabulary

Emoticons: expression of someone's feelings about the whole sentence or situation

Weak Positive: Loving my new BlackBerry Q10! No iPhone needed over here.

Strong Positive: The show was hilarious :-D

Weak Negative: I hate this phone I'm using :-(

Strong Negative: The Dow Jones fell 200 points :-(((

Additional social slang coverage e.g. GR8, LOL, luv, etc.


21 Confidential

Text Analysis Data in a Search Based Application Built with HANA Info Access Toolkit for HTML5


22 Confidential

SAP HANA Available Text Analysis Configuration Options


23 Confidential

SAP HANA Predictive Analytics Library

Predictive Analysis Library (PAL) and Business Function Library (BFL)

Compiled analytic function library for business analysis in SAP HANA

Multiple algorithms are supported, such as:

K-means algorithm: e.g. can be used for market segmentation or customer segmentation

Apriori algorithm: e.g. can be used for product recommendation or affinity analysis

C4.5 decision tree: e.g. can be used for user purchase decision prediction

Do not need to buy 3rd party predictive analytic packages

Help Customers To

Know Your

Business

Decide with

Confidence

Compute

Quickly

Empower the

Business


24 Confidential

R Integration for SAP HANA

Embedding R scripts within the SAP HANA

database execution

Enhancements are made to the SAP HANA

database to allow R code (RLANG) to be processed

as part of the overall query execution plan

Suitable when the modeling and consumption

environment sits on HANA and the R environment is

used for specific statistical functions

DROP TABLE "spamClassified";

CREATE COLUMN TABLE "spamClassified" LIKE "spamEval"

WITH NO DATA;

ALTER TABLE "spamClassified" ADD ("classified"

VARCHAR(5000));

DROP PROCEDURE USE_SVM;

CREATE PROCEDURE USE_SVM( IN train "spamTraining", IN

eval "spamEval", OUT

result "spamClassified")

LANGUAGE RLANG AS

BEGIN

library(kernlab)

model <- ksvm(type~. , data=train,

kernel=rbfdot(sigma=0.1))

classified <- predict(model, eval [,-

(which(names(eval) %in% "type"))])

result <- as.data.frame(cbind(eval, classified))

END;

CALL USE_SVM("spamTraining", "spamEval",

"spamClassified") WITH OVERVIEW;

SELECT * FROM "spamClassified";

Sample Codes in SAP HANA SQLScript


25 Confidential

Transformation Scenarios

SAP HANA Extended Application Services (XS)

Front-end Technologies

http/s

HTML5 / SAPUI5

Client-side JavaScript

Control Flow Technologies

OData

Server-Side JavaScript

XMLA

Data Processing Technologies

SQL / SqlScript

Calculation Engine Functions

Application Function Library (AFL)

Presentation logic

Control flow logic

Data

Client: Browser or Mobile

SAP HANA

XS

Calculation logic


26 Confidential

SAP HANA for developers

• SAP HANA as development platform

• extended application services (XS engine)

• developer perspective in SAP HANA Studio

• application content lifecycle management

• Application- and data-logic separation

• client side app logic in JavaScript (HTML5)

• server side app logic in JavaScript

• data intense procedures in SQLScript

• data models, tables, user roles “as code”

• Application Foundation Library (AFL)

• accessible from SQLScript

• business functions in BFL

• analytic procedures in PAL

SAP HANA

XS services

HTML5 Apps

iOS Apps

Develop

& deploy

SAP HANA Studio development perspective

Thank you

Documents

Hana Co- Innovation Lab and Eco-System - Meetupfiles.meetup.com/8995352/SAP_EcoSystem_OCS_July2013_Mike...SAP HANA Spatial Reference Architecture Data Sources Data Integration Tools