Transcript
Page 1: Using Hot and Cold Data in your SAP Analytics Landscape

Using  Hot  and  Cold  Data  in  your  SAP  Analy5cs  Landscape  

Clint  Vosloo  (@vosloo777)  –  Manager  Partner  for  ANZ  (EV  Technologies)      

Page 2: Using Hot and Cold Data in your SAP Analytics Landscape

In this session..

•  Understand  what  database  technology  you  can  use  in  the  SAP  Real-­‐Time  Data  PlaMorm  to  drive  analy5cs    

•  Benefit  from  hot/cold  data  storage  to  maximize  your  investments    

•  Set  up  and  configure  Near-­‐Line  Storage  for  your  SAP  BW  environment  using  SAP  Sybase  IQ  

•  Understand  Extended  Tables  in  your  BW  Environment    •  Take  advantage  of  SAP’s  new  Smart  Data  Access  using  SAP  

Sybase  IQ  and  SAP  HANA  and  Calcula5on  Views–  just  released  in  SP7    

Page 3: Using Hot and Cold Data in your SAP Analytics Landscape

What we will Cover

SAP  Real-­‐Time  Data  PlaMorm    Near-­‐Line  Storage  for  SAP  BW  using  SAP  Sybase  IQ  Using  Extended  Tables  in  your  BW  on  HANA  Environment  SAP  Smart  Data  Access  with  SAP  HANA  and  SAP  Sybase  IQ  Wrap-­‐up  

Page 4: Using Hot and Cold Data in your SAP Analytics Landscape

SAP’s Real-Time Data Platform

Page 5: Using Hot and Cold Data in your SAP Analytics Landscape

Hadoop as a DWH by Gartner

Page 6: Using Hot and Cold Data in your SAP Analytics Landscape

Guinness Book World Record •  Benchmark  done  with  SAP  Sybase  IQ  16    •  Loaded  34.3  TB  of  data  per  hour  (Over  double  the  previous  

record  of  14  TB  per  hour)  •  Equates  to  823  TB  per  day  and  5.7  PB  per  week  •  In  printed  macer,  Sybase  IQ  could  load  the  en5re  collec5on  of  

the  Library  of  Congress  in  under  35  minutes  •  One  petabyte  is  approximately  13.3  years  of  HD  TV  content,  

meaning  Sybase  IQ  could  load  and  analyze  76  years  worth  of  True  Blood  episodes  per  week  

•  ***  Valid  as  of  April  2013  ***  

Page 7: Using Hot and Cold Data in your SAP Analytics Landscape

Guinness Book World Record •  Benchmark  done  with  SAP  HANA  SPS07  SAP  IQ  16    •  12.1  PB  Data  Warehouse  •  Combina5on  of  SAP  HANA  and  SAP  IQ  –  Using  Smart  Data  

Access  to  Federate  queries  •  4  to  1  compression  ra5o    •  12  000  5mes  the  US  Library  of  Congress  Stored  (10  TB)    •  **  Valid  as  of  March  2014  **    

Page 8: Using Hot and Cold Data in your SAP Analytics Landscape

SAP IQ vs SQL Server

Sybase  IQ   SQL  Server  Free   Edi5on     Free  

11  469  MBs   Raw  Data  Size     5  427  MBs  123  534  969   Rows  Loaded   63  558  180  4  966  MBs   Database  Size   9  216  MBs  230,95  %   Compression  %     58,89  %  

72,5  seconds   Ave  Query  Run  Time  Speed   159,4  seconds  

*      SAP  Sybase  IQ  was  on  average  580%  faster!      **  No  CPUs  were  harmed  during  this  benchmark…  

Page 9: Using Hot and Cold Data in your SAP Analytics Landscape
Page 10: Using Hot and Cold Data in your SAP Analytics Landscape

SAP BW – Current State

Page 11: Using Hot and Cold Data in your SAP Analytics Landscape

SAP BW – Large Data Volumes

5  TB  

Page 12: Using Hot and Cold Data in your SAP Analytics Landscape

SAP BW – HANA Solution

1  TB  

Page 13: Using Hot and Cold Data in your SAP Analytics Landscape

What we will Cover

SAP  Real-­‐Time  Data  PlaMorm    Near-­‐Line  Storage  for  SAP  BW  using  SAP  Sybase  IQ  Using  Extended  Tables  in  your  BW  on  HANA  Environment  SAP  Smart  Data  Access  with  SAP  HANA  and  SAP  Sybase  IQ  Wrap-­‐up  

Page 14: Using Hot and Cold Data in your SAP Analytics Landscape

SAP BW – NLS (7.3 SP09)

1 TB 1 TB

Page 15: Using Hot and Cold Data in your SAP Analytics Landscape

SAP BW – NLS with HANA

1 TB 200MB

Page 16: Using Hot and Cold Data in your SAP Analytics Landscape

Setting Up BW NLS with SAP Sybase IQ

•  Step  1:  Install  SAP  Sybase  IQ  Drivers  on  the  BW  system  •  Step  2:  Set  up  a  secondary  database  connec5on  in  SAP  BW    

–  Transac5on  code  DBCO    

 

Page 17: Using Hot and Cold Data in your SAP Analytics Landscape

Setting Up BW NLS with SAP Sybase IQ (cont.)

•  Step  3:  Install  all  the  SAP  Notes/Patches  men5oned  in  documenta5on  (20  at  5me  of  comple5ng  the  work)    

•  Step  4:  Set  up  a  Near-­‐Line  Storage  Connec5on  –  BW  Code  RSA1    

•  Administra5on  ª  Current  Semngs  ª  Near-­‐Line  Storage  Connec5ons    

Page 18: Using Hot and Cold Data in your SAP Analytics Landscape

Setting Up BW NLS with SAP Sybase IQ (cont.)

•  Step  5:  Set  up  the  object  (either  DSO  or  InfoCube)  for  NLS    –  Specify  a  Selec5on  Profile  (date-­‐based,  transac5on  code,  etc.)  

•  Step  6:  Kick  off  Near-­‐Line  Storage    –  Click  on  “Manage”  for  the  Object  that  you  want  to  archive  –  Go  to  the  Archiving  Tab    –  Create  an  Archiving  Request    

•  Push  “Archive  in  the  Background”  •  SAP  First  Guidance  —  SAP  NLS  Solu5on  with  Sybase  IQ  

–  www.sdn.sap.com/irj/scn/go/portal/prtroot/docs/library/uuid/301395ac-­‐c476-­‐3010-­‐1d84-­‐802a2f12f530?QuickLink=index&overridelayout=true&58540404284044  

•  SAP  NetWeaver®  BW  Near  Line  Storage  solu5on  (NLS)  based  on  Sybase  IQ  –  hcp://scn.sap.com/docs/DOC-­‐39944  

Page 19: Using Hot and Cold Data in your SAP Analytics Landscape

Live Demo – NLS with IQ

•  Benchmark  Queries  from  SAP  BW    •  Run  Compara5ve  Queries  Directly  from  SAP  Sybase  IQ    

Page 20: Using Hot and Cold Data in your SAP Analytics Landscape

What we will Cover

SAP  Real-­‐Time  Data  PlaMorm    Near-­‐Line  Storage  for  SAP  BW  using  SAP  Sybase  IQ  Using  Extended  Tables  in  your  BW  on  HANA  Environment  SAP  Smart  Data  Access  with  SAP  HANA  and  SAP  Sybase  IQ  Wrap-­‐up  

Page 21: Using Hot and Cold Data in your SAP Analytics Landscape

SAP BW – Extended Tables

** Image from SAP

•  BW  7.4  SP  5  •  HANA  SPS07    •  SAP  IQ  16  SP2  •  Only  GA  Q4  2014  

Page 22: Using Hot and Cold Data in your SAP Analytics Landscape

What we will Cover

SAP  Real-­‐Time  Data  PlaMorm    Near-­‐Line  Storage  for  SAP  BW  using  SAP  Sybase  IQ  Using  Extended  Tables  in  your  BW  on  HANA  Environment  SAP  Smart  Data  Access  with  SAP  HANA  and  SAP  Sybase  IQ  Wrap-­‐up  

Page 23: Using Hot and Cold Data in your SAP Analytics Landscape

Smart Data Access (SDA)

** Image from SAP

Page 24: Using Hot and Cold Data in your SAP Analytics Landscape

SDA on Amazon AWS Step  1:  Configure  PuTTY  to  talk  to  Amazon  Instance  

hcp://docs.aws.amazon.com/AWSEC2/latest/UserGuide/pucy.html  

Remember  to  load  the  KeyPair  file  through  PucyGen  first  Step  1a:  Set  up  DynDNS  on  HANA  Amazon  Instance  

hcp://scn.sap.com/community/hana-­‐in-­‐memory/blog/2013/07/26/using-­‐dynamic-­‐dns-­‐with-­‐amazon-­‐ec2-­‐and-­‐hana-­‐development-­‐edi5on  

This  requires  a  DynDNS  account  and  assumes  you  are  using  an  Amazon  hosted  instance  of  HANA  running  on  Linux    

Page 25: Using Hot and Cold Data in your SAP Analytics Landscape

SDA on Amazon AWS Step  2:  Download  SAP  Sybase  IQ  Driver  from  SAP  Service  Market  Place  

§  hcps://websmp206.sap-­‐ag.de/support  § Requires  login  creden5als  to  the  SAP  Service  Marketplace  for  SMP  with  correct  access  rights  

 

     

 

Page 26: Using Hot and Cold Data in your SAP Analytics Landscape

SDA on Amazon AWS Step  3:  FTP  the  SAP  Sybase  IQ  ODBC  driver  files  to  your  Amazon  SAP  HANA  Server  using  FTP  Client  of  choice    

§  Remember  to  add  your  Amazon  .pem  file  to  the  SFTP  sec5on  in  semngs    

§  Look  out  for  SAP  NOTE  for  more  detailed  informa5on  for  Sybase  ASE  and  TerraData    

Step  4:  Install  the  Sybase  IQ  Drivers  on  your  SAP  HANA  system  Step  5:  Set  up  a  SAP  Sybase  IQ  DSN  entry  in  the  ODBC.ini  file    

§  Make  sure  that  unixODBC  is  installed  on  your  Linux  server    § www.linuxfromscratch.org/blfs/view/svn/general/unixodbc.html    

Page 27: Using Hot and Cold Data in your SAP Analytics Landscape

SDA on Amazon AWS

Step  6:  In  SAP  HANA  Studio,  create  a  new  Remote  Data  Source  Connec5on    

Page 28: Using Hot and Cold Data in your SAP Analytics Landscape

SDA on Amazon AWS

Step  7:  Add  a  virtual  table  in  remote  system    

Page 29: Using Hot and Cold Data in your SAP Analytics Landscape

SDA – Live Demo

•  Configura5on  Overview    •  Crea5ng  Virtual  Tables    •  Running  Queries    •  Reviewing  Performance  Sta5s5cs    

Page 30: Using Hot and Cold Data in your SAP Analytics Landscape

What we will Cover

SAP  Real-­‐Time  Data  PlaMorm    Near-­‐Line  Storage  for  SAP  BW  using  SAP  Sybase  IQ  SAP  Smart  Data  Access  with  SAP  HANA  and  SAP  Sybase  IQ  Wrap-­‐up  

Page 31: Using Hot and Cold Data in your SAP Analytics Landscape

More Information

•  “Semng  up  BW  Near-­‐Line  Storage  with  SAP  Sybase  IQ”  (Diversified  Seman5c  Layer)  hcp://dslayer.net/vlayer/view/219-­‐semng-­‐up-­‐bw-­‐near-­‐line-­‐storage-­‐with-­‐sap-­‐sybase-­‐iq  

•  Clint  Vosloo,  “SAP’s  big  play  in  the  EDW  Space  –  But  does  any-­‐one  know  about  it?”  (SAP  SCN,  April  2013).  hcp://scn.sap.com/people/clint.vosloo/blog/2013/04/30/saps-­‐big-­‐play-­‐in-­‐the-­‐edw-­‐space-­‐-­‐but-­‐does-­‐any-­‐one-­‐know-­‐about-­‐it  

•  Official  Product  Tutorials  –  SAP  BI  Suite  (SCN).  hcp://scn.sap.com/docs/DOC-­‐7725  

•  DSLayerd  Podcast  on  SAP  BusinessObjects  Analy5cs  Bundles  hcp://dslayer.net/dslayer/view/202-­‐bundles-­‐of-­‐sap-­‐joy    

Page 32: Using Hot and Cold Data in your SAP Analytics Landscape

More Information

•  SAP  HANA  and  SAP  IQ  Guinness  Book  World  Record  •  hcp://www.saphana.com/community/blogs/blog/

2014/03/05/guinness-­‐world-­‐record-­‐-­‐largest-­‐data-­‐warehouse  

•  SAP  HANA  Academy  Tutorials  (YouTube)  •  HANA  Academy:  Smart  Data  Access  –  Connec5ng  to  Sybase    

IQ  16  •  www.youtube.com/watch?v=SVTt0T3yfO8  

•  HANA  Academy:  Smart  Data  Access  using  Sybase  IQ  16    •  www.youtube.com/watch?v=cEkzgQVnfwg  

•  Timo  Ellioc’s  Blog  on  Hadoop    •  hcp://5moellioc.com/blog/2014/04/no-­‐hadoop-­‐isnt-­‐

going-­‐to-­‐replace-­‐your-­‐data-­‐warehouse.html  

Page 33: Using Hot and Cold Data in your SAP Analytics Landscape

Contact Information


Recommended