Upload
spagoworld
View
845
Download
0
Embed Size (px)
DESCRIPTION
The presentation supported the webinar focused on the smart approach adopted by SpagoBI suite to manage Big Data, delivered on October 8th, 2013 within SpagoWorld Webinar Center. http://www.spagoworld.org/
Citation preview
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
SpagoBI & Big Data:
a smart approach to turn data into knowledge
October 8th, 2013
Monica Franceschini – IT Solution Architect
This presentation has been used during a webinar delivered withinSpagoWorld Webinar Center - http://bit.ly/WebinarCenter
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
Smart approach
By smart approach we mean:
● Information building through
● Different data sources connections
● Datasets
● Self service BI
● Agile development of information
● Visualization through
● Dashboards with interactions between documents
● Behavioural model leading documents behaviour
● Ad hoc reporting
● Smart approach = comprehensive approach
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
Comprehensive approach
BYTES STREAM
SEMANTIC
BIG DATASETS
for Big Data
ANALYTICS
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
Comprehensive approach
for Big Data
Visualization
Information building
Static reportsChartsGeoAd hoc reporting...
NoSqlHadoopReal timeSelf Service...
DATASET
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
3 scenarios
Data Source
Data Set
Visualization
InIn--MemoryMemoryPersistencyPersistency
SchedulationSchedulation
Data Streaming
Semanticdatabase
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
Dataset component
Data Set
Visualization
InIn--MemoryMemoryPersistencyPersistency
SchedulationSchedulation
BehaviouralBehavioural modelmodel
Analytical driver Analytical driver LOV (List of Values)LOV (List of Values)
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
Big Data storages
Data SourceData Set
Impala
JDBC / JNDI connectionstowards NoSql databases of the Hadoop ecosystem
Dataset follows the Behavioural Modelusing: SpagoBI analytical driversUser attributes
Query ● HBql● CQL● HiveQL● ...
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
Real time
Data Streaming
InIn--MemoryMemory
Event Dispatcher
SpagoBIAdapter
● Web Service● Java API● Queue● ...
Event Handlers
Dataset
● SMS● Alerts● Mail● ...
PersistencyPersistency
Visualization
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
Semantic
Linked data semantic ontologies
Experienced NoSQL graph databases:
OrientDBNeo4J
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
Semantic
Semanticdatabase
ExplorativeExplorative AnalysisAnalysisNetwork Network AnalysisAnalysis asas DRIVERDRIVER
Network AnalysisEngine
MQL,MQL,CypherCypher, , SPARQLSPARQL, , GremlinGremlintraversetraverse
OrientOrient DB, DB, Neo4J...Neo4J...
Classify and Categorize unstructured and heterogeneous data throughsemantic annotations, using domain ontologies.
FILTERFILTER
VisualizationVisualization
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
Comprehensive approach
for Big Data
Visualization
Information building
Static reportsChartsGeo
Ad hoc Ad hoc reportingreporting...
NoSqlHadoopReal time
SelfSelf ServiceService...
DATASET
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
Agile development
Query
Create charts
Refine the query
Persist
New query
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
Self service
Use Free Enquiry Engine to:
DefineDefine youryour ownown queriesqueriesoverover datasetsdatasets
Create Create newnew datasetsdatasets in in a a graphicalgraphical and and smartsmart
wayway
RefineRefine youryour analysisanalysis
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
Ad hoc reporting
Use Worksheet
to:
InteractInteract withwith QbEQbE totorefreshrefresh youryour datadata
ProvideProvide anan instantinstantgraphicalgraphical meaningmeaning toto
youryour datasetsdatasetsCreate a Create a prototypeprototype forforyouryour projectproject
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
Dashboards
Use Cockpits to:
Aggregate Aggregate analysisanalysis totogetget information at a information at a
glanceglance
FilterFilter data data usingusingspecificspecific documentsdocuments
MakeMake differentdifferent kindskinds ofofdocumentsdocuments interactinteract
withwith eacheach otherother
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
What comes nextUnstructured &
heterogeneous data
Statistical computing
Text mining
Sentiment analysis
...and more advanced & predictive analysis
NEW VISUALIZATION
Data mining
NEW INFORMATION
BUILDING TECH
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
Find out all information
(demo, documentation, tutorials, services and much more)
and download all SpagoBI components at:
www.spagobi.org
Contact us