View
3
Download
0
Category
Tags:
Preview:
DESCRIPTION
big data ieee paper
Citation preview
7/17/2019 Big_Data
http://slidepdf.com/reader/full/bigdata-568dd690c25b8 1/20
BIG DATA – WHAT’S THE BIG DEAL
Debarchan SarkarMicrosoftCorporation
The call o!l" start soon# please be on$!te%
Thanks for &o!r ti$e an" patience%
7/17/2019 Big_Data
http://slidepdf.com/reader/full/bigdata-568dd690c25b8 2/20
WH' AM I
Debarchan# fro$ Calc!tta ith an In"ian heart an" a (lobal $in"%
%)ET pro(ra$$er ho fell in lo*e ith 'pen So!rce# speci+call& Ap A!thor%
Co$$!nit& enth!siast%
Cricket an" $!sic lo*er%
'ne ho (ets reall& scare" an" bore" if to$orro is e,actl& like to"
-non is a "rop# the !nknon is an ocean%
7/17/2019 Big_Data
http://slidepdf.com/reader/full/bigdata-568dd690c25b8 3/20
WHAT IS BIG DATA.
Data Co$ple,it&/ 0ariet& an"
0elocit&
Terab&tes
Gi(ab&tes
Me(ab&tes
1etab&te
s BDLo( +les
Spatial 2G1S coo
Data $afee"s
eGo* feWeather
Te,t3i$a
Click
strea$
Wikis3blo(s
Sensors345ID
3"e*ices
Social
senti$ent
A!"io3*i"eo
Web6%7
Web Lo(s
Di(ital Marketin(
Search Marketin(
4eco$$en"ations
A"*ertisin(
Mobile
Collaboration
eCo$$erce
E413C4M1a&ables
1a&roll
In*entor&
Contacts
Deal Trackin(
Sales1ipeline
7/17/2019 Big_Data
http://slidepdf.com/reader/full/bigdata-568dd690c25b8 4/20
Ho "o I opti$i8e$& 9eet base" oneather an" tra:cpatterns.
S'CIAL 2 WEBA)AL;TICS
LI0E DATA5EEDS
AD0A)CA)AL;T
What’s the socialsenti$ent for $&bran" or pro"!cts
Ho pre"o!tco
A )EW SET '5 <=ESTI')
7/17/2019 Big_Data
http://slidepdf.com/reader/full/bigdata-568dd690c25b8 5/20
C'MM') BIG DATA C=ST'ME4 SCE)A4I'SGAI) C'M1ETITI0E AD0A)TAGE B; M'0I)G 5I4ST A)D 5AI)D=ST4;
Web appopti$i8ation
S$art $eter$onitorin(
E>!ip$ent$onitorin(
A"*ertisin(anal&sis
Life sciencesresearch
5ra!""etection
Healthcareo!tco$esWeatherforecastin(
)at!ral
reso!rcee,ploration
Social netorkanal&sis
Ch!rnanal&sis
Tra:c 9oopti$i8ation
ITinfrastr!ct!reopti$i8ation
Le(al"isco*er&
7/17/2019 Big_Data
http://slidepdf.com/reader/full/bigdata-568dd690c25b8 6/20
THE BIG DATA LI5EC;CLE
Insi(htMana(e Enrich
7/17/2019 Big_Data
http://slidepdf.com/reader/full/bigdata-568dd690c25b8 7/20
4elational)on?4elational Strea$in(
MA)AGE A); DATA# A); SI@E# A);
777777777777777777777777
=ni+e" Monitorin(# Mana(e$ent 2
Sec!rit&
Data Mo*e$ent
7/17/2019 Big_Data
http://slidepdf.com/reader/full/bigdata-568dd690c25b8 8/20
E,tre$el& lar(e *ol!$e of !nstr!eb lo(s
A" hoc anal&sis of lo(s to protot&patternsHa"oop "ata cl!ster fee"s lar(e 6B!siness !sers anal&8e c!be "ata
1BHa"oopCl!ster
6 TB S<LSer*er ASC!be
Micro Tools
E%(% ST4=CT=4ED 2 =)ST4=CT=4ED
7/17/2019 Big_Data
http://slidepdf.com/reader/full/bigdata-568dd690c25b8 9/20
Insi(htMana(e Enrich
THE BIG DATA LI5EC;CLE
7/17/2019 Big_Data
http://slidepdf.com/reader/full/bigdata-568dd690c25b8 10/20
E)4ICH B; C'))ECTI)G T' THE WDATA
Disco*er
Co$bine
4e+ne
7/17/2019 Big_Data
http://slidepdf.com/reader/full/bigdata-568dd690c25b8 11/20
1'WE4 '5 C'MBI)I)G THE W'4LD
1ersonalData
'r(ani8ationalData
Co$$!nit&Data
Worl"Data
0a
7/17/2019 Big_Data
http://slidepdf.com/reader/full/bigdata-568dd690c25b8 12/20
E%(% 0AL=E '5 ETE4)AL DA
“When it comes to business intelligence, Microsoft SQL Servdemonstrates that the platform has continued to advance aith the innovations that are happening in big data!"
David Mariani,0ice 1resi"ent of En(ineerin(
Connects to $ore than billion si(nals
Across lea"in( social netorks# incl!"in(
Generates a F-lo!t’ score for in"i*i"!al peoppartners
Enables anal&sis# tar(etin( an" social (raphs
7/17/2019 Big_Data
http://slidepdf.com/reader/full/bigdata-568dd690c25b8 13/20
Insi(htMana(e Enrich
THE BIG DATA LI5EC;CLE
7/17/2019 Big_Data
http://slidepdf.com/reader/full/bigdata-568dd690c25b8 14/20
I)SIGHTS ') A); DATA# ALL =SE4S# WHE4EA4E
4elational)on?4elational Strea$in(
777777777777777777777777777777
BI 1rofessionals B!siness AnaData Scientists
7/17/2019 Big_Data
http://slidepdf.com/reader/full/bigdata-568dd690c25b8 15/20
I)SIGHTS 5'4 ALL =SE4S TH4'=GH 5A T''LS
A"*ance"Anal&tics fro$Microsoft an" r" parties
Self Ser*iceAnal&sis ith1oer1i*ot 21oer 0ie
Interacti*it& 2e,ploration Ha"oop "ataE,cel
1B TB GB
BI 1rofessionals B!siness AnData Scientists
7/17/2019 Big_Data
http://slidepdf.com/reader/full/bigdata-568dd690c25b8 16/20
• Application ritten in a*a for Bi( Data 1rocessin(
• =ses the Map?4e"!ceJ 1rocessin( 1ara"i($
• Characteristics/ Ho is it "iKerent fro$ tra"itional Ser*er.
% 'pti$i8e" for "istrib!te" stora(e an" co$p!tin( of "ata
6% Hi(hl&?scalable scale o!t $o"el
% Co$$o"it& HW?base"
% 'pen So!rce
⇒.0er& lo cost for ac>!isition an" stora(e
Ha"oop is for Bi( Data%
Ha"oopData Anal&tic
Datafow
7/17/2019 Big_Data
http://slidepdf.com/reader/full/bigdata-568dd690c25b8 17/20
Distrib!te" Stora(eHD5S
<!er&Hi*e
Distrib!te" 1rocessin(
Map 4e"!ce
Scriptin(1i(
) o S <L D at a
b a s e
HB a s e
M
Meta"ataHCatalo(
D at aI nt e (r at i on
'DB C 3 S < ' '1 3
4 E S T M
B ! s i n e s s I nt el l i ( en c e
E , c el #1 o e
r 0 i eO M
MachineLearnin(Maho!t
Graph1e(as!s
Statsprocessin
(4Ha"oop
1 i p el i n e 3
or k 9 o
' o8 i e M
L o (+ l e
a ( (r e ( at i on
5 l !$ e M
A c t i * e
Di r e c t or &
S e c !r i t & M
S & s t e$ C ent er
The Ha"oop Ecos&ste$
7/17/2019 Big_Data
http://slidepdf.com/reader/full/bigdata-568dd690c25b8 18/20
Welco$e to the @ooQHDInsight
ApacheRHa"oopRon Win"os
A8!re Blob Stora(eLibHD5S5T1S
Acti*eDirector&
Need to Know*
StreamInsight
JDBC Connector
Good to Know*
HCatalo( Oo8ieA$bari
Hadoop/ #he $e%nitive? To$ White# '
7/17/2019 Big_Data
http://slidepdf.com/reader/full/bigdata-568dd690c25b8 19/20
5ee" !s back
• S!pport Tea$’s blo(/ http/33blo(s%$s"n%co$3b3bi("atas!p• 5acebook 1a(e/ https/33%facebook%co$3MicrosoftBi(Da• 5acebook Gro!p/ https/33%facebook%co$3(ro!ps3bi("a• Titter/ "ebarchans
4ea" $ore/• http/33en%ikipe"ia%or(3iki3Ha"oop• http/33en%ikipe"ia%or(3iki3Bi(U"ata
)e,t Session/• Apache Ha"oop – A "eep "i*e
7/17/2019 Big_Data
http://slidepdf.com/reader/full/bigdata-568dd690c25b8 20/20
V 676 Microsoft Corporation% All ri(hts reser*e"% Microsoft# Win"os# Win"os 0ista an" other pro"!ct na$es are or $a& be re(istere" tra"e$arks an"3or tra"e$arks in the =%S% an"3or other co!ntries% The infor$ation herein is for infor$ational p!rposes onl& an" represents the c!rrent *ie of Microsoft Corporation as of the "ate of this presentation% Beca!se Microsoft $!st respon" to chan(in( $arket con"itionsco$$it$ent on the part of Microsoft# an" Microsoft cannot (!arantee the acc!rac& of an& infor$ation pro*i"e" after the "ate of this presentation%MIC4'S'5T MA-ES )' WA44A)TIES# E14ESS# IM1LIED '4 STAT=T'4;# AS T' THE I)5'4MATI') I) THIS 14ESE)TATI')%
Recommended