11
LEANDRO DA COSTA GONÇALVES

Lightning talk hadoop

Embed Size (px)

DESCRIPTION

 

Citation preview

Page 1: Lightning talk hadoop

LEANDRO DA COSTA GONÇALVES

Page 2: Lightning talk hadoop

INTRODUTION Framework for distributed computing; Used in clusters/grids; Thousands of nodes; Common hardware; Petabytes of data; Open Source (Apache license); Java; Originally inspired by Google's MapReduce and GFS.

Page 3: Lightning talk hadoop

WHO USES HADOOP?

FACEBOOK; GOOGLE; YAHOO; STOCK EXCHANGE FROM NEW YORK; CERN.

Page 4: Lightning talk hadoop

PRINCIPALS COMPONENTS

Auto-recoveryHigh bandwidth consuption

ClusteringHighly tolerant of failures

Fault ToleranceDistributed processing

Page 5: Lightning talk hadoop

LIFE CYCLE OF MAPREDUCE

Page 6: Lightning talk hadoop

MAPREDUCE OF WORD COUNT

Page 7: Lightning talk hadoop

MAPPER

Page 8: Lightning talk hadoop

REDUCER

Page 9: Lightning talk hadoop

THE MAIN

Page 10: Lightning talk hadoop

THE HADOOP ECOSYSTEM

Page 11: Lightning talk hadoop

CONCLUSION

BigDataThe foundations Apache and Spring

SourceGoogle and FacebookSocial networks