10
Hadoop MapReduce

Hadoop - csc.villanova.eduekim/classes/CSC2053F18/Hadoop.pdf · — users publish posts receives new comments new are created - conducts tinder searches snaps new professionals users

  • Upload
    others

  • View
    5

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Hadoop - csc.villanova.eduekim/classes/CSC2053F18/Hadoop.pdf · — users publish posts receives new comments new are created - conducts tinder searches snaps new professionals users

Hadoop MapReduce

Page 2: Hadoop - csc.villanova.eduekim/classes/CSC2053F18/Hadoop.pdf · — users publish posts receives new comments new are created - conducts tinder searches snaps new professionals users

Big Data

Page 3: Hadoop - csc.villanova.eduekim/classes/CSC2053F18/Hadoop.pdf · — users publish posts receives new comments new are created - conducts tinder searches snaps new professionals users

• Over 2.5 quintillion bytes of data are created every single day, and it's only going to grow from there. By 2020, it's estimated that 1.7MB ofdata will be created every second for every person on earth."

Page 4: Hadoop - csc.villanova.eduekim/classes/CSC2053F18/Hadoop.pdf · — users publish posts receives new comments new are created - conducts tinder searches snaps new professionals users

• http://www.internetlivestats.com/one-second/

Page 5: Hadoop - csc.villanova.eduekim/classes/CSC2053F18/Hadoop.pdf · — users publish posts receives new comments new are created - conducts tinder searches snaps new professionals users

• ./hadoop jar /opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.2.jar wordcount /license.txt /license-out

Page 6: Hadoop - csc.villanova.eduekim/classes/CSC2053F18/Hadoop.pdf · — users publish posts receives new comments new are created - conducts tinder searches snaps new professionals users

Word Count

Page 7: Hadoop - csc.villanova.eduekim/classes/CSC2053F18/Hadoop.pdf · — users publish posts receives new comments new are created - conducts tinder searches snaps new professionals users
Page 8: Hadoop - csc.villanova.eduekim/classes/CSC2053F18/Hadoop.pdf · — users publish posts receives new comments new are created - conducts tinder searches snaps new professionals users
Page 9: Hadoop - csc.villanova.eduekim/classes/CSC2053F18/Hadoop.pdf · — users publish posts receives new comments new are created - conducts tinder searches snaps new professionals users
Page 10: Hadoop - csc.villanova.eduekim/classes/CSC2053F18/Hadoop.pdf · — users publish posts receives new comments new are created - conducts tinder searches snaps new professionals users