16
HADOOP ONLINE TUTORIAL By HYDERABADSYS ONLINE TRAINING

Hadoop Online Training Institute in India,USA,UK,Canada

Embed Size (px)

Citation preview

Page 1: Hadoop Online Training Institute in India,USA,UK,Canada

HADOOP ONLINE TUTORIAL

By

HYDERABADSYS ONLINE TRAINING

Page 2: Hadoop Online Training Institute in India,USA,UK,Canada

Hadoop OnlineTraining Course Content

Basics of Hadoop: Motivation for Hadoop Large scale system training Survey of data storage literature Literature survey of data processing Networking constraints New approach requirements

Page 3: Hadoop Online Training Institute in India,USA,UK,Canada

Basic concepts of HadoopWhat is Hadoop? What is Hadoop? Distributed file system of Hadoop Map reduction of Hadoop works Hadoop cluster and its anatomy Hadoop demons

Page 4: Hadoop Online Training Institute in India,USA,UK,Canada

Master demons Name node Tracking of job Secondary node detection Slave daemons

Page 5: Hadoop Online Training Institute in India,USA,UK,Canada

Hadoop OnlineTraining Course Content

Tracking of task HDFS(Hadoop Distributed File System) Spilts and blocks Input Spilts HDFS spilts Replication of data Awareness of Hadoop racking High availably of data Block placement and cluster architecture CASE STUDIES Practices & Tuning of performances Development of mass reduce programs Local mode Running without HDFS

Page 6: Hadoop Online Training Institute in India,USA,UK,Canada

High availably of data Block placement and cluster architecture CASE STUDIES Practices & Tuning of performances Development of mass reduce programs Local mode Running without HDFS

Page 7: Hadoop Online Training Institute in India,USA,UK,Canada

Hadoop OnlineTraining Course Content

Hadoop administration Setup of Hadoop cluster of Cloud era, Apache, Green plum, Horton works On a single desktop, make a full cluster of a Hadoop setup. Configure and Install Apache Hadoop on a multi node cluster. In a distributed mode, configure and install Cloud era distribution. In a fully distributed mode, configure and install Hortom works

distribution

Page 8: Hadoop Online Training Institute in India,USA,UK,Canada

In a fully distributed mode, configure the Green Plum distribution.

Monitor the cluster Get used to the management console of

Horton works and Cloud era. Name the node in a safe mode Data backup. Case studies Monitoring of clusters

Page 9: Hadoop Online Training Institute in India,USA,UK,Canada

Hadoop OnlineTraining Course Content

Hadoop Development : Writing a MapReduce Program Sample the mapreduce program. API concepts and their basics Driver code Mapper Reducer Hadoop AVI streaming

Page 10: Hadoop Online Training Institute in India,USA,UK,Canada

Performing several Hadoop jobs Configuring close methods Sequencing of files Record reading Record writer Reporter and its role Counters Output collection

Page 11: Hadoop Online Training Institute in India,USA,UK,Canada

Assessing HDFS Tool runner Use of distributed CACHE Several MapReduce jobs (In Detailed) 1.MOST EFFECTIVE SEARCH USING MAPREDUCE 2.GENERATING THE RECOMMENDATIONS USING

MAPREDUCE 3.PROCESSING THE LOG FILES USING MAPREDUCE Identification of mapper Identification of reducer Exploring the problems using this application Debugging the MapReduce Programs MR unit testing Logging

Hadoop OnlineTraining Course Content

Page 12: Hadoop Online Training Institute in India,USA,UK,Canada

3.PROCESSING THE LOG FILES USING MAPREDUCE

Identification of mapper Identification of reducer Exploring the problems using this application Debugging the MapReduce Programs MR unit testing Logging

Page 13: Hadoop Online Training Institute in India,USA,UK,Canada

Hadoop OnlineTraining Course Content Debugging strategies Advanced MapReduce Programming Secondary sort Output and input format customization Mapreduce joins Monitoring & debugging on a Production Cluster Counters

Page 14: Hadoop Online Training Institute in India,USA,UK,Canada

Skipping Bad Records Running the local mode MapReduce performance tuning Reduction network traffic by combiner Partitioners Reducing of input data Using Compression Reusing the JVM

Page 15: Hadoop Online Training Institute in India,USA,UK,Canada
Page 16: Hadoop Online Training Institute in India,USA,UK,Canada