CLOUD INFRASTRUCTURE SERVICES
Topic : Installing Hadoop on Raspberry Pi
Mentor : Mr. Manoj Kumar Baliyan
Team Member: Aniket Maithani
Rajat Goyal
What is Raspberry Pi?
The Raspberry Pi is a credit-card-sized single-board computer developed in the UK by the Raspberry Pi Foundation with the intention of promoting the teaching of basic computer science in schools.
The Raspberry Pi is manufactured in two board configurations, Pi A and Pi B.
It was first released in 2012 and since then massive development work have been done over it.
Components of Raspberry Pi
For our current project, we have purchased Raspberry Pi Model B. It's basic structure is given here :
Raspberry Pi in India Some of the major hardware distributors that
sell Raspbery Pi in India are Element 14, RCElectro etc.
Pi B model cost around 3000/- Rs. The model does not contain any accessories,
in general unless is given under some offer by the hardware distributor.
Accessories Required with Pi
With Pi, you need the following accessories Micro USB Charger
Ethernet Cable SD Card
HDMI cable HDMI – VGA Converter
RSA cable [optional] In case you are planning to use more
attachment with Pi, you'll also be needing a USB Power Hub.
Making SDHC card bootable
Before you start configuring your Pi, you need to make the SD Card Bootable.
This can be done easily. You need to download the available distros for
Pi, from their official website : http://www.raspberrypi.org/downloads
I downloaded the 'Raspbian Wheezy'
Making SDHC card bootable
After downloading the .img file. I used PowerISO software [Windows] to burn the .img on the card and make it bootable.
If you are using Linux, you can use UNetBootin or some other program, in case your version of UNetBootin doesn't supports .img file.
Let's get started....
Once you have loaded the distro into the card, all you need to do is plug in the card in the memory card slot.
Connect the neccessary peripherals in the USB slots.
Connect your output cable [RCA/HDMI whatever is your preference].
This is what our setup looks like
On the first bootup You'll see the following screen on your first
bootup, please go through the options carefully.
Configuration
Since Pi does not have start/off switch on board, it automatically gets started once you plugged in the power source.
Now you'll see the first bootup screen. When it is done, it will prompt you for login The default username for Pi Board is pi and
password is raspberry. Once it accepts your credentials, you'll see the
command prompt. Type startx and GUI session will start.
Tada..
This is what the GUI interface of Wheezy looks like.
Connecting to Internet
To connect your Pi to internet you can use both wifi dongle or ethernet cable.
During this process I chose ethernet to connect Pi to Internet.
DHCP setting, automatically detected by Pi.
Configuring Hadoop
Before configuring Hadoop on a single node Pi . We need to install webserver onto it.
This can be done by executing the following commands on the terminal.
$: apt-get install phpmyadmin apache2 php5 php5-cli mysql-server
Installation Process● Here is a snapshot of the installation process.
Hadoop
●Before installing Hadoop we need to install OpenJDK on Pi. ● Then we need to create Hadoop system user. ●Set up the ssh.●Install Hadoop from any of the given mirrors. ● Edit .bashrc file accordingly, specify path into it. ●Then once Hadoop is installed, configure the hadoop-env.sh file.
Final Step
● You can find more details about configuration at our blog. [experimentswithpi.blogspot.in]
● If all goes well, restart the pi and enter ● $ hadoop version in terminal, you'll see this● Hadoop 1.2.1● Subversion
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.2 -r 1503152
● Compiled by mattf on Mon Jul 22 15:23:09 PDT 2013● From source with checksum 6923c86528809c4e7e6f493b6b413a9a● This command was run using /usr/local/hadoop/hadoop-1.2.1/hadoop-
core-1.2.1.jar
Future Scope
● I'll be adding more Pi, making a comhrensive and robust cluster● Load Balancer to be configured● Will be creating an application using HadooPY
For detailed information you can visit our blog:
http://experimentswithpi.blogspot.in
References
Wikipedia Raspberry Pi Foundation Official Blog IRC #RaspberryPi DIY Guides ADAFRUIT Apache Hadoop Guide
About This Presentation
The following presentation is released under CC License.
All the “products/softwares” described in the presentation belongs to their respectful owners.
The following presentation is a cumulation of our research work, this can be reproduce provided proper citation of our work is given.