Posts

Showing posts from November, 2011

Hadoop at Twitter (Hadoop Summit 2010)

View more presentations from Kevin Weil

Facebook Hadoop Summit

View more presentations from Shakeel Shrestha

Hadoop and Hive Development at Facebook

View more presentations from Shakeel Shrestha

Enable password-less SSH login

To enable password-less login, generate a new SSH key with an empty passphrase: ssh-keygen -t rsa -P '' -f ~/.ssh/id_rsa cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys Test this with:      ssh localhost If successful, you should not have to type in a new password.

Installing Hadoop and Hive on Ubuntu

Steps to follow: 1. Copy unziped Hadoop and Hive folders into /home/user 2. Add these configuration in /etc/environment     PATH="home/user/Hadoop/bin:/home/user/Hive/bin"     LANG="en_US.UTF-8"     HADOOP_INSTALL="/home/user/Hadoop"     HIVE_INSTALL="/home/user/Hive" 3. In the terminal type "hadoop version" to check if it is running

Installing Java on Ubuntu Manually

Steps to follow: 1. Download jdk. I downloaded java7 from oracle's website. 2. Unzip and copy the folder into /usr/lib/jvm      Make directory jvm if it doesn't exist. I renamed the folder to java-7-oracle 3. Open /etc/environment and add this line      JAVA_HOME=/usr/lib/jvm/java-7-oracle      PATH=$PATH:$JAVA_HOME/bin 4. Then execute this command      source /etc/environment 5. On terminal type java -version to check if it shows the right version