How to Install Hadoop on Mac OS X 10.10 Yosemite Step-by-Step Guide

Hadoop 2.X Quick Start on macOS 10.10 Yosemite

Hi! The Tutorial shows you Step-by-Step How to Install and Getting-Started with Apache Hadoop/Map-Reduce vanilla in Pseudo-Distributed mode on Mac OS X 10.10 Yosemite Desktop.

Hadoop is a distributed master-slave that consists of the Hadoop Distributed File System (HDFS) for storage and Map-Reduce for computational capabilities.

The Guide Describe a System-Wide Setup with Root Privileges but you Can Easily Convert the Procedure to a Local One.

Apache Hadoop Require the Java JDK 6+ Installed so If Needed Just Update your Mac 10.10 Yosemite.

The Contents and Details of How to Install Hadoop on macOS 10.10 Yosemite are Expressly Essentials to Give Focus Only to the Essentials Instructions and Commands.

1. Download Latest Apache Hadoop Stable Release:

   Here Apache Hadoop Binary tar.gz

   Link to Download Latest Apache Hadoop Stable tar.gz Archive Release

2. Double-Click on Archive to Extract

3. Open Terminal Window
   (Press “Enter” to Execute Commands)

   

   In case first see: Terminal QuickStart Guide.

4. Relocate Apache Hadoop Directory

   Copy

   sudo mv $HOME/Downloads/hadoop* /usr/local

   Copy

   sudo ln -s /usr/local/hadoop-[2.x] /usr/local/hadoop

   Copy

   sudo mkdir /usr/local/hadoop/tmp

   Copy

   sudo chown -R root:admin /usr/local/hadoop*

5. Check if Java JDK 6/7 is Installed

   Copy

   java --version

   How to Install Required Oracle JDK on MacOS X

   Here Install Oracle JDK for Mac

   How to Install OracleJava JDK 7 on MacOS X

6. Set JAVA_HOME in Hadoop Env File.

   Copy

   sudo su

   If Got “User is Not in Sudoers file” then see: How to Enable sudo

   Copy

   mkdir /usr/local/hadoop/conf

   Copy

   nano /usr/local/hadoop/conf/hadoop-env.sh

   Append:

   Copy

   export JAVA_HOME=$(/usr/libexec/java_home)
   

   Ctrl+x to Save & Exit :)

7. Configuration for Pseudo-Distributed mode

   Copy

   nano /usr/local/hadoop/conf/core-site.xml

   The Content Should Look Like:

   Copy

   <?xml version="1.0"?>
   <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
   <configuration>
   <property>
   <name>hadoop.tmp.dir</name>
   <value>/usr/local/hadoop/tmp</value>
   </property>
   <property>
   <name>fs.default.name</name>
   <value>hdfs://localhost:8020</value>
   </property>
   </configuration>
   

   Next:

   Copy

   nano /usr/local/hadoop/conf/hdfs-site.xml

   The Content Should Look Like:

   Copy

   <?xml version="1.0"?>
   <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
   <configuration>
   <property>
   <name>dfs.replication</name>
   <value>1</value>
   </property>
   <property>
   <!-- specify this so that running 'hdfs namenode -format'
   formats the right dir -->
   <name>dfs.name.dir</name>
   <value>/usr/local/hadoop/cache/hadoop/dfs/name</value>
   </property>
   </configuration>
   

   Latest:

   Copy

   nano /usr/local/hadoop/conf/mapred-site.xml

   The Content Should Look Like:

   Copy

   <?xml version="1.0"?>
   <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
   <configuration>
   <property>
   <name>mapred.job.tracker</name>
   <value>localhost:8021</value>
   </property>
   </configuration>
   

8. SetUp Local Path & Environment.

   Copy

   exit

   Copy

   cd  

   Copy

   nano .profile

   Inserts:

   Copy

   HADOOP_HOME=/usr/local/hadoop
   export PATH=$PATH:$HADOOP_HOME/bin:$HADOOP_HOME/sbin
   

   The JAVA_HOME is Set Following Oracle Java JDK6+ Installation Version…

   Then Load New Setup:

   Copy

   source $HOME/.profile

9. SetUp Needed Local SSH Connection.

   Enable SSH Connection:

   Copy

   System Preferences > Sharing

   

   Testing Connection:

   Copy

   ssh 127.0.0.1

10. Formatting HDFS

    Copy

    hdfs namenode -format

    

11. Starting Up Hadoop Database

    Copy

    start-all.sh

12. Apache Hadoop Database Quick Start Guide

    Here Hadoop MapReduce Quick Start

    Apache Hadoop Step-by-Step Quick Start Guide

Eclipse Hadoop 2.X Integration with Free Plugin.

Here Hadoop 2.X Eclipse Plugin SetUp
How to Install Eclipse Hadoop 2.X Plugin