How to Install Hadoop on Red Hat Enterprise Linux 7 Step-by-Step Guide

April 23, 2019 | By the+gnu+linux+evangelist.

Hadoop RedHat Linux 7 - Setting Up

Relocate Apache Hadoop Directory
Get SuperUser Privileges:
Copy
```
sudo su
```
If Got “User is Not in Sudoers file” then see: How to Enable sudo
Then Switch the contents with:
Copy
```
mv /tmp/hadoop* /usr/local/
```
Make an hadoop symlink directory:
Copy
```
ln -s /usr/local/hadoop* /usr/local/hadoop
```
Make Hadoop Needed Directories:

First, Make the Logs Dir:
Copy
```
mkdir /usr/local/hadoop/logs
```
Giving Writing Permissions:
Copy
```
chmod 777 /usr/local/hadoop/logs
```
Next Make the Cache Dir:
Copy
```
mkdir /usr/local/hadoop/cache
```
Same Writing Permissions as for Logs:
Copy
```
chmod 777 /usr/local/hadoop/cache
```
And then also the Temporary Dir:
Copy
```
mkdir /usr/local/hadoop/tmp
```
Set the root as Owner:
Copy
```
sudo chown -R root:root /usr/local/hadoop*
```
How to Install Required Java JDK 8+ on Red Hat Linux

Here Install Oracle JDK 8+ for Red Hat Linux

Link to Download and Install Oracle JDK 8+ on Red Hat Linux Distro
Set JAVA_HOME in Hadoop Env File
Make the Conf directory:
Copy
```
mkdir /usr/local/hadoop/conf
```
Make an Env file:
Copy
```
nano /usr/local/hadoop/conf/hadoop-env.sh
```
Append:
Copy
```
export JAVA_HOME=/usr/lib/jvm/[oracleJdkVersion]
```
Change [oracleJdkVersion] with the current Version:
Ctrl+x to Save & Exit from nano Editor :)

Eclipse Hadoop Integration with Free Plugin.

Here Hadoop Eclipse Plugin SetUp

How to Install Eclipse Hadoop Plugin

Hadoop Configuration for Pseudo-Distributed mode

Copy

nano /usr/local/hadoop/conf/core-site.xml

Append:

Copy

<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
<property>
<name>hadoop.tmp.dir</name>
<value>/usr/local/hadoop/tmp</value>
</property>
<property>
<name>fs.default.name</name>
<value>hdfs://localhost:8020</value>
</property>
</configuration>

Copy

nano /usr/local/hadoop/conf/hdfs-site.xml

Append:

Copy

<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
<property>
<!-- specify this so that running 'hdfs namenode -format'
formats the right dir -->
<name>dfs.name.dir</name>
<value>/usr/local/hadoop/cache/hadoop/dfs/name</value>
</property>
</configuration>

Last:

Copy

nano /usr/local/hadoop/conf/mapred-site.xml

Append:

Copy

<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
<property>
<name>mapred.job.tracker</name>
<value>localhost:8021</value>
</property>
</configuration>

SetUp Local Path & Environment
Exit from SuperUser to the normal User:
Copy
```
exit
```
Change to the Home directory:
Copy
```
cd  
```
Edit the bash Config file:
Copy
```
nano .bashrc
```
Inserts:
Copy
```
HADOOP_HOME=/usr/local/hadoop
export PATH=$PATH:$HADOOP_HOME/bin:$HADOOP_HOME/sbin
export JAVA_HOME=/usr/lib/jvm/<oracleJdkVersion>
```
Then Load the New Setup:
Copy
```
source $HOME/.bashrc
```

SetUp Needed Local SSH Connection

Copy

sudo systemctl start ssh

Generate SSH Keys to Access:

Copy

ssh-keygen -b 2048 -t rsa

Copy

echo "$(cat ~/.ssh/id_rsa.pub)" > ~/.ssh/authorized_keys

Testing Connection:

Copy

ssh 127.0.0.1

Formatting HDFS
Copy
```
hdfs namenode -format
```
Starting Up Hadoop Database
Copy
```
start-all.sh
```

Pages: 1 2 3 4

How to Install Hadoop on Red Hat Enterprise Linux 7 Step-by-Step Guide

Hadoop RedHat Linux 7 - Setting Up

Contents