How-to Install Eclipse Hadoop/Map-Reduce 2.X Plugin on Linux/Unix Easy Guide

March 3rd, 2014 by thelinuxevangelist

Eclipse Hadoop/Map-Reduce 2.X Integration

The Short Guide Shows You Step-by-Step How-to Download, Compile and Install the Eclipse Plugin for Hadoop/Map-Reduce 2.X Release for Linux/Unix.

Hadoop is an open source framework for writing and running distributed applications that process Big Data (large amounts of data).

Hadoop 2.x New Features:

  • MapReduce NextGen (YARN) resource management system as a general big data processing platform.
  • Pluggable Shuffle and Pluggable Sort. For more information, go to Pluggable Shuffle and Pluggable Sort.
  • Capacity Scheduler and Fair Scheduler. For more information, go to Capacity Scheduler and Fair Scheduler.
  • Hadoop Distributed File System (HDFS) snapshots. For more information, go to HDFS Snapshots.
  • Performance-related enhancements such as short-circuit read. For more information, go to HDFS Short-Circuit Local Reads.
  • Distributed job life cycle management by the application master.
  • Various security improvements.
Eclipse Hadoop/Map-Reduce 2.X Integration - Featured
  1. Download Eclipse Hadoop 2.X Plugin Source:

    Eclipse Hadoop Plugin .zip
  2. Generate Hadoop 2.X Plugin

    cd /[path/2]/hadoop2x-eclipse-plugin-master/src/contrib/eclipse-plugin
    ant jar -Dversion=2.2.0 -Declipse.home=/opt/eclipse -Dhadoop.home=/usr/share/hadoop

    How-to Install Apache Ant on Linux Distributions:

    Install Ant on Linux

    Wait for a Little Moment…

    Then the jar Plugin will be Generated at Directory:

    /[path/2]/hadoop2x-eclipse-plugin-master/build/contrib/eclipse-plugin/hadoop-eclipse-plugin-2.2.0.jar
  3. How-to Install Manually Eclipse Plugin from Jar:

    Eclipse Plugin Manual SetUp
  4. Then You are Able to Create a Map-Reduce Eclipse Project

    Eclipse Hadoop/Map-Reduce 2.X Integration - Featured

Tags: , , , , , , , , , , ,