Hadoop

From CS Support Wiki
Revision as of 20:40, 12 September 2014 by Jpr9c (Talk | contribs) (Created page with "The department currently has a small, somewhat limited Hadoop cluster available for department users. Resource sharing is not mediated by PBS or any other kind of resource sc...")

(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to: navigation, search

The department currently has a small, somewhat limited Hadoop cluster available for department users. Resource sharing is not mediated by PBS or any other kind of resource scheduling system so please be aware of other users and please clean up your work.

Hadoop Installation

Hadoop Software

The hadoop package currently installed in /opt/hadoop-2.4.1/

The preferred Java (and set as your $JAVA_HOME) is Sun 1.7 in /opt/java:

jpr9c@centurion002
: /af13/jpr9c ; java -version
java version "1.7.0_67"
Java(TM) SE Runtime Environment (build 1.7.0_67-b01)
Java HotSpot(TM) 64-Bit Server VM (build 24.65-b04, mixed mode)

HDFS

YARN