Hadoop

From CS Support Wiki
Jump to: navigation, search

The department currently has a small, somewhat limited Hadoop cluster available for department users. Resource sharing is not mediated by PBS or any other kind of resource scheduling system so please be aware of other users and please clean up your work.

Hadoop Installation

Hadoop Software

The hadoop package currently installed in /opt/hadoop-2.4.1/

The preferred Java (and set as your $JAVA_HOME) is Sun 1.7 in /opt/java:

jpr9c@centurion002
: /af13/jpr9c ; java -version
java version "1.7.0_67"
Java(TM) SE Runtime Environment (build 1.7.0_67-b01)
Java HotSpot(TM) 64-Bit Server VM (build 24.65-b04, mixed mode)

HDFS

YARN