HADOOP: Difference between revisions

From DaqWiki
Jump to navigation Jump to search
Line 13: Line 13:
chkconfig hadoop-0.20-datanode off
chkconfig hadoop-0.20-datanode off
</pre>
</pre>
* FIXME: adjust hadoop UID/GID somehow - it is different on every machine! wrong, wrong, wrong!


* configure data node
* configure data node

Revision as of 10:11, 2 January 2012

HADOOP

Create a data node

  • install data node software
cd /triumfcs/trshare/olchansk/linux/hadoop/
rpm --import RPM-GPG-KEY-cloudera 
rpm -vh --install cdh3-repository-1.0-1.noarch.rpm-SL5 (or -SL6)
(cd $HOME; sh /triumfcs/trshare/olchansk/linux/hadoop/jdk-6u30-linux-x64-rpm.bin)
cd ~
yum install hadoop"*"datanode hadoop"*"fuse hadoop"*"native
chkconfig hadoop-0.20-datanode off
  • FIXME: adjust hadoop UID/GID somehow - it is different on every machine! wrong, wrong, wrong!
  • configure data node
ln -s /home/olchansk/sysadm/hadoop/conf.daq_test /etc/hadoop-0.20