Hi WeiWei, Issue 1: hadoop-log4j.properties is a log4j configuration file for Hadoop to enable streaming of Hadoop log files to Chukwa. To be more specific, the appenders are converted to use SocketAppender instead of FileRollingAppender to stream Hadoop logs directly to Chukwa. However, please make sure that the copy of hadoop-log4j.properties can apply to your version of Hadoop. Chukwa is released as source only, do you compile Chukwa? The jar files only exists in binary tarball. You may need to run "mvn clean package" from Chukwa source to obtain binary tarball, then the jar files would be inside the binary tarball.
It looks like Question 1 will be answered when you have compiled chukwa. regards, Eric On Mon, Apr 24, 2017 at 1:34 AM, weiwei <wenxuan_...@163.com> wrote: > Hi Team: > > Any progress for following problems? > > > > On Apr 20, 2017, at 12:25 PM, weiwei <wenxuan_...@163.com> wrote: > > Hi Team: > > This is Wei Wei who is now installing Chukwa 0.8 on Red Hat Linux 7. > I encountered some issues during installing Chukwa 0.8, could you please > help me to resolve them?Many thanks. > Note that the information in red below is issue/problem, the > information in blue is my responses for the relevant issues/problems. > > The environment for the Chukwa 0.8 as following: > OS==>Red Hat Enterprise Linux Server release 7.0 (Maipo) > Chukwa==>0.8.0 > Java==>1.8.0_121 > Hadoop==>2.7.2 > Hbase==>1.2.0 > $CHUKWA_HOME=/home/chukwa/chukwa-src-0.8.0 > $HADOOP_HOME=/home/hadoop/hadoop-2.7.2 > $HBASE_HOME=/home/hadoop/hbase-1.2.0 > $HADOOP_CONF_DIR=$HADOOP_HOME/etc/hadoop > $HBASE_CONF_DIR=$HBASE_HOME/conf > > According to the instructions from official website > http://chukwa.apache.org/docs/r0.8.0/Quick_Start_Guide.htmll , I have > already set the CHUWA_HOME variable. > > However on the part of “Configure Hadoop and HBase”, following > issues happened, > > Issue1: > cp $CHUKWA_HOME/etc/chukwa/hadoop-log4j.properties > $HADOOP_CONF_DIR/log4j.properties. > cp $CHUKWA_HOME/etc/chukwa/hadoop-metrics2.properties > $HADOOP_CONF_DIR/hadoop-metrics2.properties > $CHUKWA_HOME/etc/chukwa in blue above Should be $CHUKWA_HOME/conf > And I have copied above two files to the relevant directory. > > cp $CHUKWA_HOME/share/chukwa/chukwa-0.8.0-client.jar > $HADOOP_HOME/share/hadoop/common/lib > cp $CHUKWA_HOME/share/chukwa/lib/json-simple-1.1.jar > $HADOOP_HOME/share/hadoop/common/lib > There is no above two files in blue. So, I could not do that. > > cp $CHUKWA_HOME/etc/chukwa/hbase-log4j.properties $HBASE_CONF_DIR/log4j. > properties > cp $CHUKWA_HOME/etc/chukwa/hadoop-metrics2-hbase.properties > $HBASE_CONF_DIR/hadoop-metrics2-hbase.properties > I have copied above two files to the relevant directory. > > cp $CHUKWA_HOME/share/chukwa/chukwa-0.8.0-client.jar $HBASE_HOME/lib > cp $CHUKWA_HOME/share/chukwa/lib/json-simple-1.1.jar $HBASE_HOME/lib > There is no above two files in blue. So, I could not do that. > > Question1: Why couldn’t I find out the chukwa-0.8.0-client.jar and > json-simple-.1. jar? Is the package on the link http://www.apache.org/dyn/ > closer.cgi/chukwa/ correct or completed? (I downloaded several times from > different mirror site). > > Then I did "bin/hbase shell < $CHUKWA_HOME/etc/chukwa/hbase.schema”, > set the environment variables (JAVA_HOME,HADOOP_CONF_DIR, HBASE_CONF_DIR) > on the file $CHUKWA_HOME/conf/chukwa-env.sh > > When I execute the the command “bin/chukwa-daemon.sh start agent”, > following errors occurred, > ./chukwa-daemon.sh: line 42: /home/chukwa/chukwa-src-0.8.0/ > bin/../libexec/chukwa-config.sh: No such file or directory > starting agent, logging to /home/chukwa/chukwa-src-0.8.0/ > logs/chukwa-root-agent-s3538463-2.out > /home/chukwa/chukwa-src-0.8.0/bin/chukwa: line 30: > /home/chukwa/chukwa-src-0.8.0/bin/../libexec/chukwa-config.sh: No such > file or directory > [root@s3538463-2 bin]# > > I checked and found that the file chukwa-config.sh was in the > $CHUKWA_HOME/bin directory, so I did following changes: > on the file chukwa-daemon.sh, line 42==>. Change . "$bin > "/../libexec/chukwa-config.sh. to . "$bin"/chukwa-config.sh > on the file chukwa, line 30==>. Change . "$bin"/../libexec/chukwa- > config.sh. to . "$bin"/chukwa-config.sh > > I executed the command “bin/chukwa-daemon.sh start agent” again > after above changes were done. > > [root@s3538463-2 bin]# ./chukwa-daemon.sh start agent > cat: /home/chukwa/chukwa-src-0.8.0/share/chukwa/VERSION: No such > file or directory > starting agent, logging to /home/chukwa/chukwa-src-0.8.0/ > logs/chukwa-root-agent-s3538463-2.out > cat: /home/chukwa/chukwa-src-0.8.0/share/chukwa/VERSION: No such > file or directory > [root@s3538463-2 bin]# > > I found that the file VERSION was in the $CHUKWA_HOME/bin directory, > and there was no share/chukwa directory, so I made the directory > (share/chukwa) > And copy the file VERSION from $CHUKWA_HOME/bin to > $CHUKWA_HOME/share/chukwa > and change the value of the file VERSION from 0.5.0 to 0.8.0 > Question: Why the value of the file VERSION is 0.5.0, I am pretty > sure that the version of CHUKWA I downloaded is 0.8.0. > > And then I executed the command,“bin/chukwa-daemon.sh start agent”, > there was no any error information. However, It could not telnet to the > port 9093, as following: > weiweis-MacBook-Air:~ weiwei$ telnet 192.168.1.105 9093 > Trying 192.168.1.105... > telnet: connect to address 192.168.1.105: Connection refused > telnet: Unable to connect to remote host > weiweis-MacBook-Air:~ weiwei$ > > I checked the log files and no more helpful information except the > errors above. > > > [root@s3538463-2 bin]# ./chukwa-daemon.sh start hicc > starting hicc, logging to /home/chukwa/chukwa-src-0.8.0/ > logs/chukwa-root-hicc-s3538463-2.out > ls: cannot access > /home/chukwa/chukwa-src-0.8.0/share/chukwa/webapps/hicc.war: > No such file or directory > [root@s3538463-2 bin]# > > There is no this file hicc.war on the package I download. > > I also checked the root cause from the Google but I didn't find > anything. So Could you help me to resolve them? Many thanks. > > > > > > > > > >
