Dear Wiki user, You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.
The following page has been changed by andykonwinski: http://wiki.apache.org/hadoop/Chukwa_Quick_Start The comment on the change is: formatting ------------------------------------------------------------------------------ == Compiling and installing Chukwa == - - If Chukwa is in the hadoop contrib directory, you should be able to just say ``ant'' in the project root directory. + 1. If Chukwa is in the hadoop contrib directory, you should be able to just say ''ant'' in the project root directory. == Configuring and starting the Collector == - - Copy conf/chukwa-collector-conf.xml.template to conf/chukwa-collector-conf.xml + 1. Copy conf/chukwa-collector-conf.xml.template to conf/chukwa-collector-conf.xml - - - Edit the writer.hdfs.filesystem property to point to a real filesystem. + 1. Edit the writer.hdfs.filesystem property to point to a real filesystem. - - - If you are running hadoop, this should be the path to the namenode. + 1. If you are running hadoop, this should be the path to the namenode. - - - If you are not running hadoop, you can just juse a local path, of the form file:///tmp/chukwa. + 1. If you are not running hadoop, you can just juse a local path, of the form file:///tmp/chukwa. - - - Copy conf/chukwa-env.sh-template to conf/chukwa-env.sh. Set JAVA_HOME in file. + 1. Copy conf/chukwa-env.sh-template to conf/chukwa-env.sh. Set JAVA_HOME in file. - - - Download the Apache logging commons jar from http://commons.apache.org/downloads/download_logging.cgi + 1. Download the Apache logging commons jar from http://commons.apache.org/downloads/download_logging.cgi - - - Copy the 'commons-logging-X.Y.Z.jar' file to $HADOOP_HOME/src/contrib/chukwa/lib + 1. Copy the 'commons-logging-X.Y.Z.jar' file to $HADOOP_HOME/src/contrib/chukwa/lib - - - In the chukwa root directory, say ``bash bin/jettyCollector.sh'' + 1. In the chukwa root directory, say ``bash bin/jettyCollector.sh'' == Configuring and starting the Local Agent == - - Copy conf/chukwa-agent-conf.xml.template to conf/chukwa-agent-conf.xml + 1. Copy conf/chukwa-agent-conf.xml.template to conf/chukwa-agent-conf.xml - - - Copy conf/collectors.template to conf/collectors + 1. Copy conf/collectors.template to conf/collectors - - - In the chukwa root directory, say ``bash bin/agent.sh'' + 1. In the chukwa root directory, say ``bash bin/agent.sh'' == Starting Adaptors == The local agent speaks a simple text-based protocol, by default over port 9093. Suppose you want Chukwa to start tailing a file /path/to/file of type MyFileType on localhost: - - Telnet to localhost 9093 + 1. Telnet to localhost 9093 - - - Type [without quotation marks] "ADD CharFileTailerUTF8 MyFileType /path/to/file 0" + 1. Type [without quotation marks] "ADD CharFileTailerUTF8 MyFileType /path/to/file 0" - - - Chukwa internal Namenode's type is NameNodeType so for namenode log type (without quotation marks): "ADD CharFileTailerUTF8 NameNodeType /path/to/nameNodeFie 0" + 1. Chukwa internal Namenode's type is NameNodeType so for namenode log type (without quotation marks): "ADD CharFileTailerUTF8 NameNodeType /path/to/nameNodeFie 0" - - - (Document TODO: the above command does not work and errors with "don't recognize adaptor name CharFileTailerUTF8". Similarly, it's not clear what /path/to/file should be in the case of tracking a name node. Should it be $HDFS/dfs/name/current/fsimage?) + 1. (Document TODO: the above command does not work and errors with "don't recognize adaptor name CharFileTailerUTF8". Similarly, it's not clear what /path/to/file should be in the case of tracking a name node. Should it be $HDFS/dfs/name/current/fsimage?) - - - Type "list" -- you should see the adaptor you just started, listed as running. + 1. Type "list" -- you should see the adaptor you just started, listed as running. - - - Type "close" to break the connection. + 1. Type "close" to break the connection. - - If you don't have telnet, you can get the same effect with netcat (``nc''). + 1. If you don't have telnet, you can get the same effect with netcat (''nc''). == Configuring and starting the demux job == @@ -81, +66 @@ - Startup Tomcat. - == RUNNING CHUKWA -- NETWORKED == + == Running Chukwa -- Networked == Running Chukwa in a networked context is essentially similar to the single-machine deployment discussed above. However, in a network context, you would also need to tell the local agent where the collector[s] live, by listing them in conf/collectors.
