Dear Wiki user, You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.
The following page has been changed by andyk: http://wiki.apache.org/hadoop/Chukwa_Quick_Start ------------------------------------------------------------------------------ '''Configure Chukwa''' (For an explanation of each configuration file in the conf directory, see ["Chukwa Configuration"]) - 1. Specify your JAVA_HOME and HADOOP_HOME in conf/chukwa-env.sh + 1. Specify your JAVA_HOME and HADOOP_HOME in conf/chukwa-env.sh - 1. Specify which hosts to run collectors on in the conf/collectors file. + 1. Specify which hosts to run collectors on in the conf/collectors file. - 1. Like in Hadoop, you need to specify a set of nodes on which you want to run Chukwa agents (similar to conf/slaves in Hadoop) using a conf/slaves file. The local agents on each machine will also reference the conf/collectors file, selecting a collector at random from this list to talk to. Thus, like Hadoop, it is common to run Chukwa from a shared file system where all of the agents (i.e. slaves) can access the same conf files. + 1. Like in Hadoop, you need to specify a set of nodes on which you want to run Chukwa agents (similar to conf/slaves in Hadoop) using a conf/slaves file. The local agents on each machine will also reference the conf/collectors file, selecting a collector at random from this list to talk to. Thus, like Hadoop, it is common to run Chukwa from a shared file system where all of the agents (i.e. slaves) can access the same conf files. - 1. Setup the initial adaptors you want to run on every agent in the chukwa cluster by copying conf/initial_adaptors.template to conf/initial_adaptors and adding whichever adaptors you see fit. See the ["Chukwa Adaptors List"] for a catalog of pre-made adaptors. + 1. Setup the initial adaptors you want to run on every agent in the chukwa cluster by copying conf/initial_adaptors.template to conf/initial_adaptors and adding whichever adaptors you see fit. See the ["Chukwa Adaptors List"] for a catalog of pre-made adaptors. '''Run Chukwa''' - 1. run bin/start-all.sh to start all agents, collectors, data loaders, and schedule the demux MapReduce job to run every 5 minutes over top of the datasink. Use bin/stop-all.sh to shut everything down. + 1. run bin/start-all.sh to start all agents, collectors, data loaders, and schedule the demux MapReduce job to run every 5 minutes over top of the datasink. Use bin/stop-all.sh to shut everything down. '''OR''' run the collectors and agents independently (without other scripts running as part of startup and shutdown) - 1. Start the collectors in your cluster with the command <code>bin/start-collectors.sh</code> (use bin/stop-collectors.sh to shut them down). + 1. Start the collectors in your cluster with the command <code>bin/start-collectors.sh</code> (use bin/stop-collectors.sh to shut them down). - 1. Start the agents by running <code>bin/start-agents.sh</code> (use bin/stop-agents.sh to shut them down). + 1. Start the agents by running <code>bin/start-agents.sh</code> (use bin/stop-agents.sh to shut them down).
