This obviously doesn't help you with 2.4, but in trunk/3.x this is 
significantly easier to do:

hdfs --loglevel DEBUG namenode  (interactive/non-daemon mode, output to 
console, usually)

hdfs --loglevel DEBUG --daemon start namenode (daemon mode, output to log file, 
usually)



On Mar 25, 2015, at 8:13 AM, xiaohe lan <zombiexco...@gmail.com> wrote:

> Hi Charles,
> 
> In my hadoop-env.sh, I set
> 
> export HADOOP_CLIENT_OPTS="-Dhadoop.root.logger=DEBUG,console -Xmx512m
> $HADOOP_CLIENT_OPTS"
> 
> However, I could not see the debug log in NN's log file
> hadoop-xilan-namenode-xxxx.out. By setting export
> HADOOP_ROOT_LOGGER="DEBUG,console" I could see lots of debug log.
> 
> One more question is what will be written to the .log file and what will be
> written to the .out file ?
> 
> @Rich,
> 
> I also tried your method but I could not see the debug log as well. I must
> be missing something.
> 
> Thanks,
> Xiaohe
> 
> On Tue, Mar 24, 2015 at 10:55 PM, Rich Haase <rha...@pandora.com> wrote:
> 
>> If you want to enable debug logging of all hadoop components you can add
>> this line to your log4j.properties.
>> 
>> log4j.logger.org.apache.hadoop=DEBUG
>> 
>> However, in a 3 node cluster that is doing next to nothing this produces a
>> lot of log output, so I find it preferable to specify an one daemon type at
>> a time to enable debug logging on, e.g.
>> 
>> log4j.logger.org.apache.hadoop.NameNode=DEBUG
>> 
>> It’s also worth while to review the hadoop daemonlog command, which can be
>> used to change the log level of running daemons.
>> 
>> Cheers,
>> 
>> Rich
>> 
>> On Mar 24, 2015, at 10:38 AM, Charles Lamb <cl...@cloudera.com<mailto:
>> cl...@cloudera.com>> wrote:
>> 
>> One way is to do:
>> 
>> HADOOP_CLIENT_OPTS="-Dhadoop.root.logger=DEBUG,console"
>> 
>> IHTH.
>> 
>> Charles
>> 
>> On 3/24/2015 10:25 AM, xiaohe lan wrote:
>> ---------- Forwarded message ----------
>> From: xiaohe lan <zombiexco...@gmail.com<mailto:zombiexco...@gmail.com>>
>> Date: Tue, Mar 24, 2015 at 9:04 PM
>> Subject: How to enable debug log in HDFS
>> To: u...@hadoop.apache.org<mailto:u...@hadoop.apache.org>
>> 
>> 
>> Hi expert,
>> 
>> I am using Hadoop 2.4, I need to see the debug log of HDFS when performing
>> some operations. Where can I set it. I did a search in log4j.properties but
>> I don't what can I do with it.
>> 
>> Thanks,
>> Xiaohe
>> 
>> 
>> 
>> 

Reply via email to