Re: Logging level
Hi, I have a similar problem - I need to control the logging level and log file path for Hive (and Pig) at runtime from my shell script. Is there a way I could do that? Cheers! On Sun, Sep 26, 2010 at 2:20 PM, Shrijeet Paliwal shrij...@rocketfuel.comwrote: You need to set hadoop looging level to debug if you are looking at map task logs. I guess hadoop.root.logger is your friend. On Sun, Sep 26, 2010 at 12:06 AM, Steven Wong sw...@netflix.com wrote: Tried your suggestion, but it still logs at INFO level in /mnt/var/log/hadoop/userlogs/attempt_201008140123_5752_m_18_0/syslog. Am I looking in the wrong file? From: Ning Zhang [mailto:nzh...@facebook.com] Sent: Saturday, September 25, 2010 11:45 PM To: hive-user@hadoop.apache.org Cc: hive-...@hadoop.apache.org Subject: Re: Logging level hive -hiveconf hive.root.logger=DEBUG,DRFA On Sep 25, 2010, at 11:27 PM, Steven Wong wrote: How can I control the logging level of Hive code that runs in the mappers/reducers? For example, how to set it to DEBUG? Thanks. Steven
RE: Logging level
Yes, I need a way to change the logging level of map/reduce tasks for the jobs of my Hive query, without affecting the logging level of other jobs or Hadoop daemons. How do I set hadoop.root.logger to do that? -Original Message- From: Shrijeet Paliwal [mailto:shrij...@rocketfuel.com] Sent: Sunday, September 26, 2010 1:51 AM To: hive-user@hadoop.apache.org Cc: hive-...@hadoop.apache.org Subject: Re: Logging level You need to set hadoop looging level to debug if you are looking at map task logs. I guess hadoop.root.logger is your friend. On Sun, Sep 26, 2010 at 12:06 AM, Steven Wong sw...@netflix.com wrote: Tried your suggestion, but it still logs at INFO level in /mnt/var/log/hadoop/userlogs/attempt_201008140123_5752_m_18_0/syslog. Am I looking in the wrong file? From: Ning Zhang [mailto:nzh...@facebook.com] Sent: Saturday, September 25, 2010 11:45 PM To: hive-user@hadoop.apache.org Cc: hive-...@hadoop.apache.org Subject: Re: Logging level hive -hiveconf hive.root.logger=DEBUG,DRFA On Sep 25, 2010, at 11:27 PM, Steven Wong wrote: How can I control the logging level of Hive code that runs in the mappers/reducers? For example, how to set it to DEBUG? Thanks. Steven
RE: Logging level
Hmm, it doesn't seem possible before MAPREDUCE-336 is fixed. -Original Message- From: Steven Wong [mailto:sw...@netflix.com] Sent: Monday, September 27, 2010 10:31 AM To: hive-user@hadoop.apache.org Cc: hive-...@hadoop.apache.org Subject: RE: Logging level Yes, I need a way to change the logging level of map/reduce tasks for the jobs of my Hive query, without affecting the logging level of other jobs or Hadoop daemons. How do I set hadoop.root.logger to do that? -Original Message- From: Shrijeet Paliwal [mailto:shrij...@rocketfuel.com] Sent: Sunday, September 26, 2010 1:51 AM To: hive-user@hadoop.apache.org Cc: hive-...@hadoop.apache.org Subject: Re: Logging level You need to set hadoop looging level to debug if you are looking at map task logs. I guess hadoop.root.logger is your friend. On Sun, Sep 26, 2010 at 12:06 AM, Steven Wong sw...@netflix.com wrote: Tried your suggestion, but it still logs at INFO level in /mnt/var/log/hadoop/userlogs/attempt_201008140123_5752_m_18_0/syslog. Am I looking in the wrong file? From: Ning Zhang [mailto:nzh...@facebook.com] Sent: Saturday, September 25, 2010 11:45 PM To: hive-user@hadoop.apache.org Cc: hive-...@hadoop.apache.org Subject: Re: Logging level hive -hiveconf hive.root.logger=DEBUG,DRFA On Sep 25, 2010, at 11:27 PM, Steven Wong wrote: How can I control the logging level of Hive code that runs in the mappers/reducers? For example, how to set it to DEBUG? Thanks. Steven
Re: Logging level
hive -hiveconf hive.root.logger=DEBUG,DRFA On Sep 25, 2010, at 11:27 PM, Steven Wong wrote: How can I control the logging level of Hive code that runs in the mappers/reducers? For example, how to set it to DEBUG? Thanks. Steven
RE: Logging level
Tried your suggestion, but it still logs at INFO level in /mnt/var/log/hadoop/userlogs/attempt_201008140123_5752_m_18_0/syslog. Am I looking in the wrong file? From: Ning Zhang [mailto:nzh...@facebook.com] Sent: Saturday, September 25, 2010 11:45 PM To: hive-user@hadoop.apache.org Cc: hive-...@hadoop.apache.org Subject: Re: Logging level hive -hiveconf hive.root.logger=DEBUG,DRFA On Sep 25, 2010, at 11:27 PM, Steven Wong wrote: How can I control the logging level of Hive code that runs in the mappers/reducers? For example, how to set it to DEBUG? Thanks. Steven
Re: Logging level
You need to set hadoop looging level to debug if you are looking at map task logs. I guess hadoop.root.logger is your friend. On Sun, Sep 26, 2010 at 12:06 AM, Steven Wong sw...@netflix.com wrote: Tried your suggestion, but it still logs at INFO level in /mnt/var/log/hadoop/userlogs/attempt_201008140123_5752_m_18_0/syslog. Am I looking in the wrong file? From: Ning Zhang [mailto:nzh...@facebook.com] Sent: Saturday, September 25, 2010 11:45 PM To: hive-user@hadoop.apache.org Cc: hive-...@hadoop.apache.org Subject: Re: Logging level hive -hiveconf hive.root.logger=DEBUG,DRFA On Sep 25, 2010, at 11:27 PM, Steven Wong wrote: How can I control the logging level of Hive code that runs in the mappers/reducers? For example, how to set it to DEBUG? Thanks. Steven
