[
https://issues.apache.org/jira/browse/TEZ-1775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240827#comment-14240827
]
Siddharth Seth edited comment on TEZ-1775 at 12/10/14 8:54 AM:
---------------------------------------------------------------
Updated patch which allows for task specific log levels.
bq. It would be good to print the changes in the logs/console
Do you mean printing the log level that will be used on the client before each
job starts ?
Ready for review.
The following are the options that can be used.
{code}
<property>
<name>tez.am.log.level</name>
<value>INFO;org.apache.tez.dag.app=INFO</value>
<!--value>INFO</value-->
</property>
<property>
<name>tez.task.log.level</name>
<!--value>DEBUG;org.apache.hadoop.ipc=INFO;org.apache.hadoop.security=INFO</value-->
<value>INFO</value>
</property>
<property>
<name>tez.task-specific.log.level</name>
<value>DEBUG;org.apache.hadoop.ipc=INFO;org.apache.hadoop.security=INFO</value>
</property>
{code}
was (Author: sseth):
Updated patch which allows for task specific log levels.
bq. It would be good to print the changes in the logs/console
Do you mean printing the log level that will be used on the client before each
job starts ?
The following are the options that can be used.
{code}
<property>
<name>tez.am.log.level</name>
<value>INFO;org.apache.tez.dag.app=INFO</value>
<!--value>INFO</value-->
</property>
<property>
<name>tez.task.log.level</name>
<!--value>DEBUG;org.apache.hadoop.ipc=INFO;org.apache.hadoop.security=INFO</value-->
<value>INFO</value>
</property>
<property>
<name>tez.task-specific.log.level</name>
<value>DEBUG;org.apache.hadoop.ipc=INFO;org.apache.hadoop.security=INFO</value>
</property>
{code}
> Simpler task / AM logger configuration
> --------------------------------------
>
> Key: TEZ-1775
> URL: https://issues.apache.org/jira/browse/TEZ-1775
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: Siddharth Seth
> Attachments: TEZ-1775.1.wip.txt, TEZ-1775.2.txt
>
>
> Currently, it's fairly difficult to configure logging beyond a generic log
> level. It'll be useful to have some control over which components need to be
> logged at a level / should be avoided. The IPC layer, for example, generates
> a lot of (multi-line) noise - which isn't useful when looking for Tez logs
> only.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
