[
https://issues.apache.org/jira/browse/TEZ-2774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14746033#comment-14746033
]
Siddharth Seth commented on TEZ-2774:
-------------------------------------
The classpath will typically be small. It'll be large for MiniClusters. It
provides a good mechanism to figure out whether multiple jars of the same
version have been added, so I'd retain that. Once per vertex does not add a lot.
In the most recent patch.
{code}
+ // this log helps quickly count the completion count for a vertex.
+ // grepping and counting for attempts and handling re-tries is time
consuming
+ LOG.info("Task Completion: " +
constructCheckTasksForCompletionLog(vertex));
{code}
This log line still seems a little excessive, given all the information
available via history.
IAC, Will wait for your reply to this, and commit this patch or the next one.
Backporting this to various branches is not going to be trivial - it won't
apply cleanly to any of the branches. I'll open follow up jiras for the
backports. I can take care of the 0.7 port. [~bikassaha], [~hitesh], [~zjffdu]
- would appreciate help with the 0.6/0.5 (potentially very similar).
> Reduce logging in the AM, and parts of the runtime
> --------------------------------------------------
>
> Key: TEZ-2774
> URL: https://issues.apache.org/jira/browse/TEZ-2774
> Project: Apache Tez
> Issue Type: Sub-task
> Reporter: Siddharth Seth
> Assignee: Siddharth Seth
> Attachments: TEZ-2774.1.txt, TEZ-2774.2.txt, TEZ-2774.3.txt,
> TEZ-2774.4.patch, TEZ-2774.5.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
