[
https://issues.apache.org/jira/browse/TEZ-2918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14988268#comment-14988268
]
Siddharth Seth commented on TEZ-2918:
-------------------------------------
Is an option to disable progress notifications required ?
[~rajesh.balamohan]/[~gopalv] This is supported in the AM via a -1 on the
update time field.
[~bikassaha] - do you have any numbers on the affect of adding these progress
notifications in the tight loop unconditionally.
Also, the previous patch - TEZ-808, adds a Configuration lookup on status
update events which do not set progress. The multiple Configuration.gets are
very avoidable.
{code}
+ if (statusEvent.getProgressNotified()) {
+ ta.lastNotifyProgressTimestamp = ta.clock.getTime();
+ } else {
+ long currTime = ta.clock.getTime();
+ long hungIntervalMax = ta.conf.getLong(
+ TezConfiguration.TEZ_TASK_PROGRESS_STUCK_INTERVAL_MS,
+ TezConfiguration.TEZ_TASK_PROGRESS_STUCK_INTERVAL_MS_DEFAULT);
{code}
> Make progress notifications in IOs
> ----------------------------------
>
> Key: TEZ-2918
> URL: https://issues.apache.org/jira/browse/TEZ-2918
> Project: Apache Tez
> Issue Type: Sub-task
> Reporter: Bikas Saha
> Assignee: Bikas Saha
> Attachments: TEZ-2918.1.patch, TEZ-2918.2.patch, TEZ-2918.3.patch,
> jmh-microbenchmark.tar.gz
>
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
