[
https://issues.apache.org/jira/browse/TEZ-2918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14985072#comment-14985072
]
Bikas Saha commented on TEZ-2918:
---------------------------------
Thats a good suggestion that we can do separately. On that, we technically have
a single reader - the notifier thread. There are multiple writers, potentially
from the different IPO's. So the question is around visibility of the set from
the IPO's to the get from the reporter thread. Since this is a boolean var, we
can approximate this to a single writer case since there can only be 1 value to
set (true). I am more concerned about usage in low latency scenarios where we
report this to the AM every 100ms and 500ms of no progress is the threshold.
However, setting this aside, it may be more useful to look at these in the
context of the actual IO's because the overhead of this in those code paths may
or may not be significant.
> Make progress notifications in IOs
> ----------------------------------
>
> Key: TEZ-2918
> URL: https://issues.apache.org/jira/browse/TEZ-2918
> Project: Apache Tez
> Issue Type: Sub-task
> Reporter: Bikas Saha
> Assignee: Bikas Saha
> Attachments: TEZ-2918.1.patch, TEZ-2918.2.patch,
> jmh-microbenchmark.tar.gz
>
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
