[
https://issues.apache.org/jira/browse/HADOOP-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542748
]
acmurthy edited comment on HADOOP-2208 at 11/15/07 4:15 AM:
-----------------------------------------------------------------
bq. One really simple option is to to add a Counters.clear method and call it
from TaskStatus.clearStatus, this will ensure that only updated counters are
sent in every hearbeat.
I jumped to a hasty conclusion. Forget it, won't work.
The way to get that to work is to add a {{boolean}} {{updated}} flag to
{{CounterRec}}, set that to true on every {{Counter.incrCounter}} call and
check and send only updated ones. The {{updated}} flag should be cleared via
{{TaskStatus.clearStatus}}. Thoughts?
was (Author: acmurthy):
bq. One really simple option is to to add a Counters.clear method and call
it from TaskStatus.clearStatus, this will ensure that only updated counters are
sent in every hearbeat.
I jumped to hasty conclusion. Forget it, won't work.
> Reduce frequency of Counter updates in the task tracker status
> --------------------------------------------------------------
>
> Key: HADOOP-2208
> URL: https://issues.apache.org/jira/browse/HADOOP-2208
> Project: Hadoop
> Issue Type: Improvement
> Reporter: Amareshwari Sri Ramadasu
> Assignee: Amareshwari Sri Ramadasu
>
> Currently, We have counter updates from task tracker to job tracker on every
> heartbeat. Both counter name and the values are updated for every heartbeat.
> This can be improved by sending names and values for the first time and only
> the values after that.
> The frequency can be reduced by doing update only when the counters got
> changed.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
