[
https://issues.apache.org/jira/browse/TEZ-2119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14488082#comment-14488082
]
Hitesh Shah commented on TEZ-2119:
----------------------------------
Yes. That sounds right.
As an initial step, given that we end up surfacing most counters only at a dag
level and not really at the AM level. we could try the following:
- a counter to track the initial no. of held containers before the dag
starts. This may contain both allocated and launched containers. We should
probably separate out the two.
- Over the dag lifetime, how many containers were allocated, launched and
released. And potentially a counter for each time a container is re-used.
\cc [~bikassaha] [~rajesh.balamohan] [~sseth] any comments?
> Counter for launched containers
> -------------------------------
>
> Key: TEZ-2119
> URL: https://issues.apache.org/jira/browse/TEZ-2119
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: Rohini Palaniswamy
> Assignee: Jeff Zhang
>
> org.apache.tez.common.counters.DAGCounter
> NUM_SUCCEEDED_TASKS=32976
> TOTAL_LAUNCHED_TASKS=32976
> OTHER_LOCAL_TASKS=2
> DATA_LOCAL_TASKS=9147
> RACK_LOCAL_TASKS=23761
> It would be very nice to have TOTAL_LAUNCHED_CONTAINERS counter added to
> this. The difference between TOTAL_LAUNCHED_CONTAINERS and
> TOTAL_LAUNCHED_TASKS should make it easy to see how much container reuse is
> happening. It is very hard to find out now.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
