[
https://issues.apache.org/jira/browse/TEZ-2119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17042142#comment-17042142
]
Rohini Palaniswamy edited comment on TEZ-2119 at 2/21/20 8:03 PM:
------------------------------------------------------------------
Haven't reviewed the code for correctness of the counter increments. But based
on Hitesh's comment, below ones make sense
INITIAL_HELD_CONTAINERS, //both allocated and launched containers before dag
start
TOTAL_ALLOCATED_CONTAINERS,
TOTAL_LAUNCHED_CONTAINERS,
TOTAL_RELEASED_CONTAINERS,
TOTAL_REUSED_CONTAINERS
I am not sure what TOTAL_USED_CONTAINERS means as earlier comment by Jeff meant
it to be same as INITIAL_HELD_CONTAINERS. Looking at code, it seems to be about
same as TOTAL_LAUNCHED_TASKS which we can skip in my opinion.
was (Author: rohini):
Haven't reviewed the code for correctness of the counter increments, but based
on Hitesh's comment, below ones make sense
INITIAL_HELD_CONTAINERS, //both allocated and launched containers before dag
start
TOTAL_ALLOCATED_CONTAINERS,
TOTAL_LAUNCHED_CONTAINERS,
TOTAL_RELEASED_CONTAINERS,
TOTAL_REUSED_CONTAINERS
I am not sure what TOTAL_USED_CONTAINERS means as earlier comment by Jeff meant
it to be same as INITIAL_HELD_CONTAINERS. Looking at code, it seems to be about
same as TOTAL_LAUNCHED_TASKS which we can skip in my opinion.
> Counter for launched containers
> -------------------------------
>
> Key: TEZ-2119
> URL: https://issues.apache.org/jira/browse/TEZ-2119
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: Rohini Palaniswamy
> Assignee: László Bodor
> Priority: Major
> Attachments: TEZ-2119.01.patch
>
>
> org.apache.tez.common.counters.DAGCounter
> NUM_SUCCEEDED_TASKS=32976
> TOTAL_LAUNCHED_TASKS=32976
> OTHER_LOCAL_TASKS=2
> DATA_LOCAL_TASKS=9147
> RACK_LOCAL_TASKS=23761
> It would be very nice to have TOTAL_LAUNCHED_CONTAINERS counter added to
> this. The difference between TOTAL_LAUNCHED_CONTAINERS and
> TOTAL_LAUNCHED_TASKS should make it easy to see how much container reuse is
> happening. It is very hard to find out now.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
