[ 
https://issues.apache.org/jira/browse/TEZ-2119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14487925#comment-14487925
 ] 

Rohini Palaniswamy commented on TEZ-2119:
-----------------------------------------

Still need the LAUNCHED_CONTAINERS. If there are going to be containers 
launched and were not used (no tasks submitted to them) then you should have 
both TOTAL_LAUNCHED_CONTAINERS and TOTAL_USED_CONTAINERS. Also is it possible 
to add something like AVG_CONTAINER_REUSE or some better statistics to see the 
amount of reuse?

> Counter for launched containers
> -------------------------------
>
>                 Key: TEZ-2119
>                 URL: https://issues.apache.org/jira/browse/TEZ-2119
>             Project: Apache Tez
>          Issue Type: Improvement
>            Reporter: Rohini Palaniswamy
>            Assignee: Jeff Zhang
>
> org.apache.tez.common.counters.DAGCounter
>                 NUM_SUCCEEDED_TASKS=32976
>                 TOTAL_LAUNCHED_TASKS=32976
>                 OTHER_LOCAL_TASKS=2
>                 DATA_LOCAL_TASKS=9147
>                 RACK_LOCAL_TASKS=23761
> It would be very nice to have TOTAL_LAUNCHED_CONTAINERS counter added to 
> this. The difference between TOTAL_LAUNCHED_CONTAINERS and 
> TOTAL_LAUNCHED_TASKS should make it easy to see how much container reuse is 
> happening. It is very hard to find out now.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to