[
https://issues.apache.org/jira/browse/TEZ-3805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16269573#comment-16269573
]
Kuhu Shukla commented on TEZ-3805:
----------------------------------
Sorry for not being clear earlier [~rajesh.balamohan]. My question is: were
there any locality misses by the scheduler for 1-1 edge in Hive on Tez that
served as motivation for this analyzer. From some testing on Pig, we did notice
scenarios where scheduler may decide to give away the container to a different
request. This is somewhat expected given the nature of the script we were
running but I was curious if Hive had a similar or analogous behavior?
> Analyzer: Add an analyzer to find out scheduling misses in 1:1 edges
> --------------------------------------------------------------------
>
> Key: TEZ-3805
> URL: https://issues.apache.org/jira/browse/TEZ-3805
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: Rajesh Balamohan
> Assignee: Rajesh Balamohan
> Fix For: 0.9.1
>
> Attachments: TEZ-3805.1.patch
>
>
> When 1:1 edge is used, it would be helpful to find out whether downstream
> tasks ran on the same location provided in the hints by the runtime.
> One of the recent feature in upstream project (hive) used 1:1 edge. Instead
> of checking the logs, it would be useful to have an analyzer to churn out the
> details.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
