[
https://issues.apache.org/jira/browse/TEZ-1942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14277331#comment-14277331
]
Prakash Ramachandran edited comment on TEZ-1942 at 1/14/15 6:00 PM:
--------------------------------------------------------------------
raised YARN-3062 for the same.
was (Author: pramachandran):
raised YARN-2444 for the same.
> Number of tasks show in Tez UI with auto-reduce parallelism is misleading
> -------------------------------------------------------------------------
>
> Key: TEZ-1942
> URL: https://issues.apache.org/jira/browse/TEZ-1942
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Rajesh Balamohan
> Attachments: Screen Shot 2015-01-14 at 9.18.21 AM.png, Screen Shot
> 2015-01-14 at 9.18.54 AM.png, output.json, result_with_direct_vertex.png,
> result_with_primary_filter.png
>
>
> Ran a simple hive query (with tez) and "--hiveconf
> hive.tez.auto.reducer.parallelism=true" . This internally turns on tez's
> auto reduce parallelism.
> - Job started off with 1009 reduce tasks
> - Tez reduces the number of reducers to 253
> - Job completes successfully, but TEZ UI shows 1009 as the number of reducers
> (and 253 tasks as successful tasks). This can be a little misleading.
> I will attach the screenshots soon.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
