Rajesh Balamohan created TEZ-1942:
-------------------------------------
Summary: Number of tasks show in Tez UI with auto-reduce
parallelism is misleading
Key: TEZ-1942
URL: https://issues.apache.org/jira/browse/TEZ-1942
Project: Apache Tez
Issue Type: Bug
Reporter: Rajesh Balamohan
Ran a simple hive query (with tez) and "--hiveconf
hive.tez.auto.reducer.parallelism=true" . This internally turns on tez's auto
reduce parallelism.
- Job started off with 1009 reduce tasks
- Tez reduces the number of reducers to 253
- Job completes successfully, but TEZ UI shows 1009 as the number of reducers
(and 253 tasks as successful tasks). This can be a little misleading.
I will attach the screenshots soon.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
