[jira] [Created] (TEZ-3351) Handle ATS performance issues for Hive-LLAP.
Harish Jaiprakash created TEZ-3351: -- Summary: Handle ATS performance issues for Hive-LLAP. Key: TEZ-3351 URL: https://issues.apache.org/jira/browse/TEZ-3351 Project: Apache Tez Issue Type: Bug Reporter: Harish Jaiprakash Assignee: Harish Jaiprakash With Hive-LLAP, we have subsecond queries and hence can run lots of queries in a small interval. This can overload ATS with lot of events and create large number of file hdfs. This jira is to reduce performance impact of ATS logging by Tez. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (TEZ-3350) Shuffle spills are not spilled to a container-specific directory
Jason Lowe created TEZ-3350: --- Summary: Shuffle spills are not spilled to a container-specific directory Key: TEZ-3350 URL: https://issues.apache.org/jira/browse/TEZ-3350 Project: Apache Tez Issue Type: Bug Affects Versions: 0.7.1 Reporter: Jason Lowe If a Tez task receives too much input data and needs to spill the inputs to disk it ends up using a path that is not container-specific. Therefore YARN will not automatically cleanup these files when the container exits as it should, and instead the files linger until the entire application completes. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (TEZ-3349) Tez: PipelinedSorter - remove interface calls from the inner loop
Gopal V created TEZ-3349: Summary: Tez: PipelinedSorter - remove interface calls from the inner loop Key: TEZ-3349 URL: https://issues.apache.org/jira/browse/TEZ-3349 Project: Apache Tez Issue Type: Bug Reporter: Gopal V IndexedSortable is responsible for a huge degradation in sort performance in PipelinedSorter. With the TezRawComparator in place, the interface dispatch within indexed sortable is significantly affecting the speed of the sort impl. !movabs-check.png! -- This message was sent by Atlassian JIRA (v6.3.4#6332)