[
https://issues.apache.org/jira/browse/HIVE-23210?focusedWorklogId=423435&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-423435
]
ASF GitHub Bot logged work on HIVE-23210:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 16/Apr/20 12:44
Start Date: 16/Apr/20 12:44
Worklog Time Spent: 10m
Work Description: pgaref commented on pull request #984: HIVE-23210:
Update ShortestJobFirstComparator
URL: https://github.com/apache/hive/pull/984
Update ShortestJobFirstComparator to take into account single-task vertices.
Single-task vertices with earlier start-time have higher priority, while the
ones with the latest start-times are the first candidates for eviction.
Change-Id: I94715d194ec8b3a6919aa56d4fae8a0b529ae23e
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 423435)
Remaining Estimate: 0h
Time Spent: 10m
> Fix shortestjobcomparator when jobs submitted have 1 task their vertices
> ------------------------------------------------------------------------
>
> Key: HIVE-23210
> URL: https://issues.apache.org/jira/browse/HIVE-23210
> Project: Hive
> Issue Type: Improvement
> Reporter: Rajesh Balamohan
> Assignee: Panagiotis Garefalakis
> Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-23210.01.patch, TestShortestJobFirstComparator.java
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> In latency sensitive queries, lots of jobs can have vertices with 1 task.
> Currently shortestjobcomparator does not work correctly and returns tasks in
> random order.
> [https://github.com/apache/hive/blob/master/llap-server/src/java/org/apache/hadoop/hive/llap/daemon/impl/comparator/ShortestJobFirstComparator.java#L51]
> This causes delay in the job runtime. I will attach a simple test case
> shortly.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
