[jira] [Updated] (HIVE-15779) LLAP: WaitQueue comparators should return 0 when tasks of the same DAG are of same priority

[Rajesh Balamohan (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-15779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rajesh Balamohan updated HIVE-15779:

   Resolution: Fixed
 Hadoop Flags: Reviewed
Fix Version/s: 2.2.0
   Status: Resolved  (was: Patch Available)

Thanks [~sseth], [~prasanth_j], [~sershe]. Committed to master.

> LLAP: WaitQueue comparators should return 0 when tasks of the same DAG are of 
> same priority
> ---
>
> Key: HIVE-15779
> URL: https://issues.apache.org/jira/browse/HIVE-15779
> Project: Hive
>  Issue Type: Bug
>  Components: llap
>Reporter: Rajesh Balamohan
>Assignee: Rajesh Balamohan
> Fix For: 2.2.0
>
> Attachments: HIVE-15779.1.patch, HIVE-15779.2.patch
>
>
> Observed cases, where in tasks within same vertex were competing with each 
> and getting killed
> {noformat}
> [IPC Server handler 3 on 44598 (1484282558103_4855_1_00_003877_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003179_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003877_7 because 
> of lower priority
> [IPC Server handler 1 on 44598 (1484282558103_4855_1_00_002959_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003832_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_002959_7 because 
> of lower priority
> [IPC Server handler 0 on 44598 (1484282558103_4855_1_00_003723_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003254_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003723_7 because 
> of lower priority
> [IPC Server handler 4 on 44598 (1484282558103_4855_1_00_003560_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003076_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003560_7 because 
> of lower priority
> [IPC Server handler 2 on 44598 (1484282558103_4855_1_00_003775_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_004011_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003775_7 because 
> of lower priority
> [IPC Server handler 3 on 44598 (1484282558103_4855_1_00_003842_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_004045_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003842_7 because 
> of lower priority
> [IPC Server handler 1 on 44598 (1484282558103_4855_1_00_003953_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003915_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003953_7 because 
> of lower priority
> [IPC Server handler 0 on 44598 (1484282558103_4855_1_00_003819_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003919_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003819_7 because 
> of lower priority
> [IPC Server handler 4 on 44598 (1484282558103_4855_1_00_002074_8)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003790_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_002074_8 because 
> of lower priority
> [IPC Server handler 2 on 44598 (1484282558103_4855_1_00_003670_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003736_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003670_7 because 
> of lower priority
> [IPC Server handler 1 on 44598 (1484282558103_4855_1_00_003153_8)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003877_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003153_8 because 
> of lower priority
> [IPC Server handler 0 on 44598 (1484282558103_4855_1_00_003328_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003775_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003328_7 because 
> of lower priority
> [IPC Server handler 4 on 44598 (1484282558103_4855_1_00_003817_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003842_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003817_7 because 
> of lower priority
> [IPC Server handler 2 on 44598 (1484282558103_4855_1_00_004065_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003723_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_004065_7 because 
> of lower priority
> [IPC Server handler 3 on 44598 (1484282558103_4855_1_00_003902_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003560_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003902_7 because 
> of lower priority
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (HIVE-15779) LLAP: WaitQueue comparators should return 0 when tasks of the same DAG are of same priority

[Rajesh Balamohan (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-15779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rajesh Balamohan updated HIVE-15779:

Status: Patch Available  (was: Open)

> LLAP: WaitQueue comparators should return 0 when tasks of the same DAG are of 
> same priority
> ---
>
> Key: HIVE-15779
> URL: https://issues.apache.org/jira/browse/HIVE-15779
> Project: Hive
>  Issue Type: Bug
>  Components: llap
>Reporter: Rajesh Balamohan
>Assignee: Rajesh Balamohan
> Attachments: HIVE-15779.1.patch, HIVE-15779.2.patch
>
>
> Observed cases, where in tasks within same vertex were competing with each 
> and getting killed
> {noformat}
> [IPC Server handler 3 on 44598 (1484282558103_4855_1_00_003877_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003179_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003877_7 because 
> of lower priority
> [IPC Server handler 1 on 44598 (1484282558103_4855_1_00_002959_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003832_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_002959_7 because 
> of lower priority
> [IPC Server handler 0 on 44598 (1484282558103_4855_1_00_003723_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003254_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003723_7 because 
> of lower priority
> [IPC Server handler 4 on 44598 (1484282558103_4855_1_00_003560_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003076_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003560_7 because 
> of lower priority
> [IPC Server handler 2 on 44598 (1484282558103_4855_1_00_003775_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_004011_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003775_7 because 
> of lower priority
> [IPC Server handler 3 on 44598 (1484282558103_4855_1_00_003842_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_004045_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003842_7 because 
> of lower priority
> [IPC Server handler 1 on 44598 (1484282558103_4855_1_00_003953_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003915_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003953_7 because 
> of lower priority
> [IPC Server handler 0 on 44598 (1484282558103_4855_1_00_003819_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003919_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003819_7 because 
> of lower priority
> [IPC Server handler 4 on 44598 (1484282558103_4855_1_00_002074_8)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003790_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_002074_8 because 
> of lower priority
> [IPC Server handler 2 on 44598 (1484282558103_4855_1_00_003670_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003736_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003670_7 because 
> of lower priority
> [IPC Server handler 1 on 44598 (1484282558103_4855_1_00_003153_8)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003877_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003153_8 because 
> of lower priority
> [IPC Server handler 0 on 44598 (1484282558103_4855_1_00_003328_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003775_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003328_7 because 
> of lower priority
> [IPC Server handler 4 on 44598 (1484282558103_4855_1_00_003817_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003842_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003817_7 because 
> of lower priority
> [IPC Server handler 2 on 44598 (1484282558103_4855_1_00_004065_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003723_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_004065_7 because 
> of lower priority
> [IPC Server handler 3 on 44598 (1484282558103_4855_1_00_003902_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003560_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003902_7 because 
> of lower priority
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (HIVE-15779) LLAP: WaitQueue comparators should return 0 when tasks of the same DAG are of same priority

[Rajesh Balamohan (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-15779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rajesh Balamohan updated HIVE-15779:

Attachment: HIVE-15779.2.patch

> LLAP: WaitQueue comparators should return 0 when tasks of the same DAG are of 
> same priority
> ---
>
> Key: HIVE-15779
> URL: https://issues.apache.org/jira/browse/HIVE-15779
> Project: Hive
>  Issue Type: Bug
>  Components: llap
>Reporter: Rajesh Balamohan
>Assignee: Rajesh Balamohan
> Attachments: HIVE-15779.1.patch, HIVE-15779.2.patch
>
>
> Observed cases, where in tasks within same vertex were competing with each 
> and getting killed
> {noformat}
> [IPC Server handler 3 on 44598 (1484282558103_4855_1_00_003877_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003179_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003877_7 because 
> of lower priority
> [IPC Server handler 1 on 44598 (1484282558103_4855_1_00_002959_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003832_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_002959_7 because 
> of lower priority
> [IPC Server handler 0 on 44598 (1484282558103_4855_1_00_003723_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003254_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003723_7 because 
> of lower priority
> [IPC Server handler 4 on 44598 (1484282558103_4855_1_00_003560_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003076_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003560_7 because 
> of lower priority
> [IPC Server handler 2 on 44598 (1484282558103_4855_1_00_003775_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_004011_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003775_7 because 
> of lower priority
> [IPC Server handler 3 on 44598 (1484282558103_4855_1_00_003842_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_004045_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003842_7 because 
> of lower priority
> [IPC Server handler 1 on 44598 (1484282558103_4855_1_00_003953_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003915_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003953_7 because 
> of lower priority
> [IPC Server handler 0 on 44598 (1484282558103_4855_1_00_003819_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003919_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003819_7 because 
> of lower priority
> [IPC Server handler 4 on 44598 (1484282558103_4855_1_00_002074_8)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003790_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_002074_8 because 
> of lower priority
> [IPC Server handler 2 on 44598 (1484282558103_4855_1_00_003670_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003736_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003670_7 because 
> of lower priority
> [IPC Server handler 1 on 44598 (1484282558103_4855_1_00_003153_8)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003877_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003153_8 because 
> of lower priority
> [IPC Server handler 0 on 44598 (1484282558103_4855_1_00_003328_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003775_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003328_7 because 
> of lower priority
> [IPC Server handler 4 on 44598 (1484282558103_4855_1_00_003817_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003842_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003817_7 because 
> of lower priority
> [IPC Server handler 2 on 44598 (1484282558103_4855_1_00_004065_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003723_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_004065_7 because 
> of lower priority
> [IPC Server handler 3 on 44598 (1484282558103_4855_1_00_003902_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003560_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003902_7 because 
> of lower priority
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (HIVE-15779) LLAP: WaitQueue comparators should return 0 when tasks of the same DAG are of same priority

[Rajesh Balamohan (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-15779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rajesh Balamohan updated HIVE-15779:

Status: Open  (was: Patch Available)

> LLAP: WaitQueue comparators should return 0 when tasks of the same DAG are of 
> same priority
> ---
>
> Key: HIVE-15779
> URL: https://issues.apache.org/jira/browse/HIVE-15779
> Project: Hive
>  Issue Type: Bug
>  Components: llap
>Reporter: Rajesh Balamohan
>Assignee: Rajesh Balamohan
> Attachments: HIVE-15779.1.patch
>
>
> Observed cases, where in tasks within same vertex were competing with each 
> and getting killed
> {noformat}
> [IPC Server handler 3 on 44598 (1484282558103_4855_1_00_003877_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003179_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003877_7 because 
> of lower priority
> [IPC Server handler 1 on 44598 (1484282558103_4855_1_00_002959_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003832_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_002959_7 because 
> of lower priority
> [IPC Server handler 0 on 44598 (1484282558103_4855_1_00_003723_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003254_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003723_7 because 
> of lower priority
> [IPC Server handler 4 on 44598 (1484282558103_4855_1_00_003560_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003076_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003560_7 because 
> of lower priority
> [IPC Server handler 2 on 44598 (1484282558103_4855_1_00_003775_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_004011_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003775_7 because 
> of lower priority
> [IPC Server handler 3 on 44598 (1484282558103_4855_1_00_003842_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_004045_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003842_7 because 
> of lower priority
> [IPC Server handler 1 on 44598 (1484282558103_4855_1_00_003953_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003915_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003953_7 because 
> of lower priority
> [IPC Server handler 0 on 44598 (1484282558103_4855_1_00_003819_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003919_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003819_7 because 
> of lower priority
> [IPC Server handler 4 on 44598 (1484282558103_4855_1_00_002074_8)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003790_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_002074_8 because 
> of lower priority
> [IPC Server handler 2 on 44598 (1484282558103_4855_1_00_003670_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003736_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003670_7 because 
> of lower priority
> [IPC Server handler 1 on 44598 (1484282558103_4855_1_00_003153_8)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003877_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003153_8 because 
> of lower priority
> [IPC Server handler 0 on 44598 (1484282558103_4855_1_00_003328_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003775_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003328_7 because 
> of lower priority
> [IPC Server handler 4 on 44598 (1484282558103_4855_1_00_003817_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003842_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003817_7 because 
> of lower priority
> [IPC Server handler 2 on 44598 (1484282558103_4855_1_00_004065_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003723_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_004065_7 because 
> of lower priority
> [IPC Server handler 3 on 44598 (1484282558103_4855_1_00_003902_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003560_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003902_7 because 
> of lower priority
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (HIVE-15779) LLAP: WaitQueue comparators should return 0 when tasks of the same DAG are of same priority

[Rajesh Balamohan (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-15779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rajesh Balamohan updated HIVE-15779:

Attachment: (was: HIVE-15779.2.patch)

> LLAP: WaitQueue comparators should return 0 when tasks of the same DAG are of 
> same priority
> ---
>
> Key: HIVE-15779
> URL: https://issues.apache.org/jira/browse/HIVE-15779
> Project: Hive
>  Issue Type: Bug
>  Components: llap
>Reporter: Rajesh Balamohan
>Assignee: Rajesh Balamohan
> Attachments: HIVE-15779.1.patch
>
>
> Observed cases, where in tasks within same vertex were competing with each 
> and getting killed
> {noformat}
> [IPC Server handler 3 on 44598 (1484282558103_4855_1_00_003877_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003179_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003877_7 because 
> of lower priority
> [IPC Server handler 1 on 44598 (1484282558103_4855_1_00_002959_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003832_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_002959_7 because 
> of lower priority
> [IPC Server handler 0 on 44598 (1484282558103_4855_1_00_003723_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003254_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003723_7 because 
> of lower priority
> [IPC Server handler 4 on 44598 (1484282558103_4855_1_00_003560_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003076_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003560_7 because 
> of lower priority
> [IPC Server handler 2 on 44598 (1484282558103_4855_1_00_003775_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_004011_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003775_7 because 
> of lower priority
> [IPC Server handler 3 on 44598 (1484282558103_4855_1_00_003842_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_004045_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003842_7 because 
> of lower priority
> [IPC Server handler 1 on 44598 (1484282558103_4855_1_00_003953_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003915_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003953_7 because 
> of lower priority
> [IPC Server handler 0 on 44598 (1484282558103_4855_1_00_003819_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003919_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003819_7 because 
> of lower priority
> [IPC Server handler 4 on 44598 (1484282558103_4855_1_00_002074_8)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003790_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_002074_8 because 
> of lower priority
> [IPC Server handler 2 on 44598 (1484282558103_4855_1_00_003670_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003736_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003670_7 because 
> of lower priority
> [IPC Server handler 1 on 44598 (1484282558103_4855_1_00_003153_8)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003877_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003153_8 because 
> of lower priority
> [IPC Server handler 0 on 44598 (1484282558103_4855_1_00_003328_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003775_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003328_7 because 
> of lower priority
> [IPC Server handler 4 on 44598 (1484282558103_4855_1_00_003817_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003842_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003817_7 because 
> of lower priority
> [IPC Server handler 2 on 44598 (1484282558103_4855_1_00_004065_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003723_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_004065_7 because 
> of lower priority
> [IPC Server handler 3 on 44598 (1484282558103_4855_1_00_003902_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003560_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003902_7 because 
> of lower priority
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (HIVE-15779) LLAP: WaitQueue comparators should return 0 when tasks of the same DAG are of same priority

[Rajesh Balamohan (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-15779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rajesh Balamohan updated HIVE-15779:

Attachment: HIVE-15779.2.patch

Attaching .2 patch to fix review comments and to address test case issue.

> LLAP: WaitQueue comparators should return 0 when tasks of the same DAG are of 
> same priority
> ---
>
> Key: HIVE-15779
> URL: https://issues.apache.org/jira/browse/HIVE-15779
> Project: Hive
>  Issue Type: Bug
>  Components: llap
>Reporter: Rajesh Balamohan
>Assignee: Rajesh Balamohan
> Attachments: HIVE-15779.1.patch, HIVE-15779.2.patch
>
>
> Observed cases, where in tasks within same vertex were competing with each 
> and getting killed
> {noformat}
> [IPC Server handler 3 on 44598 (1484282558103_4855_1_00_003877_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003179_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003877_7 because 
> of lower priority
> [IPC Server handler 1 on 44598 (1484282558103_4855_1_00_002959_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003832_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_002959_7 because 
> of lower priority
> [IPC Server handler 0 on 44598 (1484282558103_4855_1_00_003723_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003254_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003723_7 because 
> of lower priority
> [IPC Server handler 4 on 44598 (1484282558103_4855_1_00_003560_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003076_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003560_7 because 
> of lower priority
> [IPC Server handler 2 on 44598 (1484282558103_4855_1_00_003775_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_004011_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003775_7 because 
> of lower priority
> [IPC Server handler 3 on 44598 (1484282558103_4855_1_00_003842_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_004045_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003842_7 because 
> of lower priority
> [IPC Server handler 1 on 44598 (1484282558103_4855_1_00_003953_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003915_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003953_7 because 
> of lower priority
> [IPC Server handler 0 on 44598 (1484282558103_4855_1_00_003819_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003919_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003819_7 because 
> of lower priority
> [IPC Server handler 4 on 44598 (1484282558103_4855_1_00_002074_8)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003790_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_002074_8 because 
> of lower priority
> [IPC Server handler 2 on 44598 (1484282558103_4855_1_00_003670_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003736_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003670_7 because 
> of lower priority
> [IPC Server handler 1 on 44598 (1484282558103_4855_1_00_003153_8)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003877_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003153_8 because 
> of lower priority
> [IPC Server handler 0 on 44598 (1484282558103_4855_1_00_003328_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003775_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003328_7 because 
> of lower priority
> [IPC Server handler 4 on 44598 (1484282558103_4855_1_00_003817_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003842_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003817_7 because 
> of lower priority
> [IPC Server handler 2 on 44598 (1484282558103_4855_1_00_004065_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003723_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_004065_7 because 
> of lower priority
> [IPC Server handler 3 on 44598 (1484282558103_4855_1_00_003902_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003560_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003902_7 because 
> of lower priority
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (HIVE-15779) LLAP: WaitQueue comparators should return 0 when tasks of the same DAG are of same priority

[Gopal V (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-15779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Gopal V updated HIVE-15779:
---
Summary: LLAP: WaitQueue comparators should return 0 when tasks of the same 
DAG are of same priority  (was: LLAP: WaitQueue comparators should return 0 
when tasks are of same priority)

> LLAP: WaitQueue comparators should return 0 when tasks of the same DAG are of 
> same priority
> ---
>
> Key: HIVE-15779
> URL: https://issues.apache.org/jira/browse/HIVE-15779
> Project: Hive
>  Issue Type: Bug
>  Components: llap
>Reporter: Rajesh Balamohan
>Assignee: Rajesh Balamohan
> Attachments: HIVE-15779.1.patch
>
>
> Observed cases, where in tasks within same vertex were competing with each 
> and getting killed
> {noformat}
> [IPC Server handler 3 on 44598 (1484282558103_4855_1_00_003877_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003179_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003877_7 because 
> of lower priority
> [IPC Server handler 1 on 44598 (1484282558103_4855_1_00_002959_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003832_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_002959_7 because 
> of lower priority
> [IPC Server handler 0 on 44598 (1484282558103_4855_1_00_003723_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003254_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003723_7 because 
> of lower priority
> [IPC Server handler 4 on 44598 (1484282558103_4855_1_00_003560_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003076_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003560_7 because 
> of lower priority
> [IPC Server handler 2 on 44598 (1484282558103_4855_1_00_003775_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_004011_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003775_7 because 
> of lower priority
> [IPC Server handler 3 on 44598 (1484282558103_4855_1_00_003842_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_004045_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003842_7 because 
> of lower priority
> [IPC Server handler 1 on 44598 (1484282558103_4855_1_00_003953_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003915_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003953_7 because 
> of lower priority
> [IPC Server handler 0 on 44598 (1484282558103_4855_1_00_003819_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003919_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003819_7 because 
> of lower priority
> [IPC Server handler 4 on 44598 (1484282558103_4855_1_00_002074_8)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003790_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_002074_8 because 
> of lower priority
> [IPC Server handler 2 on 44598 (1484282558103_4855_1_00_003670_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003736_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003670_7 because 
> of lower priority
> [IPC Server handler 1 on 44598 (1484282558103_4855_1_00_003153_8)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003877_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003153_8 because 
> of lower priority
> [IPC Server handler 0 on 44598 (1484282558103_4855_1_00_003328_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003775_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003328_7 because 
> of lower priority
> [IPC Server handler 4 on 44598 (1484282558103_4855_1_00_003817_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003842_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003817_7 because 
> of lower priority
> [IPC Server handler 2 on 44598 (1484282558103_4855_1_00_004065_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003723_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_004065_7 because 
> of lower priority
> [IPC Server handler 3 on 44598 (1484282558103_4855_1_00_003902_7)] 
> impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003560_7 evicted 
> from wait queue in favor of attempt_1484282558103_4855_1_00_003902_7 because 
> of lower priority
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)