[jira] [Comment Edited] (HIVE-17841) implement applying the resource plan

[Lefty Leverenz (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-17841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16239405#comment-16239405
 ] 

Lefty Leverenz edited comment on HIVE-17841 at 1/2/18 12:56 AM:


Doc note:  This adds *hive.server2.tez.wm.worker.threads* to HiveConf.java, so 
it needs to be documented in the wiki.

It belongs in the HiveServer2 section of Configuration Properties, but should 
also be listed at the beginning of the Tez section.

* [Configuration Properties -- HiveServer2 | 
https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-HiveServer2]
* [Configuration Properties -- Tez | 
https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-Tez]

Added a TODOC3.0 label.

Update 01/01/18:  HIVE-18003 renames this parameter 
*hive.server2.wm.worker.threads* with the same default value and description, 
also for release 3.0.0.  (Removing the TODOC3.0 label.)


was (Author: le...@hortonworks.com):
Doc note:  This adds *hive.server2.tez.wm.worker.threads* to HiveConf.java, so 
it needs to be documented in the wiki.

It belongs in the HiveServer2 section of Configuration Properties, but should 
also be listed at the beginning of the Tez section.

* [Configuration Properties -- HiveServer2 | 
https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-HiveServer2]
* [Configuration Properties -- Tez | 
https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-Tez]

Added a TODOC3.0 label.

> implement applying the resource plan
> 
>
> Key: HIVE-17841
> URL: https://issues.apache.org/jira/browse/HIVE-17841
> Project: Hive
>  Issue Type: Sub-task
>Reporter: Sergey Shelukhin
>Assignee: Sergey Shelukhin
>  Labels: TODOC3.0
> Fix For: 3.0.0
>
> Attachments: HIVE-17841.01.patch, HIVE-17841.02.patch, 
> HIVE-17841.03.patch, HIVE-17841.04.patch, HIVE-17841.05.patch, 
> HIVE-17841.06.patch, HIVE-17841.07.patch, HIVE-17841.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Comment Edited] (HIVE-17841) implement applying the resource plan

[Sergey Shelukhin (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-17841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210612#comment-16210612
 ] 

Sergey Shelukhin edited comment on HIVE-17841 at 10/19/17 5:40 AM:
---

This preliminary patch is based on master although it will be committed after 
the pools patch. I'm pretty sure tests will fail... will look tomorrow.
This rewrites WM to use a single thread to process almost everything that can 
happen to a session that is in use (so, excluding out of bounds expiration). 
This is because there are too many things coming from multiple sources and 
otherwise synchronization and reasoning about all the things happening in 
parallel becomes a huge pain. Also makes some things like getting session from 
the pool, waiting for AM registry, etc. async to facilitate that.
There are some followup jiras that would be needed - handling internal AM 
restart (AM registry info update), and LLAP cluster information changes (the 
logic in WM is simple, the information propagation needs to be added).

cc [~prasanth_j]


was (Author: sershe):
This preliminary patch is based on master although it will be committed after 
the pools patch. I'm pretty sure tests will fail... will look tomorrow.
This rewrites WM to use a single thread to process almost everything that can 
happen to a session that is in use (so, excluding out of bounds expiration). 
There are some followup jiras that would be needed - handling internal AM 
restart (AM registry info update), and LLAP cluster information changes (the 
logic in WM is simple, the information propagation needs to be added).

> implement applying the resource plan
> 
>
> Key: HIVE-17841
> URL: https://issues.apache.org/jira/browse/HIVE-17841
> Project: Hive
>  Issue Type: Sub-task
>Reporter: Sergey Shelukhin
>Assignee: Sergey Shelukhin
> Attachments: HIVE-17841.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)