[jira] [Updated] (HIVE-13667) Improve performance for ServiceInstanceSet.getByHost
[ https://issues.apache.org/jira/browse/HIVE-13667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-13667: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.2.0 Status: Resolved (was: Patch Available) Thanks [~sseth], [~prasanth_j], [~sershe]. Committed to master. > Improve performance for ServiceInstanceSet.getByHost > > > Key: HIVE-13667 > URL: https://issues.apache.org/jira/browse/HIVE-13667 > Project: Hive > Issue Type: Improvement >Reporter: Siddharth Seth >Assignee: Rajesh Balamohan > Fix For: 2.2.0 > > Attachments: HIVE-13667.1.patch, HIVE-13667.2.patch, > HIVE-13667.3.patch, HIVE-13667.4.patch, HIVE-13667.5.patch > > > ServiceInstanceSet.getByHost is used for scheduling local tasks as well as > constructing the log URL. > It ends up traversing all hosts on each lookup. This should be avoided. > cc [~prasanth_j] -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (HIVE-13667) Improve performance for ServiceInstanceSet.getByHost
[ https://issues.apache.org/jira/browse/HIVE-13667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-13667: Status: Patch Available (was: Open) > Improve performance for ServiceInstanceSet.getByHost > > > Key: HIVE-13667 > URL: https://issues.apache.org/jira/browse/HIVE-13667 > Project: Hive > Issue Type: Improvement >Reporter: Siddharth Seth >Assignee: Rajesh Balamohan > Attachments: HIVE-13667.1.patch, HIVE-13667.2.patch, > HIVE-13667.3.patch, HIVE-13667.4.patch, HIVE-13667.5.patch > > > ServiceInstanceSet.getByHost is used for scheduling local tasks as well as > constructing the log URL. > It ends up traversing all hosts on each lookup. This should be avoided. > cc [~prasanth_j] -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (HIVE-13667) Improve performance for ServiceInstanceSet.getByHost
[ https://issues.apache.org/jira/browse/HIVE-13667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-13667: Attachment: HIVE-13667.5.patch "instance.getHost()" had to be used in populating nodeToInstanceCache. Attaching .5 patch. > Improve performance for ServiceInstanceSet.getByHost > > > Key: HIVE-13667 > URL: https://issues.apache.org/jira/browse/HIVE-13667 > Project: Hive > Issue Type: Improvement >Reporter: Siddharth Seth >Assignee: Rajesh Balamohan > Attachments: HIVE-13667.1.patch, HIVE-13667.2.patch, > HIVE-13667.3.patch, HIVE-13667.4.patch, HIVE-13667.5.patch > > > ServiceInstanceSet.getByHost is used for scheduling local tasks as well as > constructing the log URL. > It ends up traversing all hosts on each lookup. This should be avoided. > cc [~prasanth_j] -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (HIVE-13667) Improve performance for ServiceInstanceSet.getByHost
[ https://issues.apache.org/jira/browse/HIVE-13667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-13667: Status: Open (was: Patch Available) > Improve performance for ServiceInstanceSet.getByHost > > > Key: HIVE-13667 > URL: https://issues.apache.org/jira/browse/HIVE-13667 > Project: Hive > Issue Type: Improvement >Reporter: Siddharth Seth >Assignee: Rajesh Balamohan > Attachments: HIVE-13667.1.patch, HIVE-13667.2.patch, > HIVE-13667.3.patch, HIVE-13667.4.patch > > > ServiceInstanceSet.getByHost is used for scheduling local tasks as well as > constructing the log URL. > It ends up traversing all hosts on each lookup. This should be avoided. > cc [~prasanth_j] -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (HIVE-13667) Improve performance for ServiceInstanceSet.getByHost
[ https://issues.apache.org/jira/browse/HIVE-13667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-13667: Attachment: HIVE-13667.4.patch > Improve performance for ServiceInstanceSet.getByHost > > > Key: HIVE-13667 > URL: https://issues.apache.org/jira/browse/HIVE-13667 > Project: Hive > Issue Type: Improvement >Reporter: Siddharth Seth >Assignee: Rajesh Balamohan > Attachments: HIVE-13667.1.patch, HIVE-13667.2.patch, > HIVE-13667.3.patch, HIVE-13667.4.patch > > > ServiceInstanceSet.getByHost is used for scheduling local tasks as well as > constructing the log URL. > It ends up traversing all hosts on each lookup. This should be avoided. > cc [~prasanth_j] -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (HIVE-13667) Improve performance for ServiceInstanceSet.getByHost
[ https://issues.apache.org/jira/browse/HIVE-13667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-13667: Attachment: HIVE-13667.3.patch Attaching .3 patch. > Improve performance for ServiceInstanceSet.getByHost > > > Key: HIVE-13667 > URL: https://issues.apache.org/jira/browse/HIVE-13667 > Project: Hive > Issue Type: Improvement >Reporter: Siddharth Seth >Assignee: Rajesh Balamohan > Attachments: HIVE-13667.1.patch, HIVE-13667.2.patch, > HIVE-13667.3.patch > > > ServiceInstanceSet.getByHost is used for scheduling local tasks as well as > constructing the log URL. > It ends up traversing all hosts on each lookup. This should be avoided. > cc [~prasanth_j] -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (HIVE-13667) Improve performance for ServiceInstanceSet.getByHost
[ https://issues.apache.org/jira/browse/HIVE-13667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-13667: Attachment: HIVE-13667.2.patch Attaching .2 patch to address review comments > Improve performance for ServiceInstanceSet.getByHost > > > Key: HIVE-13667 > URL: https://issues.apache.org/jira/browse/HIVE-13667 > Project: Hive > Issue Type: Improvement >Reporter: Siddharth Seth >Assignee: Rajesh Balamohan > Attachments: HIVE-13667.1.patch, HIVE-13667.2.patch > > > ServiceInstanceSet.getByHost is used for scheduling local tasks as well as > constructing the log URL. > It ends up traversing all hosts on each lookup. This should be avoided. > cc [~prasanth_j] -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (HIVE-13667) Improve performance for ServiceInstanceSet.getByHost
[ https://issues.apache.org/jira/browse/HIVE-13667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-13667: Status: Patch Available (was: Open) > Improve performance for ServiceInstanceSet.getByHost > > > Key: HIVE-13667 > URL: https://issues.apache.org/jira/browse/HIVE-13667 > Project: Hive > Issue Type: Improvement >Reporter: Siddharth Seth >Assignee: Rajesh Balamohan > Attachments: HIVE-13667.1.patch > > > ServiceInstanceSet.getByHost is used for scheduling local tasks as well as > constructing the log URL. > It ends up traversing all hosts on each lookup. This should be avoided. > cc [~prasanth_j] -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (HIVE-13667) Improve performance for ServiceInstanceSet.getByHost
[ https://issues.apache.org/jira/browse/HIVE-13667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-13667: Attachment: HIVE-13667.1.patch Changes: 1. Use local cache in LlapZookeeperRegistryImpl. Cache updates are handled in InstanceStateChangeListener 2. Calls like DynamicServiceInstanceSet::getByHost, getAll etc to make use of this local cache. 3. Minor refactorings in LlapTaskSchedulerService to reduce object creation 4. Reduced the number of times LlapTaskSchedulerService::getTotalResources is invoked. > Improve performance for ServiceInstanceSet.getByHost > > > Key: HIVE-13667 > URL: https://issues.apache.org/jira/browse/HIVE-13667 > Project: Hive > Issue Type: Improvement >Reporter: Siddharth Seth >Assignee: Rajesh Balamohan > Attachments: HIVE-13667.1.patch > > > ServiceInstanceSet.getByHost is used for scheduling local tasks as well as > constructing the log URL. > It ends up traversing all hosts on each lookup. This should be avoided. > cc [~prasanth_j] -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (HIVE-13667) Improve performance for ServiceInstanceSet.getByHost
[ https://issues.apache.org/jira/browse/HIVE-13667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-13667: --- Target Version/s: 2.2.0 (was: 2.1.0) > Improve performance for ServiceInstanceSet.getByHost > > > Key: HIVE-13667 > URL: https://issues.apache.org/jira/browse/HIVE-13667 > Project: Hive > Issue Type: Improvement >Reporter: Siddharth Seth >Assignee: Prasanth Jayachandran > > ServiceInstanceSet.getByHost is used for scheduling local tasks as well as > constructing the log URL. > It ends up traversing all hosts on each lookup. This should be avoided. > cc [~prasanth_j] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
