[ 
https://issues.apache.org/jira/browse/HIVE-12935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15169817#comment-15169817
 ] 

Prasanth Jayachandran commented on HIVE-12935:
----------------------------------------------

Tested this patch on 1TB scale q55-random.sql queries with chaosmonkey interval 
of 120s on 6 instances. However I did not see any logs related to chaosmonkey 
terminating an instance. The entire queryset succeeded though without any 
issues. I also ran the same test with slider flexing up/down the number of 
containers and was able to see the notifications. All queries succeeded while 
flexing up and down (with few attempt failures/kills which are expected on 
flexing down).

{code}
2016-02-26 16:03:23,685 [INFO] [StateChangeNotificationHandler] 
|impl.LlapZookeeperRegistryImpl$InstanceStateChangeListener|: Removed zknode 
/prasanth/llap0/workers/worker-0000000106 from llap namespace. Notifying state 
change listener.
2016-02-26 16:03:23,685 [INFO] [StateChangeNotificationHandler] 
|tezplugins.LlapTaskSchedulerService$NodeStateChangeListener|: Removed node 
with identity: 8b46e9f6-eefd-40d7-b17c-5b3016039934
{code}

> LLAP: Replace Yarn registry with Zookeeper registry
> ---------------------------------------------------
>
>                 Key: HIVE-12935
>                 URL: https://issues.apache.org/jira/browse/HIVE-12935
>             Project: Hive
>          Issue Type: Improvement
>    Affects Versions: 2.0.0
>            Reporter: Prasanth Jayachandran
>            Assignee: Prasanth Jayachandran
>         Attachments: 12935.1.patch, HIVE-12935.2.patch, HIVE-12935.3.patch, 
> HIVE-12935.4.patch, HIVE-12935.5.patch, HIVE-12935.6.patch, HIVE-12935.7.patch
>
>
> Existing YARN registry service for cluster membership has to depend on 
> refresh intervals to get the list of instances/daemons that are running in 
> the cluster. Better approach would be replace it with zookeeper based 
> registry service so that custom listeners can be added to update healthiness 
> of daemons in the cluster.  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to