[
https://issues.apache.org/jira/browse/HAMA-454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Jungblut updated HAMA-454:
---------------------------------
Attachment: HAMA-454.patch
Zookeeper now works (theoretically).
Sometimes I still have shutdown issues in the ApplicationMaster:
{noformat}
11/10/21 18:30:57 INFO server.NIOServerCnxn: NIOServerCnxn factory exited run
method
11/10/21 18:30:57 INFO server.PrepRequestProcessor: PrepRequestProcessor exited
loop!
11/10/21 18:30:57 INFO server.SyncRequestProcessor: SyncRequestProcessor exited!
11/10/21 18:30:57 INFO server.FinalRequestProcessor: shutdown of request
processor complete
11/10/21 18:30:57 INFO server.FinalRequestProcessor: shutdown of request
processor complete
11/10/21 18:30:57 WARN jmx.MBeanRegistry: Failed to unregister MBean
InMemoryDataTree
11/10/21 18:30:57 WARN jmx.MBeanRegistry: Error during unregister
javax.management.InstanceNotFoundException:
org.apache.ZooKeeperService:name0=StandaloneServer_port-1,name1=InMemoryDataTree
at
com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1094)
at
com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:415)
at
com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:403)
at
com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:506)
at
org.apache.zookeeper.jmx.MBeanRegistry.unregister(MBeanRegistry.java:94)
at
org.apache.zookeeper.jmx.MBeanRegistry.unregister(MBeanRegistry.java:111)
at
org.apache.zookeeper.server.ZooKeeperServer.unregisterJMX(ZooKeeperServer.java:421)
at
org.apache.zookeeper.server.ZooKeeperServer.shutdown(ZooKeeperServer.java:414)
at
org.apache.zookeeper.server.NIOServerCnxn$Factory.shutdown(NIOServerCnxn.java:323)
at
org.apache.zookeeper.server.ZooKeeperServerMain.shutdown(ZooKeeperServerMain.java:125)
at
org.apache.hama.zookeeper.QuorumPeer$ShutdownableZooKeeperServerMain.shutdown(QuorumPeer.java:407)
at
org.apache.hama.zookeeper.QuorumPeer$ShutdownableZooKeeperServerMain.shutdownZookeeperMain(QuorumPeer.java:402)
at
org.apache.hama.bsp.sync.zookeeper.ZooKeeperSyncServerImpl.stopServer(ZooKeeperSyncServerImpl.java:82)
at
org.apache.hama.bsp.sync.SyncServerRunner.stop(SyncServerRunner.java:47)
at
org.apache.hama.bsp.BSPApplicationMaster.cleanup(BSPApplicationMaster.java:243)
at
org.apache.hama.bsp.BSPApplicationMaster.main(BSPApplicationMaster.java:279)
{noformat}
Besides this everything works.
Even the RPC Synchronization works, but we have to manually build core module
with Hadoop 23.0.
> Add Zookeeper as synchronization service
> ----------------------------------------
>
> Key: HAMA-454
> URL: https://issues.apache.org/jira/browse/HAMA-454
> Project: Hama
> Issue Type: Sub-task
> Reporter: Thomas Jungblut
> Assignee: Thomas Jungblut
> Attachments: HAMA-454.patch, HAMA-454.patch, HAMA-454_v2.patch
>
>
> We should use Zookeeper instead of our own implementation.
> Additionally we should use the plain BSPPeerImpl in YARN to reduce duplicate
> code.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira