[
https://issues.apache.org/jira/browse/TAJO-138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
hyoungjunkim reassigned TAJO-138:
---------------------------------
Assignee: (was: hyoungjunkim)
> Too many RPC connections in TajoWorker
> --------------------------------------
>
> Key: TAJO-138
> URL: https://issues.apache.org/jira/browse/TAJO-138
> Project: Tajo
> Issue Type: Improvement
> Components: worker
> Reporter: Hyunsik Choi
> Fix For: 0.3-incubating
>
>
> We can see that there are many same connection/disconnection messages from
> TaskWorker log as the following. This is caused by the fact that each
> TaskRunner connects to QueryMaster. We need to share those connections among
> TaskRunners in the same TajoWorker.
> {noformat}
> 2013-08-29 10:34:51,880 INFO worker.TajoWorker (TajoWorker.java:run(400)) -
> Worker Resource Heartbeat Thread stopped.
> 2013-08-29 10:34:51,881 INFO rpc.NettyClientBase
> (NettyClientBase.java:close(87)) - Proxy is disconnected from
> 211.239.116.115:9005
> 2013-08-29 10:34:51,884 INFO rpc.NettyServerBase
> (NettyServerBase.java:shutdown(120)) - Rpc (TajoWorkerProtocol) listened on
> 0:0:0:0:0:0:0:0:8092) shutdown
> 2013-08-29 10:34:51,884 INFO worker.TajoWorkerManagerService
> (TajoWorkerManagerService.java:stop(108)) - TajoWorkerManagerService stopped
> 2013-08-29 10:34:51,884 INFO querymaster.QueryMaster
> (QueryMaster.java:run(304)) - QueryMaster heartbeat thread stopped
> 2013-08-29 10:34:51,884 INFO service.AbstractService
> (AbstractService.java:stop(113)) -
> Service:org.apache.tajo.master.TajoAsyncDispatcher is stopped.
> 2013-08-29 10:34:51,885 INFO master.TajoAsyncDispatcher
> (TajoAsyncDispatcher.java:stop(122)) - AsyncDispatcher
> stopped:querymaster_1377740005035
> 2013-08-29 10:34:51,885 INFO service.AbstractService
> (AbstractService.java:stop(113)) -
> Service:org.apache.tajo.master.querymaster.QueryMaster is stopped.
> 2013-08-29 10:34:51,885 INFO querymaster.QueryMaster
> (QueryMaster.java:stop(146)) - QueryMaster stop
> 2013-08-29 10:34:51,885 INFO service.AbstractService
> (AbstractService.java:stop(113)) -
> Service:org.apache.tajo.worker.TajoWorkerManagerService is stopped.
> 2013-08-29 10:34:51,885 INFO worker.TajoWorkerClientService
> (TajoWorkerClientService.java:stop(103)) - ====> TajoWorkerClientService
> stopping
> 2013-08-29 10:34:51,885 INFO rpc.NettyServerBase
> (NettyServerBase.java:shutdown(120)) - Rpc (QueryMasterClientProtocol)
> listened on 0:0:0:0:0:0:0:0:8091) shutdown
> 2013-08-29 10:34:51,885 INFO worker.TajoWorkerClientService
> (TajoWorkerClientService.java:stop(107)) - ====> TajoWorkerClientService
> stopped
> 2013-08-29 10:34:51,885 INFO service.AbstractService
> (AbstractService.java:stop(113)) -
> Service:org.apache.tajo.worker.TajoWorkerClientService is stopped.
> 2013-08-29 10:34:51,889 INFO service.AbstractService
> (AbstractService.java:stop(113)) - Service:httpshuffle is stopped.
> 2013-08-29 10:34:51,890 INFO rpc.NettyClientBase
> (NettyClientBase.java:close(87)) - Proxy is disconnected from
> 211.239.116.119:8092
> 2013-08-29 10:34:51,890 INFO worker.TaskRunner (TaskRunner.java:stop(236)) -
> Stop TaskRunner: eb_1377740003810_0001_000002
> 2013-08-29 10:34:51,891 INFO rpc.NettyClientBase
> (NettyClientBase.java:close(87)) - Proxy is disconnected from
> 211.239.116.119:8092
> 2013-08-29 10:34:51,891 INFO worker.TaskRunner (TaskRunner.java:stop(236)) -
> Stop TaskRunner: eb_1377740003810_0001_000002
> 2013-08-29 10:34:51,892 INFO rpc.NettyClientBase
> (NettyClientBase.java:close(87)) - Proxy is disconnected from
> 211.239.116.119:8092
> 2013-08-29 10:34:51,892 INFO worker.TaskRunner (TaskRunner.java:stop(236)) -
> Stop TaskRunner: eb_1377740003810_0001_000002
> 2013-08-29 10:34:51,892 INFO rpc.NettyClientBase
> (NettyClientBase.java:close(87)) - Proxy is disconnected from
> 211.239.116.119:8092
> 2013-08-29 10:34:51,892 INFO worker.TaskRunner (TaskRunner.java:stop(236)) -
> Stop TaskRunner: eb_1377740003810_0001_000002
> 2013-08-29 10:34:51,894 INFO rpc.NettyClientBase
> (NettyClientBase.java:close(87)) - Proxy is disconnected from
> 211.239.116.119:8092
> 2013-08-29 10:34:51,894 INFO worker.TaskRunner (TaskRunner.java:stop(236)) -
> Stop TaskRunner: eb_1377740003810_0001_000002
> 2013-08-29 10:34:51,895 INFO rpc.NettyClientBase
> (NettyClientBase.java:close(87)) - Proxy is disconnected from
> 211.239.116.119:8092
> 2013-08-29 10:34:51,895 INFO worker.TaskRunner (TaskRunner.java:stop(236)) -
> Stop TaskRunner: eb_1377740003810_0001_000002
> 2013-08-29 10:34:51,896 INFO rpc.NettyClientBase
> (NettyClientBase.java:close(87)) - Proxy is disconnected from
> 211.239.116.119:8092
> 2013-08-29 10:34:51,896 INFO worker.TaskRunner (TaskRunner.java:stop(236)) -
> Stop TaskRunner: eb_1377740003810_0001_000002
> 2013-08-29 10:34:51,897 INFO rpc.NettyClientBase
> (NettyClientBase.java:close(87)) - Proxy is disconnected from
> 211.239.116.119:8092
> 2013-08-29 10:34:51,897 INFO worker.TaskRunner (TaskRunner.java:stop(236)) -
> Stop TaskRunner: eb_1377740003810_0001_000002
> 2013-08-29 10:34:51,898 INFO rpc.NettyClientBase
> (NettyClientBase.java:close(87)) - Proxy is disconnected from
> 211.239.116.119:8092
> 2013-08-29 10:34:51,898 INFO worker.TaskRunner (TaskRunner.java:stop(236)) -
> Stop TaskRunner: eb_1377740003810_0001_000002
> 2013-08-29 10:34:51,898 INFO service.AbstractService
> (AbstractService.java:stop(113)) -
> Service:org.apache.tajo.worker.TaskRunnerManager is stopped.
> 2013-08-29 10:34:51,898 INFO service.AbstractService
> (AbstractService.java:stop(113)) - Service:org.apache.tajo.worker.TajoWorker
> is stopped.
> 2013-08-29 10:34:51,898 INFO worker.TajoWorker (TajoWorker.java:stop(187)) -
> TajoWorker main thread exiting
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.1#6144)
