[
https://issues.apache.org/jira/browse/TAJO-8?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on TAJO-8 stopped by Jinho Kim.
> MapReduce's ShuffleHandler and Tajo's PullServerAuxService conflict each other
> ------------------------------------------------------------------------------
>
> Key: TAJO-8
> URL: https://issues.apache.org/jira/browse/TAJO-8
> Project: Tajo
> Issue Type: Bug
> Components: repartitioning
> Reporter: Hyunsik Choi
> Assignee: Jinho Kim
> Priority: Minor
> Labels: newbie
> Attachments: TAJO-8.patch
>
>
> PullServerAuxService was implemented from some parts of MR's ShuffleHandler.
> Its metrics id seems to conflict each other. So, both AuxiliaryServices
> cannot work at the same time. When you start nodemanagers of Yarn with both
> AuxiliaryServices, you will see the following errors in nodemanagers' logs.
> {noformat}
> 2013-03-05 19:44:53,213 FATAL
> org.apache.hadoop.yarn.server.nodemanager.NodeManager: Error starting
> NodeManager
> java.lang.RuntimeException: java.lang.reflect.InvocationTargetException
> at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:128)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices.init(AuxServices.java:96)
> at
> org.apache.hadoop.yarn.service.CompositeService.init(CompositeService.java:58)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.init(ContainerManagerImpl.java:179)
> at
> org.apache.hadoop.yarn.service.CompositeService.init(CompositeService.java:58)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.init(NodeManager.java:165)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:274)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:291)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)
> at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
> at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:525)
> at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:126)
> ... 7 more
> Caused by: org.apache.hadoop.metrics2.MetricsException: Metrics source
> ShuffleMetrics already exists!
> at
> org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.newSourceName(DefaultMetricsSystem.java:126)
> at
> org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.sourceName(DefaultMetricsSystem.java:107)
> at
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl.register(MetricsSystemImpl.java:217)
> at
> org.apache.hadoop.metrics2.MetricsSystem.register(MetricsSystem.java:54)
> at
> tajo.pullserver.PullServerAuxService.<init>(PullServerAuxService.java:152)
> at
> tajo.pullserver.PullServerAuxService.<init>(PullServerAuxService.java:157)
> ... 12 more
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
