[
https://issues.apache.org/jira/browse/TEZ-2855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14907400#comment-14907400
]
Bikas Saha commented on TEZ-2855:
---------------------------------
line 4429 is handling vm event and so vm is null -> vertex is still initializing
exception message does not show which vertex was handling the event. something
we should add under logging improvements
until the exception the following vertices had not assigned vm's but tasks that
write outputs to them had started. so it could be that some of tasks sent vm
events to these vertices before there was a vm to handle them. same would apply
to input initializer events also.
Reducer 29
Reducer 31
Reducer 33
Reducer 35
Reducer 37
Reducer 39
Reducer 41
Reducer 43
Reducer 45
Reducer 47
Reducer 49
> NPE while routing events
> ------------------------
>
> Key: TEZ-2855
> URL: https://issues.apache.org/jira/browse/TEZ-2855
> Project: Apache Tez
> Issue Type: Bug
> Affects Versions: 0.8.0-alpha
> Reporter: Siddharth Seth
> Priority: Critical
> Attachments: 2855log.gz
>
>
> Observed while running against 0.8.0-alpha. This will likely affect 0.7 as
> well - that'll be known after debugging.
> {code}
> 2015-09-24T12:13:42,675 ERROR [Dispatcher thread: Central]
> common.AsyncDispatcher: Error in dispatcher thread
> java.lang.NullPointerException
> at
> org.apache.tez.dag.app.dag.impl.VertexImpl.handleRoutedTezEvents(VertexImpl.java:4429)
> ~[TezAppJar.jar:0.8.0-alpha]
> at
> org.apache.tez.dag.app.dag.impl.VertexImpl.access$4000(VertexImpl.java:203)
> ~[TezAppJar.jar:0.8.0-alpha]
> at
> org.apache.tez.dag.app.dag.impl.VertexImpl$RouteEventTransition.transition(VertexImpl.java:4175)
> ~[TezAppJar.jar:0.8.0-alpha]
> at
> org.apache.tez.dag.app.dag.impl.VertexImpl$RouteEventTransition.transition(VertexImpl.java:4167)
> ~[TezAppJar.jar:0.8.0-alpha]
> at
> org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:385)
> ~[hadoop-yarn-common-2.6.0.jar:?]
> at
> org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302)
> ~[hadoop-yarn-common-2.6.0.jar:?]
> at
> org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:46)
> ~[hadoop-yarn-common-2.6.0.jar:?]
> at
> org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:448)
> ~[hadoop-yarn-common-2.6.0.jar:?]
> at
> org.apache.tez.state.StateMachineTez.doTransition(StateMachineTez.java:57)
> ~[TezAppJar.jar:0.8.0-alpha]
> at org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:1906)
> ~[TezAppJar.jar:0.8.0-alpha]
> at org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:202)
> ~[TezAppJar.jar:0.8.0-alpha]
> at
> org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:2069)
> ~[TezAppJar.jar:0.8.0-alpha]
> at
> org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:2055)
> ~[TezAppJar.jar:0.8.0-alpha]
> at org.apache.tez.common.AsyncDispatcher.dispatch(AsyncDispatcher.java:183)
> [tez-common-0.8.0-alpha.jar:0.8.0-alpha]
> at org.apache.tez.common.AsyncDispatcher$1.run(AsyncDispatcher.java:114)
> [tez-common-0.8.0-alpha.jar:0.8.0-alpha]
> at java.lang.Thread.run(Thread.java:745) [?:1.8.0_40]
> 2015-09-24T12:13:42,681 INFO [HistoryEventHandlingThread]
> impl.SimpleHistoryLoggingService: Writing event TASK_ATTEMPT_FINISHED to
> history file
> {code}
> Looks like the VertexManager was null.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
