[jira] [Commented] (TEZ-3137) Tez task failed with illegal state exception in recovery
[
https://issues.apache.org/jira/browse/TEZ-3137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166698#comment-15166698
]
Jeff Zhang commented on TEZ-3137:
-
Committed to branch-0.7
> Tez task failed with illegal state exception in recovery
>
>
> Key: TEZ-3137
> URL: https://issues.apache.org/jira/browse/TEZ-3137
> Project: Apache Tez
> Issue Type: Bug
>Affects Versions: 0.7.0
>Reporter: Jeff Zhang
>Assignee: Jeff Zhang
> Fix For: 0.7.1
>
> Attachments: TEZ-3137-1.patch, TEZ-3137-2.patch, TEZ-3137-3.patch
>
>
> {noformat}
> 2016-02-19 02:33:18,917 [INFO] [Dispatcher thread {Central}]
> |impl.VertexImpl|: vertex_1455323976018_32442_1_20 [ Map 31]
> transitioned from NEW to INITIALIZING due to event V_INIT
> 154089 2016-02-19 02:33:18,917 [INFO] [InputInitializer {Map 31} #0]
> |dag.RootInputInitializerManager|: Starting InputIn itializer for
> Input: web_sales on vertex vertex_1455323976018_32442_1_20 [Map 31]
> 154090 2016-02-19 02:33:18,917 [ERROR] [Dispatcher thread {Central}]
> |impl.VertexImpl|: Uncaught Exception when handlingevent V_START on
> vertex Map 31 with vertexId vertex_1455323976018_32442_1_20 at current state
> INITIALIZING
> java.lang.IllegalStateException: Vertex: vertex_1455323976018_32442_1_20
> [Map 31] got invalid start event
> at
> com.google.common.base.Preconditions.checkState(Preconditions.java:149)
> at
> org.apache.tez.dag.app.dag.impl.VertexImpl$StartWhileInitializingTransition.transition(VertexImpl.java:360
>8)
> at
> org.apache.tez.dag.app.dag.impl.VertexImpl$StartWhileInitializingTransition.transition(VertexImpl.java:360
>0)
> at
> org.apache.hadoop.yarn.state.StateMachineFactory$SingleInternalArc.doTransition(StateMachineFactory.java:3
>62)
> at
> org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302)
> at
> org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:46)
> at
> org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.jav
>a:448)
> at
> org.apache.tez.state.StateMachineTez.doTransition(StateMachineTez.java:57)
> at
> org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:1862)
> at org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:201)
> at
> org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:1978)
> at
> org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:1964)
> at
> org.apache.tez.common.AsyncDispatcher.dispatch(AsyncDispatcher.java:183)
> at org.apache.tez.common.AsyncDispatcher$1.run(AsyncDispatcher.java:114)
> at java.lang.Thread.run(Thread.java:745)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (TEZ-3137) Tez task failed with illegal state exception in recovery
[
https://issues.apache.org/jira/browse/TEZ-3137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166696#comment-15166696
]
Hitesh Shah commented on TEZ-3137:
--
+1
> Tez task failed with illegal state exception in recovery
>
>
> Key: TEZ-3137
> URL: https://issues.apache.org/jira/browse/TEZ-3137
> Project: Apache Tez
> Issue Type: Bug
>Affects Versions: 0.7.0
>Reporter: Jeff Zhang
>Assignee: Jeff Zhang
> Attachments: TEZ-3137-1.patch, TEZ-3137-2.patch, TEZ-3137-3.patch
>
>
> {noformat}
> 2016-02-19 02:33:18,917 [INFO] [Dispatcher thread {Central}]
> |impl.VertexImpl|: vertex_1455323976018_32442_1_20 [ Map 31]
> transitioned from NEW to INITIALIZING due to event V_INIT
> 154089 2016-02-19 02:33:18,917 [INFO] [InputInitializer {Map 31} #0]
> |dag.RootInputInitializerManager|: Starting InputIn itializer for
> Input: web_sales on vertex vertex_1455323976018_32442_1_20 [Map 31]
> 154090 2016-02-19 02:33:18,917 [ERROR] [Dispatcher thread {Central}]
> |impl.VertexImpl|: Uncaught Exception when handlingevent V_START on
> vertex Map 31 with vertexId vertex_1455323976018_32442_1_20 at current state
> INITIALIZING
> java.lang.IllegalStateException: Vertex: vertex_1455323976018_32442_1_20
> [Map 31] got invalid start event
> at
> com.google.common.base.Preconditions.checkState(Preconditions.java:149)
> at
> org.apache.tez.dag.app.dag.impl.VertexImpl$StartWhileInitializingTransition.transition(VertexImpl.java:360
>8)
> at
> org.apache.tez.dag.app.dag.impl.VertexImpl$StartWhileInitializingTransition.transition(VertexImpl.java:360
>0)
> at
> org.apache.hadoop.yarn.state.StateMachineFactory$SingleInternalArc.doTransition(StateMachineFactory.java:3
>62)
> at
> org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302)
> at
> org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:46)
> at
> org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.jav
>a:448)
> at
> org.apache.tez.state.StateMachineTez.doTransition(StateMachineTez.java:57)
> at
> org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:1862)
> at org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:201)
> at
> org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:1978)
> at
> org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:1964)
> at
> org.apache.tez.common.AsyncDispatcher.dispatch(AsyncDispatcher.java:183)
> at org.apache.tez.common.AsyncDispatcher$1.run(AsyncDispatcher.java:114)
> at java.lang.Thread.run(Thread.java:745)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (TEZ-3137) Tez task failed with illegal state exception in recovery
[
https://issues.apache.org/jira/browse/TEZ-3137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166690#comment-15166690
]
TezQA commented on TEZ-3137:
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12789861/TEZ-3137-3.patch
against master revision bdcdfcc.
{color:red}-1 patch{color}. The patch command could not apply the patch.
Console output: https://builds.apache.org/job/PreCommit-TEZ-Build/1510//console
This message is automatically generated.
> Tez task failed with illegal state exception in recovery
>
>
> Key: TEZ-3137
> URL: https://issues.apache.org/jira/browse/TEZ-3137
> Project: Apache Tez
> Issue Type: Bug
>Affects Versions: 0.7.0
>Reporter: Jeff Zhang
>Assignee: Jeff Zhang
> Attachments: TEZ-3137-1.patch, TEZ-3137-2.patch, TEZ-3137-3.patch
>
>
> {noformat}
> 2016-02-19 02:33:18,917 [INFO] [Dispatcher thread {Central}]
> |impl.VertexImpl|: vertex_1455323976018_32442_1_20 [ Map 31]
> transitioned from NEW to INITIALIZING due to event V_INIT
> 154089 2016-02-19 02:33:18,917 [INFO] [InputInitializer {Map 31} #0]
> |dag.RootInputInitializerManager|: Starting InputIn itializer for
> Input: web_sales on vertex vertex_1455323976018_32442_1_20 [Map 31]
> 154090 2016-02-19 02:33:18,917 [ERROR] [Dispatcher thread {Central}]
> |impl.VertexImpl|: Uncaught Exception when handlingevent V_START on
> vertex Map 31 with vertexId vertex_1455323976018_32442_1_20 at current state
> INITIALIZING
> java.lang.IllegalStateException: Vertex: vertex_1455323976018_32442_1_20
> [Map 31] got invalid start event
> at
> com.google.common.base.Preconditions.checkState(Preconditions.java:149)
> at
> org.apache.tez.dag.app.dag.impl.VertexImpl$StartWhileInitializingTransition.transition(VertexImpl.java:360
>8)
> at
> org.apache.tez.dag.app.dag.impl.VertexImpl$StartWhileInitializingTransition.transition(VertexImpl.java:360
>0)
> at
> org.apache.hadoop.yarn.state.StateMachineFactory$SingleInternalArc.doTransition(StateMachineFactory.java:3
>62)
> at
> org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302)
> at
> org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:46)
> at
> org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.jav
>a:448)
> at
> org.apache.tez.state.StateMachineTez.doTransition(StateMachineTez.java:57)
> at
> org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:1862)
> at org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:201)
> at
> org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:1978)
> at
> org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:1964)
> at
> org.apache.tez.common.AsyncDispatcher.dispatch(AsyncDispatcher.java:183)
> at org.apache.tez.common.AsyncDispatcher$1.run(AsyncDispatcher.java:114)
> at java.lang.Thread.run(Thread.java:745)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (TEZ-3137) Tez task failed with illegal state exception in recovery
[
https://issues.apache.org/jira/browse/TEZ-3137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166684#comment-15166684
]
Jeff Zhang commented on TEZ-3137:
-
The previous patch (2) is incorrect. cause TestDAGRecovery fail. The condition
should be OR (should allow this transition happen in recovery mode)
{noformat}
(vertex.sourceVertices == null || vertex.sourceVertices.isEmpty() ||
vertex.isInRecovery),
{noformat}
> Tez task failed with illegal state exception in recovery
>
>
> Key: TEZ-3137
> URL: https://issues.apache.org/jira/browse/TEZ-3137
> Project: Apache Tez
> Issue Type: Bug
>Affects Versions: 0.7.0
>Reporter: Jeff Zhang
>Assignee: Jeff Zhang
> Attachments: TEZ-3137-1.patch, TEZ-3137-2.patch, TEZ-3137-3.patch
>
>
> {noformat}
> 2016-02-19 02:33:18,917 [INFO] [Dispatcher thread {Central}]
> |impl.VertexImpl|: vertex_1455323976018_32442_1_20 [ Map 31]
> transitioned from NEW to INITIALIZING due to event V_INIT
> 154089 2016-02-19 02:33:18,917 [INFO] [InputInitializer {Map 31} #0]
> |dag.RootInputInitializerManager|: Starting InputIn itializer for
> Input: web_sales on vertex vertex_1455323976018_32442_1_20 [Map 31]
> 154090 2016-02-19 02:33:18,917 [ERROR] [Dispatcher thread {Central}]
> |impl.VertexImpl|: Uncaught Exception when handlingevent V_START on
> vertex Map 31 with vertexId vertex_1455323976018_32442_1_20 at current state
> INITIALIZING
> java.lang.IllegalStateException: Vertex: vertex_1455323976018_32442_1_20
> [Map 31] got invalid start event
> at
> com.google.common.base.Preconditions.checkState(Preconditions.java:149)
> at
> org.apache.tez.dag.app.dag.impl.VertexImpl$StartWhileInitializingTransition.transition(VertexImpl.java:360
>8)
> at
> org.apache.tez.dag.app.dag.impl.VertexImpl$StartWhileInitializingTransition.transition(VertexImpl.java:360
>0)
> at
> org.apache.hadoop.yarn.state.StateMachineFactory$SingleInternalArc.doTransition(StateMachineFactory.java:3
>62)
> at
> org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302)
> at
> org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:46)
> at
> org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.jav
>a:448)
> at
> org.apache.tez.state.StateMachineTez.doTransition(StateMachineTez.java:57)
> at
> org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:1862)
> at org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:201)
> at
> org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:1978)
> at
> org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:1964)
> at
> org.apache.tez.common.AsyncDispatcher.dispatch(AsyncDispatcher.java:183)
> at org.apache.tez.common.AsyncDispatcher$1.run(AsyncDispatcher.java:114)
> at java.lang.Thread.run(Thread.java:745)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (TEZ-3137) Tez task failed with illegal state exception in recovery
[
https://issues.apache.org/jira/browse/TEZ-3137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166617#comment-15166617
]
Jeff Zhang commented on TEZ-3137:
-
Upload another patch, recoveredState is NEW by default, need to check the
attemptId to verify whether it is in recovering.
> Tez task failed with illegal state exception in recovery
>
>
> Key: TEZ-3137
> URL: https://issues.apache.org/jira/browse/TEZ-3137
> Project: Apache Tez
> Issue Type: Bug
>Affects Versions: 0.7.0
>Reporter: Jeff Zhang
>Assignee: Jeff Zhang
> Attachments: TEZ-3137-1.patch
>
>
> {noformat}
> 2016-02-19 02:33:18,917 [INFO] [Dispatcher thread {Central}]
> |impl.VertexImpl|: vertex_1455323976018_32442_1_20 [ Map 31]
> transitioned from NEW to INITIALIZING due to event V_INIT
> 154089 2016-02-19 02:33:18,917 [INFO] [InputInitializer {Map 31} #0]
> |dag.RootInputInitializerManager|: Starting InputIn itializer for
> Input: web_sales on vertex vertex_1455323976018_32442_1_20 [Map 31]
> 154090 2016-02-19 02:33:18,917 [ERROR] [Dispatcher thread {Central}]
> |impl.VertexImpl|: Uncaught Exception when handlingevent V_START on
> vertex Map 31 with vertexId vertex_1455323976018_32442_1_20 at current state
> INITIALIZING
> java.lang.IllegalStateException: Vertex: vertex_1455323976018_32442_1_20
> [Map 31] got invalid start event
> at
> com.google.common.base.Preconditions.checkState(Preconditions.java:149)
> at
> org.apache.tez.dag.app.dag.impl.VertexImpl$StartWhileInitializingTransition.transition(VertexImpl.java:360
>8)
> at
> org.apache.tez.dag.app.dag.impl.VertexImpl$StartWhileInitializingTransition.transition(VertexImpl.java:360
>0)
> at
> org.apache.hadoop.yarn.state.StateMachineFactory$SingleInternalArc.doTransition(StateMachineFactory.java:3
>62)
> at
> org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302)
> at
> org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:46)
> at
> org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.jav
>a:448)
> at
> org.apache.tez.state.StateMachineTez.doTransition(StateMachineTez.java:57)
> at
> org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:1862)
> at org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:201)
> at
> org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:1978)
> at
> org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:1964)
> at
> org.apache.tez.common.AsyncDispatcher.dispatch(AsyncDispatcher.java:183)
> at org.apache.tez.common.AsyncDispatcher$1.run(AsyncDispatcher.java:114)
> at java.lang.Thread.run(Thread.java:745)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (TEZ-3137) Tez task failed with illegal state exception in recovery
[
https://issues.apache.org/jira/browse/TEZ-3137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166576#comment-15166576
]
Jeff Zhang commented on TEZ-3137:
-
[~hitesh] Trivial patch, please help review. This is only for branch-0.7, so
prebuild won't pass
> Tez task failed with illegal state exception in recovery
>
>
> Key: TEZ-3137
> URL: https://issues.apache.org/jira/browse/TEZ-3137
> Project: Apache Tez
> Issue Type: Bug
>Affects Versions: 0.7.0
>Reporter: Jeff Zhang
>Assignee: Jeff Zhang
> Attachments: TEZ-3137-1.patch
>
>
> {noformat}
> 2016-02-19 02:33:18,917 [INFO] [Dispatcher thread {Central}]
> |impl.VertexImpl|: vertex_1455323976018_32442_1_20 [ Map 31]
> transitioned from NEW to INITIALIZING due to event V_INIT
> 154089 2016-02-19 02:33:18,917 [INFO] [InputInitializer {Map 31} #0]
> |dag.RootInputInitializerManager|: Starting InputIn itializer for
> Input: web_sales on vertex vertex_1455323976018_32442_1_20 [Map 31]
> 154090 2016-02-19 02:33:18,917 [ERROR] [Dispatcher thread {Central}]
> |impl.VertexImpl|: Uncaught Exception when handlingevent V_START on
> vertex Map 31 with vertexId vertex_1455323976018_32442_1_20 at current state
> INITIALIZING
> java.lang.IllegalStateException: Vertex: vertex_1455323976018_32442_1_20
> [Map 31] got invalid start event
> at
> com.google.common.base.Preconditions.checkState(Preconditions.java:149)
> at
> org.apache.tez.dag.app.dag.impl.VertexImpl$StartWhileInitializingTransition.transition(VertexImpl.java:360
>8)
> at
> org.apache.tez.dag.app.dag.impl.VertexImpl$StartWhileInitializingTransition.transition(VertexImpl.java:360
>0)
> at
> org.apache.hadoop.yarn.state.StateMachineFactory$SingleInternalArc.doTransition(StateMachineFactory.java:3
>62)
> at
> org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302)
> at
> org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:46)
> at
> org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.jav
>a:448)
> at
> org.apache.tez.state.StateMachineTez.doTransition(StateMachineTez.java:57)
> at
> org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:1862)
> at org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:201)
> at
> org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:1978)
> at
> org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:1964)
> at
> org.apache.tez.common.AsyncDispatcher.dispatch(AsyncDispatcher.java:183)
> at org.apache.tez.common.AsyncDispatcher$1.run(AsyncDispatcher.java:114)
> at java.lang.Thread.run(Thread.java:745)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (TEZ-3137) Tez task failed with illegal state exception in recovery
[
https://issues.apache.org/jira/browse/TEZ-3137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166503#comment-15166503
]
TezQA commented on TEZ-3137:
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12789819/TEZ-3137-1.patch
against master revision bdcdfcc.
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:red}-1 tests included{color}. The patch doesn't appear to include
any new or modified tests.
Please justify why no new tests are needed for this
patch.
Also please list what manual steps were performed to
verify this patch.
{color:red}-1 javac{color:red}. The patch appears to cause the build to
fail.
Console output: https://builds.apache.org/job/PreCommit-TEZ-Build/1509//console
This message is automatically generated.
> Tez task failed with illegal state exception in recovery
>
>
> Key: TEZ-3137
> URL: https://issues.apache.org/jira/browse/TEZ-3137
> Project: Apache Tez
> Issue Type: Bug
>Affects Versions: 0.7.0
>Reporter: Jeff Zhang
>Assignee: Jeff Zhang
> Attachments: TEZ-3137-1.patch
>
>
> {noformat}
> 2016-02-19 02:33:18,917 [INFO] [Dispatcher thread {Central}]
> |impl.VertexImpl|: vertex_1455323976018_32442_1_20 [ Map 31]
> transitioned from NEW to INITIALIZING due to event V_INIT
> 154089 2016-02-19 02:33:18,917 [INFO] [InputInitializer {Map 31} #0]
> |dag.RootInputInitializerManager|: Starting InputIn itializer for
> Input: web_sales on vertex vertex_1455323976018_32442_1_20 [Map 31]
> 154090 2016-02-19 02:33:18,917 [ERROR] [Dispatcher thread {Central}]
> |impl.VertexImpl|: Uncaught Exception when handlingevent V_START on
> vertex Map 31 with vertexId vertex_1455323976018_32442_1_20 at current state
> INITIALIZING
> java.lang.IllegalStateException: Vertex: vertex_1455323976018_32442_1_20
> [Map 31] got invalid start event
> at
> com.google.common.base.Preconditions.checkState(Preconditions.java:149)
> at
> org.apache.tez.dag.app.dag.impl.VertexImpl$StartWhileInitializingTransition.transition(VertexImpl.java:360
>8)
> at
> org.apache.tez.dag.app.dag.impl.VertexImpl$StartWhileInitializingTransition.transition(VertexImpl.java:360
>0)
> at
> org.apache.hadoop.yarn.state.StateMachineFactory$SingleInternalArc.doTransition(StateMachineFactory.java:3
>62)
> at
> org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302)
> at
> org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:46)
> at
> org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.jav
>a:448)
> at
> org.apache.tez.state.StateMachineTez.doTransition(StateMachineTez.java:57)
> at
> org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:1862)
> at org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:201)
> at
> org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:1978)
> at
> org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:1964)
> at
> org.apache.tez.common.AsyncDispatcher.dispatch(AsyncDispatcher.java:183)
> at org.apache.tez.common.AsyncDispatcher$1.run(AsyncDispatcher.java:114)
> at java.lang.Thread.run(Thread.java:745)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (TEZ-3137) Tez task failed with illegal state exception in recovery
[
https://issues.apache.org/jira/browse/TEZ-3137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166424#comment-15166424
]
Jeff Zhang commented on TEZ-3137:
-
StartWhileInitializingTransition is for the root vertex where V_START is sent
from DAGAppMaster, but it is not true for recovery. In recovery, each vertex
recover its state by itself, and will send V_START to itself.
See VertexImpl#RecoverTransition
{noformat}
switch (vertex.recoveredState) {
case NEW:
// Drop all root events if not inited properly
Iterator iterator = vertex.recoveredEvents.iterator();
while (iterator.hasNext()) {
if (iterator.next().getEventType().equals(
EventType.ROOT_INPUT_DATA_INFORMATION_EVENT)) {
iterator.remove();
}
}
// Trigger init if all sources initialized
if (vertex.numInitedSourceVertices == vertex.getInputVerticesCount())
{
vertex.eventHandler.handle(new VertexEvent(vertex.vertexId,
VertexEventType.V_INIT));
}
if (vertex.numStartedSourceVertices ==
vertex.getInputVerticesCount()) {
vertex.eventHandler.handle(new VertexEvent(vertex.vertexId,
VertexEventType.V_START));
}
endState = VertexState.NEW;
{noformat}
> Tez task failed with illegal state exception in recovery
>
>
> Key: TEZ-3137
> URL: https://issues.apache.org/jira/browse/TEZ-3137
> Project: Apache Tez
> Issue Type: Bug
>Affects Versions: 0.7.0
>Reporter: Jeff Zhang
>Assignee: Jeff Zhang
>
> {noformat}
> 2016-02-19 02:33:18,917 [INFO] [Dispatcher thread {Central}]
> |impl.VertexImpl|: vertex_1455323976018_32442_1_20 [ Map 31]
> transitioned from NEW to INITIALIZING due to event V_INIT
> 154089 2016-02-19 02:33:18,917 [INFO] [InputInitializer {Map 31} #0]
> |dag.RootInputInitializerManager|: Starting InputIn itializer for
> Input: web_sales on vertex vertex_1455323976018_32442_1_20 [Map 31]
> 154090 2016-02-19 02:33:18,917 [ERROR] [Dispatcher thread {Central}]
> |impl.VertexImpl|: Uncaught Exception when handlingevent V_START on
> vertex Map 31 with vertexId vertex_1455323976018_32442_1_20 at current state
> INITIALIZING
> java.lang.IllegalStateException: Vertex: vertex_1455323976018_32442_1_20
> [Map 31] got invalid start event
> at
> com.google.common.base.Preconditions.checkState(Preconditions.java:149)
> at
> org.apache.tez.dag.app.dag.impl.VertexImpl$StartWhileInitializingTransition.transition(VertexImpl.java:360
>8)
> at
> org.apache.tez.dag.app.dag.impl.VertexImpl$StartWhileInitializingTransition.transition(VertexImpl.java:360
>0)
> at
> org.apache.hadoop.yarn.state.StateMachineFactory$SingleInternalArc.doTransition(StateMachineFactory.java:3
>62)
> at
> org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302)
> at
> org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:46)
> at
> org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.jav
>a:448)
> at
> org.apache.tez.state.StateMachineTez.doTransition(StateMachineTez.java:57)
> at
> org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:1862)
> at org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:201)
> at
> org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:1978)
> at
> org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:1964)
> at
> org.apache.tez.common.AsyncDispatcher.dispatch(AsyncDispatcher.java:183)
> at org.apache.tez.common.AsyncDispatcher$1.run(AsyncDispatcher.java:114)
> at java.lang.Thread.run(Thread.java:745)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
