Kuhu Shukla created TEZ-4053:
--------------------------------
Summary: TestExceptionPropagation.testExceptionPropagationSession
fails intermittently
Key: TEZ-4053
URL: https://issues.apache.org/jira/browse/TEZ-4053
Project: Apache Tez
Issue Type: Bug
Reporter: Kuhu Shukla
Assignee: Kuhu Shukla
Irrespective of the test case failing or not I see the below stack trace that
needs to be looked at:
{code}
2019-03-13 15:12:19,457 [INFO] [Dispatcher thread {Central}]
|HistoryEventHandler.criticalEvents|:
[HISTORY][DAG:dag_1552507929653_0001_1][Event:DAG_FINISHED]:
dagId=dag_1552507929653_0001_1, startTime=1552507939233,
finishTime=1552507939419, timeTaken=186, status=FAILED, diagnostics=Vertex
failed, vertexName=v1, vertexId=vertex_1552507929653_0001_1_00,
diagnostics=[Exception in EdgeManager, vertex:vertex_1552507929653_0001_1_00
[v1],java.lang.RuntimeException: EM_GetNumSourceTaskPhysicalOutputs
at
org.apache.tez.test.TestExceptionPropagation$CustomEdgeManager.getNumSourceTaskPhysicalOutputs(TestExceptionPropagation.java:828)
at org.apache.tez.dag.app.dag.impl.Edge.getSourceSpec(Edge.java:340)
at
org.apache.tez.dag.app.dag.impl.VertexImpl.getSourceSpecFor(VertexImpl.java:4489)
at
org.apache.tez.dag.app.dag.impl.VertexImpl.getOutputSpecList(VertexImpl.java:4477)
at
org.apache.tez.dag.app.dag.impl.VertexImpl.createRemoteTaskSpec(VertexImpl.java:1647)
at
org.apache.tez.dag.app.dag.impl.VertexImpl.scheduleTasks(VertexImpl.java:1683)
] completed., numCompletedVertices=2, numSuccessfulVertices=0,
numFailedVertices=1, numKilledVertices=1, numVertices=2
2019-03-13 15:12:19,418 [INFO] [Dispatcher thread {Central}] |impl.DAGImpl|:
Checking vertices for DAG completion, num
CompletedVertices=2, numSuccessfulVertices=0, numFailedVertices=1,
numKilledVertices=1, numVertices=2, commitInProgres
s=0, terminationCause=VERTEX_FAILURE
2019-03-13 15:12:19,418 [INFO] [Dispatcher thread {Central}] |impl.DAGImpl|:
DAG did not succeed due to VERTEX_FAILURE
. failedVertices:1 killedVertices:1
2019-03-13 15:12:19,443 [INFO] [Dispatcher thread {Central}]
|recovery.RecoveryService|: DAG completed, dagId=dag_1552
507929653_0001_1, queueSize=0
2019-03-13 15:12:19,457 [INFO] [Dispatcher thread {Central}]
|HistoryEventHandler.criticalEvents|: [HISTORY][DAG:dag_1
552507929653_0001_1][Event:DAG_FINISHED]: dagId=dag_1552507929653_0001_1,
startTime=1552507939233, finishTime=15525079
39419, timeTaken=186, status=FAILED, diagnostics=Vertex failed, vertexName=v1,
vertexId=vertex_1552507929653_0001_1_00
, diagnostics=[Exception in EdgeManager, vertex:vertex_1552507929653_0001_1_00
[v1],java.lang.RuntimeException: EM_Get
NumSourceTaskPhysicalOutputs
at
org.apache.tez.test.TestExceptionPropagation$CustomEdgeManager.getNumSourceTaskPhysicalOutputs(TestExceptio
nPropagation.java:828)
at org.apache.tez.dag.app.dag.impl.Edge.getSourceSpec(Edge.java:340)
at
org.apache.tez.dag.app.dag.impl.VertexImpl.getSourceSpecFor(VertexImpl.java:4489)
at
org.apache.tez.dag.app.dag.impl.VertexImpl.getOutputSpecList(VertexImpl.java:4477)
at
org.apache.tez.dag.app.dag.impl.VertexImpl.createRemoteTaskSpec(VertexImpl.java:1647)
at
org.apache.tez.dag.app.dag.impl.VertexImpl.scheduleTasks(VertexImpl.java:1683)
at
org.apache.tez.dag.app.dag.impl.VertexManager$VertexManagerPluginContextImpl.scheduleTasks(VertexManager.java:221)
at
org.apache.tez.dag.app.dag.impl.RootInputVertexManager.schedulePendingTasks(RootInputVertexManager.java:386)
at
org.apache.tez.dag.app.dag.impl.RootInputVertexManager.processPendingTasks(RootInputVertexManager.java:379)
at
org.apache.tez.dag.app.dag.impl.RootInputVertexManager.onVertexStarted(RootInputVertexManager.java:182)
at
org.apache.tez.test.TestExceptionPropagation$RootInputVertexManagerWithException.onVertexStarted(TestExceptionPropagation.java:714)
at
org.apache.tez.dag.app.dag.impl.VertexManager$VertexManagerEventOnVertexStarted.invoke(VertexManager.java:618)
at
org.apache.tez.dag.app.dag.impl.VertexManager$VertexManagerEvent$1.run(VertexManager.java:687)
at
org.apache.tez.dag.app.dag.impl.VertexManager$VertexManagerEvent$1.run(VertexManager.java:682)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1953)
at
org.apache.tez.dag.app.dag.impl.VertexManager$VertexManagerEvent.call(VertexManager.java:682)
at
org.apache.tez.dag.app.dag.impl.VertexManager$VertexManagerEvent.call(VertexManager.java:671)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
