[
https://issues.apache.org/jira/browse/TAJO-1111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14167086#comment-14167086
]
Hyunsik Choi commented on TAJO-1111:
------------------------------------
I tried to reproduce the bug for two days in order to get some detailed error
log. It was hard to reproduce because it occurs rarely. Finally, I grabbed the
detail error log!!!
{noformat}
2014-10-10 09:05:12,569 INFO: org.apache.tajo.storage.AbstractStorageManager
(listStatus(385)) - Total input paths to process : 1
2014-10-10 09:05:12,570 INFO: org.apache.tajo.storage.AbstractStorageManager
(getSplits(614)) - Total # of splits: 1
2014-10-10 09:05:12,570 INFO: org.apache.tajo.master.querymaster.Query
(handle(952)) - Processing q_1412957112432_0000 of type KILL
2014-10-10 09:05:12,570 INFO: org.apache.tajo.master.querymaster.Query
(handle(970)) - q_1412957112432_0000 Query Transitioned from QUERY_RUNNING to
QUERY_KILL_WAIT
2014-10-10 09:05:12,570 INFO: org.apache.tajo.master.DefaultTaskScheduler
(stop(148)) - Task Scheduler stopped
2014-10-10 09:05:12,570 INFO: org.apache.tajo.master.querymaster.SubQuery
(run(673)) - 1 objects are scheduled
2014-10-10 09:05:12,570 INFO: org.apache.tajo.master.DefaultTaskScheduler
(handle(244)) - ta_1412957112432_0000_000001_000000_00 is canceled from
DefaultTaskScheduler
2014-10-10 09:05:12,570 INFO:
org.apache.tajo.master.querymaster.QueryUnitAttempt (transition(326)) -
ta_1412957112432_0000_000001_000000_00 Received TA_KILLED Status from LocalTask
2014-10-10 09:05:12,571 ERROR: org.apache.tajo.master.querymaster.QueryUnit
(handle(601)) - Can't handle this event at current state, eventType:T_KILL,
oldState:KILLED, nextState:KILLED
org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event:
T_KILL at KILLED
at
org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:305)
at
org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:46)
at
org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:448)
at org.apache.tajo.master.querymaster.QueryUnit.handle(QueryUnit.java:599)
at
org.apache.tajo.master.querymaster.QueryMasterTask$TaskEventDispatcher.handle(QueryMasterTask.java:286)
at
org.apache.tajo.master.querymaster.QueryMasterTask$TaskEventDispatcher.handle(QueryMasterTask.java:277)
at
org.apache.tajo.master.TajoAsyncDispatcher.dispatch(TajoAsyncDispatcher.java:137)
at
org.apache.tajo.master.TajoAsyncDispatcher$1.run(TajoAsyncDispatcher.java:79)
at java.lang.Thread.run(Thread.java:744)
2014-10-10 09:05:12,571 INFO: org.apache.tajo.master.querymaster.SubQuery
(transition(1114)) - [eb_1412957112432_0000_000001] Task Completion Event
(Total: 1, Success: 0, Killed: 1, Failed: 0)
2014-10-10 09:05:12,571 INFO: org.apache.tajo.master.querymaster.Query
(handle(952)) - Processing q_1412957112432_0000 of type INTERNAL_ERROR
2014-10-10 09:05:12,572 INFO: org.apache.tajo.master.querymaster.Query
(handle(970)) - q_1412957112432_0000 Query Transitioned from QUERY_KILL_WAIT to
QUERY_ERROR
2014-10-10 09:05:12,572 INFO: org.apache.tajo.master.querymaster.SubQuery
(transition(1216)) - subQuery completed - eb_1412957112432_0000_000001
(total=1, success=0, killed=1)
2014-10-10 09:05:12,572 INFO: org.apache.tajo.master.querymaster.QueryMaster
(cleanupExecutionBlock(186)) - cleanup executionBlocks:
2014-10-10 09:05:12,572 INFO:
org.apache.tajo.master.querymaster.QueryMasterTask (handle(323)) - Query
completion notified from q_1412957112432_0000
2014-10-10 09:05:12,572 INFO:
org.apache.tajo.master.querymaster.QueryMasterTask (handle(334)) - Query final
state: QUERY_ERROR
2014-10-10 09:05:12,572 INFO: org.apache.tajo.master.querymaster.Query
(handle(952)) - Processing q_1412957112432_0000 of type SUBQUERY_COMPLETED
2014-10-10 09:05:12,572 ERROR: org.apache.tajo.master.querymaster.Query
(handle(960)) - Can't handle this event at current state, type:EventType:
SUBQUERY_COMPLETED, oldState:QUERY_ERROR, nextState:QUERY_ERROR
org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event:
SUBQUERY_COMPLETED at QUERY_ERROR
at
org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:305)
at
org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:46)
at
org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:448)
at org.apache.tajo.master.querymaster.Query.handle(Query.java:957)
at org.apache.tajo.master.querymaster.Query.handle(Query.java:63)
at
org.apache.tajo.master.TajoAsyncDispatcher.dispatch(TajoAsyncDispatcher.java:137)
at
org.apache.tajo.master.TajoAsyncDispatcher$1.run(TajoAsyncDispatcher.java:79)
at java.lang.Thread.run(Thread.java:744)
2014-10-10 09:05:12,573 INFO: org.apache.tajo.master.querymaster.Query
(handle(952)) - Processing q_1412957112432_0000 of type INTERNAL_ERROR
2014-10-10 09:05:12,573 INFO:
org.apache.tajo.master.querymaster.QueryMasterTask (handle(323)) - Query
completion notified from q_1412957112432_0000
2014-10-10 09:05:12,573 INFO:
org.apache.tajo.master.querymaster.QueryMasterTask (handle(334)) - Query final
state: QUERY_ERROR
Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 2.408 sec <<<
FAILURE! - in org.apache.tajo.master.querymaster.TestKillQuery
testKillQueryFromInitState(org.apache.tajo.master.querymaster.TestKillQuery)
Time elapsed: 2.408 sec <<< FAILURE!
java.lang.AssertionError: expected:<QUERY_KILLED> but was:<QUERY_ERROR>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:144)
at
org.apache.tajo.master.querymaster.TestKillQuery.testKillQueryFromInitState(TestKillQuery.java:104)
Running org.apache.tajo.master.querymaster.TestQueryProgress
2014-10-10 09:05:14,717 INFO: org.apache.tajo.master.session.SessionManager
(createSession(73)) - Session 8297515c-6bca-4617-a4d5-bf92f332075a is created.
2014-10-10 09:05:14,717 INFO: org.apache.tajo.master.GlobalEngine
(executeQuery(156)) - Query: select l_orderkey from lineitem group by l_orderkey
2014-10-10 09:05:14,731 INFO: org.apache.tajo.master.GlobalEngine
(createLogicalPlan(507)) - Non Optimized Query:
{noformat}
> TestKillQuery.testKillQueryFromInitState occasionally fails
> -----------------------------------------------------------
>
> Key: TAJO-1111
> URL: https://issues.apache.org/jira/browse/TAJO-1111
> Project: Tajo
> Issue Type: Bug
> Components: query master
> Reporter: Hyunsik Choi
> Priority: Blocker
> Fix For: 0.9.0
>
>
> See the title. this test occasionally fails.
> {noformat}
> [INFO] Results :
> [INFO]
> [INFO] Failed tests:
> [INFO] TestKillQuery.testKillQueryFromInitState:104 expected:<QUERY_KILLED>
> but was:<QUERY_ERROR>
> [INFO]
> [INFO] Tests run: 1234, Failures: 1, Errors: 0, Skipped: 0
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
