Seungun Choe created TAJO-246:
---------------------------------
Summary: java.lang.ArrayIndexOutOfBoundsException occurs sometimes
Key: TAJO-246
URL: https://issues.apache.org/jira/browse/TAJO-246
Project: Tajo
Issue Type: Bug
Reporter: Seungun Choe
{code}
---------------------------------------------------------------
Execution Block Graph (TERMINAL - eb_1381647894474_0002_000004)
-------------------------------------------------------------------------------
|-eb_1381647894474_0002_000004
|-eb_1381647894474_0002_000003
|-eb_1381647894474_0002_000002
|-eb_1381647894474_0002_000001
-------------------------------------------------------------------------------
=======================================================
Block Id: eb_1381647894474_0002_000001 [LEAF]
=======================================================
[Outgoing]
[q_1381647894474_0002] 1 => 3 (type=HASH_PARTITION, key=id, num=32)
Table Subquery (alias = b)
"Scan" : {"table":"web_category_info", "qual": "aa.kk (TEXT(0)) = car", "target
list": aa.cc (TEXT(0)), aa.pp (TEXT(0)), aa.dd (TEXT(0)), aa.id (TEXT(0)),
aa.ee (TEXT(0)), aa.bb (TEXT(0)),
"out schema": {aa.cc (TEXT(0)),aa.pp (TEXT(0)),aa.dd (TEXT(0)),aa.id
(TEXT(0)),aa.ee (TEXT(0)),aa.bb (TEXT(0))}
"in schema": {aa.kk (TEXT(0)),aa.cc (TEXT(0)),aa.pp (TEXT(0)),aa.dd
(TEXT(0)),aa.id (TEXT(0)),aa.ee (TEXT(0)),web_category_info.open_date
(TEXT(0)),aa.cnt (INT8(0)),aa.bb (TEXT(0))}
=======================================================
Block Id: eb_1381647894474_0002_000002 [LEAF]
=======================================================
[Outgoing]
[q_1381647894474_0002] 2 => 3 (type=HASH_PARTITION, key=id, num=32)
Table Subquery (alias = a)
"Scan" : {"table":"table1", "qual": "table1.col5 (TEXT(0)) = 109 AND
table1.col2 (TEXT(0)) = data1", "target list": table1.col5 (TEXT(0)) as vdate,
table1.col6 (TEXT(0)) as vcol6, table1.col10 (TEXT(0)), table1.col1 (TEXT(0)),
table1.col2 (TEXT(0)) as pt, split_part(split_part(table1.skip
(TEXT(0)),clubid=,2),&,1) as id,
"out schema": {vdate (TEXT(0)),vcol6 (TEXT(0)),table1.col10
(TEXT(0)),table1.col1 (TEXT(0)),pt (TEXT(0)),id (TEXT(0))}
"in schema": {table1.col1 (TEXT(0)),table1.col10 (TEXT(0)),table1.col2
(TEXT(0)),table1.skip (TEXT(0)),table1.col5 (TEXT(0)),table1.col6 (TEXT(0))}
=======================================================
Block Id: eb_1381647894474_0002_000003 [INTERMEDIATE]
=======================================================
[Incoming]
[q_1381647894474_0002] 1 => 3 (type=HASH_PARTITION, key=id, num=32)
[q_1381647894474_0002] 2 => 3 (type=HASH_PARTITION, key=id, num=32)
[Outgoing]
[q_1381647894474_0002] 3 => 4 (type=NONE_PARTITION)
"Join": "joinType": " INNER", "qual": a.id (TEXT(0)) = b.id (TEXT(0)), "target
list": a.col10 (TEXT(0)), a.col1 (TEXT(0)), a.pt (TEXT(0)), b.skip (TEXT(0)),
a.id (TEXT(0)), b.name (TEXT(0)), ?int8_0 (INT8(0)), b.category (TEXT(0)),
b.sub_query (TEXT(0)), b.keyword (TEXT(0)), a.vcol6 (TEXT(0)), a.vdate (TEXT(0))
"out schema: {a.col10 (TEXT(0)),a.col1 (TEXT(0)),a.pt (TEXT(0)),b.skip
(TEXT(0)),a.id (TEXT(0)),b.name (TEXT(0)),?int8_0 (INT8(0)),b.category
(TEXT(0)),b.sub_query (TEXT(0)),b.keyword (TEXT(0)),a.vcol6 (TEXT(0)),a.vdate
(TEXT(0))}
"in schema: {b.category (TEXT(0)),b.sub_query (TEXT(0)),b.skip (TEXT(0)),b.id
(TEXT(0)),b.name (TEXT(0)),b.keyword (TEXT(0)),?int8_0 (INT8(0)),a.vdate
(TEXT(0)),a.vcol6 (TEXT(0)),a.col10 (TEXT(0)),a.col1 (TEXT(0)),a.pt
(TEXT(0)),a.id (TEXT(0))}
"Scan" : {"table":"eb_1381647894474_0002_000001",
"out schema": {b.category (TEXT(0)),b.sub_query (TEXT(0)),b.skip
(TEXT(0)),b.id (TEXT(0)),b.name (TEXT(0)),b.keyword (TEXT(0)),?int8_0 (INT8(0))}
"in schema": {b.category (TEXT(0)),b.sub_query (TEXT(0)),b.skip
(TEXT(0)),b.id (TEXT(0)),b.name (TEXT(0)),b.keyword (TEXT(0)),?int8_0
(INT8(0))} and "Scan" : {"table":"eb_1381647894474_0002_000002",
"out schema": {a.vdate (TEXT(0)),a.vcol6 (TEXT(0)),a.col10 (TEXT(0)),a.col1
(TEXT(0)),a.pt (TEXT(0)),a.id (TEXT(0))}
"in schema": {a.vdate (TEXT(0)),a.vcol6 (TEXT(0)),a.col10 (TEXT(0)),a.col1
(TEXT(0)),a.pt (TEXT(0)),a.id (TEXT(0))}
=======================================================
Block Id: eb_1381647894474_0002_000004 [TERMINAL]
=======================================================
2013-10-13 16:10:13,906 INFO service.AbstractService
(AbstractService.java:start(94)) -
Service:org.apache.tajo.worker.AbstractResourceAllocator is started.
2013-10-13 16:10:13,907 INFO service.AbstractService
(AbstractService.java:start(94)) -
Service:org.apache.tajo.master.TajoAsyncDispatcher is started.
2013-10-13 16:10:13,907 INFO master.TajoAsyncDispatcher
(TajoAsyncDispatcher.java:start(101)) - AsyncDispatcher
started:q_1381647894474_0002
2013-10-13 16:10:13,907 INFO service.AbstractService
(AbstractService.java:start(94)) -
Service:org.apache.tajo.master.querymaster.QueryMasterTask is started.
2013-10-13 16:10:13,907 INFO querymaster.Query (Query.java:handle(443)) -
Processing q_1381647894474_0002 of type INIT
2013-10-13 16:10:13,908 INFO querymaster.Query (Query.java:handle(457)) -
q_1381647894474_0002 Query Transitioned from QUERY_NEW to QUERY_INIT
2013-10-13 16:10:13,908 INFO querymaster.Query (Query.java:handle(443)) -
Processing q_1381647894474_0002 of type START
2013-10-13 16:10:13,913 INFO querymaster.SubQuery
(SubQuery.java:calculatePartitionNum(506)) - Outer volume: 1.0
2013-10-13 16:10:13,913 INFO querymaster.SubQuery
(SubQuery.java:calculatePartitionNum(507)) - Inner volume: 3288.0
2013-10-13 16:10:13,913 INFO querymaster.SubQuery
(SubQuery.java:calculatePartitionNum(512)) - Smaller Table's volume is
approximately 1 MB
2013-10-13 16:10:13,913 INFO querymaster.SubQuery
(SubQuery.java:calculatePartitionNum(516)) - The determined number of join
partitions is 1
2013-10-13 16:10:13,924 INFO storage.AbstractStorageManager
(AbstractStorageManager.java:listStatus(377)) - Total input paths to process : 1
2013-10-13 16:10:13,964 INFO storage.AbstractStorageManager
(AbstractStorageManager.java:getSplits(593)) - Total # of splits: 1
2013-10-13 16:10:13,967 INFO querymaster.SubQuery
(SubQuery.java:createTasks(566)) - Create 1 Tasks
2013-10-13 16:10:13,970 INFO service.AbstractService
(AbstractService.java:init(81)) -
Service:org.apache.tajo.master.TaskSchedulerImpl is inited.
2013-10-13 16:10:13,970 INFO event.TaskScheduleEvent
(TaskSchedulerImpl.java:start(90)) - Start TaskScheduler
2013-10-13 16:10:13,970 INFO service.AbstractService
(AbstractService.java:start(94)) -
Service:org.apache.tajo.master.TaskSchedulerImpl is started.
2013-10-13 16:10:13,978 INFO querymaster.SubQuery
(SubQuery.java:allocateContainers(620)) - Request Container for
eb_1381647894474_0002_000001 containers=1
2013-10-13 16:10:13,983 INFO querymaster.Query (Query.java:handle(457)) -
q_1381647894474_0002 Query Transitioned from QUERY_INIT to QUERY_RUNNING
2013-10-13 16:10:13,983 INFO worker.TajoResourceAllocator
(TajoResourceAllocator.java:run(223)) - Start TajoWorkerAllocationThread
2013-10-13 16:10:13,987 INFO worker.TajoResourceAllocator
(TajoResourceAllocator.java:run(323)) - Stop TajoWorkerAllocationThread
2013-10-13 16:10:13,988 INFO querymaster.SubQuery
(SubQuery.java:transition(686)) - SubQuery (eb_1381647894474_0002_000001) has 1
containers!
2013-10-13 16:10:13,990 INFO master.ContainerProxy
(TajoContainerProxy.java:launch(56)) - Launch
Container:eb_1381647894474_0002_000001,1,container_1381647894474_0002_01_000001,ceo-tajo05:8092,
pullServer=37687
2013-10-13 16:10:13,993 INFO worker.TajoResourceAllocator
(TajoResourceAllocator.java:run(182)) - ContainerProxy
started:container_1381647894474_0002_01_000001
2013-10-13 16:10:13,996 INFO querymaster.Query (Query.java:handle(443)) -
Processing q_1381647894474_0002 of type INIT_COMPLETED
2013-10-13 16:10:14,003 INFO event.TaskScheduleEvent
(TaskSchedulerImpl.java:handle(232)) - TaskRequest:
container_1381647894474_0002_01_000001,eb_1381647894474_0002_000001
2013-10-13 16:10:14,148 ERROR querymaster.QueryUnitAttempt
(QueryUnitAttempt.java:transition(312)) - FROM ceo-tajo05 >>
java.lang.ArrayIndexOutOfBoundsException: 6
at org.apache.tajo.storage.VTuple.get(VTuple.java:97)
at
org.apache.tajo.storage.CSVFile$CSVAppender.addTuple(CSVFile.java:172)
at
org.apache.tajo.engine.planner.physical.PartitionedStoreExec.next(PartitionedStoreExec.java:124)
at org.apache.tajo.worker.Task.run(Task.java:381)
at org.apache.tajo.worker.TaskRunner$2.run(TaskRunner.java:364)
at java.lang.Thread.run(Thread.java:662)
2013-10-13 16:10:14,148 INFO event.TaskScheduleEvent
(TaskSchedulerImpl.java:handle(232)) - TaskRequest:
container_1381647894474_0002_01_000001,eb_1381647894474_0002_000001
2013-10-13 16:10:14,149 INFO querymaster.QueryUnit
(QueryUnit.java:transition(432)) -
=============================================================
2013-10-13 16:10:14,149 INFO querymaster.QueryUnit
(QueryUnit.java:transition(433)) - >>> Task Failed:
ta_1381647894474_0002_000001_000000_00 <<<
2013-10-13 16:10:14,149 INFO querymaster.QueryUnit
(QueryUnit.java:transition(434)) -
=============================================================
2013-10-13 16:10:14,209 ERROR querymaster.QueryUnitAttempt
(QueryUnitAttempt.java:transition(312)) - FROM ceo-tajo05 >>
java.lang.ArrayIndexOutOfBoundsException: 6
at org.apache.tajo.storage.VTuple.get(VTuple.java:97)
at
org.apache.tajo.storage.CSVFile$CSVAppender.addTuple(CSVFile.java:172)
at
org.apache.tajo.engine.planner.physical.PartitionedStoreExec.next(PartitionedStoreExec.java:124)
at org.apache.tajo.worker.Task.run(Task.java:381)
at org.apache.tajo.worker.TaskRunner$2.run(TaskRunner.java:364)
at java.lang.Thread.run(Thread.java:662)
2013-10-13 16:10:14,209 INFO querymaster.QueryUnit
(QueryUnit.java:transition(432)) -
=============================================================
2013-10-13 16:10:14,209 INFO querymaster.QueryUnit
(QueryUnit.java:transition(433)) - >>> Task Failed:
ta_1381647894474_0002_000001_000000_01 <<<
2013-10-13 16:10:14,209 INFO event.TaskScheduleEvent
(TaskSchedulerImpl.java:handle(232)) - TaskRequest:
container_1381647894474_0002_01_000001,eb_1381647894474_0002_000001
2013-10-13 16:10:14,209 INFO querymaster.QueryUnit
(QueryUnit.java:transition(434)) -
=============================================================
2013-10-13 16:10:14,320 ERROR querymaster.QueryUnitAttempt
(QueryUnitAttempt.java:transition(312)) - FROM ceo-tajo05 >>
java.lang.ArrayIndexOutOfBoundsException
2013-10-13 16:10:14,320 INFO querymaster.QueryUnit
(QueryUnit.java:transition(432)) -
=============================================================
2013-10-13 16:10:14,320 INFO querymaster.QueryUnit
(QueryUnit.java:transition(433)) - >>> Task Failed:
ta_1381647894474_0002_000001_000000_02 <<<
2013-10-13 16:10:14,320 INFO event.TaskScheduleEvent
(TaskSchedulerImpl.java:handle(232)) - TaskRequest:
container_1381647894474_0002_01_000001,eb_1381647894474_0002_000001
2013-10-13 16:10:14,320 INFO querymaster.QueryUnit
(QueryUnit.java:transition(434)) -
=============================================================
2013-10-13 16:10:14,994 INFO rpc.NettyClientBase
(NettyClientBase.java:close(87)) - Proxy is disconnected from 50.1.102.126:8092
{code}
--
This message was sent by Atlassian JIRA
(v6.1#6144)
