[
https://issues.apache.org/jira/browse/TAJO-246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyunsik Choi resolved TAJO-246.
-------------------------------
Resolution: Cannot Reproduce
> java.lang.ArrayIndexOutOfBoundsException occurs sometimes
> ---------------------------------------------------------
>
> Key: TAJO-246
> URL: https://issues.apache.org/jira/browse/TAJO-246
> Project: Tajo
> Issue Type: Bug
> Reporter: Seungun Choe
>
> {code}
> ---------------------------------------------------------------
> Execution Block Graph (TERMINAL - eb_1381647894474_0002_000004)
> -------------------------------------------------------------------------------
> |-eb_1381647894474_0002_000004
> |-eb_1381647894474_0002_000003
> |-eb_1381647894474_0002_000002
> |-eb_1381647894474_0002_000001
> -------------------------------------------------------------------------------
> =======================================================
> Block Id: eb_1381647894474_0002_000001 [LEAF]
> =======================================================
> [Outgoing]
> [q_1381647894474_0002] 1 => 3 (type=HASH_PARTITION, key=id, num=32)
> Table Subquery (alias = b)
> "Scan" : {"table":"web_category_info", "qual": "aa.kk (TEXT(0)) = car",
> "target list": aa.cc (TEXT(0)), aa.pp (TEXT(0)), aa.dd (TEXT(0)), aa.id
> (TEXT(0)), aa.ee (TEXT(0)), aa.bb (TEXT(0)),
> "out schema": {aa.cc (TEXT(0)),aa.pp (TEXT(0)),aa.dd (TEXT(0)),aa.id
> (TEXT(0)),aa.ee (TEXT(0)),aa.bb (TEXT(0))}
> "in schema": {aa.kk (TEXT(0)),aa.cc (TEXT(0)),aa.pp (TEXT(0)),aa.dd
> (TEXT(0)),aa.id (TEXT(0)),aa.ee (TEXT(0)),web_category_info.open_date
> (TEXT(0)),aa.cnt (INT8(0)),aa.bb (TEXT(0))}
> =======================================================
> Block Id: eb_1381647894474_0002_000002 [LEAF]
> =======================================================
> [Outgoing]
> [q_1381647894474_0002] 2 => 3 (type=HASH_PARTITION, key=id, num=32)
> Table Subquery (alias = a)
> "Scan" : {"table":"table1", "qual": "table1.col5 (TEXT(0)) = 109 AND
> table1.col2 (TEXT(0)) = data1", "target list": table1.col5 (TEXT(0)) as
> vdate, table1.col6 (TEXT(0)) as vcol6, table1.col10 (TEXT(0)), table1.col1
> (TEXT(0)), table1.col2 (TEXT(0)) as pt, split_part(split_part(table1.skip
> (TEXT(0)),clubid=,2),&,1) as id,
> "out schema": {vdate (TEXT(0)),vcol6 (TEXT(0)),table1.col10
> (TEXT(0)),table1.col1 (TEXT(0)),pt (TEXT(0)),id (TEXT(0))}
> "in schema": {table1.col1 (TEXT(0)),table1.col10 (TEXT(0)),table1.col2
> (TEXT(0)),table1.skip (TEXT(0)),table1.col5 (TEXT(0)),table1.col6 (TEXT(0))}
> =======================================================
> Block Id: eb_1381647894474_0002_000003 [INTERMEDIATE]
> =======================================================
> [Incoming]
> [q_1381647894474_0002] 1 => 3 (type=HASH_PARTITION, key=id, num=32)
> [q_1381647894474_0002] 2 => 3 (type=HASH_PARTITION, key=id, num=32)
> [Outgoing]
> [q_1381647894474_0002] 3 => 4 (type=NONE_PARTITION)
> "Join": "joinType": " INNER", "qual": a.id (TEXT(0)) = b.id (TEXT(0)),
> "target list": a.col10 (TEXT(0)), a.col1 (TEXT(0)), a.pt (TEXT(0)), b.skip
> (TEXT(0)), a.id (TEXT(0)), b.name (TEXT(0)), ?int8_0 (INT8(0)), b.category
> (TEXT(0)), b.sub_query (TEXT(0)), b.keyword (TEXT(0)), a.vcol6 (TEXT(0)),
> a.vdate (TEXT(0))
> "out schema: {a.col10 (TEXT(0)),a.col1 (TEXT(0)),a.pt (TEXT(0)),b.skip
> (TEXT(0)),a.id (TEXT(0)),b.name (TEXT(0)),?int8_0 (INT8(0)),b.category
> (TEXT(0)),b.sub_query (TEXT(0)),b.keyword (TEXT(0)),a.vcol6 (TEXT(0)),a.vdate
> (TEXT(0))}
> "in schema: {b.category (TEXT(0)),b.sub_query (TEXT(0)),b.skip (TEXT(0)),b.id
> (TEXT(0)),b.name (TEXT(0)),b.keyword (TEXT(0)),?int8_0 (INT8(0)),a.vdate
> (TEXT(0)),a.vcol6 (TEXT(0)),a.col10 (TEXT(0)),a.col1 (TEXT(0)),a.pt
> (TEXT(0)),a.id (TEXT(0))}
> "Scan" : {"table":"eb_1381647894474_0002_000001",
> "out schema": {b.category (TEXT(0)),b.sub_query (TEXT(0)),b.skip
> (TEXT(0)),b.id (TEXT(0)),b.name (TEXT(0)),b.keyword (TEXT(0)),?int8_0
> (INT8(0))}
> "in schema": {b.category (TEXT(0)),b.sub_query (TEXT(0)),b.skip
> (TEXT(0)),b.id (TEXT(0)),b.name (TEXT(0)),b.keyword (TEXT(0)),?int8_0
> (INT8(0))} and "Scan" : {"table":"eb_1381647894474_0002_000002",
> "out schema": {a.vdate (TEXT(0)),a.vcol6 (TEXT(0)),a.col10 (TEXT(0)),a.col1
> (TEXT(0)),a.pt (TEXT(0)),a.id (TEXT(0))}
> "in schema": {a.vdate (TEXT(0)),a.vcol6 (TEXT(0)),a.col10 (TEXT(0)),a.col1
> (TEXT(0)),a.pt (TEXT(0)),a.id (TEXT(0))}
> =======================================================
> Block Id: eb_1381647894474_0002_000004 [TERMINAL]
> =======================================================
> 2013-10-13 16:10:13,906 INFO service.AbstractService
> (AbstractService.java:start(94)) -
> Service:org.apache.tajo.worker.AbstractResourceAllocator is started.
> 2013-10-13 16:10:13,907 INFO service.AbstractService
> (AbstractService.java:start(94)) -
> Service:org.apache.tajo.master.TajoAsyncDispatcher is started.
> 2013-10-13 16:10:13,907 INFO master.TajoAsyncDispatcher
> (TajoAsyncDispatcher.java:start(101)) - AsyncDispatcher
> started:q_1381647894474_0002
> 2013-10-13 16:10:13,907 INFO service.AbstractService
> (AbstractService.java:start(94)) -
> Service:org.apache.tajo.master.querymaster.QueryMasterTask is started.
> 2013-10-13 16:10:13,907 INFO querymaster.Query (Query.java:handle(443)) -
> Processing q_1381647894474_0002 of type INIT
> 2013-10-13 16:10:13,908 INFO querymaster.Query (Query.java:handle(457)) -
> q_1381647894474_0002 Query Transitioned from QUERY_NEW to QUERY_INIT
> 2013-10-13 16:10:13,908 INFO querymaster.Query (Query.java:handle(443)) -
> Processing q_1381647894474_0002 of type START
> 2013-10-13 16:10:13,913 INFO querymaster.SubQuery
> (SubQuery.java:calculatePartitionNum(506)) - Outer volume: 1.0
> 2013-10-13 16:10:13,913 INFO querymaster.SubQuery
> (SubQuery.java:calculatePartitionNum(507)) - Inner volume: 3288.0
> 2013-10-13 16:10:13,913 INFO querymaster.SubQuery
> (SubQuery.java:calculatePartitionNum(512)) - Smaller Table's volume is
> approximately 1 MB
> 2013-10-13 16:10:13,913 INFO querymaster.SubQuery
> (SubQuery.java:calculatePartitionNum(516)) - The determined number of join
> partitions is 1
> 2013-10-13 16:10:13,924 INFO storage.AbstractStorageManager
> (AbstractStorageManager.java:listStatus(377)) - Total input paths to process
> : 1
> 2013-10-13 16:10:13,964 INFO storage.AbstractStorageManager
> (AbstractStorageManager.java:getSplits(593)) - Total # of splits: 1
> 2013-10-13 16:10:13,967 INFO querymaster.SubQuery
> (SubQuery.java:createTasks(566)) - Create 1 Tasks
> 2013-10-13 16:10:13,970 INFO service.AbstractService
> (AbstractService.java:init(81)) -
> Service:org.apache.tajo.master.TaskSchedulerImpl is inited.
> 2013-10-13 16:10:13,970 INFO event.TaskScheduleEvent
> (TaskSchedulerImpl.java:start(90)) - Start TaskScheduler
> 2013-10-13 16:10:13,970 INFO service.AbstractService
> (AbstractService.java:start(94)) -
> Service:org.apache.tajo.master.TaskSchedulerImpl is started.
> 2013-10-13 16:10:13,978 INFO querymaster.SubQuery
> (SubQuery.java:allocateContainers(620)) - Request Container for
> eb_1381647894474_0002_000001 containers=1
> 2013-10-13 16:10:13,983 INFO querymaster.Query (Query.java:handle(457)) -
> q_1381647894474_0002 Query Transitioned from QUERY_INIT to QUERY_RUNNING
> 2013-10-13 16:10:13,983 INFO worker.TajoResourceAllocator
> (TajoResourceAllocator.java:run(223)) - Start TajoWorkerAllocationThread
> 2013-10-13 16:10:13,987 INFO worker.TajoResourceAllocator
> (TajoResourceAllocator.java:run(323)) - Stop TajoWorkerAllocationThread
> 2013-10-13 16:10:13,988 INFO querymaster.SubQuery
> (SubQuery.java:transition(686)) - SubQuery (eb_1381647894474_0002_000001) has
> 1 containers!
> 2013-10-13 16:10:13,990 INFO master.ContainerProxy
> (TajoContainerProxy.java:launch(56)) - Launch
> Container:eb_1381647894474_0002_000001,1,container_1381647894474_0002_01_000001,ceo-tajo05:8092,
> pullServer=37687
> 2013-10-13 16:10:13,993 INFO worker.TajoResourceAllocator
> (TajoResourceAllocator.java:run(182)) - ContainerProxy
> started:container_1381647894474_0002_01_000001
> 2013-10-13 16:10:13,996 INFO querymaster.Query (Query.java:handle(443)) -
> Processing q_1381647894474_0002 of type INIT_COMPLETED
> 2013-10-13 16:10:14,003 INFO event.TaskScheduleEvent
> (TaskSchedulerImpl.java:handle(232)) - TaskRequest:
> container_1381647894474_0002_01_000001,eb_1381647894474_0002_000001
> 2013-10-13 16:10:14,148 ERROR querymaster.QueryUnitAttempt
> (QueryUnitAttempt.java:transition(312)) - FROM ceo-tajo05 >>
> java.lang.ArrayIndexOutOfBoundsException: 6
> at org.apache.tajo.storage.VTuple.get(VTuple.java:97)
> at
> org.apache.tajo.storage.CSVFile$CSVAppender.addTuple(CSVFile.java:172)
> at
> org.apache.tajo.engine.planner.physical.PartitionedStoreExec.next(PartitionedStoreExec.java:124)
> at org.apache.tajo.worker.Task.run(Task.java:381)
> at org.apache.tajo.worker.TaskRunner$2.run(TaskRunner.java:364)
> at java.lang.Thread.run(Thread.java:662)
> 2013-10-13 16:10:14,148 INFO event.TaskScheduleEvent
> (TaskSchedulerImpl.java:handle(232)) - TaskRequest:
> container_1381647894474_0002_01_000001,eb_1381647894474_0002_000001
> 2013-10-13 16:10:14,149 INFO querymaster.QueryUnit
> (QueryUnit.java:transition(432)) -
> =============================================================
> 2013-10-13 16:10:14,149 INFO querymaster.QueryUnit
> (QueryUnit.java:transition(433)) - >>> Task Failed:
> ta_1381647894474_0002_000001_000000_00 <<<
> 2013-10-13 16:10:14,149 INFO querymaster.QueryUnit
> (QueryUnit.java:transition(434)) -
> =============================================================
> 2013-10-13 16:10:14,209 ERROR querymaster.QueryUnitAttempt
> (QueryUnitAttempt.java:transition(312)) - FROM ceo-tajo05 >>
> java.lang.ArrayIndexOutOfBoundsException: 6
> at org.apache.tajo.storage.VTuple.get(VTuple.java:97)
> at
> org.apache.tajo.storage.CSVFile$CSVAppender.addTuple(CSVFile.java:172)
> at
> org.apache.tajo.engine.planner.physical.PartitionedStoreExec.next(PartitionedStoreExec.java:124)
> at org.apache.tajo.worker.Task.run(Task.java:381)
> at org.apache.tajo.worker.TaskRunner$2.run(TaskRunner.java:364)
> at java.lang.Thread.run(Thread.java:662)
> 2013-10-13 16:10:14,209 INFO querymaster.QueryUnit
> (QueryUnit.java:transition(432)) -
> =============================================================
> 2013-10-13 16:10:14,209 INFO querymaster.QueryUnit
> (QueryUnit.java:transition(433)) - >>> Task Failed:
> ta_1381647894474_0002_000001_000000_01 <<<
> 2013-10-13 16:10:14,209 INFO event.TaskScheduleEvent
> (TaskSchedulerImpl.java:handle(232)) - TaskRequest:
> container_1381647894474_0002_01_000001,eb_1381647894474_0002_000001
> 2013-10-13 16:10:14,209 INFO querymaster.QueryUnit
> (QueryUnit.java:transition(434)) -
> =============================================================
> 2013-10-13 16:10:14,320 ERROR querymaster.QueryUnitAttempt
> (QueryUnitAttempt.java:transition(312)) - FROM ceo-tajo05 >>
> java.lang.ArrayIndexOutOfBoundsException
> 2013-10-13 16:10:14,320 INFO querymaster.QueryUnit
> (QueryUnit.java:transition(432)) -
> =============================================================
> 2013-10-13 16:10:14,320 INFO querymaster.QueryUnit
> (QueryUnit.java:transition(433)) - >>> Task Failed:
> ta_1381647894474_0002_000001_000000_02 <<<
> 2013-10-13 16:10:14,320 INFO event.TaskScheduleEvent
> (TaskSchedulerImpl.java:handle(232)) - TaskRequest:
> container_1381647894474_0002_01_000001,eb_1381647894474_0002_000001
> 2013-10-13 16:10:14,320 INFO querymaster.QueryUnit
> (QueryUnit.java:transition(434)) -
> =============================================================
> 2013-10-13 16:10:14,994 INFO rpc.NettyClientBase
> (NettyClientBase.java:close(87)) - Proxy is disconnected from
> 50.1.102.126:8092
> {code}
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
