[
https://issues.apache.org/jira/browse/ASTERIXDB-1152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15012366#comment-15012366
]
ASF subversion and git services commented on ASTERIXDB-1152:
------------------------------------------------------------
Commit d1b19bbf97eaef5d18178615a8d1f5fc14349989 in incubator-asterixdb's branch
refs/heads/master from [~mhubail]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-asterixdb.git;h=d1b19bb ]
ASTERIXDB-1152: Delete storage data of old instances
Change-Id: Ibb6c6949bdf2ed6c3e491fa66a23491ff34fc830
Reviewed-on: https://asterix-gerrit.ics.uci.edu/469
Tested-by: Jenkins <[email protected]>
Reviewed-by: Till Westmann <[email protected]>
Reviewed-by: Taewoo Kim <[email protected]>
Reviewed-by: Ian Maxon <[email protected]>
> DatasetLifecycleManager returns wrong index because of resourceID fetching
> issues
> ---------------------------------------------------------------------------------
>
> Key: ASTERIXDB-1152
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1152
> Project: Apache AsterixDB
> Issue Type: Bug
> Reporter: Taewoo Kim
> Assignee: Murtadha Hubail
>
> When you have multiple secondary indexes on a dataset and tries to bulkload
> data into that dataset, an exception happens. The reason that Young-Seok and
> I observed was one issue. That is, IndexLifecycleManager returns wrong index
> because of resourceID fetching issues. Specifically, if an index file already
> exists on disk, it is cached as a local resource. When indexDataFlowHelper
> tries to get the index by dataset and resource name, IndexLifecyclyManager
> returns a wrong resource ID to the currently existing index (e.g., LSMBTree
> index will be returned for LSMInvertedIndexDataflowHelper).
> You can reproduce this issue by executing one ExecutionTest that creates
> multiple secondary indexes and does a bulkload -
> index-leftouterjoin/probe-pidx-with-join-btree-sidx1.
> Then, you can see the following exception, which is the result of mismatch
> between the expected index-type and actual index.
> org.apache.hyracks.api.exceptions.HyracksDataException:
> java.lang.ArrayIndexOutOfBoundsException: 2
> at
> org.apache.hyracks.dataflow.std.sort.ExternalSortRunMerger.process(ExternalSortRunMerger.java:215)
> at
> org.apache.hyracks.dataflow.std.sort.AbstractSorterOperatorDescriptor$MergeActivity$1.initialize(AbstractSorterOperatorDescriptor.java:194)
> at
> org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.initialize(SuperActivityOperatorNodePushable.java:85)
> at org.apache.hyracks.control.nc.Task.run(Task.java:255)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.ArrayIndexOutOfBoundsException: 2
> at
> org.apache.hyracks.storage.am.common.tuples.TypeAwareTupleWriter.getFieldSlotsBytes(TypeAwareTupleWriter.java:126)
> at
> org.apache.hyracks.storage.am.common.tuples.TypeAwareTupleWriter.bytesRequired(TypeAwareTupleWriter.java:40)
> at
> org.apache.hyracks.storage.am.lsm.btree.tuples.LSMBTreeTupleWriter.bytesRequired(LSMBTreeTupleWriter.java:43)
> at
> org.apache.hyracks.storage.am.btree.frames.BTreeNSMLeafFrame.getBytesRequriedToWriteTuple(BTreeNSMLeafFrame.java:54)
> at
> org.apache.hyracks.storage.am.btree.impls.BTree$BTreeBulkLoader.add(BTree.java:974)
> at
> org.apache.hyracks.storage.am.lsm.btree.impls.LSMBTree$LSMBTreeBulkLoader.add(LSMBTree.java:690)
> at
> org.apache.hyracks.storage.am.common.dataflow.IndexBulkLoadOperatorNodePushable.nextFrame(IndexBulkLoadOperatorNodePushable.java:95)
> at
> org.apache.hyracks.dataflow.common.comm.io.AbstractFrameAppender.flush(AbstractFrameAppender.java:83)
> at
> org.apache.hyracks.dataflow.std.sort.AbstractFrameSorter.flush(AbstractFrameSorter.java:176)
> at
> org.apache.hyracks.dataflow.std.sort.ExternalSortRunMerger.process(ExternalSortRunMerger.java:128)
> ... 6 more
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
