[
https://issues.apache.org/jira/browse/ASTERIXDB-1841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930630#comment-15930630
]
Taewoo Kim edited comment on ASTERIXDB-1841 at 3/17/17 8:12 PM:
----------------------------------------------------------------
Edit: My guess is that if the index size is huge, its instance might not be
activated when the Asterix instance starts. I maybe wrong. When destroying an
index, if an index instance is in memory, it just goes ahead and unregister
that instance and delete files. But, if an index instance is not in memory, the
code tries to create an index instance first. That's where it fails.
was (Author: wangsaeu):
My guess is that if the index size is huge, its instance might not be activated
when the Asterix instance starts. I maybe wrong.
> Dropping a large inverted index generates an exception
> ------------------------------------------------------
>
> Key: ASTERIXDB-1841
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1841
> Project: Apache AsterixDB
> Issue Type: Bug
> Reporter: Taewoo Kim
> Assignee: Abdullah Alamoudi
>
> There are four NCs and each NC has 6GB of allocated memory.
> The size of the dataset itself is about 60GB. The index size is about 37GB.
> When I just tried to delete this index by using the following AQL, an
> exception occurred.
> {code}
> use dataverse exp;
> drop index AmazonReviewNoDup. AmazonReviewNoDup_reviewText_kw_idx;
> {code}
> {code}
> org.apache.hyracks.storage.am.common.dataflow.IndexDropOperatorDescriptor
> cannot be cast to
> org.apache.hyracks.storage.am.lsm.invertedindex.api.IInvertedIndexOperatorDescriptor
> [ClassCastException]
> {code}
> Detailed Exception from the log:
> {code}
> org.apache.hyracks.api.exceptions.HyracksDataException:
> java.lang.ClassCastException:
> org.apache.hyracks.storage.am.common.dataflow.IndexDropOperatorDescriptor
> cannot be cast to
> org.apache.hyracks.storage.am.lsm.invertedindex.api.IInvertedIndexOperatorDescriptor
> at
> org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.runInParallel(SuperActivityOperatorNodePushable.java:228)
> at
> org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.initialize(SuperActivityOperatorNodePushable.java:84)
> at org.apache.hyracks.control.nc.Task.run(Task.java:273)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.util.concurrent.ExecutionException:
> java.lang.ClassCastException:
> org.apache.hyracks.storage.am.common.dataflow.IndexDropOperatorDescriptor
> cannot be cast to
> org.apache.hyracks.storage.am.lsm.invertedindex.api.IInvertedIndexOperatorDescriptor
> at java.util.concurrent.FutureTask.report(FutureTask.java:122)
> at java.util.concurrent.FutureTask.get(FutureTask.java:192)
> at
> org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.runInParallel(SuperActivityOperatorNodePushable.java:222)
> ... 5 more
> Caused by: java.lang.ClassCastException:
> org.apache.hyracks.storage.am.common.dataflow.IndexDropOperatorDescriptor
> cannot be cast to
> org.apache.hyracks.storage.am.lsm.invertedindex.api.IInvertedIndexOperatorDescriptor
> at
> org.apache.hyracks.storage.am.lsm.invertedindex.dataflow.PartitionedLSMInvertedIndexDataflowHelper.createIndexInstance(PartitionedLSMInvertedIndexDataflowHelper.java:79)
> at
> org.apache.hyracks.storage.am.common.dataflow.IndexDataflowHelper.destroy(IndexDataflowHelper.java:140)
> at
> org.apache.hyracks.storage.am.common.dataflow.IndexDropOperatorNodePushable.initialize(IndexDropOperatorNodePushable.java:53)
> at
> org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.lambda$initialize$0(SuperActivityOperatorNodePushable.java:86)
> at
> org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.lambda$runInParallel$2(SuperActivityOperatorNodePushable.java:216)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> ... 3 more
> org.apache.hyracks.api.exceptions.HyracksDataException:
> java.lang.ClassCastException:
> org.apache.hyracks.storage.am.common.dataflow.IndexDropOperatorDescriptor
> cannot be cast to
> org.apache.hyracks.storage.am.lsm.invertedindex.api.IInvertedIndexOperatorDescriptor
> at
> org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.runInParallel(SuperActivityOperatorNodePushable.java:228)
> at
> org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.initialize(SuperActivityOperatorNodePushable.java:84)
> at org.apache.hyracks.control.nc.Task.run(Task.java:273)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.util.concurrent.ExecutionException:
> java.lang.ClassCastException:
> org.apache.hyracks.storage.am.common.dataflow.IndexDropOperatorDescriptor
> cannot be cast to
> org.apache.hyracks.storage.am.lsm.invertedindex.api.IInvertedIndexOperatorDescriptor
> at java.util.concurrent.FutureTask.report(FutureTask.java:122)
> at java.util.concurrent.FutureTask.get(FutureTask.java:192)
> at
> org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.runInParallel(SuperActivityOperatorNodePushable.java:222)
> ... 5 more
> Caused by: java.lang.ClassCastException:
> org.apache.hyracks.storage.am.common.dataflow.IndexDropOperatorDescriptor
> cannot be cast to
> org.apache.hyracks.storage.am.lsm.invertedindex.api.IInvertedIndexOperatorDescriptor
> at
> org.apache.hyracks.storage.am.lsm.invertedindex.dataflow.PartitionedLSMInvertedIndexDataflowHelper.createIndexInstance(PartitionedLSMInvertedIndexDataflowHelper.java:79)
> at
> org.apache.hyracks.storage.am.common.dataflow.IndexDataflowHelper.destroy(IndexDataflowHelper.java:140)
> at
> org.apache.hyracks.storage.am.common.dataflow.IndexDropOperatorNodePushable.initialize(IndexDropOperatorNodePushable.java:53)
> at
> org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.lambda$initialize$0(SuperActivityOperatorNodePushable.java:86)
> at
> org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.lambda$runInParallel$2(SuperActivityOperatorNodePushable.java:216)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> ... 3 more
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
