[ https://issues.apache.org/jira/browse/ASTERIXDB-2083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Taewoo Kim closed ASTERIXDB-2083. --------------------------------- Resolution: Fixed > An inverted index-search generates OOM Exception. > ------------------------------------------------- > > Key: ASTERIXDB-2083 > URL: https://issues.apache.org/jira/browse/ASTERIXDB-2083 > Project: Apache AsterixDB > Issue Type: Bug > Reporter: Taewoo Kim > Assignee: Taewoo Kim > Priority: Major > > An inverted index search can generate OOM Exception if the index size is > large. This can apply to any inverted-index search related functions such as > *ftcontains* and *contains*. > An example exception message is as follows. We can see that this happens > during an inverted-index search. > {code} > Aug 15, 2017 6:58:06 AM > org.apache.hyracks.api.lifecycle.LifeCycleComponentManager uncaughtException > SEVERE: Uncaught Exception from thread Executor-9:1 > java.lang.OutOfMemoryError: Java heap space > Aug 15, 2017 6:58:06 AM > org.apache.hyracks.api.lifecycle.LifeCycleComponentManager stopAll > INFO: Attempting to stop > org.apache.hyracks.api.lifecycle.LifeCycleComponentManager@69a3d1d > Aug 15, 2017 6:58:06 AM > org.apache.hyracks.api.lifecycle.LifeCycleComponentManager stopAll > SEVERE: Stopping instance > Aug 15, 2017 6:58:06 AM > org.apache.hyracks.control.common.work.WorkQueue$WorkerThread run > INFO: Executing: AbortTasks > Aug 15, 2017 6:58:06 AM org.apache.hyracks.control.nc.Task run > WARNING: Task TAID:TID:ANID:ODID:4:0:0:0 failed with exception > org.apache.hyracks.api.exceptions.HyracksDataException: > java.lang.OutOfMemoryError: Java heap space > at > org.apache.hyracks.api.exceptions.HyracksDataException.create(HyracksDataException.java:45) > at > org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.runInParallel(SuperActivityOperatorNodePushable.java:220) > at > org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.initialize(SuperActivityOperatorNodePushable.java:86) > at org.apache.hyracks.control.nc.Task.run(Task.java:286) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:744) > Caused by: java.lang.OutOfMemoryError: Java heap space > at > org.apache.hyracks.storage.am.btree.impls.BTree.createOpContext(BTree.java:753) > at > org.apache.hyracks.storage.am.btree.impls.BTree.access$100(BTree.java:67) > at > org.apache.hyracks.storage.am.btree.impls.BTree$BTreeAccessor.<init>(BTree.java:844) > at > org.apache.hyracks.storage.am.btree.impls.BTree.createAccessor(BTree.java:820) > at > org.apache.hyracks.storage.am.lsm.invertedindex.ondisk.OnDiskInvertedIndexOpContext.<init>(OnDiskInvertedIndexOpContext.java:42) > at > org.apache.hyracks.storage.am.lsm.invertedindex.ondisk.OnDiskInvertedIndex$OnDiskInvertedIndexAccessor.<init>(OnDiskInvertedIndex.java:422) > at > org.apache.hyracks.storage.am.lsm.invertedindex.ondisk.OnDiskInvertedIndex.createAccessor(OnDiskInvertedIndex.java:491) > at > org.apache.hyracks.storage.am.lsm.invertedindex.impls.LSMInvertedIndex.search(LSMInvertedIndex.java:275) > at > org.apache.hyracks.storage.am.lsm.common.impls.LSMHarness.search(LSMHarness.java:445) > at > org.apache.hyracks.storage.am.lsm.invertedindex.impls.LSMInvertedIndexAccessor.search(LSMInvertedIndexAccessor.java:77) > at > org.apache.hyracks.storage.am.common.dataflow.IndexSearchOperatorNodePushable.nextFrame(IndexSearchOperatorNodePushable.java:193) > at > org.apache.hyracks.dataflow.common.comm.io.AbstractFrameAppender.write(AbstractFrameAppender.java:92) > at > org.apache.hyracks.algebricks.runtime.operators.base.AbstractOneInputOneOutputOneFramePushRuntime.flushAndReset(AbstractOneInputOneOutputOneFramePushRuntime.java:66) > at > org.apache.hyracks.algebricks.runtime.operators.base.AbstractOneInputOneOutputOneFramePushRuntime.flushIfNotFailed(AbstractOneInputOneOutputOneFramePushRuntime.java:72) > at > org.apache.hyracks.algebricks.runtime.operators.base.AbstractOneInputOneOutputOneFramePushRuntime.close(AbstractOneInputOneOutputOneFramePushRuntime.java:55) > at > org.apache.hyracks.algebricks.runtime.operators.std.AssignRuntimeFactory$1.close(AssignRuntimeFactory.java:119) > at > org.apache.hyracks.algebricks.runtime.operators.std.EmptyTupleSourceRuntimeFactory$1.close(EmptyTupleSourceRuntimeFactory.java:65) > at > org.apache.hyracks.algebricks.runtime.operators.meta.AlgebricksMetaOperatorDescriptor$1.initialize(AlgebricksMetaOperatorDescriptor.java:104) > at > org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable$$Lambda$57/871672554.run(Unknown > Source) > at > org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.lambda$runInParallel$1(SuperActivityOperatorNodePushable.java:204) > at > org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable$$Lambda$59/686827126.call(Unknown > Source) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > ... 3 more > {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005)