Chen Luo created ASTERIXDB-2250:
-----------------------------------
Summary: Component files are not cleaned up during failed
FLUSH/MERGE
Key: ASTERIXDB-2250
URL: https://issues.apache.org/jira/browse/ASTERIXDB-2250
Project: Apache AsterixDB
Issue Type: Bug
Components: STO - Storage
Reporter: Chen Luo
When a flush/merge fails, the component bulkloader (or in general the
flush/merge operation) didn't clean up the component files. As a result, the
next time when the flush/merge is scheduled again, the system will complain the
files already exist on disk.
{code}
org.apache.hyracks.api.exceptions.HyracksDataException: HYR0082: Failed to
create the file
/Users/luochen/Documents/Research/projects/asterixdb/asterixdb/asterix-app/target/tmp/asterix_nc1/iodevice1/storage/partition_0/test/LineItem/0/idx_LineItem_partkey/2018-01-17-09-19-03-524_2018-01-17-09-19-03-510_b
because it already exists
at
org.apache.hyracks.api.exceptions.HyracksDataException.create(HyracksDataException.java:53)
~[classes/:?]
at org.apache.hyracks.api.util.IoUtil.create(IoUtil.java:90) ~[classes/:?]
at
org.apache.hyracks.storage.common.buffercache.BufferCache.createFile(BufferCache.java:825)
~[classes/:?]
at
org.apache.hyracks.storage.am.common.impls.AbstractTreeIndex.create(AbstractTreeIndex.java:83)
~[classes/:?]
at
org.apache.hyracks.storage.am.lsm.common.impls.AbstractLSMDiskComponent.activate(AbstractLSMDiskComponent.java:155)
~[classes/:?]
at
org.apache.hyracks.storage.am.lsm.common.impls.AbstractLSMIndex.createDiskComponent(AbstractLSMIndex.java:461)
~[classes/:?]
at
org.apache.hyracks.storage.am.lsm.btree.impls.LSMBTree.doMerge(LSMBTree.java:355)
~[classes/:?]
at
org.apache.hyracks.storage.am.lsm.common.impls.AbstractLSMIndex.merge(AbstractLSMIndex.java:744)
~[classes/:?]
at
org.apache.hyracks.storage.am.lsm.common.impls.LSMHarness.merge(LSMHarness.java:628)
[classes/:?]
at
org.apache.hyracks.storage.am.lsm.common.impls.LSMTreeIndexAccessor.merge(LSMTreeIndexAccessor.java:127)
[classes/:?]
at
org.apache.hyracks.storage.am.lsm.common.impls.MergeOperation.callInternal(MergeOperation.java:56)
[classes/:?]
at
org.apache.hyracks.storage.am.lsm.common.impls.AbstractIoOperation.call(AbstractIoOperation.java:55)
[classes/:?]
at
org.apache.hyracks.storage.am.lsm.common.impls.AbstractIoOperation.call(AbstractIoOperation.java:31)
[classes/:?]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_121]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[?:1.8.0_121]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[?:1.8.0_121]
at java.lang.Thread.run(Thread.java:745) [?:1.8.0_121]
{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
