[jira] [Commented] (ASTERIXDB-2398) HYR0068: No mapping found for file in [rebalance: single_dataset_with_index]
[
https://issues.apache.org/jira/browse/ASTERIXDB-2398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16575340#comment-16575340
]
ASF subversion and git services commented on ASTERIXDB-2398:
Commit 1eb3e7392ce09d1298819bea5bf932cc9226d3ba in asterixdb's branch
refs/heads/master from [~mhubail]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=1eb3e73 ]
[ASTERIXDB-2398][STO] Ensure No Concurrent Access to FileMapManager
- user model changes: no
- storage format changes: no
- interface changes: no
Details:
- Currently it is possible for a thread to access
FileMapManager without holding the proper lock
and therefore seeing a stale state of the map.
This change ensures that all access to the map
is synchronized on the same lock.
Change-Id: Iea7fdb0b891b4ba2aaa528b42eab47b6f841672d
Reviewed-on: https://asterix-gerrit.ics.uci.edu/2863
Sonar-Qube: Jenkins
Tested-by: Jenkins
Contrib: Jenkins
Integration-Tests: Jenkins
Reviewed-by: abdullah alamoudi
> HYR0068: No mapping found for file in [rebalance: single_dataset_with_index]
>
>
> Key: ASTERIXDB-2398
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-2398
> Project: Apache AsterixDB
> Issue Type: Bug
> Components: HYR - Hyracks
>Affects Versions: 0.9.3
>Reporter: Till
>Assignee: Abdullah Alamoudi
>Priority: Major
> Fix For: 0.9.4
>
> Attachments: target.zip
>
>
> {noformat}
> 09:05:09.049 [main] TestExecutor - Starting [TEST]:
> rebalance/single_dataset_with_index ...
> 09:05:09.411 [main] TestExecutor - testFile
> src/test/resources/runtimets/queries_sqlpp/rebalance/single_dataset_with_index/single_dataset_with_index.2.update.sqlpp
> raised an unexpected exception
> java.lang.Exception: HYR0068: No mapping found for file id 50
> at
> org.apache.asterix.test.common.ResultExtractor.checkForErrors(ResultExtractor.java:183)
> ~[test-classes/:?]
> at
> org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:116)
> ~[test-classes/:?]
> at
> org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:86)
> ~[test-classes/:?]
> at
> org.apache.asterix.test.common.TestExecutor.executeUpdateOrDdl(TestExecutor.java:1372)
> ~[test-classes/:?]
> at
> org.apache.asterix.test.common.TestExecutor.executeSqlppUpdateOrDdl(TestExecutor.java:1362)
> ~[test-classes/:?]
> at
> org.apache.asterix.test.common.TestExecutor.executeTestFile(TestExecutor.java:842)
> ~[test-classes/:?]
> at
> org.apache.asterix.test.common.TestExecutor.executeTest(TestExecutor.java:1557)
> [test-classes/:?]
> at
> org.apache.asterix.test.runtime.LangExecutionUtil.test(LangExecutionUtil.java:126)
> [test-classes/:?]
> at
> org.apache.asterix.test.runtime.LangExecutionUtil.test(LangExecutionUtil.java:113)
> [test-classes/:?]
> at
> org.apache.asterix.test.runtime.RebalanceTest.test(RebalanceTest.java:62)
> [test-classes/:?]
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (ASTERIXDB-2398) HYR0068: No mapping found for file in [rebalance: single_dataset_with_index]
[
https://issues.apache.org/jira/browse/ASTERIXDB-2398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503477#comment-16503477
]
Abdullah Alamoudi commented on ASTERIXDB-2398:
--
Ran the rebalance test that failed in a 50 times loop locally. Didn't fail once.
> HYR0068: No mapping found for file in [rebalance: single_dataset_with_index]
>
>
> Key: ASTERIXDB-2398
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-2398
> Project: Apache AsterixDB
> Issue Type: Bug
> Components: HYR - Hyracks
>Affects Versions: 0.9.3
>Reporter: Till
>Assignee: Abdullah Alamoudi
>Priority: Major
> Fix For: 0.9.4
>
>
> {noformat}
> 09:05:09.049 [main] TestExecutor - Starting [TEST]:
> rebalance/single_dataset_with_index ...
> 09:05:09.411 [main] TestExecutor - testFile
> src/test/resources/runtimets/queries_sqlpp/rebalance/single_dataset_with_index/single_dataset_with_index.2.update.sqlpp
> raised an unexpected exception
> java.lang.Exception: HYR0068: No mapping found for file id 50
> at
> org.apache.asterix.test.common.ResultExtractor.checkForErrors(ResultExtractor.java:183)
> ~[test-classes/:?]
> at
> org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:116)
> ~[test-classes/:?]
> at
> org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:86)
> ~[test-classes/:?]
> at
> org.apache.asterix.test.common.TestExecutor.executeUpdateOrDdl(TestExecutor.java:1372)
> ~[test-classes/:?]
> at
> org.apache.asterix.test.common.TestExecutor.executeSqlppUpdateOrDdl(TestExecutor.java:1362)
> ~[test-classes/:?]
> at
> org.apache.asterix.test.common.TestExecutor.executeTestFile(TestExecutor.java:842)
> ~[test-classes/:?]
> at
> org.apache.asterix.test.common.TestExecutor.executeTest(TestExecutor.java:1557)
> [test-classes/:?]
> at
> org.apache.asterix.test.runtime.LangExecutionUtil.test(LangExecutionUtil.java:126)
> [test-classes/:?]
> at
> org.apache.asterix.test.runtime.LangExecutionUtil.test(LangExecutionUtil.java:113)
> [test-classes/:?]
> at
> org.apache.asterix.test.runtime.RebalanceTest.test(RebalanceTest.java:62)
> [test-classes/:?]
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (ASTERIXDB-2398) HYR0068: No mapping found for file in [rebalance: single_dataset_with_index]
[ https://issues.apache.org/jira/browse/ASTERIXDB-2398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503452#comment-16503452 ] Abdullah Alamoudi commented on ASTERIXDB-2398: -- 09:05:09.378 [org.apache.hyracks.api.rewriter.runtime.SuperActivity:TAID:TID:ANID:ODID:6:1:1:0:0] WARN org.apache.hyracks.control.nc.Task - Task TAID:TID:ANID:ODID:6:1:1:0 failed with exception org.apache.hyracks.api.exceptions.HyracksDataException: HYR0068: No mapping found for file id 50 at org.apache.hyracks.api.exceptions.HyracksDataException.create(HyracksDataException.java:60) ~[hyracks-api-0.3.4-SNAPSHOT.jar:0.3.4-SNAPSHOT] at org.apache.hyracks.storage.common.file.FileMapManager.lookupFileName(FileMapManager.java:39) ~[hyracks-storage-common-0.3.4-SNAPSHOT.jar:0.3.4-SNAPSHOT] at org.apache.hyracks.storage.common.buffercache.BufferCache.openFile(BufferCache.java:859) ~[hyracks-storage-common-0.3.4-SNAPSHOT.jar:0.3.4-SNAPSHOT] at org.apache.hyracks.storage.am.common.impls.AbstractTreeIndex.create(AbstractTreeIndex.java:86) ~[hyracks-storage-am-common-0.3.4-SNAPSHOT.jar:0.3.4-SNAPSHOT] at org.apache.hyracks.storage.am.lsm.common.impls.AbstractLSMDiskComponent.activate(AbstractLSMDiskComponent.java:169) ~[hyracks-storage-am-lsm-common-0.3.4-SNAPSHOT.jar:0.3.4-SNAPSHOT] at org.apache.hyracks.storage.am.lsm.common.impls.AbstractLSMIndex.createDiskComponent(AbstractLSMIndex.java:536) ~[hyracks-storage-am-lsm-common-0.3.4-SNAPSHOT.jar:0.3.4-SNAPSHOT] at org.apache.hyracks.storage.am.lsm.common.impls.AbstractLSMIndex.createBulkLoader(AbstractLSMIndex.java:516) ~[hyracks-storage-am-lsm-common-0.3.4-SNAPSHOT.jar:0.3.4-SNAPSHOT] at org.apache.hyracks.storage.am.lsm.common.impls.AbstractLSMIndex.createBulkLoader(AbstractLSMIndex.java:507) ~[hyracks-storage-am-lsm-common-0.3.4-SNAPSHOT.jar:0.3.4-SNAPSHOT] at org.apache.asterix.runtime.operators.LSMIndexBulkLoadOperatorNodePushable.initializeBulkLoader(LSMIndexBulkLoadOperatorNodePushable.java:79) ~[asterix-runtime-0.9.4-SNAPSHOT.jar:0.9.4-SNAPSHOT] at org.apache.hyracks.storage.am.common.dataflow.IndexBulkLoadOperatorNodePushable.open(IndexBulkLoadOperatorNodePushable.java:68) ~[hyracks-storage-am-common-0.3.4-SNAPSHOT.jar:0.3.4-SNAPSHOT] at org.apache.hyracks.api.dataflow.EnforceFrameWriter.open(EnforceFrameWriter.java:59) ~[hyracks-api-0.3.4-SNAPSHOT.jar:0.3.4-SNAPSHOT] at org.apache.hyracks.dataflow.std.sort.AbstractExternalSortRunMerger.process(AbstractExternalSortRunMerger.java:87) ~[hyracks-dataflow-std-0.3.4-SNAPSHOT.jar:0.3.4-SNAPSHOT] at org.apache.hyracks.dataflow.std.sort.AbstractSorterOperatorDescriptor$MergeActivity$1.initialize(AbstractSorterOperatorDescriptor.java:181) ~[hyracks-dataflow-std-0.3.4-SNAPSHOT.jar:0.3.4-SNAPSHOT] at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.lambda$runInParallel$0(SuperActivityOperatorNodePushable.java:208) ~[hyracks-api-0.3.4-SNAPSHOT.jar:0.3.4-SNAPSHOT] at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_102] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_102] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_102] at java.lang.Thread.run(Thread.java:745) [?:1.8.0_102] Suppressed: org.apache.hyracks.api.exceptions.HyracksDataException: java.lang.InterruptedException at org.apache.hyracks.api.exceptions.HyracksDataException.create(HyracksDataException.java:51) ~[hyracks-api-0.3.4-SNAPSHOT.jar:0.3.4-SNAPSHOT] at org.apache.hyracks.storage.common.buffercache.AsyncFIFOPageQueueManager$PageQueue.put(AsyncFIFOPageQueueManager.java:70) ~[hyracks-storage-common-0.3.4-SNAPSHOT.jar:0.3.4-SNAPSHOT] at org.apache.hyracks.storage.am.btree.impls.BTree$BTreeBulkLoader.add(BTree.java:1048) ~[hyracks-storage-am-btree-0.3.4-SNAPSHOT.jar:0.3.4-SNAPSHOT] at org.apache.hyracks.storage.am.lsm.common.impls.LSMIndexBulkLoader.add(LSMIndexBulkLoader.java:54) ~[hyracks-storage-am-lsm-common-0.3.4-SNAPSHOT.jar:0.3.4-SNAPSHOT] at org.apache.hyracks.storage.am.lsm.common.impls.ChainedLSMDiskComponentBulkLoader.add(ChainedLSMDiskComponentBulkLoader.java:63) ~[hyracks-storage-am-lsm-common-0.3.4-SNAPSHOT.jar:0.3.4-SNAPSHOT] at org.apache.hyracks.storage.am.lsm.common.impls.LSMIndexDiskComponentBulkLoader.add(LSMIndexDiskComponentBulkLoader.java:50) ~[hyracks-storage-am-lsm-common-0.3.4-SNAPSHOT.jar:0.3.4-SNAPSHOT] at org.apache.hyracks.storage.am.common.dataflow.IndexBulkLoadOperatorNodePushable.nextFrame(IndexBulkLoadOperatorNodePushable.java:81) ~[hyracks-storage-am-common-0.3.4-SNAPSHOT.jar:0.3.4-SNAPSHOT] at org.apache.hyracks.api.dataflow.EnforceFrameWriter.nextFrame(EnforceFrameWriter.java:76) ~[hyracks-api-0.3.4-SNAPSHOT.jar:0.3.4-SNAPSHOT] at org.apache.hyracks.dataflow.common.comm.io.AbstractFrameAppender.write(AbstractFrameAppender.java:93)
