Murtadha Hubail has uploaded a new patch set (#2). Change subject: [ASTERIXDB-2081][STO] Introduce DatasetMemoryManager ......................................................................
[ASTERIXDB-2081][STO] Introduce DatasetMemoryManager - user model changes: no - storage format changes: no - interface changes: yes Added IDatasetMemoryManager to manage datasets memory reservation and allocation. Details: - Reserve metadata datasets memory to allow them to be opened when needed. - Close all datasets at the end of recovery to clear used memory and flush all recovered datasets. - Add UngracefulShutdownNCApplication to force recovery to run on AsterixHyracksIntegrationUtil. - Refactor the use of firstAvilableUserDatasetID to check for metadata datasets. - Add ThreadSafe annotation. - Add test case for RecoveryManager after creating multiple datasets. Change-Id: Ica76b3c8eca6f7d2ad1d962fb5ef84267c258571 --- M asterixdb/asterix-app/src/main/java/org/apache/asterix/api/common/AsterixHyracksIntegrationUtil.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/nc/NCAppRuntimeContext.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/nc/RecoveryManager.java A asterixdb/asterix-app/src/test/java/org/apache/asterix/test/txn/RecoveryManagerTest.java A asterixdb/asterix-common/src/main/java/org/apache/asterix/common/api/IDatasetMemoryManager.java M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/api/INcApplicationContext.java M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/context/DatasetLifecycleManager.java A asterixdb/asterix-common/src/main/java/org/apache/asterix/common/context/DatasetMemoryManager.java M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/context/DatasetResource.java M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/context/DatasetVirtualBufferCaches.java M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/metadata/MetadataIndexImmutableProperties.java A asterixdb/asterix-common/src/test/java/org/apache/asterix/test/context/DatasetMemoryManagerTest.java M asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/bootstrap/MetadataBootstrap.java A hyracks-fullstack/hyracks/hyracks-util/src/main/java/org/apache/hyracks/util/annotations/ThreadSafe.java 14 files changed, 555 insertions(+), 67 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/12/2112/2 -- To view, visit https://asterix-gerrit.ics.uci.edu/2112 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: newpatchset Gerrit-Change-Id: Ica76b3c8eca6f7d2ad1d962fb5ef84267c258571 Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail <[email protected]> Gerrit-Reviewer: Jenkins <[email protected]>
