Jianfeng Jia created ASTERIXDB-1339:
---------------------------------------
Summary: Have a dynamically allocate memory management for
in-memory components
Key: ASTERIXDB-1339
URL: https://issues.apache.org/jira/browse/ASTERIXDB-1339
Project: Apache AsterixDB
Issue Type: Improvement
Components: Storage
Reporter: Jianfeng Jia
Each dataset has a fixed budget no matter how small/big it is. Then the number
of datasets can be loaded at the same time is also fixed by $number =
storage.memorycomponent.globalbudget/storage.memorycomponent.numpages.
Is it possible that all those datasets share a global budget in a multi-tenant
way?
>From Yingyi:
In the current implementation, we pre-allocate all in-memory pages
upfront:
https://github.com/apache/incubator-asterixdb-hyracks/blob/master/hyracks/hyracks-storage-am-lsm-common/src/main/java/org/apache/hyracks/storage/am/lsm/common/impls/VirtualBufferCache.java#L247
I think we should fix it to dynamically allocate memory when needed. (Disk
buffer cache already does that.)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)