Jianfeng Jia created ASTERIXDB-1339:
---------------------------------------

             Summary: Have a dynamically allocate memory management for 
in-memory components
                 Key: ASTERIXDB-1339
                 URL: https://issues.apache.org/jira/browse/ASTERIXDB-1339
             Project: Apache AsterixDB
          Issue Type: Improvement
          Components: Storage
            Reporter: Jianfeng Jia


Each dataset has a fixed budget no matter how small/big it is. Then the number 
of datasets can be loaded at the same time is also fixed by $number = 
storage.memorycomponent.globalbudget/storage.memorycomponent.numpages.

Is it possible that all those datasets share a global budget in a multi-tenant 
way? 
>From Yingyi:
In the current implementation, we pre-allocate all in-memory pages
upfront:
https://github.com/apache/incubator-asterixdb-hyracks/blob/master/hyracks/hyracks-storage-am-lsm-common/src/main/java/org/apache/hyracks/storage/am/lsm/common/impls/VirtualBufferCache.java#L247

I think we should fix it to dynamically allocate memory when needed.  (Disk
buffer cache already does that.)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to