[
https://issues.apache.org/jira/browse/IMPALA-3200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tim Armstrong resolved IMPALA-3200.
-----------------------------------
Resolution: Fixed
Fix Version/s: Impala 2.10.0
All the subtasks are now finished. We'll track any issues that come up in
further testing separately.
> Replace BufferedBlockMgr with new buffer pool
> ---------------------------------------------
>
> Key: IMPALA-3200
> URL: https://issues.apache.org/jira/browse/IMPALA-3200
> Project: IMPALA
> Issue Type: Improvement
> Components: Backend
> Affects Versions: Impala 2.6.0
> Reporter: Tim Armstrong
> Assignee: Tim Armstrong
> Priority: Blocker
> Labels: resource-management
> Fix For: Impala 2.10.0
>
>
> We want to replace BufferedBlockMgr, a query-wide buffer pool, with a new
> BufferPool that is shared between all queries. The goals are:
> * Support for guaranteed reservations: i.e. if a reservation is granted, the
> buffer pool will fulfil it (unless the OS is unable to fulfill the buffer
> pool's memory requirements).
> * Simplified interaction between reservations and pins (if you have a
> reservation, you can pin, if you don't, you can't)
> * Support for increasing reservations (up to a planner-specified limit).
> * Support for smaller buffer sizes with similar performance (so we can reduce
> minimum memory requirement to execute spill-to-disk algorithm)
> * Support for larger buffers to support wide rows
> * Reduced reliance on TCMalloc, which isn't suited to management of large
> buffers (e.g. see IMPALA-2800)
> * Better transfer model for buffer pool pages, so we can implement
> transfer-of-ownership consistently for row batches (instead of mixing
> transfer with MarkNeedsToReturn()).
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
