Tim Armstrong has uploaded a new patch set (#19). Change subject: IMPALA-3201: headers and reservation logic for new buffer pool ......................................................................
IMPALA-3201: headers and reservation logic for new buffer pool This patch implements the core interface and reservation bookkeeping logic for the new buffer pool. It is far from fully functional but is capable of tracking reservations and allocating buffers based on those reservations. The ReservationTrackers integrate with MemTrackers by counting reservations as consumption against a MemTracker. This reflects that fact that the reservations are 'hard': the memory is committed and cannot be used for other purposes. Includes new reservation mechanism where reservations are always guaranteed and buffers can't be pinned without a reservation. Reservations are tracked via a hierarchy of ReservationTrackers. Locks are fine-grained so that the buffer pool can scale to many concurrent queries. Includes basic tests for buffer pool setup, allocation and reservations. Change-Id: I35cc89e863efb4cc506657bfdaaaf633a10bbab6 --- M be/CMakeLists.txt A be/src/bufferpool/CMakeLists.txt A be/src/bufferpool/buffer-allocator.cc A be/src/bufferpool/buffer-allocator.h A be/src/bufferpool/buffer-pool-test.cc A be/src/bufferpool/buffer-pool.cc A be/src/bufferpool/buffer-pool.h A be/src/bufferpool/reservation-tracker.cc A be/src/bufferpool/reservation-tracker.h M be/src/runtime/mem-tracker.h M be/src/util/internal-queue.h M be/src/util/uid-util.h M common/thrift/generate_error_codes.py 13 files changed, 2,088 insertions(+), 40 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala refs/changes/69/2569/19 -- To view, visit http://gerrit.cloudera.org:8080/2569 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: newpatchset Gerrit-Change-Id: I35cc89e863efb4cc506657bfdaaaf633a10bbab6 Gerrit-PatchSet: 19 Gerrit-Project: Impala Gerrit-Branch: cdh5-trunk Gerrit-Owner: Tim Armstrong <[email protected]> Gerrit-Reviewer: Dan Hecht <[email protected]> Gerrit-Reviewer: Marcel Kornacker <[email protected]> Gerrit-Reviewer: Michael Ho Gerrit-Reviewer: Tim Armstrong <[email protected]>
