Tim Armstrong has uploaded a new change for review. http://gerrit.cloudera.org:8080/3993
Change subject: IMPALA-3201: headers and reservation logic for new buffer pool ...................................................................... IMPALA-3201: headers and reservation logic for new buffer pool This patch implements the core interface and reservation bookkeeping logic for the new buffer pool. It is far from fully functional but is capable of tracking reservations and allocating buffers based on those reservations. The ReservationTrackers integrate with MemTrackers by counting reservations as consumption against a MemTracker. This reflects that fact that the reservations are 'hard': the memory is committed and cannot be used for other purposes. Includes new reservation mechanism where reservations are always guaranteed and buffers can't be pinned without a reservation. Reservations are tracked via a hierarchy of ReservationTrackers. Locks are fine-grained so that the buffer pool can scale to many concurrent queries. Includes basic tests for buffer pool setup, allocation and reservations. Change-Id: I35cc89e863efb4cc506657bfdaaaf633a10bbab6 --- M be/CMakeLists.txt A be/src/bufferpool/CMakeLists.txt A be/src/bufferpool/buffer-allocator.cc A be/src/bufferpool/buffer-allocator.h A be/src/bufferpool/buffer-pool-test.cc A be/src/bufferpool/buffer-pool.cc A be/src/bufferpool/buffer-pool.h A be/src/bufferpool/reservation-tracker.cc A be/src/bufferpool/reservation-tracker.h M be/src/runtime/mem-tracker.h M be/src/util/internal-queue.h M be/src/util/uid-util.h M common/thrift/generate_error_codes.py 13 files changed, 2,183 insertions(+), 41 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/93/3993/1 -- To view, visit http://gerrit.cloudera.org:8080/3993 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I35cc89e863efb4cc506657bfdaaaf633a10bbab6 Gerrit-PatchSet: 1 Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-Owner: Tim Armstrong <[email protected]>
