Quanlong Huang has uploaded this change for review. ( http://gerrit.cloudera.org:8080/22123
Change subject: WIP: IMPALA-13486: Support MemBool backed by BufferPool in parquet scanner ...................................................................... WIP: IMPALA-13486: Support MemBool backed by BufferPool in parquet scanner Currently only works on MT_DOP>0, i.e. HdfsScanNodeMt. ScratchBatch MemPools and data page pools are now backed by BufferPool to reduce tcmalloc contention in the central free list. TODO: test ORC scanner TODO: Doesn't work on MT_DOP=0 maybe due to HdfsScanNode::ReturnReservationFromScannerThread() returns too many reservation. Reservation used in the output RowBatch needs to be correctly accounted. Change-Id: I7cf0eac43fa98cb4cff66e5061f5bb561487d6ab --- M be/src/exec/exec-node.h M be/src/exec/hdfs-columnar-scanner.cc M be/src/exec/hdfs-columnar-scanner.h M be/src/exec/hdfs-scan-node.cc M be/src/exec/hdfs-scanner.h M be/src/exec/parquet/hdfs-parquet-scanner.cc M be/src/exec/parquet/hdfs-parquet-scanner.h M be/src/exec/parquet/parquet-column-chunk-reader.cc M be/src/exec/scratch-tuple-batch.h M be/src/runtime/bufferpool/buffer-pool.h M be/src/runtime/io/request-ranges.h M be/src/runtime/mem-pool.cc M be/src/runtime/mem-pool.h M be/src/runtime/mem-tracker.cc M be/src/runtime/mem-tracker.h M be/src/runtime/row-batch.cc M be/src/runtime/row-batch.h 17 files changed, 188 insertions(+), 58 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/23/22123/1 -- To view, visit http://gerrit.cloudera.org:8080/22123 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: I7cf0eac43fa98cb4cff66e5061f5bb561487d6ab Gerrit-Change-Number: 22123 Gerrit-PatchSet: 1 Gerrit-Owner: Quanlong Huang <[email protected]>
