Huaisi Xu has submitted this change and it was merged. Change subject: CDH-41243: Parquet scanner regression on wide tables ......................................................................
CDH-41243: Parquet scanner regression on wide tables IMPALA-2473 introduced a check that prevent row batches growing beyond 8MB, but it has a corner case that when an empty row batch is larger than 8MB, it returns this row batch immediately after it materialize one row, essentailly setting batch_size=1. Revert part of "IMPALA-2473: reduce scanner memory usage": be/src/exec/hdfs-parquet-scanner.cc testdata/workloads/functional-query/queries/QueryTest/nested-types-tpch.test Change-Id: I55a94363840c2b3804ed070c23f57f2117b4fab3 Reviewed-on: http://gerrit.cloudera.org:8080/3429 Reviewed-by: Tim Armstrong <[email protected]> Tested-by: Huaisi Xu <[email protected]> --- M be/src/exec/hdfs-parquet-scanner.cc M testdata/workloads/functional-query/queries/QueryTest/nested-types-tpch.test 2 files changed, 0 insertions(+), 38 deletions(-) Approvals: Huaisi Xu: Verified Tim Armstrong: Looks good to me, approved -- To view, visit http://gerrit.cloudera.org:8080/3429 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: merged Gerrit-Change-Id: I55a94363840c2b3804ed070c23f57f2117b4fab3 Gerrit-PatchSet: 3 Gerrit-Project: Impala Gerrit-Branch: cdh5-2.5.0_5.7.x Gerrit-Owner: Huaisi Xu <[email protected]> Gerrit-Reviewer: Huaisi Xu <[email protected]> Gerrit-Reviewer: Tim Armstrong <[email protected]>
