This is an automated email from the ASF dual-hosted git repository.
suxiaogang223 pushed a change to branch refact_reader_branch
in repository https://gitbox.apache.org/repos/asf/doris.git
from 983d645102a Support read_dense_for_nullable (#64258)
add 49307d52765 [improvement](be) Add new parquet page-level skip and
profile metrics (#64214)
No new revisions were added by this update.
Summary of changes:
.../parquet/parquet_profile.h} | 23 +--
be/src/format_v2/parquet/parquet_reader.cpp | 54 ++++++
be/src/format_v2/parquet/parquet_reader.h | 12 ++
be/src/format_v2/parquet/parquet_scan.cpp | 99 +++++++---
be/src/format_v2/parquet/parquet_scan.h | 24 ++-
be/src/format_v2/parquet/parquet_statistics.cpp | 187 ++++++++++++++++--
be/src/format_v2/parquet/parquet_statistics.h | 9 +-
.../parquet/reader/arrow_leaf_reader_adapter.cpp | 13 +-
.../parquet/reader/arrow_leaf_reader_adapter.h | 2 +
be/src/format_v2/parquet/reader/column_reader.cpp | 124 ++++++++++--
be/src/format_v2/parquet/reader/column_reader.h | 25 ++-
.../format_v2/parquet/reader/list_column_reader.h | 6 +-
.../format_v2/parquet/reader/map_column_reader.cpp | 15 +-
.../format_v2/parquet/reader/map_column_reader.h | 5 +-
.../parquet/reader/nested_column_reader.cpp | 10 +-
.../parquet/reader/row_position_column_reader.cpp | 5 +-
.../parquet/reader/row_position_column_reader.h | 3 +-
.../parquet/reader/scalar_column_reader.cpp | 67 ++++++-
.../parquet/reader/scalar_column_reader.h | 13 +-
.../parquet/reader/struct_column_reader.h | 5 +-
be/src/format_v2/parquet/selection_vector.h | 23 +++
.../parquet/parquet_column_reader_test.cpp | 2 +-
be/test/format_v2/parquet/parquet_reader_test.cpp | 213 ++++++++++++++++++++-
docs/observability-profile-plan.md | 100 ----------
docs/page-level-skip-plan.md | 111 -----------
25 files changed, 824 insertions(+), 326 deletions(-)
copy be/src/{agent/workload_sched_policy_listener.h =>
format_v2/parquet/parquet_profile.h} (65%)
delete mode 100644 docs/observability-profile-plan.md
delete mode 100644 docs/page-level-skip-plan.md
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
