This is an automated email from the ASF dual-hosted git repository.
suxiaogang223 pushed a change to branch refact_reader_branch
in repository https://gitbox.apache.org/repos/asf/doris.git
from b000e93fb6f Fix 0612 (#64456)
add b4948c36736 [refactor](be) Normalize parquet complex schema projection
(#64451)
No new revisions were added by this update.
Summary of changes:
be/src/exec/scan/file_scanner_v2.cpp | 48 +-
be/src/format_v2/column_data.h | 7 +-
be/src/format_v2/column_mapper.cpp | 103 ++--
be/src/format_v2/column_mapper.h | 4 +-
be/src/format_v2/file_reader.h | 14 +-
be/src/format_v2/parquet/parquet_column_schema.cpp | 328 +++++++---
be/src/format_v2/parquet/parquet_column_schema.h | 12 +-
be/src/format_v2/parquet/parquet_reader.cpp | 1 +
be/src/format_v2/parquet/parquet_statistics.cpp | 39 +-
be/src/format_v2/parquet/reader/column_reader.cpp | 127 ++--
be/src/format_v2/parquet/reader/column_reader.h | 59 +-
.../format_v2/parquet/reader/list_column_reader.h | 1 -
.../format_v2/parquet/reader/map_column_reader.h | 2 -
.../parquet/reader/scalar_column_reader.h | 7 +-
.../parquet/reader/struct_column_reader.cpp | 24 +-
.../parquet/reader/struct_column_reader.h | 5 +-
be/src/format_v2/schema_projection.cpp | 79 ++-
be/src/format_v2/schema_projection.h | 42 +-
be/src/format_v2/table/iceberg_reader.cpp | 9 +-
be/src/format_v2/table_reader.h | 14 +-
be/test/exec/scan/vfile_scanner_exception_test.cpp | 16 +-
be/test/format_v2/column_mapper_test.cpp | 104 ++--
.../parquet/parquet_column_reader_test.cpp | 225 ++++---
be/test/format_v2/parquet/parquet_reader_test.cpp | 49 +-
be/test/format_v2/table_reader_test.cpp | 19 +-
docs/parquet-list-map-compat-design.md | 664 +++++++++++++++++++++
26 files changed, 1416 insertions(+), 586 deletions(-)
create mode 100644 docs/parquet-list-map-compat-design.md
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
