This is an automated email from the ASF dual-hosted git repository.
Gabriel39 pushed a change to branch refact_reader_branch
in repository https://gitbox.apache.org/repos/asf/doris.git
from ecb62eb94ae update (#64150)
add 50e9d4e067a [refactor](be) Refine reader column mapping identifiers
(#64159)
No new revisions were added by this update.
Summary of changes:
be/src/exec/scan/file_scanner_v2.cpp | 179 +++-
be/src/exec/scan/file_scanner_v2.h | 13 +-
.../format/new_parquet/parquet_column_schema.cpp | 49 +-
be/src/format/new_parquet/parquet_column_schema.h | 32 +-
be/src/format/new_parquet/parquet_reader.cpp | 72 +-
be/src/format/new_parquet/parquet_reader.h | 13 +-
be/src/format/new_parquet/parquet_scan.cpp | 58 +-
be/src/format/new_parquet/parquet_statistics.cpp | 16 +-
be/src/format/new_parquet/reader/column_reader.cpp | 79 +-
be/src/format/new_parquet/reader/column_reader.h | 20 +-
be/src/format/reader/column_data.h | 365 +++++++
be/src/format/reader/column_mapper.cpp | 1086 ++++++++++++--------
be/src/format/reader/column_mapper.h | 139 ++-
be/src/format/reader/file_reader.h | 69 +-
be/src/format/reader/schema_projection.cpp | 44 +
be/src/format/reader/schema_projection.h | 9 +
be/src/format/reader/table_reader.cpp | 47 +-
be/src/format/reader/table_reader.h | 292 +++---
be/src/format/table/iceberg_reader_v2.cpp | 62 +-
be/test/exec/scan/vfile_scanner_exception_test.cpp | 41 +-
.../new_parquet/parquet_column_reader_test.cpp | 61 +-
be/test/format/new_parquet/parquet_reader_test.cpp | 409 ++++----
be/test/format/reader/expr/cast_test.cpp | 241 +++--
be/test/format/reader/table_reader_test.cpp | 761 ++++++++++----
docs/doris-iceberg-parquet-api-design.md | 8 +-
docs/new-parquet-reader-column-index-refactor.md | 404 ++++++++
26 files changed, 3057 insertions(+), 1512 deletions(-)
create mode 100644 be/src/format/reader/column_data.h
create mode 100644 docs/new-parquet-reader-column-index-refactor.md
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
