This is an automated email from the ASF dual-hosted git repository.
kxiao pushed a change to branch branch-2.0
in repository https://gitbox.apache.org/repos/asf/doris.git
from 153e5e594b [fix](ut) Fix histo ut (#23336)
new 2c942bf47b [fix](Outfile) fix bug that the `fileSize` is not correct
when outfile is completed (#22951)
new c8a17ba695 [feature](multi-catalog)support iceberg hadoop catalog
external table query (#22949)
new 5675d45261 [fix](case) nereids_p0/update/update_unique_table.groovy
(#23195)
new 59fe081a82 [fix](nereids)scalar subquery shouldn't be used in mark
join (#22907)
new 5d7ca717be [Chore](ColdHeatSeparation) change partition value for cold
heat separation case (#22996)
new 9c06aeadc5 Update test_csv_with_enclose_and_escape.groovy (#23173)
new cf90cc6642 [improve](jdbc catalog) Add more detailed exception logging
to the jdbc catalog (#22930)
new 8fa74d8320 [fix](case) comment out orthogonal_bitmap_* (#23259)
new 3b92df1d3e [Fix](regression-test) fix es regression test (#23160)
new 0342dc548e [improve](jdbc catalog) Add a variable to accommodate the
final keyword in ClickHouse Jdbc Catalog queries (#23282)
new 473359772c [fix](parquet) parquet reader confuses
logical/physical/slot id of columns (#23198)
new b744bd8eae [fix])(nereids)Support select catalog.db.table.column from
xxx for nereids planner. #23221
new 3dd909f751 [fix](parquet) A row of complex type may be stored across
more pages (#23277)
new 90afc28cfc [FIX](regress-test) fix local_tvf with complex-type in
cluster (#23299)
new 81585c0835 [fix](jdbc catalog) fix adaptation to Oracle special
character `/` table names (#23080)
new 88a11cc569 [improve](alter-job) Add a config for forbiding doing alter
job (#23294)
new f540ce7bb0 [fix](be) fix the crash when there is no tzfile in docker
env (#23071)
new 4bd7ba657d [fix](show) show load warning support load v2 (#22759)
new 800b6307ff fix compile error of pick
The 19 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
be/src/util/timezone_utils.cpp | 5 +
be/src/vec/exec/format/parquet/parquet_common.h | 8 --
.../exec/format/parquet/vparquet_column_reader.cpp | 63 +++++++---
.../exec/format/parquet/vparquet_column_reader.h | 4 +-
.../exec/format/parquet/vparquet_group_reader.cpp | 11 +-
.../exec/format/parquet/vparquet_group_reader.h | 8 +-
be/src/vec/exec/format/parquet/vparquet_reader.cpp | 97 +++++++--------
be/src/vec/exec/format/parquet/vparquet_reader.h | 6 +-
be/src/vec/runtime/vfile_result_writer.cpp | 6 +-
be/test/vec/exec/parquet/parquet_thrift_test.cpp | 4 +-
.../clickhouse/init/03-create-table.sql | 10 +-
.../docker-compose/clickhouse/init/04-insert.sql | 4 +
.../docker-compose/oracle/init/03-create-table.sql | 12 ++
.../docker-compose/oracle/init/04-insert.sql | 3 +
docs/en/docs/advanced/variables.md | 6 +
docs/en/docs/lakehouse/multi-catalog/iceberg.md | 59 ++++++++-
docs/en/docs/lakehouse/multi-catalog/jdbc.md | 2 +
.../Data-Manipulation-Statements/OUTFILE.md | 6 +-
docs/zh-CN/docs/advanced/variables.md | 6 +
docs/zh-CN/docs/lakehouse/multi-catalog/iceberg.md | 61 +++++++++-
docs/zh-CN/docs/lakehouse/multi-catalog/jdbc.md | 2 +
.../Data-Manipulation-Statements/OUTFILE.md | 6 +-
.../main/java/org/apache/doris/common/Config.java | 3 +
.../apache/doris/alter/SchemaChangeHandler.java | 3 +
.../org/apache/doris/catalog/HdfsResource.java | 1 +
.../datasource/iceberg/IcebergExternalCatalog.java | 1 +
.../iceberg/IcebergExternalCatalogFactory.java | 2 +
.../iceberg/IcebergHadoopExternalCatalog.java | 62 ++++++++++
.../doris/datasource/jdbc/JdbcExternalCatalog.java | 1 +
.../doris/datasource/jdbc/client/JdbcClient.java | 60 +++++++---
.../datasource/jdbc/client/JdbcClientConfig.java | 10 ++
.../datasource/jdbc/client/JdbcMySQLClient.java | 4 -
.../datasource/jdbc/client/JdbcOracleClient.java | 128 ++++++++++++++++++++
.../doris/nereids/rules/analysis/SlotBinder.java | 35 +++++-
.../nereids/rules/analysis/SubqueryToApply.java | 132 +++------------------
.../join/LogicalJoinSemiJoinTranspose.java | 6 +-
.../join/LogicalJoinSemiJoinTransposeProject.java | 7 +-
.../join/SemiJoinSemiJoinTranspose.java | 2 +-
.../rewrite/AggScalarSubQueryToWindowFunction.java | 25 ++--
.../nereids/rules/rewrite/ExistsApplyToJoin.java | 19 +--
.../doris/nereids/rules/rewrite/InApplyToJoin.java | 3 -
...CorrelatedFilterUnderApplyAggregateProject.java | 4 +-
.../rules/rewrite/PullUpProjectUnderApply.java | 4 +-
.../rewrite/PushdownFilterThroughProject.java | 36 +++---
.../nereids/rules/rewrite/ScalarApplyToJoin.java | 17 +--
.../rewrite/UnCorrelatedApplyAggregateFilter.java | 4 +-
.../rules/rewrite/UnCorrelatedApplyFilter.java | 4 +-
.../rewrite/UnCorrelatedApplyProjectFilter.java | 4 +-
.../trees/copier/LogicalPlanDeepCopier.java | 4 +-
.../nereids/trees/plans/logical/LogicalApply.java | 48 ++++----
.../plans/logical/LogicalCatalogRelation.java | 7 ++
.../org/apache/doris/persist/gson/GsonUtils.java | 2 +
.../planner/external/iceberg/IcebergScanNode.java | 23 +++-
.../doris/planner/external/jdbc/JdbcScanNode.java | 4 +
.../java/org/apache/doris/qe/SessionVariable.java | 5 +
.../java/org/apache/doris/qe/ShowExecutor.java | 42 ++++++-
.../rules/analysis/AnalyzeWhereSubqueryTest.java | 62 +++++-----
.../AggScalarSubQueryToWindowFunctionTest.java | 3 +
.../external_table_p0/es/test_es_query_nereids.out | 75 ++++--------
.../jdbc/test_clickhouse_jdbc_catalog.out | Bin 2710 -> 2766 bytes
.../jdbc/test_oracle_jdbc_catalog.out | 6 +
.../hive/test_hive_star_qualifier.out | 97 +++++++++++++++
.../hive/test_hive_text_complex_type.out | 3 +
...est_external_catalog_iceberg_hadoop_catalog.out | 17 +++
.../data/external_table_p2/tvf/test_tvf_p2.out | 3 +
.../nereids_syntax_p0/sub_query_correlated.out | 3 -
.../nereids_tpcds_shape_sf100_p0/shape/query1.out | 18 +--
.../nereids_tpcds_shape_sf100_p0/shape/query30.out | 15 +--
.../nereids_tpcds_shape_sf100_p0/shape/query41.out | 2 +-
.../nereids_tpcds_shape_sf100_p0/shape/query6.out | 88 +++++++-------
.../nereids_tpcds_shape_sf100_p0/shape/query81.out | 15 +--
.../nereids_tpch_shape_sf1000_p0/shape/q20.out | 2 +-
.../data/nereids_tpch_shape_sf500_p0/shape/q20.out | 2 +-
.../create_table_use_partition_policy.groovy | 4 +-
.../modify_replica_use_partition.groovy | 6 +-
.../test_outfile_orc_max_file_size.groovy | 115 ++++++++++++++++++
.../es/test_es_query_nereids.groovy | 51 +++++---
.../jdbc/test_clickhouse_jdbc_catalog.groovy | 14 ++-
.../jdbc/test_oracle_jdbc_catalog.groovy | 14 +++
.../tvf/test_local_tvf_with_complex_type.groovy | 22 +++-
...t_local_tvf_with_complex_type_element_at.groovy | 52 +++++---
...l_tvf_with_complex_type_insertinto_doris.groovy | 26 ++--
.../hive/test_hive_star_qualifier.groovy | 62 ++++++++++
.../hive/test_hive_text_complex_type.groovy | 6 +-
...external_catalog_iceberg_hadoop_catalog.groovy} | 35 +++---
.../external_table_p2/tvf/test_tvf_p2.groovy | 7 ++
.../load_p0/broker_load/test_etl_failed.groovy | 78 ++++++++++++
.../test_csv_with_enclose_and_escape.groovy | 3 +-
.../nereids_p0/insert_into_table/aggregate.groovy | 3 +
.../nereids_p0/insert_into_table/duplicate.groovy | 12 ++
.../insert_into_table/no_partition.groovy | 38 ++++++
.../nereids_p0/insert_into_table/random.groovy | 4 +
.../insert_into_table/type_cast_duplicate.groovy | 10 ++
.../nereids_p0/insert_into_table/unique.groovy | 6 +
.../suites/nereids_p0/update/load.groovy | 84 -------------
.../nereids_p0/update/update_unique_table.groovy | 65 ++++++++++
.../nereids_syntax_p0/sub_query_correlated.groovy | 6 +-
.../shape/query6.groovy | 3 +
.../bitmap_functions/test_bitmap_function.groovy | 76 ++++++------
99 files changed, 1607 insertions(+), 707 deletions(-)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/iceberg/IcebergHadoopExternalCatalog.java
create mode 100644
regression-test/data/external_table_p2/hive/test_hive_star_qualifier.out
create mode 100644
regression-test/data/external_table_p2/iceberg/test_external_catalog_iceberg_hadoop_catalog.out
create mode 100644
regression-test/suites/export_p2/test_outfile_orc_max_file_size.groovy
create mode 100644
regression-test/suites/external_table_p2/hive/test_hive_star_qualifier.groovy
copy regression-test/suites/external_table_p2/{hive/test_hive_to_array.groovy
=> iceberg/test_external_catalog_iceberg_hadoop_catalog.groovy} (51%)
create mode 100644
regression-test/suites/load_p0/broker_load/test_etl_failed.groovy
delete mode 100644 regression-test/suites/nereids_p0/update/load.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
