This is an automated email from the ASF dual-hosted git repository.
morrysnow pushed a change to branch 2.1_38012
in repository https://gitbox.apache.org/repos/asf/doris.git
discard 6ea6eb8eed3 [fix](compatibility) type toSql should return lowercase
string (#38012)
omit 53773ae6b77 [opt](join) check datatype of intermediate slots in hash
join (#38556) (#38792)
omit 40767003c62 [Fix](ScanNode) Move the finalize phase of ScanNode to
after the end of the Physical Translate phase (#38604)
omit 8fa0710cb35 [branch-2.1](load) fix miss writer in concurrency
incremental open (#38605) (#38793)
omit f76397277ec [fix](routine load) fix show routine load task result
incorrect (#38523) (#38826)
omit 79b07d0b8a4 [fix](routine load) fix enclose and escape can not set in
routine load job (#38402) (#38825)
omit 6035edad0b1 [fix](multi table) fix single stream multi table memory
leak (#38255) (#38824)
omit 8e4fad99a1b [test](routine load) add routine load case with timestamp
as offset(#38567) (#38822)
omit eef8c87fb5e [chore](test) disable fault injection to make pipeline
task check happy (#38665) (#38821)
omit 7c70f75198f [Fix](Load)Audit logs avoid recording certain sensitive
information #38769 (#38784)
omit 0603ec1d9d7 [enhancement](compaction) optimizing memory usage for
compaction (#37099) (#37486)
omit 7bdc508ac7d [Bug](fix) fix coredump case in (not null, null) execpt
(not null, not null) case (#38756)
omit c0caca7c557 [fix](ES Catalog)Fix unstable test test_es_query (#38801)
(#38802)
omit fe3e3d0fab6 [fix](test)Fix build index fault test (#38736) (#38762)
omit 74908c123a5 [fix](test)Fix unstable test drop index fault #38768
(#38772)
omit 64b69ed1baf [branch-2.1] Picks "[opt](merge-on-write) Skip the
alignment process of some rowsets in partial update #38487" (#38682)
omit 556f0fc784f [pick](json-keys) support json_keys function (#38631)
omit 2425730609d [enhance](auth)support cache ranger datamask and row
filter (#37723) (#38575)
omit f24d55fc947 [fix](syntax) multi statements must delim with semicolon
(#38670) (#38753)
omit da7b2cf5783 [refactor](catalog) set "use_meta_cache" default to true
(#38244)(#38352)(#38619) (#38355)
omit 9b07cd20692 [pick](json-serde)pick jsonb string deserialize with spec
char (#38711)
omit d8004348592 [Chore](Fe)Upgrade dependencies (#38509) (#38747)
omit 7bcda898813 [pick](case) fix one_nested_types cases (#38723)
omit f21d7e3833e [test](inverted index)Add cases for inverted index format
v2 (#38132)(#38443) (#38222)
omit b3f335ba5fb [enhancement](index compaction) Enable index compaction by
default (#36812) (#38676)
omit 4f2ca439176 [minor](fe) simplfy some code in HMSExternalTable (#32344)
(#38675)
omit 1d982ada456 [pick](array-funcs)pick array func array_enumerate_uniq
bugfix (#38721)
omit f5bc65989c0 [pick](array-range)improve array_range func for large
param (#38707)
omit b7e1588be9a [pick](upgrade)fix log message (#38710)
omit 84d9b2fcf41 [pick](nestedtypes) support nested type with agg
replace_if_not_null (#38719)
omit 327069fdbcc [branch-2.1](log) add tablet clear cache log (#38713)
omit e140613ae1f [fix](Nereids) remove db readlock before get table from db
(#38660) (#38729)
omit 0da388ade5b [fix](inverted index) fix match_phrase_ edge query result
error #38327 (#38740)
omit 4d980b82351 [feature](http action)Add http action to show nested
inverted index file (#38272) (#38672)
omit 555dccb1a4c [fix](bloom filter)Fix rename column with bloom filter
(#38431) (#38662)
omit 2562cf33a76 [fix](mtmv) Choose a valid partition column when there are
both valid and invalid expressions (#38367) (#38684)
omit e59a866d6a3 [fix](test)Fix unstable index compaction fault injection
case (#38501) (#38673)
omit 60091f072a8 [fix](auth)fix create table like need create_priv of
existed table (#… (#38570)
omit a4e793752fc [bugfix](iceberg)revert count(*) directly returned by fe
for 2.1 (#38566) (#38655)
omit 3e5255a8623 [pipeline](fix) Fix blocking task which is not triggered
by 2nd RPC (… (#38694)
omit 82c681595e2 [fix](local exchange) Fix local exchange blocked by a huge
data block… (#38693)
omit e8690b62ee8 [fix](group commit) Pick add debug log show why group
commit not work; delete wal when replay success (#38611) (#38659)
omit cafcf7acc1f [cherry-pick](SSL) Fix ssl connection close 2.1 (#38587)
(#38677)
omit 9d23ccf1f2a [Improvement](schema scan) Use async scanner for schema
scanners (#38… (#38666)
omit b0943064e04 [fix](kerberos)fix and refactor ugi login for kerberos and
simple authentication (#38607)
omit 4042cdf5532 [Fix](memory) Fix allocator.h compiling failed on mac.
(#38646)
omit 63a3ff570b5 [Opt](load) print tablet id when memtable flush coredump
#38618 (#38656)
omit 28998300d43 [Bug](fix) fix ubsan use int32_t pointer access bool value
(#38621)
omit c310b92727d [bugfix](external)Modify the default value of
`pushdowncount` for 2.1 (#37754) (#38591)
omit 057ee1905f8 [bugfix](hudi)add timetravel for nereids for 2.1 (#38324)
(#38582)
omit 338fa32303b [pick](simdjson) fix simdjson with object array when
jsonroot is not empty (#38633)
omit 41fa7bc9fdc [bugfix](paimon)Fixed the reading of timestamp with time
zone type data for 2.1 (#37716) (#38592)
omit 9f1e41c6232 [Cherry-pick](branch-2.1) Pick "[Enhancement](audit log)
Add print audit log sesssion variable #38419" (#38624)
omit 184b8cbbe4f [pick](json)fix jsonb deseriaze (#38630)
omit 6bd93b119fa [pick](cast)Feature cast complexttype2 json (#38632)
omit fa45f3b95a0 [feature](paimon/iceberg)add a docker that can directly
pull up all the relevant environments of paimon/iceberg/doris for 2.1 (#38009)
(#38588)
omit 4c330e3fc63 [Fix](test) fix pull up literal predicate regression
(#38564)
omit 098ac67a75b [fix](catalog)fix db name may be null in NotificationEvent
(#38421) (#38596)
omit c8037ca833b [fix](regression-test) fix `test_numbers` test (#38600)
omit b21b906306d [Fix](outfile) FE check the hdfs URI of outfile (#38602)
omit ef8a1918c3c [case][fix](iceberg)move rest cases from p2 to p0 and fix
iceberg version issue for 2.1 (#37898) (#38589)
omit 1c176db0106 [bugfix](paimon)add support for 'in' and 'not in' for 2.1
#38390 (#38576)
omit 46dfb65b6b7 [fix](auth)fix show routine load db is null (#38574)
omit 96413e679d5 [branch-2.1](mtmv) Support read sync materialized view in
async materialized view (#38462)
omit ee47ef88260 [Fix](regression) fix regression sql which has schema
change (#37941) (#38456)
add f65e8378150 [fix](compatibility) type toSql should return lowercase
string (#38012)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (6ea6eb8eed3)
\
N -- N -- N refs/heads/2.1_38012 (f65e8378150)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
be/src/agent/task_worker_pool.cpp | 4 +-
be/src/common/config.cpp | 8 +-
be/src/common/config.h | 6 -
be/src/exec/schema_scanner.cpp | 69 +---
be/src/exec/schema_scanner.h | 24 +-
.../schema_active_queries_scanner.cpp | 2 +-
.../schema_scanner/schema_active_queries_scanner.h | 2 +-
.../schema_scanner/schema_backend_active_tasks.cpp | 3 +-
.../schema_scanner/schema_backend_active_tasks.h | 2 +-
.../schema_scanner/schema_charsets_scanner.cpp | 2 +-
.../exec/schema_scanner/schema_charsets_scanner.h | 2 +-
.../schema_scanner/schema_collations_scanner.cpp | 2 +-
.../schema_scanner/schema_collations_scanner.h | 2 +-
.../exec/schema_scanner/schema_columns_scanner.cpp | 2 +-
.../exec/schema_scanner/schema_columns_scanner.h | 2 +-
.../exec/schema_scanner/schema_dummy_scanner.cpp | 2 +-
be/src/exec/schema_scanner/schema_dummy_scanner.h | 2 +-
.../exec/schema_scanner/schema_files_scanner.cpp | 2 +-
be/src/exec/schema_scanner/schema_files_scanner.h | 2 +-
.../schema_metadata_name_ids_scanner.cpp | 2 +-
.../schema_metadata_name_ids_scanner.h | 2 +-
.../schema_scanner/schema_partitions_scanner.cpp | 2 +-
.../schema_scanner/schema_partitions_scanner.h | 2 +-
.../schema_scanner/schema_processlist_scanner.cpp | 2 +-
.../schema_scanner/schema_processlist_scanner.h | 2 +-
.../schema_scanner/schema_profiling_scanner.cpp | 2 +-
.../exec/schema_scanner/schema_profiling_scanner.h | 2 +-
.../exec/schema_scanner/schema_routine_scanner.cpp | 2 +-
.../exec/schema_scanner/schema_routine_scanner.h | 2 +-
.../exec/schema_scanner/schema_rowsets_scanner.cpp | 2 +-
.../exec/schema_scanner/schema_rowsets_scanner.h | 2 +-
.../schema_schema_privileges_scanner.cpp | 2 +-
.../schema_schema_privileges_scanner.h | 2 +-
.../schema_scanner/schema_schemata_scanner.cpp | 2 +-
.../exec/schema_scanner/schema_schemata_scanner.h | 2 +-
.../schema_table_privileges_scanner.cpp | 2 +-
.../schema_table_privileges_scanner.h | 2 +-
.../exec/schema_scanner/schema_tables_scanner.cpp | 2 +-
be/src/exec/schema_scanner/schema_tables_scanner.h | 2 +-
.../schema_user_privileges_scanner.cpp | 2 +-
.../schema_user_privileges_scanner.h | 2 +-
be/src/exec/schema_scanner/schema_user_scanner.cpp | 2 +-
be/src/exec/schema_scanner/schema_user_scanner.h | 2 +-
.../schema_scanner/schema_variables_scanner.cpp | 2 +-
.../exec/schema_scanner/schema_variables_scanner.h | 2 +-
.../exec/schema_scanner/schema_views_scanner.cpp | 2 +-
be/src/exec/schema_scanner/schema_views_scanner.h | 2 +-
.../schema_workload_groups_scanner.cpp | 2 +-
.../schema_workload_groups_scanner.h | 2 +-
.../schema_workload_sched_policy_scanner.cpp | 3 +-
.../schema_workload_sched_policy_scanner.h | 2 +-
be/src/exprs/runtime_filter.cpp | 4 +-
.../http/action/show_nested_index_file_action.cpp | 80 ----
be/src/http/action/show_nested_index_file_action.h | 46 ---
be/src/io/fs/multi_table_pipe.cpp | 13 -
be/src/olap/base_compaction.cpp | 10 -
be/src/olap/base_tablet.h | 5 -
be/src/olap/compaction.cpp | 14 +-
be/src/olap/compaction.h | 1 -
be/src/olap/cumulative_compaction.cpp | 15 +-
be/src/olap/iterators.h | 15 +-
be/src/olap/memtable_flush_executor.cpp | 1 -
be/src/olap/merger.cpp | 67 +---
be/src/olap/merger.h | 6 +-
be/src/olap/partial_update_info.h | 5 +-
be/src/olap/rowset/beta_rowset.cpp | 128 -------
be/src/olap/rowset/beta_rowset.h | 3 -
be/src/olap/rowset/rowset.h | 1 -
be/src/olap/rowset/rowset_meta.h | 21 --
be/src/olap/rowset/segcompaction.cpp | 2 +-
.../inverted_index/query/phrase_edge_query.cpp | 26 +-
.../inverted_index/query/phrase_edge_query.h | 1 -
be/src/olap/rowset_builder.cpp | 11 +-
be/src/olap/rowset_builder.h | 1 -
be/src/olap/tablet.cpp | 72 +---
be/src/olap/tablet.h | 1 -
be/src/olap/tablet_reader.h | 2 -
be/src/olap/tablet_schema.cpp | 23 +-
be/src/olap/task/engine_publish_version_task.cpp | 14 -
be/src/olap/wal/wal_table.cpp | 15 +-
be/src/pipeline/exec/hashjoin_probe_operator.cpp | 51 ---
be/src/pipeline/exec/schema_scan_operator.cpp | 9 +-
be/src/pipeline/exec/schema_scan_operator.h | 14 +-
be/src/pipeline/exec/set_sink_operator.cpp | 8 +-
be/src/pipeline/pipeline_x/dependency.h | 20 +-
.../local_exchange/local_exchange_sink_operator.h | 2 -
.../local_exchange_source_operator.cpp | 6 +-
.../local_exchange_source_operator.h | 2 -
.../pipeline_x/local_exchange/local_exchanger.cpp | 111 +++---
.../pipeline_x/local_exchange/local_exchanger.h | 14 -
be/src/pipeline/pipeline_x/pipeline_x_task.cpp | 2 +
be/src/pipeline/pipeline_x/pipeline_x_task.h | 1 -
be/src/runtime/group_commit_mgr.cpp | 2 -
be/src/runtime/tablets_channel.cpp | 8 -
be/src/runtime/tablets_channel.h | 9 +-
be/src/service/http_service.cpp | 6 -
be/src/vec/common/allocator.h | 17 +-
.../vec/data_types/serde/data_type_string_serde.h | 46 +--
be/src/vec/exec/format/json/new_json_reader.cpp | 3 +-
be/src/vec/exec/format/json/new_json_reader.h | 1 -
be/src/vec/exec/scan/vfile_scanner.cpp | 15 +-
be/src/vec/exec/vschema_scan_node.cpp | 2 +-
be/src/vec/exec/vset_operation_node.cpp | 6 +-
.../functions/array/function_array_enumerate.cpp | 1 +
.../array/function_array_enumerate_uniq.cpp | 9 +-
.../vec/functions/array/function_array_range.cpp | 31 +-
be/src/vec/functions/function_cast.h | 2 -
be/src/vec/functions/function_jsonb.cpp | 174 ---------
be/src/vec/olap/vertical_block_reader.cpp | 23 +-
be/src/vec/olap/vertical_block_reader.h | 3 +-
be/src/vec/olap/vertical_merge_iterator.cpp | 29 +-
be/src/vec/olap/vertical_merge_iterator.h | 25 +-
be/test/olap/base_compaction_test.cpp | 84 -----
be/test/olap/rowid_conversion_test.cpp | 6 +-
be/test/vec/olap/vertical_compaction_test.cpp | 18 +-
.../elasticsearch/scripts/es_init.sh | 1 -
.../docker-compose/iceberg/iceberg.yaml.tpl | 1 -
.../docker-compose/iceberg/spark-init-iceberg.sql | 25 +-
.../docker-compose/iceberg/tools/save_docker.sh | 4 -
.../kerberos/common/conf/doris-krb5.conf | 2 +-
fe/be-java-extensions/hudi-scanner/pom.xml | 1 +
.../org/apache/doris/paimon/PaimonColumnValue.java | 30 +-
.../org/apache/doris/paimon/PaimonJniScanner.java | 14 +-
fe/be-java-extensions/preload-extensions/pom.xml | 1 +
.../main/java/org/apache/doris/catalog/Type.java | 3 -
.../main/java/org/apache/doris/common/Config.java | 6 -
.../authentication/AuthenticationConfig.java | 2 -
.../authentication/HadoopAuthenticator.java | 44 ---
.../HadoopKerberosAuthenticator.java | 192 ----------
.../authentication/HadoopSimpleAuthenticator.java | 47 ---
.../common/security/authentication/HadoopUGI.java | 89 ++++-
.../ImpersonatingHadoopAuthenticator.java | 43 ---
.../KerberosAuthenticationConfig.java | 3 -
.../antlr4/org/apache/doris/nereids/DorisParser.g4 | 2 +-
.../doris/analysis/AlterRoutineLoadStmt.java | 8 -
.../java/org/apache/doris/analysis/CastExpr.java | 4 -
.../doris/analysis/CreateRoutineLoadStmt.java | 32 +-
.../org/apache/doris/analysis/CreateTableStmt.java | 3 +-
.../apache/doris/analysis/ExpressionFunctions.java | 2 +-
.../java/org/apache/doris/analysis/LoadStmt.java | 2 +-
.../analysis/ModifyTablePropertiesClause.java | 4 -
.../apache/doris/analysis/NativeInsertStmt.java | 63 +---
.../org/apache/doris/analysis/OutFileClause.java | 8 -
.../apache/doris/analysis/ShowRoutineLoadStmt.java | 4 +-
.../doris/analysis/ShowRoutineLoadTaskStmt.java | 2 +-
.../doris/catalog/BuiltinScalarFunctions.java | 2 -
.../java/org/apache/doris/catalog/ColumnType.java | 2 +-
.../main/java/org/apache/doris/catalog/Env.java | 15 -
.../org/apache/doris/catalog/PartitionKey.java | 4 +-
.../ranger/cache/CatalogCacheAccessController.java | 84 -----
.../authorizer/ranger/cache/DatamaskCacheKey.java | 89 -----
.../authorizer/ranger/cache/RangerCache.java | 107 ------
.../cache/RangerCacheInvalidateListener.java | 41 --
.../authorizer/ranger/cache/RowFilterCacheKey.java | 82 ----
.../doris/RangerCacheDorisAccessController.java | 44 ---
.../ranger/doris/RangerDorisAccessController.java | 7 +-
.../authorizer/ranger/doris/RangerDorisPlugin.java | 6 -
.../hive/RangerCacheHiveAccessController.java | 47 ---
.../ranger/hive/RangerHiveAccessController.java | 8 +-
.../hive/RangerHiveAccessControllerFactory.java | 2 +-
.../authorizer/ranger/hive/RangerHivePlugin.java | 6 -
.../java/org/apache/doris/common/util/Util.java | 8 +-
.../org/apache/doris/datasource/CatalogMgr.java | 6 +-
.../apache/doris/datasource/ExternalCatalog.java | 19 +-
.../apache/doris/datasource/ExternalDatabase.java | 11 +-
.../apache/doris/datasource/FileQueryScanNode.java | 26 +-
.../org/apache/doris/datasource/FileScanNode.java | 6 +-
.../apache/doris/datasource/InternalCatalog.java | 24 +-
.../doris/datasource/hive/HMSCachedClient.java | 5 -
.../doris/datasource/hive/HMSExternalCatalog.java | 12 +-
.../doris/datasource/hive/HMSExternalTable.java | 11 +-
.../doris/datasource/hive/HiveMetadataOps.java | 7 +-
.../datasource/hive/ThriftHMSCachedClient.java | 12 +-
.../datasource/hive/event/AlterDatabaseEvent.java | 2 +-
.../datasource/hive/event/CreateDatabaseEvent.java | 2 +-
.../datasource/hive/event/MetastoreEvent.java | 5 +-
.../hudi/source/HudiLocalEngineContext.java | 188 ----------
.../hudi/source/HudiPartitionProcessor.java | 3 +-
.../doris/datasource/hudi/source/HudiScanNode.java | 9 +-
.../datasource/iceberg/source/IcebergScanNode.java | 31 +-
.../doris/datasource/jdbc/source/JdbcScanNode.java | 9 +
.../doris/datasource/metacache/MetaCache.java | 7 +-
.../doris/datasource/odbc/source/OdbcScanNode.java | 9 +
.../datasource/paimon/PaimonExternalTable.java | 25 +-
.../paimon/source/PaimonPredicateConverter.java | 39 --
.../datasource/paimon/source/PaimonScanNode.java | 42 ++-
.../apache/doris/fs/remote/RemoteFileSystem.java | 14 +-
.../apache/doris/fs/remote/dfs/DFSFileSystem.java | 48 +--
.../main/java/org/apache/doris/load/ExportMgr.java | 4 +-
.../doris/load/routineload/RoutineLoadJob.java | 10 +-
.../java/org/apache/doris/mysql/MysqlChannel.java | 2 +-
.../mysql/privilege/AccessControllerManager.java | 4 +-
.../org/apache/doris/nereids/CascadesContext.java | 15 +-
.../org/apache/doris/nereids/NereidsPlanner.java | 24 +-
.../glue/translator/PhysicalPlanTranslator.java | 51 ++-
.../exploration/mv/MaterializedViewUtils.java | 23 +-
.../nereids/rules/expression/check/CheckCast.java | 22 --
.../doris/nereids/trees/expressions/Cast.java | 2 +-
.../expressions/functions/scalar/JsonKeys.java | 84 -----
.../expressions/visitor/ScalarFunctionVisitor.java | 5 -
.../plans/commands/info/ColumnDefinition.java | 6 +-
.../org/apache/doris/planner/OlapScanNode.java | 6 +-
.../org/apache/doris/planner/OriginalPlanner.java | 16 +
.../java/org/apache/doris/planner/ScanNode.java | 13 +-
.../org/apache/doris/qe/MysqlConnectProcessor.java | 33 +-
.../java/org/apache/doris/qe/SessionVariable.java | 10 -
.../org/apache/doris/statistics/Histogram.java | 2 +-
.../doris/analysis/CancelExportStmtTest.java | 26 ++
.../org/apache/doris/catalog/RefreshDbTest.java | 3 -
.../doris/datasource/RefreshCatalogTest.java | 5 +-
.../doris/nereids/parser/NereidsParserTest.java | 9 +-
.../exploration/mv/MaterializedViewUtilsTest.java | 49 ---
fe/pom.xml | 57 ++-
gensrc/script/doris_builtins_functions.py | 5 -
.../one_level_nestedtypes_with_s3data.out | 414 ++++++++++-----------
.../create_nestedtypes_with_replaceIfNOtNull.out | 46 ---
.../export_p0/outfile/hdfs/test_outfile_hdfs.out | 137 -------
...xport_with_s3.out => test_export_with_hdfs.out} | 0
.../iceberg/test_gen_iceberg_by_api.out | 10 -
.../iceberg/test_iceberg_equality_delete.out | 41 --
.../iceberg/test_iceberg_time_travel.out | 46 ---
.../test_iceberg_upper_case_column_name.out | 45 ---
.../paimon/paimon_timestamp_types.out | 139 -------
.../hive/test_upper_case_column_name.out | 44 +++
.../hudi/test_hudi_timetravel.out | 125 -------
.../iceberg/iceberg_equality_delete.out | 109 ++++++
.../iceberg/iceberg_position_delete.out} | 0
...est_external_catalog_iceberg_hadoop_catalog.out | 26 ++
.../test_external_catalog_icebergv2_nereids.out | 74 ++++
.../{partial_update => }/concurrency_update1.csv | 0
.../{partial_update => }/concurrency_update2.csv | 0
.../{partial_update => }/concurrency_update3.csv | 0
...rtial_update_compaction_with_higher_version.out | 11 -
...est_partial_update_conflict_skip_compaction.out | 11 -
.../test_partial_update_skip_compaction.out | 11 -
...t_partial_update_column_num_fault_injection.out | 0
..._partial_update_publish_conflict_with_error.out | 0
.../test_add_build_index_with_format_v2.out | 6 -
.../test_create_table_with_format_v2.out | 6 -
.../test_cumulative_compaction_with_format_v2.out | 9 -
.../test_drop_column_index_with_format_v2.out | 6 -
.../test_drop_column_with_format_v2.out | 6 -
.../test_drop_index_with_format_v2.out | 6 -
.../test_mor_table_with_format_v2.out | 7 -
.../test_mow_table_with_format_v2.out | 7 -
.../test_rename_column_with_format_v2.out | 11 -
...st_single_replica_compaction_with_format_v2.out | 9 -
.../test_index_match_phrase_edge.out | 12 -
..._nested_index_file_http_action_with_variant.out | 13 -
regression-test/data/jsonb_p0/test_jsonb_cast.csv | 4 -
regression-test/data/jsonb_p0/test_jsonb_cast.out | 27 --
.../data/jsonb_p0/test_jsonb_load_and_function.out | 114 ------
.../data/jsonb_p0/test_jsonb_unescaped.csv | 5 -
.../data/jsonb_p0/test_jsonb_unescaped.json | 5 -
.../jsonb_p0/test_jsonb_with_unescaped_string.out | 15 -
.../routine_load/test_routine_load_offset.out | 4 -
.../routine_load/test_routine_load_property.out | 10 -
.../load_p0/stream_load/load_object_array_json.out | 4 -
.../load_p0/stream_load/test_json_object_array.csv | 1 -
.../data/nereids_function_p0/scalar_function/J.out | 105 ------
.../infer_predicate/pull_up_predicate_literal.out | 14 +-
.../query_p0/cast/test_complextype_to_json.out | 67 ----
.../data/query_p0/except/test_query_except.out | 2 -
.../query_p0/join/test_runtime_filter_boolean.out | 9 -
.../data/rollup_p0/test_create_mv_and_mtmv.out | 14 -
.../doris/regression/action/WaitForAction.groovy | 12 +-
.../pipeline/p0/conf/regression-conf.groovy | 1 -
.../plugins/plugin_curl_requester.groovy | 130 +------
...est_bloom_filter_hit_with_renamed_column.groovy | 142 -------
.../compaction_width_array_column.groovy | 137 -------
.../one_level_nestedtypes_with_s3data.groovy | 4 +-
...create_nestedtypes_with_replaceIfNOtNull.groovy | 325 ----------------
.../test_array_zip_array_enumerate_uniq.groovy | 25 --
.../ddl_p0/test_create_table_like_nereids.groovy | 13 +-
.../outfile/hdfs/test_outfile_hdfs.groovy | 97 -----
.../suites/export_p2/test_export_with_hdfs.groovy | 118 ++++++
.../hive/test_upper_case_column_name.groovy | 32 ++
.../iceberg/test_gen_iceberg_by_api.groovy | 192 ----------
.../iceberg/test_iceberg_equality_delete.groovy | 152 --------
.../iceberg/test_iceberg_table_stats.groovy | 4 -
.../iceberg/test_iceberg_time_travel.groovy | 55 ---
.../test_iceberg_upper_case_column_name.groovy | 78 ----
.../kerberos/test_two_hive_kerberos.groovy | 33 --
.../paimon/paimon_timestamp_types.groovy | 224 +----------
.../paimon/test_paimon_predict.groovy | 127 -------
.../external_table_p0/tvf/test_numbers.groovy | 2 +-
.../hive/test_upper_case_column_name.groovy | 32 ++
.../hudi/test_hudi_timetravel.groovy | 107 ------
.../iceberg/iceberg_equality_delete.groovy | 57 +++
.../iceberg/iceberg_position_delete.groovy} | 42 +--
..._external_catalog_iceberg_hadoop_catalog.groovy | 49 +++
.../test_external_catalog_icebergv2_nereids.groovy | 84 +++++
...al_update_compaction_with_higher_version.groovy | 222 -----------
..._partial_update_conflict_skip_compaction.groovy | 212 -----------
.../test_partial_update_skip_compaction.groovy | 193 ----------
.../test_build_index_fault.groovy | 14 +-
...oup_commit_async_wal_msg_fault_injection.groovy | 41 +-
...index_builder_drop_index_fault_injection.groovy | 22 --
.../test_index_compaction_fault_injection.groovy | 7 +-
...artial_update_column_num_fault_injection.groovy | 0
...rtial_update_publish_conflict_with_error.groovy | 0
regression-test/suites/insert_p0/insert.groovy | 2 +-
.../insert_p0/insert_group_commit_into.groovy | 8 -
.../test_index_compaction_dup_keys.groovy | 2 +-
.../test_index_compaction_null.groovy | 6 +-
.../test_index_compaction_unique_keys.groovy | 3 +-
...dex_compaction_with_multi_index_segments.groovy | 6 +-
.../test_add_build_index_with_format_v2.groovy | 143 -------
.../test_create_table_with_format_v2.groovy | 61 ---
...est_cumulative_compaction_with_format_v2.groovy | 254 -------------
.../test_drop_column_with_format_v2.groovy | 125 -------
.../test_drop_index_with_format_v2.groovy | 96 -----
.../test_index_change_format.groovy | 51 ---
.../test_mor_table_with_format_v2.groovy | 259 -------------
.../test_mow_table_with_format_v2.groovy | 252 -------------
.../test_recover_with_format_v2.groovy | 84 -----
.../test_rename_column_with_format_v2.groovy | 94 -----
...single_replica_compaction_with_format_v2.groovy | 254 -------------
.../test_index_match_phrase_edge.groovy | 11 -
.../test_show_nested_index_file_http_action.groovy | 98 -----
...sted_index_file_http_action_with_variant.groovy | 130 -------
.../suites/jsonb_p0/test_jsonb_cast.groovy | 79 ----
.../jsonb_p0/test_jsonb_load_and_function.groovy | 41 --
.../test_jsonb_with_unescaped_string.groovy | 99 -----
.../routine_load/data/test_enclose_and_escape0.csv | 1 -
.../routine_load/data/test_enclose_and_escape1.csv | 1 -
.../load_p0/routine_load/data/test_offset_time.csv | 1 -
.../routine_load/data/test_show_routine_load.csv | 1 -
.../routine_load/test_routine_load_offset.groovy | 113 ------
.../routine_load/test_routine_load_property.groovy | 187 ----------
.../routine_load/test_show_routine_load.groovy | 150 --------
.../stream_load/load_object_array_json.groovy | 100 -----
.../scalar_function/Array.groovy | 30 --
.../nereids_function_p0/scalar_function/J.groovy | 42 ---
.../query_p0/cast/test_complextype_to_json.groovy | 119 ------
.../query_p0/except/test_query_except.groovy | 3 -
.../join/test_runtime_filter_boolean.groovy | 64 ----
.../array_functions/test_array_functions.groovy | 22 --
.../rollup_p0/test_create_mv_and_mtmv.groovy | 109 ------
samples/datalake/iceberg_and_paimon/README.md | 279 --------------
.../data/flink-conf/flink-conf.yaml | 312 ----------------
.../data/flink-conf/log4j-cli.properties | 67 ----
.../data/flink-conf/log4j-console.properties | 70 ----
.../data/flink-conf/log4j-session.properties | 42 ---
.../data/flink-conf/log4j.properties | 61 ---
.../data/flink-conf/logback-console.xml | 67 ----
.../data/flink-conf/logback-session.xml | 39 --
.../iceberg_and_paimon/data/flink-conf/logback.xml | 58 ---
.../iceberg_and_paimon/data/flink-conf/masters | 18 -
.../iceberg_and_paimon/data/flink-conf/workers | 18 -
.../iceberg_and_paimon/data/flink-conf/zoo.cfg | 36 --
.../data/spark-conf/fairscheduler.xml.template | 31 --
.../data/spark-conf/log4j2.properties.template | 69 ----
.../data/spark-conf/metrics.properties.template | 210 -----------
.../data/spark-conf/spark-defaults.conf | 43 ---
.../data/spark-conf/spark-defaults.conf.template | 27 --
.../data/spark-conf/spark-env.sh.template | 81 ----
.../data/spark-conf/workers.template | 19 -
.../data/table/customer/000000_0 | Bin 740686 -> 0 bytes
.../data/table/customer/000001_0 | Bin 739823 -> 0 bytes
.../data/table/customer/000002_0 | Bin 740700 -> 0 bytes
.../data/table/customer/000003_0 | Bin 739592 -> 0 bytes
.../datalake/iceberg_and_paimon/docker-compose.env | 22 --
.../datalake/iceberg_and_paimon/docker-compose.yml | 173 ---------
.../iceberg_and_paimon/scripts/start_doris.sh | 60 ---
.../datalake/iceberg_and_paimon/sql/init_doris.sql | 21 --
.../iceberg_and_paimon/sql/init_tables.sql | 53 ---
.../iceberg_and_paimon/sql/prepare_data.sql | 8 -
samples/datalake/iceberg_and_paimon/start_all.sh | 121 ------
.../iceberg_and_paimon/start_doris_client.sh | 20 -
.../iceberg_and_paimon/start_flink_client.sh | 19 -
.../start_spark_iceberg_client.sh | 19 -
.../start_spark_paimon_client.sh | 19 -
samples/datalake/iceberg_and_paimon/stop_all.sh | 19 -
374 files changed, 1601 insertions(+), 12195 deletions(-)
delete mode 100644 be/src/http/action/show_nested_index_file_action.cpp
delete mode 100644 be/src/http/action/show_nested_index_file_action.h
delete mode 100644 be/test/olap/base_compaction_test.cpp
delete mode 100644
fe/fe-common/src/main/java/org/apache/doris/common/security/authentication/HadoopAuthenticator.java
delete mode 100644
fe/fe-common/src/main/java/org/apache/doris/common/security/authentication/HadoopKerberosAuthenticator.java
delete mode 100644
fe/fe-common/src/main/java/org/apache/doris/common/security/authentication/HadoopSimpleAuthenticator.java
delete mode 100644
fe/fe-common/src/main/java/org/apache/doris/common/security/authentication/ImpersonatingHadoopAuthenticator.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/catalog/authorizer/ranger/cache/CatalogCacheAccessController.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/catalog/authorizer/ranger/cache/DatamaskCacheKey.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/catalog/authorizer/ranger/cache/RangerCache.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/catalog/authorizer/ranger/cache/RangerCacheInvalidateListener.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/catalog/authorizer/ranger/cache/RowFilterCacheKey.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/catalog/authorizer/ranger/doris/RangerCacheDorisAccessController.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/catalog/authorizer/ranger/hive/RangerCacheHiveAccessController.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/hudi/source/HudiLocalEngineContext.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/JsonKeys.java
delete mode 100644
regression-test/data/datatype_p0/nested_types/ddl/create_nestedtypes_with_replaceIfNOtNull.out
delete mode 100644
regression-test/data/export_p0/outfile/hdfs/test_outfile_hdfs.out
copy regression-test/data/export_p2/{test_export_with_s3.out =>
test_export_with_hdfs.out} (100%)
delete mode 100644
regression-test/data/external_table_p0/iceberg/test_gen_iceberg_by_api.out
delete mode 100644
regression-test/data/external_table_p0/iceberg/test_iceberg_equality_delete.out
delete mode 100644
regression-test/data/external_table_p0/iceberg/test_iceberg_time_travel.out
delete mode 100644
regression-test/data/external_table_p0/iceberg/test_iceberg_upper_case_column_name.out
delete mode 100644
regression-test/data/external_table_p0/paimon/paimon_timestamp_types.out
delete mode 100644
regression-test/data/external_table_p2/hudi/test_hudi_timetravel.out
create mode 100644
regression-test/data/external_table_p2/iceberg/iceberg_equality_delete.out
rename
regression-test/data/{external_table_p0/iceberg/test_iceberg_position_delete.out
=> external_table_p2/iceberg/iceberg_position_delete.out} (100%)
create mode 100644
regression-test/data/external_table_p2/iceberg/test_external_catalog_iceberg_hadoop_catalog.out
create mode 100644
regression-test/data/external_table_p2/iceberg/test_external_catalog_icebergv2_nereids.out
rename regression-test/data/fault_injection_p0/{partial_update =>
}/concurrency_update1.csv (100%)
rename regression-test/data/fault_injection_p0/{partial_update =>
}/concurrency_update2.csv (100%)
rename regression-test/data/fault_injection_p0/{partial_update =>
}/concurrency_update3.csv (100%)
delete mode 100644
regression-test/data/fault_injection_p0/partial_update/test_partial_update_compaction_with_higher_version.out
delete mode 100644
regression-test/data/fault_injection_p0/partial_update/test_partial_update_conflict_skip_compaction.out
delete mode 100644
regression-test/data/fault_injection_p0/partial_update/test_partial_update_skip_compaction.out
rename regression-test/data/fault_injection_p0/{partial_update =>
}/test_partial_update_column_num_fault_injection.out (100%)
rename regression-test/data/fault_injection_p0/{partial_update =>
}/test_partial_update_publish_conflict_with_error.out (100%)
delete mode 100644
regression-test/data/inverted_index_p0/index_format_v2/test_add_build_index_with_format_v2.out
delete mode 100644
regression-test/data/inverted_index_p0/index_format_v2/test_create_table_with_format_v2.out
delete mode 100644
regression-test/data/inverted_index_p0/index_format_v2/test_cumulative_compaction_with_format_v2.out
delete mode 100644
regression-test/data/inverted_index_p0/index_format_v2/test_drop_column_index_with_format_v2.out
delete mode 100644
regression-test/data/inverted_index_p0/index_format_v2/test_drop_column_with_format_v2.out
delete mode 100644
regression-test/data/inverted_index_p0/index_format_v2/test_drop_index_with_format_v2.out
delete mode 100644
regression-test/data/inverted_index_p0/index_format_v2/test_mor_table_with_format_v2.out
delete mode 100644
regression-test/data/inverted_index_p0/index_format_v2/test_mow_table_with_format_v2.out
delete mode 100644
regression-test/data/inverted_index_p0/index_format_v2/test_rename_column_with_format_v2.out
delete mode 100644
regression-test/data/inverted_index_p0/index_format_v2/test_single_replica_compaction_with_format_v2.out
delete mode 100644
regression-test/data/inverted_index_p0/test_show_nested_index_file_http_action_with_variant.out
delete mode 100644 regression-test/data/jsonb_p0/test_jsonb_cast.csv
delete mode 100644 regression-test/data/jsonb_p0/test_jsonb_cast.out
delete mode 100644 regression-test/data/jsonb_p0/test_jsonb_unescaped.csv
delete mode 100644 regression-test/data/jsonb_p0/test_jsonb_unescaped.json
delete mode 100644
regression-test/data/jsonb_p0/test_jsonb_with_unescaped_string.out
delete mode 100644
regression-test/data/load_p0/routine_load/test_routine_load_offset.out
delete mode 100644
regression-test/data/load_p0/routine_load/test_routine_load_property.out
delete mode 100644
regression-test/data/load_p0/stream_load/load_object_array_json.out
delete mode 100644
regression-test/data/load_p0/stream_load/test_json_object_array.csv
delete mode 100644
regression-test/data/query_p0/cast/test_complextype_to_json.out
delete mode 100644
regression-test/data/query_p0/join/test_runtime_filter_boolean.out
delete mode 100644 regression-test/data/rollup_p0/test_create_mv_and_mtmv.out
delete mode 100644
regression-test/suites/bloom_filter_p0/test_bloom_filter_hit_with_renamed_column.groovy
delete mode 100644
regression-test/suites/compaction/compaction_width_array_column.groovy
delete mode 100644
regression-test/suites/datatype_p0/nested_types/ddl/create_nestedtypes_with_replaceIfNOtNull.groovy
delete mode 100644
regression-test/suites/export_p0/outfile/hdfs/test_outfile_hdfs.groovy
create mode 100644
regression-test/suites/export_p2/test_export_with_hdfs.groovy
delete mode 100644
regression-test/suites/external_table_p0/iceberg/test_gen_iceberg_by_api.groovy
delete mode 100644
regression-test/suites/external_table_p0/iceberg/test_iceberg_equality_delete.groovy
delete mode 100644
regression-test/suites/external_table_p0/iceberg/test_iceberg_time_travel.groovy
delete mode 100644
regression-test/suites/external_table_p0/iceberg/test_iceberg_upper_case_column_name.groovy
delete mode 100644
regression-test/suites/external_table_p0/paimon/test_paimon_predict.groovy
delete mode 100644
regression-test/suites/external_table_p2/hudi/test_hudi_timetravel.groovy
create mode 100644
regression-test/suites/external_table_p2/iceberg/iceberg_equality_delete.groovy
rename
regression-test/suites/{external_table_p0/iceberg/test_iceberg_position_delete.groovy
=> external_table_p2/iceberg/iceberg_position_delete.groovy} (92%)
create mode 100644
regression-test/suites/external_table_p2/iceberg/test_external_catalog_iceberg_hadoop_catalog.groovy
create mode 100644
regression-test/suites/external_table_p2/iceberg/test_external_catalog_icebergv2_nereids.groovy
delete mode 100644
regression-test/suites/fault_injection_p0/partial_update/test_partial_update_compaction_with_higher_version.groovy
delete mode 100644
regression-test/suites/fault_injection_p0/partial_update/test_partial_update_conflict_skip_compaction.groovy
delete mode 100644
regression-test/suites/fault_injection_p0/partial_update/test_partial_update_skip_compaction.groovy
rename regression-test/suites/fault_injection_p0/{partial_update =>
}/test_partial_update_column_num_fault_injection.groovy (100%)
rename regression-test/suites/fault_injection_p0/{partial_update =>
}/test_partial_update_publish_conflict_with_error.groovy (100%)
delete mode 100644
regression-test/suites/inverted_index_p0/index_format_v2/test_add_build_index_with_format_v2.groovy
delete mode 100644
regression-test/suites/inverted_index_p0/index_format_v2/test_create_table_with_format_v2.groovy
delete mode 100644
regression-test/suites/inverted_index_p0/index_format_v2/test_cumulative_compaction_with_format_v2.groovy
delete mode 100644
regression-test/suites/inverted_index_p0/index_format_v2/test_drop_column_with_format_v2.groovy
delete mode 100644
regression-test/suites/inverted_index_p0/index_format_v2/test_drop_index_with_format_v2.groovy
delete mode 100644
regression-test/suites/inverted_index_p0/index_format_v2/test_index_change_format.groovy
delete mode 100644
regression-test/suites/inverted_index_p0/index_format_v2/test_mor_table_with_format_v2.groovy
delete mode 100644
regression-test/suites/inverted_index_p0/index_format_v2/test_mow_table_with_format_v2.groovy
delete mode 100644
regression-test/suites/inverted_index_p0/index_format_v2/test_recover_with_format_v2.groovy
delete mode 100644
regression-test/suites/inverted_index_p0/index_format_v2/test_rename_column_with_format_v2.groovy
delete mode 100644
regression-test/suites/inverted_index_p0/index_format_v2/test_single_replica_compaction_with_format_v2.groovy
delete mode 100644
regression-test/suites/inverted_index_p0/test_show_nested_index_file_http_action.groovy
delete mode 100644
regression-test/suites/inverted_index_p0/test_show_nested_index_file_http_action_with_variant.groovy
delete mode 100644 regression-test/suites/jsonb_p0/test_jsonb_cast.groovy
delete mode 100644
regression-test/suites/jsonb_p0/test_jsonb_with_unescaped_string.groovy
delete mode 100644
regression-test/suites/load_p0/routine_load/data/test_enclose_and_escape0.csv
delete mode 100644
regression-test/suites/load_p0/routine_load/data/test_enclose_and_escape1.csv
delete mode 100644
regression-test/suites/load_p0/routine_load/data/test_offset_time.csv
delete mode 100644
regression-test/suites/load_p0/routine_load/data/test_show_routine_load.csv
delete mode 100644
regression-test/suites/load_p0/routine_load/test_routine_load_offset.groovy
delete mode 100644
regression-test/suites/load_p0/routine_load/test_routine_load_property.groovy
delete mode 100644
regression-test/suites/load_p0/routine_load/test_show_routine_load.groovy
delete mode 100644
regression-test/suites/load_p0/stream_load/load_object_array_json.groovy
delete mode 100644
regression-test/suites/query_p0/cast/test_complextype_to_json.groovy
delete mode 100644
regression-test/suites/query_p0/join/test_runtime_filter_boolean.groovy
delete mode 100644
regression-test/suites/rollup_p0/test_create_mv_and_mtmv.groovy
delete mode 100644 samples/datalake/iceberg_and_paimon/README.md
delete mode 100644
samples/datalake/iceberg_and_paimon/data/flink-conf/flink-conf.yaml
delete mode 100644
samples/datalake/iceberg_and_paimon/data/flink-conf/log4j-cli.properties
delete mode 100644
samples/datalake/iceberg_and_paimon/data/flink-conf/log4j-console.properties
delete mode 100644
samples/datalake/iceberg_and_paimon/data/flink-conf/log4j-session.properties
delete mode 100644
samples/datalake/iceberg_and_paimon/data/flink-conf/log4j.properties
delete mode 100644
samples/datalake/iceberg_and_paimon/data/flink-conf/logback-console.xml
delete mode 100644
samples/datalake/iceberg_and_paimon/data/flink-conf/logback-session.xml
delete mode 100644
samples/datalake/iceberg_and_paimon/data/flink-conf/logback.xml
delete mode 100644 samples/datalake/iceberg_and_paimon/data/flink-conf/masters
delete mode 100644 samples/datalake/iceberg_and_paimon/data/flink-conf/workers
delete mode 100644 samples/datalake/iceberg_and_paimon/data/flink-conf/zoo.cfg
delete mode 100644
samples/datalake/iceberg_and_paimon/data/spark-conf/fairscheduler.xml.template
delete mode 100644
samples/datalake/iceberg_and_paimon/data/spark-conf/log4j2.properties.template
delete mode 100644
samples/datalake/iceberg_and_paimon/data/spark-conf/metrics.properties.template
delete mode 100755
samples/datalake/iceberg_and_paimon/data/spark-conf/spark-defaults.conf
delete mode 100644
samples/datalake/iceberg_and_paimon/data/spark-conf/spark-defaults.conf.template
delete mode 100755
samples/datalake/iceberg_and_paimon/data/spark-conf/spark-env.sh.template
delete mode 100644
samples/datalake/iceberg_and_paimon/data/spark-conf/workers.template
delete mode 100644
samples/datalake/iceberg_and_paimon/data/table/customer/000000_0
delete mode 100644
samples/datalake/iceberg_and_paimon/data/table/customer/000001_0
delete mode 100644
samples/datalake/iceberg_and_paimon/data/table/customer/000002_0
delete mode 100644
samples/datalake/iceberg_and_paimon/data/table/customer/000003_0
delete mode 100644 samples/datalake/iceberg_and_paimon/docker-compose.env
delete mode 100644 samples/datalake/iceberg_and_paimon/docker-compose.yml
delete mode 100644 samples/datalake/iceberg_and_paimon/scripts/start_doris.sh
delete mode 100644 samples/datalake/iceberg_and_paimon/sql/init_doris.sql
delete mode 100644 samples/datalake/iceberg_and_paimon/sql/init_tables.sql
delete mode 100644 samples/datalake/iceberg_and_paimon/sql/prepare_data.sql
delete mode 100644 samples/datalake/iceberg_and_paimon/start_all.sh
delete mode 100644 samples/datalake/iceberg_and_paimon/start_doris_client.sh
delete mode 100644 samples/datalake/iceberg_and_paimon/start_flink_client.sh
delete mode 100644
samples/datalake/iceberg_and_paimon/start_spark_iceberg_client.sh
delete mode 100644
samples/datalake/iceberg_and_paimon/start_spark_paimon_client.sh
delete mode 100644 samples/datalake/iceberg_and_paimon/stop_all.sh
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
