This is an automated email from the ASF dual-hosted git repository.
dataroaring pushed a change to branch mor_value_predicate_pushdown_control
in repository https://gitbox.apache.org/repos/asf/doris.git
omit 4d22670a644 [fix](scan) Remove obsolete pipeline:: namespace qualifier
in olap_scanner
omit 368053e173e [fix](scan) Add virtual base declaration for
_should_push_down_mor_value_predicate
omit a8e3952a2e4 [fix](scan) Refactor table list matching to use
TableNameInfo-style component parsing
omit 228120329e4 [feature](scan) Add read_mor_as_dup_tables session
variable to read MOR tables without merge
omit 233f825a396 [feature](scan) Implement BE-side value predicate pushdown
for MOR tables
omit f2e849e6825 [feature](scan) Add session variable to control value
predicate pushdown for MOR tables
add 92c779ee4ab [fix](recycler) use document_remove to delete versioned
rowset meta (#61157)
add 53f1452b41e [fix](catalog) commit index with correctly partition ids
(#61139)
add f895ef03c7a [opt](paimon) support paimon table with
partition.legacy-name in date type (#61076)
add 0f27e8ac1f1 [fix](cloud) Skip empty rowsets before accessor lookup in
batch delete_rowset_data (#60919)
add bff85cb7fc6 [fix](test) update results of array_apply test (#61152)
add 7c88610da20 [feature](lineage) Support lineage SPI framework for data
lineage collection (#61004)
add 692a3fa6500 [chore](dep)Upgrade fe dependencies (#61060)
add 711ef9ebb7e [fix](auth) restrict skip_catalog_priv_check to SHOW and
SELECT on catalog privilege checks (#61147)
add 50bbf89c907 [Enhancement](skills) clarify code review skill usage and
refine guidelines (#61116)
add 7bc32307c4b [fix](test) Fix ODR violation for MockFileReader across
test files. (#61170)
add 00b2e853252 [refactor](expr) Replace Expr.toThrift() and normalize()
with visitor pattern (#61165)
add afa679b6e41 [fix](cloud) recycle tmp rowsets before recycling deleted
instance (#61167)
add 3567c2fa099 [feature](scan) Add session variable to control value
predicate pushdown for MOR tables
add 8eeae3976cb [feature](scan) Implement BE-side value predicate pushdown
for MOR tables
add 988b865fc11 [feature](scan) Add read_mor_as_dup_tables session
variable to read MOR tables without merge
add 3b190b5a3b6 [fix](scan) Refactor table list matching to use
TableNameInfo-style component parsing
add 40b30e9cb61 [fix](scan) Add virtual base declaration for
_should_push_down_mor_value_predicate
add 9c5114737b3 [fix](scan) Remove obsolete pipeline:: namespace qualifier
in olap_scanner
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (4d22670a644)
\
N -- N -- N refs/heads/mor_value_predicate_pushdown_control
(9c5114737b3)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.claude/skills/code-review/SKILL.md | 23 +-
AGENTS.md | 8 +-
.../format/file_reader/file_meta_cache_test.cpp | 2 +
be/test/format/orc/orc_file_reader_test.cpp | 2 +
be/test/io/fs/packed_file_reader_test.cpp | 9 +-
be/test/io/fs/packed_file_system_test.cpp | 5 +-
build.sh | 2 +
cloud/src/meta-store/keys.cpp | 9 -
cloud/src/meta-store/keys.h | 7 -
cloud/src/recycler/recycler.cpp | 165 ++--
cloud/src/recycler/recycler.h | 7 +-
cloud/test/recycler_test.cpp | 90 ++
.../create_preinstalled_scripts/paimon/run12.sql | 54 ++
.../main/java/org/apache/doris/common/Config.java | 19 +-
fe/fe-core/pom.xml | 10 +
.../org/apache/doris/analysis/ArithmeticExpr.java | 45 +-
.../org/apache/doris/analysis/ArrayLiteral.java | 9 -
.../apache/doris/analysis/BetweenPredicate.java | 14 -
.../org/apache/doris/analysis/BinaryPredicate.java | 40 +-
.../org/apache/doris/analysis/BoolLiteral.java | 10 -
.../java/org/apache/doris/analysis/CaseExpr.java | 14 -
.../java/org/apache/doris/analysis/CastExpr.java | 35 +-
.../org/apache/doris/analysis/ColumnRefExpr.java | 16 +-
.../apache/doris/analysis/CompoundPredicate.java | 26 +-
.../org/apache/doris/analysis/DateLiteral.java | 19 -
.../org/apache/doris/analysis/DecimalLiteral.java | 10 -
.../org/apache/doris/analysis/EncryptKeyRef.java | 6 -
.../main/java/org/apache/doris/analysis/Expr.java | 74 +-
.../apache/doris/analysis/ExprToSqlVisitor.java | 4 +-
.../apache/doris/analysis/ExprToThriftVisitor.java | 799 +++++++++++++++++
.../org/apache/doris/analysis/FloatLiteral.java | 9 -
.../apache/doris/analysis/FunctionCallExpr.java | 48 +-
.../org/apache/doris/analysis/IPv4Literal.java | 14 +-
.../org/apache/doris/analysis/IPv6Literal.java | 13 +-
.../org/apache/doris/analysis/InPredicate.java | 26 +-
.../apache/doris/analysis/InformationFunction.java | 9 -
.../java/org/apache/doris/analysis/IntLiteral.java | 9 -
.../org/apache/doris/analysis/IsNullPredicate.java | 14 +-
.../org/apache/doris/analysis/JsonLiteral.java | 9 -
.../doris/analysis/LambdaFunctionCallExpr.java | 7 -
.../apache/doris/analysis/LambdaFunctionExpr.java | 7 -
.../org/apache/doris/analysis/LargeIntLiteral.java | 9 -
.../org/apache/doris/analysis/LikePredicate.java | 8 -
.../org/apache/doris/analysis/LiteralExpr.java | 21 -
.../java/org/apache/doris/analysis/MapLiteral.java | 14 -
.../org/apache/doris/analysis/MatchPredicate.java | 68 +-
.../java/org/apache/doris/analysis/MaxLiteral.java | 6 -
.../org/apache/doris/analysis/NullLiteral.java | 7 -
.../org/apache/doris/analysis/PlaceHolderExpr.java | 6 -
.../org/apache/doris/analysis/SearchPredicate.java | 230 +----
.../org/apache/doris/analysis/SlotDescriptor.java | 2 +-
.../java/org/apache/doris/analysis/SlotRef.java | 24 -
.../java/org/apache/doris/analysis/SortInfo.java | 2 +-
.../org/apache/doris/analysis/StringLiteral.java | 13 -
.../org/apache/doris/analysis/StructLiteral.java | 14 -
.../org/apache/doris/analysis/TimeV2Literal.java | 9 -
.../doris/analysis/TimestampArithmeticExpr.java | 76 --
.../org/apache/doris/analysis/TryCastExpr.java | 16 +-
.../apache/doris/analysis/VarBinaryLiteral.java | 12 +-
.../org/apache/doris/analysis/VariableExpr.java | 52 +-
.../main/java/org/apache/doris/catalog/Env.java | 9 +
.../org/apache/doris/datasource/FileScanNode.java | 3 +-
.../apache/doris/datasource/InternalCatalog.java | 2 +-
.../apache/doris/datasource/es/QueryBuilders.java | 19 +-
.../doris/datasource/hive/HiveBucketUtil.java | 50 +-
.../datasource/hive/HiveMetaStoreClientHelper.java | 12 +-
.../doris/datasource/iceberg/IcebergUtils.java | 105 +--
.../doris/datasource/lakesoul/LakeSoulUtils.java | 88 +-
.../datasource/paimon/PaimonMetadataCache.java | 8 +-
.../apache/doris/datasource/paimon/PaimonUtil.java | 21 +-
.../paimon/source/PaimonPredicateConverter.java | 67 +-
.../source/TrinoConnectorPredicateConverter.java | 8 +-
.../org/apache/doris/mysql/MysqlAuthPacket.java | 5 +
.../java/org/apache/doris/mysql/MysqlProto.java | 1 +
.../mysql/privilege/AccessControllerManager.java | 20 +-
.../org/apache/doris/nereids/NereidsPlanner.java | 6 +
.../java/org/apache/doris/nereids/PlannerHook.java | 4 +-
.../doris/nereids/lineage/LineageContext.java | 244 ++++++
.../nereids/lineage/LineageEventProcessor.java | 349 ++++++++
.../apache/doris/nereids/lineage/LineageInfo.java | 248 ++++++
.../nereids/lineage/LineageInfoExtractor.java | 678 +++++++++++++++
.../doris/nereids/lineage/LineagePlugin.java | 59 ++
.../nereids/lineage/LineagePluginFactory.java | 54 ++
.../apache/doris/nereids/lineage/LineageUtils.java | 322 +++++++
.../nereids/load/NereidsLoadPlanInfoCollector.java | 8 +-
.../expression/rules/FoldConstantRuleOnBE.java | 3 +-
.../trees/plans/commands/CreateTableCommand.java | 12 +-
.../commands/insert/InsertIntoTableCommand.java | 11 +
.../insert/InsertOverwriteTableCommand.java | 7 +
.../nereids/trees/plans/physical/TopnFilter.java | 3 +-
.../org/apache/doris/planner/AggregationNode.java | 7 +-
.../org/apache/doris/planner/AnalyticEvalNode.java | 8 +-
.../org/apache/doris/planner/DataPartition.java | 3 +-
.../org/apache/doris/planner/DataStreamSink.java | 7 +-
.../org/apache/doris/planner/HashJoinNode.java | 17 +-
.../apache/doris/planner/MaterializationNode.java | 3 +-
.../apache/doris/planner/NestedLoopJoinNode.java | 5 +-
.../org/apache/doris/planner/OlapScanNode.java | 7 +-
.../org/apache/doris/planner/OlapTableSink.java | 18 +-
.../apache/doris/planner/PartitionSortNode.java | 3 +-
.../org/apache/doris/planner/PlanFragment.java | 3 +-
.../java/org/apache/doris/planner/PlanNode.java | 16 +-
.../java/org/apache/doris/planner/RepeatNode.java | 5 +-
.../org/apache/doris/planner/RuntimeFilter.java | 7 +-
.../org/apache/doris/planner/SetOperationNode.java | 5 +-
.../apache/doris/planner/TableFunctionNode.java | 5 +-
.../planner/normalize/ExprNormalizeVisitor.java | 99 +++
.../main/java/org/apache/doris/plugin/Plugin.java | 1 +
.../java/org/apache/doris/plugin/PluginMgr.java | 2 +
.../java/org/apache/doris/qe/ConnectContext.java | 15 +
.../java/org/apache/doris/qe/ConnectProcessor.java | 32 +-
.../java/org/apache/doris/qe/FEOpExecutor.java | 3 +-
.../apache/doris/qe/ShortCircuitQueryContext.java | 6 +-
.../doris/qe/runtime/ThriftPlansBuilder.java | 3 +-
.../org/apache/doris/task/AlterReplicaTask.java | 5 +-
.../doris/analysis/ExprToThriftBehaviorTest.java | 285 ++++++
.../apache/doris/analysis/SearchPredicateTest.java | 16 +-
.../analysis/VarBinaryLiteralAnalysisTest.java | 4 +-
.../privilege/AccessControllerManagerTest.java | 124 ++-
.../nereids/lineage/LineageEventProcessorTest.java | 453 ++++++++++
.../nereids/lineage/LineageInfoExtractorTest.java | 960 +++++++++++++++++++++
.../nereids/lineage/LineageUtilsSkipTest.java | 109 +++
.../trees/expressions/VarBinaryLiteralTest.java | 5 +-
fe/pom.xml | 16 +-
.../timestamptz/array/test_tz_array_functions.out | 6 +-
.../data/doc/sql-manual/ArrayNullsafe.out | 2 +-
.../paimon/paimon_partition_legacy.out | 41 +
...ormat.groovy => paimon_partition_legacy.groovy} | 16 +-
128 files changed, 5678 insertions(+), 1357 deletions(-)
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/create_preinstalled_scripts/paimon/run12.sql
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/analysis/ExprToThriftVisitor.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/lineage/LineageContext.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/lineage/LineageEventProcessor.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/lineage/LineageInfo.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/lineage/LineageInfoExtractor.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/lineage/LineagePlugin.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/lineage/LineagePluginFactory.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/lineage/LineageUtils.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/planner/normalize/ExprNormalizeVisitor.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/analysis/ExprToThriftBehaviorTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/lineage/LineageEventProcessorTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/lineage/LineageInfoExtractorTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/lineage/LineageUtilsSkipTest.java
create mode 100644
regression-test/data/external_table_p0/paimon/paimon_partition_legacy.out
copy
regression-test/suites/external_table_p0/paimon/{paimon_tb_mix_format.groovy =>
paimon_partition_legacy.groovy} (79%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
