This is an automated email from the ASF dual-hosted git repository.
rui pushed a change to branch wip_data_col
in repository https://gitbox.apache.org/repos/asf/incubator-gluten.git
discard fec8708ef8 Use column names
add b3ebdb419d [GLUTEN-6887][VL] Daily Update Velox Version (2025_05_27)
(#9751)
add d8d1065c07 [VL] Add sqrt support (#9725)
add 159f9b7959 [FOLLOWUP] Fix splitFilesByPathMethod reflection (#9763)
add cb2ccc2252 [GLUTEN-9764][VL] Use AUTO re2 source for openEuler24
(#9765)
add b720ab2cbd [VL] RAS: Add internal property `MemoRole` to reduce
duplications in plan enumeration for rule applications (#9749)
add da6cb16ac3 [GLUTEN-9719][VL] Unify output definitions for
Broadcast/Hash/Columnar shuffle joins
add 49cbb3cf5e [CH] Support deletion vector optimize for mergetree(add ut)
(#9762)
add 7f256a2526 [GLUTEN-9524][FLINK] Use spotless plugin for code style
check (#9576)
add 7bffeda982 [GLUTEN-6887][VL] Daily Update Velox Version (2025_05_28)
(#9773)
add 12eb8f6f5a [VL] Add mirror for ftp.gnu.org (#9760)
add 54ac91bc09 [FLINK] Incorrect Flink-to-Velox conversion on varbinary
literals (#9669)
add 2feb5f936c [VL] RAS: Minor code cleanups (#9771)
add 7431a9c5aa [GLUTEN-9163][VL][FOLLOWUP] Fix segfault triggered by
fixed-width inputs (#9766)
add 0e1637ecdf [GLUTEN-1632][CH]Daily Update Clickhouse Version (20250529)
(#9787)
add 7afe8d318a [GLUTEN-9774][VL] Fix AWS, GCS and etc. storge backend
builds (#9786)
add fac063117c [GLUTEN-9779][VL] Remove redundant GetTimestamp (#9782)
add be858e5e7f [FLINK] Add a basic CI job for flink module(#9778)
add 289475cb9d [GLUTEN-6887][VL] Daily Update Velox Version (2025_05_29)
(#9788)
add 2850e6b43d [FLINK] Fix flink CI (#9797)
add d73a7f4b32 Use column names
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (fec8708ef8)
\
N -- N -- N refs/heads/wip_data_col (d73a7f4b32)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/workflows/{check_license.yml => flink.yml} | 35 +-
.../GlutenDeltaMergeTreeDeletionVectorSuite.scala | 21 +
.../gluten/backendsapi/velox/VeloxRuleApi.scala | 2 +
.../enumerated/planner/VeloxRasSuite.scala | 22 +-
.../functions/DateFunctionsValidateSuite.scala | 30 +
.../functions/MathFunctionsValidateSuite.scala | 7 +
cpp-ch/clickhouse.version | 4 +-
cpp-ch/local-engine/tests/gtest_write_pipeline.cpp | 10 +-
cpp/velox/shuffle/VeloxSortShuffleWriter.cc | 2 +-
cpp/velox/substrait/SubstraitToVeloxPlan.cc | 24 +-
cpp/velox/tests/VeloxShuffleWriterTest.cc | 136 +--
dev/build_helper_functions.sh | 4 +-
dev/builddeps-veloxbe.sh | 7 +-
dev/vcpkg/CONTRIBUTING.md | 2 +-
dev/vcpkg/ports/gsasl/portfile.cmake | 2 +-
dev/vcpkg/setup-build-depends.sh | 10 +-
ep/build-velox/src/get_velox.sh | 2 +-
.../extension/columnar/cost/LongCostModel.scala | 2 +-
.../planner/metadata/GlutenMetadataModel.scala | 10 +-
.../enumerated/planner/plan/GlutenPlanModel.scala | 93 +-
.../enumerated/planner/plan/GroupLeafExec.scala | 127 ++
.../enumerated/planner/property/Conv.scala | 89 +-
.../planner/property/GlutenPropertyModel.scala | 20 +-
.scalafmt.conf => gluten-flink/.scalafmt.conf | 2 -
gluten-flink/docs/Flink.md | 3 +-
.../flink/table/planner/loader/PlannerModule.java | 287 +++--
gluten-flink/patches/fix-velox4j.patch | 49 +
.../plan/nodes/exec/common/CommonExecSink.java | 1007 ++++++++--------
.../plan/nodes/exec/stream/StreamExecCalc.java | 185 ++-
.../exec/stream/StreamExecWatermarkAssigner.java | 231 ++--
.../gluten/rexnode/RexConversionContext.java | 16 +-
.../apache/gluten/rexnode/RexNodeConverter.java | 142 ++-
.../main/java/org/apache/gluten/rexnode/Utils.java | 103 +-
.../rexnode/functions/BaseRexCallConverters.java | 67 +-
.../rexnode/functions/ModRexCallConverter.java | 31 +-
.../gluten/rexnode/functions/RexCallConverter.java | 8 +-
.../rexnode/functions/RexCallConverterFactory.java | 46 +-
gluten-flink/pom.xml | 50 +-
.../apache/flink/client/StreamGraphTranslator.java | 252 ++--
.../runtime/taskexecutor/TaskManagerRunner.java | 1226 ++++++++++----------
.../LegacySourceTransformationTranslator.java | 158 +--
.../translators/SinkTransformationTranslator.java | 895 +++++++-------
.../SourceTransformationTranslator.java | 192 ++-
.../operators/GlutenOneInputOperatorFactory.java | 61 +-
.../streaming/api/operators/GlutenOperator.java | 12 +-
.../api/operators/GlutenStreamSource.java | 61 +-
.../operators/GlutenSingleInputOperator.java | 236 ++--
.../runtime/operators/GlutenSourceFunction.java | 152 +--
.../apache/gluten/util/LogicalTypeConverter.java | 66 +-
.../apache/gluten/util/PlanNodeIdGenerator.java | 8 +-
.../gluten/vectorized/ArrowVectorAccessor.java | 183 +--
.../gluten/vectorized/ArrowVectorWriter.java | 424 ++++---
.../vectorized/FlinkRowToVLVectorConvertor.java | 136 +--
.../apache/gluten/vectorized/VLVectorIterator.java | 30 +-
.../stream/common/GlutenStreamingTestBase.java | 94 +-
.../runtime/stream/common/Velox4jEnvironment.java | 27 +-
.../runtime/stream/custom/ScalarFunctionsTest.java | 142 ++-
.../table/runtime/stream/custom/ScanTest.java | 78 +-
.../org/apache/gluten/ras/MetadataModel.scala | 4 +-
.../scala/org/apache/gluten/ras/PlanModel.scala | 17 +-
.../org/apache/gluten/ras/PropertyModel.scala | 21 +-
.../src/main/scala/org/apache/gluten/ras/Ras.scala | 122 +-
.../scala/org/apache/gluten/ras/RasCluster.scala | 4 +-
.../scala/org/apache/gluten/ras/RasGroup.scala | 2 +-
.../main/scala/org/apache/gluten/ras/RasNode.scala | 6 +-
.../scala/org/apache/gluten/ras/dp/DpPlanner.scala | 56 +-
.../org/apache/gluten/ras/dp/DpZipperAlgo.scala | 116 +-
.../gluten/ras/exaustive/ExhaustivePlanner.scala | 50 +-
.../apache/gluten/ras/memo/ForwardMemoTable.scala | 54 +-
.../scala/org/apache/gluten/ras/memo/Memo.scala | 23 +-
.../org/apache/gluten/ras/memo/MemoTable.scala | 26 +-
.../org/apache/gluten/ras/path/OutputFilter.scala | 30 +-
.../org/apache/gluten/ras/path/PathFinder.scala | 2 +-
.../scala/org/apache/gluten/ras/path/RasPath.scala | 2 +
.../org/apache/gluten/ras/property/MemoRole.scala | 218 ++++
.../apache/gluten/ras/property/PropertySet.scala | 22 +-
.../gluten/ras/property/PropertySetFactory.scala | 102 ++
.../org/apache/gluten/ras/rule/EnforcerRule.scala | 109 --
.../gluten/ras/rule/EnforcerRuleFactory.scala | 68 ++
.../apache/gluten/ras/rule/EnforcerRuleSet.scala | 99 ++
.../scala/org/apache/gluten/ras/rule/RasRule.scala | 1 -
.../org/apache/gluten/ras/rule/RuleApplier.scala | 85 +-
.../apache/gluten/ras/vis/GraphvizVisualizer.scala | 2 +-
.../org/apache/gluten/ras/MetadataSuite.scala | 7 +
.../org/apache/gluten/ras/OperationSuite.scala | 14 +-
.../org/apache/gluten/ras/PropertySuite.scala | 192 +--
.../scala/org/apache/gluten/ras/RasSuite.scala | 25 +-
.../scala/org/apache/gluten/ras/RasSuiteBase.scala | 78 +-
.../org/apache/gluten/ras/mock/MockMemoState.scala | 11 +-
.../org/apache/gluten/ras/mock/MockRasPath.scala | 2 +-
.../gluten/ras/specific/DistributedSuite.scala | 212 ++--
.../BroadcastNestedLoopJoinExecTransformer.scala | 22 +-
.../gluten/execution/JoinExecTransformer.scala | 40 +-
.../org/apache/gluten/execution/JoinUtils.scala | 13 +-
....scala => EliminateRedundantGetTimestamp.scala} | 27 +-
.../gluten/execution/PartitionedFileUtilShim.scala | 2 +
tools/gluten-te/centos/centos-7-deps.sh | 7 +-
97 files changed, 4925 insertions(+), 4289 deletions(-)
copy .github/workflows/{check_license.yml => flink.yml} (51%)
create mode 100644
gluten-core/src/main/scala/org/apache/gluten/extension/columnar/enumerated/planner/plan/GroupLeafExec.scala
copy .scalafmt.conf => gluten-flink/.scalafmt.conf (97%)
create mode 100644 gluten-flink/patches/fix-velox4j.patch
create mode 100644
gluten-ras/common/src/main/scala/org/apache/gluten/ras/property/MemoRole.scala
create mode 100644
gluten-ras/common/src/main/scala/org/apache/gluten/ras/property/PropertySetFactory.scala
delete mode 100644
gluten-ras/common/src/main/scala/org/apache/gluten/ras/rule/EnforcerRule.scala
create mode 100644
gluten-ras/common/src/main/scala/org/apache/gluten/ras/rule/EnforcerRuleFactory.scala
create mode 100644
gluten-ras/common/src/main/scala/org/apache/gluten/ras/rule/EnforcerRuleSet.scala
copy
gluten-substrait/src/main/scala/org/apache/gluten/extension/columnar/{CollectTailTransformerRule.scala
=> EliminateRedundantGetTimestamp.scala} (60%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
