This is an automated email from the ASF dual-hosted git repository.
rui pushed a change to branch wip_data_col
in repository https://gitbox.apache.org/repos/asf/incubator-gluten.git
omit d73a7f4b32 Use column names
add 35f6603f55 [VL] disable CI on ubuntu-20.04 (#9800)
add c50e21ddd0 [VL] RAS: Various fixes (#9803)
add 580db626f1 [CORE] Test trait `WithQueryPlanListener` for ensuring no
fallback query plan node conveniently (#9802)
add e99b519274 [GLUTEN-9790][Flink] Support resolving different converters
for Rex calls that share the same operator name (#9792)
add eff142c5e8 [GLUTEN-9752][Flink] Support array/map in row/vector
conversion (#9757)
add 796bf35078 [GLUTEN-6887][VL] Daily Update Velox Version (2025_05_30)
(#9805)
add 05c7fddac9 [GLUTEN-8663][VL] Fix column directory structure for
partitioned writes (#9733)
add 442d38478b [GLUTEN-9801] Delete the written file if the task failed
(#9808)
add cba61a4e6e [GLUTEN-9769][CELEBORN] Use the correct shuffle time
metrics for celeborn columnar shuffle (#9770)
add 829fc0b0f8 [VL] Following #9802, fix the plan listener not working for
Scala 2.12 (#9815)
add 6134265d3e [GLUTEN-6887][VL] Daily Update Velox Version (2025_05_31)
(#9819)
add 42800ee29f [GLUTEN-6887][VL] Daily Update Velox Version (2025_06_01)
(#9825)
add 508189d513 [GLUTEN-6887][VL] Daily Update Velox Version (2025_06_02)
(#9827)
add e914f7a17a [GLUTEN-9755][FLINK] Support null (#9806)
add b21ea90efc [VL] Remove useless compile.sh (#9837)
add 78d882c173 [GLUTEN-9823] Exclude jsr305 from Gluten shaded jar to
reduce redundancy (#9822)
add a334bde810 [GLUTEN-6887][VL] Daily Update Velox Version (2025_06_03)
(#9835)
add ba24a5c7b6 Disable requested type check
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (d73a7f4b32)
\
N -- N -- N refs/heads/wip_data_col (ba24a5c7b6)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/labeler.yml | 1 -
.github/workflows/velox_backend.yml | 3 +-
.../VeloxCelebornColumnarShuffleWriter.scala | 21 +-
.../gluten/backendsapi/velox/VeloxBackend.scala | 1 +
.../spark/shuffle/ColumnarShuffleWriter.scala | 4 +-
.../apache/spark/shuffle/utils/ShuffleUtil.scala | 3 +-
.../execution/SparkWriteFilesCommitProtocol.scala | 5 +-
.../execution/VeloxColumnarWriteFilesExec.scala | 2 +-
.../gluten/execution/MiscOperatorSuite.scala | 41 ++
.../enumerated/planner/VeloxRasSuite.scala | 4 +-
cpp/compile.sh | 158 --------
cpp/velox/compute/WholeStageResultIterator.cc | 1 +
cpp/velox/substrait/SubstraitToVeloxPlan.cc | 41 +-
ep/build-velox/src/get_velox.sh | 2 +-
.../apache/gluten/rexnode/RexNodeConverter.java | 3 +-
.../gluten/rexnode/{Utils.java => TypeUtils.java} | 41 +-
.../main/java/org/apache/gluten/rexnode/Utils.java | 48 ---
.../rexnode/functions/BaseRexCallConverters.java | 22 +-
.../functions/BasicCompareOperatorConverters.java | 90 +++++
.../rexnode/functions/ModRexCallConverter.java | 12 +-
.../gluten/rexnode/functions/RexCallConverter.java | 2 +
.../rexnode/functions/RexCallConverterFactory.java | 81 +++-
.../apache/gluten/util/LogicalTypeConverter.java | 99 +++--
.../gluten/vectorized/ArrowVectorAccessor.java | 174 +++++---
.../gluten/vectorized/ArrowVectorWriter.java | 448 ++++++++++++++++-----
.../runtime/stream/custom/ScalarFunctionsTest.java | 68 +++-
.../table/runtime/stream/custom/ScanTest.java | 100 +++++
.../src/main/scala/org/apache/gluten/ras/Ras.scala | 46 ++-
.../scala/org/apache/gluten/ras/RasCluster.scala | 12 +-
.../org/apache/gluten/ras/dp/DpGroupAlgo.scala | 4 +-
.../scala/org/apache/gluten/ras/dp/DpPlanner.scala | 22 +-
.../gluten/ras/exaustive/ExhaustivePlanner.scala | 21 +-
.../apache/gluten/ras/memo/ForwardMemoTable.scala | 40 +-
.../scala/org/apache/gluten/ras/memo/Memo.scala | 12 +-
.../org/apache/gluten/ras/memo/MemoTable.scala | 17 +-
.../org/apache/gluten/ras/property/MemoRole.scala | 162 ++++----
.../apache/gluten/ras/rule/EnforcerRuleSet.scala | 2 +-
.../apache/gluten/ras/vis/GraphvizVisualizer.scala | 26 +-
.../org/apache/gluten/ras/mock/MockMemoState.scala | 7 +-
.../apache/gluten/ras/property/MemoRoleSuite.scala | 32 +-
.../gluten/backendsapi/BackendSettingsApi.scala | 1 +
.../execution/WriteFilesExecTransformer.scala | 119 +++++-
.../spark/shuffle/GlutenShuffleWriterWrapper.scala | 12 +-
.../org/apache/gluten/test/FallbackUtil.scala | 10 +-
.../apache/spark/sql/WithQueryPlanListener.scala | 136 +++++++
.../org/apache/spark/sql/GlutenSQLQuerySuite.scala | 11 +-
package/pom.xml | 6 +
47 files changed, 1430 insertions(+), 743 deletions(-)
delete mode 100755 cpp/compile.sh
copy gluten-flink/planner/src/main/java/org/apache/gluten/rexnode/{Utils.java
=> TypeUtils.java} (70%)
create mode 100644
gluten-flink/planner/src/main/java/org/apache/gluten/rexnode/functions/BasicCompareOperatorConverters.java
copy gluten-core/src/main/scala/org/apache/spark/task/SparkTaskUtil.scala =>
gluten-ras/common/src/test/scala/org/apache/gluten/ras/property/MemoRoleSuite.scala
(53%)
create mode 100644
gluten-substrait/src/test/scala/org/apache/spark/sql/WithQueryPlanListener.scala
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
