This is an automated email from the ASF dual-hosted git repository.
hongze pushed a change to branch branch-1.6
in repository https://gitbox.apache.org/repos/asf/incubator-gluten.git
from ccfa92b446 [GLUTEN-11402][VL] fix reading decimal partition key
(#11518)
add c5c43c1a6f [GLUTEN-11569][VL] Following #11527, fix the error calling
#noMoreSplits on cuDF value stream nodes (#11572)
add 24b8c7634e Bump pip from 24.2 to 26.0 in
/tools/workload/benchmark_velox/analysis (#11564)
add 73cbf88c31 [VL][CI] Migrate Spark 4.1 tests to CentOS 9 (#11519)
add ee5f9ef3cc [MINOR] Remove scan filter extraction logs from
`BatchScanExecTransformerBase` (#11573)
add 1c2ffcae14 Fix deprecated Delta API usages in velox test code (#11594)
add 48ca0ba9ce [GLUTEN-11559][Build] Improve incremental build time for
test-compile phase (#11560)
add ae2fc5b5eb [GLUTEN-6887][VL] Daily Update Velox Version (2026_02_06)
(#11583)
add 0e5bb9f1ec [Tools] Add explicit HDFS URI scheme support for
qualification-tool (#11602)
add 017fa4bd52 [Tools] Improve error handling and data sanitization in
UnsupportedOperators report (#11601)
add a508e82089 [GLUTEN-11417][VL] Enhance qualification tool to support
lakehouse format detection (#11436)
add a4e565577a [VL] Enhance VeloxIceberg documentation with SQL options
(#11586)
add c22eb87092 [VL] Add S3 integration tests to gluten (#11516)
No new revisions were added by this update.
Summary of changes:
.github/workflows/util/install-resources.sh | 60 ++
.github/workflows/velox_backend_x86.yml | 34 +-
.gitignore | 12 +-
backends-clickhouse/pom.xml | 1 -
backends-velox/pom.xml | 2 +-
.../spark/sql/delta/DeletionVectorsTestUtils.scala | 4 +-
.../org/apache/spark/sql/delta/DeltaSuite.scala | 18 +-
.../perf/OptimizeMetadataOnlyDeltaQuerySuite.scala | 2 +-
build/mvn | 2 +-
build/mvnd | 179 ++++++
cpp/velox/compute/VeloxPlanConverter.cc | 1 +
cpp/velox/compute/VeloxRuntime.cc | 11 +-
cpp/velox/compute/WholeStageResultIterator.cc | 6 +-
cpp/velox/compute/WholeStageResultIterator.h | 2 +-
cpp/velox/substrait/SubstraitToVeloxPlan.cc | 7 +-
cpp/velox/substrait/SubstraitToVeloxPlan.h | 13 +-
dev/gluten-build-info.sh | 19 +-
dev/run-scala-test.sh | 673 +++++++++++++++++++++
docs/get-started/VeloxIceberg.md | 214 ++++++-
ep/build-velox/src/get-velox.sh | 4 +-
gluten-core/pom.xml | 5 +-
gluten-delta/pom.xml | 1 -
gluten-hudi/pom.xml | 1 -
gluten-iceberg/pom.xml | 1 -
gluten-kafka/pom.xml | 1 -
gluten-paimon/pom.xml | 1 -
gluten-ras/pom.xml | 1 -
gluten-substrait/pom.xml | 43 +-
.../execution/BatchScanExecTransformer.scala | 1 -
gluten-ut/common/pom.xml | 1 -
gluten-ut/spark32/pom.xml | 1 -
gluten-ut/spark33/pom.xml | 1 -
gluten-ut/spark34/pom.xml | 1 -
gluten-ut/spark35/pom.xml | 1 -
gluten-ut/spark40/pom.xml | 1 -
gluten-ut/spark41/pom.xml | 1 -
.../expressions/GlutenCastWithAnsiOffSuite.scala | 7 +-
.../catalyst/expressions/GlutenTryCastSuite.scala | 7 +-
gluten-ut/test/pom.xml | 1 -
pom.xml | 27 +-
tools/gluten-it/common/pom.xml | 6 +-
.../apache/gluten/integration/QueryRunner.scala | 2 +-
.../apache/gluten/integration/ds/TpcdsSuite.scala | 2 +-
.../apache/gluten/integration/h/TpchSuite.scala | 2 +-
.../gluten/qt/support/LakehouseFormatDetector.java | 132 ++++
.../gluten/qt/support/LocationPatternMatcher.java | 98 +++
.../gluten/qt/support/NodeSupportVisitor.java | 44 +-
.../gluten/qt/support/ProviderClassExtractor.java | 87 +++
.../apache/gluten/qt/file/HadoopFileSource.scala | 1 +
.../org/apache/gluten/qt/writer/ImpactReport.scala | 3 +-
.../qt/writer/OperatorImpactReportWriter.scala | 29 +-
.../qt/support/LakehouseFormatDetectorTest.java | 305 ++++++++++
.../support/NodeSupportVisitorLakehouseTest.java | 366 +++++++++++
.../benchmark_velox/analysis/requirements.txt | 2 +-
54 files changed, 2309 insertions(+), 138 deletions(-)
create mode 100755 build/mvnd
create mode 100755 dev/run-scala-test.sh
create mode 100644
tools/qualification-tool/src/main/java/org/apache/gluten/qt/support/LakehouseFormatDetector.java
create mode 100644
tools/qualification-tool/src/main/java/org/apache/gluten/qt/support/LocationPatternMatcher.java
create mode 100644
tools/qualification-tool/src/main/java/org/apache/gluten/qt/support/ProviderClassExtractor.java
create mode 100644
tools/qualification-tool/src/test/java/org/apache/gluten/qt/support/LakehouseFormatDetectorTest.java
create mode 100644
tools/qualification-tool/src/test/java/org/apache/gluten/qt/support/NodeSupportVisitorLakehouseTest.java
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
