This is an automated email from the ASF dual-hosted git repository.
yuanzhou pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/incubator-gluten.git
The following commit(s) were added to refs/heads/main by this push:
new 9f1bfaa9e3 [GLUTEN-6887][VL] Daily Update Velox Version (2025_03_26)
(#9135)
9f1bfaa9e3 is described below
commit 9f1bfaa9e36b2465cd45312dd5cb3bd0c481ec43
Author: Gluten Performance Bot
<[email protected]>
AuthorDate: Thu Mar 27 19:27:55 2025 +0000
[GLUTEN-6887][VL] Daily Update Velox Version (2025_03_26) (#9135)
Upstream Velox's New Commits:
c870f8ff5 by Christian Zentgraf, fix(build): Update deprecated declarations
in adapters Dockerfile (12789)
b83cc884d by Yenda Li, fix: PrestoSerde should be using chain length during
serialization (12784)
3696cf406 by Sergey Pershin, fix: Change sanity check in
TDigest::mergeDeserialized() (12785)
ccd765d3d by Jimmy Lu, feat: Full MAP_CONCAT support in Prism connector
(12649)
e489a26cc by James Gill, refactor: Rename Geospatial* to BingTile* (12778)
567227131 by Chengcheng Jin, feat: Optimize deserialize UnsafeRows to
RowVector (11936)
059ffcbea by Hongze Zhang, feat: Add API DataSource::cancel() to allow
implementation run cleanup logic while TableScan::close() is called (12701)
822e65951 by Natasha Sehgal, feat: Add Merge TDigest for Velox (12615)
a2b81cd26 by Orri Erling, feat: Add file format setting for
LocalRunnerTestBase (12783)
86ef11496 by Peter Enescu, fix(fuzzer): Make less ambiguous function not
execution by adding to unary operator map (12786)
70e222e18 by Deepak Majeti, fix(parquet): SkippedStrides runtime stats
(12777)
e21e1ce53 by Hongze Zhang, fix: Untangle some strange code in
`PlanBuilder::finalAggregation()` (12466)
0b8c32298 by Jimmy Lu, fix: Move only one region to prefetch if the regions
overlap (12776)
a732664f7 by Kevin Wilfong, fix: Expand the range of supported years (12694)
9e4828ce2 by Xiaoxuan Meng, fix: Fix flaky innerJoinWithTableScan (12787)
58c2e108c by Xiao Du, feat: Impl split_to_multimap Null Args (12779)
406d2c0bf by Xin Zhang, build: GCC13 compilation failures in Experimental
CI (12517)
040e5185f by Rui Mo, fix: Fix NaN values in Spark collect_set aggregate
function (12335)
215213a62 by Muhammad Haseeb, feat: Add a method to specify a custom
`InsertTableHandle` in TableWriterBuilder (12259)
e8dd265a8 by zhaokuo03, fix: Fix partition filters with timestamp value
(12368)
---
.../serializer/VeloxRowToColumnarConverter.cc | 1 +
ep/build-velox/src/get_velox.sh | 2 +-
.../sql-tests/inputs/datetime-parsing-invalid.sql | 6 +++--
.../results/datetime-parsing-invalid.sql.out | 26 ----------------------
4 files changed, 6 insertions(+), 29 deletions(-)
diff --git a/cpp/velox/operators/serializer/VeloxRowToColumnarConverter.cc
b/cpp/velox/operators/serializer/VeloxRowToColumnarConverter.cc
index ef85a56726..7529b9d1fd 100644
--- a/cpp/velox/operators/serializer/VeloxRowToColumnarConverter.cc
+++ b/cpp/velox/operators/serializer/VeloxRowToColumnarConverter.cc
@@ -18,6 +18,7 @@
#include "VeloxRowToColumnarConverter.h"
#include "memory/VeloxColumnarBatch.h"
#include "velox/row/UnsafeRowDeserializers.h"
+#include "velox/vector/FlatVector.h"
#include "velox/vector/arrow/Bridge.h"
using namespace facebook::velox;
diff --git a/ep/build-velox/src/get_velox.sh b/ep/build-velox/src/get_velox.sh
index 95fcf0cf6e..b90fdf9360 100755
--- a/ep/build-velox/src/get_velox.sh
+++ b/ep/build-velox/src/get_velox.sh
@@ -17,7 +17,7 @@
set -exu
VELOX_REPO=https://github.com/oap-project/velox.git
-VELOX_BRANCH=2025_03_25_fix
+VELOX_BRANCH=2025_03_26
VELOX_HOME=""
OS=`uname -s`
diff --git
a/gluten-ut/spark35/src/test/resources/backends-velox/sql-tests/inputs/datetime-parsing-invalid.sql
b/gluten-ut/spark35/src/test/resources/backends-velox/sql-tests/inputs/datetime-parsing-invalid.sql
index 730e5eac1f..286763d4cb 100644
---
a/gluten-ut/spark35/src/test/resources/backends-velox/sql-tests/inputs/datetime-parsing-invalid.sql
+++
b/gluten-ut/spark35/src/test/resources/backends-velox/sql-tests/inputs/datetime-parsing-invalid.sql
@@ -1,9 +1,11 @@
--- TESTS FOR DATETIME PARSING FUNCTIONS WITH INVALID VALUES ---
-- parsing invalid value with pattern 'y'
-select to_timestamp('294248', 'y'); -- out of year value range [0, 294247]
+-- disable since https://github.com/facebookincubator/velox/pull/12694
+-- select to_timestamp('294248', 'y'); -- out of year value range [0, 294247]
-select to_timestamp('1234567', 'yyyyyyy'); -- the length of 'y' pattern must
be less than 7
+-- disable since https://github.com/facebookincubator/velox/pull/12694
+-- select to_timestamp('1234567', 'yyyyyyy'); -- the length of 'y' pattern
must be less than 7
-- in java 8 this case is invalid, but valid in java 11, disabled for jenkins
-- select to_timestamp('100', 'DD');
diff --git
a/gluten-ut/spark35/src/test/resources/backends-velox/sql-tests/results/datetime-parsing-invalid.sql.out
b/gluten-ut/spark35/src/test/resources/backends-velox/sql-tests/results/datetime-parsing-invalid.sql.out
index 1ed684f76b..caf6605c3b 100644
---
a/gluten-ut/spark35/src/test/resources/backends-velox/sql-tests/results/datetime-parsing-invalid.sql.out
+++
b/gluten-ut/spark35/src/test/resources/backends-velox/sql-tests/results/datetime-parsing-invalid.sql.out
@@ -1,30 +1,4 @@
-- Automatically generated by SQLQueryTestSuite
--- !query
-select to_timestamp('294248', 'y')
--- !query schema
-struct<>
--- !query output
-java.lang.ArithmeticException
-long overflow
-
-
--- !query
-select to_timestamp('1234567', 'yyyyyyy')
--- !query schema
-struct<>
--- !query output
-org.apache.spark.SparkUpgradeException
-{
- "errorClass" :
"INCONSISTENT_BEHAVIOR_CROSS_VERSION.DATETIME_PATTERN_RECOGNITION",
- "sqlState" : "42K0B",
- "messageParameters" : {
- "config" : "\"spark.sql.legacy.timeParserPolicy\"",
- "docroot" : "https://spark.apache.org/docs/latest";,
- "pattern" : "'yyyyyyy'"
- }
-}
-
-
-- !query
select to_timestamp('2019-366', 'yyyy-DDD')
-- !query schema
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
