baibaichen opened a new issue, #11915:
URL: https://github.com/apache/gluten/issues/11915
## Backend
VL (Velox)
## Bug description
Spark 4.1 introduced checksum-based shuffle writers
(SPARK-53322/SPARK-54439, sub-tasks of SPARK-51166 Umbrella). Gluten's shuffle
writer implementation does not produce the expected checksums, causing test
failures.
Spark 4.1 only.
Parent issue: #11550
### Impact
| Suite | Status | spark40 | spark41 |
|-------|--------|:-------:|:-------:|
| GlutenMapStatusEndToEndSuite | Entire suite TODO | 🟢 | 🔴 |
| GlutenKeyGroupedPartitioningSuite | `.excludeByPrefix("SPARK-53322")` | 🟢
| 🔴 |
| GlutenKeyGroupedPartitioningSuite | `.excludeByPrefix("SPARK-54439")` | 🟢
| 🔴 |
### References
- Apache Spark JIRA:
[SPARK-53322](https://issues.apache.org/jira/browse/SPARK-53322)
- Apache Spark JIRA:
[SPARK-54439](https://issues.apache.org/jira/browse/SPARK-54439)
- Apache Spark JIRA:
[SPARK-51166](https://issues.apache.org/jira/browse/SPARK-51166) (Umbrella)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
