felipepessoto commented on issue #12387: URL: https://github.com/apache/gluten/issues/12387#issuecomment-5244364985
Noting a CI workaround that should be removed together with the fix. The Delta Spark UT pipeline (#12388) cannot run the two `DeletionVectorsSuite` 2B-row tests -- they balloon the forked test JVM to ~13G of native memory and get OOM-killed, which wedges sbt and hangs the whole shard until the hang watchdog kills it, taking every suite queued behind it with it. As an interim measure `setup-delta.sh` injects a `fail(...)` as the first statement of each of those two test bodies, so they fail fast with a clear message instead of hanging the shard, and the two entries sit in `known-failures.txt`. They were force-failed rather than ignored precisely so the gap stays visible. When this is fixed, please remove that `sed` block from `.github/workflows/util/delta-spark-ut/setup-delta.sh` and drop the two entries from `known-failures.txt`, otherwise we permanently lose 2B-row DV read/delete coverage. Tracked in #12743. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
