akshaytayal opened a new issue, #13180:
URL: https://github.com/apache/gluten/issues/13180
Part of the Spark 4.2 unit-test enablement (GLUTEN-12569, PR
apache/gluten#13163). This issue tracks **re-enabling** one root-cause group of
UTs that are currently **disabled** to keep the `gluten-ut/spark42` CI green.
### Root cause
File-source & Hive scan (Parquet/ORC ignoreMissingFiles/NullType,
bucketed-scan AE, ADD JAR)
### How it's disabled
`.exclude(...)` in
`gluten-ut/spark42/src/test/scala/org/apache/gluten/utils/velox/VeloxTestSettings.scala`
(Parquet/ORC V1/V2,
GlutenDisableUnnecessaryBucketedScanWithoutHiveSupportSuiteAE,
GlutenHiveQuerySuite).
Standard `.exclude("<test>")` entries.
### Files updated
-
`gluten-ut/spark42/src/test/scala/org/apache/gluten/utils/velox/VeloxTestSettings.scala`
### Disabled tests (11)
- `GlutenDisableUnnecessaryBucketedScanWithoutHiveSupportSuiteAE` ::
Aggregates with no groupby over tables having 1 BUCKET, return multiple rows
- `GlutenDisableUnnecessaryBucketedScanWithoutHiveSupportSuiteAE` ::
SPARK-32859: disable unnecessary bucketed table scan - basic test
- `GlutenDisableUnnecessaryBucketedScanWithoutHiveSupportSuiteAE` ::
SPARK-32859: disable unnecessary bucketed table scan - multiple bucketed
columns test
- `GlutenDisableUnnecessaryBucketedScanWithoutHiveSupportSuiteAE` ::
SPARK-32859: disable unnecessary bucketed table scan - multiple joins test
- `GlutenDisableUnnecessaryBucketedScanWithoutHiveSupportSuiteAE` ::
SPARK-32859: disable unnecessary bucketed table scan - other operators test
- `GlutenParquetV2QuerySuite` :: SPARK-55857: Enabling/disabling
ignoreMissingFiles
- `GlutenOrcV2QuerySuite` :: SPARK-55857: Enabling/disabling
ignoreMissingFiles
- `GlutenParquetV1QuerySuite` :: SPARK-55857: Enabling/disabling
ignoreMissingFiles
- `GlutenParquetIOSuite` :: SPARK-54220: NullType
- `GlutenOrcV1QuerySuite` :: SPARK-55857: Enabling/disabling
ignoreMissingFiles
- `GlutenHiveQuerySuite` :: ADD JAR command 2
### How to re-enable
Implement the underlying Gluten/Velox support, then remove the corresponding
`.exclude(...)` / allowlist / `@Ignore` / `ignore(...)` entries and confirm the
tests pass in the spark42 UT CI.
Related: PR apache/gluten#13163, GLUTEN-12569.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
