Copilot commented on code in PR #1958:
URL: https://github.com/apache/auron/pull/1958#discussion_r2739815708
##########
spark-extension-shims-spark/src/test/scala/org/apache/auron/BaseAuronSQLSuite.scala:
##########
@@ -58,5 +58,8 @@ trait BaseAuronSQLSuite extends SharedSparkSession {
.set("spark.auron.enable", "true")
.set("spark.ui.enabled", "false")
.set("spark.sql.warehouse.dir", warehouseDir)
+ // Avoid the code size overflow error in Spark code generation.
+ .set("spark.sql.codegen.wholeStage", "false")
+ .set("spark.sql.codegen.factoryMode", "NO_CODEGEN")
Review Comment:
The suite-level SparkConf now disables whole-stage codegen and forces
NO_CODEGEN for all test runs. This changes test coverage/behavior for Spark 3.x
as well (not just Spark 4.1) and can mask regressions that only reproduce under
codegen. Consider scoping these settings to Spark 4.x only (e.g., conditional
on SparkVersionUtil.isSparkV40OrGreater) or to the Spark 4.1 CI/profile, so
Spark 3.x tests continue exercising codegen paths.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
