kazuyukitanimura commented on code in PR #509:
URL: https://github.com/apache/datafusion-comet/pull/509#discussion_r1630778450
##########
spark/src/main/scala/org/apache/comet/CometSparkSessionExtensions.scala:
##########
@@ -712,17 +712,6 @@ class CometSparkSessionExtensions
}
override def apply(plan: SparkPlan): SparkPlan = {
- // DataFusion doesn't have ANSI mode. For now we just disable CometExec
if ANSI mode is
- // enabled.
- if (isANSIEnabled(conf)) {
- if (COMET_ANSI_MODE_ENABLED.get()) {
- logWarning("Using Comet's experimental support for ANSI mode.")
- } else {
- logInfo("Comet extension disabled for ANSI mode")
- return plan
- }
- }
Review Comment:
I am close to finish my PR to enable the spark tests with Spark 4.0 I.e.
ANSI enabled, and I am disabling expressions that failed those tests with ANSI
enabled.
I would propose to hold this part of change for now. Perhaps after we fix
all Spark 4.0 issues, we can backport the learning to Spark 3.4
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org
For additional commands, e-mail: github-h...@datafusion.apache.org
