Yohahaha commented on PR #4893: URL: https://github.com/apache/incubator-gluten/pull/4893#issuecomment-1990903745
seems copy Apache Spark source file into Gluten brings a limitation that require user must use same commit id or tag of these copied source file, if user has modified these source file in their own Spark, they may need apply changes in Gluten copied source file too, correct me if I was wrong. I believe the way below is better than copy more and more Spark source files into Gluten. > Is it possible that just pass spark operator to transformer plan as a parameter ? For example, like the comet: [CometScanExec](https://github.com/apache/arrow-datafusion-comet/blob/main/spark/src/main/scala/org/apache/spark/sql/comet/CometScanExec.scala) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
