GitHub user FelixYBW added a comment to the discussion: How to dynamically switch between native Spark and Gluten backend based on the execution plan?
Do you mean fallback whole queries or stages? to queries, you can set `spark.gluten.enabled=false` for the query. To stages we currently can support whole stage fallback once there is one operator in the stage needs fallback by setting `spark.gluten.sql.columnar.wholeStage.fallback.threshold=1`. If you need to fallback any whole stage you want, how do you define the stage? you can easily add some config like `spark.gluten.fallbackstage=5`. But you would like to fallback based on some rules, RAS is a good choice. GitHub link: https://github.com/apache/incubator-gluten/discussions/10954#discussioncomment-14883284 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
