ulysses-you commented on pull request #32468: URL: https://github.com/apache/spark/pull/32468#issuecomment-840233602
Some random thoughts. We considered about supporting stage level config completly that means for every query stage we can use it's own config. Some options: * enhance hint to support set config and at AQE side use it. Syntax may look like `SELECT /*+ MERGE(t2, config(key=value)) */ * FROM t1 JOIN t2 JOIN t3` * add config tag to match the stage id. Syntax may look like `set spark.sql.adaptive.stage1.advisoryPartitionSizeInBytes=xxx`. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
