HeartSaVioR commented on PR #56542: URL: https://github.com/apache/spark/pull/56542#issuecomment-4727041106
That sounds to me even bigger scope than what I thought - should the shard infrastructure be also opt-in? What's the downside of making it by default? Is it a separate process than executor or inlined? If it's a separate process, then how the Spark infra launches them? This obviously needs a design doc, and "opt-out doesn't impact others" does not justify an addition of the feature. Again, I'm not an expert of this area, but I feel like folks in SQL area might be a same page that this warrants SPIP. cc. @cloud-fan @dtenedor FYI -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
