manuzhang commented on PR #27924: URL: https://github.com/apache/spark/pull/27924#issuecomment-1139617705
I'm not asking for revert here but to explore an option to disable this behavior, and hence the question about partitioning and bucketed scan. Bucket table is built to avoid shuffle but it's a table and we cannot prevent downstream users from using it in other ways. As a platform, we'd better keep backward compatibility with some general options rather than asking users to fine tune their jobs. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
