brkyvz opened a new pull request #27941: [SPARK-31178][SQL] Prevent V2 exec nodes from executing multiple times URL: https://github.com/apache/spark/pull/27941 ### What changes were proposed in this pull request? This PR prevents the execution of V2 DataSource exec nodes multiple times when `collect()` is called on them. For V1 DataSources, commands would be executed as a RunnableCommand, which would cache the result as part of the `ExecutedCommandExec` node. This PR introduces similar machinery for V2 nodes. ### Why are the changes needed? Calling `collect()` on a SQL command that inserts data or creates a table or alters a table gets executed multiple times otherwise. ### Does this PR introduce any user-facing change? Fixes a bug ### How was this patch tested? Unit tests
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
