rdblue commented on issue #24129: [SPARK-27190][SQL] add table capability for streaming URL: https://github.com/apache/spark/pull/24129#issuecomment-483860349 I synced up with Wenchen on slack about this. We agreed that we can easily add a check that every streaming v2 relation that will be scanned supports at least one streaming execution mode. It should also be possible to check that at least one mode works for all relations in the query. These checks should be added as analyzer rules. Wenchen also pointed out that the logical plan node for writing is not present in the plan that is analyzed, so it would be a substantial refactor to add a write-side check. In that case, I think it's reasonable to open a follow-up issue to track it.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
