cloud-fan commented on issue #24129: [SPARK-27190][SQL] add table capability for streaming URL: https://github.com/apache/spark/pull/24129#issuecomment-474346919 @rdblue The check for the streaming side is done in `MicroBatchExecution` and `ContinuousExecution`, and the related tests are in `StreamingDataSourceV2Suite`. I don't think it's an easy change to move the check to `V2WriteSupportCheck`, because 1. streaming need to check the read side as well. A streaming source may only support micro-batch and can't be used with continuous mode. 2. the check needs to know the current streaming mode, which is only available in `MicroBatchExecution` and `ContinuousExecution`. If we do want to move the check, we should do it in another PR, which would introduce a non-trivial refactor.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
