aokolnychyi commented on pull request #31700: URL: https://github.com/apache/spark/pull/31700#issuecomment-790939311
> Micro-batch is an implementation detail and shouldn't be used to define the semantic. That's a fair argument. I'd like to hide it as well. Do you have a good idea, @cloud-fan? I was inspired by the existing code where we had `WriteToContinuousDataSource` and `WriteToMicroBatchDataSource`. We probably need a way to distinguish continuous and micro-batch writes (does not have to be a separate plan, though). ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
