cloud-fan edited a comment on pull request #28523: URL: https://github.com/apache/spark/pull/28523#issuecomment-628404331
About how to evolute to a better update mode, I have a rough idea. To me, the missing piece of the current update mode is: there is no update condition. This makes the behavior ambiguous. We can add a new API in `DataStreamWriter` (or just use options) to specify the update condition. When update condition is not specified, the v2 sink can provide a default one. It can be constant `false` which means update is the same as append. We can fail by default if update condition is not specified, and provide a legacy config to allow it. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
