HeartSaVioR commented on pull request #30521: URL: https://github.com/apache/spark/pull/30521#issuecomment-735034126
In streaming query we only do append. There's no overwrite, truncate, partition based operations, etc. I don't think it's a difficult requirement for end users to create table in prior, hence I'd in favor of dealing with existing table only. That's also why I'm actually in favor of `insertIntoTable` instead of `saveAsTable`. Furthermore, I see we're still putting lots of efforts in V1 table (most likely file (streaming) sink), instead of finding the reason we can't migrate file (streaming) sink to V2. I'm not sure this is a good direction. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
