zsxwing commented on pull request #30521: URL: https://github.com/apache/spark/pull/30521#issuecomment-737308122
> You have no idea of output mode in DSv1, and that's what I have been concerned about. We pass the output mode to the sink here: https://github.com/apache/spark/blob/084d38b64ecbcaa9fac47ffca5604cf2a72936fc/sql/core/src/main/scala/org/apache/spark/sql/sources/interfaces.scala#L154 > I have lots of concerns on creating table Could you clarify this? We create an output path if it doesn't exist since the beginning in streaming, and I have not heard complaints about this. Why not make the behavior of creating table consistent with creating an output path? ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
