rdblue commented on issue #25651: [SPARK-28948][SQL] Support passing all Table metadata in TableProvider URL: https://github.com/apache/spark/pull/25651#issuecomment-545091601 > If you really think that schema or partition inference should be done for writing, we should disable file source v2 by default to not surprise users. I'm not saying that it is what we should do. That should be covered by a design doc for path-based tables. My point is that the claim that it won't be done is not necessarily true and makes assumptions about how these tables will behave.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
