cloud-fan commented on issue #25995: [SPARK-29324][SQL] Fix overwrite behaviour for saveAsTable URL: https://github.com/apache/spark/pull/25995#issuecomment-539072233 > User needs to specify the fileformat when writing using this API. This is a bug that we should fix. But I'm not sure this would happen as we explicitly drop and re-create the table. > we might transparently change a Hive(provider = Hive) table to datasource table This behavior makes sense if you think about it as `REPLACE OR CREATE TABLE AS SELECT`. I know `saveAsTable` is not a good name, but that's what it is today. You can try the new `DataFrameWriterV2` which has clear semantic after 3.0 preview is released. also cc @rdblue
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
