Gschiavon opened a new pull request #26733: [WIP][SPARK-30097][SS][SQL] - Add suport for core sinks in writeStream URL: https://github.com/apache/spark/pull/26733 ### What changes were proposed in this pull request? When using `writeStream` we always have to use `format("xxx")` in order to target the selected sink while in `readStream` you can use directly `.parquet` Basically this is to add the support to the core writers for writeStream Example: ``` writeStream .outputMode("append") .partitionBy("id") .options(options) .parquet(path) ``` ### Why are the changes needed? The changes are needed to maintain same syntax between `write` and `writeStream` just like `read` and `readStream` ### Does this PR introduce any user-facing change? It adds a new way of calling the sinks when using `writeStream` ### How was this patch tested? For now I just added a test for the `parquet` sink
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
