[
https://issues.apache.org/jira/browse/SPARK-30097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
German Schiavon Matteo updated SPARK-30097:
-------------------------------------------
Description:
When using `writeStream` we always have to use `format("xxx")` in order to
target the selected sink while in `readStream` you can use directly `.parquet`.
Basically this is to add the support to the core writers for `writeStream`
Example:
{{{code}}}
writeStream .outputMode("append") .partitionBy("id") .parquet(path)}
{{{code}}}
was:
When using `writeStream` we always have to use `format("xxx")` in order to
target the selected sink while in `readStream` you can use directly `.parquet`.
Basically this is to add the support to the core writers for `writeStream`
Example:
{writeStream .outputMode("append") .partitionBy("id") .parquet(path)}
> Adding support for core writers
> --------------------------------
>
> Key: SPARK-30097
> URL: https://issues.apache.org/jira/browse/SPARK-30097
> Project: Spark
> Issue Type: Improvement
> Components: SQL, Structured Streaming
> Affects Versions: 3.0.0
> Environment: {code:java}
> {code}
>
> Reporter: German Schiavon Matteo
> Priority: Minor
>
> When using `writeStream` we always have to use `format("xxx")` in order to
> target the selected sink while in `readStream` you can use directly
> `.parquet`.
> Basically this is to add the support to the core writers for `writeStream`
> Example:
>
> {{{code}}}
> writeStream .outputMode("append") .partitionBy("id") .parquet(path)}
>
> {{{code}}}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
