[
https://issues.apache.org/jira/browse/SPARK-17264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-17264.
-------------------------------
Resolution: Fixed
Fix Version/s: 2.1.0
2.0.1
Issue resolved by pull request 14860
[https://github.com/apache/spark/pull/14860]
> DataStreamWriter should document that it only supports Parquet for now
> ----------------------------------------------------------------------
>
> Key: SPARK-17264
> URL: https://issues.apache.org/jira/browse/SPARK-17264
> Project: Spark
> Issue Type: Bug
> Components: Documentation, Input/Output
> Affects Versions: 2.0.0
> Environment: Mac OSX
> Reporter: Bill Reed
> Assignee: Sean Owen
> Priority: Trivial
> Fix For: 2.0.1, 2.1.0
>
>
> The API documentations for DataStreamWriter.format states "Specifies the
> underlying output data source. Built-in options include "parquet", "json",
> etc." but when specifying "json" or "text" for the format. the following
> exception is thrown:
> Exception in thread "main" java.lang.UnsupportedOperationException: Data
> source json does not support streamed writing
> at
> org.apache.spark.sql.execution.datasources.DataSource.createSink(DataSource.scala:273)
> at
> org.apache.spark.sql.streaming.DataStreamWriter.start(DataStreamWriter.scala:291)
> The only format that works is .format("parquet")
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
