[
https://issues.apache.org/jira/browse/SPARK-5657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stanislav Los updated SPARK-5657:
---------------------------------
Component/s: PySpark
Examples
Affects Version/s: 1.2.0
> Add PySpark Avro Output Format example
> --------------------------------------
>
> Key: SPARK-5657
> URL: https://issues.apache.org/jira/browse/SPARK-5657
> Project: Spark
> Issue Type: Improvement
> Components: Examples, PySpark
> Affects Versions: 1.2.0
> Reporter: Stanislav Los
>
> There is an Avro Input Format example that shows how to read Avro data in
> PySpark, but nothing shows how to write from PySpark to Avro. The main
> challenge, a Converter needs an Avro schema to build a record, but current
> Spark API doesn't provide a way to supply extra parameters to custom
> converters. Provided workaround is possible.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
