Stanislav Los created SPARK-5657:
------------------------------------
Summary: Add PySpark Avro Output Format example
Key: SPARK-5657
URL: https://issues.apache.org/jira/browse/SPARK-5657
Project: Spark
Issue Type: Improvement
Reporter: Stanislav Los
There is an Avro Input Format example that shows how to read Avro data in
PySpark, but nothing shows how to write from PySpark to Avro. The main
challenge, a Converter needs an Avro schema to build a record, but current
Spark API doesn't provide a way to supply extra parameters to custom
converters. Provided workaround is possible.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
