[
https://issues.apache.org/jira/browse/SPARK-2736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14079761#comment-14079761
]
Michael Armbrust commented on SPARK-2736:
-----------------------------------------
Another thing to consider is that Avro would be an idea fit for SchemaRDDs and
then we could reuse the java/python bridge code that is already there.
> Ceeate Pyspark RDD from Apache Avro File
> ----------------------------------------
>
> Key: SPARK-2736
> URL: https://issues.apache.org/jira/browse/SPARK-2736
> Project: Spark
> Issue Type: Improvement
> Components: PySpark
> Reporter: Eric Garcia
> Assignee: Kan Zhang
> Priority: Minor
> Original Estimate: 4h
> Remaining Estimate: 4h
>
> There is a partially working example Avro Converter at this pull request:
> https://github.com/apache/spark/pull/1536
> It does not fully implement all types in the Avro format and could be cleaned
> up a little bit.
--
This message was sent by Atlassian JIRA
(v6.2#6252)