[
https://issues.apache.org/jira/browse/ARROW-288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15499623#comment-15499623
]
Wes McKinney commented on ARROW-288:
------------------------------------
Yes, we'd happily accept help with this. There is lots of work to do both in
Arrow (e.g. integration testing / conforming the Java and C++ implementations)
and Spark.
> Implement Arrow adapter for Spark Datasets
> ------------------------------------------
>
> Key: ARROW-288
> URL: https://issues.apache.org/jira/browse/ARROW-288
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++, Java - Vectors
> Reporter: Wes McKinney
>
> It would be valuable for applications that use Arrow to be able to
> * Convert between Spark DataFrames/Datasets and Java Arrow vectors
> * Send / Receive Arrow record batches / Arrow file format RPCs to / from
> Spark
> * Allow PySpark to use Arrow for messaging in UDF evaluation
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
