Wes McKinney commented on ARROW-288:

Yes, we'd happily accept help with this. There is lots of work to do both in 
Arrow (e.g. integration testing / conforming the Java and C++ implementations) 
and Spark.

> Implement Arrow adapter for Spark Datasets
> ------------------------------------------
>                 Key: ARROW-288
>                 URL: https://issues.apache.org/jira/browse/ARROW-288
>             Project: Apache Arrow
>          Issue Type: Bug
>          Components: C++, Java - Vectors
>            Reporter: Wes McKinney
> It would be valuable for applications that use Arrow to be able to 
> * Convert between Spark DataFrames/Datasets and Java Arrow vectors
> * Send / Receive Arrow record batches / Arrow file format RPCs to / from 
> Spark 
> * Allow PySpark to use Arrow for messaging in UDF evaluation

This message was sent by Atlassian JIRA

Reply via email to