[jira] [Updated] (ARROW-293) [C++] Implementations of IO interfaces for operating system files

2016-09-17 Thread Wes McKinney (JIRA)

 [ 
https://issues.apache.org/jira/browse/ARROW-293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wes McKinney updated ARROW-293:
---
Summary: [C++] Implementations of IO interfaces for operating system files  
(was: [C++] Implemented of IO interfaces for operating system files)

> [C++] Implementations of IO interfaces for operating system files
> -
>
> Key: ARROW-293
> URL: https://issues.apache.org/jira/browse/ARROW-293
> Project: Apache Arrow
>  Issue Type: New Feature
>  Components: C++
>Reporter: Wes McKinney
>Assignee: Wes McKinney
>
> We can possibly adapt the code found in 
> https://github.com/wesm/feather/blob/master/cpp/src/feather/io.h



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (ARROW-293) [C++] Implemented of IO interfaces for operating system files

2016-09-17 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-293:
--

 Summary: [C++] Implemented of IO interfaces for operating system 
files
 Key: ARROW-293
 URL: https://issues.apache.org/jira/browse/ARROW-293
 Project: Apache Arrow
  Issue Type: New Feature
  Components: C++
Reporter: Wes McKinney
Assignee: Wes McKinney


We can possibly adapt the code found in 

https://github.com/wesm/feather/blob/master/cpp/src/feather/io.h



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (ARROW-288) Implement Arrow adapter for Spark Datasets

2016-09-17 Thread Wes McKinney (JIRA)

[ 
https://issues.apache.org/jira/browse/ARROW-288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15499623#comment-15499623
 ] 

Wes McKinney commented on ARROW-288:


Yes, we'd happily accept help with this. There is lots of work to do both in 
Arrow (e.g. integration testing / conforming the Java and C++ implementations) 
and Spark.

> Implement Arrow adapter for Spark Datasets
> --
>
> Key: ARROW-288
> URL: https://issues.apache.org/jira/browse/ARROW-288
> Project: Apache Arrow
>  Issue Type: Bug
>  Components: C++, Java - Vectors
>Reporter: Wes McKinney
>
> It would be valuable for applications that use Arrow to be able to 
> * Convert between Spark DataFrames/Datasets and Java Arrow vectors
> * Send / Receive Arrow record batches / Arrow file format RPCs to / from 
> Spark 
> * Allow PySpark to use Arrow for messaging in UDF evaluation



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)