[jira] [Created] (ARROW-2107) [GLib] Follow arrow::gpu::CudaIpcMemHandle API change

2018-02-06 Thread Kouhei Sutou (JIRA)
Kouhei Sutou created ARROW-2107: --- Summary: [GLib] Follow arrow::gpu::CudaIpcMemHandle API change Key: ARROW-2107 URL: https://issues.apache.org/jira/browse/ARROW-2107 Project: Apache Arrow Issu

[jira] [Created] (ARROW-2106) pyarrow.array can't take a pandas Series of python datetime objects.

2018-02-06 Thread Naveen Michaud-Agrawal (JIRA)
Naveen Michaud-Agrawal created ARROW-2106: - Summary: pyarrow.array can't take a pandas Series of python datetime objects. Key: ARROW-2106 URL: https://issues.apache.org/jira/browse/ARROW-2106

[jira] [Created] (ARROW-2105) [C++] Implement take kernel functions - properly handle special indices

2018-02-06 Thread Jingyuan Wang (JIRA)
Jingyuan Wang created ARROW-2105: Summary: [C++] Implement take kernel functions - properly handle special indices Key: ARROW-2105 URL: https://issues.apache.org/jira/browse/ARROW-2105 Project: Apache

[jira] [Created] (ARROW-2104) [C++] Implement take kernel functions - nested array value type

2018-02-06 Thread Jingyuan Wang (JIRA)
Jingyuan Wang created ARROW-2104: Summary: [C++] Implement take kernel functions - nested array value type Key: ARROW-2104 URL: https://issues.apache.org/jira/browse/ARROW-2104 Project: Apache Arrow

Re: Writing nested parquet data using pyarrow

2018-02-06 Thread Wes McKinney
hi Ishaan, Full support for converting between Arrow's and Parquet's nested data representation in https://github.com/apache/parquet-cpp/tree/master/src/parquet/arrow is not yet complete. I have no estimate on when the work will be completed since I'm not sure who's going to do the work. I will

[jira] [Created] (ARROW-2103) [C++] Implement take kernel functions - string/binary value type

2018-02-06 Thread Jingyuan Wang (JIRA)
Jingyuan Wang created ARROW-2103: Summary: [C++] Implement take kernel functions - string/binary value type Key: ARROW-2103 URL: https://issues.apache.org/jira/browse/ARROW-2103 Project: Apache Arrow

[jira] [Created] (ARROW-2102) [C++] Implement take kernel functions - primitive value type

2018-02-06 Thread Jingyuan Wang (JIRA)
Jingyuan Wang created ARROW-2102: Summary: [C++] Implement take kernel functions - primitive value type Key: ARROW-2102 URL: https://issues.apache.org/jira/browse/ARROW-2102 Project: Apache Arrow

[jira] [Created] (ARROW-2101) [Python] from_pandas reads 'str' types as binary Arrow data with Python 2

2018-02-06 Thread Bryan Cutler (JIRA)
Bryan Cutler created ARROW-2101: --- Summary: [Python] from_pandas reads 'str' types as binary Arrow data with Python 2 Key: ARROW-2101 URL: https://issues.apache.org/jira/browse/ARROW-2101 Project: Apache

[jira] [Created] (ARROW-2100) [Python] Drop Python 3.4 support

2018-02-06 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created ARROW-2100: -- Summary: [Python] Drop Python 3.4 support Key: ARROW-2100 URL: https://issues.apache.org/jira/browse/ARROW-2100 Project: Apache Arrow Issue Type: Improvement

Re: Spark DataFrame <--> Arrow Roundtrip

2018-02-06 Thread Li Jin
Hi Michael, Please see my comments inline. Keep in mind these are all pretty internal APIs so they might change in the future. On Mon, Feb 5, 2018 at 11:30 AM, Michael Shtelma wrote: > Hi all, > > I would like to make some changes (updates) to the data stored in > Spark data frames, which I ge

[jira] [Created] (ARROW-2099) [Python] Support DictionaryArray::FromIndices in Python bindings

2018-02-06 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-2099: --- Summary: [Python] Support DictionaryArray::FromIndices in Python bindings Key: ARROW-2099 URL: https://issues.apache.org/jira/browse/ARROW-2099 Project: Apache Arrow

[jira] [Created] (ARROW-2098) [Python] Implement "errors as null" option when coercing Python object arrays to Arrow format

2018-02-06 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-2098: --- Summary: [Python] Implement "errors as null" option when coercing Python object arrays to Arrow format Key: ARROW-2098 URL: https://issues.apache.org/jira/browse/ARROW-2098

R: [Python] Retrieving a RecordBatch from plasma inside a function

2018-02-06 Thread ALBERTO Bocchinfuso
Hi, I’m using python 3.5.2 and pyarrow 0.8.0 As key, I put a string of 20 bytes, of course. I’m doing it differently from the canonical way since I’m no more using python 2.7, but python 3, and this seemed to me to be the right way to create a string of 20 bytes. The full code is: import pyarr