[jira] [Assigned] (ARROW-1376) [C++] RecordBatchStreamReader::Open API is inconsistent with writer

2017-08-23 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney reassigned ARROW-1376: --- Assignee: Wes McKinney > [C++] RecordBatchStreamReader::Open API is inconsistent with writer

[jira] [Commented] (ARROW-1403) [C++] Add variant of SerializeRecordBatch that accepts an writer-allocator callback

2017-08-23 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139515#comment-16139515 ] Wes McKinney commented on ARROW-1403: - I looked at this today. I think this might be overkill versus

[jira] [Comment Edited] (ARROW-1403) [C++] Add variant of SerializeRecordBatch that accepts an writer-allocator callback

2017-08-23 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139515#comment-16139515 ] Wes McKinney edited comment on ARROW-1403 at 8/24/17 3:42 AM: -- I looked at

[jira] [Resolved] (ARROW-1386) [C++] Unpin CMake version in MSVC build toolchain

2017-08-23 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-1386. - Resolution: Fixed Issue resolved by pull request 989 [https://github.com/apache/arrow/pull/989]

[jira] [Created] (ARROW-1409) [Format] Use for "page" attribute in Buffer in metadata

2017-08-23 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-1409: --- Summary: [Format] Use for "page" attribute in Buffer in metadata Key: ARROW-1409 URL: https://issues.apache.org/jira/browse/ARROW-1409 Project: Apache Arrow

[jira] [Assigned] (ARROW-1406) [Python] Harden user API for generating serialized schema and record batch messages as memoryview-compatible objects

2017-08-23 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney reassigned ARROW-1406: --- Assignee: Wes McKinney > [Python] Harden user API for generating serialized schema and

[jira] [Updated] (ARROW-1403) [C++] Add variant of SerializeRecordBatch that accepts an writer-allocator callback

2017-08-23 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-1403: Fix Version/s: (was: 0.7.0) > [C++] Add variant of SerializeRecordBatch that accepts an

[jira] [Assigned] (ARROW-1386) [C++] Unpin CMake version in MSVC build toolchain

2017-08-23 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney reassigned ARROW-1386: --- Assignee: Wes McKinney > [C++] Unpin CMake version in MSVC build toolchain >

[jira] [Created] (ARROW-1408) [C++] Refactor and make IPC read / write APIs more consistent, add appropriate deprecations

2017-08-23 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-1408: --- Summary: [C++] Refactor and make IPC read / write APIs more consistent, add appropriate deprecations Key: ARROW-1408 URL: https://issues.apache.org/jira/browse/ARROW-1408

[jira] [Assigned] (ARROW-1364) [C++] IPC reader and writer specialized for GPU device memory

2017-08-23 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney reassigned ARROW-1364: --- Assignee: Wes McKinney > [C++] IPC reader and writer specialized for GPU device memory >

[jira] [Updated] (ARROW-1407) Dictionaries can only hold a maximum of 4096 indices

2017-08-23 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-1407: Fix Version/s: 0.7.0 > Dictionaries can only hold a maximum of 4096 indices >

[jira] [Commented] (ARROW-1407) Dictionaries can only hold a maximum of 4096 indices

2017-08-23 Thread Emilio Lahr-Vivaz (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16138958#comment-16138958 ] Emilio Lahr-Vivaz commented on ARROW-1407: -- FYI, you don't have to use the DictionaryEncoder

[jira] [Updated] (ARROW-1407) Dictionaries can only hold a maximum of 4096 indices

2017-08-23 Thread Shayan Monshizadeh (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shayan Monshizadeh updated ARROW-1407: -- Summary: Dictionaries can only hold a maximum of 4096 indices (was: Dictionaries can

[jira] [Updated] (ARROW-1407) Dictionaries can only hold 4096 indices

2017-08-23 Thread Shayan Monshizadeh (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shayan Monshizadeh updated ARROW-1407: -- Description: Dictionaries seem to only be able to hold 4096 indices, meaning only

[jira] [Created] (ARROW-1407) Dictionaries can only hold 4096 indices

2017-08-23 Thread Shayan Monshizadeh (JIRA)
Shayan Monshizadeh created ARROW-1407: - Summary: Dictionaries can only hold 4096 indices Key: ARROW-1407 URL: https://issues.apache.org/jira/browse/ARROW-1407 Project: Apache Arrow Issue

[jira] [Commented] (ARROW-1238) [Java] Add JSON read/write support for decimals for integration tests

2017-08-23 Thread Li Jin (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16138928#comment-16138928 ] Li Jin commented on ARROW-1238: --- I can take a look if [~bryanc] is not available. What's the json format for

[jira] [Commented] (ARROW-229) [C++] Implement safe casts for primitive types

2017-08-23 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16138641#comment-16138641 ] Wes McKinney commented on ARROW-229: Any function that is capable of allocating memory must be passed a

[jira] [Commented] (ARROW-229) [C++] Implement safe casts for primitive types

2017-08-23 Thread Ankit Aggarwal (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16138635#comment-16138635 ] Ankit Aggarwal commented on ARROW-229: -- Scope: To define safe casts functions for the each type

[jira] [Commented] (ARROW-590) Add integration tests for Union types

2017-08-23 Thread Li Jin (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16138633#comment-16138633 ] Li Jin commented on ARROW-590: -- PR: https://github.com/apache/arrow/pull/987 > Add integration tests for

[jira] [Updated] (ARROW-1398) [Python] No support reading columns of type decimal(19,4)

2017-08-23 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-1398: Summary: [Python] No support reading columns of type decimal(19,4) (was: No support reading

[jira] [Commented] (ARROW-489) Python: Pandas zero-copy for ListArrays conversion

2017-08-23 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16138469#comment-16138469 ] Wes McKinney commented on ARROW-489: Removed from 0.7.0. We are computing slices in arrow_to_pandas.cc,

[jira] [Updated] (ARROW-489) Python: Pandas zero-copy for ListArrays conversion

2017-08-23 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-489: --- Fix Version/s: (was: 0.7.0) > Python: Pandas zero-copy for ListArrays conversion >

[jira] [Updated] (ARROW-1280) [C++] Implement Fixed Size List type

2017-08-23 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-1280: Fix Version/s: (was: 1.0.0) 0.7.0 > [C++] Implement Fixed Size List type >

[jira] [Commented] (ARROW-1238) [Java] Add JSON read/write support for decimals for integration tests

2017-08-23 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16138432#comment-16138432 ] Wes McKinney commented on ARROW-1238: - This is getting pretty close to being needed. [~icexelloss] may

[jira] [Updated] (ARROW-1238) [Java] Add JSON read/write support for decimals for integration tests

2017-08-23 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-1238: Fix Version/s: 0.7.0 > [Java] Add JSON read/write support for decimals for integration tests >

[jira] [Updated] (ARROW-941) [Docs] Improve "cold start" integration testing instructions

2017-08-23 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-941: --- Fix Version/s: 0.7.0 > [Docs] Improve "cold start" integration testing instructions >

[jira] [Commented] (ARROW-1401) [C++] Add extra debugging context to failures in RETURN_NOT_OK in debug builds

2017-08-23 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16138419#comment-16138419 ] Wes McKinney commented on ARROW-1401: - In release builds we could print only the file and line number

[jira] [Commented] (ARROW-1401) [C++] Add extra debugging context to failures in RETURN_NOT_OK in debug builds

2017-08-23 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16138413#comment-16138413 ] Uwe L. Korn commented on ARROW-1401: I would also like to see this in release builds so it would

[jira] [Assigned] (ARROW-1282) Large memory reallocation by Arrow causes hang in jemalloc

2017-08-23 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn reassigned ARROW-1282: -- Assignee: Uwe L. Korn > Large memory reallocation by Arrow causes hang in jemalloc >

[jira] [Comment Edited] (ARROW-229) [C++] Implement safe casts for primitive types

2017-08-23 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16138406#comment-16138406 ] Wes McKinney edited comment on ARROW-229 at 8/23/17 2:20 PM: - Thank you for

[jira] [Commented] (ARROW-229) [C++] Implement safe casts for primitive types

2017-08-23 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16138406#comment-16138406 ] Wes McKinney commented on ARROW-229: Thank you for your patch. The scope of what I am intending here is

[jira] [Assigned] (ARROW-590) Add integration tests for Union types

2017-08-23 Thread Li Jin (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Jin reassigned ARROW-590: Assignee: Li Jin > Add integration tests for Union types > - > >

[jira] [Resolved] (ARROW-1392) [C++] Implement reader and writer IO interfaces for GPU buffers

2017-08-23 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-1392. - Resolution: Fixed Issue resolved by pull request 985 [https://github.com/apache/arrow/pull/985]