[jira] [Commented] (ARROW-6896) [Java] Vector schema root should not share vectors

2019-10-15 Thread Jacques Nadeau (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952513#comment-16952513 ] Jacques Nadeau commented on ARROW-6896: --- You shouldn't be sharing a vector between two batches. You

[jira] [Resolved] (ARROW-6853) [Java] Support vector and dictionary encoder use different hasher for calculating hashCode

2019-10-15 Thread Micah Kornfield (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Kornfield resolved ARROW-6853. Fix Version/s: 1.0.0 Resolution: Fixed Issue resolved by pull request 5625

[jira] [Updated] (ARROW-6897) Fix MakeArrayFromScalar function validity buffer is null bug

2019-10-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-6897: -- Labels: pull-request-available (was: ) > Fix MakeArrayFromScalar function validity buffer is

[jira] [Created] (ARROW-6897) Fix MakeArrayFromScalar function validity buffer is null bug

2019-10-15 Thread Chendi.Xue (Jira)
Chendi.Xue created ARROW-6897: - Summary: Fix MakeArrayFromScalar function validity buffer is null bug Key: ARROW-6897 URL: https://issues.apache.org/jira/browse/ARROW-6897 Project: Apache Arrow

[jira] [Commented] (ARROW-6896) [Java] Vector schema root should not share vectors

2019-10-15 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952497#comment-16952497 ] Liya Fan commented on ARROW-6896: - [~jnadeau] Thanks for your comments. Reference count solves the

[jira] [Commented] (ARROW-6896) [Java] Vector schema root should not share vectors

2019-10-15 Thread Jacques Nadeau (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952475#comment-16952475 ] Jacques Nadeau commented on ARROW-6896: --- I disagree with the issue here. We should probably add a

[jira] [Commented] (ARROW-6887) [Java] Create prose documentation for using ValueVectors

2019-10-15 Thread Micah Kornfield (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952465#comment-16952465 ] Micah Kornfield commented on ARROW-6887: I agree with Uwe, something under docs makes sense. >

[jira] [Updated] (ARROW-6896) [Java] Vector schema root should not share vectors

2019-10-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-6896: -- Labels: pull-request-available (was: ) > [Java] Vector schema root should not share vectors >

[jira] [Resolved] (ARROW-6659) [Rust] [DataFusion] Refactor of HashAggregateExec to support custom merge

2019-10-15 Thread Andy Grove (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Grove resolved ARROW-6659. --- Fix Version/s: 1.0.0 Resolution: Fixed Issue resolved by pull request 5648

[jira] [Commented] (ARROW-6844) [C++][Parquet][Python] List columns read broken with 0.15.0

2019-10-15 Thread Benoit Rostykus (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952248#comment-16952248 ] Benoit Rostykus commented on ARROW-6844: Thank you for the quick fix! > [C++][Parquet][Python]

[jira] [Commented] (ARROW-6887) [Java] Create prose documentation for using ValueVectors

2019-10-15 Thread Uwe Korn (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952245#comment-16952245 ] Uwe Korn commented on ARROW-6887: - Maybe start a Java folder in 

[jira] [Updated] (ARROW-6884) [Python][Flight] Make server-side RPC exceptions more friendly?

2019-10-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-6884: -- Labels: pull-request-available (was: ) > [Python][Flight] Make server-side RPC exceptions

[jira] [Resolved] (ARROW-6789) [Python] Automatically box bytes/buffer-like values yielded from `FlightServerBase.do_action` in Result values

2019-10-15 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-6789. - Resolution: Fixed Issue resolved by pull request 5651

[jira] [Closed] (ARROW-6719) Parquet read_table error in Python3.7: pyarrow.lib.ArrowInvalid: Column data for field with type list<...> is inconsistent with schema list<...>

2019-10-15 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche closed ARROW-6719. Resolution: Duplicate > Parquet read_table error in Python3.7:

[jira] [Commented] (ARROW-6719) Parquet read_table error in Python3.7: pyarrow.lib.ArrowInvalid: Column data for field with type list<...> is inconsistent with schema list<...>

2019-10-15 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952151#comment-16952151 ] Joris Van den Bossche commented on ARROW-6719: -- This seems to be a duplicate of ARROW-6844 I

[jira] [Resolved] (ARROW-6844) [C++][Parquet][Python] List columns read broken with 0.15.0

2019-10-15 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-6844. - Resolution: Fixed Issue resolved by pull request 5658

[jira] [Commented] (ARROW-6719) Parquet read_table error in Python3.7: pyarrow.lib.ArrowInvalid: Column data for field with type list<...> is inconsistent with schema list<...>

2019-10-15 Thread V Luong (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952129#comment-16952129 ] V Luong commented on ARROW-6719: I have attached some data above to reproduce the problem > Parquet

[jira] [Commented] (ARROW-5454) [C++] Implement Take on ChunkedArray for DataFrame use

2019-10-15 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-5454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952121#comment-16952121 ] Wes McKinney commented on ARROW-5454: - You're welcome to contribute an implementation. It does not

[jira] [Assigned] (ARROW-6885) [Python] Remove superfluous skipped timedelta test

2019-10-15 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou reassigned ARROW-6885: - Assignee: Joris Van den Bossche > [Python] Remove superfluous skipped timedelta test >

[jira] [Resolved] (ARROW-6885) [Python] Remove superfluous skipped timedelta test

2019-10-15 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou resolved ARROW-6885. --- Resolution: Fixed Issue resolved by pull request 5657

[jira] [Created] (ARROW-6894) [C++] Add/document configuration to build with WebAssembly

2019-10-15 Thread Wes McKinney (Jira)
Wes McKinney created ARROW-6894: --- Summary: [C++] Add/document configuration to build with WebAssembly Key: ARROW-6894 URL: https://issues.apache.org/jira/browse/ARROW-6894 Project: Apache Arrow

[jira] [Resolved] (ARROW-5971) [Website] Blog post introducing Arrow Flight

2019-10-15 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-5971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-5971. - Resolution: Fixed Issue resolved by pull request 35

[jira] [Created] (ARROW-6893) Missing APT package metadata for versions prior to 0.15.0

2019-10-15 Thread Joshua Randall (Jira)
Joshua Randall created ARROW-6893: - Summary: Missing APT package metadata for versions prior to 0.15.0 Key: ARROW-6893 URL: https://issues.apache.org/jira/browse/ARROW-6893 Project: Apache Arrow

[jira] [Updated] (ARROW-6869) [C++] Dictionary "delta" building logic in builder_dict.h produces invalid arrays

2019-10-15 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson updated ARROW-6869: --- Priority: Blocker (was: Major) > [C++] Dictionary "delta" building logic in builder_dict.h

[jira] [Created] (ARROW-6892) [Rust] [DataFusion] Implement optimizer rule to remove redundant projections

2019-10-15 Thread Andy Grove (Jira)
Andy Grove created ARROW-6892: - Summary: [Rust] [DataFusion] Implement optimizer rule to remove redundant projections Key: ARROW-6892 URL: https://issues.apache.org/jira/browse/ARROW-6892 Project: Apache

[jira] [Resolved] (ARROW-6567) [Rust] [DataFusion] SQL aggregate query execution assume grouping expressions precede aggregate expressions

2019-10-15 Thread Andy Grove (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Grove resolved ARROW-6567. --- Resolution: Fixed Issue resolved by pull request 5639 [https://github.com/apache/arrow/pull/5639] >

[jira] [Created] (ARROW-6891) [Rust] [Parquet] Add Utf8 support to ArrowReader

2019-10-15 Thread Andy Grove (Jira)
Andy Grove created ARROW-6891: - Summary: [Rust] [Parquet] Add Utf8 support to ArrowReader Key: ARROW-6891 URL: https://issues.apache.org/jira/browse/ARROW-6891 Project: Apache Arrow Issue Type:

[jira] [Created] (ARROW-6890) [Rust] [Parquet] ArrowReader fails with seg fault

2019-10-15 Thread Andy Grove (Jira)
Andy Grove created ARROW-6890: - Summary: [Rust] [Parquet] ArrowReader fails with seg fault Key: ARROW-6890 URL: https://issues.apache.org/jira/browse/ARROW-6890 Project: Apache Arrow Issue Type:

[jira] [Updated] (ARROW-6889) [Java] ComplexCopier enable FixedSizeList type & fix RangeEualsVisitor StackOverFlow

2019-10-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-6889: -- Labels: pull-request-available (was: ) > [Java] ComplexCopier enable FixedSizeList type & fix

[jira] [Created] (ARROW-6889) [Java] ComplexCopier enable FixedSizeList type & fix RangeEualsVisitor StackOverFlow

2019-10-15 Thread Ji Liu (Jira)
Ji Liu created ARROW-6889: - Summary: [Java] ComplexCopier enable FixedSizeList type & fix RangeEualsVisitor StackOverFlow Key: ARROW-6889 URL: https://issues.apache.org/jira/browse/ARROW-6889 Project: Apache

[jira] [Updated] (ARROW-6888) [Java] Support copy operation for vector value comparators

2019-10-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-6888: -- Labels: pull-request-available (was: ) > [Java] Support copy operation for vector value

[jira] [Created] (ARROW-6888) [Java] Support copy operation for vector value comparators

2019-10-15 Thread Liya Fan (Jira)
Liya Fan created ARROW-6888: --- Summary: [Java] Support copy operation for vector value comparators Key: ARROW-6888 URL: https://issues.apache.org/jira/browse/ARROW-6888 Project: Apache Arrow Issue

[jira] [Issue Comment Deleted] (ARROW-6719) Parquet read_table error in Python3.7: pyarrow.lib.ArrowInvalid: Column data for field with type list<...> is inconsistent with schema list<...>

2019-10-15 Thread V Luong (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] V Luong updated ARROW-6719: --- Comment: was deleted (was: Sorry, I've just found out that the PyArrow used was actually 0.14.0.RAY,

[jira] [Comment Edited] (ARROW-6719) Parquet read_table error in Python3.7: pyarrow.lib.ArrowInvalid: Column data for field with type list<...> is inconsistent with schema list<...>

2019-10-15 Thread V Luong (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951797#comment-16951797 ] V Luong edited comment on ARROW-6719 at 10/15/19 10:12 AM: --- I am encountering

[jira] [Updated] (ARROW-6719) Parquet read_table error in Python3.7: pyarrow.lib.ArrowInvalid: Column data for field with type list<...> is inconsistent with schema list<...>

2019-10-15 Thread V Luong (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] V Luong updated ARROW-6719: --- Description: I have Parquet files with certain complex columns of type List, List, etc. and am using latest

[jira] [Updated] (ARROW-6719) Parquet read_table error in Python3.7: pyarrow.lib.ArrowInvalid: Column data for field with type list<...> is inconsistent with schema list<...>

2019-10-15 Thread V Luong (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] V Luong updated ARROW-6719: --- Affects Version/s: 0.15.0 > Parquet read_table error in Python3.7: pyarrow.lib.ArrowInvalid: Column data >

[jira] [Updated] (ARROW-6719) Parquet read_table error in Python3.7: pyarrow.lib.ArrowInvalid: Column data for field with type list<...> is inconsistent with schema list<...>

2019-10-15 Thread V Luong (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] V Luong updated ARROW-6719: --- Attachment: read-fail.snappy.parquet > Parquet read_table error in Python3.7: pyarrow.lib.ArrowInvalid:

[jira] [Updated] (ARROW-6719) Parquet read_table error in Python3.7: pyarrow.lib.ArrowInvalid: Column data for field with type list<...> is inconsistent with schema list<...>

2019-10-15 Thread V Luong (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] V Luong updated ARROW-6719: --- Affects Version/s: (was: 0.14.1) > Parquet read_table error in Python3.7: pyarrow.lib.ArrowInvalid:

[jira] [Reopened] (ARROW-6719) Parquet read_table error in Python3.7: pyarrow.lib.ArrowInvalid: Column data for field with type list<...> is inconsistent with schema list<...>

2019-10-15 Thread V Luong (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] V Luong reopened ARROW-6719: I am encountering this issue in PyArrow 0.15.0 again > Parquet read_table error in Python3.7:

[jira] [Commented] (ARROW-5454) [C++] Implement Take on ChunkedArray for DataFrame use

2019-10-15 Thread Artem KOZHEVNIKOV (Jira)
[ https://issues.apache.org/jira/browse/ARROW-5454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951704#comment-16951704 ] Artem KOZHEVNIKOV commented on ARROW-5454: -- [~wesm], could you have a look on this ? a part a

[jira] [Comment Edited] (ARROW-5454) [C++] Implement Take on ChunkedArray for DataFrame use

2019-10-15 Thread Artem KOZHEVNIKOV (Jira)
[ https://issues.apache.org/jira/browse/ARROW-5454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951704#comment-16951704 ] Artem KOZHEVNIKOV edited comment on ARROW-5454 at 10/15/19 8:09 AM:

[jira] [Closed] (ARROW-5399) [Rust] [Testing] Add IPC test files to arrow-testing

2019-10-15 Thread Neville Dipale (Jira)
[ https://issues.apache.org/jira/browse/ARROW-5399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neville Dipale closed ARROW-5399. - Resolution: Workaround Going to reuse the files used for integration tests > [Rust] [Testing]

[jira] [Commented] (ARROW-6650) [Rust] [Integration] Create methods to test Arrow files against Integration JSON

2019-10-15 Thread Neville Dipale (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951651#comment-16951651 ] Neville Dipale commented on ARROW-6650: --- I initially tried to create a `to_json()` function from

[jira] [Updated] (ARROW-6650) [Rust] [Integration] Create methods to test Arrow files against Integration JSON

2019-10-15 Thread Neville Dipale (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neville Dipale updated ARROW-6650: -- Summary: [Rust] [Integration] Create methods to test Arrow files against Integration JSON

[jira] [Commented] (ARROW-6887) [Java] Create prose documentation for using ValueVectors

2019-10-15 Thread Ji Liu (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951647#comment-16951647 ] Ji Liu commented on ARROW-6887: --- Where should we place the documentation? > [Java] Create prose

[jira] [Commented] (ARROW-2892) [Plasma] Implement interface to get Java arrow objects from Plasma

2019-10-15 Thread Ji Liu (Jira)
[ https://issues.apache.org/jira/browse/ARROW-2892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951637#comment-16951637 ] Ji Liu commented on ARROW-2892: --- [~emkornfi...@gmail.com] I'll take a close watch later. > [Plasma]

[jira] [Commented] (ARROW-2892) [Plasma] Implement interface to get Java arrow objects from Plasma

2019-10-15 Thread Micah Kornfield (Jira)
[ https://issues.apache.org/jira/browse/ARROW-2892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951635#comment-16951635 ] Micah Kornfield commented on ARROW-2892: [~tianchen92] not sure if this is of interest to you? >

[jira] [Updated] (ARROW-6887) [Java] Create prose documentation for using ValueVectors

2019-10-15 Thread Micah Kornfield (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Kornfield updated ARROW-6887: --- Description: We should create documentation (in restructured text) for the library that