[jira] [Assigned] (ARROW-8392) [Java] Fix overflow related corner cases for vector value comparison

2020-04-09 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liya Fan reassigned ARROW-8392: --- Assignee: Liya Fan > [Java] Fix overflow related corner cases for vector value comparison >

[jira] [Commented] (ARROW-8392) [Java] Fix overflow related corner cases for vector value comparison

2020-04-09 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17080218#comment-17080218 ] Liya Fan commented on ARROW-8392: - Hi Martin Janda, do you want to provide a patch for this issue? >

[jira] [Created] (ARROW-8392) [Java] Fix overflow related corner cases for vector value comparison

2020-04-09 Thread Liya Fan (Jira)
Liya Fan created ARROW-8392: --- Summary: [Java] Fix overflow related corner cases for vector value comparison Key: ARROW-8392 URL: https://issues.apache.org/jira/browse/ARROW-8392 Project: Apache Arrow

[jira] [Updated] (ARROW-7965) [Python] Refine higher level dataset API

2020-04-09 Thread Krisztian Szucs (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Szucs updated ARROW-7965: --- Summary: [Python] Refine higher level dataset API (was: [Python] Hold a reference to the

[jira] [Created] (ARROW-8391) [C++] Implement row range read API for IPC file (and Feather)

2020-04-09 Thread Wes McKinney (Jira)
Wes McKinney created ARROW-8391: --- Summary: [C++] Implement row range read API for IPC file (and Feather) Key: ARROW-8391 URL: https://issues.apache.org/jira/browse/ARROW-8391 Project: Apache Arrow

[jira] [Resolved] (ARROW-8335) [Release] Add crossbow jobs to run release verification

2020-04-09 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-8335. - Fix Version/s: (was: 1.0.0) 0.17.0 Resolution: Fixed Issue

[jira] [Resolved] (ARROW-6510) [Python][Filesystem] Expose nanosecond resolution mtime

2020-04-09 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-6510. - Fix Version/s: (was: 1.0.0) 0.17.0 Resolution: Fixed Issue

[jira] [Resolved] (ARROW-8389) [Integration] Run tests in parallel

2020-04-09 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson resolved ARROW-8389. Fix Version/s: 0.17.0 Resolution: Fixed Issue resolved by pull request 6888

[jira] [Updated] (ARROW-8390) [R] Expose schema unification features

2020-04-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-8390: -- Labels: pull-request-available (was: ) > [R] Expose schema unification features >

[jira] [Created] (ARROW-8390) [R] Expose schema unification features

2020-04-09 Thread Neal Richardson (Jira)
Neal Richardson created ARROW-8390: -- Summary: [R] Expose schema unification features Key: ARROW-8390 URL: https://issues.apache.org/jira/browse/ARROW-8390 Project: Apache Arrow Issue Type:

[jira] [Resolved] (ARROW-6823) [C++][Python][R] Support metadata in the feather format?

2020-04-09 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-6823. - Fix Version/s: 0.17.0 Assignee: Wes McKinney Resolution: Fixed Yes, this is done

[jira] [Updated] (ARROW-8386) [Python] pyarrow.jvm raises error for empty Arrays

2020-04-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-8386: -- Labels: pull-request-available (was: ) > [Python] pyarrow.jvm raises error for empty Arrays >

[jira] [Updated] (ARROW-6783) [C++] Provide API for IPC roundtrip of RecordBatches not using the encapsulated message format

2020-04-09 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-6783: Description: Much of our IPC code presumes the use of the encapsulated message format. At some

[jira] [Updated] (ARROW-6783) [C++] Provide API for IPC reconstruction of RecordBatches not originating from encapsulated message format

2020-04-09 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-6783: Description: Much of our IPC code presumes the use of the encapsulated message format. (was: A

[jira] [Updated] (ARROW-6783) [C++] Provide API for IPC roundtrip of RecordBatches not using the encapsulated message format

2020-04-09 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-6783: Summary: [C++] Provide API for IPC roundtrip of RecordBatches not using the encapsulated message

[jira] [Updated] (ARROW-6783) [C++] Provide API for IPC reconstruction of RecordBatches not originating from encapsulated message format

2020-04-09 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-6783: Summary: [C++] Provide API for IPC reconstruction of RecordBatches not originating from

[jira] [Commented] (ARROW-6783) [C++] Provide API for reconstruction of RecordBatch from Flatbuffer containing process memory addresses instead of relative offsets into an IPC message

2020-04-09 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17080059#comment-17080059 ] Wes McKinney commented on ARROW-6783: - I removed it from the 1.0.0 milestone. I agree that the C

[jira] [Updated] (ARROW-6783) [C++] Provide API for reconstruction of RecordBatch from Flatbuffer containing process memory addresses instead of relative offsets into an IPC message

2020-04-09 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-6783: Fix Version/s: (was: 1.0.0) > [C++] Provide API for reconstruction of RecordBatch from

[jira] [Closed] (ARROW-7840) [Java] [Integration] Java executables fail

2020-04-09 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou closed ARROW-7840. - Resolution: Cannot Reproduce > [Java] [Integration] Java executables fail >

[jira] [Commented] (ARROW-7840) [Java] [Integration] Java executables fail

2020-04-09 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17080047#comment-17080047 ] Antoine Pitrou commented on ARROW-7840: --- I haven't seen this in a long time. I probably had a stale

[jira] [Updated] (ARROW-8389) [Integration] Run tests in parallel

2020-04-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-8389: -- Labels: pull-request-available (was: ) > [Integration] Run tests in parallel >

[jira] [Assigned] (ARROW-8389) [Integration] Run tests in parallel

2020-04-09 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou reassigned ARROW-8389: - Assignee: Antoine Pitrou > [Integration] Run tests in parallel >

[jira] [Created] (ARROW-8389) [Integration] Run tests in parallel

2020-04-09 Thread Antoine Pitrou (Jira)
Antoine Pitrou created ARROW-8389: - Summary: [Integration] Run tests in parallel Key: ARROW-8389 URL: https://issues.apache.org/jira/browse/ARROW-8389 Project: Apache Arrow Issue Type:

[jira] [Resolved] (ARROW-7679) [R] Cleaner interface for creating UnionDataset

2020-04-09 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson resolved ARROW-7679. Resolution: Fixed Issue resolved by pull request 6887

[jira] [Resolved] (ARROW-8373) [GLib] Problems resolving gobject-introspection, arrow in Meson builds

2020-04-09 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson resolved ARROW-8373. Resolution: Fixed Issue resolved by pull request 6886

[jira] [Commented] (ARROW-1682) [Python] Add documentation / example for reading a directory of Parquet files on S3

2020-04-09 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-1682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17080038#comment-17080038 ] Antoine Pitrou commented on ARROW-1682: --- cc [~jorisvandenbossche] > [Python] Add documentation /

[jira] [Commented] (ARROW-5926) [Java] Test fuzzer inputs

2020-04-09 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-5926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17080037#comment-17080037 ] Antoine Pitrou commented on ARROW-5926: --- cc [~emkornfield] [~jacq...@dremio.com] Note the current

[jira] [Commented] (ARROW-6783) [C++] Provide API for reconstruction of RecordBatch from Flatbuffer containing process memory addresses instead of relative offsets into an IPC message

2020-04-09 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17080032#comment-17080032 ] Antoine Pitrou commented on ARROW-6783: --- What is the usefulness of this compared to the C data

[jira] [Commented] (ARROW-8382) [C++][Dataset] Refactor WritePlan to decouple from Fragment/Scan/Partition classes

2020-04-09 Thread Ben Kietzman (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17080021#comment-17080021 ] Ben Kietzman commented on ARROW-8382: - Decoupling paths and partition information seems worthwhile

[jira] [Updated] (ARROW-7679) [R] Cleaner interface for creating UnionDataset

2020-04-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-7679: -- Labels: pull-request-available (was: ) > [R] Cleaner interface for creating UnionDataset >

[jira] [Updated] (ARROW-7679) [R] Cleaner interface for creating UnionDataset

2020-04-09 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson updated ARROW-7679: --- Summary: [R] Cleaner interface for creating UnionDataset (was: [R] Purge unnecessary

[jira] [Updated] (ARROW-7679) [R] Cleaner interface for creating UnionDataset

2020-04-09 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson updated ARROW-7679: --- Fix Version/s: (was: 1.0.0) 0.17.0 > [R] Cleaner interface for

[jira] [Resolved] (ARROW-1907) [C++/Python] Feather format cannot accommodate string columns containing more than a total of 2GB of data

2020-04-09 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-1907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson resolved ARROW-1907. Fix Version/s: (was: 2.0.0) 0.17.0 Resolution: Fixed >

[jira] [Commented] (ARROW-6823) [C++][Python][R] Support metadata in the feather format?

2020-04-09 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17079994#comment-17079994 ] Neal Richardson commented on ARROW-6823: [~wesm] [~jorisvandenbossche] so is this resolved now by

[jira] [Updated] (ARROW-8382) [C++][Dataset] Refactor WritePlan to decouple from Fragment/Scan/Partition classes

2020-04-09 Thread Ben Kietzman (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Kietzman updated ARROW-8382: Description: WritePlan should look like the following. {code:c++} class ARROW_DS_EXPORT

[jira] [Updated] (ARROW-8373) [GLib] Problems resolving gobject-introspection, arrow in Meson builds

2020-04-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-8373: -- Labels: pull-request-available (was: ) > [GLib] Problems resolving gobject-introspection,

[jira] [Resolved] (ARROW-8376) [R] Add experimental interface to ScanTask/RecordBatch iterators

2020-04-09 Thread Francois Saint-Jacques (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Francois Saint-Jacques resolved ARROW-8376. --- Fix Version/s: 0.17.0 Resolution: Fixed Issue resolved by pull

[jira] [Created] (ARROW-8388) [C++] GCC 4.8 fails to move on return

2020-04-09 Thread Ben Kietzman (Jira)
Ben Kietzman created ARROW-8388: --- Summary: [C++] GCC 4.8 fails to move on return Key: ARROW-8388 URL: https://issues.apache.org/jira/browse/ARROW-8388 Project: Apache Arrow Issue Type: Bug

[jira] [Updated] (ARROW-8376) [R] Add experimental interface to ScanTask/RecordBatch iterators

2020-04-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-8376: -- Labels: pull-request-available (was: ) > [R] Add experimental interface to

[jira] [Updated] (ARROW-8387) [rust] Make schema_to_fb public

2020-04-09 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-8387: Summary: [rust] Make schema_to_fb public (was: [rust] Make schema_to_fb public because it is very

[jira] [Updated] (ARROW-8387) [Rust] Make schema_to_fb public

2020-04-09 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-8387: Component/s: Rust > [Rust] Make schema_to_fb public > --- > >

[jira] [Updated] (ARROW-8387) [Rust] Make schema_to_fb public

2020-04-09 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-8387: Summary: [Rust] Make schema_to_fb public (was: [rust] Make schema_to_fb public) > [Rust] Make

[jira] [Updated] (ARROW-8387) [rust] Make schema_to_fb public because it is very useful!

2020-04-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-8387: -- Labels: pull-request-available (was: ) > [rust] Make schema_to_fb public because it is very

[jira] [Created] (ARROW-8387) [rust] Make schema_to_fb public because it is very useful!

2020-04-09 Thread Max Burke (Jira)
Max Burke created ARROW-8387: Summary: [rust] Make schema_to_fb public because it is very useful! Key: ARROW-8387 URL: https://issues.apache.org/jira/browse/ARROW-8387 Project: Apache Arrow

[jira] [Updated] (ARROW-8360) [C++][Gandiva] Fixes date32 support for date/time functions

2020-04-09 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-8360: Summary: [C++][Gandiva] Fixes date32 support for date/time functions (was: Fixes date32 support

[jira] [Updated] (ARROW-8312) [Java][Gandiva] improve IN expression support

2020-04-09 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-8312: Summary: [Java][Gandiva] improve IN expression support (was: improve IN expression support) >

[jira] [Commented] (ARROW-1231) [C++] Add filesystem / IO implementation for Google Cloud Storage

2020-04-09 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-1231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17079627#comment-17079627 ] Antoine Pitrou commented on ARROW-1231: --- Looks like the Python GCS client is unusable for

[jira] [Commented] (ARROW-8359) [C++/Python] Enable aarch64/ppc64le build in conda recipes

2020-04-09 Thread Krisztian Szucs (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17079598#comment-17079598 ] Krisztian Szucs commented on ARROW-8359: For travis we do, not yet for drone. Does drone provide

[jira] [Comment Edited] (ARROW-8359) [C++/Python] Enable aarch64/ppc64le build in conda recipes

2020-04-09 Thread Krisztian Szucs (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17079598#comment-17079598 ] Krisztian Szucs edited comment on ARROW-8359 at 4/9/20, 5:36 PM: - [~uwe]

[jira] [Assigned] (ARROW-7794) [Rust] cargo publish fails for arrow-flight due to relative path to Flight.proto

2020-04-09 Thread Krisztian Szucs (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Szucs reassigned ARROW-7794: -- Assignee: Andy Grove (was: Krisztian Szucs) > [Rust] cargo publish fails for

[jira] [Assigned] (ARROW-7794) [Rust] cargo publish fails for arrow-flight due to relative path to Flight.proto

2020-04-09 Thread Krisztian Szucs (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Szucs reassigned ARROW-7794: -- Assignee: Krisztian Szucs (was: Andy Grove) > [Rust] cargo publish fails for

[jira] [Updated] (ARROW-8065) [C++][Dataset] Untangle Dataset, Fragment and ScanOptions

2020-04-09 Thread Francois Saint-Jacques (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Francois Saint-Jacques updated ARROW-8065: -- Description: Currently: a fragment is a product of a scan; it is a lazy

[jira] [Created] (ARROW-8386) [Python] pyarrow.jvm raises error for empty Arrays

2020-04-09 Thread Bryan Cutler (Jira)
Bryan Cutler created ARROW-8386: --- Summary: [Python] pyarrow.jvm raises error for empty Arrays Key: ARROW-8386 URL: https://issues.apache.org/jira/browse/ARROW-8386 Project: Apache Arrow Issue

[jira] [Assigned] (ARROW-1231) [C++] Add filesystem / IO implementation for Google Cloud Storage

2020-04-09 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-1231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou reassigned ARROW-1231: - Assignee: Antoine Pitrou > [C++] Add filesystem / IO implementation for Google Cloud

[jira] [Resolved] (ARROW-7336) [C++] Implement MinMax options to not skip nulls

2020-04-09 Thread Ben Kietzman (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Kietzman resolved ARROW-7336. - Fix Version/s: 0.17.0 Resolution: Fixed Issue resolved by pull request 5981

[jira] [Commented] (ARROW-8385) [Python][Parquet] Crash on parquet.read_table on windows python 3.82

2020-04-09 Thread Geoff Quested-Joens (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17079516#comment-17079516 ] Geoff Quested-Joens commented on ARROW-8385: No problem anything I can help with, happy to do

[jira] [Commented] (ARROW-8385) [Python][Parquet] Crash on parquet.read_table on windows python 3.82

2020-04-09 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17079511#comment-17079511 ] Wes McKinney commented on ARROW-8385: - Thanks for the reproducer, will try to take a look before

[jira] [Updated] (ARROW-8385) Crash on parquet.read_table on windows python 3.82

2020-04-09 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-8385: Fix Version/s: 0.17.0 > Crash on parquet.read_table on windows python 3.82 >

[jira] [Updated] (ARROW-8385) [Python][Parquet] Crash on parquet.read_table on windows python 3.82

2020-04-09 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-8385: Summary: [Python][Parquet] Crash on parquet.read_table on windows python 3.82 (was: Crash on

[jira] [Created] (ARROW-8385) Crash on parquet.read_table on windows python 3.82

2020-04-09 Thread Geoff Quested-Joens (Jira)
Geoff Quested-Joens created ARROW-8385: -- Summary: Crash on parquet.read_table on windows python 3.82 Key: ARROW-8385 URL: https://issues.apache.org/jira/browse/ARROW-8385 Project: Apache Arrow

[jira] [Commented] (ARROW-8384) [C++][Python] arrow/filesystem/hdfs.h and Python wrapper does not have an option for setting a path to a Kerberos ticket

2020-04-09 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17079493#comment-17079493 ] Wes McKinney commented on ARROW-8384: - At minimum what's in {{HdfsConnectionConfig}} needs to be

[jira] [Commented] (ARROW-8384) [C++][Python] arrow/filesystem/hdfs.h and Python wrapper does not have an option for setting a path to a Kerberos ticket

2020-04-09 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17079484#comment-17079484 ] Antoine Pitrou commented on ARROW-8384: --- That should be easy to re-add. Do you have a list of the

[jira] [Resolved] (ARROW-8164) [C++][Dataset] Let datasets be viewable with non-identical schema

2020-04-09 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson resolved ARROW-8164. Resolution: Fixed Issue resolved by pull request 6721

[jira] [Created] (ARROW-8384) [C++][Python] arrow/filesystem/hdfs.h and Python wrapper does not have an option for setting a path to a Kerberos ticket

2020-04-09 Thread Wes McKinney (Jira)
Wes McKinney created ARROW-8384: --- Summary: [C++][Python] arrow/filesystem/hdfs.h and Python wrapper does not have an option for setting a path to a Kerberos ticket Key: ARROW-8384 URL:

[jira] [Assigned] (ARROW-8380) [RUST] StringDictionaryBuilder not publicly exported from arrow::array

2020-04-09 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson reassigned ARROW-8380: -- Assignee: Jörn Horstmann > [RUST] StringDictionaryBuilder not publicly exported from

[jira] [Resolved] (ARROW-8380) [RUST] StringDictionaryBuilder not publicly exported from arrow::array

2020-04-09 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson resolved ARROW-8380. Fix Version/s: 0.17.0 Resolution: Fixed Issue resolved by pull request 6881

[jira] [Resolved] (ARROW-7233) [C++] Add Result APIs to IPC module

2020-04-09 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou resolved ARROW-7233. --- Resolution: Fixed Issue resolved by pull request 6867

[jira] [Closed] (ARROW-8378) [Python] "empty" dtype metadata leads to wrong Parquet column type

2020-04-09 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney closed ARROW-8378. --- Resolution: Not A Problem What [~jorisvandenbossche] wrote is right -- I missed that

[jira] [Comment Edited] (ARROW-8378) [Python] "empty" dtype metadata leads to wrong Parquet column type

2020-04-09 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17078813#comment-17078813 ] Wes McKinney edited comment on ARROW-8378 at 4/9/20, 2:36 PM: -- I'm showing

[jira] [Created] (ARROW-8383) [RUST] Easier random access to DictionaryArray keys and values

2020-04-09 Thread Jira
Jörn Horstmann created ARROW-8383: - Summary: [RUST] Easier random access to DictionaryArray keys and values Key: ARROW-8383 URL: https://issues.apache.org/jira/browse/ARROW-8383 Project: Apache Arrow

[jira] [Comment Edited] (ARROW-8364) [Python] Get Access to the type_to_type_id dictionary

2020-04-09 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17079392#comment-17079392 ] Joris Van den Bossche edited comment on ARROW-8364 at 4/9/20, 2:35 PM:

[jira] [Commented] (ARROW-8364) [Python] Get Access to the type_to_type_id dictionary

2020-04-09 Thread Or (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17079392#comment-17079392 ] Or commented on ARROW-8364: --- Of course,   The code is [here|https://codeshare.io/G8d0Pe] > [Python] Get

[jira] [Updated] (ARROW-8382) [C++][Dataset] Refactor WritePlan to decouple from Fragment/Scan/Partition classes

2020-04-09 Thread Francois Saint-Jacques (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Francois Saint-Jacques updated ARROW-8382: -- Description: WritePlan should look like the following. {code:c++} class

[jira] [Updated] (ARROW-8382) [C++][Dataset] Refactor WritePlan to decouple from Fragment/Scan/Partition classes

2020-04-09 Thread Francois Saint-Jacques (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Francois Saint-Jacques updated ARROW-8382: -- Description: WritePlan should look like the following. {code:c++} class

[jira] [Updated] (ARROW-8382) [C++][Dataset] Refactor WritePlan to decouple from Fragment/Scan/Partition classes

2020-04-09 Thread Francois Saint-Jacques (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Francois Saint-Jacques updated ARROW-8382: -- Component/s: C++ - Dataset > [C++][Dataset] Refactor WritePlan to decouple

[jira] [Updated] (ARROW-8382) [C++][Dataset] Refactor WritePlan to decouple from Fragment/Scan/Partition classes

2020-04-09 Thread Francois Saint-Jacques (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Francois Saint-Jacques updated ARROW-8382: -- Description: WritePlan should look like the following. {code:c++} class

[jira] [Comment Edited] (ARROW-7584) [Python] Improve ergonomics of new FileSystem API

2020-04-09 Thread Jira
[ https://issues.apache.org/jira/browse/ARROW-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17079373#comment-17079373 ] Fabian Höring edited comment on ARROW-7584 at 4/9/20, 2:07 PM: --- I abandoned

[jira] [Created] (ARROW-8382) [C++][Dataset] Refactor WritePlan to decouple from Fragment/Scan/Partition classes

2020-04-09 Thread Francois Saint-Jacques (Jira)
Francois Saint-Jacques created ARROW-8382: - Summary: [C++][Dataset] Refactor WritePlan to decouple from Fragment/Scan/Partition classes Key: ARROW-8382 URL:

[jira] [Commented] (ARROW-7584) [Python] Improve ergonomics of new FileSystem API

2020-04-09 Thread Jira
[ https://issues.apache.org/jira/browse/ARROW-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17079373#comment-17079373 ] Fabian Höring commented on ARROW-7584: -- I abandoned the idea if changing the new fs implementation,

[jira] [Assigned] (ARROW-7584) [Python] Improve ergonomics of new FileSystem API

2020-04-09 Thread Jira
[ https://issues.apache.org/jira/browse/ARROW-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Höring reassigned ARROW-7584: Assignee: (was: Fabian Höring) > [Python] Improve ergonomics of new FileSystem API >

[jira] [Resolved] (ARROW-8039) [Python][Dataset] Support using dataset API in pyarrow.parquet with a minimal ParquetDataset shim

2020-04-09 Thread Ben Kietzman (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Kietzman resolved ARROW-8039. - Resolution: Fixed Issue resolved by pull request 6303

[jira] [Closed] (ARROW-7669) [CI] [C++] Turn optimizations off on AppVeyor

2020-04-09 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou closed ARROW-7669. - Resolution: Abandoned Should not be a problem anymore now that we've moved R and MinGW builds to

[jira] [Commented] (ARROW-3134) [C++] Implement n-ary iterator for a collection of chunked arrays with possibly different chunking layouts

2020-04-09 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-3134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17079352#comment-17079352 ] Wes McKinney commented on ARROW-3134: - Yeah, at some point we'll need to implement an n-ary version

[jira] [Commented] (ARROW-8364) [Python] Get Access to the type_to_type_id dictionary

2020-04-09 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17079301#comment-17079301 ] Joris Van den Bossche commented on ARROW-8364: -- [~archybald] can you give a concrete code

[jira] [Commented] (ARROW-8378) [Python] "empty" dtype metadata leads to wrong Parquet column type

2020-04-09 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17079297#comment-17079297 ] Joris Van den Bossche commented on ARROW-8378: -- [~yiannisliodakis] I think the "bug" lies in

[jira] [Created] (ARROW-8381) [C++][Dataset] Dataset writing should require a writer schema

2020-04-09 Thread Francois Saint-Jacques (Jira)
Francois Saint-Jacques created ARROW-8381: - Summary: [C++][Dataset] Dataset writing should require a writer schema Key: ARROW-8381 URL: https://issues.apache.org/jira/browse/ARROW-8381

[jira] [Updated] (ARROW-6510) [Python][Filesystem] Expose nanosecond resolution mtime

2020-04-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-6510: -- Labels: pull-request-available (was: ) > [Python][Filesystem] Expose nanosecond resolution

[jira] [Assigned] (ARROW-6510) [Python][Filesystem] Expose nanosecond resolution mtime

2020-04-09 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou reassigned ARROW-6510: - Assignee: Antoine Pitrou > [Python][Filesystem] Expose nanosecond resolution mtime >

[jira] [Commented] (ARROW-3134) [C++] Implement n-ary iterator for a collection of chunked arrays with possibly different chunking layouts

2020-04-09 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-3134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17079161#comment-17079161 ] Antoine Pitrou commented on ARROW-3134: --- Not n-ary, but we have {{ApplyBinaryChunked}} now. >

[jira] [Updated] (ARROW-8380) [RUST] StringDictionaryBuilder not publicly exported from arrow::array

2020-04-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-8380: -- Labels: pull-request-available (was: ) > [RUST] StringDictionaryBuilder not publicly exported

[jira] [Created] (ARROW-8380) [RUST] StringDictionaryBuilder not publicly exported from arrow::array

2020-04-09 Thread Jira
Jörn Horstmann created ARROW-8380: - Summary: [RUST] StringDictionaryBuilder not publicly exported from arrow::array Key: ARROW-8380 URL: https://issues.apache.org/jira/browse/ARROW-8380 Project: