[jira] [Created] (ARROW-8771) [C++] Add boost/process library to build support

2020-05-11 Thread Liya Fan (Jira)
Liya Fan created ARROW-8771: --- Summary: [C++] Add boost/process library to build support Key: ARROW-8771 URL: https://issues.apache.org/jira/browse/ARROW-8771 Project: Apache Arrow Issue Type:

[jira] [Created] (ARROW-8770) [C++][CI] enable arrow-csv-test on s390x

2020-05-11 Thread Kazuaki Ishizaki (Jira)
Kazuaki Ishizaki created ARROW-8770: --- Summary: [C++][CI] enable arrow-csv-test on s390x Key: ARROW-8770 URL: https://issues.apache.org/jira/browse/ARROW-8770 Project: Apache Arrow Issue

[jira] [Created] (ARROW-8769) [C++] Add convenience methods to access fields by name in StructScalar

2020-05-11 Thread Wes McKinney (Jira)
Wes McKinney created ARROW-8769: --- Summary: [C++] Add convenience methods to access fields by name in StructScalar Key: ARROW-8769 URL: https://issues.apache.org/jira/browse/ARROW-8769 Project: Apache

[jira] [Updated] (ARROW-8760) [C++] Add benchmarks for arrow/util/rle_encoder.h for non-dictionary encodings.

2020-05-11 Thread Kouhei Sutou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kouhei Sutou updated ARROW-8760: Summary: [C++] Add benchmarks for arrow/util/rle_encoder.h for non-dictionary encodings. (was:

[jira] [Created] (ARROW-8768) [R][CI] Fix nightly as-cran spurious failure

2020-05-11 Thread Neal Richardson (Jira)
Neal Richardson created ARROW-8768: -- Summary: [R][CI] Fix nightly as-cran spurious failure Key: ARROW-8768 URL: https://issues.apache.org/jira/browse/ARROW-8768 Project: Apache Arrow Issue

[jira] [Updated] (ARROW-8667) [C++] Add multi-consumer Scheduler API to sit one layer above ThreadPool

2020-05-11 Thread Francois Saint-Jacques (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Francois Saint-Jacques updated ARROW-8667: -- Description: I believe we should define an abstraction to allow for custom

[jira] [Commented] (ARROW-8748) [R] Implementing methodes for combining arrow tabels using dplyr::bind_rows and dplyr::bind_cols

2020-05-11 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104730#comment-17104730 ] Neal Richardson commented on ARROW-8748: We could add methods to concatenate Tables in Arrow

[jira] [Updated] (ARROW-8748) [R] Implementing methodes for combining arrow tabels using dplyr::bind_rows and dplyr::bind_cols

2020-05-11 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson updated ARROW-8748: --- Labels: features performance (was: features performance pull-request-available) > [R]

[jira] [Assigned] (ARROW-8750) [Python] pyarrow.feather.write_feather does not default to lz4 compression if it's available

2020-05-11 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney reassigned ARROW-8750: --- Assignee: Wes McKinney > [Python] pyarrow.feather.write_feather does not default to lz4

[jira] [Updated] (ARROW-8549) [R] Assorted post-0.17 release cleanups

2020-05-11 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson updated ARROW-8549: --- Fix Version/s: 0.17.1 > [R] Assorted post-0.17 release cleanups >

[jira] [Updated] (ARROW-8699) [R] Fix automatic r_to_py conversion

2020-05-11 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson updated ARROW-8699: --- Fix Version/s: 0.17.1 > [R] Fix automatic r_to_py conversion >

[jira] [Updated] (ARROW-8741) [Python][Packaging] Keep VS2015 with bundled dependencies for the windows wheels

2020-05-11 Thread Krisztian Szucs (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Szucs updated ARROW-8741: --- Issue Type: Bug (was: Improvement) > [Python][Packaging] Keep VS2015 with bundled

[jira] [Updated] (ARROW-8609) [C++] ORC JNI bridge crashed on null arrow buffer

2020-05-11 Thread Krisztian Szucs (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Szucs updated ARROW-8609: --- Fix Version/s: 0.17.1 > [C++] ORC JNI bridge crashed on null arrow buffer >

[jira] [Updated] (ARROW-8584) [Packaging][C++] Protobuf link error in deb builds

2020-05-11 Thread Krisztian Szucs (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Szucs updated ARROW-8584: --- Fix Version/s: 0.17.1 > [Packaging][C++] Protobuf link error in deb builds >

[jira] [Updated] (ARROW-8503) [Packaging][deb] Can't build apache-arrow-archive-keyring for RC

2020-05-11 Thread Krisztian Szucs (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Szucs updated ARROW-8503: --- Fix Version/s: 0.17.1 > [Packaging][deb] Can't build apache-arrow-archive-keyring for RC >

[jira] [Updated] (ARROW-8501) [Packaging][RPM] Upgrade devtoolset to 8 on CentOS 6

2020-05-11 Thread Krisztian Szucs (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Szucs updated ARROW-8501: --- Fix Version/s: 0.17.1 > [Packaging][RPM] Upgrade devtoolset to 8 on CentOS 6 >

[jira] [Resolved] (ARROW-8758) [R] Updates for compatibility with dplyr 1.0

2020-05-11 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson resolved ARROW-8758. Resolution: Fixed Issue resolved by pull request 7147

[jira] [Commented] (ARROW-555) [C++] String algorithm library for StringArray/BinaryArray

2020-05-11 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104685#comment-17104685 ] Wes McKinney commented on ARROW-555: Having ASCII versions of functions sounds fine to me. There is a

[jira] [Updated] (ARROW-8726) [R][Dataset] segfault with a mis-specified partition

2020-05-11 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson updated ARROW-8726: --- Fix Version/s: (was: 0.17.1) > [R][Dataset] segfault with a mis-specified partition >

[jira] [Updated] (ARROW-8741) [Python][Packaging] Keep VS2015 with bundled dependencies for the windows wheels

2020-05-11 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson updated ARROW-8741: --- Fix Version/s: 1.0.0 > [Python][Packaging] Keep VS2015 with bundled dependencies for the

[jira] [Commented] (ARROW-555) [C++] String algorithm library for StringArray/BinaryArray

2020-05-11 Thread Maarten Breddels (Jira)
[ https://issues.apache.org/jira/browse/ARROW-555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104666#comment-17104666 ] Maarten Breddels commented on ARROW-555: Something to consider (or should I move this discussion

[jira] [Resolved] (ARROW-8745) [C++] Bitmap.ToString causes failures on a big-endian platform

2020-05-11 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou resolved ARROW-8745. --- Fix Version/s: 1.0.0 Resolution: Fixed Issue resolved by pull request 7134

[jira] [Resolved] (ARROW-8756) [C++] Bitmap word tests cause failures on a big-endian platform

2020-05-11 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou resolved ARROW-8756. --- Fix Version/s: 1.0.0 Resolution: Fixed Issue resolved by pull request 7145

[jira] [Assigned] (ARROW-8756) [C++] Bitmap word tests cause failures on a big-endian platform

2020-05-11 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou reassigned ARROW-8756: - Assignee: Kazuaki Ishizaki > [C++] Bitmap word tests cause failures on a big-endian

[jira] [Commented] (ARROW-8765) [C++] Design Scheduler API

2020-05-11 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104634#comment-17104634 ] Antoine Pitrou commented on ARROW-8765: --- This issue is more about a DAG of tasks. See draft design

[jira] [Commented] (ARROW-8765) [C++] Design Scheduler API

2020-05-11 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104625#comment-17104625 ] Wes McKinney commented on ARROW-8765: - Possibly a dup of ARROW-8667 > [C++] Design Scheduler API >

[jira] [Commented] (ARROW-8767) [C++] Make ThreadPool task ordering configurable

2020-05-11 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104623#comment-17104623 ] Wes McKinney commented on ARROW-8767: - I linked a couple of related issues. Whatever solution is

[jira] [Commented] (ARROW-8767) [C++] Make ThreadPool task ordering configurable

2020-05-11 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104610#comment-17104610 ] Antoine Pitrou commented on ARROW-8767: --- cc [~fsaintjacques] Possible API: {code:cpp} struct

[jira] [Created] (ARROW-8767) [C++] Make ThreadPool task ordering configurable

2020-05-11 Thread Antoine Pitrou (Jira)
Antoine Pitrou created ARROW-8767: - Summary: [C++] Make ThreadPool task ordering configurable Key: ARROW-8767 URL: https://issues.apache.org/jira/browse/ARROW-8767 Project: Apache Arrow

[jira] [Created] (ARROW-8766) [Python] A FileSystem implementation based on Python callbacks

2020-05-11 Thread Joris Van den Bossche (Jira)
Joris Van den Bossche created ARROW-8766: Summary: [Python] A FileSystem implementation based on Python callbacks Key: ARROW-8766 URL: https://issues.apache.org/jira/browse/ARROW-8766

[jira] [Commented] (ARROW-8765) [C++] Design Scheduler API

2020-05-11 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104559#comment-17104559 ] Antoine Pitrou commented on ARROW-8765: --- Should look at dask distributed for ideas and heuristics.

[jira] [Created] (ARROW-8765) [C++] Design Scheduler API

2020-05-11 Thread Antoine Pitrou (Jira)
Antoine Pitrou created ARROW-8765: - Summary: [C++] Design Scheduler API Key: ARROW-8765 URL: https://issues.apache.org/jira/browse/ARROW-8765 Project: Apache Arrow Issue Type: Improvement

[jira] [Commented] (ARROW-8765) [C++] Design Scheduler API

2020-05-11 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104551#comment-17104551 ] Antoine Pitrou commented on ARROW-8765: --- cc [~fsaintjacques] > [C++] Design Scheduler API >

[jira] [Created] (ARROW-8764) [C++] Make ThreadPool configurable in ReadRangeCache

2020-05-11 Thread Antoine Pitrou (Jira)
Antoine Pitrou created ARROW-8764: - Summary: [C++] Make ThreadPool configurable in ReadRangeCache Key: ARROW-8764 URL: https://issues.apache.org/jira/browse/ARROW-8764 Project: Apache Arrow

[jira] [Assigned] (ARROW-8763) [C++] Create RandomAccessFile::WillNeed-like API

2020-05-11 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou reassigned ARROW-8763: - Assignee: Antoine Pitrou > [C++] Create RandomAccessFile::WillNeed-like API >

[jira] [Created] (ARROW-8763) [C++] Create RandomAccessFile::WillNeed-like API

2020-05-11 Thread Antoine Pitrou (Jira)
Antoine Pitrou created ARROW-8763: - Summary: [C++] Create RandomAccessFile::WillNeed-like API Key: ARROW-8763 URL: https://issues.apache.org/jira/browse/ARROW-8763 Project: Apache Arrow

[jira] [Commented] (ARROW-555) [C++] String algorithm library for StringArray/BinaryArray

2020-05-11 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104530#comment-17104530 ] Wes McKinney commented on ARROW-555: Cool. I will circle back here once I have a PR up for the work I

[jira] [Commented] (ARROW-555) [C++] String algorithm library for StringArray/BinaryArray

2020-05-11 Thread Maarten Breddels (Jira)
[ https://issues.apache.org/jira/browse/ARROW-555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104525#comment-17104525 ] Maarten Breddels commented on ARROW-555: I am likely to be able to start working on strings in

[jira] [Created] (ARROW-8762) [C++][Gandiva] Replace Gandiva's BitmapAnd with common implementation

2020-05-11 Thread Wes McKinney (Jira)
Wes McKinney created ARROW-8762: --- Summary: [C++][Gandiva] Replace Gandiva's BitmapAnd with common implementation Key: ARROW-8762 URL: https://issues.apache.org/jira/browse/ARROW-8762 Project: Apache

[jira] [Resolved] (ARROW-4018) [C++] RLE decoder may not big-endian compatible

2020-05-11 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-4018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou resolved ARROW-4018. --- Fix Version/s: 1.0.0 Resolution: Fixed Issue resolved by pull request 7144

[jira] [Commented] (ARROW-555) [C++] String algorithm library for StringArray/BinaryArray

2020-05-11 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104443#comment-17104443 ] Wes McKinney commented on ARROW-555: Update: I'm in the middle of an overhaul of the API for

[jira] [Commented] (ARROW-7905) [Go][Parquet] Port the C++ Parquet implementation to Go

2020-05-11 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104426#comment-17104426 ] Wes McKinney commented on ARROW-7905: - We can discuss more on the mailing list, but keep in mind that

[jira] [Commented] (ARROW-8553) [C++] Reimplement BitmapAnd using Bitmap::VisitWords

2020-05-11 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104397#comment-17104397 ] Antoine Pitrou commented on ARROW-8553: --- (it can also be a bitmask parameter) > [C++] Reimplement

[jira] [Commented] (ARROW-8553) [C++] Reimplement BitmapAnd using Bitmap::VisitWords

2020-05-11 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104396#comment-17104396 ] Antoine Pitrou commented on ARROW-8553: --- I think it's fine to a "valid bits" parameter to the

[jira] [Assigned] (ARROW-8759) [C++] TestPlasmaSerialization.DeleteReply tests failure on big-endian platforms

2020-05-11 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou reassigned ARROW-8759: - Assignee: Kazuaki Ishizaki > [C++] TestPlasmaSerialization.DeleteReply tests failure on

[jira] [Resolved] (ARROW-8759) [C++] TestPlasmaSerialization.DeleteReply tests failure on big-endian platforms

2020-05-11 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou resolved ARROW-8759. --- Fix Version/s: 1.0.0 Resolution: Fixed Issue resolved by pull request 7148

[jira] [Updated] (ARROW-8761) [C++] Improve the performance of minmax kernel

2020-05-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-8761: -- Labels: pull-request-available (was: ) > [C++] Improve the performance of minmax kernel >

[jira] [Created] (ARROW-8761) [C++] Improve the performance of minmax kernel

2020-05-11 Thread Liya Fan (Jira)
Liya Fan created ARROW-8761: --- Summary: [C++] Improve the performance of minmax kernel Key: ARROW-8761 URL: https://issues.apache.org/jira/browse/ARROW-8761 Project: Apache Arrow Issue Type:

[jira] [Commented] (ARROW-5359) [Python] timestamp_as_object support for pa.Table.to_pandas in pyarrow

2020-05-11 Thread Tanguy Fautre (Jira)
[ https://issues.apache.org/jira/browse/ARROW-5359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104355#comment-17104355 ] Tanguy Fautre commented on ARROW-5359: -- I suspect this feature is needed to support Parquet files

[jira] [Resolved] (ARROW-8486) [C++] arrow-utility-test causes failures on a big-endian platform

2020-05-11 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou resolved ARROW-8486. --- Fix Version/s: 1.0.0 Resolution: Fixed Issue resolved by pull request 7136