[jira] [Resolved] (ARROW-10202) [CI][Windows] Use sf.net mirror for MSYS2

2020-10-07 Thread Kouhei Sutou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kouhei Sutou resolved ARROW-10202. -- Fix Version/s: 2.0.0 Resolution: Fixed Issue resolved by pull request 8373

[jira] [Created] (ARROW-10204) [RUST] [Datafusion] Test failure in aggregate_grouped_empty with simd feature enabled

2020-10-07 Thread Jira
Jörn Horstmann created ARROW-10204: -- Summary: [RUST] [Datafusion] Test failure in aggregate_grouped_empty with simd feature enabled Key: ARROW-10204 URL: https://issues.apache.org/jira/browse/ARROW-10204

[jira] [Resolved] (ARROW-10178) [CI] Fix spark master integration test build setup

2020-10-07 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche resolved ARROW-10178. --- Resolution: Fixed Issue resolved by pull request 8352

[jira] [Updated] (ARROW-10194) [Python] Array.to_numpy() with type fixed_size_list(int64(), 1) doesn't roundtrip for large integer values

2020-10-07 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche updated ARROW-10194: -- Labels: python-conversion (was: ) > [Python] Array.to_numpy() with type

[jira] [Updated] (ARROW-10209) [Python] support positional arguments for options in compute wrapper

2020-10-07 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou updated ARROW-10209: --- Fix Version/s: 3.0.0 > [Python] support positional arguments for options in compute wrapper

[jira] [Updated] (ARROW-10205) [Java][FlightRPC] Add client option to disable server verification

2020-10-07 Thread David Li (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Li updated ARROW-10205: - Component/s: Java FlightRPC > [Java][FlightRPC] Add client option to disable server

[jira] [Resolved] (ARROW-10205) [Java][FlightRPC] Add client option to disable server verification

2020-10-07 Thread David Li (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Li resolved ARROW-10205. -- Resolution: Fixed Issue resolved by pull request 8377 [https://github.com/apache/arrow/pull/8377] >

[jira] [Created] (ARROW-10214) [Python] UnicodeDecodeError when printing schema with binary metadata

2020-10-07 Thread Paul Balanca (Jira)
Paul Balanca created ARROW-10214: Summary: [Python] UnicodeDecodeError when printing schema with binary metadata Key: ARROW-10214 URL: https://issues.apache.org/jira/browse/ARROW-10214 Project:

[jira] [Commented] (ARROW-10211) [Python] Storing negative and positive zeros in dictionary array

2020-10-07 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209484#comment-17209484 ] Antoine Pitrou commented on ARROW-10211: What is {{validate_categories}}? Is it in PyArrow? >

[jira] [Commented] (ARROW-10183) Create a ForEach library function that runs on an iterator of futures

2020-10-07 Thread Weston Pace (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209498#comment-17209498 ] Weston Pace commented on ARROW-10183: - I had not quite come across that class so I appreciate the

[jira] [Updated] (ARROW-10183) Create a ForEach library function that runs on an iterator of futures

2020-10-07 Thread Weston Pace (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weston Pace updated ARROW-10183: Attachment: arrow-continuation-flow.jpg > Create a ForEach library function that runs on an

[jira] [Created] (ARROW-10208) [C++] comparing list arrays with nulls fails in test framework

2020-10-07 Thread Maarten Breddels (Jira)
Maarten Breddels created ARROW-10208: Summary: [C++] comparing list arrays with nulls fails in test framework Key: ARROW-10208 URL: https://issues.apache.org/jira/browse/ARROW-10208 Project:

[jira] [Commented] (ARROW-10211) [Python] Storing negative and positive zeros in dictionary array

2020-10-07 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209489#comment-17209489 ] Antoine Pitrou commented on ARROW-10211: Also, I have to ask: how often do people actually use

[jira] [Resolved] (ARROW-9943) [C++] Arrow metadata not applied recursively when reading Parquet file

2020-10-07 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou resolved ARROW-9943. --- Fix Version/s: 2.0.0 Resolution: Fixed Issue resolved by pull request 8366

[jira] [Commented] (ARROW-10134) [C++][Dataset] Add ParquetFileFragment::num_row_groups property

2020-10-07 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209505#comment-17209505 ] Joris Van den Bossche commented on ARROW-10134: --- For checking if it is a subselection of

[jira] [Updated] (ARROW-10213) [C++] Temporal cast from timestamp to date rounds instead of extracting date component

2020-10-07 Thread David Li (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Li updated ARROW-10213: - Description: I'd expect this code to give 1950-01-01 twice (i.e. a timestamp -> date cast extracts the

[jira] [Updated] (ARROW-10213) [C++] Temporal cast from timestamp to date rounds instead of extracting date component

2020-10-07 Thread David Li (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Li updated ARROW-10213: - Description: I'd expect this code to give 1950-01-01 twice (i.e. a timestamp -> date cast extracts the

[jira] [Created] (ARROW-10213) [C++] Temporal cast from timestamp to date rounds instead of extracting date component

2020-10-07 Thread David Li (Jira)
David Li created ARROW-10213: Summary: [C++] Temporal cast from timestamp to date rounds instead of extracting date component Key: ARROW-10213 URL: https://issues.apache.org/jira/browse/ARROW-10213

[jira] [Comment Edited] (ARROW-10197) [Gandiva][python] Execute expression on filtered data

2020-10-07 Thread Kirill Lykov (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209418#comment-17209418 ] Kirill Lykov edited comment on ARROW-10197 at 10/7/20, 1:06 PM: I fix

[jira] [Comment Edited] (ARROW-10197) [Gandiva][python] Execute expression on filtered data

2020-10-07 Thread Kirill Lykov (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209418#comment-17209418 ] Kirill Lykov edited comment on ARROW-10197 at 10/7/20, 1:22 PM: I fix

[jira] [Assigned] (ARROW-10206) [Python][C++][FlightRPC] Add client option to disable server validation

2020-10-07 Thread James Duong (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Duong reassigned ARROW-10206: --- Assignee: James Duong > [Python][C++][FlightRPC] Add client option to disable server

[jira] [Updated] (ARROW-10205) [Java][FlightRPC] Add client option to disable server verification

2020-10-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-10205: --- Labels: pull-request-available (was: ) > [Java][FlightRPC] Add client option to disable

[jira] [Updated] (ARROW-10206) [Python][C++][FlightRPC] Add client option to disable server validation

2020-10-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-10206: --- Labels: pull-request-available (was: ) > [Python][C++][FlightRPC] Add client option to

[jira] [Commented] (ARROW-10197) [Gandiva][python] Execute expression on filtered data

2020-10-07 Thread Kirill Lykov (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209418#comment-17209418 ] Kirill Lykov commented on ARROW-10197: -- Yeah, I found it and looks like fixed. Now I need to do a

[jira] [Commented] (ARROW-10208) [C++] comparing list arrays with nulls fails in test framework

2020-10-07 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209451#comment-17209451 ] Antoine Pitrou commented on ARROW-10208: Just thinking out loud, but it may be that the *types*

[jira] [Created] (ARROW-10210) [Python] Pandas roundtrip of timestamp array ignores time unit

2020-10-07 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-10210: --- Summary: [Python] Pandas roundtrip of timestamp array ignores time unit Key: ARROW-10210 URL: https://issues.apache.org/jira/browse/ARROW-10210 Project: Apache

[jira] [Created] (ARROW-10211) [Python] Storing negative and positive zeros in dictionary array

2020-10-07 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-10211: --- Summary: [Python] Storing negative and positive zeros in dictionary array Key: ARROW-10211 URL: https://issues.apache.org/jira/browse/ARROW-10211 Project:

[jira] [Created] (ARROW-10212) [Python] Generate union and extension typed arrays with hypothesis

2020-10-07 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-10212: --- Summary: [Python] Generate union and extension typed arrays with hypothesis Key: ARROW-10212 URL: https://issues.apache.org/jira/browse/ARROW-10212 Project:

[jira] [Created] (ARROW-10205) [Java][FlightRPC] Add client option to disable server verification

2020-10-07 Thread James Duong (Jira)
James Duong created ARROW-10205: --- Summary: [Java][FlightRPC] Add client option to disable server verification Key: ARROW-10205 URL: https://issues.apache.org/jira/browse/ARROW-10205 Project: Apache

[jira] [Assigned] (ARROW-10204) [RUST] [Datafusion] Test failure in aggregate_grouped_empty with simd feature enabled

2020-10-07 Thread Jira
[ https://issues.apache.org/jira/browse/ARROW-10204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jörn Horstmann reassigned ARROW-10204: -- Assignee: Jörn Horstmann > [RUST] [Datafusion] Test failure in

[jira] [Updated] (ARROW-9304) [C++] Add "AppendEmptyValue" builder APIs for use inside StructBuilder::AppendNull

2020-10-07 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou updated ARROW-9304: -- Fix Version/s: (was: 2.0.0) 3.0.0 > [C++] Add "AppendEmptyValue"

[jira] [Updated] (ARROW-9543) [C++] Simplify parsing/conversion utilities

2020-10-07 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou updated ARROW-9543: -- Fix Version/s: (was: 2.0.0) 3.0.0 > [C++] Simplify parsing/conversion

[jira] [Updated] (ARROW-10144) [Flight] Add support for using the TLS_SNI extension

2020-10-07 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou updated ARROW-10144: --- Fix Version/s: (was: 2.0.0) 3.0.0 > [Flight] Add support for using

[jira] [Updated] (ARROW-10144) [Flight] Add support for using the TLS_SNI extension

2020-10-07 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou updated ARROW-10144: --- Summary: [Flight] Add support for using the TLS_SNI extension (was: Add support for using

[jira] [Comment Edited] (ARROW-10211) [Python] Storing negative and positive zeros in dictionary array

2020-10-07 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209495#comment-17209495 ] Joris Van den Bossche edited comment on ARROW-10211 at 10/7/20, 11:50 AM:

[jira] [Commented] (ARROW-10211) [Python] Storing negative and positive zeros in dictionary array

2020-10-07 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209495#comment-17209495 ] Joris Van den Bossche commented on ARROW-10211: --- > If we treat 0 and -0 as equal, then the

[jira] [Created] (ARROW-10207) C++] Unary kernels that results in a list have no preallocated offset buffer

2020-10-07 Thread Maarten Breddels (Jira)
Maarten Breddels created ARROW-10207: Summary: C++] Unary kernels that results in a list have no preallocated offset buffer Key: ARROW-10207 URL: https://issues.apache.org/jira/browse/ARROW-10207

[jira] [Resolved] (ARROW-9147) [C++][Dataset] Support null -> other type promotion in Dataset scanning

2020-10-07 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou resolved ARROW-9147. --- Resolution: Fixed Issue resolved by pull request 8343

[jira] [Commented] (ARROW-10211) [Python] Storing negative and positive zeros in dictionary array

2020-10-07 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209487#comment-17209487 ] Joris Van den Bossche commented on ARROW-10211: --- Another place where this comes up (which

[jira] [Commented] (ARROW-10211) [Python] Storing negative and positive zeros in dictionary array

2020-10-07 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209488#comment-17209488 ] Antoine Pitrou commented on ARROW-10211: If we treat 0 and -0 as equal, then the categorization

[jira] [Commented] (ARROW-10211) [Python] Storing negative and positive zeros in dictionary array

2020-10-07 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209499#comment-17209499 ] Joris Van den Bossche commented on ARROW-10211: --- > Conversely, I would expect

[jira] [Created] (ARROW-10206) [Python][C++][FlightRPC] Add client option to disable server validation

2020-10-07 Thread James Duong (Jira)
James Duong created ARROW-10206: --- Summary: [Python][C++][FlightRPC] Add client option to disable server validation Key: ARROW-10206 URL: https://issues.apache.org/jira/browse/ARROW-10206 Project:

[jira] [Created] (ARROW-10209) [Python] support positional arguments for options in compute wrapper

2020-10-07 Thread Maarten Breddels (Jira)
Maarten Breddels created ARROW-10209: Summary: [Python] support positional arguments for options in compute wrapper Key: ARROW-10209 URL: https://issues.apache.org/jira/browse/ARROW-10209

[jira] [Commented] (ARROW-10211) [Python] Storing negative and positive zeros in dictionary array

2020-10-07 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209497#comment-17209497 ] Antoine Pitrou commented on ARROW-10211: Well, sure, they are equal, but they are not the same.

[jira] [Updated] (ARROW-10204) [RUST] [Datafusion] Test failure in aggregate_grouped_empty with simd feature enabled

2020-10-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-10204: --- Labels: pull-request-available (was: ) > [RUST] [Datafusion] Test failure in

[jira] [Commented] (ARROW-10207) C++] Unary kernels that results in a list have no preallocated offset buffer

2020-10-07 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209420#comment-17209420 ] Antoine Pitrou commented on ARROW-10207: [~wesm] What do you think? > C++] Unary kernels that

[jira] [Updated] (ARROW-10207) C++] Unary kernels that results in a list have no preallocated offset buffer

2020-10-07 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou updated ARROW-10207: --- Component/s: C++ > C++] Unary kernels that results in a list have no preallocated offset

[jira] [Resolved] (ARROW-10151) [Python] Add support MapArray to_pandas conversion

2020-10-07 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou resolved ARROW-10151. Resolution: Fixed Issue resolved by pull request 8337

[jira] [Updated] (ARROW-10207) C++] Unary kernels that results in a list have no preallocated offset buffer

2020-10-07 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou updated ARROW-10207: --- Fix Version/s: 3.0.0 > C++] Unary kernels that results in a list have no preallocated

[jira] [Commented] (ARROW-10211) [Python] Storing negative and positive zeros in dictionary array

2020-10-07 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209486#comment-17209486 ] Joris Van den Bossche commented on ARROW-10211: --- No, it's code from pandas, but the code

[jira] [Issue Comment Deleted] (ARROW-10197) [Gandiva][python] Execute expression on filtered data

2020-10-07 Thread Kirill Lykov (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Lykov updated ARROW-10197: - Comment: was deleted (was: I fix that and I see the code compiling but I get problems runtime:

[jira] [Commented] (ARROW-10197) [Gandiva][python] Execute expression on filtered data

2020-10-07 Thread Kirill Lykov (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209584#comment-17209584 ] Kirill Lykov commented on ARROW-10197: -- Looks like I will soon manage to fix the thing but I can

[jira] [Resolved] (ARROW-10093) [R] Add ability to opt-out of int64 -> int demotion

2020-10-07 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson resolved ARROW-10093. - Fix Version/s: 2.0.0 Resolution: Fixed Issue resolved by pull request 8341

[jira] [Resolved] (ARROW-10030) [Rust] Support fromIter and toIter

2020-10-07 Thread Jira
[ https://issues.apache.org/jira/browse/ARROW-10030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jorge Leitão resolved ARROW-10030. -- Fix Version/s: 2.0.0 Resolution: Fixed Issue resolved by pull request 8211

[jira] [Commented] (ARROW-9974) [Python][C++] pyarrow version 1.0.1 throws Out Of Memory exception while reading large number of files using ParquetDataset

2020-10-07 Thread Ashish Gupta (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209705#comment-17209705 ] Ashish Gupta commented on ARROW-9974: - Tried... export MALLOC_MMAP_THRESHOLD_=65536 same error

[jira] [Commented] (ARROW-5244) [C++] Review experimental / unstable APIs

2020-10-07 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-5244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209601#comment-17209601 ] Antoine Pitrou commented on ARROW-5244: --- The only thing that stands out is the Scalar API. I think

[jira] [Commented] (ARROW-10214) [Python] UnicodeDecodeError when printing schema with binary metadata

2020-10-07 Thread Paul Balanca (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209614#comment-17209614 ] Paul Balanca commented on ARROW-10214: -- That was fast! Thanks, amazing support :) > [Python]

[jira] [Commented] (ARROW-10100) [C++][Dataset] Ability to read/subset a ParquetFileFragment with given set of row group ids

2020-10-07 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209624#comment-17209624 ] Joris Van den Bossche commented on ARROW-10100: --- [~bkietz] thoughts on the return value

[jira] [Resolved] (ARROW-10181) [Rust] Arrow tests fail to compile on Raspberry Pi (32 bit)

2020-10-07 Thread Jira
[ https://issues.apache.org/jira/browse/ARROW-10181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jorge Leitão resolved ARROW-10181. -- Resolution: Fixed Issue resolved by pull request 8353

[jira] [Created] (ARROW-10216) [Rust] Simd implementation of min/max aggregation kernels for primitive types

2020-10-07 Thread Jira
Jörn Horstmann created ARROW-10216: -- Summary: [Rust] Simd implementation of min/max aggregation kernels for primitive types Key: ARROW-10216 URL: https://issues.apache.org/jira/browse/ARROW-10216

[jira] [Created] (ARROW-10217) [CI] Run fewer GitHub Actions jobs

2020-10-07 Thread Neal Richardson (Jira)
Neal Richardson created ARROW-10217: --- Summary: [CI] Run fewer GitHub Actions jobs Key: ARROW-10217 URL: https://issues.apache.org/jira/browse/ARROW-10217 Project: Apache Arrow Issue Type:

[jira] [Resolved] (ARROW-10214) [Python] UnicodeDecodeError when printing schema with binary metadata

2020-10-07 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou resolved ARROW-10214. Resolution: Fixed Issue resolved by pull request 8379

[jira] [Updated] (ARROW-10217) [CI] Run fewer GitHub Actions jobs

2020-10-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-10217: --- Labels: pull-request-available (was: ) > [CI] Run fewer GitHub Actions jobs >

[jira] [Reopened] (ARROW-10140) [Python][C++] No data for map column of a parquet file created from pyarrow and pandas

2020-10-07 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney reopened ARROW-10140: -- > [Python][C++] No data for map column of a parquet file created from pyarrow > and pandas >

[jira] [Comment Edited] (ARROW-10140) [Python][C++] No data for map column of a parquet file created from pyarrow and pandas

2020-10-07 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209667#comment-17209667 ] Wes McKinney edited comment on ARROW-10140 at 10/7/20, 4:39 PM: I'm

[jira] [Commented] (ARROW-10140) [Python][C++] No data for map column of a parquet file created from pyarrow and pandas

2020-10-07 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209667#comment-17209667 ] Wes McKinney commented on ARROW-10140: -- I'm reopening this until someone confirms that this case is

[jira] [Updated] (ARROW-10088) [R] Don't store "data.table" pointer in metadata

2020-10-07 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson updated ARROW-10088: Fix Version/s: (was: 2.0.0) > [R] Don't store "data.table" pointer in metadata >

[jira] [Commented] (ARROW-9974) [Python][C++] pyarrow version 1.0.1 throws Out Of Memory exception while reading large number of files using ParquetDataset

2020-10-07 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209676#comment-17209676 ] Antoine Pitrou commented on ARROW-9974: --- [~kgashish] Can you try what I suggested above? >

[jira] [Resolved] (ARROW-10196) [C++] Add Future::DeferNotOk()

2020-10-07 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou resolved ARROW-10196. Resolution: Fixed Issue resolved by pull request 8362

[jira] [Commented] (ARROW-10207) C++] Unary kernels that results in a list have no preallocated offset buffer

2020-10-07 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209542#comment-17209542 ] Wes McKinney commented on ARROW-10207: -- It seems OK for there to be the _option_ to preallocate the

[jira] [Updated] (ARROW-10214) [Python] UnicodeDecodeError when printing schema with binary metadata

2020-10-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-10214: --- Labels: pull-request-available (was: ) > [Python] UnicodeDecodeError when printing schema

[jira] [Commented] (ARROW-9974) [Python][C++] pyarrow version 1.0.1 throws Out Of Memory exception while reading large number of files using ParquetDataset

2020-10-07 Thread Ashish Gupta (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209671#comment-17209671 ] Ashish Gupta commented on ARROW-9974: - Anyone tried to reproduce on centos-8? > [Python][C++]

[jira] [Created] (ARROW-10215) [Rust] [DataFusion] Rename "Source" typedef

2020-10-07 Thread Andy Grove (Jira)
Andy Grove created ARROW-10215: -- Summary: [Rust] [DataFusion] Rename "Source" typedef Key: ARROW-10215 URL: https://issues.apache.org/jira/browse/ARROW-10215 Project: Apache Arrow Issue Type:

[jira] [Commented] (ARROW-10214) [Python] UnicodeDecodeError when printing schema with binary metadata

2020-10-07 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209586#comment-17209586 ] Antoine Pitrou commented on ARROW-10214: I'll submit a PR. > [Python] UnicodeDecodeError when

[jira] [Commented] (ARROW-10218) [Python] [C++] Errors when building pyarrow from source

2020-10-07 Thread Andrew Wieteska (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209648#comment-17209648 ] Andrew Wieteska commented on ARROW-10218: - That was it. Thanks so much!!! > [Python] [C++]

[jira] [Resolved] (ARROW-10218) [Python] [C++] Errors when building pyarrow from source

2020-10-07 Thread Andrew Wieteska (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wieteska resolved ARROW-10218. - Resolution: Fixed > [Python] [C++] Errors when building pyarrow from source >

[jira] [Commented] (ARROW-10088) [R] Issues in restoring R metadata for "integer64", "data.table" classes

2020-10-07 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209665#comment-17209665 ] Neal Richardson commented on ARROW-10088: - The integer64 subclass issue doesn't reproduce on

[jira] [Commented] (ARROW-10214) [Python] UnicodeDecodeError when printing schema with binary metadata

2020-10-07 Thread Paul Balanca (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209585#comment-17209585 ] Paul Balanca commented on ARROW-10214: -- I have some bandwidth this week, so probably I should be

[jira] [Comment Edited] (ARROW-10214) [Python] UnicodeDecodeError when printing schema with binary metadata

2020-10-07 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209586#comment-17209586 ] Antoine Pitrou edited comment on ARROW-10214 at 10/7/20, 2:30 PM: --

[jira] [Resolved] (ARROW-7960) [C++][Parquet] Add support for schema translation from parquet nodes back to arrow for missing types

2020-10-07 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou resolved ARROW-7960. --- Resolution: Fixed Issue resolved by pull request 8376

[jira] [Resolved] (ARROW-10217) [CI] Run fewer GitHub Actions jobs

2020-10-07 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson resolved ARROW-10217. - Resolution: Fixed Issue resolved by pull request 8380

[jira] [Updated] (ARROW-10088) [R] Don't store "data.table" pointer in metadata

2020-10-07 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson updated ARROW-10088: Summary: [R] Don't store "data.table" pointer in metadata (was: [R] Issues in restoring

[jira] [Updated] (ARROW-10088) [R] Issues in restoring R metadata for "integer64", "data.table" classes

2020-10-07 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson updated ARROW-10088: Description: Issues with metadata$r: * The ".internal.selfref" attribute from data.table

[jira] [Commented] (ARROW-10214) [Python] UnicodeDecodeError when printing schema with binary metadata

2020-10-07 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209539#comment-17209539 ] Antoine Pitrou commented on ARROW-10214: [~balancap] If you, yes, otherwise we can take a look.

[jira] [Updated] (ARROW-10214) [Python] UnicodeDecodeError when printing schema with binary metadata

2020-10-07 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou updated ARROW-10214: --- Fix Version/s: 2.0.0 > [Python] UnicodeDecodeError when printing schema with binary

[jira] [Assigned] (ARROW-10214) [Python] UnicodeDecodeError when printing schema with binary metadata

2020-10-07 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou reassigned ARROW-10214: -- Assignee: Antoine Pitrou > [Python] UnicodeDecodeError when printing schema with

[jira] [Created] (ARROW-10218) [Python] [C++] Errors when building pyarrow from source

2020-10-07 Thread Andrew Wieteska (Jira)
Andrew Wieteska created ARROW-10218: --- Summary: [Python] [C++] Errors when building pyarrow from source Key: ARROW-10218 URL: https://issues.apache.org/jira/browse/ARROW-10218 Project: Apache Arrow

[jira] [Updated] (ARROW-9964) [C++] CSV date support

2020-10-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-9964: -- Labels: pull-request-available (was: ) > [C++] CSV date support > -- > >

[jira] [Commented] (ARROW-10218) [Python] [C++] Errors when building pyarrow from source

2020-10-07 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209646#comment-17209646 ] Antoine Pitrou commented on ARROW-10218: It's {{-DARROW_PYTHON=ON}} and not

[jira] [Updated] (ARROW-10172) [Python] cancat_arrays requires upcast for large array

2020-10-07 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-10172: - Summary: [Python] cancat_arrays requires upcast for large array (was: cancat_arrays requires

[jira] [Updated] (ARROW-10172) [Python] pyarrow.concat_arrays segfaults if a resulting StringArray's capacity overflows

2020-10-07 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-10172: - Summary: [Python] pyarrow.concat_arrays segfaults if a resulting StringArray's capacity

[jira] [Created] (ARROW-10219) [C++] csv::TableReader column names, Read() arguments

2020-10-07 Thread Neal Richardson (Jira)
Neal Richardson created ARROW-10219: --- Summary: [C++] csv::TableReader column names, Read() arguments Key: ARROW-10219 URL: https://issues.apache.org/jira/browse/ARROW-10219 Project: Apache Arrow

[jira] [Resolved] (ARROW-6972) [C#] Should support StructField arrays

2020-10-07 Thread Eric Erhardt (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Erhardt resolved ARROW-6972. - Resolution: Fixed Issue resolved by pull request 8348

[jira] [Resolved] (ARROW-10099) [C++][Dataset] Also allow integer partition fields to be dictionary encoded

2020-10-07 Thread Ben Kietzman (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Kietzman resolved ARROW-10099. -- Resolution: Fixed Issue resolved by pull request 8367

[jira] [Commented] (ARROW-10219) [C++] csv::TableReader column names, Read() arguments

2020-10-07 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209724#comment-17209724 ] Antoine Pitrou commented on ARROW-10219: I'm not sure I understand #1, can you explain a bit

[jira] [Resolved] (ARROW-9645) [Python] Deprecate the legacy pyarrow.filesystem interface

2020-10-07 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou resolved ARROW-9645. --- Resolution: Fixed Issue resolved by pull request 8149

[jira] [Resolved] (ARROW-9266) [Python][Packaging] Enable S3 support in macOS wheels

2020-10-07 Thread Krisztian Szucs (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Szucs resolved ARROW-9266. Resolution: Fixed Issue resolved by pull request 8315

[jira] [Commented] (ARROW-10219) [C++] csv::TableReader column names, Read() arguments

2020-10-07 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209762#comment-17209762 ] Neal Richardson commented on ARROW-10219: - I didn't know about include_columns, thanks. Here's

[jira] [Created] (ARROW-10222) [C++] Add FileSystem::MakeUri() to serialize file locations to URIs

2020-10-07 Thread Ben Kietzman (Jira)
Ben Kietzman created ARROW-10222: Summary: [C++] Add FileSystem::MakeUri() to serialize file locations to URIs Key: ARROW-10222 URL: https://issues.apache.org/jira/browse/ARROW-10222 Project: Apache

[jira] [Updated] (ARROW-3822) [C++] parquet::arrow::FileReader::GetRecordBatchReader may not iterate through chunked columns completely

2020-10-07 Thread Ben Kietzman (Jira)
[ https://issues.apache.org/jira/browse/ARROW-3822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Kietzman updated ARROW-3822: Fix Version/s: (was: 2.0.0) 3.0.0 > [C++]

  1   2   >