[jira] [Commented] (ARROW-7905) [Go][Parquet] Port the C++ Parquet implementation to Go

2020-05-12 Thread Micah Kornfield (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105935#comment-17105935 ] Micah Kornfield commented on ARROW-7905: @wesm I don't think this really warrants more

[jira] [Closed] (ARROW-8656) [Python] Switch to VS2017 in the windows wheel builds

2020-05-12 Thread Krisztian Szucs (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Szucs closed ARROW-8656. -- Resolution: Won't Fix According to discussion we keep VS2015 for now. > [Python] Switch to

[jira] [Resolved] (ARROW-8741) [Python][Packaging] Keep VS2015 with for the windows wheels

2020-05-12 Thread Krisztian Szucs (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Szucs resolved ARROW-8741. Resolution: Fixed Issue resolved by pull request 7129

[jira] [Updated] (ARROW-8456) [Release] Add python script to help curating JIRA

2020-05-12 Thread Krisztian Szucs (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Szucs updated ARROW-8456: --- Issue Type: Improvement (was: Task) > [Release] Add python script to help curating JIRA >

[jira] [Resolved] (ARROW-8684) [Python] "SystemError: Bad call flags in _PyMethodDef_RawFastCallDict" in Python 3.7.7 on macOS when using pyarrow wheel

2020-05-12 Thread Krisztian Szucs (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Szucs resolved ARROW-8684. Resolution: Fixed Issue resolved by pull request 7160

[jira] [Updated] (ARROW-8779) [R] Implement conversion to List

2020-05-12 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson updated ARROW-8779: --- Summary: [R] Implement conversion to List (was: [R] Unable to write Struct Layout to file

[jira] [Updated] (ARROW-8779) [R] Unable to write Struct Layout to file (.arrow, .parquet)

2020-05-12 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson updated ARROW-8779: --- Labels: (was: features patch) > [R] Unable to write Struct Layout to file (.arrow,

[jira] [Commented] (ARROW-8779) [R] Unable to write Struct Layout to file (.arrow, .parquet)

2020-05-12 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105751#comment-17105751 ] Neal Richardson commented on ARROW-8779: Here's a more minimal reproducer: {code:r}

[jira] [Commented] (ARROW-8779) [R] Unable to write Struct Layout to file (.arrow, .parquet)

2020-05-12 Thread Dominic Dennenmoser (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105742#comment-17105742 ] Dominic Dennenmoser commented on ARROW-8779: This minimal repex should result in the

[jira] [Commented] (ARROW-8779) [R] Unable to write Struct Layout to file (.arrow, .parquet)

2020-05-12 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105733#comment-17105733 ] Neal Richardson commented on ARROW-8779: Could you please provide a minimal reproducible example?

[jira] [Updated] (ARROW-8779) [R] Unable to write Struct Layout to file (.arrow, .parquet)

2020-05-12 Thread Dominic Dennenmoser (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dominic Dennenmoser updated ARROW-8779: --- Description: It seems there is no method implemented to write a StructArrow (within

[jira] [Updated] (ARROW-8779) [R] Unable to write Struct Layout to file (.arrow, .parquet)

2020-05-12 Thread Dominic Dennenmoser (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dominic Dennenmoser updated ARROW-8779: --- Description: It seems there is no method implemented to write a StructArrow (within

[jira] [Updated] (ARROW-8779) [R] Unable to write Struct Layout to file (.arrow, .parquet)

2020-05-12 Thread Dominic Dennenmoser (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dominic Dennenmoser updated ARROW-8779: --- Description: It seems there is no method implemented to write a StructArrow (within

[jira] [Updated] (ARROW-8779) [R] Unable to write Struct Layout to file (.arrow, .parquet)

2020-05-12 Thread Dominic Dennenmoser (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dominic Dennenmoser updated ARROW-8779: --- Description: It seems there is no method implemented to write a StructArrow (within

[jira] [Updated] (ARROW-8779) [R] Unable to write Struct Layout to file (.arrow, .parquet)

2020-05-12 Thread Dominic Dennenmoser (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dominic Dennenmoser updated ARROW-8779: --- Description: It seems there is no method implemented to write a StructArrow (within

[jira] [Created] (ARROW-8779) [R] Unable to write Struct Layout to file (.arrow, .parquet)

2020-05-12 Thread Dominic Dennenmoser (Jira)
Dominic Dennenmoser created ARROW-8779: -- Summary: [R] Unable to write Struct Layout to file (.arrow, .parquet) Key: ARROW-8779 URL: https://issues.apache.org/jira/browse/ARROW-8779 Project:

[jira] [Commented] (ARROW-8732) [C++] Let Futures support cancellation

2020-05-12 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105721#comment-17105721 ] Wes McKinney commented on ARROW-8732: - Probably the in-process thread will have to be abandoned. At

[jira] [Commented] (ARROW-8732) [C++] Let Futures support cancellation

2020-05-12 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105718#comment-17105718 ] Antoine Pitrou commented on ARROW-8732: --- C++20 stop_token:

[jira] [Resolved] (ARROW-7910) [C++] Provide function to query page size portably

2020-05-12 Thread Francois Saint-Jacques (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Francois Saint-Jacques resolved ARROW-7910. --- Resolution: Fixed Issue resolved by pull request 7155

[jira] [Assigned] (ARROW-8778) [C++][gandiva] SelectionVector related test failed on big-endian platforms

2020-05-12 Thread Kazuaki Ishizaki (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki reassigned ARROW-8778: --- Assignee: Kazuaki Ishizaki > [C++][gandiva] SelectionVector related test failed on

[jira] [Created] (ARROW-8778) [C++][gandiva] SelectionVector related test failed on big-endian platforms

2020-05-12 Thread Kazuaki Ishizaki (Jira)
Kazuaki Ishizaki created ARROW-8778: --- Summary: [C++][gandiva] SelectionVector related test failed on big-endian platforms Key: ARROW-8778 URL: https://issues.apache.org/jira/browse/ARROW-8778

[jira] [Resolved] (ARROW-8750) [Python] pyarrow.feather.write_feather does not default to lz4 compression if it's available

2020-05-12 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-8750. - Resolution: Fixed Issue resolved by pull request 7150

[jira] [Comment Edited] (ARROW-8774) [Rust] [DataFusion] Improve threading model

2020-05-12 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105594#comment-17105594 ] Antoine Pitrou edited comment on ARROW-8774 at 5/12/20, 4:47 PM: - We

[jira] [Comment Edited] (ARROW-8774) [Rust] [DataFusion] Improve threading model

2020-05-12 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105594#comment-17105594 ] Antoine Pitrou edited comment on ARROW-8774 at 5/12/20, 4:46 PM: - We

[jira] [Comment Edited] (ARROW-8774) [Rust] [DataFusion] Improve threading model

2020-05-12 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105594#comment-17105594 ] Antoine Pitrou edited comment on ARROW-8774 at 5/12/20, 4:46 PM: - We

[jira] [Commented] (ARROW-8774) [Rust] [DataFusion] Improve threading model

2020-05-12 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105594#comment-17105594 ] Antoine Pitrou commented on ARROW-8774: --- We don't have a design doc per se, just a bunch of

[jira] [Assigned] (ARROW-8684) [Python] "SystemError: Bad call flags in _PyMethodDef_RawFastCallDict" in Python 3.7.7 on macOS when using pyarrow wheel

2020-05-12 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou reassigned ARROW-8684: - Assignee: Antoine Pitrou (was: Wes McKinney) > [Python] "SystemError: Bad call flags

[jira] [Commented] (ARROW-8684) [Python] "SystemError: Bad call flags in _PyMethodDef_RawFastCallDict" in Python 3.7.7 on macOS when using pyarrow wheel

2020-05-12 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105569#comment-17105569 ] Antoine Pitrou commented on ARROW-8684: --- Ok, this is a Cython bug. See

[jira] [Created] (ARROW-8777) [Rust] Parquet.rs does not support reading fixed-size binary fields.

2020-05-12 Thread Max Burke (Jira)
Max Burke created ARROW-8777: Summary: [Rust] Parquet.rs does not support reading fixed-size binary fields. Key: ARROW-8777 URL: https://issues.apache.org/jira/browse/ARROW-8777 Project: Apache Arrow

[jira] [Commented] (ARROW-8763) [C++] Create RandomAccessFile::WillNeed-like API

2020-05-12 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105561#comment-17105561 ] Antoine Pitrou commented on ARROW-8763: --- posix_madvise():

[jira] [Created] (ARROW-8776) [FlightRPC][C++] Flight/C++ middleware don't receive headers on failed calls to Java servers

2020-05-12 Thread David Li (Jira)
David Li created ARROW-8776: --- Summary: [FlightRPC][C++] Flight/C++ middleware don't receive headers on failed calls to Java servers Key: ARROW-8776 URL: https://issues.apache.org/jira/browse/ARROW-8776

[jira] [Created] (ARROW-8775) [C++][FlightRPC] Integration client doesn't run integration tests

2020-05-12 Thread David Li (Jira)
David Li created ARROW-8775: --- Summary: [C++][FlightRPC] Integration client doesn't run integration tests Key: ARROW-8775 URL: https://issues.apache.org/jira/browse/ARROW-8775 Project: Apache Arrow

[jira] [Commented] (ARROW-8774) [Rust] [DataFusion] Improve threading model

2020-05-12 Thread Andy Grove (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105531#comment-17105531 ] Andy Grove commented on ARROW-8774: --- I think it would be good to add tot he design doc. I expect we'll

[jira] [Comment Edited] (ARROW-8774) [Rust] [DataFusion] Improve threading model

2020-05-12 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105527#comment-17105527 ] Wes McKinney edited comment on ARROW-8774 at 5/12/20, 3:29 PM: --- FYI we're

[jira] [Comment Edited] (ARROW-8774) [Rust] [DataFusion] Improve threading model

2020-05-12 Thread Adam Lippai (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105524#comment-17105524 ] Adam Lippai edited comment on ARROW-8774 at 5/12/20, 3:29 PM: -- A thing to

[jira] [Commented] (ARROW-8774) [Rust] [DataFusion] Improve threading model

2020-05-12 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105527#comment-17105527 ] Wes McKinney commented on ARROW-8774: - FYI we're also working on our thread scheduling and concurrent

[jira] [Commented] (ARROW-8774) [Rust] [DataFusion] Improve threading model

2020-05-12 Thread Adam Lippai (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105524#comment-17105524 ] Adam Lippai commented on ARROW-8774: A thing to consider on the long run (but a single default

[jira] [Updated] (ARROW-8774) [Rust] [DataFusion] Improve threading model

2020-05-12 Thread Andy Grove (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Grove updated ARROW-8774: -- Description: DataFusion currently spawns one thread per partition and this results in poor

[jira] [Commented] (ARROW-6691) [Rust] [DataFusion] Use tokio and Futures instead of spawning threads

2020-05-12 Thread Andy Grove (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105509#comment-17105509 ] Andy Grove commented on ARROW-6691: --- Thanks. yes. I've been looking at Rayon and threadpool so far this

[jira] [Commented] (ARROW-6691) [Rust] [DataFusion] Use tokio and Futures instead of spawning threads

2020-05-12 Thread Adam Lippai (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105493#comment-17105493 ] Adam Lippai commented on ARROW-6691: [~andygrove] Skipping Tokio can be reasonable, but we still need

[jira] [Created] (ARROW-8774) [Rust] [DataFusion] Improve threading model

2020-05-12 Thread Andy Grove (Jira)
Andy Grove created ARROW-8774: - Summary: [Rust] [DataFusion] Improve threading model Key: ARROW-8774 URL: https://issues.apache.org/jira/browse/ARROW-8774 Project: Apache Arrow Issue Type:

[jira] [Resolved] (ARROW-6689) [Rust] [DataFusion] Query execution enhancements for 1.0.0 release

2020-05-12 Thread Andy Grove (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Grove resolved ARROW-6689. --- Resolution: Fixed > [Rust] [DataFusion] Query execution enhancements for 1.0.0 release >

[jira] [Updated] (ARROW-8205) [Rust] [DataFusion] DataFusion should enforce unique field names in a schema

2020-05-12 Thread Andy Grove (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Grove updated ARROW-8205: -- Component/s: Rust - DataFusion > [Rust] [DataFusion] DataFusion should enforce unique field names in a

[jira] [Updated] (ARROW-8205) [Rust] [DataFusion] DataFusion should enforce unique field names in a schema

2020-05-12 Thread Andy Grove (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Grove updated ARROW-8205: -- Summary: [Rust] [DataFusion] DataFusion should enforce unique field names in a schema (was: [Rust]

[jira] [Closed] (ARROW-8701) [Rust] Unresolved import `crate::compute::util::simd_load_set_invalid` on Raspberry Pi

2020-05-12 Thread Andy Grove (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Grove closed ARROW-8701. - Resolution: Invalid I was able to get past this by disabling default features. > [Rust] Unresolved

[jira] [Closed] (ARROW-6691) [Rust] [DataFusion] Use tokio and Futures instead of spawning threads

2020-05-12 Thread Andy Grove (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Grove closed ARROW-6691. - Resolution: Invalid I spent a little time working on a PoC of this [1] but the advice from the Tokio

[jira] [Commented] (ARROW-5156) [Python] `df.to_parquet('s3://...', partition_cols=...)` fails with `'NoneType' object has no attribute '_isfilestore'`

2020-05-12 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-5156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105437#comment-17105437 ] Wes McKinney commented on ARROW-5156: - That's good, but we are building native C++ filesystem

[jira] [Commented] (ARROW-8772) [C++] Expand SumKernel benchmark to more types

2020-05-12 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105432#comment-17105432 ] Wes McKinney commented on ARROW-8772: - Please be cautious about patches to src/arrow/compute if you

[jira] [Resolved] (ARROW-8770) [C++][CI] enable arrow-csv-test on s390x

2020-05-12 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou resolved ARROW-8770. --- Fix Version/s: 1.0.0 Resolution: Fixed Issue resolved by pull request 7152

[jira] [Assigned] (ARROW-8770) [C++][CI] enable arrow-csv-test on s390x

2020-05-12 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou reassigned ARROW-8770: - Assignee: Kazuaki Ishizaki > [C++][CI] enable arrow-csv-test on s390x >

[jira] [Commented] (ARROW-5156) [Python] `df.to_parquet('s3://...', partition_cols=...)` fails with `'NoneType' object has no attribute '_isfilestore'`

2020-05-12 Thread Martin Durant (Jira)
[ https://issues.apache.org/jira/browse/ARROW-5156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105408#comment-17105408 ] Martin Durant commented on ARROW-5156: -- Note that with something likeĀ 

[jira] [Assigned] (ARROW-7910) [C++] Provide function to query page size portably

2020-05-12 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou reassigned ARROW-7910: - Assignee: Antoine Pitrou > [C++] Provide function to query page size portably >

[jira] [Commented] (ARROW-8767) [C++] Make ThreadPool task ordering configurable

2020-05-12 Thread David Li (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105391#comment-17105391 ] David Li commented on ARROW-8767: - For I/O, it would also be useful to be able to assign a "weight" to a

[jira] [Commented] (ARROW-8764) [C++] Make ThreadPool configurable in ReadRangeCache

2020-05-12 Thread David Li (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105389#comment-17105389 ] David Li commented on ARROW-8764: - I thought ReadRangeCache didn't itself have a pool, but rather it

[jira] [Created] (ARROW-8773) pyarrow schema.empty_table() does not preserve nullability of fields

2020-05-12 Thread Al Taylor (Jira)
Al Taylor created ARROW-8773: Summary: pyarrow schema.empty_table() does not preserve nullability of fields Key: ARROW-8773 URL: https://issues.apache.org/jira/browse/ARROW-8773 Project: Apache Arrow

[jira] [Commented] (ARROW-8733) [C++][Dataset][Python] ParquetFileFragment should provide access to parquet FileMetadata

2020-05-12 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105335#comment-17105335 ] Joris Van den Bossche commented on ARROW-8733: -- Hmm, good questions. Currently in

[jira] [Commented] (ARROW-8733) [C++][Dataset][Python] ParquetFileFragment should provide access to parquet FileMetadata

2020-05-12 Thread Francois Saint-Jacques (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105331#comment-17105331 ] Francois Saint-Jacques commented on ARROW-8733: --- I mean that the `_metadata`'s FileMetaData

[jira] [Updated] (ARROW-8741) [Python][Packaging] Keep VS2015 with for the windows wheels

2020-05-12 Thread Krisztian Szucs (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Szucs updated ARROW-8741: --- Summary: [Python][Packaging] Keep VS2015 with for the windows wheels (was:

[jira] [Updated] (ARROW-6756) [C++][Python] Include HDFS `getfacl` in `pyarrow.hdfs.HadoopFileSystem`

2020-05-12 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche updated ARROW-6756: - Labels: filesystem hdfs (was: arrow hdfs pyarrow) > [C++][Python] Include HDFS

[jira] [Updated] (ARROW-8240) [Python] New FS interface (pyarrow.fs) does not seem to work correctly for HDFS (Python 3.6, pyarrow 0.16.0)

2020-05-12 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche updated ARROW-8240: - Labels: HDFS filesystem (was: ) > [Python] New FS interface (pyarrow.fs) does

[jira] [Commented] (ARROW-8748) [R] Implementing methodes for combining arrow tabels using dplyr::bind_rows and dplyr::bind_cols

2020-05-12 Thread Dominic Dennenmoser (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105284#comment-17105284 ] Dominic Dennenmoser commented on ARROW-8748: Your solution seems a nicer workaround than

[jira] [Commented] (ARROW-5156) [Python] `df.to_parquet('s3://...', partition_cols=...)` fails with `'NoneType' object has no attribute '_isfilestore'`

2020-05-12 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-5156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105266#comment-17105266 ] Joris Van den Bossche commented on ARROW-5156: -- So this is solved on the pandas side (they

[jira] [Commented] (ARROW-5359) [Python] timestamp_as_object support for pa.Table.to_pandas in pyarrow

2020-05-12 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-5359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105254#comment-17105254 ] Joris Van den Bossche commented on ARROW-5359: -- Indeed, out-of-bounds timetamps (out of

[jira] [Commented] (ARROW-8641) [Python] Regression in feather: no longer supports permutation in column selection

2020-05-12 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105250#comment-17105250 ] Joris Van den Bossche commented on ARROW-8641: -- No embarrassment needed! Happy it was a

[jira] [Commented] (ARROW-8733) [C++][Dataset][Python] ParquetFileFragment should provide access to parquet FileMetadata

2020-05-12 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105223#comment-17105223 ] Joris Van den Bossche commented on ARROW-8733: -- > but more importantly because it may or not

[jira] [Updated] (ARROW-8726) [C++][Dataset] Mis-specified DirectoryPartitioning incorrectly uses the file name as value

2020-05-12 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche updated ARROW-8726: - Summary: [C++][Dataset] Mis-specified DirectoryPartitioning incorrectly uses the

[jira] [Commented] (ARROW-8726) [R][Dataset] segfault with a mis-specified partition

2020-05-12 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105211#comment-17105211 ] Joris Van den Bossche commented on ARROW-8726: -- OK, so that's the same problem than what I

[jira] [Created] (ARROW-8772) [C++] Expand SumKernel benchmark to more types

2020-05-12 Thread Frank Du (Jira)
Frank Du created ARROW-8772: --- Summary: [C++] Expand SumKernel benchmark to more types Key: ARROW-8772 URL: https://issues.apache.org/jira/browse/ARROW-8772 Project: Apache Arrow Issue Type: