[jira] [Created] (ARROW-8250) [C++] Add "random access" / slice read API to RecordBatchFileReader

2020-03-27 Thread Wes McKinney (Jira)
Wes McKinney created ARROW-8250: --- Summary: [C++] Add "random access" / slice read API to RecordBatchFileReader Key: ARROW-8250 URL: https://issues.apache.org/jira/browse/ARROW-8250 Project: Apache Arrow

[VOTE] Accept "DoExchange" RPC to Arrow Flight protocol

2020-03-27 Thread Wes McKinney
Hello, David M Li has proposed adding a "bidirectional" DoExchange RPC [1] to the Arrow Flight Protocol [2]. In this client call, datasets (possibly having different schemas) are sent by both the client and server in a single transaction. This can be used to offload computational tasks and other w

[jira] [Created] (ARROW-8249) [Rust] [DataFusion] Make Table and LogicalPlanBuilder APIs more consistent

2020-03-27 Thread Andy Grove (Jira)
Andy Grove created ARROW-8249: - Summary: [Rust] [DataFusion] Make Table and LogicalPlanBuilder APIs more consistent Key: ARROW-8249 URL: https://issues.apache.org/jira/browse/ARROW-8249 Project: Apache Ar

Re: Proposal to use Black for automatic formatting of Python code

2020-03-27 Thread Bryan Cutler
+1 for using black On Fri, Mar 27, 2020 at 11:53 AM Joris Van den Bossche < jorisvandenboss...@gmail.com> wrote: > On Fri, 27 Mar 2020 at 18:49, Antoine Pitrou wrote: > > > > > I don't want to be the small minority opposing this so let's go for it. > > One question though: will we continue to ch

[jira] [Created] (ARROW-8248) vcpkg build clobbers arrow.lib from shared (.dll) with static (.lib)

2020-03-27 Thread Scott Wilson (Jira)
Scott Wilson created ARROW-8248: --- Summary: vcpkg build clobbers arrow.lib from shared (.dll) with static (.lib) Key: ARROW-8248 URL: https://issues.apache.org/jira/browse/ARROW-8248 Project: Apache Arro

Re: Proposal to use Black for automatic formatting of Python code

2020-03-27 Thread Joris Van den Bossche
On Fri, 27 Mar 2020 at 18:49, Antoine Pitrou wrote: > > I don't want to be the small minority opposing this so let's go for it. > One question though: will we continue to check Cython files using > flake8? > Yes, and I think we can continue to check flake8 for python files as well. At least that

[jira] [Created] (ARROW-8247) [Python] Expose Parquet writing "engine" setting in pyarrow.parquet.write_table

2020-03-27 Thread Wes McKinney (Jira)
Wes McKinney created ARROW-8247: --- Summary: [Python] Expose Parquet writing "engine" setting in pyarrow.parquet.write_table Key: ARROW-8247 URL: https://issues.apache.org/jira/browse/ARROW-8247 Project:

[jira] [Created] (ARROW-8246) [C++] Add -Wa,-mbig-obj when compiling with MinGW to avoid linking errors

2020-03-27 Thread Wes McKinney (Jira)
Wes McKinney created ARROW-8246: --- Summary: [C++] Add -Wa,-mbig-obj when compiling with MinGW to avoid linking errors Key: ARROW-8246 URL: https://issues.apache.org/jira/browse/ARROW-8246 Project: Apache

Re: Proposal to use Black for automatic formatting of Python code

2020-03-27 Thread Antoine Pitrou
I don't want to be the small minority opposing this so let's go for it. One question though: will we continue to check Cython files using flake8? Regards Antoine. On Thu, 26 Mar 2020 20:37:01 +0100 Joris Van den Bossche wrote: > Hi all, > > I would like to propose adopting Black as code for

Re: [Discuss][FlightRPC] Extensions to Flight: "DoBidirectional"

2020-03-27 Thread Wes McKinney
Looks like there is consensus about this. I'll start a vote about the format change soon if no further comments. On Mon, Mar 23, 2020 at 7:41 AM David Li wrote: > > Hey Wes, > > Thanks for the review. I've broken out the format change into this PR: > https://github.com/apache/arrow/pull/6686 > >

[jira] [Created] (ARROW-8245) [Python] Skip hidden directories when reading partitioned parquet files

2020-03-27 Thread Caleb Overman (Jira)
Caleb Overman created ARROW-8245: Summary: [Python] Skip hidden directories when reading partitioned parquet files Key: ARROW-8245 URL: https://issues.apache.org/jira/browse/ARROW-8245 Project: Apache

[jira] [Created] (ARROW-8244) Add `write_to_dataset` option to populate the "file_path" metadata fields

2020-03-27 Thread Rick Zamora (Jira)
Rick Zamora created ARROW-8244: -- Summary: Add `write_to_dataset` option to populate the "file_path" metadata fields Key: ARROW-8244 URL: https://issues.apache.org/jira/browse/ARROW-8244 Project: Apache A

[jira] [Created] (ARROW-8243) [Rust] [DataFusion] Fix inconsistent API in LogicalPlanBuilder

2020-03-27 Thread Andy Grove (Jira)
Andy Grove created ARROW-8243: - Summary: [Rust] [DataFusion] Fix inconsistent API in LogicalPlanBuilder Key: ARROW-8243 URL: https://issues.apache.org/jira/browse/ARROW-8243 Project: Apache Arrow

[jira] [Created] (ARROW-8242) [C++] GCC 4.8 fails to compile Flight

2020-03-27 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-8242: -- Summary: [C++] GCC 4.8 fails to compile Flight Key: ARROW-8242 URL: https://issues.apache.org/jira/browse/ARROW-8242 Project: Apache Arrow Issue Type: Im

[jira] [Created] (ARROW-8241) Add convenience methods to Schema

2020-03-27 Thread Andy Grove (Jira)
Andy Grove created ARROW-8241: - Summary: Add convenience methods to Schema Key: ARROW-8241 URL: https://issues.apache.org/jira/browse/ARROW-8241 Project: Apache Arrow Issue Type: Improvement

[jira] [Created] (ARROW-8240) [Python] New FS interface (pyarrow.fs) does not seem to work correctly for HDFS (Python 3.6, pyarrow 0.16.0)

2020-03-27 Thread Yaqub Alwan (Jira)
Yaqub Alwan created ARROW-8240: -- Summary: [Python] New FS interface (pyarrow.fs) does not seem to work correctly for HDFS (Python 3.6, pyarrow 0.16.0) Key: ARROW-8240 URL: https://issues.apache.org/jira/browse/ARROW-

[NIGHTLY] Arrow Build Report for Job nightly-2020-03-27-0

2020-03-27 Thread Crossbow
Arrow Build Report for Job nightly-2020-03-27-0 All tasks: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-03-27-0 Failed Tasks: - conda-linux-gcc-py36: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-03-27-0-azure-conda-linux-gcc-py36 - cond

Re: Proposal to use Black for automatic formatting of Python code

2020-03-27 Thread Krisztián Szűcs
+1 from me too, hopefully cython support will land eventually. On Fri, Mar 27, 2020 at 11:33 AM Rok Mihevc wrote: > > +1 for black > > On Fri, Mar 27, 2020 at 11:11 AM Uwe L. Korn wrote: > > > I'm also very much in favor of this. > > > > For the black / cython support, I think the current state

Re: Proposal to use Black for automatic formatting of Python code

2020-03-27 Thread Rok Mihevc
+1 for black On Fri, Mar 27, 2020 at 11:11 AM Uwe L. Korn wrote: > I'm also very much in favor of this. > > For the black / cython support, I think the current state is reflected in > https://github.com/pablogsal/black/tree/cython. > > On Fri, Mar 27, 2020, at 4:40 AM, Micah Kornfield wrote: > >

Re: Proposal to use Black for automatic formatting of Python code

2020-03-27 Thread Uwe L. Korn
I'm also very much in favor of this. For the black / cython support, I think the current state is reflected in https://github.com/pablogsal/black/tree/cython. On Fri, Mar 27, 2020, at 4:40 AM, Micah Kornfield wrote: > +1 from me as well. > > On Thursday, March 26, 2020, Neal Richardson > wrote