Re: Python 2.7 support removed

2020-02-19 Thread Micah Kornfield
Hi Antoine, Do you have a timeline for the 3.5 support? If possible could it maybe wait until after the next release or has it become onerous to maintain? Thanks, Micah On Wed, Feb 19, 2020 at 1:24 AM Antoine Pitrou wrote: > > Hello, > > Following the previous discussions on this

Re: Using GitHub Actions to automate style and other fixes

2020-02-19 Thread Micah Kornfield
It might pay to open up a separate thread on the Java specifically. I think automatic formatting might have been discussed before but people were afraid of the magnitude of the change. I'm also slightly against automated pushes, having something in Ursabot or GHA which could be easily invoked

Re: Using GitHub Actions to automate style and other fixes

2020-02-19 Thread Andy Grove
To backtrack slightly on my earlier email, when I said "I couldn't agree more" I was speaking to the frustrations around builds failing due to linting errors and then having to manually fix them. I think if we make as easy as possible for committers to automate the formatting before pushing (and

[jira] [Created] (ARROW-7891) [C++] RecordBatch->Equals should also have a check_metadata argument

2020-02-19 Thread Neal Richardson (Jira)
Neal Richardson created ARROW-7891: -- Summary: [C++] RecordBatch->Equals should also have a check_metadata argument Key: ARROW-7891 URL: https://issues.apache.org/jira/browse/ARROW-7891 Project:

CI setup on dedicated arm hardware

2020-02-19 Thread Ganesh Raju
Hi, I am following up on the discussion from here , with interest to have dedicated arm hardware for CI setup. We can surely help with that if we get a go-ahead from the project. Thanks, Ganesh -- IRC: ganeshraju@#linaro on irc.freenode.ne

Re: Using GitHub Actions to automate style and other fixes

2020-02-19 Thread Antoine Pitrou
Hi, On Wed, 19 Feb 2020 09:59:04 -0800 > > It doesn't have to be this way. With GitHub Actions, we can run workflows > that fix style and other violations and push the fix in a commit back to > the branch. I'm rather opposed to this. Doing automated pushes behind the user's back will feel

[jira] [Created] (ARROW-7890) [C++] Add Promise / Future implementation

2020-02-19 Thread Antoine Pitrou (Jira)
Antoine Pitrou created ARROW-7890: - Summary: [C++] Add Promise / Future implementation Key: ARROW-7890 URL: https://issues.apache.org/jira/browse/ARROW-7890 Project: Apache Arrow Issue Type:

[jira] [Created] (ARROW-7889) [Rust] Datafusion CLI does not support registering Parquet files

2020-02-19 Thread Max Burke (Jira)
Max Burke created ARROW-7889: Summary: [Rust] Datafusion CLI does not support registering Parquet files Key: ARROW-7889 URL: https://issues.apache.org/jira/browse/ARROW-7889 Project: Apache Arrow

[jira] [Created] (ARROW-7888) Allow using a more modern version of jpype in pyarrow.jvm

2020-02-19 Thread Marius van Niekerk (Jira)
Marius van Niekerk created ARROW-7888: - Summary: Allow using a more modern version of jpype in pyarrow.jvm Key: ARROW-7888 URL: https://issues.apache.org/jira/browse/ARROW-7888 Project: Apache

Re: Using GitHub Actions to automate style and other fixes

2020-02-19 Thread Andy Grove
I couldn't agree more. I'm a fan of tools that check formatting style, but only if the tools can also apply the style. Having a tool to tell humans to manually fix style issues is annoying at best. This has been a pain point for me as I start to work with the Java implementation. In Rust, we just

Using GitHub Actions to automate style and other fixes

2020-02-19 Thread Neal Richardson
Hi all, Having a build fail because of a lint check or similar style requirement is frustrating. It adds time to the process of getting a patch finished and merged because you have to check back to see the build failed, switch contexts from whatever you'd been working on since, and go fix it. And

Re: Arrow sync call February 19 at 12:00 US/Eastern, 17:00 UTC

2020-02-19 Thread Neal Richardson
It was a brief one today: Attendees: * Projjal Chanda * Ben Kietzman * Rok Mihevc * Antoine Pitrou * Neal Richardson * Aaron Discussion: * 1.0 release preparation: reviewed https://cwiki.apache.org/confluence/display/ARROW/Arrow+1.0.0+Release, discussed work in C++ on integration testing and

Arrow sync call February 19 at 12:00 US/Eastern, 17:00 UTC

2020-02-19 Thread Neal Richardson
Hi all, Our biweekly call is starting right now at https://meet.google.com/vtm-teks-phx. All are welcome to join. Notes will be sent out to the mailing list afterward. Neal

[jira] [Created] (ARROW-7887) Rust filter kernel does not support temporal types

2020-02-19 Thread Max Burke (Jira)
Max Burke created ARROW-7887: Summary: Rust filter kernel does not support temporal types Key: ARROW-7887 URL: https://issues.apache.org/jira/browse/ARROW-7887 Project: Apache Arrow Issue Type:

Re: [NIGHTLY] Arrow Build Report for Job nightly-2020-02-19-0

2020-02-19 Thread Projjal Chanda
I will look into the gandiva failures. On Wed, Feb 19, 2020, at 9:10 PM, Krisztián Szűcs wrote: > I’ll will work on them tomorrow, but of course any help is appreciated. > > On 2020. Feb 19., Wed at 15:40, Wes McKinney wrote: > > > The trendline on the nightlies does not look too great. > > >

[jira] [Created] (ARROW-7886) [C++][Dataset] Consolidate Source and Dataset

2020-02-19 Thread Ben Kietzman (Jira)
Ben Kietzman created ARROW-7886: --- Summary: [C++][Dataset] Consolidate Source and Dataset Key: ARROW-7886 URL: https://issues.apache.org/jira/browse/ARROW-7886 Project: Apache Arrow Issue Type:

Re: [NIGHTLY] Arrow Build Report for Job nightly-2020-02-19-0

2020-02-19 Thread Krisztián Szűcs
I’ll will work on them tomorrow, but of course any help is appreciated. On 2020. Feb 19., Wed at 15:40, Wes McKinney wrote: > The trendline on the nightlies does not look too great. > > On Wed, Feb 19, 2020 at 8:01 AM Crossbow wrote: > > > > > > Arrow Build Report for Job nightly-2020-02-19-0

Re: [NIGHTLY] Arrow Build Report for Job nightly-2020-02-19-0

2020-02-19 Thread Wes McKinney
The trendline on the nightlies does not look too great. On Wed, Feb 19, 2020 at 8:01 AM Crossbow wrote: > > > Arrow Build Report for Job nightly-2020-02-19-0 > > All tasks: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-02-19-0 > > Failed Tasks: > - centos-8: > URL:

[NIGHTLY] Arrow Build Report for Job nightly-2020-02-19-0

2020-02-19 Thread Crossbow
Arrow Build Report for Job nightly-2020-02-19-0 All tasks: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-02-19-0 Failed Tasks: - centos-8: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-02-19-0-azure-centos-8 - gandiva-jar-osx: URL:

[jira] [Created] (ARROW-7885) Serialize dask dataframe

2020-02-19 Thread Benjamin (Jira)
Benjamin created ARROW-7885: --- Summary: Serialize dask dataframe Key: ARROW-7885 URL: https://issues.apache.org/jira/browse/ARROW-7885 Project: Apache Arrow Issue Type: Wish Reporter:

[jira] [Created] (ARROW-7884) [C++][Python] Crash in pq.read_table()

2020-02-19 Thread Antoine Pitrou (Jira)
Antoine Pitrou created ARROW-7884: - Summary: [C++][Python] Crash in pq.read_table() Key: ARROW-7884 URL: https://issues.apache.org/jira/browse/ARROW-7884 Project: Apache Arrow Issue Type:

[jira] [Created] (ARROW-7883) pyarrow-serialize-pandas-df-with-nullable-integer-type

2020-02-19 Thread Benjamin (Jira)
Benjamin created ARROW-7883: --- Summary: pyarrow-serialize-pandas-df-with-nullable-integer-type Key: ARROW-7883 URL: https://issues.apache.org/jira/browse/ARROW-7883 Project: Apache Arrow Issue

Python 2.7 support removed

2020-02-19 Thread Antoine Pitrou
Hello, Following the previous discussions on this mailing-list, we have entirely removed Python 2.7 support from the codebase (see ARROW-5757 on JIRA). This deleted a lot of compatibility code that was spread around the C++ and Python codebases. As a reminder, Python 2.7 has stopped being

[jira] [Created] (ARROW-7882) [C++][Gandiva] Optimise like function for substring pattern

2020-02-19 Thread Projjal Chanda (Jira)
Projjal Chanda created ARROW-7882: - Summary: [C++][Gandiva] Optimise like function for substring pattern Key: ARROW-7882 URL: https://issues.apache.org/jira/browse/ARROW-7882 Project: Apache Arrow