Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-11 Thread Krisztián Szűcs
10, 2020 at 3:57 PM Wes McKinney > > wrote: > > > > > > > > > > > > Can we announce the release? Let me know if I can help with > > anything > > > > > > > > > > > > On Sun, Feb 9, 2020 at 6:23 PM Sutou Kouhei > > wrote: > > > > > > > &g

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-10 Thread Neal Richardson
e know if I can help with > anything > > > > > > > > > > On Sun, Feb 9, 2020 at 6:23 PM Sutou Kouhei > wrote: > > > > > > > > > > > > Hi, > > > > > > > > > > > > MSYS2 package is updated: > > > > > > https

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-10 Thread Krisztián Szűcs
: > > > > > > > > > > Hi, > > > > > > > > > > MSYS2 package is updated: > > > > > https://github.com/msys2/MINGW-packages/pull/6175 > > > > > > > > > > > > > > > Thanks, > > > > > -- > >

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-10 Thread Krisztián Szűcs
; > > > > > > Hi, > > > > > > > > MSYS2 package is updated: > > > > https://github.com/msys2/MINGW-packages/pull/6175 > > > > > > > > > > > > Thanks, > > > > -- > > > > kou > > > > > > > >

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-10 Thread Francois Saint-Jacques
t; > > > > > MSYS2 package is updated: > > > https://github.com/msys2/MINGW-packages/pull/6175 > > > > > > > > > Thanks, > > > -- > > > kou > > > > > > In > > > "Re: [VOTE] Release Apache

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-10 Thread Krisztián Szűcs
nounce the release? Let me know if I can help with anything > > On Sun, Feb 9, 2020 at 6:23 PM Sutou Kouhei wrote: > > > > Hi, > > > > MSYS2 package is updated: > > https://github.com/msys2/MINGW-packages/pull/6175 > > > > > > Thanks, >

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-10 Thread Wes McKinney
Can we announce the release? Let me know if I can help with anything On Sun, Feb 9, 2020 at 6:23 PM Sutou Kouhei wrote: > > Hi, > > MSYS2 package is updated: > https://github.com/msys2/MINGW-packages/pull/6175 > > > Thanks, > -- > kou > > In > "

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-09 Thread Sutou Kouhei
Hi, MSYS2 package is updated: https://github.com/msys2/MINGW-packages/pull/6175 Thanks, -- kou In "Re: [VOTE] Release Apache Arrow 0.16.0 - RC2" on Sun, 9 Feb 2020 09:06:39 -0800, Neal Richardson wrote: > R package 0.16.0 has been accepted by CRAN; may take a few more da

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-09 Thread Neal Richardson
R package 0.16.0 has been accepted by CRAN; may take a few more days for CRAN to build Windows and macOS binaries. Neal On Fri, Feb 7, 2020 at 4:50 PM Neal Richardson wrote: > Homebrew PR is up: https://github.com/Homebrew/homebrew-core/pull/49908 > > > > On Fri, Feb 7, 2020 at 3:44 PM Neal

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-07 Thread Neal Richardson
Homebrew PR is up: https://github.com/Homebrew/homebrew-core/pull/49908 On Fri, Feb 7, 2020 at 3:44 PM Neal Richardson wrote: > I'm working (with Jeroen) on the R package stuff, and I'll put together > the homebrew formula PR now. > > Neal > > On Fri, Feb 7, 2020 at 6:42 AM Andy Grove wrote:

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-07 Thread Neal Richardson
I'm working (with Jeroen) on the R package stuff, and I'll put together the homebrew formula PR now. Neal On Fri, Feb 7, 2020 at 6:42 AM Andy Grove wrote: > Rust crates are published. Filed > https://issues.apache.org/jira/browse/ARROW-7794 for the arrow-flight > issue. > > On Fri, Feb 7, 2020

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-07 Thread Andy Grove
Rust crates are published. Filed https://issues.apache.org/jira/browse/ARROW-7794 for the arrow-flight issue. On Fri, Feb 7, 2020 at 7:05 AM Andy Grove wrote: > I'll look at the Rust issue now. > > On Fri, Feb 7, 2020 at 3:27 AM Krisztián Szűcs > wrote: > >> Status of the post release tasks:

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-07 Thread Andy Grove
I'll look at the Rust issue now. On Fri, Feb 7, 2020 at 3:27 AM Krisztián Szűcs wrote: > Status of the post release tasks: > > - [DONE] marking the released version as "RELEASED" on JIRA > - [DONE] rebase the master branch on top of the release branch > We have failing builds on the master

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-07 Thread Krisztián Szűcs
Status of the post release tasks: - [DONE] marking the released version as "RELEASED" on JIRA - [DONE] rebase the master branch on top of the release branch We have failing builds on the master because of the bumped version numbers, those must be fixed. - [DONE] rebase the pull requests -

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-06 Thread Krisztián Szűcs
The VOTE carries with 4 binding +1 votes, 3 non-binding +1 votes and one binding +0 vote. I'm starting the post-release tasks, if anyone wants to help please let me know. On Fri, Feb 7, 2020 at 12:25 AM Krisztián Szűcs wrote: > > So far we have the following votes: > > +0 (binding) > +1

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-06 Thread Krisztián Szűcs
So far we have the following votes: +0 (binding) +1 (binding) +1 (non-binding) +1 (binding) +1 (non-binding) +1 (binding) +1 (non-binding) +1 (binding) 4 +1 (binding) 3 +1 (non-binding) I'm waiting for votes until tomorrow morning (UTC), then I'm closing the VOTE. Thanks everyone!

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-06 Thread Krisztián Szűcs
Testing on macOS Catalina Binaries: OK Wheels: OK Verified on macOS and on Linux. On linux the verification script has failed for python 3.5 and manylinux2010 and manylinux2014 with unsupported platform tag. I've manually checked these wheels in the python:3.5 docker image, and the wheels were

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-06 Thread Neal Richardson
I re-verified the macOS wheels and they worked but I had to hard-code `MACOSX_DEPLOYMENT_TARGET="10.14"` to get past the cython error I reported previously. I tried to set that env var dynamically based on your current OS version but didn't succeed in getting it passed through to pytest, despite

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-05 Thread Wes McKinney
+1 (binding) I was able to verify the Windows wheels with the following patch applied https://github.com/apache/arrow/pull/6364 On Wed, Feb 5, 2020 at 1:09 PM Krisztián Szűcs wrote: > > There were binary naming issues with the macosx and the win-cp38 > wheels. > I've uploaded them, all of the

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-05 Thread Krisztián Szűcs
There were binary naming issues with the macosx and the win-cp38 wheels. I've uploaded them, all of the wheels should be available now [1] Note that the newly built macosx wheels have 10_9 platform tag instead of 10_6, so the verification script must be updated [2] to verify the macosx wheels.

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-05 Thread Neal Richardson
I have a fix on my GHA test branch, I think: https://github.com/apache/arrow/pull/6349/files#diff-3ebb5f8536634a43ccb884fcd453b1cd On Wed, Feb 5, 2020 at 9:14 AM Wes McKinney wrote: > The Windows wheel RC script is broken > > wget --no-check-certificate -O

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-05 Thread Krisztián Szűcs
The wheel was built successfully and available under the crossbow releases. Something must have gone wrong during download/upload to bintray. I'm re-uploading the wheels again, waiting for the network. On Wed, Feb 5, 2020 at 6:14 PM Wes McKinney wrote: > > The Windows wheel RC script is broken >

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-05 Thread Wes McKinney
The Windows wheel RC script is broken wget --no-check-certificate -O pyarrow-0.16.0-cp38-cp38m-win_amd64.whl https://bintray.com/apache/arrow/download_file?file_path=python-rc%2F0.16.0-rc2%2Fpyarrow-0.1 6.0-cp38-cp38m-win_amd64.whl || EXIT /B 1 --2020-02-05 11:11:15--

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-05 Thread Uwe L. Korn
I'm failing to verify C++ on macOS as it seems that we nowadays pull all dependencies from the system. Is there a known way to build & test on OSX with the script and use conda for the requirements? Otherwise I probably need to investe to create such a way. Cheers Uwe On Wed, Feb 5, 2020, at

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-04 Thread Krisztián Szűcs
Hi, I've cherry-picked the wheel fix [1] on top of the 0.16 release tag, re-built the wheels using crossbow [2], and uploaded them to bintray [3] (also removed win-py38m). Anyone who has voted after verifying the wheels, please re-run the verification script again for the wheels and re-vote.

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-04 Thread Bryan Cutler
+1 I had some trouble due to ARROW-7760 at first, but applied the same patch and passed. I ran the command: TMPDIR=/tmp/arrow TEST_DEFAULT=0 TEST_SOURCE=1 TEST_CPP=1 TEST_PYTHON=1 TEST_JAVA=1 TEST_INTEGRATION_CPP=1 TEST_INTEGRATION_JAVA=1 dev/release/verify-release-candidate.sh source 0.16.0 2

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-04 Thread Wes McKinney
+1 (binding) Some patches were required to the verification scripts but I have run: * Full source verification on Ubuntu 18.04 * Linux binary verification * Source verification on Windows 10 (needed ARROW-6757) * Windows binary verification. Note that Python 3.8 wheel is broken (see ARROW-7755).

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-03 Thread Francois Saint-Jacques
Tested on ubuntu 18.04 for the source release. On Mon, Feb 3, 2020 at 10:07 PM Francois Saint-Jacques wrote: > > +1 > > Binaries verification didn't have any issues. > Sources verification worked with some local environment hiccups > > François > > On Mon, Feb 3, 2020 at 8:46 PM Andy Grove

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-03 Thread Francois Saint-Jacques
+1 Binaries verification didn't have any issues. Sources verification worked with some local environment hiccups François On Mon, Feb 3, 2020 at 8:46 PM Andy Grove wrote: > > +1 (binding) based on running the Rust tests > > Thanks. > > On Thu, Jan 30, 2020 at 8:13 PM Krisztián Szűcs > wrote:

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-03 Thread Andy Grove
+1 (binding) based on running the Rust tests Thanks. On Thu, Jan 30, 2020 at 8:13 PM Krisztián Szűcs wrote: > Hi, > > I would like to propose the following release candidate (RC2) of Apache > Arrow version 0.16.0. This is a release consisting of 728 > resolved JIRA issues[1]. > > This release

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-03 Thread David Li
Hi Neal, The flaky Flight auth test has been an issue recently: https://issues.apache.org/jira/browse/ARROW-7721 I'm hoping to take a look at this when I get a chance. Best, David On 2/3/20, Neal Richardson wrote: > Some further color, as builds have started to fail: > > 1. Windows source

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-03 Thread Neal Richardson
Some further color, as builds have started to fail: 1. Windows source fails oddly; it seems that installing boost makes wget not work correctly. Before installing boost, I can wget the rc tarball and build as far as the boost version check in C++, but after installing boost, I can't download the

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-03 Thread Neal Richardson
I've been experimenting with running the release verification on GitHub Actions: https://github.com/apache/arrow/pull/6349. It would be great to automate at least the core checks, even if releasing still requires some manual checking too. So far, I've verified Python wheels on Windows except for

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-03 Thread Neal Richardson
I used that with https://patch-diff.githubusercontent.com/raw/apache/arrow/pull/6344.diff applied. On Mon, Feb 3, 2020 at 11:34 AM Krisztián Szűcs wrote: > Please use the latest master [1] to verify the wheels. > > [1]: >

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-03 Thread Krisztián Szűcs
Please use the latest master [1] to verify the wheels. [1]: https://github.com/apache/arrow/commit/cb81f7d84c26cd75f4568ae1b29744cb4218b578 On Mon, Feb 3, 2020 at 8:26 PM Neal Richardson wrote: > > +1 (non-binding) > > I did binary verification and macOS (10.14) wheels. Wheels for 3.5 failed >

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-03 Thread Neal Richardson
+1 (non-binding) I did binary verification and macOS (10.14) wheels. Wheels for 3.5 failed as previously described, and 2.7 also failed similarly, so I'm gathering that that's not a blocker. 3.6 - 3.8 passed once I added this patch for Flight test fixtures:

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-03 Thread Antoine Pitrou
On Fri, 31 Jan 2020 04:13:12 +0100 Krisztián Szűcs wrote: > Hi, > > I would like to propose the following release candidate (RC2) of Apache > Arrow version 0.16.0. This is a release consisting of 728 > resolved JIRA issues[1]. > > This release candidate is based on commit: >

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-02 Thread Krisztián Szűcs
Run the wheel verification on OS X and experienced the same. At the same time the wheel properly works for python 3.5 docker images without conda environment. Conda forge doesn't maintain packages for python 3.5 anymore and something must have mixed with the numpy versions. I've created a PR to

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-01 Thread Sutou Kouhei
+0 (binding) I ran the followings on Debian GNU/Linux sid: * TEST_CSHARP=0 \ PATH=$HOME/.local/bin \ JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64 \ CUDA_TOOLKIT_ROOT=/usr \ dev/release/verify-release-candidate.sh source 0.16.0 2 *

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-01 Thread Sutou Kouhei
Thanks! They work well now! In "Re: [VOTE] Release Apache Arrow 0.16.0 - RC2" on Fri, 31 Jan 2020 14:50:49 +0100, Krisztián Szűcs wrote: > Rerun with cosmic and the successfully built ARM packages. > > On Fri, Jan 31, 2020 at 12:57 PM Sutou Kouhei wrote: >> &g

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-01-31 Thread Wes McKinney
OK, yes that is too old. We should install a sufficiently new version of Go as part of the release verification script to avoid this class of failure https://issues.apache.org/jira/browse/ARROW-7733 If you're interested in installing a newer version of Go on Ubuntu 18.04, here is how I do it

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-01-31 Thread Antoine Pitrou
It's the version packaged in Ubuntu 18.04. $ go version go version go1.10.4 linux/amd64 Regards Antoine. Le 31/01/2020 à 20:06, Wes McKinney a écrit : > hi Antoine -- which version of Go are you using? Some of these issues > are resolved by upgrading the Go version > > On Fri, Jan 31, 2020

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-01-31 Thread Wes McKinney
hi Antoine -- which version of Go are you using? Some of these issues are resolved by upgrading the Go version On Fri, Jan 31, 2020 at 6:19 AM Antoine Pitrou wrote: > > > On Ubuntu 18.04, the source verification is successful until the go > step, which fails: >

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-01-31 Thread Krisztián Szűcs
0" and re-run "dev/release/03-binary.sh"? > > > Thanks, > -- > kou > > In <20200131.205531.1001999778589734260....@clear-code.com> > "Re: [VOTE] Release Apache Arrow 0.16.0 - RC2" on Fri, 31 Jan 2020 20:55:31 > +0900 (JST), > Sutou K

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-01-31 Thread Antoine Pitrou
On Ubuntu 18.04, the source verification is successful until the go step, which fails: https://gist.github.com/pitrou/7e089ac146197b1141585c271cb39866 Side note: the JS verification step should avoid spamming the terminal with tons of useless information. Regards Antoine. Le 31/01/2020 à

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-01-31 Thread Krisztián Szűcs
Most of the ARM builds have exceeded the CI timeout [1], although I'll update the xenial, bionic, stretch packages. [1]: https://github.com/ursa-labs/crossbow/branches/all?query=arm > > > Thanks, > -- > kou > > In <20200131.205531.1001999778589734260....@clear-code.com> >

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-01-31 Thread Sutou Kouhei
Hi, One more thing. It seems that some .deb/.rpm files for arm64 aren't uploaded. Could you re-run "crossbow download-artifacts build-730" and re-run "dev/release/03-binary.sh"? Thanks, -- kou In <20200131.205531.1001999778589734260....@clear-code.com> "

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-01-31 Thread Sutou Kouhei
Hi, "dev/release/verify-release-candidate.sh binaries 0.16.0 2" is still failing. And I found the cause of the problem. Could you re-run 03-binary.sh with the change? --- diff --git a/dev/release/binary-task.rb b/dev/release/binary-task.rb index 4b5960445..3dd1d9c08 100644 ---