R package 0.16.0 has been accepted by CRAN; may take a few more days for CRAN to build Windows and macOS binaries.
Neal On Fri, Feb 7, 2020 at 4:50 PM Neal Richardson <neal.p.richard...@gmail.com> wrote: > Homebrew PR is up: https://github.com/Homebrew/homebrew-core/pull/49908 > > > > On Fri, Feb 7, 2020 at 3:44 PM Neal Richardson < > neal.p.richard...@gmail.com> wrote: > >> I'm working (with Jeroen) on the R package stuff, and I'll put together >> the homebrew formula PR now. >> >> Neal >> >> On Fri, Feb 7, 2020 at 6:42 AM Andy Grove <andygrov...@gmail.com> wrote: >> >>> Rust crates are published. Filed >>> https://issues.apache.org/jira/browse/ARROW-7794 for the arrow-flight >>> issue. >>> >>> On Fri, Feb 7, 2020 at 7:05 AM Andy Grove <andygrov...@gmail.com> wrote: >>> >>> > I'll look at the Rust issue now. >>> > >>> > On Fri, Feb 7, 2020 at 3:27 AM Krisztián Szűcs < >>> szucs.kriszt...@gmail.com> >>> > wrote: >>> > >>> >> Status of the post release tasks: >>> >> >>> >> - [DONE] marking the released version as "RELEASED" on JIRA >>> >> - [DONE] rebase the master branch on top of the release branch >>> >> We have failing builds on the master because of the bumped version >>> >> numbers, those must be fixed. >>> >> - [DONE] rebase the pull requests >>> >> - [DONE] uploading source release artifacts to SVN >>> >> - [DONE] uploading binary release artifacts to Bintray >>> >> - [DONE] updating the Arrow website >>> >> - [DONE] python source distribution >>> >> - [DONE] ruby gems >>> >> - [DONE] javascript npm packages >>> >> - [DONE] .NET nuget packages >>> >> - [DONE] java maven artifacts >>> >> I had to re-stage the maven artifacts >>> >> - [kszucs] python wheels >>> >> Partially done, the manylinux2010 and manylinux2014 wheels have hit >>> >> the 60MB limit of pypi, requested to increase it >>> >> https://github.com/pypa/pypi-support/issues/186 >>> >> - [xhochy] conda packages >>> >> Uwe works on it, arrow-cpp is already merged. >>> >> - [andygrove] rust packages >>> >> Arrow-flight misses the format directory, didn't dig deeper. Andy >>> >> could you take a look? >>> >> - [nealrichardson] R packages >>> >> Neal should handle this. >>> >> - [ ] homebrew packages >>> >> - [ ] updating website with new API documentation >>> >> - [ ] announcing release >>> >> >>> >> On Fri, Feb 7, 2020 at 8:18 AM Krisztián Szűcs >>> >> <szucs.kriszt...@gmail.com> wrote: >>> >> > >>> >> > The VOTE carries with 4 binding +1 votes, 3 non-binding +1 votes and >>> >> > one binding +0 vote. >>> >> > >>> >> > I'm starting the post-release tasks, if anyone wants to help please >>> let >>> >> me know. >>> >> > >>> >> > On Fri, Feb 7, 2020 at 12:25 AM Krisztián Szűcs >>> >> > <szucs.kriszt...@gmail.com> wrote: >>> >> > > >>> >> > > So far we have the following votes: >>> >> > > >>> >> > > +0 (binding) >>> >> > > +1 (binding) >>> >> > > +1 (non-binding) >>> >> > > +1 (binding) >>> >> > > +1 (non-binding) >>> >> > > +1 (binding) >>> >> > > +1 (non-binding) >>> >> > > +1 (binding) >>> >> > > ------------ >>> >> > > 4 +1 (binding) >>> >> > > 3 +1 (non-binding) >>> >> > > >>> >> > > I'm waiting for votes until tomorrow morning (UTC), then I'm >>> closing >>> >> the VOTE. >>> >> > > >>> >> > > Thanks everyone! >>> >> > > >>> >> > > - Krisztian >>> >> > > >>> >> > > On Fri, Feb 7, 2020 at 12:06 AM Krisztián Szűcs >>> >> > > <szucs.kriszt...@gmail.com> wrote: >>> >> > > > >>> >> > > > Testing on macOS Catalina >>> >> > > > >>> >> > > > Binaries: OK >>> >> > > > >>> >> > > > Wheels: OK >>> >> > > > Verified on macOS and on Linux. >>> >> > > > On linux the verification script has failed for python 3.5 and >>> >> manylinux2010 >>> >> > > > and manylinux2014 with unsupported platform tag. I've manually >>> >> checked >>> >> > > > these wheels in the python:3.5 docker image, and the wheels were >>> >> good >>> >> > > > (this is automatically checked by crossbow too [1]). All other >>> >> wheels were >>> >> > > > passing using the verification script. >>> >> > > > >>> >> > > > Source: OK >>> >> > > > I had to revert the nvm path [2] to pass the js and integration >>> >> tests and >>> >> > > > force the glib test to use my system python instead of the conda >>> >> one. >>> >> > > > >>> >> > > > I vote with +1 (binding) >>> >> > > > >>> >> > > > [1]: >>> >> https://github.com/apache/arrow/blob/master/dev/tasks/tasks.yml#L568 >>> >> > > > [2]: >>> >> >>> https://github.com/apache/arrow/commit/37434fb34a1f2cd5273092ed3e1c61db90bb4dd2 >>> >> > > > >>> >> > > > >>> >> > > > On Thu, Feb 6, 2020 at 7:42 PM Neal Richardson >>> >> > > > <neal.p.richard...@gmail.com> wrote: >>> >> > > > > >>> >> > > > > I re-verified the macOS wheels and they worked but I had to >>> >> hard-code >>> >> > > > > `MACOSX_DEPLOYMENT_TARGET="10.14"` to get past the cython >>> error I >>> >> reported >>> >> > > > > previously. I tried to set that env var dynamically based on >>> your >>> >> current >>> >> > > > > OS version but didn't succeed in getting it passed through to >>> >> pytest, >>> >> > > > > despite many attempts to `export` it; someone with better bash >>> >> skills than >>> >> > > > > I should probably add that to the script. FTR `defaults read >>> >> loginwindow >>> >> > > > > SystemVersionStampAsString | sed s/\.[0-9]$//` returns the >>> right >>> >> macOS >>> >> > > > > version. >>> >> > > > > >>> >> > > > > Neal >>> >> > > > > >>> >> > > > > On Wed, Feb 5, 2020 at 1:29 PM Wes McKinney < >>> wesmck...@gmail.com> >>> >> wrote: >>> >> > > > > >>> >> > > > > > +1 (binding) >>> >> > > > > > >>> >> > > > > > I was able to verify the Windows wheels with the following >>> >> patch applied >>> >> > > > > > >>> >> > > > > > https://github.com/apache/arrow/pull/6364 >>> >> > > > > > >>> >> > > > > > On Wed, Feb 5, 2020 at 1:09 PM Krisztián Szűcs >>> >> > > > > > <szucs.kriszt...@gmail.com> wrote: >>> >> > > > > > > >>> >> > > > > > > There were binary naming issues with the macosx and the >>> >> win-cp38 >>> >> > > > > > > wheels. >>> >> > > > > > > I've uploaded them, all of the wheels should be available >>> now >>> >> [1] >>> >> > > > > > > >>> >> > > > > > > Note that the newly built macosx wheels have 10_9 >>> platform tag >>> >> > > > > > > instead of 10_6, so the verification script must be >>> updated >>> >> [2] to >>> >> > > > > > > verify the macosx wheels. >>> >> > > > > > > >>> >> > > > > > > [1] >>> >> https://bintray.com/apache/arrow/python-rc/0.16.0-rc2#files >>> >> > > > > > > [2] >>> >> > > > > > >>> >> >>> https://github.com/apache/arrow/pull/6362/files#diff-8cc7fa3ae5de30b356c17d7a4b59fe09R658 >>> >> > > > > > > >>> >> > > > > > > On Wed, Feb 5, 2020 at 6:30 PM Krisztián Szűcs >>> >> > > > > > > <szucs.kriszt...@gmail.com> wrote: >>> >> > > > > > > > >>> >> > > > > > > > The wheel was built successfully and available under the >>> >> crossbow >>> >> > > > > > > > releases. Something must have gone wrong during >>> >> download/upload >>> >> > > > > > > > to bintray. I'm re-uploading the wheels again, waiting >>> for >>> >> the network. >>> >> > > > > > > > >>> >> > > > > > > > On Wed, Feb 5, 2020 at 6:14 PM Wes McKinney < >>> >> wesmck...@gmail.com> >>> >> > > > > > wrote: >>> >> > > > > > > > > >>> >> > > > > > > > > The Windows wheel RC script is broken >>> >> > > > > > > > > >>> >> > > > > > > > > wget --no-check-certificate -O >>> >> > > > > > pyarrow-0.16.0-cp38-cp38m-win_amd64.whl >>> >> > > > > > > > > >>> >> > > > > > >>> >> >>> https://bintray.com/apache/arrow/download_file?file_path=python-rc%2F0.16.0-rc2%2Fpyarrow-0.1 >>> >> > > > > > > > > 6.0-cp38-cp38m-win_amd64.whl || EXIT /B 1 >>> >> > > > > > > > > --2020-02-05 11:11:15-- >>> >> > > > > > > > > >>> >> > > > > > >>> >> >>> https://bintray.com/apache/arrow/download_file?file_path=python-rc%2F0.16.0-rc2%2Fpyarrow-0.16.0-cp38-cp38m-win_amd64.whl >>> >> > > > > > > > > Resolving bintray.com (bintray.com)... 75.126.208.206 >>> >> > > > > > > > > Connecting to bintray.com (bintray.com >>> >> )|75.126.208.206|:443... >>> >> > > > > > > > > connected. >>> >> > > > > > > > > HTTP request sent, awaiting response... 404 Not Found >>> >> > > > > > > > > 2020-02-05 11:11:15 ERROR 404: Not Found. >>> >> > > > > > > > > >>> >> > > > > > > > > I will try to fix >>> >> > > > > > > > > >>> >> > > > > > > > > On Wed, Feb 5, 2020 at 7:31 AM Uwe L. Korn < >>> >> uw...@xhochy.com> wrote: >>> >> > > > > > > > > > >>> >> > > > > > > > > > I'm failing to verify C++ on macOS as it seems that >>> we >>> >> nowadays >>> >> > > > > > pull all dependencies from the system. Is there a known way >>> to >>> >> build & test >>> >> > > > > > on OSX with the script and use conda for the requirements? >>> >> > > > > > > > > > >>> >> > > > > > > > > > Otherwise I probably need to investe to create such >>> a >>> >> way. >>> >> > > > > > > > > > >>> >> > > > > > > > > > Cheers >>> >> > > > > > > > > > Uwe >>> >> > > > > > > > > > >>> >> > > > > > > > > > On Wed, Feb 5, 2020, at 2:54 AM, Krisztián Szűcs >>> wrote: >>> >> > > > > > > > > > > Hi, >>> >> > > > > > > > > > > >>> >> > > > > > > > > > > I've cherry-picked the wheel fix [1] on top of the >>> >> 0.16 release >>> >> > > > > > tag, >>> >> > > > > > > > > > > re-built the wheels using crossbow [2], and >>> uploaded >>> >> them to >>> >> > > > > > > > > > > bintray [3] (also removed win-py38m). >>> >> > > > > > > > > > > >>> >> > > > > > > > > > > Anyone who has voted after verifying the wheels, >>> >> please re-run >>> >> > > > > > > > > > > the verification script again for the wheels and >>> >> re-vote. >>> >> > > > > > > > > > > >>> >> > > > > > > > > > > Thanks, Krisztian >>> >> > > > > > > > > > > >>> >> > > > > > > > > > > [1] >>> >> > > > > > > > > > > >>> >> > > > > > >>> >> >>> https://github.com/apache/arrow/commit/67e34c53b3be4c88348369f8109626b4a8a997aa >>> >> > > > > > > > > > > [2] >>> >> > > > > > >>> >> https://github.com/ursa-labs/crossbow/branches/all?query=build-733 >>> >> > > > > > > > > > > [3] >>> >> https://bintray.com/apache/arrow/python-rc/0.16.0-rc2#files >>> >> > > > > > > > > > > >>> >> > > > > > > > > > > On Tue, Feb 4, 2020 at 7:08 PM Wes McKinney < >>> >> wesmck...@gmail.com> >>> >> > > > > > wrote: >>> >> > > > > > > > > > > > >>> >> > > > > > > > > > > > +1 (binding) >>> >> > > > > > > > > > > > >>> >> > > > > > > > > > > > Some patches were required to the verification >>> >> scripts but I >>> >> > > > > > have run: >>> >> > > > > > > > > > > > >>> >> > > > > > > > > > > > * Full source verification on Ubuntu 18.04 >>> >> > > > > > > > > > > > * Linux binary verification >>> >> > > > > > > > > > > > * Source verification on Windows 10 (needed >>> >> ARROW-6757) >>> >> > > > > > > > > > > > * Windows binary verification. Note that Python >>> 3.8 >>> >> wheel is >>> >> > > > > > broken >>> >> > > > > > > > > > > > (see ARROW-7755). Whoever uploads the wheels to >>> >> PyPI _SHOULD >>> >> > > > > > NOT_ >>> >> > > > > > > > > > > > upload this 3.8 wheel until we know what's wrong >>> >> (if we upload >>> >> > > > > > a >>> >> > > > > > > > > > > > broken wheel then `pip install pyarrow==0.16.0` >>> >> will be >>> >> > > > > > permanently >>> >> > > > > > > > > > > > broken on Windows/Python 3.8) >>> >> > > > > > > > > > > > >>> >> > > > > > > > > > > > On Mon, Feb 3, 2020 at 9:26 PM Francois >>> >> Saint-Jacques >>> >> > > > > > > > > > > > <fsaintjacq...@gmail.com> wrote: >>> >> > > > > > > > > > > > > >>> >> > > > > > > > > > > > > Tested on ubuntu 18.04 for the source release. >>> >> > > > > > > > > > > > > >>> >> > > > > > > > > > > > > On Mon, Feb 3, 2020 at 10:07 PM Francois >>> >> Saint-Jacques >>> >> > > > > > > > > > > > > <fsaintjacq...@gmail.com> wrote: >>> >> > > > > > > > > > > > > > >>> >> > > > > > > > > > > > > > +1 >>> >> > > > > > > > > > > > > > >>> >> > > > > > > > > > > > > > Binaries verification didn't have any >>> issues. >>> >> > > > > > > > > > > > > > Sources verification worked with some local >>> >> environment >>> >> > > > > > hiccups >>> >> > > > > > > > > > > > > > >>> >> > > > > > > > > > > > > > François >>> >> > > > > > > > > > > > > > >>> >> > > > > > > > > > > > > > On Mon, Feb 3, 2020 at 8:46 PM Andy Grove < >>> >> > > > > > andygrov...@gmail.com> wrote: >>> >> > > > > > > > > > > > > > > >>> >> > > > > > > > > > > > > > > +1 (binding) based on running the Rust >>> tests >>> >> > > > > > > > > > > > > > > >>> >> > > > > > > > > > > > > > > Thanks. >>> >> > > > > > > > > > > > > > > >>> >> > > > > > > > > > > > > > > On Thu, Jan 30, 2020 at 8:13 PM Krisztián >>> >> Szűcs < >>> >> > > > > > szucs.kriszt...@gmail.com> >>> >> > > > > > > > > > > > > > > wrote: >>> >> > > > > > > > > > > > > > > >>> >> > > > > > > > > > > > > > > > Hi, >>> >> > > > > > > > > > > > > > > > >>> >> > > > > > > > > > > > > > > > I would like to propose the following >>> >> release >>> >> > > > > > candidate (RC2) of Apache >>> >> > > > > > > > > > > > > > > > Arrow version 0.16.0. This is a release >>> >> consisting of >>> >> > > > > > 728 >>> >> > > > > > > > > > > > > > > > resolved JIRA issues[1]. >>> >> > > > > > > > > > > > > > > > >>> >> > > > > > > > > > > > > > > > This release candidate is based on >>> commit: >>> >> > > > > > > > > > > > > > > > >>> 729a7689fd87572e6a14ad36f19cd579a8b8d9c5 [2] >>> >> > > > > > > > > > > > > > > > >>> >> > > > > > > > > > > > > > > > The source release rc2 is hosted at [3]. >>> >> > > > > > > > > > > > > > > > The binary artifacts are hosted at >>> >> [4][5][6][7]. >>> >> > > > > > > > > > > > > > > > The changelog is located at [8]. >>> >> > > > > > > > > > > > > > > > >>> >> > > > > > > > > > > > > > > > Please download, verify checksums and >>> >> signatures, run >>> >> > > > > > the unit tests, >>> >> > > > > > > > > > > > > > > > and vote on the release. See [9] for >>> how to >>> >> validate a >>> >> > > > > > release candidate. >>> >> > > > > > > > > > > > > > > > >>> >> > > > > > > > > > > > > > > > The vote will be open for at least 72 >>> hours. >>> >> > > > > > > > > > > > > > > > >>> >> > > > > > > > > > > > > > > > [ ] +1 Release this as Apache Arrow >>> 0.16.0 >>> >> > > > > > > > > > > > > > > > [ ] +0 >>> >> > > > > > > > > > > > > > > > [ ] -1 Do not release this as Apache >>> Arrow >>> >> 0.16.0 >>> >> > > > > > because... >>> >> > > > > > > > > > > > > > > > >>> >> > > > > > > > > > > > > > > > [1]: >>> >> > > > > > > > > > > > > > > > >>> >> > > > > > >>> >> >>> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.16.0 >>> >> > > > > > > > > > > > > > > > [2]: >>> >> > > > > > > > > > > > > > > > >>> >> > > > > > >>> >> >>> https://github.com/apache/arrow/tree/729a7689fd87572e6a14ad36f19cd579a8b8d9c5 >>> >> > > > > > > > > > > > > > > > [3]: >>> >> > > > > > >>> >> https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.16.0-rc2 >>> >> > > > > > > > > > > > > > > > [4]: >>> >> > > > > > https://bintray.com/apache/arrow/centos-rc/0.16.0-rc2 >>> >> > > > > > > > > > > > > > > > [5]: >>> >> > > > > > https://bintray.com/apache/arrow/debian-rc/0.16.0-rc2 >>> >> > > > > > > > > > > > > > > > [6]: >>> >> > > > > > https://bintray.com/apache/arrow/python-rc/0.16.0-rc2 >>> >> > > > > > > > > > > > > > > > [7]: >>> >> > > > > > https://bintray.com/apache/arrow/ubuntu-rc/0.16.0-rc2 >>> >> > > > > > > > > > > > > > > > [8]: >>> >> > > > > > > > > > > > > > > > >>> >> > > > > > >>> >> >>> https://github.com/apache/arrow/blob/729a7689fd87572e6a14ad36f19cd579a8b8d9c5/CHANGELOG.md >>> >> > > > > > > > > > > > > > > > [9]: >>> >> > > > > > > > > > > > > > > > >>> >> > > > > > >>> >> >>> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates >>> >> > > > > > > > > > > > > > > > >>> >> > > > > > > > > > > >>> >> > > > > > >>> >> >>> > >>> >>
