I'm working (with Jeroen) on the R package stuff, and I'll put together the homebrew formula PR now.
Neal On Fri, Feb 7, 2020 at 6:42 AM Andy Grove <andygrov...@gmail.com> wrote: > Rust crates are published. Filed > https://issues.apache.org/jira/browse/ARROW-7794 for the arrow-flight > issue. > > On Fri, Feb 7, 2020 at 7:05 AM Andy Grove <andygrov...@gmail.com> wrote: > > > I'll look at the Rust issue now. > > > > On Fri, Feb 7, 2020 at 3:27 AM Krisztián Szűcs < > szucs.kriszt...@gmail.com> > > wrote: > > > >> Status of the post release tasks: > >> > >> - [DONE] marking the released version as "RELEASED" on JIRA > >> - [DONE] rebase the master branch on top of the release branch > >> We have failing builds on the master because of the bumped version > >> numbers, those must be fixed. > >> - [DONE] rebase the pull requests > >> - [DONE] uploading source release artifacts to SVN > >> - [DONE] uploading binary release artifacts to Bintray > >> - [DONE] updating the Arrow website > >> - [DONE] python source distribution > >> - [DONE] ruby gems > >> - [DONE] javascript npm packages > >> - [DONE] .NET nuget packages > >> - [DONE] java maven artifacts > >> I had to re-stage the maven artifacts > >> - [kszucs] python wheels > >> Partially done, the manylinux2010 and manylinux2014 wheels have hit > >> the 60MB limit of pypi, requested to increase it > >> https://github.com/pypa/pypi-support/issues/186 > >> - [xhochy] conda packages > >> Uwe works on it, arrow-cpp is already merged. > >> - [andygrove] rust packages > >> Arrow-flight misses the format directory, didn't dig deeper. Andy > >> could you take a look? > >> - [nealrichardson] R packages > >> Neal should handle this. > >> - [ ] homebrew packages > >> - [ ] updating website with new API documentation > >> - [ ] announcing release > >> > >> On Fri, Feb 7, 2020 at 8:18 AM Krisztián Szűcs > >> <szucs.kriszt...@gmail.com> wrote: > >> > > >> > The VOTE carries with 4 binding +1 votes, 3 non-binding +1 votes and > >> > one binding +0 vote. > >> > > >> > I'm starting the post-release tasks, if anyone wants to help please > let > >> me know. > >> > > >> > On Fri, Feb 7, 2020 at 12:25 AM Krisztián Szűcs > >> > <szucs.kriszt...@gmail.com> wrote: > >> > > > >> > > So far we have the following votes: > >> > > > >> > > +0 (binding) > >> > > +1 (binding) > >> > > +1 (non-binding) > >> > > +1 (binding) > >> > > +1 (non-binding) > >> > > +1 (binding) > >> > > +1 (non-binding) > >> > > +1 (binding) > >> > > ------------ > >> > > 4 +1 (binding) > >> > > 3 +1 (non-binding) > >> > > > >> > > I'm waiting for votes until tomorrow morning (UTC), then I'm closing > >> the VOTE. > >> > > > >> > > Thanks everyone! > >> > > > >> > > - Krisztian > >> > > > >> > > On Fri, Feb 7, 2020 at 12:06 AM Krisztián Szűcs > >> > > <szucs.kriszt...@gmail.com> wrote: > >> > > > > >> > > > Testing on macOS Catalina > >> > > > > >> > > > Binaries: OK > >> > > > > >> > > > Wheels: OK > >> > > > Verified on macOS and on Linux. > >> > > > On linux the verification script has failed for python 3.5 and > >> manylinux2010 > >> > > > and manylinux2014 with unsupported platform tag. I've manually > >> checked > >> > > > these wheels in the python:3.5 docker image, and the wheels were > >> good > >> > > > (this is automatically checked by crossbow too [1]). All other > >> wheels were > >> > > > passing using the verification script. > >> > > > > >> > > > Source: OK > >> > > > I had to revert the nvm path [2] to pass the js and integration > >> tests and > >> > > > force the glib test to use my system python instead of the conda > >> one. > >> > > > > >> > > > I vote with +1 (binding) > >> > > > > >> > > > [1]: > >> https://github.com/apache/arrow/blob/master/dev/tasks/tasks.yml#L568 > >> > > > [2]: > >> > https://github.com/apache/arrow/commit/37434fb34a1f2cd5273092ed3e1c61db90bb4dd2 > >> > > > > >> > > > > >> > > > On Thu, Feb 6, 2020 at 7:42 PM Neal Richardson > >> > > > <neal.p.richard...@gmail.com> wrote: > >> > > > > > >> > > > > I re-verified the macOS wheels and they worked but I had to > >> hard-code > >> > > > > `MACOSX_DEPLOYMENT_TARGET="10.14"` to get past the cython error > I > >> reported > >> > > > > previously. I tried to set that env var dynamically based on > your > >> current > >> > > > > OS version but didn't succeed in getting it passed through to > >> pytest, > >> > > > > despite many attempts to `export` it; someone with better bash > >> skills than > >> > > > > I should probably add that to the script. FTR `defaults read > >> loginwindow > >> > > > > SystemVersionStampAsString | sed s/\.[0-9]$//` returns the right > >> macOS > >> > > > > version. > >> > > > > > >> > > > > Neal > >> > > > > > >> > > > > On Wed, Feb 5, 2020 at 1:29 PM Wes McKinney < > wesmck...@gmail.com> > >> wrote: > >> > > > > > >> > > > > > +1 (binding) > >> > > > > > > >> > > > > > I was able to verify the Windows wheels with the following > >> patch applied > >> > > > > > > >> > > > > > https://github.com/apache/arrow/pull/6364 > >> > > > > > > >> > > > > > On Wed, Feb 5, 2020 at 1:09 PM Krisztián Szűcs > >> > > > > > <szucs.kriszt...@gmail.com> wrote: > >> > > > > > > > >> > > > > > > There were binary naming issues with the macosx and the > >> win-cp38 > >> > > > > > > wheels. > >> > > > > > > I've uploaded them, all of the wheels should be available > now > >> [1] > >> > > > > > > > >> > > > > > > Note that the newly built macosx wheels have 10_9 platform > tag > >> > > > > > > instead of 10_6, so the verification script must be updated > >> [2] to > >> > > > > > > verify the macosx wheels. > >> > > > > > > > >> > > > > > > [1] > >> https://bintray.com/apache/arrow/python-rc/0.16.0-rc2#files > >> > > > > > > [2] > >> > > > > > > >> > https://github.com/apache/arrow/pull/6362/files#diff-8cc7fa3ae5de30b356c17d7a4b59fe09R658 > >> > > > > > > > >> > > > > > > On Wed, Feb 5, 2020 at 6:30 PM Krisztián Szűcs > >> > > > > > > <szucs.kriszt...@gmail.com> wrote: > >> > > > > > > > > >> > > > > > > > The wheel was built successfully and available under the > >> crossbow > >> > > > > > > > releases. Something must have gone wrong during > >> download/upload > >> > > > > > > > to bintray. I'm re-uploading the wheels again, waiting for > >> the network. > >> > > > > > > > > >> > > > > > > > On Wed, Feb 5, 2020 at 6:14 PM Wes McKinney < > >> wesmck...@gmail.com> > >> > > > > > wrote: > >> > > > > > > > > > >> > > > > > > > > The Windows wheel RC script is broken > >> > > > > > > > > > >> > > > > > > > > wget --no-check-certificate -O > >> > > > > > pyarrow-0.16.0-cp38-cp38m-win_amd64.whl > >> > > > > > > > > > >> > > > > > > >> > https://bintray.com/apache/arrow/download_file?file_path=python-rc%2F0.16.0-rc2%2Fpyarrow-0.1 > >> > > > > > > > > 6.0-cp38-cp38m-win_amd64.whl || EXIT /B 1 > >> > > > > > > > > --2020-02-05 11:11:15-- > >> > > > > > > > > > >> > > > > > > >> > https://bintray.com/apache/arrow/download_file?file_path=python-rc%2F0.16.0-rc2%2Fpyarrow-0.16.0-cp38-cp38m-win_amd64.whl > >> > > > > > > > > Resolving bintray.com (bintray.com)... 75.126.208.206 > >> > > > > > > > > Connecting to bintray.com (bintray.com > >> )|75.126.208.206|:443... > >> > > > > > > > > connected. > >> > > > > > > > > HTTP request sent, awaiting response... 404 Not Found > >> > > > > > > > > 2020-02-05 11:11:15 ERROR 404: Not Found. > >> > > > > > > > > > >> > > > > > > > > I will try to fix > >> > > > > > > > > > >> > > > > > > > > On Wed, Feb 5, 2020 at 7:31 AM Uwe L. Korn < > >> uw...@xhochy.com> wrote: > >> > > > > > > > > > > >> > > > > > > > > > I'm failing to verify C++ on macOS as it seems that we > >> nowadays > >> > > > > > pull all dependencies from the system. Is there a known way to > >> build & test > >> > > > > > on OSX with the script and use conda for the requirements? > >> > > > > > > > > > > >> > > > > > > > > > Otherwise I probably need to investe to create such a > >> way. > >> > > > > > > > > > > >> > > > > > > > > > Cheers > >> > > > > > > > > > Uwe > >> > > > > > > > > > > >> > > > > > > > > > On Wed, Feb 5, 2020, at 2:54 AM, Krisztián Szűcs > wrote: > >> > > > > > > > > > > Hi, > >> > > > > > > > > > > > >> > > > > > > > > > > I've cherry-picked the wheel fix [1] on top of the > >> 0.16 release > >> > > > > > tag, > >> > > > > > > > > > > re-built the wheels using crossbow [2], and uploaded > >> them to > >> > > > > > > > > > > bintray [3] (also removed win-py38m). > >> > > > > > > > > > > > >> > > > > > > > > > > Anyone who has voted after verifying the wheels, > >> please re-run > >> > > > > > > > > > > the verification script again for the wheels and > >> re-vote. > >> > > > > > > > > > > > >> > > > > > > > > > > Thanks, Krisztian > >> > > > > > > > > > > > >> > > > > > > > > > > [1] > >> > > > > > > > > > > > >> > > > > > > >> > https://github.com/apache/arrow/commit/67e34c53b3be4c88348369f8109626b4a8a997aa > >> > > > > > > > > > > [2] > >> > > > > > > >> https://github.com/ursa-labs/crossbow/branches/all?query=build-733 > >> > > > > > > > > > > [3] > >> https://bintray.com/apache/arrow/python-rc/0.16.0-rc2#files > >> > > > > > > > > > > > >> > > > > > > > > > > On Tue, Feb 4, 2020 at 7:08 PM Wes McKinney < > >> wesmck...@gmail.com> > >> > > > > > wrote: > >> > > > > > > > > > > > > >> > > > > > > > > > > > +1 (binding) > >> > > > > > > > > > > > > >> > > > > > > > > > > > Some patches were required to the verification > >> scripts but I > >> > > > > > have run: > >> > > > > > > > > > > > > >> > > > > > > > > > > > * Full source verification on Ubuntu 18.04 > >> > > > > > > > > > > > * Linux binary verification > >> > > > > > > > > > > > * Source verification on Windows 10 (needed > >> ARROW-6757) > >> > > > > > > > > > > > * Windows binary verification. Note that Python > 3.8 > >> wheel is > >> > > > > > broken > >> > > > > > > > > > > > (see ARROW-7755). Whoever uploads the wheels to > >> PyPI _SHOULD > >> > > > > > NOT_ > >> > > > > > > > > > > > upload this 3.8 wheel until we know what's wrong > >> (if we upload > >> > > > > > a > >> > > > > > > > > > > > broken wheel then `pip install pyarrow==0.16.0` > >> will be > >> > > > > > permanently > >> > > > > > > > > > > > broken on Windows/Python 3.8) > >> > > > > > > > > > > > > >> > > > > > > > > > > > On Mon, Feb 3, 2020 at 9:26 PM Francois > >> Saint-Jacques > >> > > > > > > > > > > > <fsaintjacq...@gmail.com> wrote: > >> > > > > > > > > > > > > > >> > > > > > > > > > > > > Tested on ubuntu 18.04 for the source release. > >> > > > > > > > > > > > > > >> > > > > > > > > > > > > On Mon, Feb 3, 2020 at 10:07 PM Francois > >> Saint-Jacques > >> > > > > > > > > > > > > <fsaintjacq...@gmail.com> wrote: > >> > > > > > > > > > > > > > > >> > > > > > > > > > > > > > +1 > >> > > > > > > > > > > > > > > >> > > > > > > > > > > > > > Binaries verification didn't have any issues. > >> > > > > > > > > > > > > > Sources verification worked with some local > >> environment > >> > > > > > hiccups > >> > > > > > > > > > > > > > > >> > > > > > > > > > > > > > François > >> > > > > > > > > > > > > > > >> > > > > > > > > > > > > > On Mon, Feb 3, 2020 at 8:46 PM Andy Grove < > >> > > > > > andygrov...@gmail.com> wrote: > >> > > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > +1 (binding) based on running the Rust tests > >> > > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > Thanks. > >> > > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > On Thu, Jan 30, 2020 at 8:13 PM Krisztián > >> Szűcs < > >> > > > > > szucs.kriszt...@gmail.com> > >> > > > > > > > > > > > > > > wrote: > >> > > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > > Hi, > >> > > > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > > I would like to propose the following > >> release > >> > > > > > candidate (RC2) of Apache > >> > > > > > > > > > > > > > > > Arrow version 0.16.0. This is a release > >> consisting of > >> > > > > > 728 > >> > > > > > > > > > > > > > > > resolved JIRA issues[1]. > >> > > > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > > This release candidate is based on commit: > >> > > > > > > > > > > > > > > > 729a7689fd87572e6a14ad36f19cd579a8b8d9c5 > [2] > >> > > > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > > The source release rc2 is hosted at [3]. > >> > > > > > > > > > > > > > > > The binary artifacts are hosted at > >> [4][5][6][7]. > >> > > > > > > > > > > > > > > > The changelog is located at [8]. > >> > > > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > > Please download, verify checksums and > >> signatures, run > >> > > > > > the unit tests, > >> > > > > > > > > > > > > > > > and vote on the release. See [9] for how > to > >> validate a > >> > > > > > release candidate. > >> > > > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > > The vote will be open for at least 72 > hours. > >> > > > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > > [ ] +1 Release this as Apache Arrow 0.16.0 > >> > > > > > > > > > > > > > > > [ ] +0 > >> > > > > > > > > > > > > > > > [ ] -1 Do not release this as Apache Arrow > >> 0.16.0 > >> > > > > > because... > >> > > > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > > [1]: > >> > > > > > > > > > > > > > > > > >> > > > > > > >> > https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.16.0 > >> > > > > > > > > > > > > > > > [2]: > >> > > > > > > > > > > > > > > > > >> > > > > > > >> > https://github.com/apache/arrow/tree/729a7689fd87572e6a14ad36f19cd579a8b8d9c5 > >> > > > > > > > > > > > > > > > [3]: > >> > > > > > > >> https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.16.0-rc2 > >> > > > > > > > > > > > > > > > [4]: > >> > > > > > https://bintray.com/apache/arrow/centos-rc/0.16.0-rc2 > >> > > > > > > > > > > > > > > > [5]: > >> > > > > > https://bintray.com/apache/arrow/debian-rc/0.16.0-rc2 > >> > > > > > > > > > > > > > > > [6]: > >> > > > > > https://bintray.com/apache/arrow/python-rc/0.16.0-rc2 > >> > > > > > > > > > > > > > > > [7]: > >> > > > > > https://bintray.com/apache/arrow/ubuntu-rc/0.16.0-rc2 > >> > > > > > > > > > > > > > > > [8]: > >> > > > > > > > > > > > > > > > > >> > > > > > > >> > https://github.com/apache/arrow/blob/729a7689fd87572e6a14ad36f19cd579a8b8d9c5/CHANGELOG.md > >> > > > > > > > > > > > > > > > [9]: > >> > > > > > > > > > > > > > > > > >> > > > > > > >> > https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates > >> > > > > > > > > > > > > > > > > >> > > > > > > > > > > > >> > > > > > > >> > > >
