I updated the R docs because I had everything I needed to do that locally: https://github.com/apache/arrow-site/pull/30 Doing the others wasn't feasible for me on my computer (I don't have CUDA, and the case insensitivity of the macOS file system always bites me with the pyarrow docs anyway).
IMO improving our CI/CD around documentation should be a priority for 1.0. Neal On Thu, Oct 10, 2019 at 12:03 PM Wes McKinney <wesmck...@gmail.com> wrote: > > The docs on http://arrow.apache.org/docs/ haven't been updated yet. > This happened the last release, too -- I ended up updating the docs > manually after a week or two. Is this included in the release > management guide? If no one beats me to it, I can update the docs by > hand again later today > > On Mon, Oct 7, 2019 at 6:20 PM Wes McKinney <wesmck...@gmail.com> wrote: > > > > I think we might be a little aggressive at removing artifacts from the > > dist system > > > > Can we change our process to only remove old dist artifacts when we > > are about to upload a new RC? Otherwise it's harder to make > > improvements to the release verification scripts without any old RC to > > test against > > > > On Mon, Oct 7, 2019 at 5:17 PM Neal Richardson > > <neal.p.richard...@gmail.com> wrote: > > > > > > The R package has been accepted by CRAN. Binaries for macOS and > > > Windows should become available in the next few days. > > > > > > Neal > > > > > > On Mon, Oct 7, 2019 at 1:41 AM Krisztián Szűcs > > > <szucs.kriszt...@gmail.com> wrote: > > > > > > > > Thanks Andy! > > > > > > > > I've just removed the RC source artefacts from SVN. > > > > > > > > We have two remaining post release tasks: > > > > - homebrew > > > > - apidocs > > > > > > > > On Mon, Oct 7, 2019 at 1:47 AM Andy Grove <andygrov...@gmail.com> wrote: > > > > > > > > > I released the Rust crates from the RC2 source tarball. I had to > > > > > comment > > > > > out the benchmark references in the Cargo.toml first since the > > > > > tarball does > > > > > not include the benchmark source code. I filed > > > > > https://issues.apache.org/jira/browse/ARROW-6801 for this bug and will > > > > > fix the packaging before the 1.0.0 release. > > > > > > > > > > On Sun, Oct 6, 2019 at 2:01 AM Krisztián Szűcs > > > > > <szucs.kriszt...@gmail.com> > > > > > wrote: > > > > > > > > > >> The rust publishing script fails because it cannot find the > > > > >> benchmarks. > > > > >> Seems to be related to cargo changes. > > > > >> I cannot investigate it right now, @Andy could you take a look? > > > > >> > > > > >> On Sun, Oct 6, 2019, 9:11 AM Krisztián Szűcs > > > > >> <szucs.kriszt...@gmail.com> > > > > >> wrote: > > > > >> > > > > >>> - published js packages to npm, please check that they are working > > > > >>> properly > > > > >>> > > > > >>> On Sat, Oct 5, 2019 at 10:14 PM Neal Richardson < > > > > >>> neal.p.richard...@gmail.com> wrote: > > > > >>> > > > > >>>> R release steps per > > > > >>>> > > > > >>>> https://cwiki.apache.org/confluence/display/ARROW/Release+Management+Guide#ReleaseManagementGuide-UpdatingRpackages > > > > >>>> are underway. > > > > >>>> > > > > >>>> Neal > > > > >>>> > > > > >>>> On Sat, Oct 5, 2019 at 8:40 AM Krisztián Szűcs > > > > >>>> <szucs.kriszt...@gmail.com> wrote: > > > > >>>> > > > > > >>>> > - website updated with the release notes > > > > >>>> > - conda-forge updates are merged > > > > >>>> > > > > > >>>> > Remaining: > > > > >>>> > - Javascript > > > > >>>> > - Rust > > > > >>>> > - R > > > > >>>> > - Homebrew > > > > >>>> > - Apidocs > > > > >>>> > > > > > >>>> > On Sat, Oct 5, 2019 at 2:58 PM Sutou Kouhei <k...@clear-code.com> > > > > >>>> wrote: > > > > >>>> > > > > > >>>> > > - uploaded C# packages > > > > >>>> > > > > > > >>>> > > In <CAHM19a6eoiMQZSuZ-29n7LBzHxZYxBigw= > > > > >>>> t1k_vz68rcb3m...@mail.gmail.com> > > > > >>>> > > "Re: [VOTE] Release Apache Arrow 0.15.0 - RC2" on Sat, 5 Oct > > > > >>>> > > 2019 > > > > >>>> > > 14:50:51 +0200, > > > > >>>> > > Krisztián Szűcs <szucs.kriszt...@gmail.com> wrote: > > > > >>>> > > > > > > >>>> > > > - uploaded python wheels to pypi > > > > >>>> > > > - uploaded java artifacts to maven central > > > > >>>> > > > > > > > >>>> > > > I'm going to update the conda recipes. > > > > >>>> > > > > > > > >>>> > > > Remaining: > > > > >>>> > > > - Javascript > > > > >>>> > > > - Rust > > > > >>>> > > > - C# > > > > >>>> > > > - R > > > > >>>> > > > - Homebrew > > > > >>>> > > > - Site > > > > >>>> > > > > > > > >>>> > > > > > > > >>>> > > > > > > > >>>> > > > On Sat, Oct 5, 2019 at 2:29 PM Krisztián Szűcs < > > > > >>>> > > szucs.kriszt...@gmail.com> > > > > >>>> > > > wrote: > > > > >>>> > > > > > > > >>>> > > >> - rebased master > > > > >>>> > > >> - rebased the pull requests > > > > >>>> > > >> - released the jira version > > > > >>>> > > >> - started the new jira version > > > > >>>> > > >> - uploaded source artifacts to svn > > > > >>>> > > >> - uploaded binary artifacts to bintray > > > > >>>> > > >> - currently uploading python wheels to pypi > > > > >>>> > > >> > > > > >>>> > > >> > > > > >>>> > > >> On Sat, Oct 5, 2019 at 2:04 PM Sutou Kouhei > > > > >>>> > > >> <k...@clear-code.com> > > > > >>>> wrote: > > > > >>>> > > >> > > > > >>>> > > >>> I'll release RubyGems. > > > > >>>> > > >>> > > > > >>>> > > >>> In < > > > > >>>> cahm19a5pxw5mq5zgb7pxoerg9rkxrhmadcrpmkw12jkjokw...@mail.gmail.com > > > > >>>> > > > > > > > >>>> > > >>> "Re: [VOTE] Release Apache Arrow 0.15.0 - RC2" on Sat, 5 > > > > >>>> > > >>> Oct > > > > >>>> 2019 > > > > >>>> > > >>> 11:46:16 +0200, > > > > >>>> > > >>> Krisztián Szűcs <szucs.kriszt...@gmail.com> wrote: > > > > >>>> > > >>> > > > > >>>> > > >>> > On Sat, Oct 5, 2019 at 11:40 AM Krisztián Szűcs < > > > > >>>> > > >>> szucs.kriszt...@gmail.com> > > > > >>>> > > >>> > wrote: > > > > >>>> > > >>> > > > > > >>>> > > >>> >> The VOTE carries with 5 binding +1 votes and 2 > > > > >>>> > > >>> >> non-binding > > > > >>>> +1 votes. > > > > >>>> > > >>> >> > > > > >>>> > > >>> >> On Fri, Oct 4, 2019 at 10:04 PM Wes McKinney < > > > > >>>> wesmck...@gmail.com> > > > > >>>> > > >>> wrote: > > > > >>>> > > >>> >> > > > > >>>> > > >>> >>> The commits from your local RC branch aren't available > > > > >>>> > > >>> >>> so I > > > > >>>> cannot > > > > >>>> > > >>> >>> rebase master yet, I'll just wait for you to be > > > > >>>> > > >>> >>> available > > > > >>>> again. > > > > >>>> > > >>> >> > > > > >>>> > > >>> >> Actually those commits are available under the tag. > > > > >>>> > > >>> >> > > > > >>>> > > >>> > The new version updates are indeed only available > > > > >>>> > > >>> > locally. > > > > >>>> I'm doing > > > > >>>> > > the > > > > >>>> > > >>> > rebase. > > > > >>>> > > >>> > > > > > >>>> > > >>> >> If anyone has some spare time we should try to complete > > > > >>>> > > >>> >> as > > > > >>>> many > > > > >>>> > > >>> >>> post-release tasks this weekend so we can announce the > > > > >>>> release on > > > > >>>> > > >>> >>> Monday or Tuesday next week. > > > > >>>> > > >>> >>> > > > > >>>> > > >>> >> > > > > >>>> > > >>> >> We have many post-release tasks, any help is > > > > >>>> > > >>> >> appreciated. > > > > >>>> > > >>> >> > > > > >>>> > > >>> >>> > > > > >>>> > > >>> >>> Thanks all for your help getting this release ready! > > > > >>>> > > >>> >>> > > > > >>>> > > >>> >>> On Fri, Oct 4, 2019 at 6:40 AM Krisztián Szűcs > > > > >>>> > > >>> >>> <szucs.kriszt...@gmail.com> wrote: > > > > >>>> > > >>> >>> > > > > > >>>> > > >>> >>> > We have 5 binding +1 votes and 2 non-binding +1 > > > > >>>> > > >>> >>> > votes so > > > > >>>> far. > > > > >>>> > > >>> >>> > The 72 hours has passed, so we can close the release > > > > >>>> > > >>> >>> > vote. > > > > >>>> > > >>> >>> > > > > > >>>> > > >>> >>> > Sadly I won't be available for the rest of the day, > > > > >>>> > > >>> >>> > so I > > > > >>>> will be > > > > >>>> > > >>> able > > > > >>>> > > >>> >>> > to close the vote and start to work on the the post > > > > >>>> release tasks > > > > >>>> > > >>> >>> > from tomorrow. > > > > >>>> > > >>> >>> > @Wes if you have bandwidth feel free to close the > > > > >>>> > > >>> >>> > vote > > > > >>>> sooner. > > > > >>>> > > >>> >>> > > > > > >>>> > > >>> >>> > > > > > >>>> > > >>> >>> > On Thu, Oct 3, 2019 at 1:14 AM Bryan Cutler < > > > > >>>> cutl...@gmail.com> > > > > >>>> > > >>> wrote: > > > > >>>> > > >>> >>> > > > > > >>>> > > >>> >>> > > Accidentally sent too soon. The ORC build error I > > > > >>>> > > >>> >>> > > got > > > > >>>> was > > > > >>>> > > probably > > > > >>>> > > >>> >>> just an > > > > >>>> > > >>> >>> > > env issue for me, but here it is in case anyone > > > > >>>> > > >>> >>> > > else > > > > >>>> had the > > > > >>>> > > same > > > > >>>> > > >>> >>> issue: > > > > >>>> > > >>> >>> > > > > > > >>>> > > >>> >>> > > In file included from > > > > >>>> > > >>> >>> > > > > > > >>>> > > >>> >>> > > > > > > >>>> > > >>> >>> > > > > >>>> > > >>> > > > > >>>> > > > > > > >>>> ESC[01mESC[K/tmp/arrow-0.15.0.KxYbA/apache-arrow-0.15.0/cpp/build/orc_ep-prefix/src/orc_ep/c++/src/wrap/orc-proto-wrapper.cc:44:0ESC[mESC[K: > > > > >>>> > > >>> >>> > > > > > > >>>> > > >>> >>> > > > > > > >>>> > > >>> >>> > > > > >>>> > > >>> > > > > >>>> > > > > > > >>>> ESC[01mESC[K/tmp/arrow-0.15.0.KxYbA/apache-arrow-0.15.0/cpp/build/orc_ep-prefix/src/orc_ep-build/c++/src/ > > > > >>>> > > >>> >>> orc_proto.pb.cc:970 > > > > >>>> > > >>> >>> > > :13:ESC[mESC[K > > > > >>>> > > >>> >>> > > ESC[01;31mESC[Kerror: > > > > >>>> > > >>> >>> > > > > > > >>>> > > >>> >>> > > > > >>>> > > >>> > > > > >>>> > > > > > > >>>> ESC[mESC[K‘ESC[01mESC[Kdynamic_init_dummy_orc_5fproto_2eprotoESC[mESC[K’ > > > > >>>> > > >>> >>> > > defined but not used [-Werror=unused-variable] > > > > >>>> > > >>> >>> > > static bool > > > > >>>> > > >>> >>> > > dynamic_init_dummy_orc_5fproto_2eproto = > > > > >>>> []() { > > > > >>>> > > >>> >>> > > AddDescriptors_orc_5fproto_2eproto(); return true; > > > > >>>> > > >>> >>> > > }(); > > > > >>>> > > >>> >>> > > ESC[01;32mESC[K ^ESC[mESC[K > > > > >>>> > > >>> >>> > > cc1plus: all warnings being treated as errors > > > > >>>> > > >>> >>> > > make[5]: *** > > > > >>>> > > >>> [c++/src/CMakeFiles/orc.dir/wrap/orc-proto-wrapper.cc.o] > > > > >>>> > > >>> >>> Error > > > > >>>> > > >>> >>> > > 1 > > > > >>>> > > >>> >>> > > make[5]: *** Waiting for unfinished jobs.... > > > > >>>> > > >>> >>> > > make[4]: *** [c++/src/CMakeFiles/orc.dir/all] > > > > >>>> > > >>> >>> > > Error 2 > > > > >>>> > > >>> >>> > > make[3]: *** [all] Error 2 > > > > >>>> > > >>> >>> > > > > > > >>>> > > >>> >>> > > [ 29%] Performing build step for 'orc_ep' > > > > >>>> > > >>> >>> > > CMake Error at > > > > >>>> > > >>> >>> > > > > > > >>>> > > >>> >>> > > > > > > >>>> > > >>> >>> > > > > >>>> > > >>> > > > > >>>> > > > > > > >>>> /tmp/arrow-0.15.0.KxYbA/apache-arrow-0.15.0/cpp/build/orc_ep-prefix/src/orc_ep-stamp/orc_ep-build-RELEASE.cmake:16 > > > > >>>> > > >>> >>> > > (message): > > > > >>>> > > >>> >>> > > Command failed: 2 > > > > >>>> > > >>> >>> > > > > > > >>>> > > >>> >>> > > 'make' > > > > >>>> > > >>> >>> > > > > > > >>>> > > >>> >>> > > See also > > > > >>>> > > >>> >>> > > > > > > >>>> > > >>> >>> > > > > > > >>>> > > >>> >>> > > > > > > >>>> > > >>> >>> > > > > > > >>>> > > >>> >>> > > > > >>>> > > >>> > > > > >>>> > > > > > > >>>> /tmp/arrow-0.15.0.KxYbA/apache-arrow-0.15.0/cpp/build/orc_ep-prefix/src/orc_ep-stamp/orc_ep-build-*.log > > > > >>>> > > >>> >>> > > > > > > >>>> > > >>> >>> > > CMakeFiles/orc_ep.dir/build.make:111: recipe for > > > > >>>> > > >>> >>> > > target > > > > >>>> > > >>> >>> > > 'orc_ep-prefix/src/orc_ep-stamp/orc_ep-build' > > > > >>>> > > >>> >>> > > failed > > > > >>>> > > >>> >>> > > make[2]: *** > > > > >>>> [orc_ep-prefix/src/orc_ep-stamp/orc_ep-build] > > > > >>>> > > Error 1 > > > > >>>> > > >>> >>> > > CMakeFiles/Makefile2:1248: recipe for target > > > > >>>> > > >>> >>> 'CMakeFiles/orc_ep.dir/all' > > > > >>>> > > >>> >>> > > failed > > > > >>>> > > >>> >>> > > make[1]: *** [CMakeFiles/orc_ep.dir/all] Error 2 > > > > >>>> > > >>> >>> > > > > > > >>>> > > >>> >>> > > On Wed, Oct 2, 2019 at 4:12 PM Bryan Cutler < > > > > >>>> cutl...@gmail.com > > > > >>>> > > > > > > > >>>> > > >>> >>> wrote: > > > > >>>> > > >>> >>> > > > > > > >>>> > > >>> >>> > > > +1 (non-binding) > > > > >>>> > > >>> >>> > > > > > > > >>>> > > >>> >>> > > > I ran the following on Ubuntu 16.04 > > > > >>>> > > >>> >>> > > > 4.15.0-64-generic: > > > > >>>> > > >>> >>> > > > > dev/release/verify-release-candidate.sh > > > > >>>> > > >>> >>> > > > > binaries > > > > >>>> 0.15.0 2 > > > > >>>> > > >>> >>> > > > > ARROW_CUDA=OFF \ > > > > >>>> > > >>> >>> > > > TEST_DEFAULT=0 \ > > > > >>>> > > >>> >>> > > > TEST_SOURCE=1 \ > > > > >>>> > > >>> >>> > > > TEST_CPP=1 \ > > > > >>>> > > >>> >>> > > > TEST_PYTHON=1 \ > > > > >>>> > > >>> >>> > > > TEST_JAVA=1 \ > > > > >>>> > > >>> >>> > > > TEST_INTEGRATION=1 \ > > > > >>>> > > >>> >>> > > > dev/release/verify-release-candidate.sh source > > > > >>>> > > >>> >>> > > > 0.15.0 > > > > >>>> 2 > > > > >>>> > > >>> >>> > > > > > > > >>>> > > >>> >>> > > > For source verification I set > > > > >>>> > > >>> INTEGRATION_TEST_ARGS="--enable-js=0 > > > > >>>> > > >>> >>> > > > --enable-go=0" > > > > >>>> > > >>> >>> > > > > > > > >>>> > > >>> >>> > > > When attempting source verification with > > > > >>>> > > >>> >>> > > > defaults, I > > > > >>>> got the > > > > >>>> > > >>> below > > > > >>>> > > >>> >>> error > > > > >>>> > > >>> >>> > > > when building the ORC adapter. It looks like > > > > >>>> > > >>> >>> > > > just a > > > > >>>> warning > > > > >>>> > > >>> that is > > > > >>>> > > >>> >>> being > > > > >>>> > > >>> >>> > > > treated as error and seems to be only in > > > > >>>> > > >>> >>> > > > > > > > >>>> > > >>> >>> > > > On Wed, Oct 2, 2019 at 7:53 AM Andy Grove < > > > > >>>> > > >>> andygrov...@gmail.com> > > > > >>>> > > >>> >>> wrote: > > > > >>>> > > >>> >>> > > > > > > > >>>> > > >>> >>> > > >> +1 (binding) > > > > >>>> > > >>> >>> > > >> > > > > >>>> > > >>> >>> > > >> On Mon, Sep 30, 2019 at 11:57 PM Krisztián > > > > >>>> > > >>> >>> > > >> Szűcs < > > > > >>>> > > >>> >>> > > >> szucs.kriszt...@gmail.com> > > > > >>>> > > >>> >>> > > >> wrote: > > > > >>>> > > >>> >>> > > >> > > > > >>>> > > >>> >>> > > >> > Hi, > > > > >>>> > > >>> >>> > > >> > > > > > >>>> > > >>> >>> > > >> > I would like to propose the following release > > > > >>>> candidate > > > > >>>> > > >>> (RC2) of > > > > >>>> > > >>> >>> > > Apache > > > > >>>> > > >>> >>> > > >> > Arrow version 0.15.0. This is a release > > > > >>>> > > >>> >>> > > >> > consiting > > > > >>>> of 697 > > > > >>>> > > >>> >>> > > >> > resolved JIRA issues[1]. > > > > >>>> > > >>> >>> > > >> > > > > > >>>> > > >>> >>> > > >> > This release candidate is based on commit: > > > > >>>> > > >>> >>> > > >> > 40d468e162e88e1761b1e80b3ead060f0be927ee [2] > > > > >>>> > > >>> >>> > > >> > > > > > >>>> > > >>> >>> > > >> > The source release rc2 is hosted at [3]. > > > > >>>> > > >>> >>> > > >> > The binary artifacts are hosted at > > > > >>>> > > >>> >>> > > >> > [4][5][6][7]. > > > > >>>> > > >>> >>> > > >> > The changelog is located at [8]. > > > > >>>> > > >>> >>> > > >> > > > > > >>>> > > >>> >>> > > >> > Please download, verify checksums and > > > > >>>> > > >>> >>> > > >> > signatures, > > > > >>>> run the > > > > >>>> > > >>> unit > > > > >>>> > > >>> >>> tests, > > > > >>>> > > >>> >>> > > >> > and vote on the release. See [9] for how to > > > > >>>> validate a > > > > >>>> > > >>> release > > > > >>>> > > >>> >>> > > >> candidate. > > > > >>>> > > >>> >>> > > >> > > > > > >>>> > > >>> >>> > > >> > The vote will be open for at least 72 hours. > > > > >>>> > > >>> >>> > > >> > > > > > >>>> > > >>> >>> > > >> > [ ] +1 Release this as Apache Arrow 0.15.0 > > > > >>>> > > >>> >>> > > >> > [ ] +0 > > > > >>>> > > >>> >>> > > >> > [ ] -1 Do not release this as Apache Arrow > > > > >>>> > > >>> >>> > > >> > 0.15.0 > > > > >>>> > > because... > > > > >>>> > > >>> >>> > > >> > > > > > >>>> > > >>> >>> > > >> > [1]: > > > > >>>> > > >>> >>> > > >> > > > > > >>>> > > >>> >>> > > >> > > > > > >>>> > > >>> >>> > > >> > > > > >>>> > > >>> >>> > > > > > > >>>> > > >>> >>> > > > > >>>> > > >>> > > > > >>>> > > > > > > >>>> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.15.0 > > > > >>>> > > >>> >>> > > >> > [2]: > > > > >>>> > > >>> >>> > > >> > > > > > >>>> > > >>> >>> > > >> > > > > > >>>> > > >>> >>> > > >> > > > > >>>> > > >>> >>> > > > > > > >>>> > > >>> >>> > > > > >>>> > > >>> > > > > >>>> > > > > > > >>>> https://github.com/apache/arrow/tree/40d468e162e88e1761b1e80b3ead060f0be927ee > > > > >>>> > > >>> >>> > > >> > [3]: > > > > >>>> > > >>> >>> > > >> > > > > >>>> > > >>> >>> > > > > >>>> > > > > > > >>>> https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.15.0-rc2 > > > > >>>> > > >>> >>> > > >> > [4]: > > > > >>>> > > https://bintray.com/apache/arrow/centos-rc/0.15.0-rc2 > > > > >>>> > > >>> >>> > > >> > [5]: > > > > >>>> > > https://bintray.com/apache/arrow/debian-rc/0.15.0-rc2 > > > > >>>> > > >>> >>> > > >> > [6]: > > > > >>>> > > https://bintray.com/apache/arrow/python-rc/0.15.0-rc2 > > > > >>>> > > >>> >>> > > >> > [7]: > > > > >>>> > > https://bintray.com/apache/arrow/ubuntu-rc/0.15.0-rc2 > > > > >>>> > > >>> >>> > > >> > [8]: > > > > >>>> > > >>> >>> > > >> > > > > > >>>> > > >>> >>> > > >> > > > > > >>>> > > >>> >>> > > >> > > > > >>>> > > >>> >>> > > > > > > >>>> > > >>> >>> > > > > >>>> > > >>> > > > > >>>> > > > > > > >>>> https://github.com/apache/arrow/blob/40d468e162e88e1761b1e80b3ead060f0be927ee/CHANGELOG.md > > > > >>>> > > >>> >>> > > >> > [9]: > > > > >>>> > > >>> >>> > > >> > > > > > >>>> > > >>> >>> > > >> > > > > > >>>> > > >>> >>> > > >> > > > > >>>> > > >>> >>> > > > > > > >>>> > > >>> >>> > > > > >>>> > > >>> > > > > >>>> > > > > > > >>>> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates > > > > >>>> > > >>> >>> > > >> > > > > > >>>> > > >>> >>> > > >> > > > > >>>> > > >>> >>> > > > > > > > >>>> > > >>> >>> > > > > > > >>>> > > >>> >>> > > > > >>>> > > >>> >> > > > > >>>> > > >>> > > > > >>>> > > >> > > > > >>>> > > > > > > >>>> > > > > >>>
