Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-11 Thread Krisztián Szűcs
All of the wheels are uploaded now
https://pypi.org/project/pyarrow/0.16.0/#files

On Mon, Feb 10, 2020 at 4:53 PM Neal Richardson
 wrote:
>
> We also have the release blog post to finish up and publish:
> https://github.com/apache/arrow-site/pull/41
>
> On Mon, Feb 10, 2020 at 7:32 AM Krisztián Szűcs 
> wrote:
>
> > Updated checklist:
> >
> > - [DONE] marking the released version as "RELEASED" on JIRA
> > - [DONE] rebase the master branch on top of the release branch
> > - [DONE] rebase the pull requests
> > - [DONE] uploading source release artifacts to SVN
> > - [DONE] uploading binary release artifacts to Bintray
> > - [DONE] updating the Arrow website
> > - [DONE] python source distribution
> > - [DONE] ruby gems
> > - [DONE] javascript npm packages
> > - [DONE] .NET nuget packages
> > - [DONE] java maven artifacts
> > - [DONE] conda packages
> > - [DONE] rust packages
> > - [DONE] R packages
> > - [DONE] homebrew packages
> > - [DONE] announcing release
> > - [kszucs] python wheels
> >   Still waiting for PyPA's response.
> > - [kszucs] updating website with new API documentation
> >   In-progress.
> >
> > On Mon, Feb 10, 2020 at 4:27 PM Krisztián Szűcs
> >  wrote:
> > >
> > > Indeed, it is here
> > >
> > https://lists.apache.org/thread.html/rf3a0840c152d7eeefb6862c3a54f986595f88b439b0c82780d15f998%40%3Cdev.arrow.apache.org%3E
> > >
> > > On Mon, Feb 10, 2020 at 4:25 PM Francois Saint-Jacques
> > >  wrote:
> > > >
> > > > I received it.
> > > >
> > > > On Mon, Feb 10, 2020 at 10:24 AM Krisztián Szűcs
> > > >  wrote:
> > > > >
> > > > > I've already announced the release 4 hours ago with my @apache
> > address.
> > > > > Although I cannot see it in the archive [1].
> > > > >
> > > > > I suppose it didn't go through, no clue why.
> > > > >
> > > > > [1] https://lists.apache.org/list.html?dev@arrow.apache.org
> > > > >
> > > > >
> > > > > On Mon, Feb 10, 2020 at 3:57 PM Wes McKinney 
> > wrote:
> > > > > >
> > > > > > Can we announce the release? Let me know if I can help with
> > anything
> > > > > >
> > > > > > On Sun, Feb 9, 2020 at 6:23 PM Sutou Kouhei 
> > wrote:
> > > > > > >
> > > > > > > Hi,
> > > > > > >
> > > > > > > MSYS2 package is updated:
> > > > > > > https://github.com/msys2/MINGW-packages/pull/6175
> > > > > > >
> > > > > > >
> > > > > > > Thanks,
> > > > > > > --
> > > > > > > kou
> > > > > > >
> > > > > > > In <
> > caocv4hjxyy_yukdzgrayf3bce65txmljjkdodz+f2zpk5op...@mail.gmail.com>
> > > > > > >   "Re: [VOTE] Release Apache Arrow 0.16.0 - RC2" on Sun, 9 Feb
> > 2020 09:06:39 -0800,
> > > > > > >   Neal Richardson  wrote:
> > > > > > >
> > > > > > > > R package 0.16.0 has been accepted by CRAN; may take a few
> > more days for
> > > > > > > > CRAN to build Windows and macOS binaries.
> > > > > > > >
> > > > > > > > Neal
> > > > > > > >
> > > > > > > > On Fri, Feb 7, 2020 at 4:50 PM Neal Richardson <
> > neal.p.richard...@gmail.com>
> > > > > > > > wrote:
> > > > > > > >
> > > > > > > >> Homebrew PR is up:
> > https://github.com/Homebrew/homebrew-core/pull/49908
> > > > > > > >>
> > > > > > > >>
> > > > > > > >>
> > > > > > > >> On Fri, Feb 7, 2020 at 3:44 PM Neal Richardson <
> > > > > > > >> neal.p.richard...@gmail.com> wrote:
> > > > > > > >>
> > > > > > > >>> I'm working (with Jeroen) on the R package stuff, and I'll
> > put together
> > > > > > > >>> the homebrew formula PR now.
> > > > > > > >>>
> > > > > > > >>> Neal
> > > > > > > >>>
> > > > > > > >>> On Fri, Feb 7, 2020 at 6:42 AM Andy Grove <
> > andygrov

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-10 Thread Neal Richardson
We also have the release blog post to finish up and publish:
https://github.com/apache/arrow-site/pull/41

On Mon, Feb 10, 2020 at 7:32 AM Krisztián Szűcs 
wrote:

> Updated checklist:
>
> - [DONE] marking the released version as "RELEASED" on JIRA
> - [DONE] rebase the master branch on top of the release branch
> - [DONE] rebase the pull requests
> - [DONE] uploading source release artifacts to SVN
> - [DONE] uploading binary release artifacts to Bintray
> - [DONE] updating the Arrow website
> - [DONE] python source distribution
> - [DONE] ruby gems
> - [DONE] javascript npm packages
> - [DONE] .NET nuget packages
> - [DONE] java maven artifacts
> - [DONE] conda packages
> - [DONE] rust packages
> - [DONE] R packages
> - [DONE] homebrew packages
> - [DONE] announcing release
> - [kszucs] python wheels
>   Still waiting for PyPA's response.
> - [kszucs] updating website with new API documentation
>   In-progress.
>
> On Mon, Feb 10, 2020 at 4:27 PM Krisztián Szűcs
>  wrote:
> >
> > Indeed, it is here
> >
> https://lists.apache.org/thread.html/rf3a0840c152d7eeefb6862c3a54f986595f88b439b0c82780d15f998%40%3Cdev.arrow.apache.org%3E
> >
> > On Mon, Feb 10, 2020 at 4:25 PM Francois Saint-Jacques
> >  wrote:
> > >
> > > I received it.
> > >
> > > On Mon, Feb 10, 2020 at 10:24 AM Krisztián Szűcs
> > >  wrote:
> > > >
> > > > I've already announced the release 4 hours ago with my @apache
> address.
> > > > Although I cannot see it in the archive [1].
> > > >
> > > > I suppose it didn't go through, no clue why.
> > > >
> > > > [1] https://lists.apache.org/list.html?dev@arrow.apache.org
> > > >
> > > >
> > > > On Mon, Feb 10, 2020 at 3:57 PM Wes McKinney 
> wrote:
> > > > >
> > > > > Can we announce the release? Let me know if I can help with
> anything
> > > > >
> > > > > On Sun, Feb 9, 2020 at 6:23 PM Sutou Kouhei 
> wrote:
> > > > > >
> > > > > > Hi,
> > > > > >
> > > > > > MSYS2 package is updated:
> > > > > > https://github.com/msys2/MINGW-packages/pull/6175
> > > > > >
> > > > > >
> > > > > > Thanks,
> > > > > > --
> > > > > > kou
> > > > > >
> > > > > > In <
> caocv4hjxyy_yukdzgrayf3bce65txmljjkdodz+f2zpk5op...@mail.gmail.com>
> > > > > >   "Re: [VOTE] Release Apache Arrow 0.16.0 - RC2" on Sun, 9 Feb
> 2020 09:06:39 -0800,
> > > > > >   Neal Richardson  wrote:
> > > > > >
> > > > > > > R package 0.16.0 has been accepted by CRAN; may take a few
> more days for
> > > > > > > CRAN to build Windows and macOS binaries.
> > > > > > >
> > > > > > > Neal
> > > > > > >
> > > > > > > On Fri, Feb 7, 2020 at 4:50 PM Neal Richardson <
> neal.p.richard...@gmail.com>
> > > > > > > wrote:
> > > > > > >
> > > > > > >> Homebrew PR is up:
> https://github.com/Homebrew/homebrew-core/pull/49908
> > > > > > >>
> > > > > > >>
> > > > > > >>
> > > > > > >> On Fri, Feb 7, 2020 at 3:44 PM Neal Richardson <
> > > > > > >> neal.p.richard...@gmail.com> wrote:
> > > > > > >>
> > > > > > >>> I'm working (with Jeroen) on the R package stuff, and I'll
> put together
> > > > > > >>> the homebrew formula PR now.
> > > > > > >>>
> > > > > > >>> Neal
> > > > > > >>>
> > > > > > >>> On Fri, Feb 7, 2020 at 6:42 AM Andy Grove <
> andygrov...@gmail.com> wrote:
> > > > > > >>>
> > > > > > >>>> Rust crates are published. Filed
> > > > > > >>>> https://issues.apache.org/jira/browse/ARROW-7794 for the
> arrow-flight
> > > > > > >>>> issue.
> > > > > > >>>>
> > > > > > >>>> On Fri, Feb 7, 2020 at 7:05 AM Andy Grove <
> andygrov...@gmail.com> wrote:
> > > > > > >>>>
> > > > > > >>>> > I'll look at the Rust issue now.
> 

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-10 Thread Krisztián Szűcs
Updated checklist:

- [DONE] marking the released version as "RELEASED" on JIRA
- [DONE] rebase the master branch on top of the release branch
- [DONE] rebase the pull requests
- [DONE] uploading source release artifacts to SVN
- [DONE] uploading binary release artifacts to Bintray
- [DONE] updating the Arrow website
- [DONE] python source distribution
- [DONE] ruby gems
- [DONE] javascript npm packages
- [DONE] .NET nuget packages
- [DONE] java maven artifacts
- [DONE] conda packages
- [DONE] rust packages
- [DONE] R packages
- [DONE] homebrew packages
- [DONE] announcing release
- [kszucs] python wheels
  Still waiting for PyPA's response.
- [kszucs] updating website with new API documentation
  In-progress.

On Mon, Feb 10, 2020 at 4:27 PM Krisztián Szűcs
 wrote:
>
> Indeed, it is here
> https://lists.apache.org/thread.html/rf3a0840c152d7eeefb6862c3a54f986595f88b439b0c82780d15f998%40%3Cdev.arrow.apache.org%3E
>
> On Mon, Feb 10, 2020 at 4:25 PM Francois Saint-Jacques
>  wrote:
> >
> > I received it.
> >
> > On Mon, Feb 10, 2020 at 10:24 AM Krisztián Szűcs
> >  wrote:
> > >
> > > I've already announced the release 4 hours ago with my @apache address.
> > > Although I cannot see it in the archive [1].
> > >
> > > I suppose it didn't go through, no clue why.
> > >
> > > [1] https://lists.apache.org/list.html?dev@arrow.apache.org
> > >
> > >
> > > On Mon, Feb 10, 2020 at 3:57 PM Wes McKinney  wrote:
> > > >
> > > > Can we announce the release? Let me know if I can help with anything
> > > >
> > > > On Sun, Feb 9, 2020 at 6:23 PM Sutou Kouhei  wrote:
> > > > >
> > > > > Hi,
> > > > >
> > > > > MSYS2 package is updated:
> > > > > https://github.com/msys2/MINGW-packages/pull/6175
> > > > >
> > > > >
> > > > > Thanks,
> > > > > --
> > > > > kou
> > > > >
> > > > > In 
> > > > > 
> > > > >   "Re: [VOTE] Release Apache Arrow 0.16.0 - RC2" on Sun, 9 Feb 2020 
> > > > > 09:06:39 -0800,
> > > > >   Neal Richardson  wrote:
> > > > >
> > > > > > R package 0.16.0 has been accepted by CRAN; may take a few more 
> > > > > > days for
> > > > > > CRAN to build Windows and macOS binaries.
> > > > > >
> > > > > > Neal
> > > > > >
> > > > > > On Fri, Feb 7, 2020 at 4:50 PM Neal Richardson 
> > > > > > 
> > > > > > wrote:
> > > > > >
> > > > > >> Homebrew PR is up: 
> > > > > >> https://github.com/Homebrew/homebrew-core/pull/49908
> > > > > >>
> > > > > >>
> > > > > >>
> > > > > >> On Fri, Feb 7, 2020 at 3:44 PM Neal Richardson <
> > > > > >> neal.p.richard...@gmail.com> wrote:
> > > > > >>
> > > > > >>> I'm working (with Jeroen) on the R package stuff, and I'll put 
> > > > > >>> together
> > > > > >>> the homebrew formula PR now.
> > > > > >>>
> > > > > >>> Neal
> > > > > >>>
> > > > > >>> On Fri, Feb 7, 2020 at 6:42 AM Andy Grove  
> > > > > >>> wrote:
> > > > > >>>
> > > > > >>>> Rust crates are published. Filed
> > > > > >>>> https://issues.apache.org/jira/browse/ARROW-7794 for the 
> > > > > >>>> arrow-flight
> > > > > >>>> issue.
> > > > > >>>>
> > > > > >>>> On Fri, Feb 7, 2020 at 7:05 AM Andy Grove 
> > > > > >>>>  wrote:
> > > > > >>>>
> > > > > >>>> > I'll look at the Rust issue now.
> > > > > >>>> >
> > > > > >>>> > On Fri, Feb 7, 2020 at 3:27 AM Krisztián Szűcs <
> > > > > >>>> szucs.kriszt...@gmail.com>
> > > > > >>>> > wrote:
> > > > > >>>> >
> > > > > >>>> >> Status of the post release tasks:
> > > > > >>>> >>
> > > > > >>>> >> - [DONE] marking the released version as "RELEASED" on JIRA
> > >

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-10 Thread Krisztián Szűcs
Indeed, it is here
https://lists.apache.org/thread.html/rf3a0840c152d7eeefb6862c3a54f986595f88b439b0c82780d15f998%40%3Cdev.arrow.apache.org%3E

On Mon, Feb 10, 2020 at 4:25 PM Francois Saint-Jacques
 wrote:
>
> I received it.
>
> On Mon, Feb 10, 2020 at 10:24 AM Krisztián Szűcs
>  wrote:
> >
> > I've already announced the release 4 hours ago with my @apache address.
> > Although I cannot see it in the archive [1].
> >
> > I suppose it didn't go through, no clue why.
> >
> > [1] https://lists.apache.org/list.html?dev@arrow.apache.org
> >
> >
> > On Mon, Feb 10, 2020 at 3:57 PM Wes McKinney  wrote:
> > >
> > > Can we announce the release? Let me know if I can help with anything
> > >
> > > On Sun, Feb 9, 2020 at 6:23 PM Sutou Kouhei  wrote:
> > > >
> > > > Hi,
> > > >
> > > > MSYS2 package is updated:
> > > > https://github.com/msys2/MINGW-packages/pull/6175
> > > >
> > > >
> > > > Thanks,
> > > > --
> > > > kou
> > > >
> > > > In 
> > > >   "Re: [VOTE] Release Apache Arrow 0.16.0 - RC2" on Sun, 9 Feb 2020 
> > > > 09:06:39 -0800,
> > > >   Neal Richardson  wrote:
> > > >
> > > > > R package 0.16.0 has been accepted by CRAN; may take a few more days 
> > > > > for
> > > > > CRAN to build Windows and macOS binaries.
> > > > >
> > > > > Neal
> > > > >
> > > > > On Fri, Feb 7, 2020 at 4:50 PM Neal Richardson 
> > > > > 
> > > > > wrote:
> > > > >
> > > > >> Homebrew PR is up: 
> > > > >> https://github.com/Homebrew/homebrew-core/pull/49908
> > > > >>
> > > > >>
> > > > >>
> > > > >> On Fri, Feb 7, 2020 at 3:44 PM Neal Richardson <
> > > > >> neal.p.richard...@gmail.com> wrote:
> > > > >>
> > > > >>> I'm working (with Jeroen) on the R package stuff, and I'll put 
> > > > >>> together
> > > > >>> the homebrew formula PR now.
> > > > >>>
> > > > >>> Neal
> > > > >>>
> > > > >>> On Fri, Feb 7, 2020 at 6:42 AM Andy Grove  
> > > > >>> wrote:
> > > > >>>
> > > > >>>> Rust crates are published. Filed
> > > > >>>> https://issues.apache.org/jira/browse/ARROW-7794 for the 
> > > > >>>> arrow-flight
> > > > >>>> issue.
> > > > >>>>
> > > > >>>> On Fri, Feb 7, 2020 at 7:05 AM Andy Grove  
> > > > >>>> wrote:
> > > > >>>>
> > > > >>>> > I'll look at the Rust issue now.
> > > > >>>> >
> > > > >>>> > On Fri, Feb 7, 2020 at 3:27 AM Krisztián Szűcs <
> > > > >>>> szucs.kriszt...@gmail.com>
> > > > >>>> > wrote:
> > > > >>>> >
> > > > >>>> >> Status of the post release tasks:
> > > > >>>> >>
> > > > >>>> >> - [DONE] marking the released version as "RELEASED" on JIRA
> > > > >>>> >> - [DONE] rebase the master branch on top of the release branch
> > > > >>>> >>   We have failing builds on the master because of the bumped 
> > > > >>>> >> version
> > > > >>>> >> numbers, those must be fixed.
> > > > >>>> >> - [DONE] rebase the pull requests
> > > > >>>> >> - [DONE] uploading source release artifacts to SVN
> > > > >>>> >> - [DONE] uploading binary release artifacts to Bintray
> > > > >>>> >> - [DONE] updating the Arrow website
> > > > >>>> >> - [DONE] python source distribution
> > > > >>>> >> - [DONE] ruby gems
> > > > >>>> >> - [DONE] javascript npm packages
> > > > >>>> >> - [DONE] .NET nuget packages
> > > > >>>> >> - [DONE] java maven artifacts
> > > > >>>> >>I had to re-stage the maven artifacts
> > > > >>>

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-10 Thread Francois Saint-Jacques
I received it.

On Mon, Feb 10, 2020 at 10:24 AM Krisztián Szűcs
 wrote:
>
> I've already announced the release 4 hours ago with my @apache address.
> Although I cannot see it in the archive [1].
>
> I suppose it didn't go through, no clue why.
>
> [1] https://lists.apache.org/list.html?dev@arrow.apache.org
>
>
> On Mon, Feb 10, 2020 at 3:57 PM Wes McKinney  wrote:
> >
> > Can we announce the release? Let me know if I can help with anything
> >
> > On Sun, Feb 9, 2020 at 6:23 PM Sutou Kouhei  wrote:
> > >
> > > Hi,
> > >
> > > MSYS2 package is updated:
> > > https://github.com/msys2/MINGW-packages/pull/6175
> > >
> > >
> > > Thanks,
> > > --
> > > kou
> > >
> > > In 
> > >   "Re: [VOTE] Release Apache Arrow 0.16.0 - RC2" on Sun, 9 Feb 2020 
> > > 09:06:39 -0800,
> > >   Neal Richardson  wrote:
> > >
> > > > R package 0.16.0 has been accepted by CRAN; may take a few more days for
> > > > CRAN to build Windows and macOS binaries.
> > > >
> > > > Neal
> > > >
> > > > On Fri, Feb 7, 2020 at 4:50 PM Neal Richardson 
> > > > 
> > > > wrote:
> > > >
> > > >> Homebrew PR is up: https://github.com/Homebrew/homebrew-core/pull/49908
> > > >>
> > > >>
> > > >>
> > > >> On Fri, Feb 7, 2020 at 3:44 PM Neal Richardson <
> > > >> neal.p.richard...@gmail.com> wrote:
> > > >>
> > > >>> I'm working (with Jeroen) on the R package stuff, and I'll put 
> > > >>> together
> > > >>> the homebrew formula PR now.
> > > >>>
> > > >>> Neal
> > > >>>
> > > >>> On Fri, Feb 7, 2020 at 6:42 AM Andy Grove  
> > > >>> wrote:
> > > >>>
> > > >>>> Rust crates are published. Filed
> > > >>>> https://issues.apache.org/jira/browse/ARROW-7794 for the arrow-flight
> > > >>>> issue.
> > > >>>>
> > > >>>> On Fri, Feb 7, 2020 at 7:05 AM Andy Grove  
> > > >>>> wrote:
> > > >>>>
> > > >>>> > I'll look at the Rust issue now.
> > > >>>> >
> > > >>>> > On Fri, Feb 7, 2020 at 3:27 AM Krisztián Szűcs <
> > > >>>> szucs.kriszt...@gmail.com>
> > > >>>> > wrote:
> > > >>>> >
> > > >>>> >> Status of the post release tasks:
> > > >>>> >>
> > > >>>> >> - [DONE] marking the released version as "RELEASED" on JIRA
> > > >>>> >> - [DONE] rebase the master branch on top of the release branch
> > > >>>> >>   We have failing builds on the master because of the bumped 
> > > >>>> >> version
> > > >>>> >> numbers, those must be fixed.
> > > >>>> >> - [DONE] rebase the pull requests
> > > >>>> >> - [DONE] uploading source release artifacts to SVN
> > > >>>> >> - [DONE] uploading binary release artifacts to Bintray
> > > >>>> >> - [DONE] updating the Arrow website
> > > >>>> >> - [DONE] python source distribution
> > > >>>> >> - [DONE] ruby gems
> > > >>>> >> - [DONE] javascript npm packages
> > > >>>> >> - [DONE] .NET nuget packages
> > > >>>> >> - [DONE] java maven artifacts
> > > >>>> >>I had to re-stage the maven artifacts
> > > >>>> >> - [kszucs] python wheels
> > > >>>> >>   Partially done, the manylinux2010 and manylinux2014 wheels have 
> > > >>>> >> hit
> > > >>>> >> the 60MB limit of pypi, requested to increase it
> > > >>>> >> https://github.com/pypa/pypi-support/issues/186
> > > >>>> >> - [xhochy] conda packages
> > > >>>> >>   Uwe works on it, arrow-cpp is already merged.
> > > >>>> >> - [andygrove] rust packages
> > > >>>> >>Arrow-flight misses the format directory, didn't dig deeper. 
> > > >>>> >> Andy
> > > >

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-10 Thread Krisztián Szűcs
I've already announced the release 4 hours ago with my @apache address.
Although I cannot see it in the archive [1].

I suppose it didn't go through, no clue why.

[1] https://lists.apache.org/list.html?dev@arrow.apache.org


On Mon, Feb 10, 2020 at 3:57 PM Wes McKinney  wrote:
>
> Can we announce the release? Let me know if I can help with anything
>
> On Sun, Feb 9, 2020 at 6:23 PM Sutou Kouhei  wrote:
> >
> > Hi,
> >
> > MSYS2 package is updated:
> > https://github.com/msys2/MINGW-packages/pull/6175
> >
> >
> > Thanks,
> > --
> > kou
> >
> > In 
> >   "Re: [VOTE] Release Apache Arrow 0.16.0 - RC2" on Sun, 9 Feb 2020 
> > 09:06:39 -0800,
> >   Neal Richardson  wrote:
> >
> > > R package 0.16.0 has been accepted by CRAN; may take a few more days for
> > > CRAN to build Windows and macOS binaries.
> > >
> > > Neal
> > >
> > > On Fri, Feb 7, 2020 at 4:50 PM Neal Richardson 
> > > 
> > > wrote:
> > >
> > >> Homebrew PR is up: https://github.com/Homebrew/homebrew-core/pull/49908
> > >>
> > >>
> > >>
> > >> On Fri, Feb 7, 2020 at 3:44 PM Neal Richardson <
> > >> neal.p.richard...@gmail.com> wrote:
> > >>
> > >>> I'm working (with Jeroen) on the R package stuff, and I'll put together
> > >>> the homebrew formula PR now.
> > >>>
> > >>> Neal
> > >>>
> > >>> On Fri, Feb 7, 2020 at 6:42 AM Andy Grove  wrote:
> > >>>
> > >>>> Rust crates are published. Filed
> > >>>> https://issues.apache.org/jira/browse/ARROW-7794 for the arrow-flight
> > >>>> issue.
> > >>>>
> > >>>> On Fri, Feb 7, 2020 at 7:05 AM Andy Grove  
> > >>>> wrote:
> > >>>>
> > >>>> > I'll look at the Rust issue now.
> > >>>> >
> > >>>> > On Fri, Feb 7, 2020 at 3:27 AM Krisztián Szűcs <
> > >>>> szucs.kriszt...@gmail.com>
> > >>>> > wrote:
> > >>>> >
> > >>>> >> Status of the post release tasks:
> > >>>> >>
> > >>>> >> - [DONE] marking the released version as "RELEASED" on JIRA
> > >>>> >> - [DONE] rebase the master branch on top of the release branch
> > >>>> >>   We have failing builds on the master because of the bumped version
> > >>>> >> numbers, those must be fixed.
> > >>>> >> - [DONE] rebase the pull requests
> > >>>> >> - [DONE] uploading source release artifacts to SVN
> > >>>> >> - [DONE] uploading binary release artifacts to Bintray
> > >>>> >> - [DONE] updating the Arrow website
> > >>>> >> - [DONE] python source distribution
> > >>>> >> - [DONE] ruby gems
> > >>>> >> - [DONE] javascript npm packages
> > >>>> >> - [DONE] .NET nuget packages
> > >>>> >> - [DONE] java maven artifacts
> > >>>> >>I had to re-stage the maven artifacts
> > >>>> >> - [kszucs] python wheels
> > >>>> >>   Partially done, the manylinux2010 and manylinux2014 wheels have 
> > >>>> >> hit
> > >>>> >> the 60MB limit of pypi, requested to increase it
> > >>>> >> https://github.com/pypa/pypi-support/issues/186
> > >>>> >> - [xhochy] conda packages
> > >>>> >>   Uwe works on it, arrow-cpp is already merged.
> > >>>> >> - [andygrove] rust packages
> > >>>> >>Arrow-flight misses the format directory, didn't dig deeper. Andy
> > >>>> >> could you take a look?
> > >>>> >> - [nealrichardson] R packages
> > >>>> >>   Neal should handle this.
> > >>>> >> - [ ] homebrew packages
> > >>>> >> - [ ] updating website with new API documentation
> > >>>> >> - [ ] announcing release
> > >>>> >>
> > >>>> >> On Fri, Feb 7, 2020 at 8:18 AM Krisztián Szűcs
> > >>>> >>  wrote:
> > >>>> >> >
> > >>>> >> > The VOTE carries with 4 binding +1 votes, 3 non-binding +1 votes 
> > &g

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-10 Thread Wes McKinney
Can we announce the release? Let me know if I can help with anything

On Sun, Feb 9, 2020 at 6:23 PM Sutou Kouhei  wrote:
>
> Hi,
>
> MSYS2 package is updated:
> https://github.com/msys2/MINGW-packages/pull/6175
>
>
> Thanks,
> --
> kou
>
> In 
>   "Re: [VOTE] Release Apache Arrow 0.16.0 - RC2" on Sun, 9 Feb 2020 09:06:39 
> -0800,
>   Neal Richardson  wrote:
>
> > R package 0.16.0 has been accepted by CRAN; may take a few more days for
> > CRAN to build Windows and macOS binaries.
> >
> > Neal
> >
> > On Fri, Feb 7, 2020 at 4:50 PM Neal Richardson 
> > wrote:
> >
> >> Homebrew PR is up: https://github.com/Homebrew/homebrew-core/pull/49908
> >>
> >>
> >>
> >> On Fri, Feb 7, 2020 at 3:44 PM Neal Richardson <
> >> neal.p.richard...@gmail.com> wrote:
> >>
> >>> I'm working (with Jeroen) on the R package stuff, and I'll put together
> >>> the homebrew formula PR now.
> >>>
> >>> Neal
> >>>
> >>> On Fri, Feb 7, 2020 at 6:42 AM Andy Grove  wrote:
> >>>
> >>>> Rust crates are published. Filed
> >>>> https://issues.apache.org/jira/browse/ARROW-7794 for the arrow-flight
> >>>> issue.
> >>>>
> >>>> On Fri, Feb 7, 2020 at 7:05 AM Andy Grove  wrote:
> >>>>
> >>>> > I'll look at the Rust issue now.
> >>>> >
> >>>> > On Fri, Feb 7, 2020 at 3:27 AM Krisztián Szűcs <
> >>>> szucs.kriszt...@gmail.com>
> >>>> > wrote:
> >>>> >
> >>>> >> Status of the post release tasks:
> >>>> >>
> >>>> >> - [DONE] marking the released version as "RELEASED" on JIRA
> >>>> >> - [DONE] rebase the master branch on top of the release branch
> >>>> >>   We have failing builds on the master because of the bumped version
> >>>> >> numbers, those must be fixed.
> >>>> >> - [DONE] rebase the pull requests
> >>>> >> - [DONE] uploading source release artifacts to SVN
> >>>> >> - [DONE] uploading binary release artifacts to Bintray
> >>>> >> - [DONE] updating the Arrow website
> >>>> >> - [DONE] python source distribution
> >>>> >> - [DONE] ruby gems
> >>>> >> - [DONE] javascript npm packages
> >>>> >> - [DONE] .NET nuget packages
> >>>> >> - [DONE] java maven artifacts
> >>>> >>I had to re-stage the maven artifacts
> >>>> >> - [kszucs] python wheels
> >>>> >>   Partially done, the manylinux2010 and manylinux2014 wheels have hit
> >>>> >> the 60MB limit of pypi, requested to increase it
> >>>> >> https://github.com/pypa/pypi-support/issues/186
> >>>> >> - [xhochy] conda packages
> >>>> >>   Uwe works on it, arrow-cpp is already merged.
> >>>> >> - [andygrove] rust packages
> >>>> >>Arrow-flight misses the format directory, didn't dig deeper. Andy
> >>>> >> could you take a look?
> >>>> >> - [nealrichardson] R packages
> >>>> >>   Neal should handle this.
> >>>> >> - [ ] homebrew packages
> >>>> >> - [ ] updating website with new API documentation
> >>>> >> - [ ] announcing release
> >>>> >>
> >>>> >> On Fri, Feb 7, 2020 at 8:18 AM Krisztián Szűcs
> >>>> >>  wrote:
> >>>> >> >
> >>>> >> > The VOTE carries with 4 binding +1 votes, 3 non-binding +1 votes and
> >>>> >> > one binding +0 vote.
> >>>> >> >
> >>>> >> > I'm starting the post-release tasks, if anyone wants to help please
> >>>> let
> >>>> >> me know.
> >>>> >> >
> >>>> >> > On Fri, Feb 7, 2020 at 12:25 AM Krisztián Szűcs
> >>>> >> >  wrote:
> >>>> >> > >
> >>>> >> > > So far we have the following votes:
> >>>> >> > >
> >>>> >> > > +0 (binding)
> >>>> >> > > +1 (binding)
> >>>> >> > > +1 (non-binding)
> >>>> >> > > +1 (binding)
> >

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-09 Thread Sutou Kouhei
Hi,

MSYS2 package is updated:
https://github.com/msys2/MINGW-packages/pull/6175


Thanks,
--
kou

In 
  "Re: [VOTE] Release Apache Arrow 0.16.0 - RC2" on Sun, 9 Feb 2020 09:06:39 
-0800,
  Neal Richardson  wrote:

> R package 0.16.0 has been accepted by CRAN; may take a few more days for
> CRAN to build Windows and macOS binaries.
> 
> Neal
> 
> On Fri, Feb 7, 2020 at 4:50 PM Neal Richardson 
> wrote:
> 
>> Homebrew PR is up: https://github.com/Homebrew/homebrew-core/pull/49908
>>
>>
>>
>> On Fri, Feb 7, 2020 at 3:44 PM Neal Richardson <
>> neal.p.richard...@gmail.com> wrote:
>>
>>> I'm working (with Jeroen) on the R package stuff, and I'll put together
>>> the homebrew formula PR now.
>>>
>>> Neal
>>>
>>> On Fri, Feb 7, 2020 at 6:42 AM Andy Grove  wrote:
>>>
>>>> Rust crates are published. Filed
>>>> https://issues.apache.org/jira/browse/ARROW-7794 for the arrow-flight
>>>> issue.
>>>>
>>>> On Fri, Feb 7, 2020 at 7:05 AM Andy Grove  wrote:
>>>>
>>>> > I'll look at the Rust issue now.
>>>> >
>>>> > On Fri, Feb 7, 2020 at 3:27 AM Krisztián Szűcs <
>>>> szucs.kriszt...@gmail.com>
>>>> > wrote:
>>>> >
>>>> >> Status of the post release tasks:
>>>> >>
>>>> >> - [DONE] marking the released version as "RELEASED" on JIRA
>>>> >> - [DONE] rebase the master branch on top of the release branch
>>>> >>   We have failing builds on the master because of the bumped version
>>>> >> numbers, those must be fixed.
>>>> >> - [DONE] rebase the pull requests
>>>> >> - [DONE] uploading source release artifacts to SVN
>>>> >> - [DONE] uploading binary release artifacts to Bintray
>>>> >> - [DONE] updating the Arrow website
>>>> >> - [DONE] python source distribution
>>>> >> - [DONE] ruby gems
>>>> >> - [DONE] javascript npm packages
>>>> >> - [DONE] .NET nuget packages
>>>> >> - [DONE] java maven artifacts
>>>> >>I had to re-stage the maven artifacts
>>>> >> - [kszucs] python wheels
>>>> >>   Partially done, the manylinux2010 and manylinux2014 wheels have hit
>>>> >> the 60MB limit of pypi, requested to increase it
>>>> >> https://github.com/pypa/pypi-support/issues/186
>>>> >> - [xhochy] conda packages
>>>> >>   Uwe works on it, arrow-cpp is already merged.
>>>> >> - [andygrove] rust packages
>>>> >>Arrow-flight misses the format directory, didn't dig deeper. Andy
>>>> >> could you take a look?
>>>> >> - [nealrichardson] R packages
>>>> >>   Neal should handle this.
>>>> >> - [ ] homebrew packages
>>>> >> - [ ] updating website with new API documentation
>>>> >> - [ ] announcing release
>>>> >>
>>>> >> On Fri, Feb 7, 2020 at 8:18 AM Krisztián Szűcs
>>>> >>  wrote:
>>>> >> >
>>>> >> > The VOTE carries with 4 binding +1 votes, 3 non-binding +1 votes and
>>>> >> > one binding +0 vote.
>>>> >> >
>>>> >> > I'm starting the post-release tasks, if anyone wants to help please
>>>> let
>>>> >> me know.
>>>> >> >
>>>> >> > On Fri, Feb 7, 2020 at 12:25 AM Krisztián Szűcs
>>>> >> >  wrote:
>>>> >> > >
>>>> >> > > So far we have the following votes:
>>>> >> > >
>>>> >> > > +0 (binding)
>>>> >> > > +1 (binding)
>>>> >> > > +1 (non-binding)
>>>> >> > > +1 (binding)
>>>> >> > > +1 (non-binding)
>>>> >> > > +1 (binding)
>>>> >> > > +1 (non-binding)
>>>> >> > > +1 (binding)
>>>> >> > > 
>>>> >> > > 4 +1 (binding)
>>>> >> > > 3 +1 (non-binding)
>>>> >> > >
>>>> >> > > I'm waiting for votes until tomorrow morning (UTC), then I'm
>>>> closing
>>>> >> the VOTE.
>>>> >> > >
>>>> >> >

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-09 Thread Neal Richardson
R package 0.16.0 has been accepted by CRAN; may take a few more days for
CRAN to build Windows and macOS binaries.

Neal

On Fri, Feb 7, 2020 at 4:50 PM Neal Richardson 
wrote:

> Homebrew PR is up: https://github.com/Homebrew/homebrew-core/pull/49908
>
>
>
> On Fri, Feb 7, 2020 at 3:44 PM Neal Richardson <
> neal.p.richard...@gmail.com> wrote:
>
>> I'm working (with Jeroen) on the R package stuff, and I'll put together
>> the homebrew formula PR now.
>>
>> Neal
>>
>> On Fri, Feb 7, 2020 at 6:42 AM Andy Grove  wrote:
>>
>>> Rust crates are published. Filed
>>> https://issues.apache.org/jira/browse/ARROW-7794 for the arrow-flight
>>> issue.
>>>
>>> On Fri, Feb 7, 2020 at 7:05 AM Andy Grove  wrote:
>>>
>>> > I'll look at the Rust issue now.
>>> >
>>> > On Fri, Feb 7, 2020 at 3:27 AM Krisztián Szűcs <
>>> szucs.kriszt...@gmail.com>
>>> > wrote:
>>> >
>>> >> Status of the post release tasks:
>>> >>
>>> >> - [DONE] marking the released version as "RELEASED" on JIRA
>>> >> - [DONE] rebase the master branch on top of the release branch
>>> >>   We have failing builds on the master because of the bumped version
>>> >> numbers, those must be fixed.
>>> >> - [DONE] rebase the pull requests
>>> >> - [DONE] uploading source release artifacts to SVN
>>> >> - [DONE] uploading binary release artifacts to Bintray
>>> >> - [DONE] updating the Arrow website
>>> >> - [DONE] python source distribution
>>> >> - [DONE] ruby gems
>>> >> - [DONE] javascript npm packages
>>> >> - [DONE] .NET nuget packages
>>> >> - [DONE] java maven artifacts
>>> >>I had to re-stage the maven artifacts
>>> >> - [kszucs] python wheels
>>> >>   Partially done, the manylinux2010 and manylinux2014 wheels have hit
>>> >> the 60MB limit of pypi, requested to increase it
>>> >> https://github.com/pypa/pypi-support/issues/186
>>> >> - [xhochy] conda packages
>>> >>   Uwe works on it, arrow-cpp is already merged.
>>> >> - [andygrove] rust packages
>>> >>Arrow-flight misses the format directory, didn't dig deeper. Andy
>>> >> could you take a look?
>>> >> - [nealrichardson] R packages
>>> >>   Neal should handle this.
>>> >> - [ ] homebrew packages
>>> >> - [ ] updating website with new API documentation
>>> >> - [ ] announcing release
>>> >>
>>> >> On Fri, Feb 7, 2020 at 8:18 AM Krisztián Szűcs
>>> >>  wrote:
>>> >> >
>>> >> > The VOTE carries with 4 binding +1 votes, 3 non-binding +1 votes and
>>> >> > one binding +0 vote.
>>> >> >
>>> >> > I'm starting the post-release tasks, if anyone wants to help please
>>> let
>>> >> me know.
>>> >> >
>>> >> > On Fri, Feb 7, 2020 at 12:25 AM Krisztián Szűcs
>>> >> >  wrote:
>>> >> > >
>>> >> > > So far we have the following votes:
>>> >> > >
>>> >> > > +0 (binding)
>>> >> > > +1 (binding)
>>> >> > > +1 (non-binding)
>>> >> > > +1 (binding)
>>> >> > > +1 (non-binding)
>>> >> > > +1 (binding)
>>> >> > > +1 (non-binding)
>>> >> > > +1 (binding)
>>> >> > > 
>>> >> > > 4 +1 (binding)
>>> >> > > 3 +1 (non-binding)
>>> >> > >
>>> >> > > I'm waiting for votes until tomorrow morning (UTC), then I'm
>>> closing
>>> >> the VOTE.
>>> >> > >
>>> >> > > Thanks everyone!
>>> >> > >
>>> >> > > - Krisztian
>>> >> > >
>>> >> > > On Fri, Feb 7, 2020 at 12:06 AM Krisztián Szűcs
>>> >> > >  wrote:
>>> >> > > >
>>> >> > > > Testing on macOS Catalina
>>> >> > > >
>>> >> > > > Binaries: OK
>>> >> > > >
>>> >> > > > Wheels: OK
>>> >> > > > Verified on macOS and on Linux.
>>> >> > > > On linux the verification script has failed for python 3.5 and
>>> >> manylinux2010
>>> >> > > > and manylinux2014 with unsupported platform tag. I've manually
>>> >> checked
>>> >> > > > these wheels in the python:3.5 docker image, and the wheels were
>>> >> good
>>> >> > > > (this is automatically checked by crossbow too [1]). All other
>>> >> wheels were
>>> >> > > > passing using the verification script.
>>> >> > > >
>>> >> > > > Source: OK
>>> >> > > > I had to revert the nvm path [2] to pass the js and integration
>>> >> tests and
>>> >> > > > force the glib test to use my system python instead of the conda
>>> >> one.
>>> >> > > >
>>> >> > > > I vote with +1 (binding)
>>> >> > > >
>>> >> > > > [1]:
>>> >> https://github.com/apache/arrow/blob/master/dev/tasks/tasks.yml#L568
>>> >> > > > [2]:
>>> >>
>>> https://github.com/apache/arrow/commit/37434fb34a1f2cd5273092ed3e1c61db90bb4dd2
>>> >> > > >
>>> >> > > >
>>> >> > > > On Thu, Feb 6, 2020 at 7:42 PM Neal Richardson
>>> >> > > >  wrote:
>>> >> > > > >
>>> >> > > > > I re-verified the macOS wheels and they worked but I had to
>>> >> hard-code
>>> >> > > > > `MACOSX_DEPLOYMENT_TARGET="10.14"` to get past the cython
>>> error I
>>> >> reported
>>> >> > > > > previously. I tried to set that env var dynamically based on
>>> your
>>> >> current
>>> >> > > > > OS version but didn't succeed in getting it passed through to
>>> >> pytest,
>>> >> > > > > despite many attempts to `export` it; someone with better bash
>>> >> skills than
>>> >> > > > > I should probably add that to the script. FTR 

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-07 Thread Neal Richardson
Homebrew PR is up: https://github.com/Homebrew/homebrew-core/pull/49908



On Fri, Feb 7, 2020 at 3:44 PM Neal Richardson 
wrote:

> I'm working (with Jeroen) on the R package stuff, and I'll put together
> the homebrew formula PR now.
>
> Neal
>
> On Fri, Feb 7, 2020 at 6:42 AM Andy Grove  wrote:
>
>> Rust crates are published. Filed
>> https://issues.apache.org/jira/browse/ARROW-7794 for the arrow-flight
>> issue.
>>
>> On Fri, Feb 7, 2020 at 7:05 AM Andy Grove  wrote:
>>
>> > I'll look at the Rust issue now.
>> >
>> > On Fri, Feb 7, 2020 at 3:27 AM Krisztián Szűcs <
>> szucs.kriszt...@gmail.com>
>> > wrote:
>> >
>> >> Status of the post release tasks:
>> >>
>> >> - [DONE] marking the released version as "RELEASED" on JIRA
>> >> - [DONE] rebase the master branch on top of the release branch
>> >>   We have failing builds on the master because of the bumped version
>> >> numbers, those must be fixed.
>> >> - [DONE] rebase the pull requests
>> >> - [DONE] uploading source release artifacts to SVN
>> >> - [DONE] uploading binary release artifacts to Bintray
>> >> - [DONE] updating the Arrow website
>> >> - [DONE] python source distribution
>> >> - [DONE] ruby gems
>> >> - [DONE] javascript npm packages
>> >> - [DONE] .NET nuget packages
>> >> - [DONE] java maven artifacts
>> >>I had to re-stage the maven artifacts
>> >> - [kszucs] python wheels
>> >>   Partially done, the manylinux2010 and manylinux2014 wheels have hit
>> >> the 60MB limit of pypi, requested to increase it
>> >> https://github.com/pypa/pypi-support/issues/186
>> >> - [xhochy] conda packages
>> >>   Uwe works on it, arrow-cpp is already merged.
>> >> - [andygrove] rust packages
>> >>Arrow-flight misses the format directory, didn't dig deeper. Andy
>> >> could you take a look?
>> >> - [nealrichardson] R packages
>> >>   Neal should handle this.
>> >> - [ ] homebrew packages
>> >> - [ ] updating website with new API documentation
>> >> - [ ] announcing release
>> >>
>> >> On Fri, Feb 7, 2020 at 8:18 AM Krisztián Szűcs
>> >>  wrote:
>> >> >
>> >> > The VOTE carries with 4 binding +1 votes, 3 non-binding +1 votes and
>> >> > one binding +0 vote.
>> >> >
>> >> > I'm starting the post-release tasks, if anyone wants to help please
>> let
>> >> me know.
>> >> >
>> >> > On Fri, Feb 7, 2020 at 12:25 AM Krisztián Szűcs
>> >> >  wrote:
>> >> > >
>> >> > > So far we have the following votes:
>> >> > >
>> >> > > +0 (binding)
>> >> > > +1 (binding)
>> >> > > +1 (non-binding)
>> >> > > +1 (binding)
>> >> > > +1 (non-binding)
>> >> > > +1 (binding)
>> >> > > +1 (non-binding)
>> >> > > +1 (binding)
>> >> > > 
>> >> > > 4 +1 (binding)
>> >> > > 3 +1 (non-binding)
>> >> > >
>> >> > > I'm waiting for votes until tomorrow morning (UTC), then I'm
>> closing
>> >> the VOTE.
>> >> > >
>> >> > > Thanks everyone!
>> >> > >
>> >> > > - Krisztian
>> >> > >
>> >> > > On Fri, Feb 7, 2020 at 12:06 AM Krisztián Szűcs
>> >> > >  wrote:
>> >> > > >
>> >> > > > Testing on macOS Catalina
>> >> > > >
>> >> > > > Binaries: OK
>> >> > > >
>> >> > > > Wheels: OK
>> >> > > > Verified on macOS and on Linux.
>> >> > > > On linux the verification script has failed for python 3.5 and
>> >> manylinux2010
>> >> > > > and manylinux2014 with unsupported platform tag. I've manually
>> >> checked
>> >> > > > these wheels in the python:3.5 docker image, and the wheels were
>> >> good
>> >> > > > (this is automatically checked by crossbow too [1]). All other
>> >> wheels were
>> >> > > > passing using the verification script.
>> >> > > >
>> >> > > > Source: OK
>> >> > > > I had to revert the nvm path [2] to pass the js and integration
>> >> tests and
>> >> > > > force the glib test to use my system python instead of the conda
>> >> one.
>> >> > > >
>> >> > > > I vote with +1 (binding)
>> >> > > >
>> >> > > > [1]:
>> >> https://github.com/apache/arrow/blob/master/dev/tasks/tasks.yml#L568
>> >> > > > [2]:
>> >>
>> https://github.com/apache/arrow/commit/37434fb34a1f2cd5273092ed3e1c61db90bb4dd2
>> >> > > >
>> >> > > >
>> >> > > > On Thu, Feb 6, 2020 at 7:42 PM Neal Richardson
>> >> > > >  wrote:
>> >> > > > >
>> >> > > > > I re-verified the macOS wheels and they worked but I had to
>> >> hard-code
>> >> > > > > `MACOSX_DEPLOYMENT_TARGET="10.14"` to get past the cython
>> error I
>> >> reported
>> >> > > > > previously. I tried to set that env var dynamically based on
>> your
>> >> current
>> >> > > > > OS version but didn't succeed in getting it passed through to
>> >> pytest,
>> >> > > > > despite many attempts to `export` it; someone with better bash
>> >> skills than
>> >> > > > > I should probably add that to the script. FTR `defaults read
>> >> loginwindow
>> >> > > > > SystemVersionStampAsString | sed s/\.[0-9]$//` returns the
>> right
>> >> macOS
>> >> > > > > version.
>> >> > > > >
>> >> > > > > Neal
>> >> > > > >
>> >> > > > > On Wed, Feb 5, 2020 at 1:29 PM Wes McKinney <
>> wesmck...@gmail.com>
>> >> wrote:
>> >> > > > >
>> >> > > > > > +1 (binding)
>> >> > > > > >
>> 

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-07 Thread Neal Richardson
I'm working (with Jeroen) on the R package stuff, and I'll put together the
homebrew formula PR now.

Neal

On Fri, Feb 7, 2020 at 6:42 AM Andy Grove  wrote:

> Rust crates are published. Filed
> https://issues.apache.org/jira/browse/ARROW-7794 for the arrow-flight
> issue.
>
> On Fri, Feb 7, 2020 at 7:05 AM Andy Grove  wrote:
>
> > I'll look at the Rust issue now.
> >
> > On Fri, Feb 7, 2020 at 3:27 AM Krisztián Szűcs <
> szucs.kriszt...@gmail.com>
> > wrote:
> >
> >> Status of the post release tasks:
> >>
> >> - [DONE] marking the released version as "RELEASED" on JIRA
> >> - [DONE] rebase the master branch on top of the release branch
> >>   We have failing builds on the master because of the bumped version
> >> numbers, those must be fixed.
> >> - [DONE] rebase the pull requests
> >> - [DONE] uploading source release artifacts to SVN
> >> - [DONE] uploading binary release artifacts to Bintray
> >> - [DONE] updating the Arrow website
> >> - [DONE] python source distribution
> >> - [DONE] ruby gems
> >> - [DONE] javascript npm packages
> >> - [DONE] .NET nuget packages
> >> - [DONE] java maven artifacts
> >>I had to re-stage the maven artifacts
> >> - [kszucs] python wheels
> >>   Partially done, the manylinux2010 and manylinux2014 wheels have hit
> >> the 60MB limit of pypi, requested to increase it
> >> https://github.com/pypa/pypi-support/issues/186
> >> - [xhochy] conda packages
> >>   Uwe works on it, arrow-cpp is already merged.
> >> - [andygrove] rust packages
> >>Arrow-flight misses the format directory, didn't dig deeper. Andy
> >> could you take a look?
> >> - [nealrichardson] R packages
> >>   Neal should handle this.
> >> - [ ] homebrew packages
> >> - [ ] updating website with new API documentation
> >> - [ ] announcing release
> >>
> >> On Fri, Feb 7, 2020 at 8:18 AM Krisztián Szűcs
> >>  wrote:
> >> >
> >> > The VOTE carries with 4 binding +1 votes, 3 non-binding +1 votes and
> >> > one binding +0 vote.
> >> >
> >> > I'm starting the post-release tasks, if anyone wants to help please
> let
> >> me know.
> >> >
> >> > On Fri, Feb 7, 2020 at 12:25 AM Krisztián Szűcs
> >> >  wrote:
> >> > >
> >> > > So far we have the following votes:
> >> > >
> >> > > +0 (binding)
> >> > > +1 (binding)
> >> > > +1 (non-binding)
> >> > > +1 (binding)
> >> > > +1 (non-binding)
> >> > > +1 (binding)
> >> > > +1 (non-binding)
> >> > > +1 (binding)
> >> > > 
> >> > > 4 +1 (binding)
> >> > > 3 +1 (non-binding)
> >> > >
> >> > > I'm waiting for votes until tomorrow morning (UTC), then I'm closing
> >> the VOTE.
> >> > >
> >> > > Thanks everyone!
> >> > >
> >> > > - Krisztian
> >> > >
> >> > > On Fri, Feb 7, 2020 at 12:06 AM Krisztián Szűcs
> >> > >  wrote:
> >> > > >
> >> > > > Testing on macOS Catalina
> >> > > >
> >> > > > Binaries: OK
> >> > > >
> >> > > > Wheels: OK
> >> > > > Verified on macOS and on Linux.
> >> > > > On linux the verification script has failed for python 3.5 and
> >> manylinux2010
> >> > > > and manylinux2014 with unsupported platform tag. I've manually
> >> checked
> >> > > > these wheels in the python:3.5 docker image, and the wheels were
> >> good
> >> > > > (this is automatically checked by crossbow too [1]). All other
> >> wheels were
> >> > > > passing using the verification script.
> >> > > >
> >> > > > Source: OK
> >> > > > I had to revert the nvm path [2] to pass the js and integration
> >> tests and
> >> > > > force the glib test to use my system python instead of the conda
> >> one.
> >> > > >
> >> > > > I vote with +1 (binding)
> >> > > >
> >> > > > [1]:
> >> https://github.com/apache/arrow/blob/master/dev/tasks/tasks.yml#L568
> >> > > > [2]:
> >>
> https://github.com/apache/arrow/commit/37434fb34a1f2cd5273092ed3e1c61db90bb4dd2
> >> > > >
> >> > > >
> >> > > > On Thu, Feb 6, 2020 at 7:42 PM Neal Richardson
> >> > > >  wrote:
> >> > > > >
> >> > > > > I re-verified the macOS wheels and they worked but I had to
> >> hard-code
> >> > > > > `MACOSX_DEPLOYMENT_TARGET="10.14"` to get past the cython error
> I
> >> reported
> >> > > > > previously. I tried to set that env var dynamically based on
> your
> >> current
> >> > > > > OS version but didn't succeed in getting it passed through to
> >> pytest,
> >> > > > > despite many attempts to `export` it; someone with better bash
> >> skills than
> >> > > > > I should probably add that to the script. FTR `defaults read
> >> loginwindow
> >> > > > > SystemVersionStampAsString | sed s/\.[0-9]$//` returns the right
> >> macOS
> >> > > > > version.
> >> > > > >
> >> > > > > Neal
> >> > > > >
> >> > > > > On Wed, Feb 5, 2020 at 1:29 PM Wes McKinney <
> wesmck...@gmail.com>
> >> wrote:
> >> > > > >
> >> > > > > > +1 (binding)
> >> > > > > >
> >> > > > > > I was able to verify the Windows wheels with the following
> >> patch applied
> >> > > > > >
> >> > > > > > https://github.com/apache/arrow/pull/6364
> >> > > > > >
> >> > > > > > On Wed, Feb 5, 2020 at 1:09 PM Krisztián Szűcs
> >> > > > > >  wrote:
> >> > > > > > >
> >> > > 

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-07 Thread Andy Grove
Rust crates are published. Filed
https://issues.apache.org/jira/browse/ARROW-7794 for the arrow-flight issue.

On Fri, Feb 7, 2020 at 7:05 AM Andy Grove  wrote:

> I'll look at the Rust issue now.
>
> On Fri, Feb 7, 2020 at 3:27 AM Krisztián Szűcs 
> wrote:
>
>> Status of the post release tasks:
>>
>> - [DONE] marking the released version as "RELEASED" on JIRA
>> - [DONE] rebase the master branch on top of the release branch
>>   We have failing builds on the master because of the bumped version
>> numbers, those must be fixed.
>> - [DONE] rebase the pull requests
>> - [DONE] uploading source release artifacts to SVN
>> - [DONE] uploading binary release artifacts to Bintray
>> - [DONE] updating the Arrow website
>> - [DONE] python source distribution
>> - [DONE] ruby gems
>> - [DONE] javascript npm packages
>> - [DONE] .NET nuget packages
>> - [DONE] java maven artifacts
>>I had to re-stage the maven artifacts
>> - [kszucs] python wheels
>>   Partially done, the manylinux2010 and manylinux2014 wheels have hit
>> the 60MB limit of pypi, requested to increase it
>> https://github.com/pypa/pypi-support/issues/186
>> - [xhochy] conda packages
>>   Uwe works on it, arrow-cpp is already merged.
>> - [andygrove] rust packages
>>Arrow-flight misses the format directory, didn't dig deeper. Andy
>> could you take a look?
>> - [nealrichardson] R packages
>>   Neal should handle this.
>> - [ ] homebrew packages
>> - [ ] updating website with new API documentation
>> - [ ] announcing release
>>
>> On Fri, Feb 7, 2020 at 8:18 AM Krisztián Szűcs
>>  wrote:
>> >
>> > The VOTE carries with 4 binding +1 votes, 3 non-binding +1 votes and
>> > one binding +0 vote.
>> >
>> > I'm starting the post-release tasks, if anyone wants to help please let
>> me know.
>> >
>> > On Fri, Feb 7, 2020 at 12:25 AM Krisztián Szűcs
>> >  wrote:
>> > >
>> > > So far we have the following votes:
>> > >
>> > > +0 (binding)
>> > > +1 (binding)
>> > > +1 (non-binding)
>> > > +1 (binding)
>> > > +1 (non-binding)
>> > > +1 (binding)
>> > > +1 (non-binding)
>> > > +1 (binding)
>> > > 
>> > > 4 +1 (binding)
>> > > 3 +1 (non-binding)
>> > >
>> > > I'm waiting for votes until tomorrow morning (UTC), then I'm closing
>> the VOTE.
>> > >
>> > > Thanks everyone!
>> > >
>> > > - Krisztian
>> > >
>> > > On Fri, Feb 7, 2020 at 12:06 AM Krisztián Szűcs
>> > >  wrote:
>> > > >
>> > > > Testing on macOS Catalina
>> > > >
>> > > > Binaries: OK
>> > > >
>> > > > Wheels: OK
>> > > > Verified on macOS and on Linux.
>> > > > On linux the verification script has failed for python 3.5 and
>> manylinux2010
>> > > > and manylinux2014 with unsupported platform tag. I've manually
>> checked
>> > > > these wheels in the python:3.5 docker image, and the wheels were
>> good
>> > > > (this is automatically checked by crossbow too [1]). All other
>> wheels were
>> > > > passing using the verification script.
>> > > >
>> > > > Source: OK
>> > > > I had to revert the nvm path [2] to pass the js and integration
>> tests and
>> > > > force the glib test to use my system python instead of the conda
>> one.
>> > > >
>> > > > I vote with +1 (binding)
>> > > >
>> > > > [1]:
>> https://github.com/apache/arrow/blob/master/dev/tasks/tasks.yml#L568
>> > > > [2]:
>> https://github.com/apache/arrow/commit/37434fb34a1f2cd5273092ed3e1c61db90bb4dd2
>> > > >
>> > > >
>> > > > On Thu, Feb 6, 2020 at 7:42 PM Neal Richardson
>> > > >  wrote:
>> > > > >
>> > > > > I re-verified the macOS wheels and they worked but I had to
>> hard-code
>> > > > > `MACOSX_DEPLOYMENT_TARGET="10.14"` to get past the cython error I
>> reported
>> > > > > previously. I tried to set that env var dynamically based on your
>> current
>> > > > > OS version but didn't succeed in getting it passed through to
>> pytest,
>> > > > > despite many attempts to `export` it; someone with better bash
>> skills than
>> > > > > I should probably add that to the script. FTR `defaults read
>> loginwindow
>> > > > > SystemVersionStampAsString | sed s/\.[0-9]$//` returns the right
>> macOS
>> > > > > version.
>> > > > >
>> > > > > Neal
>> > > > >
>> > > > > On Wed, Feb 5, 2020 at 1:29 PM Wes McKinney 
>> wrote:
>> > > > >
>> > > > > > +1 (binding)
>> > > > > >
>> > > > > > I was able to verify the Windows wheels with the following
>> patch applied
>> > > > > >
>> > > > > > https://github.com/apache/arrow/pull/6364
>> > > > > >
>> > > > > > On Wed, Feb 5, 2020 at 1:09 PM Krisztián Szűcs
>> > > > > >  wrote:
>> > > > > > >
>> > > > > > > There were binary naming issues with the macosx and the
>> win-cp38
>> > > > > > > wheels.
>> > > > > > > I've uploaded them, all of the wheels should be available now
>> [1]
>> > > > > > >
>> > > > > > > Note that the newly built macosx wheels have 10_9 platform tag
>> > > > > > > instead of 10_6, so the verification script must be updated
>> [2] to
>> > > > > > > verify the macosx wheels.
>> > > > > > >
>> > > > > > > [1]
>> https://bintray.com/apache/arrow/python-rc/0.16.0-rc2#files
>> > 

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-07 Thread Andy Grove
I'll look at the Rust issue now.

On Fri, Feb 7, 2020 at 3:27 AM Krisztián Szűcs 
wrote:

> Status of the post release tasks:
>
> - [DONE] marking the released version as "RELEASED" on JIRA
> - [DONE] rebase the master branch on top of the release branch
>   We have failing builds on the master because of the bumped version
> numbers, those must be fixed.
> - [DONE] rebase the pull requests
> - [DONE] uploading source release artifacts to SVN
> - [DONE] uploading binary release artifacts to Bintray
> - [DONE] updating the Arrow website
> - [DONE] python source distribution
> - [DONE] ruby gems
> - [DONE] javascript npm packages
> - [DONE] .NET nuget packages
> - [DONE] java maven artifacts
>I had to re-stage the maven artifacts
> - [kszucs] python wheels
>   Partially done, the manylinux2010 and manylinux2014 wheels have hit
> the 60MB limit of pypi, requested to increase it
> https://github.com/pypa/pypi-support/issues/186
> - [xhochy] conda packages
>   Uwe works on it, arrow-cpp is already merged.
> - [andygrove] rust packages
>Arrow-flight misses the format directory, didn't dig deeper. Andy
> could you take a look?
> - [nealrichardson] R packages
>   Neal should handle this.
> - [ ] homebrew packages
> - [ ] updating website with new API documentation
> - [ ] announcing release
>
> On Fri, Feb 7, 2020 at 8:18 AM Krisztián Szűcs
>  wrote:
> >
> > The VOTE carries with 4 binding +1 votes, 3 non-binding +1 votes and
> > one binding +0 vote.
> >
> > I'm starting the post-release tasks, if anyone wants to help please let
> me know.
> >
> > On Fri, Feb 7, 2020 at 12:25 AM Krisztián Szűcs
> >  wrote:
> > >
> > > So far we have the following votes:
> > >
> > > +0 (binding)
> > > +1 (binding)
> > > +1 (non-binding)
> > > +1 (binding)
> > > +1 (non-binding)
> > > +1 (binding)
> > > +1 (non-binding)
> > > +1 (binding)
> > > 
> > > 4 +1 (binding)
> > > 3 +1 (non-binding)
> > >
> > > I'm waiting for votes until tomorrow morning (UTC), then I'm closing
> the VOTE.
> > >
> > > Thanks everyone!
> > >
> > > - Krisztian
> > >
> > > On Fri, Feb 7, 2020 at 12:06 AM Krisztián Szűcs
> > >  wrote:
> > > >
> > > > Testing on macOS Catalina
> > > >
> > > > Binaries: OK
> > > >
> > > > Wheels: OK
> > > > Verified on macOS and on Linux.
> > > > On linux the verification script has failed for python 3.5 and
> manylinux2010
> > > > and manylinux2014 with unsupported platform tag. I've manually
> checked
> > > > these wheels in the python:3.5 docker image, and the wheels were good
> > > > (this is automatically checked by crossbow too [1]). All other
> wheels were
> > > > passing using the verification script.
> > > >
> > > > Source: OK
> > > > I had to revert the nvm path [2] to pass the js and integration
> tests and
> > > > force the glib test to use my system python instead of the conda one.
> > > >
> > > > I vote with +1 (binding)
> > > >
> > > > [1]:
> https://github.com/apache/arrow/blob/master/dev/tasks/tasks.yml#L568
> > > > [2]:
> https://github.com/apache/arrow/commit/37434fb34a1f2cd5273092ed3e1c61db90bb4dd2
> > > >
> > > >
> > > > On Thu, Feb 6, 2020 at 7:42 PM Neal Richardson
> > > >  wrote:
> > > > >
> > > > > I re-verified the macOS wheels and they worked but I had to
> hard-code
> > > > > `MACOSX_DEPLOYMENT_TARGET="10.14"` to get past the cython error I
> reported
> > > > > previously. I tried to set that env var dynamically based on your
> current
> > > > > OS version but didn't succeed in getting it passed through to
> pytest,
> > > > > despite many attempts to `export` it; someone with better bash
> skills than
> > > > > I should probably add that to the script. FTR `defaults read
> loginwindow
> > > > > SystemVersionStampAsString | sed s/\.[0-9]$//` returns the right
> macOS
> > > > > version.
> > > > >
> > > > > Neal
> > > > >
> > > > > On Wed, Feb 5, 2020 at 1:29 PM Wes McKinney 
> wrote:
> > > > >
> > > > > > +1 (binding)
> > > > > >
> > > > > > I was able to verify the Windows wheels with the following patch
> applied
> > > > > >
> > > > > > https://github.com/apache/arrow/pull/6364
> > > > > >
> > > > > > On Wed, Feb 5, 2020 at 1:09 PM Krisztián Szűcs
> > > > > >  wrote:
> > > > > > >
> > > > > > > There were binary naming issues with the macosx and the
> win-cp38
> > > > > > > wheels.
> > > > > > > I've uploaded them, all of the wheels should be available now
> [1]
> > > > > > >
> > > > > > > Note that the newly built macosx wheels have 10_9 platform tag
> > > > > > > instead of 10_6, so the verification script must be updated
> [2] to
> > > > > > > verify the macosx wheels.
> > > > > > >
> > > > > > > [1]
> https://bintray.com/apache/arrow/python-rc/0.16.0-rc2#files
> > > > > > > [2]
> > > > > >
> https://github.com/apache/arrow/pull/6362/files#diff-8cc7fa3ae5de30b356c17d7a4b59fe09R658
> > > > > > >
> > > > > > > On Wed, Feb 5, 2020 at 6:30 PM Krisztián Szűcs
> > > > > > >  wrote:
> > > > > > > >
> > > > > > > > The wheel was built successfully and available under the
> crossbow
> > 

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-07 Thread Krisztián Szűcs
Status of the post release tasks:

- [DONE] marking the released version as "RELEASED" on JIRA
- [DONE] rebase the master branch on top of the release branch
  We have failing builds on the master because of the bumped version
numbers, those must be fixed.
- [DONE] rebase the pull requests
- [DONE] uploading source release artifacts to SVN
- [DONE] uploading binary release artifacts to Bintray
- [DONE] updating the Arrow website
- [DONE] python source distribution
- [DONE] ruby gems
- [DONE] javascript npm packages
- [DONE] .NET nuget packages
- [DONE] java maven artifacts
   I had to re-stage the maven artifacts
- [kszucs] python wheels
  Partially done, the manylinux2010 and manylinux2014 wheels have hit
the 60MB limit of pypi, requested to increase it
https://github.com/pypa/pypi-support/issues/186
- [xhochy] conda packages
  Uwe works on it, arrow-cpp is already merged.
- [andygrove] rust packages
   Arrow-flight misses the format directory, didn't dig deeper. Andy
could you take a look?
- [nealrichardson] R packages
  Neal should handle this.
- [ ] homebrew packages
- [ ] updating website with new API documentation
- [ ] announcing release

On Fri, Feb 7, 2020 at 8:18 AM Krisztián Szűcs
 wrote:
>
> The VOTE carries with 4 binding +1 votes, 3 non-binding +1 votes and
> one binding +0 vote.
>
> I'm starting the post-release tasks, if anyone wants to help please let me 
> know.
>
> On Fri, Feb 7, 2020 at 12:25 AM Krisztián Szűcs
>  wrote:
> >
> > So far we have the following votes:
> >
> > +0 (binding)
> > +1 (binding)
> > +1 (non-binding)
> > +1 (binding)
> > +1 (non-binding)
> > +1 (binding)
> > +1 (non-binding)
> > +1 (binding)
> > 
> > 4 +1 (binding)
> > 3 +1 (non-binding)
> >
> > I'm waiting for votes until tomorrow morning (UTC), then I'm closing the 
> > VOTE.
> >
> > Thanks everyone!
> >
> > - Krisztian
> >
> > On Fri, Feb 7, 2020 at 12:06 AM Krisztián Szűcs
> >  wrote:
> > >
> > > Testing on macOS Catalina
> > >
> > > Binaries: OK
> > >
> > > Wheels: OK
> > > Verified on macOS and on Linux.
> > > On linux the verification script has failed for python 3.5 and 
> > > manylinux2010
> > > and manylinux2014 with unsupported platform tag. I've manually checked
> > > these wheels in the python:3.5 docker image, and the wheels were good
> > > (this is automatically checked by crossbow too [1]). All other wheels were
> > > passing using the verification script.
> > >
> > > Source: OK
> > > I had to revert the nvm path [2] to pass the js and integration tests and
> > > force the glib test to use my system python instead of the conda one.
> > >
> > > I vote with +1 (binding)
> > >
> > > [1]: https://github.com/apache/arrow/blob/master/dev/tasks/tasks.yml#L568
> > > [2]: 
> > > https://github.com/apache/arrow/commit/37434fb34a1f2cd5273092ed3e1c61db90bb4dd2
> > >
> > >
> > > On Thu, Feb 6, 2020 at 7:42 PM Neal Richardson
> > >  wrote:
> > > >
> > > > I re-verified the macOS wheels and they worked but I had to hard-code
> > > > `MACOSX_DEPLOYMENT_TARGET="10.14"` to get past the cython error I 
> > > > reported
> > > > previously. I tried to set that env var dynamically based on your 
> > > > current
> > > > OS version but didn't succeed in getting it passed through to pytest,
> > > > despite many attempts to `export` it; someone with better bash skills 
> > > > than
> > > > I should probably add that to the script. FTR `defaults read loginwindow
> > > > SystemVersionStampAsString | sed s/\.[0-9]$//` returns the right macOS
> > > > version.
> > > >
> > > > Neal
> > > >
> > > > On Wed, Feb 5, 2020 at 1:29 PM Wes McKinney  wrote:
> > > >
> > > > > +1 (binding)
> > > > >
> > > > > I was able to verify the Windows wheels with the following patch 
> > > > > applied
> > > > >
> > > > > https://github.com/apache/arrow/pull/6364
> > > > >
> > > > > On Wed, Feb 5, 2020 at 1:09 PM Krisztián Szűcs
> > > > >  wrote:
> > > > > >
> > > > > > There were binary naming issues with the macosx and the win-cp38
> > > > > > wheels.
> > > > > > I've uploaded them, all of the wheels should be available now [1]
> > > > > >
> > > > > > Note that the newly built macosx wheels have 10_9 platform tag
> > > > > > instead of 10_6, so the verification script must be updated [2] to
> > > > > > verify the macosx wheels.
> > > > > >
> > > > > > [1] https://bintray.com/apache/arrow/python-rc/0.16.0-rc2#files
> > > > > > [2]
> > > > > https://github.com/apache/arrow/pull/6362/files#diff-8cc7fa3ae5de30b356c17d7a4b59fe09R658
> > > > > >
> > > > > > On Wed, Feb 5, 2020 at 6:30 PM Krisztián Szűcs
> > > > > >  wrote:
> > > > > > >
> > > > > > > The wheel was built successfully and available under the crossbow
> > > > > > > releases. Something must have gone wrong during download/upload
> > > > > > > to bintray. I'm re-uploading the wheels again, waiting for the 
> > > > > > > network.
> > > > > > >
> > > > > > > On Wed, Feb 5, 2020 at 6:14 PM Wes McKinney 
> > > > > wrote:
> > > > > > > >
> > > > > > > > The Windows wheel RC script is 

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-06 Thread Krisztián Szűcs
The VOTE carries with 4 binding +1 votes, 3 non-binding +1 votes and
one binding +0 vote.

I'm starting the post-release tasks, if anyone wants to help please let me know.

On Fri, Feb 7, 2020 at 12:25 AM Krisztián Szűcs
 wrote:
>
> So far we have the following votes:
>
> +0 (binding)
> +1 (binding)
> +1 (non-binding)
> +1 (binding)
> +1 (non-binding)
> +1 (binding)
> +1 (non-binding)
> +1 (binding)
> 
> 4 +1 (binding)
> 3 +1 (non-binding)
>
> I'm waiting for votes until tomorrow morning (UTC), then I'm closing the VOTE.
>
> Thanks everyone!
>
> - Krisztian
>
> On Fri, Feb 7, 2020 at 12:06 AM Krisztián Szűcs
>  wrote:
> >
> > Testing on macOS Catalina
> >
> > Binaries: OK
> >
> > Wheels: OK
> > Verified on macOS and on Linux.
> > On linux the verification script has failed for python 3.5 and manylinux2010
> > and manylinux2014 with unsupported platform tag. I've manually checked
> > these wheels in the python:3.5 docker image, and the wheels were good
> > (this is automatically checked by crossbow too [1]). All other wheels were
> > passing using the verification script.
> >
> > Source: OK
> > I had to revert the nvm path [2] to pass the js and integration tests and
> > force the glib test to use my system python instead of the conda one.
> >
> > I vote with +1 (binding)
> >
> > [1]: https://github.com/apache/arrow/blob/master/dev/tasks/tasks.yml#L568
> > [2]: 
> > https://github.com/apache/arrow/commit/37434fb34a1f2cd5273092ed3e1c61db90bb4dd2
> >
> >
> > On Thu, Feb 6, 2020 at 7:42 PM Neal Richardson
> >  wrote:
> > >
> > > I re-verified the macOS wheels and they worked but I had to hard-code
> > > `MACOSX_DEPLOYMENT_TARGET="10.14"` to get past the cython error I reported
> > > previously. I tried to set that env var dynamically based on your current
> > > OS version but didn't succeed in getting it passed through to pytest,
> > > despite many attempts to `export` it; someone with better bash skills than
> > > I should probably add that to the script. FTR `defaults read loginwindow
> > > SystemVersionStampAsString | sed s/\.[0-9]$//` returns the right macOS
> > > version.
> > >
> > > Neal
> > >
> > > On Wed, Feb 5, 2020 at 1:29 PM Wes McKinney  wrote:
> > >
> > > > +1 (binding)
> > > >
> > > > I was able to verify the Windows wheels with the following patch applied
> > > >
> > > > https://github.com/apache/arrow/pull/6364
> > > >
> > > > On Wed, Feb 5, 2020 at 1:09 PM Krisztián Szűcs
> > > >  wrote:
> > > > >
> > > > > There were binary naming issues with the macosx and the win-cp38
> > > > > wheels.
> > > > > I've uploaded them, all of the wheels should be available now [1]
> > > > >
> > > > > Note that the newly built macosx wheels have 10_9 platform tag
> > > > > instead of 10_6, so the verification script must be updated [2] to
> > > > > verify the macosx wheels.
> > > > >
> > > > > [1] https://bintray.com/apache/arrow/python-rc/0.16.0-rc2#files
> > > > > [2]
> > > > https://github.com/apache/arrow/pull/6362/files#diff-8cc7fa3ae5de30b356c17d7a4b59fe09R658
> > > > >
> > > > > On Wed, Feb 5, 2020 at 6:30 PM Krisztián Szűcs
> > > > >  wrote:
> > > > > >
> > > > > > The wheel was built successfully and available under the crossbow
> > > > > > releases. Something must have gone wrong during download/upload
> > > > > > to bintray. I'm re-uploading the wheels again, waiting for the 
> > > > > > network.
> > > > > >
> > > > > > On Wed, Feb 5, 2020 at 6:14 PM Wes McKinney 
> > > > wrote:
> > > > > > >
> > > > > > > The Windows wheel RC script is broken
> > > > > > >
> > > > > > > wget --no-check-certificate -O
> > > > pyarrow-0.16.0-cp38-cp38m-win_amd64.whl
> > > > > > >
> > > > https://bintray.com/apache/arrow/download_file?file_path=python-rc%2F0.16.0-rc2%2Fpyarrow-0.1
> > > > > > > 6.0-cp38-cp38m-win_amd64.whl   || EXIT /B 1
> > > > > > > --2020-02-05 11:11:15--
> > > > > > >
> > > > https://bintray.com/apache/arrow/download_file?file_path=python-rc%2F0.16.0-rc2%2Fpyarrow-0.16.0-cp38-cp38m-win_amd64.whl
> > > > > > > Resolving bintray.com (bintray.com)... 75.126.208.206
> > > > > > > Connecting to bintray.com (bintray.com)|75.126.208.206|:443...
> > > > > > > connected.
> > > > > > > HTTP request sent, awaiting response... 404 Not Found
> > > > > > > 2020-02-05 11:11:15 ERROR 404: Not Found.
> > > > > > >
> > > > > > > I will try to fix
> > > > > > >
> > > > > > > On Wed, Feb 5, 2020 at 7:31 AM Uwe L. Korn  
> > > > > > > wrote:
> > > > > > > >
> > > > > > > > I'm failing to verify C++ on macOS as it seems that we nowadays
> > > > pull all dependencies from the system. Is there a known way to build & 
> > > > test
> > > > on OSX with the script and use conda for the requirements?
> > > > > > > >
> > > > > > > > Otherwise I probably need to investe to create such a way.
> > > > > > > >
> > > > > > > > Cheers
> > > > > > > > Uwe
> > > > > > > >
> > > > > > > > On Wed, Feb 5, 2020, at 2:54 AM, Krisztián Szűcs wrote:
> > > > > > > > > Hi,
> > > > > > > > >
> > > > > > > > > I've cherry-picked the 

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-06 Thread Krisztián Szűcs
So far we have the following votes:

+0 (binding)
+1 (binding)
+1 (non-binding)
+1 (binding)
+1 (non-binding)
+1 (binding)
+1 (non-binding)
+1 (binding)

4 +1 (binding)
3 +1 (non-binding)

I'm waiting for votes until tomorrow morning (UTC), then I'm closing the VOTE.

Thanks everyone!

- Krisztian

On Fri, Feb 7, 2020 at 12:06 AM Krisztián Szűcs
 wrote:
>
> Testing on macOS Catalina
>
> Binaries: OK
>
> Wheels: OK
> Verified on macOS and on Linux.
> On linux the verification script has failed for python 3.5 and manylinux2010
> and manylinux2014 with unsupported platform tag. I've manually checked
> these wheels in the python:3.5 docker image, and the wheels were good
> (this is automatically checked by crossbow too [1]). All other wheels were
> passing using the verification script.
>
> Source: OK
> I had to revert the nvm path [2] to pass the js and integration tests and
> force the glib test to use my system python instead of the conda one.
>
> I vote with +1 (binding)
>
> [1]: https://github.com/apache/arrow/blob/master/dev/tasks/tasks.yml#L568
> [2]: 
> https://github.com/apache/arrow/commit/37434fb34a1f2cd5273092ed3e1c61db90bb4dd2
>
>
> On Thu, Feb 6, 2020 at 7:42 PM Neal Richardson
>  wrote:
> >
> > I re-verified the macOS wheels and they worked but I had to hard-code
> > `MACOSX_DEPLOYMENT_TARGET="10.14"` to get past the cython error I reported
> > previously. I tried to set that env var dynamically based on your current
> > OS version but didn't succeed in getting it passed through to pytest,
> > despite many attempts to `export` it; someone with better bash skills than
> > I should probably add that to the script. FTR `defaults read loginwindow
> > SystemVersionStampAsString | sed s/\.[0-9]$//` returns the right macOS
> > version.
> >
> > Neal
> >
> > On Wed, Feb 5, 2020 at 1:29 PM Wes McKinney  wrote:
> >
> > > +1 (binding)
> > >
> > > I was able to verify the Windows wheels with the following patch applied
> > >
> > > https://github.com/apache/arrow/pull/6364
> > >
> > > On Wed, Feb 5, 2020 at 1:09 PM Krisztián Szűcs
> > >  wrote:
> > > >
> > > > There were binary naming issues with the macosx and the win-cp38
> > > > wheels.
> > > > I've uploaded them, all of the wheels should be available now [1]
> > > >
> > > > Note that the newly built macosx wheels have 10_9 platform tag
> > > > instead of 10_6, so the verification script must be updated [2] to
> > > > verify the macosx wheels.
> > > >
> > > > [1] https://bintray.com/apache/arrow/python-rc/0.16.0-rc2#files
> > > > [2]
> > > https://github.com/apache/arrow/pull/6362/files#diff-8cc7fa3ae5de30b356c17d7a4b59fe09R658
> > > >
> > > > On Wed, Feb 5, 2020 at 6:30 PM Krisztián Szűcs
> > > >  wrote:
> > > > >
> > > > > The wheel was built successfully and available under the crossbow
> > > > > releases. Something must have gone wrong during download/upload
> > > > > to bintray. I'm re-uploading the wheels again, waiting for the 
> > > > > network.
> > > > >
> > > > > On Wed, Feb 5, 2020 at 6:14 PM Wes McKinney 
> > > wrote:
> > > > > >
> > > > > > The Windows wheel RC script is broken
> > > > > >
> > > > > > wget --no-check-certificate -O
> > > pyarrow-0.16.0-cp38-cp38m-win_amd64.whl
> > > > > >
> > > https://bintray.com/apache/arrow/download_file?file_path=python-rc%2F0.16.0-rc2%2Fpyarrow-0.1
> > > > > > 6.0-cp38-cp38m-win_amd64.whl   || EXIT /B 1
> > > > > > --2020-02-05 11:11:15--
> > > > > >
> > > https://bintray.com/apache/arrow/download_file?file_path=python-rc%2F0.16.0-rc2%2Fpyarrow-0.16.0-cp38-cp38m-win_amd64.whl
> > > > > > Resolving bintray.com (bintray.com)... 75.126.208.206
> > > > > > Connecting to bintray.com (bintray.com)|75.126.208.206|:443...
> > > > > > connected.
> > > > > > HTTP request sent, awaiting response... 404 Not Found
> > > > > > 2020-02-05 11:11:15 ERROR 404: Not Found.
> > > > > >
> > > > > > I will try to fix
> > > > > >
> > > > > > On Wed, Feb 5, 2020 at 7:31 AM Uwe L. Korn  wrote:
> > > > > > >
> > > > > > > I'm failing to verify C++ on macOS as it seems that we nowadays
> > > pull all dependencies from the system. Is there a known way to build & 
> > > test
> > > on OSX with the script and use conda for the requirements?
> > > > > > >
> > > > > > > Otherwise I probably need to investe to create such a way.
> > > > > > >
> > > > > > > Cheers
> > > > > > > Uwe
> > > > > > >
> > > > > > > On Wed, Feb 5, 2020, at 2:54 AM, Krisztián Szűcs wrote:
> > > > > > > > Hi,
> > > > > > > >
> > > > > > > > I've cherry-picked the wheel fix [1] on top of the 0.16 release
> > > tag,
> > > > > > > > re-built the wheels using crossbow [2], and uploaded them to
> > > > > > > > bintray [3] (also removed win-py38m).
> > > > > > > >
> > > > > > > > Anyone who has voted after verifying the wheels, please re-run
> > > > > > > > the verification script again for the wheels and re-vote.
> > > > > > > >
> > > > > > > > Thanks, Krisztian
> > > > > > > >
> > > > > > > > [1]
> > > > > > > >
> > > 

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-06 Thread Krisztián Szűcs
Testing on macOS Catalina

Binaries: OK

Wheels: OK
Verified on macOS and on Linux.
On linux the verification script has failed for python 3.5 and manylinux2010
and manylinux2014 with unsupported platform tag. I've manually checked
these wheels in the python:3.5 docker image, and the wheels were good
(this is automatically checked by crossbow too [1]). All other wheels were
passing using the verification script.

Source: OK
I had to revert the nvm path [2] to pass the js and integration tests and
force the glib test to use my system python instead of the conda one.

I vote with +1 (binding)

[1]: https://github.com/apache/arrow/blob/master/dev/tasks/tasks.yml#L568
[2]: 
https://github.com/apache/arrow/commit/37434fb34a1f2cd5273092ed3e1c61db90bb4dd2


On Thu, Feb 6, 2020 at 7:42 PM Neal Richardson
 wrote:
>
> I re-verified the macOS wheels and they worked but I had to hard-code
> `MACOSX_DEPLOYMENT_TARGET="10.14"` to get past the cython error I reported
> previously. I tried to set that env var dynamically based on your current
> OS version but didn't succeed in getting it passed through to pytest,
> despite many attempts to `export` it; someone with better bash skills than
> I should probably add that to the script. FTR `defaults read loginwindow
> SystemVersionStampAsString | sed s/\.[0-9]$//` returns the right macOS
> version.
>
> Neal
>
> On Wed, Feb 5, 2020 at 1:29 PM Wes McKinney  wrote:
>
> > +1 (binding)
> >
> > I was able to verify the Windows wheels with the following patch applied
> >
> > https://github.com/apache/arrow/pull/6364
> >
> > On Wed, Feb 5, 2020 at 1:09 PM Krisztián Szűcs
> >  wrote:
> > >
> > > There were binary naming issues with the macosx and the win-cp38
> > > wheels.
> > > I've uploaded them, all of the wheels should be available now [1]
> > >
> > > Note that the newly built macosx wheels have 10_9 platform tag
> > > instead of 10_6, so the verification script must be updated [2] to
> > > verify the macosx wheels.
> > >
> > > [1] https://bintray.com/apache/arrow/python-rc/0.16.0-rc2#files
> > > [2]
> > https://github.com/apache/arrow/pull/6362/files#diff-8cc7fa3ae5de30b356c17d7a4b59fe09R658
> > >
> > > On Wed, Feb 5, 2020 at 6:30 PM Krisztián Szűcs
> > >  wrote:
> > > >
> > > > The wheel was built successfully and available under the crossbow
> > > > releases. Something must have gone wrong during download/upload
> > > > to bintray. I'm re-uploading the wheels again, waiting for the network.
> > > >
> > > > On Wed, Feb 5, 2020 at 6:14 PM Wes McKinney 
> > wrote:
> > > > >
> > > > > The Windows wheel RC script is broken
> > > > >
> > > > > wget --no-check-certificate -O
> > pyarrow-0.16.0-cp38-cp38m-win_amd64.whl
> > > > >
> > https://bintray.com/apache/arrow/download_file?file_path=python-rc%2F0.16.0-rc2%2Fpyarrow-0.1
> > > > > 6.0-cp38-cp38m-win_amd64.whl   || EXIT /B 1
> > > > > --2020-02-05 11:11:15--
> > > > >
> > https://bintray.com/apache/arrow/download_file?file_path=python-rc%2F0.16.0-rc2%2Fpyarrow-0.16.0-cp38-cp38m-win_amd64.whl
> > > > > Resolving bintray.com (bintray.com)... 75.126.208.206
> > > > > Connecting to bintray.com (bintray.com)|75.126.208.206|:443...
> > > > > connected.
> > > > > HTTP request sent, awaiting response... 404 Not Found
> > > > > 2020-02-05 11:11:15 ERROR 404: Not Found.
> > > > >
> > > > > I will try to fix
> > > > >
> > > > > On Wed, Feb 5, 2020 at 7:31 AM Uwe L. Korn  wrote:
> > > > > >
> > > > > > I'm failing to verify C++ on macOS as it seems that we nowadays
> > pull all dependencies from the system. Is there a known way to build & test
> > on OSX with the script and use conda for the requirements?
> > > > > >
> > > > > > Otherwise I probably need to investe to create such a way.
> > > > > >
> > > > > > Cheers
> > > > > > Uwe
> > > > > >
> > > > > > On Wed, Feb 5, 2020, at 2:54 AM, Krisztián Szűcs wrote:
> > > > > > > Hi,
> > > > > > >
> > > > > > > I've cherry-picked the wheel fix [1] on top of the 0.16 release
> > tag,
> > > > > > > re-built the wheels using crossbow [2], and uploaded them to
> > > > > > > bintray [3] (also removed win-py38m).
> > > > > > >
> > > > > > > Anyone who has voted after verifying the wheels, please re-run
> > > > > > > the verification script again for the wheels and re-vote.
> > > > > > >
> > > > > > > Thanks, Krisztian
> > > > > > >
> > > > > > > [1]
> > > > > > >
> > https://github.com/apache/arrow/commit/67e34c53b3be4c88348369f8109626b4a8a997aa
> > > > > > > [2]
> > https://github.com/ursa-labs/crossbow/branches/all?query=build-733
> > > > > > > [3] https://bintray.com/apache/arrow/python-rc/0.16.0-rc2#files
> > > > > > >
> > > > > > > On Tue, Feb 4, 2020 at 7:08 PM Wes McKinney 
> > wrote:
> > > > > > > >
> > > > > > > > +1 (binding)
> > > > > > > >
> > > > > > > > Some patches were required to the verification scripts but I
> > have run:
> > > > > > > >
> > > > > > > > * Full source verification on Ubuntu 18.04
> > > > > > > > * Linux binary verification
> > > > > > > > * Source verification on 

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-06 Thread Neal Richardson
I re-verified the macOS wheels and they worked but I had to hard-code
`MACOSX_DEPLOYMENT_TARGET="10.14"` to get past the cython error I reported
previously. I tried to set that env var dynamically based on your current
OS version but didn't succeed in getting it passed through to pytest,
despite many attempts to `export` it; someone with better bash skills than
I should probably add that to the script. FTR `defaults read loginwindow
SystemVersionStampAsString | sed s/\.[0-9]$//` returns the right macOS
version.

Neal

On Wed, Feb 5, 2020 at 1:29 PM Wes McKinney  wrote:

> +1 (binding)
>
> I was able to verify the Windows wheels with the following patch applied
>
> https://github.com/apache/arrow/pull/6364
>
> On Wed, Feb 5, 2020 at 1:09 PM Krisztián Szűcs
>  wrote:
> >
> > There were binary naming issues with the macosx and the win-cp38
> > wheels.
> > I've uploaded them, all of the wheels should be available now [1]
> >
> > Note that the newly built macosx wheels have 10_9 platform tag
> > instead of 10_6, so the verification script must be updated [2] to
> > verify the macosx wheels.
> >
> > [1] https://bintray.com/apache/arrow/python-rc/0.16.0-rc2#files
> > [2]
> https://github.com/apache/arrow/pull/6362/files#diff-8cc7fa3ae5de30b356c17d7a4b59fe09R658
> >
> > On Wed, Feb 5, 2020 at 6:30 PM Krisztián Szűcs
> >  wrote:
> > >
> > > The wheel was built successfully and available under the crossbow
> > > releases. Something must have gone wrong during download/upload
> > > to bintray. I'm re-uploading the wheels again, waiting for the network.
> > >
> > > On Wed, Feb 5, 2020 at 6:14 PM Wes McKinney 
> wrote:
> > > >
> > > > The Windows wheel RC script is broken
> > > >
> > > > wget --no-check-certificate -O
> pyarrow-0.16.0-cp38-cp38m-win_amd64.whl
> > > >
> https://bintray.com/apache/arrow/download_file?file_path=python-rc%2F0.16.0-rc2%2Fpyarrow-0.1
> > > > 6.0-cp38-cp38m-win_amd64.whl   || EXIT /B 1
> > > > --2020-02-05 11:11:15--
> > > >
> https://bintray.com/apache/arrow/download_file?file_path=python-rc%2F0.16.0-rc2%2Fpyarrow-0.16.0-cp38-cp38m-win_amd64.whl
> > > > Resolving bintray.com (bintray.com)... 75.126.208.206
> > > > Connecting to bintray.com (bintray.com)|75.126.208.206|:443...
> > > > connected.
> > > > HTTP request sent, awaiting response... 404 Not Found
> > > > 2020-02-05 11:11:15 ERROR 404: Not Found.
> > > >
> > > > I will try to fix
> > > >
> > > > On Wed, Feb 5, 2020 at 7:31 AM Uwe L. Korn  wrote:
> > > > >
> > > > > I'm failing to verify C++ on macOS as it seems that we nowadays
> pull all dependencies from the system. Is there a known way to build & test
> on OSX with the script and use conda for the requirements?
> > > > >
> > > > > Otherwise I probably need to investe to create such a way.
> > > > >
> > > > > Cheers
> > > > > Uwe
> > > > >
> > > > > On Wed, Feb 5, 2020, at 2:54 AM, Krisztián Szűcs wrote:
> > > > > > Hi,
> > > > > >
> > > > > > I've cherry-picked the wheel fix [1] on top of the 0.16 release
> tag,
> > > > > > re-built the wheels using crossbow [2], and uploaded them to
> > > > > > bintray [3] (also removed win-py38m).
> > > > > >
> > > > > > Anyone who has voted after verifying the wheels, please re-run
> > > > > > the verification script again for the wheels and re-vote.
> > > > > >
> > > > > > Thanks, Krisztian
> > > > > >
> > > > > > [1]
> > > > > >
> https://github.com/apache/arrow/commit/67e34c53b3be4c88348369f8109626b4a8a997aa
> > > > > > [2]
> https://github.com/ursa-labs/crossbow/branches/all?query=build-733
> > > > > > [3] https://bintray.com/apache/arrow/python-rc/0.16.0-rc2#files
> > > > > >
> > > > > > On Tue, Feb 4, 2020 at 7:08 PM Wes McKinney 
> wrote:
> > > > > > >
> > > > > > > +1 (binding)
> > > > > > >
> > > > > > > Some patches were required to the verification scripts but I
> have run:
> > > > > > >
> > > > > > > * Full source verification on Ubuntu 18.04
> > > > > > > * Linux binary verification
> > > > > > > * Source verification on Windows 10 (needed ARROW-6757)
> > > > > > > * Windows binary verification. Note that Python 3.8 wheel is
> broken
> > > > > > > (see ARROW-7755). Whoever uploads the wheels to PyPI _SHOULD
> NOT_
> > > > > > > upload this 3.8 wheel until we know what's wrong (if we upload
> a
> > > > > > > broken wheel then `pip install pyarrow==0.16.0` will be
> permanently
> > > > > > > broken on Windows/Python 3.8)
> > > > > > >
> > > > > > > On Mon, Feb 3, 2020 at 9:26 PM Francois Saint-Jacques
> > > > > > >  wrote:
> > > > > > > >
> > > > > > > > Tested on ubuntu 18.04 for the source release.
> > > > > > > >
> > > > > > > > On Mon, Feb 3, 2020 at 10:07 PM Francois Saint-Jacques
> > > > > > > >  wrote:
> > > > > > > > >
> > > > > > > > > +1
> > > > > > > > >
> > > > > > > > > Binaries verification didn't have any issues.
> > > > > > > > > Sources verification worked with some local environment
> hiccups
> > > > > > > > >
> > > > > > > > > François
> > > > > > > > >
> > > > > > > > > On Mon, Feb 3, 2020 at 8:46 PM Andy Grove <

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-05 Thread Wes McKinney
+1 (binding)

I was able to verify the Windows wheels with the following patch applied

https://github.com/apache/arrow/pull/6364

On Wed, Feb 5, 2020 at 1:09 PM Krisztián Szűcs
 wrote:
>
> There were binary naming issues with the macosx and the win-cp38
> wheels.
> I've uploaded them, all of the wheels should be available now [1]
>
> Note that the newly built macosx wheels have 10_9 platform tag
> instead of 10_6, so the verification script must be updated [2] to
> verify the macosx wheels.
>
> [1] https://bintray.com/apache/arrow/python-rc/0.16.0-rc2#files
> [2] 
> https://github.com/apache/arrow/pull/6362/files#diff-8cc7fa3ae5de30b356c17d7a4b59fe09R658
>
> On Wed, Feb 5, 2020 at 6:30 PM Krisztián Szűcs
>  wrote:
> >
> > The wheel was built successfully and available under the crossbow
> > releases. Something must have gone wrong during download/upload
> > to bintray. I'm re-uploading the wheels again, waiting for the network.
> >
> > On Wed, Feb 5, 2020 at 6:14 PM Wes McKinney  wrote:
> > >
> > > The Windows wheel RC script is broken
> > >
> > > wget --no-check-certificate -O pyarrow-0.16.0-cp38-cp38m-win_amd64.whl
> > > https://bintray.com/apache/arrow/download_file?file_path=python-rc%2F0.16.0-rc2%2Fpyarrow-0.1
> > > 6.0-cp38-cp38m-win_amd64.whl   || EXIT /B 1
> > > --2020-02-05 11:11:15--
> > > https://bintray.com/apache/arrow/download_file?file_path=python-rc%2F0.16.0-rc2%2Fpyarrow-0.16.0-cp38-cp38m-win_amd64.whl
> > > Resolving bintray.com (bintray.com)... 75.126.208.206
> > > Connecting to bintray.com (bintray.com)|75.126.208.206|:443...
> > > connected.
> > > HTTP request sent, awaiting response... 404 Not Found
> > > 2020-02-05 11:11:15 ERROR 404: Not Found.
> > >
> > > I will try to fix
> > >
> > > On Wed, Feb 5, 2020 at 7:31 AM Uwe L. Korn  wrote:
> > > >
> > > > I'm failing to verify C++ on macOS as it seems that we nowadays pull 
> > > > all dependencies from the system. Is there a known way to build & test 
> > > > on OSX with the script and use conda for the requirements?
> > > >
> > > > Otherwise I probably need to investe to create such a way.
> > > >
> > > > Cheers
> > > > Uwe
> > > >
> > > > On Wed, Feb 5, 2020, at 2:54 AM, Krisztián Szűcs wrote:
> > > > > Hi,
> > > > >
> > > > > I've cherry-picked the wheel fix [1] on top of the 0.16 release tag,
> > > > > re-built the wheels using crossbow [2], and uploaded them to
> > > > > bintray [3] (also removed win-py38m).
> > > > >
> > > > > Anyone who has voted after verifying the wheels, please re-run
> > > > > the verification script again for the wheels and re-vote.
> > > > >
> > > > > Thanks, Krisztian
> > > > >
> > > > > [1]
> > > > > https://github.com/apache/arrow/commit/67e34c53b3be4c88348369f8109626b4a8a997aa
> > > > > [2] https://github.com/ursa-labs/crossbow/branches/all?query=build-733
> > > > > [3] https://bintray.com/apache/arrow/python-rc/0.16.0-rc2#files
> > > > >
> > > > > On Tue, Feb 4, 2020 at 7:08 PM Wes McKinney  
> > > > > wrote:
> > > > > >
> > > > > > +1 (binding)
> > > > > >
> > > > > > Some patches were required to the verification scripts but I have 
> > > > > > run:
> > > > > >
> > > > > > * Full source verification on Ubuntu 18.04
> > > > > > * Linux binary verification
> > > > > > * Source verification on Windows 10 (needed ARROW-6757)
> > > > > > * Windows binary verification. Note that Python 3.8 wheel is broken
> > > > > > (see ARROW-7755). Whoever uploads the wheels to PyPI _SHOULD NOT_
> > > > > > upload this 3.8 wheel until we know what's wrong (if we upload a
> > > > > > broken wheel then `pip install pyarrow==0.16.0` will be permanently
> > > > > > broken on Windows/Python 3.8)
> > > > > >
> > > > > > On Mon, Feb 3, 2020 at 9:26 PM Francois Saint-Jacques
> > > > > >  wrote:
> > > > > > >
> > > > > > > Tested on ubuntu 18.04 for the source release.
> > > > > > >
> > > > > > > On Mon, Feb 3, 2020 at 10:07 PM Francois Saint-Jacques
> > > > > > >  wrote:
> > > > > > > >
> > > > > > > > +1
> > > > > > > >
> > > > > > > > Binaries verification didn't have any issues.
> > > > > > > > Sources verification worked with some local environment hiccups
> > > > > > > >
> > > > > > > > François
> > > > > > > >
> > > > > > > > On Mon, Feb 3, 2020 at 8:46 PM Andy Grove 
> > > > > > > >  wrote:
> > > > > > > > >
> > > > > > > > > +1 (binding) based on running the Rust tests
> > > > > > > > >
> > > > > > > > > Thanks.
> > > > > > > > >
> > > > > > > > > On Thu, Jan 30, 2020 at 8:13 PM Krisztián Szűcs 
> > > > > > > > > 
> > > > > > > > > wrote:
> > > > > > > > >
> > > > > > > > > > Hi,
> > > > > > > > > >
> > > > > > > > > > I would like to propose the following release candidate 
> > > > > > > > > > (RC2) of Apache
> > > > > > > > > > Arrow version 0.16.0. This is a release consisting of 728
> > > > > > > > > > resolved JIRA issues[1].
> > > > > > > > > >
> > > > > > > > > > This release candidate is based on commit:
> > > > > > > > > > 729a7689fd87572e6a14ad36f19cd579a8b8d9c5 [2]
> > > > > > > > > >
> > > > > > > > > > 

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-05 Thread Krisztián Szűcs
There were binary naming issues with the macosx and the win-cp38
wheels.
I've uploaded them, all of the wheels should be available now [1]

Note that the newly built macosx wheels have 10_9 platform tag
instead of 10_6, so the verification script must be updated [2] to
verify the macosx wheels.

[1] https://bintray.com/apache/arrow/python-rc/0.16.0-rc2#files
[2] 
https://github.com/apache/arrow/pull/6362/files#diff-8cc7fa3ae5de30b356c17d7a4b59fe09R658

On Wed, Feb 5, 2020 at 6:30 PM Krisztián Szűcs
 wrote:
>
> The wheel was built successfully and available under the crossbow
> releases. Something must have gone wrong during download/upload
> to bintray. I'm re-uploading the wheels again, waiting for the network.
>
> On Wed, Feb 5, 2020 at 6:14 PM Wes McKinney  wrote:
> >
> > The Windows wheel RC script is broken
> >
> > wget --no-check-certificate -O pyarrow-0.16.0-cp38-cp38m-win_amd64.whl
> > https://bintray.com/apache/arrow/download_file?file_path=python-rc%2F0.16.0-rc2%2Fpyarrow-0.1
> > 6.0-cp38-cp38m-win_amd64.whl   || EXIT /B 1
> > --2020-02-05 11:11:15--
> > https://bintray.com/apache/arrow/download_file?file_path=python-rc%2F0.16.0-rc2%2Fpyarrow-0.16.0-cp38-cp38m-win_amd64.whl
> > Resolving bintray.com (bintray.com)... 75.126.208.206
> > Connecting to bintray.com (bintray.com)|75.126.208.206|:443...
> > connected.
> > HTTP request sent, awaiting response... 404 Not Found
> > 2020-02-05 11:11:15 ERROR 404: Not Found.
> >
> > I will try to fix
> >
> > On Wed, Feb 5, 2020 at 7:31 AM Uwe L. Korn  wrote:
> > >
> > > I'm failing to verify C++ on macOS as it seems that we nowadays pull all 
> > > dependencies from the system. Is there a known way to build & test on OSX 
> > > with the script and use conda for the requirements?
> > >
> > > Otherwise I probably need to investe to create such a way.
> > >
> > > Cheers
> > > Uwe
> > >
> > > On Wed, Feb 5, 2020, at 2:54 AM, Krisztián Szűcs wrote:
> > > > Hi,
> > > >
> > > > I've cherry-picked the wheel fix [1] on top of the 0.16 release tag,
> > > > re-built the wheels using crossbow [2], and uploaded them to
> > > > bintray [3] (also removed win-py38m).
> > > >
> > > > Anyone who has voted after verifying the wheels, please re-run
> > > > the verification script again for the wheels and re-vote.
> > > >
> > > > Thanks, Krisztian
> > > >
> > > > [1]
> > > > https://github.com/apache/arrow/commit/67e34c53b3be4c88348369f8109626b4a8a997aa
> > > > [2] https://github.com/ursa-labs/crossbow/branches/all?query=build-733
> > > > [3] https://bintray.com/apache/arrow/python-rc/0.16.0-rc2#files
> > > >
> > > > On Tue, Feb 4, 2020 at 7:08 PM Wes McKinney  wrote:
> > > > >
> > > > > +1 (binding)
> > > > >
> > > > > Some patches were required to the verification scripts but I have run:
> > > > >
> > > > > * Full source verification on Ubuntu 18.04
> > > > > * Linux binary verification
> > > > > * Source verification on Windows 10 (needed ARROW-6757)
> > > > > * Windows binary verification. Note that Python 3.8 wheel is broken
> > > > > (see ARROW-7755). Whoever uploads the wheels to PyPI _SHOULD NOT_
> > > > > upload this 3.8 wheel until we know what's wrong (if we upload a
> > > > > broken wheel then `pip install pyarrow==0.16.0` will be permanently
> > > > > broken on Windows/Python 3.8)
> > > > >
> > > > > On Mon, Feb 3, 2020 at 9:26 PM Francois Saint-Jacques
> > > > >  wrote:
> > > > > >
> > > > > > Tested on ubuntu 18.04 for the source release.
> > > > > >
> > > > > > On Mon, Feb 3, 2020 at 10:07 PM Francois Saint-Jacques
> > > > > >  wrote:
> > > > > > >
> > > > > > > +1
> > > > > > >
> > > > > > > Binaries verification didn't have any issues.
> > > > > > > Sources verification worked with some local environment hiccups
> > > > > > >
> > > > > > > François
> > > > > > >
> > > > > > > On Mon, Feb 3, 2020 at 8:46 PM Andy Grove  
> > > > > > > wrote:
> > > > > > > >
> > > > > > > > +1 (binding) based on running the Rust tests
> > > > > > > >
> > > > > > > > Thanks.
> > > > > > > >
> > > > > > > > On Thu, Jan 30, 2020 at 8:13 PM Krisztián Szűcs 
> > > > > > > > 
> > > > > > > > wrote:
> > > > > > > >
> > > > > > > > > Hi,
> > > > > > > > >
> > > > > > > > > I would like to propose the following release candidate (RC2) 
> > > > > > > > > of Apache
> > > > > > > > > Arrow version 0.16.0. This is a release consisting of 728
> > > > > > > > > resolved JIRA issues[1].
> > > > > > > > >
> > > > > > > > > This release candidate is based on commit:
> > > > > > > > > 729a7689fd87572e6a14ad36f19cd579a8b8d9c5 [2]
> > > > > > > > >
> > > > > > > > > The source release rc2 is hosted at [3].
> > > > > > > > > The binary artifacts are hosted at [4][5][6][7].
> > > > > > > > > The changelog is located at [8].
> > > > > > > > >
> > > > > > > > > Please download, verify checksums and signatures, run the 
> > > > > > > > > unit tests,
> > > > > > > > > and vote on the release. See [9] for how to validate a 
> > > > > > > > > release candidate.
> > > > > > > > >
> > > > > > > > > The vote 

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-05 Thread Neal Richardson
I have a fix on my GHA test branch, I think:
https://github.com/apache/arrow/pull/6349/files#diff-3ebb5f8536634a43ccb884fcd453b1cd

On Wed, Feb 5, 2020 at 9:14 AM Wes McKinney  wrote:

> The Windows wheel RC script is broken
>
> wget --no-check-certificate -O pyarrow-0.16.0-cp38-cp38m-win_amd64.whl
>
> https://bintray.com/apache/arrow/download_file?file_path=python-rc%2F0.16.0-rc2%2Fpyarrow-0.1
> 6.0-cp38-cp38m-win_amd64.whl
> 
>  || EXIT /B 1
> --2020-02-05 11:11:15--
>
> https://bintray.com/apache/arrow/download_file?file_path=python-rc%2F0.16.0-rc2%2Fpyarrow-0.16.0-cp38-cp38m-win_amd64.whl
> Resolving bintray.com (bintray.com)... 75.126.208.206
> Connecting to bintray.com (bintray.com)|75.126.208.206|:443...
> connected.
> HTTP request sent, awaiting response... 404 Not Found
> 2020-02-05 11:11:15 ERROR 404: Not Found.
>
> I will try to fix
>
> On Wed, Feb 5, 2020 at 7:31 AM Uwe L. Korn  wrote:
> >
> > I'm failing to verify C++ on macOS as it seems that we nowadays pull all
> dependencies from the system. Is there a known way to build & test on OSX
> with the script and use conda for the requirements?
> >
> > Otherwise I probably need to investe to create such a way.
> >
> > Cheers
> > Uwe
> >
> > On Wed, Feb 5, 2020, at 2:54 AM, Krisztián Szűcs wrote:
> > > Hi,
> > >
> > > I've cherry-picked the wheel fix [1] on top of the 0.16 release tag,
> > > re-built the wheels using crossbow [2], and uploaded them to
> > > bintray [3] (also removed win-py38m).
> > >
> > > Anyone who has voted after verifying the wheels, please re-run
> > > the verification script again for the wheels and re-vote.
> > >
> > > Thanks, Krisztian
> > >
> > > [1]
> > >
> https://github.com/apache/arrow/commit/67e34c53b3be4c88348369f8109626b4a8a997aa
> > > [2] https://github.com/ursa-labs/crossbow/branches/all?query=build-733
> > > [3] https://bintray.com/apache/arrow/python-rc/0.16.0-rc2#files
> > >
> > > On Tue, Feb 4, 2020 at 7:08 PM Wes McKinney 
> wrote:
> > > >
> > > > +1 (binding)
> > > >
> > > > Some patches were required to the verification scripts but I have
> run:
> > > >
> > > > * Full source verification on Ubuntu 18.04
> > > > * Linux binary verification
> > > > * Source verification on Windows 10 (needed ARROW-6757)
> > > > * Windows binary verification. Note that Python 3.8 wheel is broken
> > > > (see ARROW-7755). Whoever uploads the wheels to PyPI _SHOULD NOT_
> > > > upload this 3.8 wheel until we know what's wrong (if we upload a
> > > > broken wheel then `pip install pyarrow==0.16.0` will be permanently
> > > > broken on Windows/Python 3.8)
> > > >
> > > > On Mon, Feb 3, 2020 at 9:26 PM Francois Saint-Jacques
> > > >  wrote:
> > > > >
> > > > > Tested on ubuntu 18.04 for the source release.
> > > > >
> > > > > On Mon, Feb 3, 2020 at 10:07 PM Francois Saint-Jacques
> > > > >  wrote:
> > > > > >
> > > > > > +1
> > > > > >
> > > > > > Binaries verification didn't have any issues.
> > > > > > Sources verification worked with some local environment hiccups
> > > > > >
> > > > > > François
> > > > > >
> > > > > > On Mon, Feb 3, 2020 at 8:46 PM Andy Grove 
> wrote:
> > > > > > >
> > > > > > > +1 (binding) based on running the Rust tests
> > > > > > >
> > > > > > > Thanks.
> > > > > > >
> > > > > > > On Thu, Jan 30, 2020 at 8:13 PM Krisztián Szűcs <
> szucs.kriszt...@gmail.com>
> > > > > > > wrote:
> > > > > > >
> > > > > > > > Hi,
> > > > > > > >
> > > > > > > > I would like to propose the following release candidate
> (RC2) of Apache
> > > > > > > > Arrow version 0.16.0. This is a release consisting of 728
> > > > > > > > resolved JIRA issues[1].
> > > > > > > >
> > > > > > > > This release candidate is based on commit:
> > > > > > > > 729a7689fd87572e6a14ad36f19cd579a8b8d9c5 [2]
> > > > > > > >
> > > > > > > > The source release rc2 is hosted at [3].
> > > > > > > > The binary artifacts are hosted at [4][5][6][7].
> > > > > > > > The changelog is located at [8].
> > > > > > > >
> > > > > > > > Please download, verify checksums and signatures, run the
> unit tests,
> > > > > > > > and vote on the release. See [9] for how to validate a
> release candidate.
> > > > > > > >
> > > > > > > > The vote will be open for at least 72 hours.
> > > > > > > >
> > > > > > > > [ ] +1 Release this as Apache Arrow 0.16.0
> > > > > > > > [ ] +0
> > > > > > > > [ ] -1 Do not release this as Apache Arrow 0.16.0 because...
> > > > > > > >
> > > > > > > > [1]:
> > > > > > > >
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.16.0
> > > > > > > > [2]:
> > > > > > > >
> https://github.com/apache/arrow/tree/729a7689fd87572e6a14ad36f19cd579a8b8d9c5
> > > > > > > > [3]:
> https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.16.0-rc2
> > > > > > > > [4]: https://bintray.com/apache/arrow/centos-rc/0.16.0-rc2
> > > > > > > > 

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-05 Thread Krisztián Szűcs
The wheel was built successfully and available under the crossbow
releases. Something must have gone wrong during download/upload
to bintray. I'm re-uploading the wheels again, waiting for the network.

On Wed, Feb 5, 2020 at 6:14 PM Wes McKinney  wrote:
>
> The Windows wheel RC script is broken
>
> wget --no-check-certificate -O pyarrow-0.16.0-cp38-cp38m-win_amd64.whl
> https://bintray.com/apache/arrow/download_file?file_path=python-rc%2F0.16.0-rc2%2Fpyarrow-0.1
> 6.0-cp38-cp38m-win_amd64.whl   || EXIT /B 1
> --2020-02-05 11:11:15--
> https://bintray.com/apache/arrow/download_file?file_path=python-rc%2F0.16.0-rc2%2Fpyarrow-0.16.0-cp38-cp38m-win_amd64.whl
> Resolving bintray.com (bintray.com)... 75.126.208.206
> Connecting to bintray.com (bintray.com)|75.126.208.206|:443...
> connected.
> HTTP request sent, awaiting response... 404 Not Found
> 2020-02-05 11:11:15 ERROR 404: Not Found.
>
> I will try to fix
>
> On Wed, Feb 5, 2020 at 7:31 AM Uwe L. Korn  wrote:
> >
> > I'm failing to verify C++ on macOS as it seems that we nowadays pull all 
> > dependencies from the system. Is there a known way to build & test on OSX 
> > with the script and use conda for the requirements?
> >
> > Otherwise I probably need to investe to create such a way.
> >
> > Cheers
> > Uwe
> >
> > On Wed, Feb 5, 2020, at 2:54 AM, Krisztián Szűcs wrote:
> > > Hi,
> > >
> > > I've cherry-picked the wheel fix [1] on top of the 0.16 release tag,
> > > re-built the wheels using crossbow [2], and uploaded them to
> > > bintray [3] (also removed win-py38m).
> > >
> > > Anyone who has voted after verifying the wheels, please re-run
> > > the verification script again for the wheels and re-vote.
> > >
> > > Thanks, Krisztian
> > >
> > > [1]
> > > https://github.com/apache/arrow/commit/67e34c53b3be4c88348369f8109626b4a8a997aa
> > > [2] https://github.com/ursa-labs/crossbow/branches/all?query=build-733
> > > [3] https://bintray.com/apache/arrow/python-rc/0.16.0-rc2#files
> > >
> > > On Tue, Feb 4, 2020 at 7:08 PM Wes McKinney  wrote:
> > > >
> > > > +1 (binding)
> > > >
> > > > Some patches were required to the verification scripts but I have run:
> > > >
> > > > * Full source verification on Ubuntu 18.04
> > > > * Linux binary verification
> > > > * Source verification on Windows 10 (needed ARROW-6757)
> > > > * Windows binary verification. Note that Python 3.8 wheel is broken
> > > > (see ARROW-7755). Whoever uploads the wheels to PyPI _SHOULD NOT_
> > > > upload this 3.8 wheel until we know what's wrong (if we upload a
> > > > broken wheel then `pip install pyarrow==0.16.0` will be permanently
> > > > broken on Windows/Python 3.8)
> > > >
> > > > On Mon, Feb 3, 2020 at 9:26 PM Francois Saint-Jacques
> > > >  wrote:
> > > > >
> > > > > Tested on ubuntu 18.04 for the source release.
> > > > >
> > > > > On Mon, Feb 3, 2020 at 10:07 PM Francois Saint-Jacques
> > > > >  wrote:
> > > > > >
> > > > > > +1
> > > > > >
> > > > > > Binaries verification didn't have any issues.
> > > > > > Sources verification worked with some local environment hiccups
> > > > > >
> > > > > > François
> > > > > >
> > > > > > On Mon, Feb 3, 2020 at 8:46 PM Andy Grove  
> > > > > > wrote:
> > > > > > >
> > > > > > > +1 (binding) based on running the Rust tests
> > > > > > >
> > > > > > > Thanks.
> > > > > > >
> > > > > > > On Thu, Jan 30, 2020 at 8:13 PM Krisztián Szűcs 
> > > > > > > 
> > > > > > > wrote:
> > > > > > >
> > > > > > > > Hi,
> > > > > > > >
> > > > > > > > I would like to propose the following release candidate (RC2) 
> > > > > > > > of Apache
> > > > > > > > Arrow version 0.16.0. This is a release consisting of 728
> > > > > > > > resolved JIRA issues[1].
> > > > > > > >
> > > > > > > > This release candidate is based on commit:
> > > > > > > > 729a7689fd87572e6a14ad36f19cd579a8b8d9c5 [2]
> > > > > > > >
> > > > > > > > The source release rc2 is hosted at [3].
> > > > > > > > The binary artifacts are hosted at [4][5][6][7].
> > > > > > > > The changelog is located at [8].
> > > > > > > >
> > > > > > > > Please download, verify checksums and signatures, run the unit 
> > > > > > > > tests,
> > > > > > > > and vote on the release. See [9] for how to validate a release 
> > > > > > > > candidate.
> > > > > > > >
> > > > > > > > The vote will be open for at least 72 hours.
> > > > > > > >
> > > > > > > > [ ] +1 Release this as Apache Arrow 0.16.0
> > > > > > > > [ ] +0
> > > > > > > > [ ] -1 Do not release this as Apache Arrow 0.16.0 because...
> > > > > > > >
> > > > > > > > [1]:
> > > > > > > > https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.16.0
> > > > > > > > [2]:
> > > > > > > > https://github.com/apache/arrow/tree/729a7689fd87572e6a14ad36f19cd579a8b8d9c5
> > > > > > > > [3]: 
> > > > > > > > https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.16.0-rc2
> > > > > > > > [4]: https://bintray.com/apache/arrow/centos-rc/0.16.0-rc2
> > > > > > > > [5]: 

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-05 Thread Wes McKinney
The Windows wheel RC script is broken

wget --no-check-certificate -O pyarrow-0.16.0-cp38-cp38m-win_amd64.whl
https://bintray.com/apache/arrow/download_file?file_path=python-rc%2F0.16.0-rc2%2Fpyarrow-0.1
6.0-cp38-cp38m-win_amd64.whl   || EXIT /B 1
--2020-02-05 11:11:15--
https://bintray.com/apache/arrow/download_file?file_path=python-rc%2F0.16.0-rc2%2Fpyarrow-0.16.0-cp38-cp38m-win_amd64.whl
Resolving bintray.com (bintray.com)... 75.126.208.206
Connecting to bintray.com (bintray.com)|75.126.208.206|:443...
connected.
HTTP request sent, awaiting response... 404 Not Found
2020-02-05 11:11:15 ERROR 404: Not Found.

I will try to fix

On Wed, Feb 5, 2020 at 7:31 AM Uwe L. Korn  wrote:
>
> I'm failing to verify C++ on macOS as it seems that we nowadays pull all 
> dependencies from the system. Is there a known way to build & test on OSX 
> with the script and use conda for the requirements?
>
> Otherwise I probably need to investe to create such a way.
>
> Cheers
> Uwe
>
> On Wed, Feb 5, 2020, at 2:54 AM, Krisztián Szűcs wrote:
> > Hi,
> >
> > I've cherry-picked the wheel fix [1] on top of the 0.16 release tag,
> > re-built the wheels using crossbow [2], and uploaded them to
> > bintray [3] (also removed win-py38m).
> >
> > Anyone who has voted after verifying the wheels, please re-run
> > the verification script again for the wheels and re-vote.
> >
> > Thanks, Krisztian
> >
> > [1]
> > https://github.com/apache/arrow/commit/67e34c53b3be4c88348369f8109626b4a8a997aa
> > [2] https://github.com/ursa-labs/crossbow/branches/all?query=build-733
> > [3] https://bintray.com/apache/arrow/python-rc/0.16.0-rc2#files
> >
> > On Tue, Feb 4, 2020 at 7:08 PM Wes McKinney  wrote:
> > >
> > > +1 (binding)
> > >
> > > Some patches were required to the verification scripts but I have run:
> > >
> > > * Full source verification on Ubuntu 18.04
> > > * Linux binary verification
> > > * Source verification on Windows 10 (needed ARROW-6757)
> > > * Windows binary verification. Note that Python 3.8 wheel is broken
> > > (see ARROW-7755). Whoever uploads the wheels to PyPI _SHOULD NOT_
> > > upload this 3.8 wheel until we know what's wrong (if we upload a
> > > broken wheel then `pip install pyarrow==0.16.0` will be permanently
> > > broken on Windows/Python 3.8)
> > >
> > > On Mon, Feb 3, 2020 at 9:26 PM Francois Saint-Jacques
> > >  wrote:
> > > >
> > > > Tested on ubuntu 18.04 for the source release.
> > > >
> > > > On Mon, Feb 3, 2020 at 10:07 PM Francois Saint-Jacques
> > > >  wrote:
> > > > >
> > > > > +1
> > > > >
> > > > > Binaries verification didn't have any issues.
> > > > > Sources verification worked with some local environment hiccups
> > > > >
> > > > > François
> > > > >
> > > > > On Mon, Feb 3, 2020 at 8:46 PM Andy Grove  
> > > > > wrote:
> > > > > >
> > > > > > +1 (binding) based on running the Rust tests
> > > > > >
> > > > > > Thanks.
> > > > > >
> > > > > > On Thu, Jan 30, 2020 at 8:13 PM Krisztián Szűcs 
> > > > > > 
> > > > > > wrote:
> > > > > >
> > > > > > > Hi,
> > > > > > >
> > > > > > > I would like to propose the following release candidate (RC2) of 
> > > > > > > Apache
> > > > > > > Arrow version 0.16.0. This is a release consisting of 728
> > > > > > > resolved JIRA issues[1].
> > > > > > >
> > > > > > > This release candidate is based on commit:
> > > > > > > 729a7689fd87572e6a14ad36f19cd579a8b8d9c5 [2]
> > > > > > >
> > > > > > > The source release rc2 is hosted at [3].
> > > > > > > The binary artifacts are hosted at [4][5][6][7].
> > > > > > > The changelog is located at [8].
> > > > > > >
> > > > > > > Please download, verify checksums and signatures, run the unit 
> > > > > > > tests,
> > > > > > > and vote on the release. See [9] for how to validate a release 
> > > > > > > candidate.
> > > > > > >
> > > > > > > The vote will be open for at least 72 hours.
> > > > > > >
> > > > > > > [ ] +1 Release this as Apache Arrow 0.16.0
> > > > > > > [ ] +0
> > > > > > > [ ] -1 Do not release this as Apache Arrow 0.16.0 because...
> > > > > > >
> > > > > > > [1]:
> > > > > > > https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.16.0
> > > > > > > [2]:
> > > > > > > https://github.com/apache/arrow/tree/729a7689fd87572e6a14ad36f19cd579a8b8d9c5
> > > > > > > [3]: 
> > > > > > > https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.16.0-rc2
> > > > > > > [4]: https://bintray.com/apache/arrow/centos-rc/0.16.0-rc2
> > > > > > > [5]: https://bintray.com/apache/arrow/debian-rc/0.16.0-rc2
> > > > > > > [6]: https://bintray.com/apache/arrow/python-rc/0.16.0-rc2
> > > > > > > [7]: https://bintray.com/apache/arrow/ubuntu-rc/0.16.0-rc2
> > > > > > > [8]:
> > > > > > > https://github.com/apache/arrow/blob/729a7689fd87572e6a14ad36f19cd579a8b8d9c5/CHANGELOG.md
> > > > > > > [9]:
> > > > > > > https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> > > > > > >
> >


Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-05 Thread Uwe L. Korn
I'm failing to verify C++ on macOS as it seems that we nowadays pull all 
dependencies from the system. Is there a known way to build & test on OSX with 
the script and use conda for the requirements? 

Otherwise I probably need to investe to create such a way.

Cheers
Uwe

On Wed, Feb 5, 2020, at 2:54 AM, Krisztián Szűcs wrote:
> Hi,
> 
> I've cherry-picked the wheel fix [1] on top of the 0.16 release tag,
> re-built the wheels using crossbow [2], and uploaded them to
> bintray [3] (also removed win-py38m).
> 
> Anyone who has voted after verifying the wheels, please re-run
> the verification script again for the wheels and re-vote.
> 
> Thanks, Krisztian
> 
> [1] 
> https://github.com/apache/arrow/commit/67e34c53b3be4c88348369f8109626b4a8a997aa
> [2] https://github.com/ursa-labs/crossbow/branches/all?query=build-733
> [3] https://bintray.com/apache/arrow/python-rc/0.16.0-rc2#files
> 
> On Tue, Feb 4, 2020 at 7:08 PM Wes McKinney  wrote:
> >
> > +1 (binding)
> >
> > Some patches were required to the verification scripts but I have run:
> >
> > * Full source verification on Ubuntu 18.04
> > * Linux binary verification
> > * Source verification on Windows 10 (needed ARROW-6757)
> > * Windows binary verification. Note that Python 3.8 wheel is broken
> > (see ARROW-7755). Whoever uploads the wheels to PyPI _SHOULD NOT_
> > upload this 3.8 wheel until we know what's wrong (if we upload a
> > broken wheel then `pip install pyarrow==0.16.0` will be permanently
> > broken on Windows/Python 3.8)
> >
> > On Mon, Feb 3, 2020 at 9:26 PM Francois Saint-Jacques
> >  wrote:
> > >
> > > Tested on ubuntu 18.04 for the source release.
> > >
> > > On Mon, Feb 3, 2020 at 10:07 PM Francois Saint-Jacques
> > >  wrote:
> > > >
> > > > +1
> > > >
> > > > Binaries verification didn't have any issues.
> > > > Sources verification worked with some local environment hiccups
> > > >
> > > > François
> > > >
> > > > On Mon, Feb 3, 2020 at 8:46 PM Andy Grove  wrote:
> > > > >
> > > > > +1 (binding) based on running the Rust tests
> > > > >
> > > > > Thanks.
> > > > >
> > > > > On Thu, Jan 30, 2020 at 8:13 PM Krisztián Szűcs 
> > > > > 
> > > > > wrote:
> > > > >
> > > > > > Hi,
> > > > > >
> > > > > > I would like to propose the following release candidate (RC2) of 
> > > > > > Apache
> > > > > > Arrow version 0.16.0. This is a release consisting of 728
> > > > > > resolved JIRA issues[1].
> > > > > >
> > > > > > This release candidate is based on commit:
> > > > > > 729a7689fd87572e6a14ad36f19cd579a8b8d9c5 [2]
> > > > > >
> > > > > > The source release rc2 is hosted at [3].
> > > > > > The binary artifacts are hosted at [4][5][6][7].
> > > > > > The changelog is located at [8].
> > > > > >
> > > > > > Please download, verify checksums and signatures, run the unit 
> > > > > > tests,
> > > > > > and vote on the release. See [9] for how to validate a release 
> > > > > > candidate.
> > > > > >
> > > > > > The vote will be open for at least 72 hours.
> > > > > >
> > > > > > [ ] +1 Release this as Apache Arrow 0.16.0
> > > > > > [ ] +0
> > > > > > [ ] -1 Do not release this as Apache Arrow 0.16.0 because...
> > > > > >
> > > > > > [1]:
> > > > > > https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.16.0
> > > > > > [2]:
> > > > > > https://github.com/apache/arrow/tree/729a7689fd87572e6a14ad36f19cd579a8b8d9c5
> > > > > > [3]: 
> > > > > > https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.16.0-rc2
> > > > > > [4]: https://bintray.com/apache/arrow/centos-rc/0.16.0-rc2
> > > > > > [5]: https://bintray.com/apache/arrow/debian-rc/0.16.0-rc2
> > > > > > [6]: https://bintray.com/apache/arrow/python-rc/0.16.0-rc2
> > > > > > [7]: https://bintray.com/apache/arrow/ubuntu-rc/0.16.0-rc2
> > > > > > [8]:
> > > > > > https://github.com/apache/arrow/blob/729a7689fd87572e6a14ad36f19cd579a8b8d9c5/CHANGELOG.md
> > > > > > [9]:
> > > > > > https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> > > > > >
>


Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-04 Thread Krisztián Szűcs
Hi,

I've cherry-picked the wheel fix [1] on top of the 0.16 release tag,
re-built the wheels using crossbow [2], and uploaded them to
bintray [3] (also removed win-py38m).

Anyone who has voted after verifying the wheels, please re-run
the verification script again for the wheels and re-vote.

Thanks, Krisztian

[1] 
https://github.com/apache/arrow/commit/67e34c53b3be4c88348369f8109626b4a8a997aa
[2] https://github.com/ursa-labs/crossbow/branches/all?query=build-733
[3] https://bintray.com/apache/arrow/python-rc/0.16.0-rc2#files

On Tue, Feb 4, 2020 at 7:08 PM Wes McKinney  wrote:
>
> +1 (binding)
>
> Some patches were required to the verification scripts but I have run:
>
> * Full source verification on Ubuntu 18.04
> * Linux binary verification
> * Source verification on Windows 10 (needed ARROW-6757)
> * Windows binary verification. Note that Python 3.8 wheel is broken
> (see ARROW-7755). Whoever uploads the wheels to PyPI _SHOULD NOT_
> upload this 3.8 wheel until we know what's wrong (if we upload a
> broken wheel then `pip install pyarrow==0.16.0` will be permanently
> broken on Windows/Python 3.8)
>
> On Mon, Feb 3, 2020 at 9:26 PM Francois Saint-Jacques
>  wrote:
> >
> > Tested on ubuntu 18.04 for the source release.
> >
> > On Mon, Feb 3, 2020 at 10:07 PM Francois Saint-Jacques
> >  wrote:
> > >
> > > +1
> > >
> > > Binaries verification didn't have any issues.
> > > Sources verification worked with some local environment hiccups
> > >
> > > François
> > >
> > > On Mon, Feb 3, 2020 at 8:46 PM Andy Grove  wrote:
> > > >
> > > > +1 (binding) based on running the Rust tests
> > > >
> > > > Thanks.
> > > >
> > > > On Thu, Jan 30, 2020 at 8:13 PM Krisztián Szűcs 
> > > > 
> > > > wrote:
> > > >
> > > > > Hi,
> > > > >
> > > > > I would like to propose the following release candidate (RC2) of 
> > > > > Apache
> > > > > Arrow version 0.16.0. This is a release consisting of 728
> > > > > resolved JIRA issues[1].
> > > > >
> > > > > This release candidate is based on commit:
> > > > > 729a7689fd87572e6a14ad36f19cd579a8b8d9c5 [2]
> > > > >
> > > > > The source release rc2 is hosted at [3].
> > > > > The binary artifacts are hosted at [4][5][6][7].
> > > > > The changelog is located at [8].
> > > > >
> > > > > Please download, verify checksums and signatures, run the unit tests,
> > > > > and vote on the release. See [9] for how to validate a release 
> > > > > candidate.
> > > > >
> > > > > The vote will be open for at least 72 hours.
> > > > >
> > > > > [ ] +1 Release this as Apache Arrow 0.16.0
> > > > > [ ] +0
> > > > > [ ] -1 Do not release this as Apache Arrow 0.16.0 because...
> > > > >
> > > > > [1]:
> > > > > https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.16.0
> > > > > [2]:
> > > > > https://github.com/apache/arrow/tree/729a7689fd87572e6a14ad36f19cd579a8b8d9c5
> > > > > [3]: 
> > > > > https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.16.0-rc2
> > > > > [4]: https://bintray.com/apache/arrow/centos-rc/0.16.0-rc2
> > > > > [5]: https://bintray.com/apache/arrow/debian-rc/0.16.0-rc2
> > > > > [6]: https://bintray.com/apache/arrow/python-rc/0.16.0-rc2
> > > > > [7]: https://bintray.com/apache/arrow/ubuntu-rc/0.16.0-rc2
> > > > > [8]:
> > > > > https://github.com/apache/arrow/blob/729a7689fd87572e6a14ad36f19cd579a8b8d9c5/CHANGELOG.md
> > > > > [9]:
> > > > > https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> > > > >


Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-04 Thread Bryan Cutler
+1

I had some trouble due to ARROW-7760 at first, but applied the same patch
and passed. I ran the command:
TMPDIR=/tmp/arrow TEST_DEFAULT=0 TEST_SOURCE=1 TEST_CPP=1 TEST_PYTHON=1
TEST_JAVA=1 TEST_INTEGRATION_CPP=1 TEST_INTEGRATION_JAVA=1
dev/release/verify-release-candidate.sh source 0.16.0 2

On Tue, Feb 4, 2020 at 10:08 AM Wes McKinney  wrote:

> +1 (binding)
>
> Some patches were required to the verification scripts but I have run:
>
> * Full source verification on Ubuntu 18.04
> * Linux binary verification
> * Source verification on Windows 10 (needed ARROW-6757)
> * Windows binary verification. Note that Python 3.8 wheel is broken
> (see ARROW-7755). Whoever uploads the wheels to PyPI _SHOULD NOT_
> upload this 3.8 wheel until we know what's wrong (if we upload a
> broken wheel then `pip install pyarrow==0.16.0` will be permanently
> broken on Windows/Python 3.8)
>
> On Mon, Feb 3, 2020 at 9:26 PM Francois Saint-Jacques
>  wrote:
> >
> > Tested on ubuntu 18.04 for the source release.
> >
> > On Mon, Feb 3, 2020 at 10:07 PM Francois Saint-Jacques
> >  wrote:
> > >
> > > +1
> > >
> > > Binaries verification didn't have any issues.
> > > Sources verification worked with some local environment hiccups
> > >
> > > François
> > >
> > > On Mon, Feb 3, 2020 at 8:46 PM Andy Grove 
> wrote:
> > > >
> > > > +1 (binding) based on running the Rust tests
> > > >
> > > > Thanks.
> > > >
> > > > On Thu, Jan 30, 2020 at 8:13 PM Krisztián Szűcs <
> szucs.kriszt...@gmail.com>
> > > > wrote:
> > > >
> > > > > Hi,
> > > > >
> > > > > I would like to propose the following release candidate (RC2) of
> Apache
> > > > > Arrow version 0.16.0. This is a release consisting of 728
> > > > > resolved JIRA issues[1].
> > > > >
> > > > > This release candidate is based on commit:
> > > > > 729a7689fd87572e6a14ad36f19cd579a8b8d9c5 [2]
> > > > >
> > > > > The source release rc2 is hosted at [3].
> > > > > The binary artifacts are hosted at [4][5][6][7].
> > > > > The changelog is located at [8].
> > > > >
> > > > > Please download, verify checksums and signatures, run the unit
> tests,
> > > > > and vote on the release. See [9] for how to validate a release
> candidate.
> > > > >
> > > > > The vote will be open for at least 72 hours.
> > > > >
> > > > > [ ] +1 Release this as Apache Arrow 0.16.0
> > > > > [ ] +0
> > > > > [ ] -1 Do not release this as Apache Arrow 0.16.0 because...
> > > > >
> > > > > [1]:
> > > > >
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.16.0
> > > > > [2]:
> > > > >
> https://github.com/apache/arrow/tree/729a7689fd87572e6a14ad36f19cd579a8b8d9c5
> > > > > [3]:
> https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.16.0-rc2
> > > > > [4]: https://bintray.com/apache/arrow/centos-rc/0.16.0-rc2
> > > > > [5]: https://bintray.com/apache/arrow/debian-rc/0.16.0-rc2
> > > > > [6]: https://bintray.com/apache/arrow/python-rc/0.16.0-rc2
> > > > > [7]: https://bintray.com/apache/arrow/ubuntu-rc/0.16.0-rc2
> > > > > [8]:
> > > > >
> https://github.com/apache/arrow/blob/729a7689fd87572e6a14ad36f19cd579a8b8d9c5/CHANGELOG.md
> > > > > [9]:
> > > > >
> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> > > > >
>


Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-04 Thread Wes McKinney
+1 (binding)

Some patches were required to the verification scripts but I have run:

* Full source verification on Ubuntu 18.04
* Linux binary verification
* Source verification on Windows 10 (needed ARROW-6757)
* Windows binary verification. Note that Python 3.8 wheel is broken
(see ARROW-7755). Whoever uploads the wheels to PyPI _SHOULD NOT_
upload this 3.8 wheel until we know what's wrong (if we upload a
broken wheel then `pip install pyarrow==0.16.0` will be permanently
broken on Windows/Python 3.8)

On Mon, Feb 3, 2020 at 9:26 PM Francois Saint-Jacques
 wrote:
>
> Tested on ubuntu 18.04 for the source release.
>
> On Mon, Feb 3, 2020 at 10:07 PM Francois Saint-Jacques
>  wrote:
> >
> > +1
> >
> > Binaries verification didn't have any issues.
> > Sources verification worked with some local environment hiccups
> >
> > François
> >
> > On Mon, Feb 3, 2020 at 8:46 PM Andy Grove  wrote:
> > >
> > > +1 (binding) based on running the Rust tests
> > >
> > > Thanks.
> > >
> > > On Thu, Jan 30, 2020 at 8:13 PM Krisztián Szűcs 
> > > 
> > > wrote:
> > >
> > > > Hi,
> > > >
> > > > I would like to propose the following release candidate (RC2) of Apache
> > > > Arrow version 0.16.0. This is a release consisting of 728
> > > > resolved JIRA issues[1].
> > > >
> > > > This release candidate is based on commit:
> > > > 729a7689fd87572e6a14ad36f19cd579a8b8d9c5 [2]
> > > >
> > > > The source release rc2 is hosted at [3].
> > > > The binary artifacts are hosted at [4][5][6][7].
> > > > The changelog is located at [8].
> > > >
> > > > Please download, verify checksums and signatures, run the unit tests,
> > > > and vote on the release. See [9] for how to validate a release 
> > > > candidate.
> > > >
> > > > The vote will be open for at least 72 hours.
> > > >
> > > > [ ] +1 Release this as Apache Arrow 0.16.0
> > > > [ ] +0
> > > > [ ] -1 Do not release this as Apache Arrow 0.16.0 because...
> > > >
> > > > [1]:
> > > > https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.16.0
> > > > [2]:
> > > > https://github.com/apache/arrow/tree/729a7689fd87572e6a14ad36f19cd579a8b8d9c5
> > > > [3]: 
> > > > https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.16.0-rc2
> > > > [4]: https://bintray.com/apache/arrow/centos-rc/0.16.0-rc2
> > > > [5]: https://bintray.com/apache/arrow/debian-rc/0.16.0-rc2
> > > > [6]: https://bintray.com/apache/arrow/python-rc/0.16.0-rc2
> > > > [7]: https://bintray.com/apache/arrow/ubuntu-rc/0.16.0-rc2
> > > > [8]:
> > > > https://github.com/apache/arrow/blob/729a7689fd87572e6a14ad36f19cd579a8b8d9c5/CHANGELOG.md
> > > > [9]:
> > > > https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> > > >


Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-03 Thread Francois Saint-Jacques
Tested on ubuntu 18.04 for the source release.

On Mon, Feb 3, 2020 at 10:07 PM Francois Saint-Jacques
 wrote:
>
> +1
>
> Binaries verification didn't have any issues.
> Sources verification worked with some local environment hiccups
>
> François
>
> On Mon, Feb 3, 2020 at 8:46 PM Andy Grove  wrote:
> >
> > +1 (binding) based on running the Rust tests
> >
> > Thanks.
> >
> > On Thu, Jan 30, 2020 at 8:13 PM Krisztián Szűcs 
> > wrote:
> >
> > > Hi,
> > >
> > > I would like to propose the following release candidate (RC2) of Apache
> > > Arrow version 0.16.0. This is a release consisting of 728
> > > resolved JIRA issues[1].
> > >
> > > This release candidate is based on commit:
> > > 729a7689fd87572e6a14ad36f19cd579a8b8d9c5 [2]
> > >
> > > The source release rc2 is hosted at [3].
> > > The binary artifacts are hosted at [4][5][6][7].
> > > The changelog is located at [8].
> > >
> > > Please download, verify checksums and signatures, run the unit tests,
> > > and vote on the release. See [9] for how to validate a release candidate.
> > >
> > > The vote will be open for at least 72 hours.
> > >
> > > [ ] +1 Release this as Apache Arrow 0.16.0
> > > [ ] +0
> > > [ ] -1 Do not release this as Apache Arrow 0.16.0 because...
> > >
> > > [1]:
> > > https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.16.0
> > > [2]:
> > > https://github.com/apache/arrow/tree/729a7689fd87572e6a14ad36f19cd579a8b8d9c5
> > > [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.16.0-rc2
> > > [4]: https://bintray.com/apache/arrow/centos-rc/0.16.0-rc2
> > > [5]: https://bintray.com/apache/arrow/debian-rc/0.16.0-rc2
> > > [6]: https://bintray.com/apache/arrow/python-rc/0.16.0-rc2
> > > [7]: https://bintray.com/apache/arrow/ubuntu-rc/0.16.0-rc2
> > > [8]:
> > > https://github.com/apache/arrow/blob/729a7689fd87572e6a14ad36f19cd579a8b8d9c5/CHANGELOG.md
> > > [9]:
> > > https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> > >


Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-03 Thread Francois Saint-Jacques
+1

Binaries verification didn't have any issues.
Sources verification worked with some local environment hiccups

François

On Mon, Feb 3, 2020 at 8:46 PM Andy Grove  wrote:
>
> +1 (binding) based on running the Rust tests
>
> Thanks.
>
> On Thu, Jan 30, 2020 at 8:13 PM Krisztián Szűcs 
> wrote:
>
> > Hi,
> >
> > I would like to propose the following release candidate (RC2) of Apache
> > Arrow version 0.16.0. This is a release consisting of 728
> > resolved JIRA issues[1].
> >
> > This release candidate is based on commit:
> > 729a7689fd87572e6a14ad36f19cd579a8b8d9c5 [2]
> >
> > The source release rc2 is hosted at [3].
> > The binary artifacts are hosted at [4][5][6][7].
> > The changelog is located at [8].
> >
> > Please download, verify checksums and signatures, run the unit tests,
> > and vote on the release. See [9] for how to validate a release candidate.
> >
> > The vote will be open for at least 72 hours.
> >
> > [ ] +1 Release this as Apache Arrow 0.16.0
> > [ ] +0
> > [ ] -1 Do not release this as Apache Arrow 0.16.0 because...
> >
> > [1]:
> > https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.16.0
> > [2]:
> > https://github.com/apache/arrow/tree/729a7689fd87572e6a14ad36f19cd579a8b8d9c5
> > [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.16.0-rc2
> > [4]: https://bintray.com/apache/arrow/centos-rc/0.16.0-rc2
> > [5]: https://bintray.com/apache/arrow/debian-rc/0.16.0-rc2
> > [6]: https://bintray.com/apache/arrow/python-rc/0.16.0-rc2
> > [7]: https://bintray.com/apache/arrow/ubuntu-rc/0.16.0-rc2
> > [8]:
> > https://github.com/apache/arrow/blob/729a7689fd87572e6a14ad36f19cd579a8b8d9c5/CHANGELOG.md
> > [9]:
> > https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> >


Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-03 Thread Andy Grove
+1 (binding) based on running the Rust tests

Thanks.

On Thu, Jan 30, 2020 at 8:13 PM Krisztián Szűcs 
wrote:

> Hi,
>
> I would like to propose the following release candidate (RC2) of Apache
> Arrow version 0.16.0. This is a release consisting of 728
> resolved JIRA issues[1].
>
> This release candidate is based on commit:
> 729a7689fd87572e6a14ad36f19cd579a8b8d9c5 [2]
>
> The source release rc2 is hosted at [3].
> The binary artifacts are hosted at [4][5][6][7].
> The changelog is located at [8].
>
> Please download, verify checksums and signatures, run the unit tests,
> and vote on the release. See [9] for how to validate a release candidate.
>
> The vote will be open for at least 72 hours.
>
> [ ] +1 Release this as Apache Arrow 0.16.0
> [ ] +0
> [ ] -1 Do not release this as Apache Arrow 0.16.0 because...
>
> [1]:
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.16.0
> [2]:
> https://github.com/apache/arrow/tree/729a7689fd87572e6a14ad36f19cd579a8b8d9c5
> [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.16.0-rc2
> [4]: https://bintray.com/apache/arrow/centos-rc/0.16.0-rc2
> [5]: https://bintray.com/apache/arrow/debian-rc/0.16.0-rc2
> [6]: https://bintray.com/apache/arrow/python-rc/0.16.0-rc2
> [7]: https://bintray.com/apache/arrow/ubuntu-rc/0.16.0-rc2
> [8]:
> https://github.com/apache/arrow/blob/729a7689fd87572e6a14ad36f19cd579a8b8d9c5/CHANGELOG.md
> [9]:
> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
>


Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-03 Thread David Li
Hi Neal,

The flaky Flight auth test has been an issue recently:
https://issues.apache.org/jira/browse/ARROW-7721

I'm hoping to take a look at this when I get a chance.

Best,
David

On 2/3/20, Neal Richardson  wrote:
> Some further color, as builds have started to fail:
>
> 1. Windows source fails oddly; it seems that installing boost makes wget
> not work correctly. Before installing boost, I can wget the rc tarball and
> build as far as the boost version check in C++, but after installing boost,
> I can't download the tarball.
> 2. On macOS, C# fails because it looks for a specific dotnet version that
> is not one of the 6 present. Skipping C#, python fails in cmake for not
> finding a CXX compiler:
> https://github.com/apache/arrow/runs/424318337?check_suite_focus=true#step:3:35613
> 3. On ubuntu source verification fails on Java, Flight memory leak:
> https://github.com/apache/arrow/runs/424357626#step:3:24982
> 4. Ubuntu wheels fail on python 3.5, but differently from Kou's experience:
> https://github.com/apache/arrow/runs/424357635#step:3:4162
>
> Not sure how much of this is misconfigured environment and how much is bad
> code.
>
> Neal
>
> On Mon, Feb 3, 2020 at 4:19 PM Neal Richardson
> 
> wrote:
>
>> I've been experimenting with running the release verification on GitHub
>> Actions: https://github.com/apache/arrow/pull/6349. It would be great to
>> automate at least the core checks, even if releasing still requires some
>> manual checking too.
>>
>> So far, I've verified Python wheels on Windows except for python 3.8
>> (there's some issue with py38 vs. py38m) and I've made it through the C++
>> source build on macOS. Other jobs are either still running or need some
>> further debugging on the setup.
>>
>> If anyone wants to try to push these further, please feel free to push to
>> my branch.
>>
>> Neal
>>
>> On Mon, Feb 3, 2020 at 11:37 AM Neal Richardson <
>> neal.p.richard...@gmail.com> wrote:
>>
>>> I used that with
>>> https://patch-diff.githubusercontent.com/raw/apache/arrow/pull/6344.diff
>>> applied.
>>>
>>> On Mon, Feb 3, 2020 at 11:34 AM Krisztián Szűcs <
>>> szucs.kriszt...@gmail.com> wrote:
>>>
 Please use the latest master [1] to verify the wheels.

 [1]:
 https://github.com/apache/arrow/commit/cb81f7d84c26cd75f4568ae1b29744cb4218b578

 On Mon, Feb 3, 2020 at 8:26 PM Neal Richardson
  wrote:
 >
 > +1 (non-binding)
 >
 > I did binary verification and macOS (10.14) wheels. Wheels for 3.5
 failed
 > as previously described, and 2.7 also failed similarly, so I'm
 gathering
 > that that's not a blocker. 3.6 - 3.8 passed once I added this patch
 > for
 > Flight test fixtures: https://github.com/apache/arrow/pull/6345
 >
 > Neal
 >
 > On Mon, Feb 3, 2020 at 7:38 AM Antoine Pitrou 
 wrote:
 >
 > > On Fri, 31 Jan 2020 04:13:12 +0100
 > > Krisztián Szűcs  wrote:
 > > > Hi,
 > > >
 > > > I would like to propose the following release candidate (RC2) of
 Apache
 > > > Arrow version 0.16.0. This is a release consisting of 728
 > > > resolved JIRA issues[1].
 > > >
 > > > This release candidate is based on commit:
 > > > 729a7689fd87572e6a14ad36f19cd579a8b8d9c5 [2]
 > > >
 > > > The source release rc2 is hosted at [3].
 > > > The binary artifacts are hosted at [4][5][6][7].
 > > > The changelog is located at [8].
 > > >
 > > > Please download, verify checksums and signatures, run the unit
 tests,
 > > > and vote on the release. See [9] for how to validate a release
 candidate.
 > > >
 > > > The vote will be open for at least 72 hours.
 > > >
 > > > [ ] +1 Release this as Apache Arrow 0.16.0
 > > > [ ] +0
 > > > [ ] -1 Do not release this as Apache Arrow 0.16.0 because...
 > >
 > > +1 from me.
 > >
 > > Regards
 > >
 > > Antoine.
 > >
 > >
 > >

>>>
>


Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-03 Thread Neal Richardson
Some further color, as builds have started to fail:

1. Windows source fails oddly; it seems that installing boost makes wget
not work correctly. Before installing boost, I can wget the rc tarball and
build as far as the boost version check in C++, but after installing boost,
I can't download the tarball.
2. On macOS, C# fails because it looks for a specific dotnet version that
is not one of the 6 present. Skipping C#, python fails in cmake for not
finding a CXX compiler:
https://github.com/apache/arrow/runs/424318337?check_suite_focus=true#step:3:35613
3. On ubuntu source verification fails on Java, Flight memory leak:
https://github.com/apache/arrow/runs/424357626#step:3:24982
4. Ubuntu wheels fail on python 3.5, but differently from Kou's experience:
https://github.com/apache/arrow/runs/424357635#step:3:4162

Not sure how much of this is misconfigured environment and how much is bad
code.

Neal

On Mon, Feb 3, 2020 at 4:19 PM Neal Richardson 
wrote:

> I've been experimenting with running the release verification on GitHub
> Actions: https://github.com/apache/arrow/pull/6349. It would be great to
> automate at least the core checks, even if releasing still requires some
> manual checking too.
>
> So far, I've verified Python wheels on Windows except for python 3.8
> (there's some issue with py38 vs. py38m) and I've made it through the C++
> source build on macOS. Other jobs are either still running or need some
> further debugging on the setup.
>
> If anyone wants to try to push these further, please feel free to push to
> my branch.
>
> Neal
>
> On Mon, Feb 3, 2020 at 11:37 AM Neal Richardson <
> neal.p.richard...@gmail.com> wrote:
>
>> I used that with
>> https://patch-diff.githubusercontent.com/raw/apache/arrow/pull/6344.diff
>> applied.
>>
>> On Mon, Feb 3, 2020 at 11:34 AM Krisztián Szűcs <
>> szucs.kriszt...@gmail.com> wrote:
>>
>>> Please use the latest master [1] to verify the wheels.
>>>
>>> [1]:
>>> https://github.com/apache/arrow/commit/cb81f7d84c26cd75f4568ae1b29744cb4218b578
>>>
>>> On Mon, Feb 3, 2020 at 8:26 PM Neal Richardson
>>>  wrote:
>>> >
>>> > +1 (non-binding)
>>> >
>>> > I did binary verification and macOS (10.14) wheels. Wheels for 3.5
>>> failed
>>> > as previously described, and 2.7 also failed similarly, so I'm
>>> gathering
>>> > that that's not a blocker. 3.6 - 3.8 passed once I added this patch for
>>> > Flight test fixtures: https://github.com/apache/arrow/pull/6345
>>> >
>>> > Neal
>>> >
>>> > On Mon, Feb 3, 2020 at 7:38 AM Antoine Pitrou 
>>> wrote:
>>> >
>>> > > On Fri, 31 Jan 2020 04:13:12 +0100
>>> > > Krisztián Szűcs  wrote:
>>> > > > Hi,
>>> > > >
>>> > > > I would like to propose the following release candidate (RC2) of
>>> Apache
>>> > > > Arrow version 0.16.0. This is a release consisting of 728
>>> > > > resolved JIRA issues[1].
>>> > > >
>>> > > > This release candidate is based on commit:
>>> > > > 729a7689fd87572e6a14ad36f19cd579a8b8d9c5 [2]
>>> > > >
>>> > > > The source release rc2 is hosted at [3].
>>> > > > The binary artifacts are hosted at [4][5][6][7].
>>> > > > The changelog is located at [8].
>>> > > >
>>> > > > Please download, verify checksums and signatures, run the unit
>>> tests,
>>> > > > and vote on the release. See [9] for how to validate a release
>>> candidate.
>>> > > >
>>> > > > The vote will be open for at least 72 hours.
>>> > > >
>>> > > > [ ] +1 Release this as Apache Arrow 0.16.0
>>> > > > [ ] +0
>>> > > > [ ] -1 Do not release this as Apache Arrow 0.16.0 because...
>>> > >
>>> > > +1 from me.
>>> > >
>>> > > Regards
>>> > >
>>> > > Antoine.
>>> > >
>>> > >
>>> > >
>>>
>>


Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-03 Thread Neal Richardson
I've been experimenting with running the release verification on GitHub
Actions: https://github.com/apache/arrow/pull/6349. It would be great to
automate at least the core checks, even if releasing still requires some
manual checking too.

So far, I've verified Python wheels on Windows except for python 3.8
(there's some issue with py38 vs. py38m) and I've made it through the C++
source build on macOS. Other jobs are either still running or need some
further debugging on the setup.

If anyone wants to try to push these further, please feel free to push to
my branch.

Neal

On Mon, Feb 3, 2020 at 11:37 AM Neal Richardson 
wrote:

> I used that with
> https://patch-diff.githubusercontent.com/raw/apache/arrow/pull/6344.diff
> applied.
>
> On Mon, Feb 3, 2020 at 11:34 AM Krisztián Szűcs 
> wrote:
>
>> Please use the latest master [1] to verify the wheels.
>>
>> [1]:
>> https://github.com/apache/arrow/commit/cb81f7d84c26cd75f4568ae1b29744cb4218b578
>>
>> On Mon, Feb 3, 2020 at 8:26 PM Neal Richardson
>>  wrote:
>> >
>> > +1 (non-binding)
>> >
>> > I did binary verification and macOS (10.14) wheels. Wheels for 3.5
>> failed
>> > as previously described, and 2.7 also failed similarly, so I'm gathering
>> > that that's not a blocker. 3.6 - 3.8 passed once I added this patch for
>> > Flight test fixtures: https://github.com/apache/arrow/pull/6345
>> >
>> > Neal
>> >
>> > On Mon, Feb 3, 2020 at 7:38 AM Antoine Pitrou 
>> wrote:
>> >
>> > > On Fri, 31 Jan 2020 04:13:12 +0100
>> > > Krisztián Szűcs  wrote:
>> > > > Hi,
>> > > >
>> > > > I would like to propose the following release candidate (RC2) of
>> Apache
>> > > > Arrow version 0.16.0. This is a release consisting of 728
>> > > > resolved JIRA issues[1].
>> > > >
>> > > > This release candidate is based on commit:
>> > > > 729a7689fd87572e6a14ad36f19cd579a8b8d9c5 [2]
>> > > >
>> > > > The source release rc2 is hosted at [3].
>> > > > The binary artifacts are hosted at [4][5][6][7].
>> > > > The changelog is located at [8].
>> > > >
>> > > > Please download, verify checksums and signatures, run the unit
>> tests,
>> > > > and vote on the release. See [9] for how to validate a release
>> candidate.
>> > > >
>> > > > The vote will be open for at least 72 hours.
>> > > >
>> > > > [ ] +1 Release this as Apache Arrow 0.16.0
>> > > > [ ] +0
>> > > > [ ] -1 Do not release this as Apache Arrow 0.16.0 because...
>> > >
>> > > +1 from me.
>> > >
>> > > Regards
>> > >
>> > > Antoine.
>> > >
>> > >
>> > >
>>
>


Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-03 Thread Neal Richardson
I used that with
https://patch-diff.githubusercontent.com/raw/apache/arrow/pull/6344.diff
applied.

On Mon, Feb 3, 2020 at 11:34 AM Krisztián Szűcs 
wrote:

> Please use the latest master [1] to verify the wheels.
>
> [1]:
> https://github.com/apache/arrow/commit/cb81f7d84c26cd75f4568ae1b29744cb4218b578
>
> On Mon, Feb 3, 2020 at 8:26 PM Neal Richardson
>  wrote:
> >
> > +1 (non-binding)
> >
> > I did binary verification and macOS (10.14) wheels. Wheels for 3.5 failed
> > as previously described, and 2.7 also failed similarly, so I'm gathering
> > that that's not a blocker. 3.6 - 3.8 passed once I added this patch for
> > Flight test fixtures: https://github.com/apache/arrow/pull/6345
> >
> > Neal
> >
> > On Mon, Feb 3, 2020 at 7:38 AM Antoine Pitrou 
> wrote:
> >
> > > On Fri, 31 Jan 2020 04:13:12 +0100
> > > Krisztián Szűcs  wrote:
> > > > Hi,
> > > >
> > > > I would like to propose the following release candidate (RC2) of
> Apache
> > > > Arrow version 0.16.0. This is a release consisting of 728
> > > > resolved JIRA issues[1].
> > > >
> > > > This release candidate is based on commit:
> > > > 729a7689fd87572e6a14ad36f19cd579a8b8d9c5 [2]
> > > >
> > > > The source release rc2 is hosted at [3].
> > > > The binary artifacts are hosted at [4][5][6][7].
> > > > The changelog is located at [8].
> > > >
> > > > Please download, verify checksums and signatures, run the unit tests,
> > > > and vote on the release. See [9] for how to validate a release
> candidate.
> > > >
> > > > The vote will be open for at least 72 hours.
> > > >
> > > > [ ] +1 Release this as Apache Arrow 0.16.0
> > > > [ ] +0
> > > > [ ] -1 Do not release this as Apache Arrow 0.16.0 because...
> > >
> > > +1 from me.
> > >
> > > Regards
> > >
> > > Antoine.
> > >
> > >
> > >
>


Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-03 Thread Krisztián Szűcs
Please use the latest master [1] to verify the wheels.

[1]: 
https://github.com/apache/arrow/commit/cb81f7d84c26cd75f4568ae1b29744cb4218b578

On Mon, Feb 3, 2020 at 8:26 PM Neal Richardson
 wrote:
>
> +1 (non-binding)
>
> I did binary verification and macOS (10.14) wheels. Wheels for 3.5 failed
> as previously described, and 2.7 also failed similarly, so I'm gathering
> that that's not a blocker. 3.6 - 3.8 passed once I added this patch for
> Flight test fixtures: https://github.com/apache/arrow/pull/6345
>
> Neal
>
> On Mon, Feb 3, 2020 at 7:38 AM Antoine Pitrou  wrote:
>
> > On Fri, 31 Jan 2020 04:13:12 +0100
> > Krisztián Szűcs  wrote:
> > > Hi,
> > >
> > > I would like to propose the following release candidate (RC2) of Apache
> > > Arrow version 0.16.0. This is a release consisting of 728
> > > resolved JIRA issues[1].
> > >
> > > This release candidate is based on commit:
> > > 729a7689fd87572e6a14ad36f19cd579a8b8d9c5 [2]
> > >
> > > The source release rc2 is hosted at [3].
> > > The binary artifacts are hosted at [4][5][6][7].
> > > The changelog is located at [8].
> > >
> > > Please download, verify checksums and signatures, run the unit tests,
> > > and vote on the release. See [9] for how to validate a release candidate.
> > >
> > > The vote will be open for at least 72 hours.
> > >
> > > [ ] +1 Release this as Apache Arrow 0.16.0
> > > [ ] +0
> > > [ ] -1 Do not release this as Apache Arrow 0.16.0 because...
> >
> > +1 from me.
> >
> > Regards
> >
> > Antoine.
> >
> >
> >


Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-03 Thread Neal Richardson
+1 (non-binding)

I did binary verification and macOS (10.14) wheels. Wheels for 3.5 failed
as previously described, and 2.7 also failed similarly, so I'm gathering
that that's not a blocker. 3.6 - 3.8 passed once I added this patch for
Flight test fixtures: https://github.com/apache/arrow/pull/6345

Neal

On Mon, Feb 3, 2020 at 7:38 AM Antoine Pitrou  wrote:

> On Fri, 31 Jan 2020 04:13:12 +0100
> Krisztián Szűcs  wrote:
> > Hi,
> >
> > I would like to propose the following release candidate (RC2) of Apache
> > Arrow version 0.16.0. This is a release consisting of 728
> > resolved JIRA issues[1].
> >
> > This release candidate is based on commit:
> > 729a7689fd87572e6a14ad36f19cd579a8b8d9c5 [2]
> >
> > The source release rc2 is hosted at [3].
> > The binary artifacts are hosted at [4][5][6][7].
> > The changelog is located at [8].
> >
> > Please download, verify checksums and signatures, run the unit tests,
> > and vote on the release. See [9] for how to validate a release candidate.
> >
> > The vote will be open for at least 72 hours.
> >
> > [ ] +1 Release this as Apache Arrow 0.16.0
> > [ ] +0
> > [ ] -1 Do not release this as Apache Arrow 0.16.0 because...
>
> +1 from me.
>
> Regards
>
> Antoine.
>
>
>


Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-03 Thread Antoine Pitrou
On Fri, 31 Jan 2020 04:13:12 +0100
Krisztián Szűcs  wrote:
> Hi,
> 
> I would like to propose the following release candidate (RC2) of Apache
> Arrow version 0.16.0. This is a release consisting of 728
> resolved JIRA issues[1].
> 
> This release candidate is based on commit:
> 729a7689fd87572e6a14ad36f19cd579a8b8d9c5 [2]
> 
> The source release rc2 is hosted at [3].
> The binary artifacts are hosted at [4][5][6][7].
> The changelog is located at [8].
> 
> Please download, verify checksums and signatures, run the unit tests,
> and vote on the release. See [9] for how to validate a release candidate.
> 
> The vote will be open for at least 72 hours.
> 
> [ ] +1 Release this as Apache Arrow 0.16.0
> [ ] +0
> [ ] -1 Do not release this as Apache Arrow 0.16.0 because...

+1 from me.

Regards

Antoine.




Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-02 Thread Krisztián Szűcs
Run the wheel verification on OS X and experienced the same.
At the same time the wheel properly works for python 3.5 docker
images without conda environment.

Conda forge doesn't maintain packages for python 3.5 anymore
and something must have mixed with the numpy versions.

I've created a PR to install all the dependencies for wheel verification
from PyPI [1], it fixed the wheel verification locally for me.

[1]: https://github.com/apache/arrow/pull/6339

On Sat, Feb 1, 2020 at 12:43 PM Sutou Kouhei  wrote:
>
> +0 (binding)
>
> I ran the followings on Debian GNU/Linux sid:
>
>   * TEST_CSHARP=0 \
>   PATH=$HOME/.local/bin \
>   JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64 \
>   CUDA_TOOLKIT_ROOT=/usr \
> dev/release/verify-release-candidate.sh source 0.16.0 2
>   * dev/release/verify-release-candidate.sh binaries 0.16.0 2
>   * dev/release/verify-release-candidate.sh wheels 0.16.0 2
>
> with:
>
>   * gcc (Debian 9.2.1-25) 9.2.1 20200123
>   * openjdk version "1.8.0_242-ea"
>   * Node.JS v12.1.0
>   * go version go1.13.6 linux/amd64
>   * nvidia-cuda-dev 10.1.168-6
>
> Notes:
>
>   * wheels verification fails for Python 3.5.
> I'm not sure this is a problem of verification script
> or wheel problem. So I vote +0.
>
> Full log:
>
>   https://gist.github.com/kou/8f187df43a2ccf9a74dc5d1840e2d1b6
>
> Related log:
>
> 
> + pytest --pyargs pyarrow
> = test session starts 
> ==
> platform linux -- Python 3.5.5, pytest-3.8.1, py-1.8.1, pluggy-0.11.0
> rootdir: /tmp/arrow-0.16.0.phvUH/binaries, inifile:
> plugins: lazy-fixture-0.6.2, faulthandler-1.5.0, hypothesis-5.4.1
> collected 2389 items / 3 skipped
>
> pyarrow/tests/test_array.py s..F...FF..FFF.. [  
> 1%]
> ..F...FFF.F...FFF.FFF.Fs [  
> 4%]
> F...F.F.FssFF.F..F   [  
> 7%]
> pyarrow/tests/test_builder.py ...[  
> 7%]
> pyarrow/tests/test_compute.py .FF..F [  
> 8%]
> F..  [  
> 9%]
> pyarrow/tests/test_convert_builtin.py ...FFFFF.. [ 
> 10%]
> ..FFFFFFFFFFFFFF [ 
> 13%]
> FFFFFFFFFFFFFFF. [ 
> 16%]
> ...FFFFFFFFF [ 
> 19%]
> FFFFFF.FFFFF [ 
> 22%]
> FFF.F....FF..FF..[ 
> 25%]
> pyarrow/tests/test_csv.py .FF... [ 
> 27%]
> .FF...FF.[ 
> 28%]
> pyarrow/tests/test_cython.py .   [ 
> 28%]
> pyarrow/tests/test_dataset.py ..F.EEE[ 
> 29%]
> pyarrow/tests/test_extension_type.py ..F [ 
> 29%]
> pyarrow/tests/test_feather.py ..F.FsFFFsFs   [ 
> 31%]
> pyarrow/tests/test_filesystem.py ..  [ 
> 31%]
> pyarrow/tests/test_flight.py ...s.F.ss..sFF..ss. [ 
> 33%]
> pyarrow/tests/test_fs.py sssssssssssssss [ 
> 35%]
> sss....ss... [ 
> 38%]
> ....ss...[ 
> 39%]
> pyarrow/tests/test_gandiva.py s  [ 
> 39%]
> pyarrow/tests/test_hdfs.py s [ 
> 41%]
> ss   [ 
> 41%]
> pyarrow/tests/test_io.py ... [ 
> 43%]
> .[ 
> 45%]
> pyarrow/tests/test_ipc.py .FFs.FF.FF...F..   [ 
> 47%]
> pyarrow/tests/test_json.py FF..FF[ 
> 48%]
> pyarrow/tests/test_memory.py [ 
> 48%]
> pyarrow/tests/test_misc.py .s... [ 
> 50%]
> ...  [ 
> 51%]
> pyarrow/tests/test_orc.py    [ 
> 52%]
> pyarrow/tests/test_pandas.py FF..FFF [ 
> 53%]
> FFFsF.FF..FF [ 
> 56%]
> F.FFF.FFsFF.FFF.FF.F.FFF [ 
> 59%]
> .FFFsF.FF..FFF.FF.F.FFF.FFFatal Python error: 
> Segmentation fault
>
> Current thread 0x7f26ad80c740 

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-01 Thread Sutou Kouhei
+0 (binding)

I ran the followings on Debian GNU/Linux sid:

  * TEST_CSHARP=0 \
  PATH=$HOME/.local/bin \
  JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64 \
  CUDA_TOOLKIT_ROOT=/usr \
dev/release/verify-release-candidate.sh source 0.16.0 2
  * dev/release/verify-release-candidate.sh binaries 0.16.0 2
  * dev/release/verify-release-candidate.sh wheels 0.16.0 2

with:

  * gcc (Debian 9.2.1-25) 9.2.1 20200123
  * openjdk version "1.8.0_242-ea"
  * Node.JS v12.1.0
  * go version go1.13.6 linux/amd64
  * nvidia-cuda-dev 10.1.168-6

Notes:

  * wheels verification fails for Python 3.5.
I'm not sure this is a problem of verification script
or wheel problem. So I vote +0.

Full log:

  https://gist.github.com/kou/8f187df43a2ccf9a74dc5d1840e2d1b6

Related log:


+ pytest --pyargs pyarrow
= test session starts ==
platform linux -- Python 3.5.5, pytest-3.8.1, py-1.8.1, pluggy-0.11.0
rootdir: /tmp/arrow-0.16.0.phvUH/binaries, inifile:
plugins: lazy-fixture-0.6.2, faulthandler-1.5.0, hypothesis-5.4.1
collected 2389 items / 3 skipped

pyarrow/tests/test_array.py s..F...FF..FFF.. [  1%]
..F...FFF.F...FFF.FFF.Fs [  4%]
F...F.F.FssFF.F..F   [  7%]
pyarrow/tests/test_builder.py ...[  7%]
pyarrow/tests/test_compute.py .FF..F [  8%]
F..  [  9%]
pyarrow/tests/test_convert_builtin.py ...FFFFF.. [ 10%]
..FFFFFFFFFFFFFF [ 13%]
FFFFFFFFFFFFFFF. [ 16%]
...FFFFFFFFF [ 19%]
FFFFFF.FFFFF [ 22%]
FFF.F....FF..FF..[ 25%]
pyarrow/tests/test_csv.py .FF... [ 27%]
.FF...FF.[ 28%]
pyarrow/tests/test_cython.py .   [ 28%]
pyarrow/tests/test_dataset.py ..F.EEE[ 29%]
pyarrow/tests/test_extension_type.py ..F [ 29%]
pyarrow/tests/test_feather.py ..F.FsFFFsFs   [ 31%]
pyarrow/tests/test_filesystem.py ..  [ 31%]
pyarrow/tests/test_flight.py ...s.F.ss..sFF..ss. [ 33%]
pyarrow/tests/test_fs.py sssssssssssssss [ 35%]
sss....ss... [ 38%]
....ss...[ 39%]
pyarrow/tests/test_gandiva.py s  [ 39%]
pyarrow/tests/test_hdfs.py s [ 41%]
ss   [ 41%]
pyarrow/tests/test_io.py ... [ 43%]
.[ 45%]
pyarrow/tests/test_ipc.py .FFs.FF.FF...F..   [ 47%]
pyarrow/tests/test_json.py FF..FF[ 48%]
pyarrow/tests/test_memory.py [ 48%]
pyarrow/tests/test_misc.py .s... [ 50%]
...  [ 51%]
pyarrow/tests/test_orc.py    [ 52%]
pyarrow/tests/test_pandas.py FF..FFF [ 53%]
FFFsF.FF..FF [ 56%]
F.FFF.FFsFF.FFF.FF.F.FFF [ 59%]
.FFFsF.FF..FFF.FF.F.FFF.FFFatal Python error: 
Segmentation fault

Current thread 0x7f26ad80c740 (most recent call first):
  File 
"/tmp/arrow-0.16.0.phvUH/test-miniconda/envs/_verify_wheel-3.5m/lib/python3.5/site-packages/numpy/core/_internal.py",
 line 705 in 
  File 
"/tmp/arrow-0.16.0.phvUH/test-miniconda/envs/_verify_wheel-3.5m/lib/python3.5/site-packages/numpy/core/_internal.py",
 line 705 in array_ufunc_errmsg_formatter
  File 
"/tmp/arrow-0.16.0.phvUH/test-miniconda/envs/_verify_wheel-3.5m/lib/python3.5/site-packages/pandas/core/dtypes/missing.py",
 line 431 in array_equivalent
  File 
"/tmp/arrow-0.16.0.phvUH/test-miniconda/envs/_verify_wheel-3.5m/lib/python3.5/site-packages/pandas/util/testing.py",
 line 1244 in assert_series_equal
  File 

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-01 Thread Sutou Kouhei
Thanks!

They work well now!

In 
  "Re: [VOTE] Release Apache Arrow 0.16.0 - RC2" on Fri, 31 Jan 2020 14:50:49 
+0100,
  Krisztián Szűcs  wrote:

> Rerun with cosmic and the successfully built ARM packages.
> 
> On Fri, Jan 31, 2020 at 12:57 PM Sutou Kouhei  wrote:
>>
>> Hi,
>>
>> One more thing.
>>
>> It seems that some .deb/.rpm files for arm64 aren't
>> uploaded. Could you re-run "crossbow download-artifacts
>> build-730" and re-run "dev/release/03-binary.sh"?
>>
>>
>> Thanks,
>> --
>> kou
>>
>> In <20200131.205531.1001999778589734260@clear-code.com>
>>   "Re: [VOTE] Release Apache Arrow 0.16.0 - RC2" on Fri, 31 Jan 2020 
>> 20:55:31 +0900 (JST),
>>   Sutou Kouhei  wrote:
>>
>> > Hi,
>> >
>> > "dev/release/verify-release-candidate.sh binaries 0.16.0 2"
>> > is still failing. And I found the cause of the problem.
>> >
>> > Could you re-run 03-binary.sh with the change?
>> >
>> > ---
>> > diff --git a/dev/release/binary-task.rb b/dev/release/binary-task.rb
>> > index 4b5960445..3dd1d9c08 100644
>> > --- a/dev/release/binary-task.rb
>> > +++ b/dev/release/binary-task.rb
>> > @@ -1015,6 +1015,7 @@ class BinaryTask
>> >["debian", "buster", "main"],
>> >["ubuntu", "xenial", "main"],
>> >["ubuntu", "bionic", "main"],
>> > +  ["ubuntu", "cosmic", "main"],
>> >["ubuntu", "disco", "main"],
>> >["ubuntu", "eoan", "main"],
>> >  ]
>> > ---
>> >
>> > Existing APT metadata files for Ubuntu Cosmic has
>> > problem (.sha512 file is missing). So we need to re-generate
>> > it only for 0.16.0 release. We don't need to do this for the
>> > next release.
>> >
>> >
>> > Thanks,
>> > --
>> > kou
>> >
>> > In 
>> >   "[VOTE] Release Apache Arrow 0.16.0 - RC2" on Fri, 31 Jan 2020 04:13:12 
>> > +0100,
>> >   Krisztián Szűcs  wrote:
>> >
>> >> Hi,
>> >>
>> >> I would like to propose the following release candidate (RC2) of Apache
>> >> Arrow version 0.16.0. This is a release consisting of 728
>> >> resolved JIRA issues[1].
>> >>
>> >> This release candidate is based on commit:
>> >> 729a7689fd87572e6a14ad36f19cd579a8b8d9c5 [2]
>> >>
>> >> The source release rc2 is hosted at [3].
>> >> The binary artifacts are hosted at [4][5][6][7].
>> >> The changelog is located at [8].
>> >>
>> >> Please download, verify checksums and signatures, run the unit tests,
>> >> and vote on the release. See [9] for how to validate a release candidate.
>> >>
>> >> The vote will be open for at least 72 hours.
>> >>
>> >> [ ] +1 Release this as Apache Arrow 0.16.0
>> >> [ ] +0
>> >> [ ] -1 Do not release this as Apache Arrow 0.16.0 because...
>> >>
>> >> [1]: 
>> >> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.16.0
>> >> [2]: 
>> >> https://github.com/apache/arrow/tree/729a7689fd87572e6a14ad36f19cd579a8b8d9c5
>> >> [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.16.0-rc2
>> >> [4]: https://bintray.com/apache/arrow/centos-rc/0.16.0-rc2
>> >> [5]: https://bintray.com/apache/arrow/debian-rc/0.16.0-rc2
>> >> [6]: https://bintray.com/apache/arrow/python-rc/0.16.0-rc2
>> >> [7]: https://bintray.com/apache/arrow/ubuntu-rc/0.16.0-rc2
>> >> [8]: 
>> >> https://github.com/apache/arrow/blob/729a7689fd87572e6a14ad36f19cd579a8b8d9c5/CHANGELOG.md
>> >> [9]: 
>> >> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates


Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-01-31 Thread Wes McKinney
OK, yes that is too old. We should install a sufficiently new version
of Go as part of the release verification script to avoid this class
of failure

https://issues.apache.org/jira/browse/ARROW-7733

If you're interested in installing a newer version of Go on Ubuntu
18.04, here is how I do it when I provision my personal machines

https://github.com/wesm/dev-toolchain/blob/master/ubuntu-bootstrap.sh#L254


On Fri, Jan 31, 2020 at 1:12 PM Antoine Pitrou  wrote:
>
>
> It's the version packaged in Ubuntu 18.04.
>
> $ go version
> go version go1.10.4 linux/amd64
>
> Regards
>
> Antoine.
>
>
> Le 31/01/2020 à 20:06, Wes McKinney a écrit :
> > hi Antoine -- which version of Go are you using? Some of these issues
> > are resolved by upgrading the Go version
> >
> > On Fri, Jan 31, 2020 at 6:19 AM Antoine Pitrou  wrote:
> >>
> >>
> >> On Ubuntu 18.04, the source verification is successful until the go
> >> step, which fails:
> >> https://gist.github.com/pitrou/7e089ac146197b1141585c271cb39866
> >>
> >> Side note: the JS verification step should avoid spamming the terminal
> >> with tons of useless information.
> >>
> >> Regards
> >>
> >> Antoine.
> >>
> >>
> >> Le 31/01/2020 à 04:13, Krisztián Szűcs a écrit :
> >>> Hi,
> >>>
> >>> I would like to propose the following release candidate (RC2) of Apache
> >>> Arrow version 0.16.0. This is a release consisting of 728
> >>> resolved JIRA issues[1].
> >>>
> >>> This release candidate is based on commit:
> >>> 729a7689fd87572e6a14ad36f19cd579a8b8d9c5 [2]
> >>>
> >>> The source release rc2 is hosted at [3].
> >>> The binary artifacts are hosted at [4][5][6][7].
> >>> The changelog is located at [8].
> >>>
> >>> Please download, verify checksums and signatures, run the unit tests,
> >>> and vote on the release. See [9] for how to validate a release candidate.
> >>>
> >>> The vote will be open for at least 72 hours.


Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-01-31 Thread Antoine Pitrou


It's the version packaged in Ubuntu 18.04.

$ go version
go version go1.10.4 linux/amd64

Regards

Antoine.


Le 31/01/2020 à 20:06, Wes McKinney a écrit :
> hi Antoine -- which version of Go are you using? Some of these issues
> are resolved by upgrading the Go version
> 
> On Fri, Jan 31, 2020 at 6:19 AM Antoine Pitrou  wrote:
>>
>>
>> On Ubuntu 18.04, the source verification is successful until the go
>> step, which fails:
>> https://gist.github.com/pitrou/7e089ac146197b1141585c271cb39866
>>
>> Side note: the JS verification step should avoid spamming the terminal
>> with tons of useless information.
>>
>> Regards
>>
>> Antoine.
>>
>>
>> Le 31/01/2020 à 04:13, Krisztián Szűcs a écrit :
>>> Hi,
>>>
>>> I would like to propose the following release candidate (RC2) of Apache
>>> Arrow version 0.16.0. This is a release consisting of 728
>>> resolved JIRA issues[1].
>>>
>>> This release candidate is based on commit:
>>> 729a7689fd87572e6a14ad36f19cd579a8b8d9c5 [2]
>>>
>>> The source release rc2 is hosted at [3].
>>> The binary artifacts are hosted at [4][5][6][7].
>>> The changelog is located at [8].
>>>
>>> Please download, verify checksums and signatures, run the unit tests,
>>> and vote on the release. See [9] for how to validate a release candidate.
>>>
>>> The vote will be open for at least 72 hours.


Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-01-31 Thread Wes McKinney
hi Antoine -- which version of Go are you using? Some of these issues
are resolved by upgrading the Go version

On Fri, Jan 31, 2020 at 6:19 AM Antoine Pitrou  wrote:
>
>
> On Ubuntu 18.04, the source verification is successful until the go
> step, which fails:
> https://gist.github.com/pitrou/7e089ac146197b1141585c271cb39866
>
> Side note: the JS verification step should avoid spamming the terminal
> with tons of useless information.
>
> Regards
>
> Antoine.
>
>
> Le 31/01/2020 à 04:13, Krisztián Szűcs a écrit :
> > Hi,
> >
> > I would like to propose the following release candidate (RC2) of Apache
> > Arrow version 0.16.0. This is a release consisting of 728
> > resolved JIRA issues[1].
> >
> > This release candidate is based on commit:
> > 729a7689fd87572e6a14ad36f19cd579a8b8d9c5 [2]
> >
> > The source release rc2 is hosted at [3].
> > The binary artifacts are hosted at [4][5][6][7].
> > The changelog is located at [8].
> >
> > Please download, verify checksums and signatures, run the unit tests,
> > and vote on the release. See [9] for how to validate a release candidate.
> >
> > The vote will be open for at least 72 hours.


Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-01-31 Thread Krisztián Szűcs
Rerun with cosmic and the successfully built ARM packages.

On Fri, Jan 31, 2020 at 12:57 PM Sutou Kouhei  wrote:
>
> Hi,
>
> One more thing.
>
> It seems that some .deb/.rpm files for arm64 aren't
> uploaded. Could you re-run "crossbow download-artifacts
> build-730" and re-run "dev/release/03-binary.sh"?
>
>
> Thanks,
> --
> kou
>
> In <20200131.205531.1001999778589734260....@clear-code.com>
>   "Re: [VOTE] Release Apache Arrow 0.16.0 - RC2" on Fri, 31 Jan 2020 20:55:31 
> +0900 (JST),
>   Sutou Kouhei  wrote:
>
> > Hi,
> >
> > "dev/release/verify-release-candidate.sh binaries 0.16.0 2"
> > is still failing. And I found the cause of the problem.
> >
> > Could you re-run 03-binary.sh with the change?
> >
> > ---
> > diff --git a/dev/release/binary-task.rb b/dev/release/binary-task.rb
> > index 4b5960445..3dd1d9c08 100644
> > --- a/dev/release/binary-task.rb
> > +++ b/dev/release/binary-task.rb
> > @@ -1015,6 +1015,7 @@ class BinaryTask
> >["debian", "buster", "main"],
> >["ubuntu", "xenial", "main"],
> >["ubuntu", "bionic", "main"],
> > +  ["ubuntu", "cosmic", "main"],
> >["ubuntu", "disco", "main"],
> >["ubuntu", "eoan", "main"],
> >  ]
> > ---
> >
> > Existing APT metadata files for Ubuntu Cosmic has
> > problem (.sha512 file is missing). So we need to re-generate
> > it only for 0.16.0 release. We don't need to do this for the
> > next release.
> >
> >
> > Thanks,
> > --
> > kou
> >
> > In 
> >   "[VOTE] Release Apache Arrow 0.16.0 - RC2" on Fri, 31 Jan 2020 04:13:12 
> > +0100,
> >   Krisztián Szűcs  wrote:
> >
> >> Hi,
> >>
> >> I would like to propose the following release candidate (RC2) of Apache
> >> Arrow version 0.16.0. This is a release consisting of 728
> >> resolved JIRA issues[1].
> >>
> >> This release candidate is based on commit:
> >> 729a7689fd87572e6a14ad36f19cd579a8b8d9c5 [2]
> >>
> >> The source release rc2 is hosted at [3].
> >> The binary artifacts are hosted at [4][5][6][7].
> >> The changelog is located at [8].
> >>
> >> Please download, verify checksums and signatures, run the unit tests,
> >> and vote on the release. See [9] for how to validate a release candidate.
> >>
> >> The vote will be open for at least 72 hours.
> >>
> >> [ ] +1 Release this as Apache Arrow 0.16.0
> >> [ ] +0
> >> [ ] -1 Do not release this as Apache Arrow 0.16.0 because...
> >>
> >> [1]: 
> >> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.16.0
> >> [2]: 
> >> https://github.com/apache/arrow/tree/729a7689fd87572e6a14ad36f19cd579a8b8d9c5
> >> [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.16.0-rc2
> >> [4]: https://bintray.com/apache/arrow/centos-rc/0.16.0-rc2
> >> [5]: https://bintray.com/apache/arrow/debian-rc/0.16.0-rc2
> >> [6]: https://bintray.com/apache/arrow/python-rc/0.16.0-rc2
> >> [7]: https://bintray.com/apache/arrow/ubuntu-rc/0.16.0-rc2
> >> [8]: 
> >> https://github.com/apache/arrow/blob/729a7689fd87572e6a14ad36f19cd579a8b8d9c5/CHANGELOG.md
> >> [9]: 
> >> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates


Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-01-31 Thread Antoine Pitrou


On Ubuntu 18.04, the source verification is successful until the go
step, which fails:
https://gist.github.com/pitrou/7e089ac146197b1141585c271cb39866

Side note: the JS verification step should avoid spamming the terminal
with tons of useless information.

Regards

Antoine.


Le 31/01/2020 à 04:13, Krisztián Szűcs a écrit :
> Hi,
> 
> I would like to propose the following release candidate (RC2) of Apache
> Arrow version 0.16.0. This is a release consisting of 728
> resolved JIRA issues[1].
> 
> This release candidate is based on commit:
> 729a7689fd87572e6a14ad36f19cd579a8b8d9c5 [2]
> 
> The source release rc2 is hosted at [3].
> The binary artifacts are hosted at [4][5][6][7].
> The changelog is located at [8].
> 
> Please download, verify checksums and signatures, run the unit tests,
> and vote on the release. See [9] for how to validate a release candidate.
> 
> The vote will be open for at least 72 hours.


Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-01-31 Thread Krisztián Szűcs
On Fri, Jan 31, 2020 at 12:57 PM Sutou Kouhei  wrote:
>
> Hi,
>
> One more thing.
>
> It seems that some .deb/.rpm files for arm64 aren't
> uploaded. Could you re-run "crossbow download-artifacts
> build-730" and re-run "dev/release/03-binary.sh"?
Most of the ARM builds have exceeded the CI timeout [1], although
I'll update the xenial, bionic, stretch packages.

[1]: https://github.com/ursa-labs/crossbow/branches/all?query=arm
>
>
> Thanks,
> --
> kou
>
> In <20200131.205531.1001999778589734260....@clear-code.com>
>   "Re: [VOTE] Release Apache Arrow 0.16.0 - RC2" on Fri, 31 Jan 2020 20:55:31 
> +0900 (JST),
>   Sutou Kouhei  wrote:
>
> > Hi,
> >
> > "dev/release/verify-release-candidate.sh binaries 0.16.0 2"
> > is still failing. And I found the cause of the problem.
> >
> > Could you re-run 03-binary.sh with the change?
> >
> > ---
> > diff --git a/dev/release/binary-task.rb b/dev/release/binary-task.rb
> > index 4b5960445..3dd1d9c08 100644
> > --- a/dev/release/binary-task.rb
> > +++ b/dev/release/binary-task.rb
> > @@ -1015,6 +1015,7 @@ class BinaryTask
> >["debian", "buster", "main"],
> >["ubuntu", "xenial", "main"],
> >["ubuntu", "bionic", "main"],
> > +  ["ubuntu", "cosmic", "main"],
> >["ubuntu", "disco", "main"],
> >["ubuntu", "eoan", "main"],
> >  ]
> > ---
> >
> > Existing APT metadata files for Ubuntu Cosmic has
> > problem (.sha512 file is missing). So we need to re-generate
> > it only for 0.16.0 release. We don't need to do this for the
> > next release.
> >
> >
> > Thanks,
> > --
> > kou
> >
> > In 
> >   "[VOTE] Release Apache Arrow 0.16.0 - RC2" on Fri, 31 Jan 2020 04:13:12 
> > +0100,
> >   Krisztián Szűcs  wrote:
> >
> >> Hi,
> >>
> >> I would like to propose the following release candidate (RC2) of Apache
> >> Arrow version 0.16.0. This is a release consisting of 728
> >> resolved JIRA issues[1].
> >>
> >> This release candidate is based on commit:
> >> 729a7689fd87572e6a14ad36f19cd579a8b8d9c5 [2]
> >>
> >> The source release rc2 is hosted at [3].
> >> The binary artifacts are hosted at [4][5][6][7].
> >> The changelog is located at [8].
> >>
> >> Please download, verify checksums and signatures, run the unit tests,
> >> and vote on the release. See [9] for how to validate a release candidate.
> >>
> >> The vote will be open for at least 72 hours.
> >>
> >> [ ] +1 Release this as Apache Arrow 0.16.0
> >> [ ] +0
> >> [ ] -1 Do not release this as Apache Arrow 0.16.0 because...
> >>
> >> [1]: 
> >> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.16.0
> >> [2]: 
> >> https://github.com/apache/arrow/tree/729a7689fd87572e6a14ad36f19cd579a8b8d9c5
> >> [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.16.0-rc2
> >> [4]: https://bintray.com/apache/arrow/centos-rc/0.16.0-rc2
> >> [5]: https://bintray.com/apache/arrow/debian-rc/0.16.0-rc2
> >> [6]: https://bintray.com/apache/arrow/python-rc/0.16.0-rc2
> >> [7]: https://bintray.com/apache/arrow/ubuntu-rc/0.16.0-rc2
> >> [8]: 
> >> https://github.com/apache/arrow/blob/729a7689fd87572e6a14ad36f19cd579a8b8d9c5/CHANGELOG.md
> >> [9]: 
> >> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates


Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-01-31 Thread Sutou Kouhei
Hi,

One more thing.

It seems that some .deb/.rpm files for arm64 aren't
uploaded. Could you re-run "crossbow download-artifacts
build-730" and re-run "dev/release/03-binary.sh"?


Thanks,
--
kou

In <20200131.205531.1001999778589734260....@clear-code.com>
  "Re: [VOTE] Release Apache Arrow 0.16.0 - RC2" on Fri, 31 Jan 2020 20:55:31 
+0900 (JST),
  Sutou Kouhei  wrote:

> Hi,
> 
> "dev/release/verify-release-candidate.sh binaries 0.16.0 2"
> is still failing. And I found the cause of the problem.
> 
> Could you re-run 03-binary.sh with the change?
> 
> ---
> diff --git a/dev/release/binary-task.rb b/dev/release/binary-task.rb
> index 4b5960445..3dd1d9c08 100644
> --- a/dev/release/binary-task.rb
> +++ b/dev/release/binary-task.rb
> @@ -1015,6 +1015,7 @@ class BinaryTask
>["debian", "buster", "main"],
>["ubuntu", "xenial", "main"],
>["ubuntu", "bionic", "main"],
> +  ["ubuntu", "cosmic", "main"],
>["ubuntu", "disco", "main"],
>["ubuntu", "eoan", "main"],
>  ]
> ---
> 
> Existing APT metadata files for Ubuntu Cosmic has
> problem (.sha512 file is missing). So we need to re-generate
> it only for 0.16.0 release. We don't need to do this for the
> next release.
> 
> 
> Thanks,
> --
> kou
> 
> In 
>   "[VOTE] Release Apache Arrow 0.16.0 - RC2" on Fri, 31 Jan 2020 04:13:12 
> +0100,
>   Krisztián Szűcs  wrote:
> 
>> Hi,
>> 
>> I would like to propose the following release candidate (RC2) of Apache
>> Arrow version 0.16.0. This is a release consisting of 728
>> resolved JIRA issues[1].
>> 
>> This release candidate is based on commit:
>> 729a7689fd87572e6a14ad36f19cd579a8b8d9c5 [2]
>> 
>> The source release rc2 is hosted at [3].
>> The binary artifacts are hosted at [4][5][6][7].
>> The changelog is located at [8].
>> 
>> Please download, verify checksums and signatures, run the unit tests,
>> and vote on the release. See [9] for how to validate a release candidate.
>> 
>> The vote will be open for at least 72 hours.
>> 
>> [ ] +1 Release this as Apache Arrow 0.16.0
>> [ ] +0
>> [ ] -1 Do not release this as Apache Arrow 0.16.0 because...
>> 
>> [1]: 
>> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.16.0
>> [2]: 
>> https://github.com/apache/arrow/tree/729a7689fd87572e6a14ad36f19cd579a8b8d9c5
>> [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.16.0-rc2
>> [4]: https://bintray.com/apache/arrow/centos-rc/0.16.0-rc2
>> [5]: https://bintray.com/apache/arrow/debian-rc/0.16.0-rc2
>> [6]: https://bintray.com/apache/arrow/python-rc/0.16.0-rc2
>> [7]: https://bintray.com/apache/arrow/ubuntu-rc/0.16.0-rc2
>> [8]: 
>> https://github.com/apache/arrow/blob/729a7689fd87572e6a14ad36f19cd579a8b8d9c5/CHANGELOG.md
>> [9]: 
>> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates


Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-01-31 Thread Sutou Kouhei
Hi,

"dev/release/verify-release-candidate.sh binaries 0.16.0 2"
is still failing. And I found the cause of the problem.

Could you re-run 03-binary.sh with the change?

---
diff --git a/dev/release/binary-task.rb b/dev/release/binary-task.rb
index 4b5960445..3dd1d9c08 100644
--- a/dev/release/binary-task.rb
+++ b/dev/release/binary-task.rb
@@ -1015,6 +1015,7 @@ class BinaryTask
   ["debian", "buster", "main"],
   ["ubuntu", "xenial", "main"],
   ["ubuntu", "bionic", "main"],
+  ["ubuntu", "cosmic", "main"],
   ["ubuntu", "disco", "main"],
   ["ubuntu", "eoan", "main"],
 ]
---

Existing APT metadata files for Ubuntu Cosmic has
problem (.sha512 file is missing). So we need to re-generate
it only for 0.16.0 release. We don't need to do this for the
next release.


Thanks,
--
kou

In 
  "[VOTE] Release Apache Arrow 0.16.0 - RC2" on Fri, 31 Jan 2020 04:13:12 +0100,
  Krisztián Szűcs  wrote:

> Hi,
> 
> I would like to propose the following release candidate (RC2) of Apache
> Arrow version 0.16.0. This is a release consisting of 728
> resolved JIRA issues[1].
> 
> This release candidate is based on commit:
> 729a7689fd87572e6a14ad36f19cd579a8b8d9c5 [2]
> 
> The source release rc2 is hosted at [3].
> The binary artifacts are hosted at [4][5][6][7].
> The changelog is located at [8].
> 
> Please download, verify checksums and signatures, run the unit tests,
> and vote on the release. See [9] for how to validate a release candidate.
> 
> The vote will be open for at least 72 hours.
> 
> [ ] +1 Release this as Apache Arrow 0.16.0
> [ ] +0
> [ ] -1 Do not release this as Apache Arrow 0.16.0 because...
> 
> [1]: 
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.16.0
> [2]: 
> https://github.com/apache/arrow/tree/729a7689fd87572e6a14ad36f19cd579a8b8d9c5
> [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.16.0-rc2
> [4]: https://bintray.com/apache/arrow/centos-rc/0.16.0-rc2
> [5]: https://bintray.com/apache/arrow/debian-rc/0.16.0-rc2
> [6]: https://bintray.com/apache/arrow/python-rc/0.16.0-rc2
> [7]: https://bintray.com/apache/arrow/ubuntu-rc/0.16.0-rc2
> [8]: 
> https://github.com/apache/arrow/blob/729a7689fd87572e6a14ad36f19cd579a8b8d9c5/CHANGELOG.md
> [9]: 
> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates