Re: [VOTE] Release Apache Parquet 1.10.1 RC0

2019-01-31 Thread Ryan Blue
With 6 +1 votes (3 binding), this vote passes. I'll publish the artifacts
and finalize the release. Thank you for voting and validating the release,
everyone!

On Thu, Jan 31, 2019 at 5:17 PM Daniel Weeks  wrote:

> +1 (binding)
>
> Verified sigs, sums, build and test.
>
> On Mon, Jan 28, 2019 at 2:08 PM Ryan Blue 
> wrote:
>
>> Hi everyone,
>>
>> I propose the following RC to be released as official Apache Parquet Java
>> 1.10.1 release.
>>
>> The commit id is a89df8f9932b6ef6633d06069e50c9b7970bebd1
>>
>>- This corresponds to the tag: apache-parquet-1.10.1
>>- https://github.com/apache/parquet-mr/commit/a89df8f
>>- https://github.com/apache/parquet-mr/tree/apache-parquet-1.10.1
>>
>> The release tarball, signature, and checksums are here:
>>
>>-
>>
>> https://dist.apache.org/repos/dist/dev/parquet/apache-parquet-1.10.1-rc0/
>>
>> You can find the KEYS file here:
>>
>>- https://dist.apache.org/repos/dist/dev/parquet/KEYS
>>
>> Binary artifacts are staged in Nexus here:
>>
>>-
>>
>> https://repository.apache.org/content/repositories/orgapacheparquet-1022/
>>
>> This release is a patch release for Parquet 1.10.0. It includes the
>> following bug fixes:
>>
>>- PARQUET-1309: Properties to disable stats and dictionary filtering
>> are
>>swapped
>>- PARQUET-1510: Dictionary filter bug skips null for notEq with
>>dictionary of one value
>>
>> Please download, verify, and test.
>>
>> Please vote in the next 72 hours:
>>
>> [ ] +1 Release this as Apache Parquet Java 1.10.1
>> [ ] +0
>> [ ] -1 Do not release this because…
>> --
>> Ryan Blue
>> Software Engineer
>> Netflix
>>
>

-- 
Ryan Blue
Software Engineer
Netflix


Re: [VOTE] Release Apache Parquet 1.10.1 RC0

2019-01-31 Thread Daniel Weeks
+1 (binding)

Verified sigs, sums, build and test.

On Mon, Jan 28, 2019 at 2:08 PM Ryan Blue  wrote:

> Hi everyone,
>
> I propose the following RC to be released as official Apache Parquet Java
> 1.10.1 release.
>
> The commit id is a89df8f9932b6ef6633d06069e50c9b7970bebd1
>
>- This corresponds to the tag: apache-parquet-1.10.1
>- https://github.com/apache/parquet-mr/commit/a89df8f
>- https://github.com/apache/parquet-mr/tree/apache-parquet-1.10.1
>
> The release tarball, signature, and checksums are here:
>
>-
>
> https://dist.apache.org/repos/dist/dev/parquet/apache-parquet-1.10.1-rc0/
>
> You can find the KEYS file here:
>
>- https://dist.apache.org/repos/dist/dev/parquet/KEYS
>
> Binary artifacts are staged in Nexus here:
>
>-
>
> https://repository.apache.org/content/repositories/orgapacheparquet-1022/
>
> This release is a patch release for Parquet 1.10.0. It includes the
> following bug fixes:
>
>- PARQUET-1309: Properties to disable stats and dictionary filtering are
>swapped
>- PARQUET-1510: Dictionary filter bug skips null for notEq with
>dictionary of one value
>
> Please download, verify, and test.
>
> Please vote in the next 72 hours:
>
> [ ] +1 Release this as Apache Parquet Java 1.10.1
> [ ] +0
> [ ] -1 Do not release this because…
> --
> Ryan Blue
> Software Engineer
> Netflix
>


Re: [VOTE] Release Apache Parquet 1.10.1 RC0

2019-01-31 Thread Uwe L. Korn
+1 (binding)

Build and tested using Ryan's script on Ubuntu 16.04.

The script helped me a bit as it included the necessary maven
options. Thanks!
For future, it would be good to include one as we have in Arrow that
also checks the signature. We have that in the main tree and the script
also downloads the source tarball. Then the script is simply in git and
not part of the release.
Uwe


On Thu, Jan 31, 2019, at 7:36 PM, Ryan Blue wrote:
> Uwe suggested that we include a validation script for release votes.
> It's a little late to add one to this release, but here is one to make
> it easier. Just run the attached script from the project root.> 
> The script checks for the correct versions of thrift and protobuf. If
> found, those modules and modules that depend on them are built and
> tested. Otherwise, it just tests the modules that don't require
> additional installs. This builds the project and runs RAT checks, then
> runs tests and prints a message at the end.> 
> rb
> 
> 
> On Wed, Jan 30, 2019 at 10:11 PM Dongjoon Hyun
>  wrote:>> +1 for 1.10.1 RC0 (non-binding).
>> 
>> I tested the src tar artifact on Ubuntu 16.04 and passed all UTs.
>> (Also, I saw the result of Ryan's Spark PR
>> https://github.com/apache/spark/pull/23704.)>> 
>> Thank you for the release.
>> 
>> Cheers,
>> Dongjoon.
>> 
>> On Wed, Jan 30, 2019 at 5:07 PM Dongjoon Hyun
>>  wrote:>>> Sure! I'll make a PR for that.
>>> 
>>> Bests,
>>> Dongjoon.
>>> 
>>> On Wed, Jan 30, 2019 at 3:11 PM Ryan Blue  wrote: 
>>> Looks like the README is out of date. I don't think we should
 fail this RC based on the README. Can you open a pull request to
 update it. 
 I think the correct version is protobuf 3.5.1 for the 1.10.x line.
 And we should remove the current release from the README. 
 On Wed, Jan 30, 2019 at 1:27 PM Dongjoon Hyun
  wrote:> Hi, All.
> 
> For RC testing, I downloaded the src tar file and followed the
> README. I'm wondering if the README is up-to-date and proper.> 
> In the master branch, `protoc` is handled by maven plugin. 
> 
> But, in RC, while `.travis.yml` installs `protobuf-3.5.1`, README
> guides to install `protobuf-2.5.0` and eventually fails due to
> `TestProto3.proto`.> 
>> main:
>> [mkdir] Created dir: 
>> /Users/dongjoon/APACHE/RC-PARQUET/apache-parquet-
>> 1.10.1/parquet-protobuf/target/generated-test-sources>> 
>> [mkdir] Created dir: /Users/dongjoon/APACHE/RC-PARQUET/apache-parquet-
>> 1.10.1/parquet-protobuf/target/generated-test-sources/java>> 
>>  [exec] src/test/resources/TestProto3.proto:1:10:
>>  Unrecognized syntax identifier "proto3".  This parser only
>>  recognizes "proto2".> 
> Also, README says `The current release is version 1.8.1` instead
> of `1.10.1`. Is it worth to fix?> 
> Bests,
> Dongjoon.
> 
> 
> On Wed, Jan 30, 2019 at 10:45 AM Ryan Blue
>  wrote:>> +1 (binding)
>> 
>>  Validated source signature, checksum. Ran unit tests. Tested
>>  Iceberg with>>  the candidate.
>> 
>>  For reference, here’s how to add test this candidate in a gradle
>>  project:>> 
>>  repositories {
>>...
>>maven {
>>  url '
>>  
>> https://repository.apache.org/content/repositories/orgapacheparquet-1022/'>>
>> }
>>  }
>> 
>>  And in a maven project:
>> 
>>
>>  ...
>>  
>>parquet-1.10.1
>>
>>Parquet 1.10.1 RC0
>>
>>
>> https://repository.apache.org/content/repositories/orgapacheparquet-1022/>>
>> 
>>  true
>>
>>
>>  false
>>
>>  
>>
>> 
>> 
>>  On Tue, Jan 29, 2019 at 6:06 AM Nandor Kollar
>>  >>  wrote:
>> 
>>  > +1 (non-binding)
>>  >
>>  > Verified signature and checksum, ran unit tests, all passed.
>>  >
>>  > Cheers,
>>  > Nandor
>>  >
>>  > On Tue, Jan 29, 2019 at 1:21 PM Gabor Szadovszky
>>  >  wrote:>>  >
>>  > > Hi Ryan,
>>  > >
>>  > > Checked the tarball: checksum/signature are correct. Content
>>  > > is correct>>  > > based on the release tag. Unit tests pass.
>>  > >
>>  > > +1 (non-binding)
>>  > >
>>  > > Cheers,
>>  > > Gabor
>>  > >
>>  > >
>>  > > On Mon, Jan 28, 2019 at 11:08 PM Ryan Blue
>>  > > >>  > > wrote:
>>  > >
>>  > > > Hi everyone,
>>  > > >
>>  > > > I propose the following RC to be released as official
>>  > > > Apache Parquet>>  > Java
>>  > > > 1.10.1 release.
>>  > > >
>>  > > > The commit id is a89df8f9932b6ef6633d06069e50c9b7970bebd1>>  
>> > > >
>>  > > >- This corresponds to the tag: apache-parquet-1.10.1
>>  > > >- 

Re: [VOTE] Release Apache Parquet 1.10.1 RC0

2019-01-31 Thread Ryan Blue
Thanks Uwe, I'll update the script to make it easier next time.

On Thu, Jan 31, 2019 at 1:45 PM Uwe L. Korn  wrote:

> +1 (binding)
>
> Build and tested using Ryan's script on Ubuntu 16.04.
>
> The script helped me a bit as it included the necessary maven options.
> Thanks!
>
> For future, it would be good to include one as we have in Arrow that also
> checks the signature. We have that in the main tree and the script also
> downloads the source tarball. Then the script is simply in git and not part
> of the release.
>
> Uwe
>
>
> On Thu, Jan 31, 2019, at 7:36 PM, Ryan Blue wrote:
>
> Uwe suggested that we include a validation script for release votes. It's
> a little late to add one to this release, but here is one to make it
> easier. Just run the attached script from the project root.
>
> The script checks for the correct versions of thrift and protobuf. If
> found, those modules and modules that depend on them are built and tested.
> Otherwise, it just tests the modules that don't require additional
> installs. This builds the project and runs RAT checks, then runs tests and
> prints a message at the end.
>
> rb
>
>
> On Wed, Jan 30, 2019 at 10:11 PM Dongjoon Hyun 
> wrote:
>
> +1 for 1.10.1 RC0 (non-binding).
>
> I tested the src tar artifact on Ubuntu 16.04 and passed all UTs.
> (Also, I saw the result of Ryan's Spark PR
> https://github.com/apache/spark/pull/23704.)
>
> Thank you for the release.
>
> Cheers,
> Dongjoon.
>
> On Wed, Jan 30, 2019 at 5:07 PM Dongjoon Hyun 
> wrote:
>
> Sure! I'll make a PR for that.
>
> Bests,
> Dongjoon.
>
> On Wed, Jan 30, 2019 at 3:11 PM Ryan Blue  wrote:
>
> Looks like the README is out of date. I don't think we should fail this RC
> based on the README. Can you open a pull request to update it.
>
> I think the correct version is protobuf 3.5.1 for the 1.10.x line. And we
> should remove the current release from the README.
>
> On Wed, Jan 30, 2019 at 1:27 PM Dongjoon Hyun 
> wrote:
>
> Hi, All.
>
> For RC testing, I downloaded the src tar file and followed the README. I'm
> wondering if the README is up-to-date and proper.
>
> In the master branch, `protoc` is handled by maven plugin.
>
> But, in RC, while `.travis.yml` installs `protobuf-3.5.1`, README guides
> to install `protobuf-2.5.0` and eventually fails due to `TestProto3.proto`.
>
> main:
> [mkdir] Created dir:
> /Users/dongjoon/APACHE/RC-PARQUET/apache-parquet-1.10.1/parquet-protobuf/target/generated-test-sources
> [mkdir] Created dir:
> /Users/dongjoon/APACHE/RC-PARQUET/apache-parquet-1.10.1/parquet-protobuf/target/generated-test-sources/java
>  [exec] src/test/resources/TestProto3.proto:1:10: Unrecognized syntax
> identifier "proto3".  This parser only recognizes "proto2".
>
>
> Also, README says `The current release is version 1.8.1` instead of
> `1.10.1`. Is it worth to fix?
>
> Bests,
> Dongjoon.
>
>
> On Wed, Jan 30, 2019 at 10:45 AM Ryan Blue 
> wrote:
>
> +1 (binding)
>
> Validated source signature, checksum. Ran unit tests. Tested Iceberg with
> the candidate.
>
> For reference, here’s how to add test this candidate in a gradle project:
>
> repositories {
>   ...
>   maven {
> url '
> https://repository.apache.org/content/repositories/orgapacheparquet-1022/'
>   }
> }
>
> And in a maven project:
>
>   
> ...
> 
>   parquet-1.10.1
>   
>   Parquet 1.10.1 RC0
>   
> https://repository.apache.org/content/repositories/orgapacheparquet-1022/
> 
>   
> true
>   
>   
> false
>   
> 
>   
>
>
> On Tue, Jan 29, 2019 at 6:06 AM Nandor Kollar  >
> wrote:
>
> > +1 (non-binding)
> >
> > Verified signature and checksum, ran unit tests, all passed.
> >
> > Cheers,
> > Nandor
> >
> > On Tue, Jan 29, 2019 at 1:21 PM Gabor Szadovszky 
> wrote:
> >
> > > Hi Ryan,
> > >
> > > Checked the tarball: checksum/signature are correct. Content is correct
> > > based on the release tag. Unit tests pass.
> > >
> > > +1 (non-binding)
> > >
> > > Cheers,
> > > Gabor
> > >
> > >
> > > On Mon, Jan 28, 2019 at 11:08 PM Ryan Blue 
> > > wrote:
> > >
> > > > Hi everyone,
> > > >
> > > > I propose the following RC to be released as official Apache Parquet
> > Java
> > > > 1.10.1 release.
> > > >
> > > > The commit id is a89df8f9932b6ef6633d06069e50c9b7970bebd1
> > > >
> > > >- This corresponds to the tag: apache-parquet-1.10.1
> > > >- https://github.com/apache/parquet-mr/commit/a89df8f
> > > >- https://github.com/apache/parquet-mr/tree/apache-parquet-1.10.1
> > > >
> > > > The release tarball, signature, and checksums are here:
> > > >
> > > >-
> > > >
> > > >
> > >
> >
> https://dist.apache.org/repos/dist/dev/parquet/apache-parquet-1.10.1-rc0/
> > > >
> > > > You can find the KEYS file here:
> > > >
> > > >- https://dist.apache.org/repos/dist/dev/parquet/KEYS
> > > >
> > > > Binary artifacts are staged in Nexus here:
> > > >
> > > >-
> > > >
> > > >
> > >
> >
> 

Re: [VOTE] Release Apache Parquet 1.10.1 RC0

2019-01-31 Thread Ryan Blue
Uwe suggested that we include a validation script for release votes. It's a
little late to add one to this release, but here is one to make it easier.
Just run the attached script from the project root.

The script checks for the correct versions of thrift and protobuf. If
found, those modules and modules that depend on them are built and tested.
Otherwise, it just tests the modules that don't require additional
installs. This builds the project and runs RAT checks, then runs tests and
prints a message at the end.

rb

On Wed, Jan 30, 2019 at 10:11 PM Dongjoon Hyun 
wrote:

> +1 for 1.10.1 RC0 (non-binding).
>
> I tested the src tar artifact on Ubuntu 16.04 and passed all UTs.
> (Also, I saw the result of Ryan's Spark PR
> https://github.com/apache/spark/pull/23704.)
>
> Thank you for the release.
>
> Cheers,
> Dongjoon.
>
> On Wed, Jan 30, 2019 at 5:07 PM Dongjoon Hyun 
> wrote:
>
>> Sure! I'll make a PR for that.
>>
>> Bests,
>> Dongjoon.
>>
>> On Wed, Jan 30, 2019 at 3:11 PM Ryan Blue  wrote:
>>
>>> Looks like the README is out of date. I don't think we should fail this
>>> RC based on the README. Can you open a pull request to update it.
>>>
>>> I think the correct version is protobuf 3.5.1 for the 1.10.x line. And
>>> we should remove the current release from the README.
>>>
>>> On Wed, Jan 30, 2019 at 1:27 PM Dongjoon Hyun 
>>> wrote:
>>>
 Hi, All.

 For RC testing, I downloaded the src tar file and followed the README.
 I'm wondering if the README is up-to-date and proper.

 In the master branch, `protoc` is handled by maven plugin.

 But, in RC, while `.travis.yml` installs `protobuf-3.5.1`, README
 guides to install `protobuf-2.5.0` and eventually fails due to
 `TestProto3.proto`.

 main:
 [mkdir] Created dir:
 /Users/dongjoon/APACHE/RC-PARQUET/apache-parquet-1.10.1/parquet-protobuf/target/generated-test-sources
 [mkdir] Created dir:
 /Users/dongjoon/APACHE/RC-PARQUET/apache-parquet-1.10.1/parquet-protobuf/target/generated-test-sources/java
  [exec] src/test/resources/TestProto3.proto:1:10: Unrecognized
 syntax identifier "proto3".  This parser only recognizes "proto2".


 Also, README says `The current release is version 1.8.1` instead of
 `1.10.1`. Is it worth to fix?

 Bests,
 Dongjoon.


 On Wed, Jan 30, 2019 at 10:45 AM Ryan Blue 
 wrote:

> +1 (binding)
>
> Validated source signature, checksum. Ran unit tests. Tested Iceberg
> with
> the candidate.
>
> For reference, here’s how to add test this candidate in a gradle
> project:
>
> repositories {
>   ...
>   maven {
> url '
> https://repository.apache.org/content/repositories/orgapacheparquet-1022/
> '
>   }
> }
>
> And in a maven project:
>
>   
> ...
> 
>   parquet-1.10.1
>   
>   Parquet 1.10.1 RC0
>   
> https://repository.apache.org/content/repositories/orgapacheparquet-1022/
> 
>   
> true
>   
>   
> false
>   
> 
>   
>
>
> On Tue, Jan 29, 2019 at 6:06 AM Nandor Kollar
> 
> wrote:
>
> > +1 (non-binding)
> >
> > Verified signature and checksum, ran unit tests, all passed.
> >
> > Cheers,
> > Nandor
> >
> > On Tue, Jan 29, 2019 at 1:21 PM Gabor Szadovszky 
> wrote:
> >
> > > Hi Ryan,
> > >
> > > Checked the tarball: checksum/signature are correct. Content is
> correct
> > > based on the release tag. Unit tests pass.
> > >
> > > +1 (non-binding)
> > >
> > > Cheers,
> > > Gabor
> > >
> > >
> > > On Mon, Jan 28, 2019 at 11:08 PM Ryan Blue
> 
> > > wrote:
> > >
> > > > Hi everyone,
> > > >
> > > > I propose the following RC to be released as official Apache
> Parquet
> > Java
> > > > 1.10.1 release.
> > > >
> > > > The commit id is a89df8f9932b6ef6633d06069e50c9b7970bebd1
> > > >
> > > >- This corresponds to the tag: apache-parquet-1.10.1
> > > >- https://github.com/apache/parquet-mr/commit/a89df8f
> > > >-
> https://github.com/apache/parquet-mr/tree/apache-parquet-1.10.1
> > > >
> > > > The release tarball, signature, and checksums are here:
> > > >
> > > >-
> > > >
> > > >
> > >
> >
> https://dist.apache.org/repos/dist/dev/parquet/apache-parquet-1.10.1-rc0/
> > > >
> > > > You can find the KEYS file here:
> > > >
> > > >- https://dist.apache.org/repos/dist/dev/parquet/KEYS
> > > >
> > > > Binary artifacts are staged in Nexus here:
> > > >
> > > >-
> > > >
> > > >
> > >
> >
> https://repository.apache.org/content/repositories/orgapacheparquet-1022/
> > > >
> > > > This release is a patch release for Parquet 

Re: [VOTE] Release Apache Parquet 1.10.1 RC0

2019-01-30 Thread Dongjoon Hyun
+1 for 1.10.1 RC0 (non-binding).

I tested the src tar artifact on Ubuntu 16.04 and passed all UTs.
(Also, I saw the result of Ryan's Spark PR
https://github.com/apache/spark/pull/23704.)

Thank you for the release.

Cheers,
Dongjoon.

On Wed, Jan 30, 2019 at 5:07 PM Dongjoon Hyun 
wrote:

> Sure! I'll make a PR for that.
>
> Bests,
> Dongjoon.
>
> On Wed, Jan 30, 2019 at 3:11 PM Ryan Blue  wrote:
>
>> Looks like the README is out of date. I don't think we should fail this
>> RC based on the README. Can you open a pull request to update it.
>>
>> I think the correct version is protobuf 3.5.1 for the 1.10.x line. And we
>> should remove the current release from the README.
>>
>> On Wed, Jan 30, 2019 at 1:27 PM Dongjoon Hyun 
>> wrote:
>>
>>> Hi, All.
>>>
>>> For RC testing, I downloaded the src tar file and followed the README.
>>> I'm wondering if the README is up-to-date and proper.
>>>
>>> In the master branch, `protoc` is handled by maven plugin.
>>>
>>> But, in RC, while `.travis.yml` installs `protobuf-3.5.1`, README guides
>>> to install `protobuf-2.5.0` and eventually fails due to `TestProto3.proto`.
>>>
>>> main:
>>> [mkdir] Created dir:
>>> /Users/dongjoon/APACHE/RC-PARQUET/apache-parquet-1.10.1/parquet-protobuf/target/generated-test-sources
>>> [mkdir] Created dir:
>>> /Users/dongjoon/APACHE/RC-PARQUET/apache-parquet-1.10.1/parquet-protobuf/target/generated-test-sources/java
>>>  [exec] src/test/resources/TestProto3.proto:1:10: Unrecognized
>>> syntax identifier "proto3".  This parser only recognizes "proto2".
>>>
>>>
>>> Also, README says `The current release is version 1.8.1` instead of
>>> `1.10.1`. Is it worth to fix?
>>>
>>> Bests,
>>> Dongjoon.
>>>
>>>
>>> On Wed, Jan 30, 2019 at 10:45 AM Ryan Blue 
>>> wrote:
>>>
 +1 (binding)

 Validated source signature, checksum. Ran unit tests. Tested Iceberg
 with
 the candidate.

 For reference, here’s how to add test this candidate in a gradle
 project:

 repositories {
   ...
   maven {
 url '
 https://repository.apache.org/content/repositories/orgapacheparquet-1022/
 '
   }
 }

 And in a maven project:

   
 ...
 
   parquet-1.10.1
   
   Parquet 1.10.1 RC0
   
 https://repository.apache.org/content/repositories/orgapacheparquet-1022/
 
   
 true
   
   
 false
   
 
   


 On Tue, Jan 29, 2019 at 6:06 AM Nandor Kollar
 
 wrote:

 > +1 (non-binding)
 >
 > Verified signature and checksum, ran unit tests, all passed.
 >
 > Cheers,
 > Nandor
 >
 > On Tue, Jan 29, 2019 at 1:21 PM Gabor Szadovszky 
 wrote:
 >
 > > Hi Ryan,
 > >
 > > Checked the tarball: checksum/signature are correct. Content is
 correct
 > > based on the release tag. Unit tests pass.
 > >
 > > +1 (non-binding)
 > >
 > > Cheers,
 > > Gabor
 > >
 > >
 > > On Mon, Jan 28, 2019 at 11:08 PM Ryan Blue
 
 > > wrote:
 > >
 > > > Hi everyone,
 > > >
 > > > I propose the following RC to be released as official Apache
 Parquet
 > Java
 > > > 1.10.1 release.
 > > >
 > > > The commit id is a89df8f9932b6ef6633d06069e50c9b7970bebd1
 > > >
 > > >- This corresponds to the tag: apache-parquet-1.10.1
 > > >- https://github.com/apache/parquet-mr/commit/a89df8f
 > > >-
 https://github.com/apache/parquet-mr/tree/apache-parquet-1.10.1
 > > >
 > > > The release tarball, signature, and checksums are here:
 > > >
 > > >-
 > > >
 > > >
 > >
 >
 https://dist.apache.org/repos/dist/dev/parquet/apache-parquet-1.10.1-rc0/
 > > >
 > > > You can find the KEYS file here:
 > > >
 > > >- https://dist.apache.org/repos/dist/dev/parquet/KEYS
 > > >
 > > > Binary artifacts are staged in Nexus here:
 > > >
 > > >-
 > > >
 > > >
 > >
 >
 https://repository.apache.org/content/repositories/orgapacheparquet-1022/
 > > >
 > > > This release is a patch release for Parquet 1.10.0. It includes
 the
 > > > following bug fixes:
 > > >
 > > >- PARQUET-1309: Properties to disable stats and dictionary
 filtering
 > > are
 > > >swapped
 > > >- PARQUET-1510: Dictionary filter bug skips null for notEq with
 > > >dictionary of one value
 > > >
 > > > Please download, verify, and test.
 > > >
 > > > Please vote in the next 72 hours:
 > > >
 > > > [ ] +1 Release this as Apache Parquet Java 1.10.1
 > > > [ ] +0
 > > > [ ] -1 Do not release this because…
 > > > --
 > > > Ryan Blue
 > > > Software Engineer
 > > > Netflix
 > > >
 > >
 >


 --
 Ryan Blue
 Software Engineer
 Netflix

>>>
>>
>> --

Re: [VOTE] Release Apache Parquet 1.10.1 RC0

2019-01-30 Thread Dongjoon Hyun
Sure! I'll make a PR for that.

Bests,
Dongjoon.

On Wed, Jan 30, 2019 at 3:11 PM Ryan Blue  wrote:

> Looks like the README is out of date. I don't think we should fail this RC
> based on the README. Can you open a pull request to update it.
>
> I think the correct version is protobuf 3.5.1 for the 1.10.x line. And we
> should remove the current release from the README.
>
> On Wed, Jan 30, 2019 at 1:27 PM Dongjoon Hyun 
> wrote:
>
>> Hi, All.
>>
>> For RC testing, I downloaded the src tar file and followed the README.
>> I'm wondering if the README is up-to-date and proper.
>>
>> In the master branch, `protoc` is handled by maven plugin.
>>
>> But, in RC, while `.travis.yml` installs `protobuf-3.5.1`, README guides
>> to install `protobuf-2.5.0` and eventually fails due to `TestProto3.proto`.
>>
>> main:
>> [mkdir] Created dir:
>> /Users/dongjoon/APACHE/RC-PARQUET/apache-parquet-1.10.1/parquet-protobuf/target/generated-test-sources
>> [mkdir] Created dir:
>> /Users/dongjoon/APACHE/RC-PARQUET/apache-parquet-1.10.1/parquet-protobuf/target/generated-test-sources/java
>>  [exec] src/test/resources/TestProto3.proto:1:10: Unrecognized syntax
>> identifier "proto3".  This parser only recognizes "proto2".
>>
>>
>> Also, README says `The current release is version 1.8.1` instead of
>> `1.10.1`. Is it worth to fix?
>>
>> Bests,
>> Dongjoon.
>>
>>
>> On Wed, Jan 30, 2019 at 10:45 AM Ryan Blue 
>> wrote:
>>
>>> +1 (binding)
>>>
>>> Validated source signature, checksum. Ran unit tests. Tested Iceberg with
>>> the candidate.
>>>
>>> For reference, here’s how to add test this candidate in a gradle project:
>>>
>>> repositories {
>>>   ...
>>>   maven {
>>> url '
>>> https://repository.apache.org/content/repositories/orgapacheparquet-1022/
>>> '
>>>   }
>>> }
>>>
>>> And in a maven project:
>>>
>>>   
>>> ...
>>> 
>>>   parquet-1.10.1
>>>   
>>>   Parquet 1.10.1 RC0
>>>   
>>> https://repository.apache.org/content/repositories/orgapacheparquet-1022/
>>> 
>>>   
>>> true
>>>   
>>>   
>>> false
>>>   
>>> 
>>>   
>>>
>>>
>>> On Tue, Jan 29, 2019 at 6:06 AM Nandor Kollar
>>> 
>>> wrote:
>>>
>>> > +1 (non-binding)
>>> >
>>> > Verified signature and checksum, ran unit tests, all passed.
>>> >
>>> > Cheers,
>>> > Nandor
>>> >
>>> > On Tue, Jan 29, 2019 at 1:21 PM Gabor Szadovszky 
>>> wrote:
>>> >
>>> > > Hi Ryan,
>>> > >
>>> > > Checked the tarball: checksum/signature are correct. Content is
>>> correct
>>> > > based on the release tag. Unit tests pass.
>>> > >
>>> > > +1 (non-binding)
>>> > >
>>> > > Cheers,
>>> > > Gabor
>>> > >
>>> > >
>>> > > On Mon, Jan 28, 2019 at 11:08 PM Ryan Blue >> >
>>> > > wrote:
>>> > >
>>> > > > Hi everyone,
>>> > > >
>>> > > > I propose the following RC to be released as official Apache
>>> Parquet
>>> > Java
>>> > > > 1.10.1 release.
>>> > > >
>>> > > > The commit id is a89df8f9932b6ef6633d06069e50c9b7970bebd1
>>> > > >
>>> > > >- This corresponds to the tag: apache-parquet-1.10.1
>>> > > >- https://github.com/apache/parquet-mr/commit/a89df8f
>>> > > >-
>>> https://github.com/apache/parquet-mr/tree/apache-parquet-1.10.1
>>> > > >
>>> > > > The release tarball, signature, and checksums are here:
>>> > > >
>>> > > >-
>>> > > >
>>> > > >
>>> > >
>>> >
>>> https://dist.apache.org/repos/dist/dev/parquet/apache-parquet-1.10.1-rc0/
>>> > > >
>>> > > > You can find the KEYS file here:
>>> > > >
>>> > > >- https://dist.apache.org/repos/dist/dev/parquet/KEYS
>>> > > >
>>> > > > Binary artifacts are staged in Nexus here:
>>> > > >
>>> > > >-
>>> > > >
>>> > > >
>>> > >
>>> >
>>> https://repository.apache.org/content/repositories/orgapacheparquet-1022/
>>> > > >
>>> > > > This release is a patch release for Parquet 1.10.0. It includes the
>>> > > > following bug fixes:
>>> > > >
>>> > > >- PARQUET-1309: Properties to disable stats and dictionary
>>> filtering
>>> > > are
>>> > > >swapped
>>> > > >- PARQUET-1510: Dictionary filter bug skips null for notEq with
>>> > > >dictionary of one value
>>> > > >
>>> > > > Please download, verify, and test.
>>> > > >
>>> > > > Please vote in the next 72 hours:
>>> > > >
>>> > > > [ ] +1 Release this as Apache Parquet Java 1.10.1
>>> > > > [ ] +0
>>> > > > [ ] -1 Do not release this because…
>>> > > > --
>>> > > > Ryan Blue
>>> > > > Software Engineer
>>> > > > Netflix
>>> > > >
>>> > >
>>> >
>>>
>>>
>>> --
>>> Ryan Blue
>>> Software Engineer
>>> Netflix
>>>
>>
>
> --
> Ryan Blue
> Software Engineer
> Netflix
>


Re: [VOTE] Release Apache Parquet 1.10.1 RC0

2019-01-30 Thread Ryan Blue
Looks like the README is out of date. I don't think we should fail this RC
based on the README. Can you open a pull request to update it.

I think the correct version is protobuf 3.5.1 for the 1.10.x line. And we
should remove the current release from the README.

On Wed, Jan 30, 2019 at 1:27 PM Dongjoon Hyun 
wrote:

> Hi, All.
>
> For RC testing, I downloaded the src tar file and followed the README. I'm
> wondering if the README is up-to-date and proper.
>
> In the master branch, `protoc` is handled by maven plugin.
>
> But, in RC, while `.travis.yml` installs `protobuf-3.5.1`, README guides
> to install `protobuf-2.5.0` and eventually fails due to `TestProto3.proto`.
>
> main:
> [mkdir] Created dir:
> /Users/dongjoon/APACHE/RC-PARQUET/apache-parquet-1.10.1/parquet-protobuf/target/generated-test-sources
> [mkdir] Created dir:
> /Users/dongjoon/APACHE/RC-PARQUET/apache-parquet-1.10.1/parquet-protobuf/target/generated-test-sources/java
>  [exec] src/test/resources/TestProto3.proto:1:10: Unrecognized syntax
> identifier "proto3".  This parser only recognizes "proto2".
>
>
> Also, README says `The current release is version 1.8.1` instead of
> `1.10.1`. Is it worth to fix?
>
> Bests,
> Dongjoon.
>
>
> On Wed, Jan 30, 2019 at 10:45 AM Ryan Blue 
> wrote:
>
>> +1 (binding)
>>
>> Validated source signature, checksum. Ran unit tests. Tested Iceberg with
>> the candidate.
>>
>> For reference, here’s how to add test this candidate in a gradle project:
>>
>> repositories {
>>   ...
>>   maven {
>> url '
>> https://repository.apache.org/content/repositories/orgapacheparquet-1022/
>> '
>>   }
>> }
>>
>> And in a maven project:
>>
>>   
>> ...
>> 
>>   parquet-1.10.1
>>   
>>   Parquet 1.10.1 RC0
>>   
>> https://repository.apache.org/content/repositories/orgapacheparquet-1022/
>> 
>>   
>> true
>>   
>>   
>> false
>>   
>> 
>>   
>>
>>
>> On Tue, Jan 29, 2019 at 6:06 AM Nandor Kollar
>> 
>> wrote:
>>
>> > +1 (non-binding)
>> >
>> > Verified signature and checksum, ran unit tests, all passed.
>> >
>> > Cheers,
>> > Nandor
>> >
>> > On Tue, Jan 29, 2019 at 1:21 PM Gabor Szadovszky 
>> wrote:
>> >
>> > > Hi Ryan,
>> > >
>> > > Checked the tarball: checksum/signature are correct. Content is
>> correct
>> > > based on the release tag. Unit tests pass.
>> > >
>> > > +1 (non-binding)
>> > >
>> > > Cheers,
>> > > Gabor
>> > >
>> > >
>> > > On Mon, Jan 28, 2019 at 11:08 PM Ryan Blue > >
>> > > wrote:
>> > >
>> > > > Hi everyone,
>> > > >
>> > > > I propose the following RC to be released as official Apache Parquet
>> > Java
>> > > > 1.10.1 release.
>> > > >
>> > > > The commit id is a89df8f9932b6ef6633d06069e50c9b7970bebd1
>> > > >
>> > > >- This corresponds to the tag: apache-parquet-1.10.1
>> > > >- https://github.com/apache/parquet-mr/commit/a89df8f
>> > > >-
>> https://github.com/apache/parquet-mr/tree/apache-parquet-1.10.1
>> > > >
>> > > > The release tarball, signature, and checksums are here:
>> > > >
>> > > >-
>> > > >
>> > > >
>> > >
>> >
>> https://dist.apache.org/repos/dist/dev/parquet/apache-parquet-1.10.1-rc0/
>> > > >
>> > > > You can find the KEYS file here:
>> > > >
>> > > >- https://dist.apache.org/repos/dist/dev/parquet/KEYS
>> > > >
>> > > > Binary artifacts are staged in Nexus here:
>> > > >
>> > > >-
>> > > >
>> > > >
>> > >
>> >
>> https://repository.apache.org/content/repositories/orgapacheparquet-1022/
>> > > >
>> > > > This release is a patch release for Parquet 1.10.0. It includes the
>> > > > following bug fixes:
>> > > >
>> > > >- PARQUET-1309: Properties to disable stats and dictionary
>> filtering
>> > > are
>> > > >swapped
>> > > >- PARQUET-1510: Dictionary filter bug skips null for notEq with
>> > > >dictionary of one value
>> > > >
>> > > > Please download, verify, and test.
>> > > >
>> > > > Please vote in the next 72 hours:
>> > > >
>> > > > [ ] +1 Release this as Apache Parquet Java 1.10.1
>> > > > [ ] +0
>> > > > [ ] -1 Do not release this because…
>> > > > --
>> > > > Ryan Blue
>> > > > Software Engineer
>> > > > Netflix
>> > > >
>> > >
>> >
>>
>>
>> --
>> Ryan Blue
>> Software Engineer
>> Netflix
>>
>

-- 
Ryan Blue
Software Engineer
Netflix


Re: [VOTE] Release Apache Parquet 1.10.1 RC0

2019-01-30 Thread Dongjoon Hyun
Hi, All.

For RC testing, I downloaded the src tar file and followed the README. I'm
wondering if the README is up-to-date and proper.

In the master branch, `protoc` is handled by maven plugin.

But, in RC, while `.travis.yml` installs `protobuf-3.5.1`, README guides to
install `protobuf-2.5.0` and eventually fails due to `TestProto3.proto`.

main:
[mkdir] Created dir:
/Users/dongjoon/APACHE/RC-PARQUET/apache-parquet-1.10.1/parquet-protobuf/target/generated-test-sources
[mkdir] Created dir:
/Users/dongjoon/APACHE/RC-PARQUET/apache-parquet-1.10.1/parquet-protobuf/target/generated-test-sources/java
 [exec] src/test/resources/TestProto3.proto:1:10: Unrecognized syntax
identifier "proto3".  This parser only recognizes "proto2".


Also, README says `The current release is version 1.8.1` instead of
`1.10.1`. Is it worth to fix?

Bests,
Dongjoon.


On Wed, Jan 30, 2019 at 10:45 AM Ryan Blue 
wrote:

> +1 (binding)
>
> Validated source signature, checksum. Ran unit tests. Tested Iceberg with
> the candidate.
>
> For reference, here’s how to add test this candidate in a gradle project:
>
> repositories {
>   ...
>   maven {
> url '
> https://repository.apache.org/content/repositories/orgapacheparquet-1022/'
>   }
> }
>
> And in a maven project:
>
>   
> ...
> 
>   parquet-1.10.1
>   
>   Parquet 1.10.1 RC0
>   
> https://repository.apache.org/content/repositories/orgapacheparquet-1022/
> 
>   
> true
>   
>   
> false
>   
> 
>   
>
>
> On Tue, Jan 29, 2019 at 6:06 AM Nandor Kollar  >
> wrote:
>
> > +1 (non-binding)
> >
> > Verified signature and checksum, ran unit tests, all passed.
> >
> > Cheers,
> > Nandor
> >
> > On Tue, Jan 29, 2019 at 1:21 PM Gabor Szadovszky 
> wrote:
> >
> > > Hi Ryan,
> > >
> > > Checked the tarball: checksum/signature are correct. Content is correct
> > > based on the release tag. Unit tests pass.
> > >
> > > +1 (non-binding)
> > >
> > > Cheers,
> > > Gabor
> > >
> > >
> > > On Mon, Jan 28, 2019 at 11:08 PM Ryan Blue 
> > > wrote:
> > >
> > > > Hi everyone,
> > > >
> > > > I propose the following RC to be released as official Apache Parquet
> > Java
> > > > 1.10.1 release.
> > > >
> > > > The commit id is a89df8f9932b6ef6633d06069e50c9b7970bebd1
> > > >
> > > >- This corresponds to the tag: apache-parquet-1.10.1
> > > >- https://github.com/apache/parquet-mr/commit/a89df8f
> > > >- https://github.com/apache/parquet-mr/tree/apache-parquet-1.10.1
> > > >
> > > > The release tarball, signature, and checksums are here:
> > > >
> > > >-
> > > >
> > > >
> > >
> >
> https://dist.apache.org/repos/dist/dev/parquet/apache-parquet-1.10.1-rc0/
> > > >
> > > > You can find the KEYS file here:
> > > >
> > > >- https://dist.apache.org/repos/dist/dev/parquet/KEYS
> > > >
> > > > Binary artifacts are staged in Nexus here:
> > > >
> > > >-
> > > >
> > > >
> > >
> >
> https://repository.apache.org/content/repositories/orgapacheparquet-1022/
> > > >
> > > > This release is a patch release for Parquet 1.10.0. It includes the
> > > > following bug fixes:
> > > >
> > > >- PARQUET-1309: Properties to disable stats and dictionary
> filtering
> > > are
> > > >swapped
> > > >- PARQUET-1510: Dictionary filter bug skips null for notEq with
> > > >dictionary of one value
> > > >
> > > > Please download, verify, and test.
> > > >
> > > > Please vote in the next 72 hours:
> > > >
> > > > [ ] +1 Release this as Apache Parquet Java 1.10.1
> > > > [ ] +0
> > > > [ ] -1 Do not release this because…
> > > > --
> > > > Ryan Blue
> > > > Software Engineer
> > > > Netflix
> > > >
> > >
> >
>
>
> --
> Ryan Blue
> Software Engineer
> Netflix
>


Re: [VOTE] Release Apache Parquet 1.10.1 RC0

2019-01-30 Thread Ryan Blue
+1 (binding)

Validated source signature, checksum. Ran unit tests. Tested Iceberg with
the candidate.

For reference, here’s how to add test this candidate in a gradle project:

repositories {
  ...
  maven {
url 
'https://repository.apache.org/content/repositories/orgapacheparquet-1022/'
  }
}

And in a maven project:

  
...

  parquet-1.10.1
  
  Parquet 1.10.1 RC0
  
https://repository.apache.org/content/repositories/orgapacheparquet-1022/
  
true
  
  
false
  

  


On Tue, Jan 29, 2019 at 6:06 AM Nandor Kollar 
wrote:

> +1 (non-binding)
>
> Verified signature and checksum, ran unit tests, all passed.
>
> Cheers,
> Nandor
>
> On Tue, Jan 29, 2019 at 1:21 PM Gabor Szadovszky  wrote:
>
> > Hi Ryan,
> >
> > Checked the tarball: checksum/signature are correct. Content is correct
> > based on the release tag. Unit tests pass.
> >
> > +1 (non-binding)
> >
> > Cheers,
> > Gabor
> >
> >
> > On Mon, Jan 28, 2019 at 11:08 PM Ryan Blue 
> > wrote:
> >
> > > Hi everyone,
> > >
> > > I propose the following RC to be released as official Apache Parquet
> Java
> > > 1.10.1 release.
> > >
> > > The commit id is a89df8f9932b6ef6633d06069e50c9b7970bebd1
> > >
> > >- This corresponds to the tag: apache-parquet-1.10.1
> > >- https://github.com/apache/parquet-mr/commit/a89df8f
> > >- https://github.com/apache/parquet-mr/tree/apache-parquet-1.10.1
> > >
> > > The release tarball, signature, and checksums are here:
> > >
> > >-
> > >
> > >
> >
> https://dist.apache.org/repos/dist/dev/parquet/apache-parquet-1.10.1-rc0/
> > >
> > > You can find the KEYS file here:
> > >
> > >- https://dist.apache.org/repos/dist/dev/parquet/KEYS
> > >
> > > Binary artifacts are staged in Nexus here:
> > >
> > >-
> > >
> > >
> >
> https://repository.apache.org/content/repositories/orgapacheparquet-1022/
> > >
> > > This release is a patch release for Parquet 1.10.0. It includes the
> > > following bug fixes:
> > >
> > >- PARQUET-1309: Properties to disable stats and dictionary filtering
> > are
> > >swapped
> > >- PARQUET-1510: Dictionary filter bug skips null for notEq with
> > >dictionary of one value
> > >
> > > Please download, verify, and test.
> > >
> > > Please vote in the next 72 hours:
> > >
> > > [ ] +1 Release this as Apache Parquet Java 1.10.1
> > > [ ] +0
> > > [ ] -1 Do not release this because…
> > > --
> > > Ryan Blue
> > > Software Engineer
> > > Netflix
> > >
> >
>


-- 
Ryan Blue
Software Engineer
Netflix


Re: [VOTE] Release Apache Parquet 1.10.1 RC0

2019-01-29 Thread Nandor Kollar
+1 (non-binding)

Verified signature and checksum, ran unit tests, all passed.

Cheers,
Nandor

On Tue, Jan 29, 2019 at 1:21 PM Gabor Szadovszky  wrote:

> Hi Ryan,
>
> Checked the tarball: checksum/signature are correct. Content is correct
> based on the release tag. Unit tests pass.
>
> +1 (non-binding)
>
> Cheers,
> Gabor
>
>
> On Mon, Jan 28, 2019 at 11:08 PM Ryan Blue 
> wrote:
>
> > Hi everyone,
> >
> > I propose the following RC to be released as official Apache Parquet Java
> > 1.10.1 release.
> >
> > The commit id is a89df8f9932b6ef6633d06069e50c9b7970bebd1
> >
> >- This corresponds to the tag: apache-parquet-1.10.1
> >- https://github.com/apache/parquet-mr/commit/a89df8f
> >- https://github.com/apache/parquet-mr/tree/apache-parquet-1.10.1
> >
> > The release tarball, signature, and checksums are here:
> >
> >-
> >
> >
> https://dist.apache.org/repos/dist/dev/parquet/apache-parquet-1.10.1-rc0/
> >
> > You can find the KEYS file here:
> >
> >- https://dist.apache.org/repos/dist/dev/parquet/KEYS
> >
> > Binary artifacts are staged in Nexus here:
> >
> >-
> >
> >
> https://repository.apache.org/content/repositories/orgapacheparquet-1022/
> >
> > This release is a patch release for Parquet 1.10.0. It includes the
> > following bug fixes:
> >
> >- PARQUET-1309: Properties to disable stats and dictionary filtering
> are
> >swapped
> >- PARQUET-1510: Dictionary filter bug skips null for notEq with
> >dictionary of one value
> >
> > Please download, verify, and test.
> >
> > Please vote in the next 72 hours:
> >
> > [ ] +1 Release this as Apache Parquet Java 1.10.1
> > [ ] +0
> > [ ] -1 Do not release this because…
> > --
> > Ryan Blue
> > Software Engineer
> > Netflix
> >
>


Re: [VOTE] Release Apache Parquet 1.10.1 RC0

2019-01-29 Thread Gabor Szadovszky
Hi Ryan,

Checked the tarball: checksum/signature are correct. Content is correct
based on the release tag. Unit tests pass.

+1 (non-binding)

Cheers,
Gabor


On Mon, Jan 28, 2019 at 11:08 PM Ryan Blue 
wrote:

> Hi everyone,
>
> I propose the following RC to be released as official Apache Parquet Java
> 1.10.1 release.
>
> The commit id is a89df8f9932b6ef6633d06069e50c9b7970bebd1
>
>- This corresponds to the tag: apache-parquet-1.10.1
>- https://github.com/apache/parquet-mr/commit/a89df8f
>- https://github.com/apache/parquet-mr/tree/apache-parquet-1.10.1
>
> The release tarball, signature, and checksums are here:
>
>-
>
> https://dist.apache.org/repos/dist/dev/parquet/apache-parquet-1.10.1-rc0/
>
> You can find the KEYS file here:
>
>- https://dist.apache.org/repos/dist/dev/parquet/KEYS
>
> Binary artifacts are staged in Nexus here:
>
>-
>
> https://repository.apache.org/content/repositories/orgapacheparquet-1022/
>
> This release is a patch release for Parquet 1.10.0. It includes the
> following bug fixes:
>
>- PARQUET-1309: Properties to disable stats and dictionary filtering are
>swapped
>- PARQUET-1510: Dictionary filter bug skips null for notEq with
>dictionary of one value
>
> Please download, verify, and test.
>
> Please vote in the next 72 hours:
>
> [ ] +1 Release this as Apache Parquet Java 1.10.1
> [ ] +0
> [ ] -1 Do not release this because…
> --
> Ryan Blue
> Software Engineer
> Netflix
>


[VOTE] Release Apache Parquet 1.10.1 RC0

2019-01-28 Thread Ryan Blue
Hi everyone,

I propose the following RC to be released as official Apache Parquet Java
1.10.1 release.

The commit id is a89df8f9932b6ef6633d06069e50c9b7970bebd1

   - This corresponds to the tag: apache-parquet-1.10.1
   - https://github.com/apache/parquet-mr/commit/a89df8f
   - https://github.com/apache/parquet-mr/tree/apache-parquet-1.10.1

The release tarball, signature, and checksums are here:

   -
   https://dist.apache.org/repos/dist/dev/parquet/apache-parquet-1.10.1-rc0/

You can find the KEYS file here:

   - https://dist.apache.org/repos/dist/dev/parquet/KEYS

Binary artifacts are staged in Nexus here:

   -
   https://repository.apache.org/content/repositories/orgapacheparquet-1022/

This release is a patch release for Parquet 1.10.0. It includes the
following bug fixes:

   - PARQUET-1309: Properties to disable stats and dictionary filtering are
   swapped
   - PARQUET-1510: Dictionary filter bug skips null for notEq with
   dictionary of one value

Please download, verify, and test.

Please vote in the next 72 hours:

[ ] +1 Release this as Apache Parquet Java 1.10.1
[ ] +0
[ ] -1 Do not release this because…
-- 
Ryan Blue
Software Engineer
Netflix