Re: [VOTE] Release Apache Avro 1.9.2 RC2

[Daniel Kulp]

+1

Looks pretty good to me.   Thanks for tackling this!

Dan



> On Feb 7, 2020, at 5:47 AM, Ryan Skraba  wrote:
> 
> Hi everyone,
> 
> I'd like to propose the following RC2 to be released as the official Apache
> Avro 1.9.2 release.
> 
> The commit id is bf20128ca6138a830b2ea13e0490f3df6b035639
> * This corresponds to the tag: release-1.9.2-rc2
> * https://github.com/apache/avro/releases/tag/release-1.9.2-rc2
> 
> The release tarball, signature, and checksums are here (revision 37932):
> * https://dist.apache.org/repos/dist/dev/avro/avro-1.9.2-rc2/
> 
> You can find the KEYS file here:
> * https://dist.apache.org/repos/dist/dev/avro/KEYS
> 
> Binary artifacts for Java are staged in Nexus here:
> * 
> https://repository.apache.org/content/groups/staging/org/apache/avro/avro/1.9.2/
> 
> This release includes 71 Jira issues (Thanks Ismael for the Fix
> Version clean-up):
> https://jira.apache.org/jira/issues/?jql=project%20%3D%20AVRO%20AND%20fixVersion%20%3D%201.9.2
> 
> * Some bug fixes:
>  - C#: AVRO-2606 handle multidimensional arrays of custom types
>  - Java: AVRO-2592 Avro decimal fails on some conditions
>  - Java: AVRO-2641 Generated code results in java.lang.ClassCastException
>  - Java: AVRO-2663 Projection on nested records does not work
>  - Python: AVRO-2429 unknown logical types should fall back
> * Improvements:
>  - Java: AVRO-2247 Improve Java reading performance with a new reader
>  - Python: AVRO-2104 Schema normalisation and fingerprint support for Python 3
> * Work to unify Python2 and Python3 APIs in preparation for sunset.
> * Improved tests
> * Improved, more reliable builds.
> * Improved readability
> * Upgrade dependencies to latest versions, including CVE fixes.
> * And more...
> 
> Since RC1, five commits have been added, fixing the following JIRA:
> * https://jira.apache.org/jira/browse/AVRO-2663 (to complete the fix in RC1)
> * https://jira.apache.org/jira/browse/AVRO-2729 Upgrade Velocity to version 
> 2.2
> * https://jira.apache.org/jira/browse/AVRO-2727 Upgrade hadoop3 to version 
> 3.2.1
> * https://jira.apache.org/jira/browse/AVRO-2726 Upgrade Jackson to
> version 2.10.2
> 
> Please download, verify, and test. This vote will remain open for at least
> 72 hours. Given sufficient votes, I would like to close after noon UTC
> Wednesday, February
> 12th
> 
> [ ] +1 Release this as Apache Avro 1.9.2
> [ ] +0
> [ ] -1 Do not release this because...
> 
> Best regards, Ryan Skraba

-- 
Daniel Kulp
dk...@apache.org  - http://dankulp.com/blog 

Talend Community Coder - http://talend.com 

[jira] [Created] (AVRO-2733) [Ruby] mistakenly requiring rubygems

[Ryan Skraba (Jira)]

Ryan Skraba created AVRO-2733:
-

 Summary: [Ruby] mistakenly requiring rubygems
 Key: AVRO-2733
 URL: https://issues.apache.org/jira/browse/AVRO-2733
 Project: Apache Avro
  Issue Type: Task
Reporter: Ryan Skraba
 Fix For: 1.10.0


It looks like we are seeing two issues with running interop tests since the 
openjdk bump that updates ruby from

*{{ruby 2.3.3p222 (2016-11-21) [x86_64-linux-gnu]}}*

to

*{{ruby 2.5.5p157 (2019-03-15 revision 67260) [x86_64-linux-gnu]}}*
 # The command line for interop tests includes {{-rubygems}} when it probably 
means {{-rrubygems}}
 # Rubygems should be automatically required since Ruby 1.9 (released 2007)

We should fix this option in the 
[test_rpc_interop.sh|https://github.com/apache/avro/blob/master/share/test/interop/bin/test_rpc_interop.sh]
 file.

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Commented] (AVRO-2732) Docker image build is broken on master

[Ryan Skraba (Jira)]

[ 
https://issues.apache.org/jira/browse/AVRO-2732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033755#comment-17033755
 ] 

Ryan Skraba commented on AVRO-2732:
---

The build is currently failing with
{code:java}
E: Unable to locate package openjdk-8-jdk {code}
A possible (but *truly* unfortunate quick fix) would be to get openjdk-8 from

*{{deb [http://deb.debian.org/debian/] sid main}}*

It's still available in the list of "unstable" packages that no longer have 
maintenance by the debian security team.

> Docker image build is broken on master
> --
>
> Key: AVRO-2732
> URL: https://issues.apache.org/jira/browse/AVRO-2732
> Project: Apache Avro
>  Issue Type: Improvement
>  Components: docker
>Reporter: Ismaël Mejía
>Assignee: Ismaël Mejía
>Priority: Minor
>
> It seems we had the bad luck that our Dockerfile building/validation image got
> broken because of a change in its upstream parent image openjdk:11 that was 
> upgraded
> to the latest version of its parent version (debian:stable). Debian stable 
> does
> not include Java 8 anymore, so when you build the image (as I did to validate
> the release) it is broken.
> We should fix this by installing Java 'manually' in the docker image. To avoid
> this kind of breakages in the future we should only rely on a pinned OS image
> and install all dev dependencies from there probably install Java.
> There are also some additional warnings that it would be good to fix, e.g. 
> apt-utils and wheel in pip upgrade.
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Updated] (AVRO-2732) Docker image build is broken on master

[Jira]

 [ 
https://issues.apache.org/jira/browse/AVRO-2732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ismaël Mejía updated AVRO-2732:
---
Description: 
It seems we had the bad luck that our Dockerfile building/validation image got
broken because of a change in its upstream parent image openjdk:11 that was 
upgraded
to the latest version of its parent version (debian:stable). Debian stable does
not include Java 8 anymore, so when you build the image (as I did to validate
the release) it is broken.

We should fix this by installing Java 'manually' in the docker image. To avoid
this kind of breakages in the future we should only rely on a pinned OS image
and install all dev dependencies from there probably install Java.

There are also some additional warnings that it would be good to fix, e.g. 
apt-utils and wheel in pip upgrade.

 

  was:
I found an issue in the installation of node and npm because of recent changes 
in their distribution, npm is now distributed independently.

There are also other minor improvements to remove some warnings.


> Docker image build is broken on master
> --
>
> Key: AVRO-2732
> URL: https://issues.apache.org/jira/browse/AVRO-2732
> Project: Apache Avro
>  Issue Type: Improvement
>  Components: docker
>Reporter: Ismaël Mejía
>Assignee: Ismaël Mejía
>Priority: Minor
>
> It seems we had the bad luck that our Dockerfile building/validation image got
> broken because of a change in its upstream parent image openjdk:11 that was 
> upgraded
> to the latest version of its parent version (debian:stable). Debian stable 
> does
> not include Java 8 anymore, so when you build the image (as I did to validate
> the release) it is broken.
> We should fix this by installing Java 'manually' in the docker image. To avoid
> this kind of breakages in the future we should only rely on a pinned OS image
> and install all dev dependencies from there probably install Java.
> There are also some additional warnings that it would be good to fix, e.g. 
> apt-utils and wheel in pip upgrade.
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Updated] (AVRO-2732) Docker image build is broken on master

[Jira]

 [ 
https://issues.apache.org/jira/browse/AVRO-2732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ismaël Mejía updated AVRO-2732:
---
Fix Version/s: (was: 1.9.2)

> Docker image build is broken on master
> --
>
> Key: AVRO-2732
> URL: https://issues.apache.org/jira/browse/AVRO-2732
> Project: Apache Avro
>  Issue Type: Improvement
>  Components: docker
>Reporter: Ismaël Mejía
>Assignee: Ismaël Mejía
>Priority: Minor
>
> I found an issue in the installation of node and npm because of recent 
> changes in their distribution, npm is now distributed independently.
> There are also other minor improvements to remove some warnings.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work stopped] (AVRO-2732) Docker image build is broken on master

[Jira]

 [ 
https://issues.apache.org/jira/browse/AVRO-2732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Work on AVRO-2732 stopped by Ismaël Mejía.
--
> Docker image build is broken on master
> --
>
> Key: AVRO-2732
> URL: https://issues.apache.org/jira/browse/AVRO-2732
> Project: Apache Avro
>  Issue Type: Improvement
>  Components: docker
>Reporter: Ismaël Mejía
>Assignee: Ismaël Mejía
>Priority: Minor
>
> I found an issue in the installation of node and npm because of recent 
> changes in their distribution, npm is now distributed independently.
> There are also other minor improvements to remove some warnings.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Updated] (AVRO-2732) Docker image build is broken on master

[Jira]

 [ 
https://issues.apache.org/jira/browse/AVRO-2732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ismaël Mejía updated AVRO-2732:
---
Summary: Docker image build is broken on master  (was: Docker image has 
warnings and missing elements)

> Docker image build is broken on master
> --
>
> Key: AVRO-2732
> URL: https://issues.apache.org/jira/browse/AVRO-2732
> Project: Apache Avro
>  Issue Type: Improvement
>  Components: docker
>Reporter: Ismaël Mejía
>Assignee: Ismaël Mejía
>Priority: Minor
> Fix For: 1.9.2
>
>
> I found an issue in the installation of node and npm because of recent 
> changes in their distribution, npm is now distributed independently.
> There are also other minor improvements to remove some warnings.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Commented] (AVRO-2693) Upgrade lang/csharp to dotnet core 3.1 (LTS)

[Hudson (Jira)]

[ 
https://issues.apache.org/jira/browse/AVRO-2693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033610#comment-17033610
 ] 

Hudson commented on AVRO-2693:
--

SUCCESS: Integrated in Jenkins build AvroJava #823 (See 
[https://builds.apache.org/job/AvroJava/823/])
AVRO-2693: Upgrade to netcoreapp3.1 (#798) (github: 
[https://github.com/apache/avro/commit/343c92e736d8fa7fce5974314b79bc2f01b00800])
* (edit) lang/csharp/src/apache/test/Avro.test.csproj
* (edit) lang/csharp/src/apache/codegen/Avro.codegen.csproj
* (edit) lang/csharp/src/apache/test/Specific/SpecificTests.cs
* (edit) .travis/before_install.sh
* (edit) lang/csharp/src/apache/perf/Avro.perf.csproj
* (edit) lang/csharp/build.sh
* (edit) lang/csharp/src/apache/test/CodGen/CodeGenTest.cs
* (edit) share/docker/Dockerfile


> Upgrade lang/csharp to dotnet core 3.1 (LTS)
> 
>
> Key: AVRO-2693
> URL: https://issues.apache.org/jira/browse/AVRO-2693
> Project: Apache Avro
>  Issue Type: Improvement
>Reporter: Zoltan Csizmadia
>Assignee: Zoltan Csizmadia
>Priority: Minor
> Fix For: 1.10.0
>
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
> netcoreapp2.2 is EOL. 
> [https://dotnet.microsoft.com/platform/support/policy/dotnet-core]
> Upgrade to 3.1 LTS (3.1.100)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Resolved] (AVRO-2693) Upgrade lang/csharp to dotnet core 3.1 (LTS)

[Fokko Driesprong (Jira)]

 [ 
https://issues.apache.org/jira/browse/AVRO-2693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Fokko Driesprong resolved AVRO-2693.

Fix Version/s: 1.10.0
   Resolution: Fixed

> Upgrade lang/csharp to dotnet core 3.1 (LTS)
> 
>
> Key: AVRO-2693
> URL: https://issues.apache.org/jira/browse/AVRO-2693
> Project: Apache Avro
>  Issue Type: Improvement
>Reporter: Zoltan Csizmadia
>Assignee: Zoltan Csizmadia
>Priority: Minor
> Fix For: 1.10.0
>
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
> netcoreapp2.2 is EOL. 
> [https://dotnet.microsoft.com/platform/support/policy/dotnet-core]
> Upgrade to 3.1 LTS (3.1.100)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Assigned] (AVRO-2693) Upgrade lang/csharp to dotnet core 3.1 (LTS)

[Fokko Driesprong (Jira)]

 [ 
https://issues.apache.org/jira/browse/AVRO-2693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Fokko Driesprong reassigned AVRO-2693:
--

Assignee: Zoltan Csizmadia

> Upgrade lang/csharp to dotnet core 3.1 (LTS)
> 
>
> Key: AVRO-2693
> URL: https://issues.apache.org/jira/browse/AVRO-2693
> Project: Apache Avro
>  Issue Type: Improvement
>Reporter: Zoltan Csizmadia
>Assignee: Zoltan Csizmadia
>Priority: Minor
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
> netcoreapp2.2 is EOL. 
> [https://dotnet.microsoft.com/platform/support/policy/dotnet-core]
> Upgrade to 3.1 LTS (3.1.100)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Commented] (AVRO-2693) Upgrade lang/csharp to dotnet core 3.1 (LTS)

[ASF subversion and git services (Jira)]

[ 
https://issues.apache.org/jira/browse/AVRO-2693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033568#comment-17033568
 ] 

ASF subversion and git services commented on AVRO-2693:
---

Commit 343c92e736d8fa7fce5974314b79bc2f01b00800 in avro's branch 
refs/heads/master from Zoltan Csizmadia
[ https://gitbox.apache.org/repos/asf?p=avro.git;h=343c92e ]

AVRO-2693: Upgrade to netcoreapp3.1 (#798)



> Upgrade lang/csharp to dotnet core 3.1 (LTS)
> 
>
> Key: AVRO-2693
> URL: https://issues.apache.org/jira/browse/AVRO-2693
> Project: Apache Avro
>  Issue Type: Improvement
>Reporter: Zoltan Csizmadia
>Priority: Minor
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
> netcoreapp2.2 is EOL. 
> [https://dotnet.microsoft.com/platform/support/policy/dotnet-core]
> Upgrade to 3.1 LTS (3.1.100)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Resolved] (AVRO-1321) Avro-ipc-tests in compile scope instead of test in Avro-mapred

[Fokko Driesprong (Jira)]

 [ 
https://issues.apache.org/jira/browse/AVRO-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Fokko Driesprong resolved AVRO-1321.

Resolution: Fixed

> Avro-ipc-tests in compile scope instead of test in Avro-mapred
> --
>
> Key: AVRO-1321
> URL: https://issues.apache.org/jira/browse/AVRO-1321
> Project: Apache Avro
>  Issue Type: Bug
>  Components: java
>Affects Versions: 1.7.3
>Reporter: Benyi Wang
>Priority: Trivial
>
> org.apache.avro:avro-ipc:1.7.3:tests is listed in "compile" scope instead of 
> "test" scope.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Re: [VOTE] Release Apache Avro 1.9.2 RC2

[Driesprong, Fokko]

Thanks again Ryan for running the release.

+1 (binding)

Did the following:

   - Verified the keys
   - Verified the hashes
   - Ran the tests
   - Ran the testsuite of Iceberg against Avro 1.9.2

Cheers, Fokko



Op vr 7 feb. 2020 om 11:47 schreef Ryan Skraba :

> Hi everyone,
>
> I'd like to propose the following RC2 to be released as the official Apache
> Avro 1.9.2 release.
>
> The commit id is bf20128ca6138a830b2ea13e0490f3df6b035639
> * This corresponds to the tag: release-1.9.2-rc2
> * https://github.com/apache/avro/releases/tag/release-1.9.2-rc2
>
> The release tarball, signature, and checksums are here (revision 37932):
> * https://dist.apache.org/repos/dist/dev/avro/avro-1.9.2-rc2/
>
> You can find the KEYS file here:
> * https://dist.apache.org/repos/dist/dev/avro/KEYS
>
> Binary artifacts for Java are staged in Nexus here:
> *
> https://repository.apache.org/content/groups/staging/org/apache/avro/avro/1.9.2/
>
> This release includes 71 Jira issues (Thanks Ismael for the Fix
> Version clean-up):
>
> https://jira.apache.org/jira/issues/?jql=project%20%3D%20AVRO%20AND%20fixVersion%20%3D%201.9.2
>
> * Some bug fixes:
>   - C#: AVRO-2606 handle multidimensional arrays of custom types
>   - Java: AVRO-2592 Avro decimal fails on some conditions
>   - Java: AVRO-2641 Generated code results in java.lang.ClassCastException
>   - Java: AVRO-2663 Projection on nested records does not work
>   - Python: AVRO-2429 unknown logical types should fall back
> * Improvements:
>   - Java: AVRO-2247 Improve Java reading performance with a new reader
>   - Python: AVRO-2104 Schema normalisation and fingerprint support for
> Python 3
> * Work to unify Python2 and Python3 APIs in preparation for sunset.
> * Improved tests
> * Improved, more reliable builds.
> * Improved readability
> * Upgrade dependencies to latest versions, including CVE fixes.
> * And more...
>
> Since RC1, five commits have been added, fixing the following JIRA:
> * https://jira.apache.org/jira/browse/AVRO-2663 (to complete the fix in
> RC1)
> * https://jira.apache.org/jira/browse/AVRO-2729 Upgrade Velocity to
> version 2.2
> * https://jira.apache.org/jira/browse/AVRO-2727 Upgrade hadoop3 to
> version 3.2.1
> * https://jira.apache.org/jira/browse/AVRO-2726 Upgrade Jackson to
> version 2.10.2
>
> Please download, verify, and test. This vote will remain open for at least
> 72 hours. Given sufficient votes, I would like to close after noon UTC
> Wednesday, February
>  12th
>
> [ ] +1 Release this as Apache Avro 1.9.2
> [ ] +0
> [ ] -1 Do not release this because...
>
> Best regards, Ryan Skraba
>