[jira] [Commented] (AVRO-1586) Build against Hadoop 2
[ https://issues.apache.org/jira/browse/AVRO-1586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14616498#comment-14616498 ] Hudson commented on AVRO-1586: -- FAILURE: Integrated in AvroJava #522 (See [https://builds.apache.org/job/AvroJava/522/]) AVRO-1586. Build against Hadoop 2. (tomwhite: rev 1689626) * /avro/trunk/CHANGES.txt * /avro/trunk/build.sh * /avro/trunk/lang/java/mapred/pom.xml * /avro/trunk/lang/java/pom.xml * /avro/trunk/lang/java/tools/pom.xml * /avro/trunk/lang/java/trevni/avro/pom.xml Build against Hadoop 2 -- Key: AVRO-1586 URL: https://issues.apache.org/jira/browse/AVRO-1586 Project: Avro Issue Type: Task Components: build, java Affects Versions: 1.7.7 Reporter: Tom White Assignee: Tom White Fix For: 1.8.0 Attachments: AVRO-1586.patch Hadoop 2 has been available for a long time now so we should switch to build against it. With this change the avro-mapred and trevni-avro JARs would not work on Hadoop 1 clusters. See the mailing list discussion at http://s.apache.org/2pI. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (AVRO-1559) Drop support for Ruby 1.8
[ https://issues.apache.org/jira/browse/AVRO-1559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14616708#comment-14616708 ] Hudson commented on AVRO-1559: -- SUCCESS: Integrated in AvroJava #524 (See [https://builds.apache.org/job/AvroJava/524/]) AVRO-1559. Drop support for Ruby 1.8. Contributed by Willem van Bergen. (tomwhite: rev 1689660) * /avro/trunk/CHANGES.txt * /avro/trunk/lang/ruby/lib/avro/data_file.rb * /avro/trunk/lang/ruby/lib/avro/io.rb Drop support for Ruby 1.8 - Key: AVRO-1559 URL: https://issues.apache.org/jira/browse/AVRO-1559 Project: Avro Issue Type: Wish Affects Versions: 1.7.7 Reporter: Willem van Bergen Assignee: Willem van Bergen Fix For: 1.8.0 Attachments: AVRO-1559.patch - Ruby 1.8 is EOL, and is even security issues aren't addressed anymore. - It is also getting hard to set up Ruby 1.8 to run the tests (e.g. on a recent OSX, it won't compile without manual fiddling). - Handling character encodings in Ruby 1.9 is very different than Ruby 1.8. Supporting both at the same time adds a lot of overhead. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (AVRO-1694) Support for schema fingerprints in the Ruby library
[ https://issues.apache.org/jira/browse/AVRO-1694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14742759#comment-14742759 ] Hudson commented on AVRO-1694: -- SUCCESS: Integrated in AvroJava #546 (See [https://builds.apache.org/job/AvroJava/546/]) AVRO-1694. Ruby: Schema normaliation and fingerprints. Contributed by Daniel Schierbeck. * Avro::SchemaNormalization.to_parsing_form converts a schema to Parsing Canonical Form * support for MD5 and SHA256 fingerprints This closes #40 (busbey: rev 1702839) * /avro/trunk/lang/ruby/lib/avro.rb * /avro/trunk/lang/ruby/lib/avro/schema.rb * /avro/trunk/lang/ruby/lib/avro/schema_normalization.rb * /avro/trunk/lang/ruby/test/case_finder.rb * /avro/trunk/lang/ruby/test/test_fingerprints.rb * /avro/trunk/lang/ruby/test/test_schema_normalization.rb > Support for schema fingerprints in the Ruby library > --- > > Key: AVRO-1694 > URL: https://issues.apache.org/jira/browse/AVRO-1694 > Project: Avro > Issue Type: Wish > Components: ruby >Reporter: Daniel Schierbeck >Assignee: Daniel Schierbeck > Fix For: 1.7.8, 1.8.0, 1.9.0 > > Attachments: AVRO-1694.1.patch > > > There does not seem to be any support for generating schema fingerprints in > the Ruby library. In order to avoid inlining schemas in my Avro-encoded > messages I'd like to store them separately and instead write the fingerprint > in the Avro metadata, thus allowing a reader to fetch and cache the actual > schema from the schema registry. > In order for that to work, my Ruby writer needs to be able to actually > generate a fingerprint for a schema. > Is the Ruby library being actively maintained? I would be willing to work on > this myself if someone would review and merge the work. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (AVRO-1709) [Ruby] Ignore generated files
[ https://issues.apache.org/jira/browse/AVRO-1709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14741953#comment-14741953 ] Hudson commented on AVRO-1709: -- SUCCESS: Integrated in AvroJava #545 (See [https://builds.apache.org/job/AvroJava/545/]) AVRO-1709. Ruby: Ignore generated files. Contributed by Daniel Schierbeck. The data.avr file is generated every times the tests are run; Gemfile.lock is generated every time `bundle install` is run. This closes #45 (busbey: rev 1702593) * /avro/trunk/lang/ruby/.gitignore > [Ruby] Ignore generated files > - > > Key: AVRO-1709 > URL: https://issues.apache.org/jira/browse/AVRO-1709 > Project: Avro > Issue Type: Improvement >Reporter: Daniel Schierbeck >Assignee: Daniel Schierbeck > Fix For: 1.7.8, 1.8.0, 1.9.0 > > Attachments: AVRO-1709.1.patch > > > Neither data.avr nor Gemfile.lock should be committed to the repository – > adding them to .gitignore thus makes it easier to work on the Ruby library. > PR: https://github.com/apache/avro/pull/45 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (AVRO-1722) Fix licensing issues
[ https://issues.apache.org/jira/browse/AVRO-1722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047124#comment-15047124 ] Hudson commented on AVRO-1722: -- SUCCESS: Integrated in AvroJava #558 (See [https://builds.apache.org/job/AvroJava/558/]) AVRO-1722 ADDENDUM: Add last license doc changes, rat helper. (blue: rev 1718650) * trunk/NOTICE.txt * trunk/build.sh * trunk/lang/ruby/test/case_finder.rb > Fix licensing issues > > > Key: AVRO-1722 > URL: https://issues.apache.org/jira/browse/AVRO-1722 > Project: Avro > Issue Type: Task > Components: build >Affects Versions: 1.8.0 >Reporter: Ryan Blue >Assignee: Ryan Blue >Priority: Blocker > Fix For: 1.8.0 > > Attachments: AVRO-1722-ADDENDUM.1.patch, AVRO-1722.2.patch > > > The 1.8.0 release vote turned up a lot of licensing issues that need to be > fixed. We need to do a scrub of the licensing. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (AVRO-1767) Simplify union wrapping logic.
[ https://issues.apache.org/jira/browse/AVRO-1767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047613#comment-15047613 ] Hudson commented on AVRO-1767: -- SUCCESS: Integrated in AvroJava #559 (See [https://builds.apache.org/job/AvroJava/559/]) AVRO-1767: Fall back to unwrapped union values. Contributed by Matthieu Monsch. Previously, union wrapping during `type.clone` calls would be done in place of normal copy. Now it is done as a backup if a normal copy fails. This is more consistent with the documentation, and makes it much simpler to wrap nested unions. Other changes: + Add an optional argument to `type.getName` to expose built-in type names (useful to implement an "optional" logical type for example). + Document (and rename) `assertLogicalTypes` parsing option. + Tweak logical type validity check, enabling error hooks to work even when a logical type is valid for a subset of its underlying type's values (e.g. when defining an "even integer" type). Previously the path would have been correct but the type would have been that of the underlying one. (blue: rev 1718715) * trunk/CHANGES.txt * trunk/lang/js/doc/API.md * trunk/lang/js/lib/schemas.js * trunk/lang/js/test/test_schemas.js > Simplify union wrapping logic. > -- > > Key: AVRO-1767 > URL: https://issues.apache.org/jira/browse/AVRO-1767 > Project: Avro > Issue Type: Improvement > Components: javascript >Reporter: Matthieu Monsch >Assignee: Ryan Blue > Fix For: 1.8.0 > > Attachments: AVRO-1767.patch > > > Previously, union wrapping during `type.clone` calls would be done in place > of normal copy. Now it is done as a backup if a normal copy fails. This is > more consistent with the documentation, and makes it much simpler to wrap > nested unions. > See here for more information and examples: > https://github.com/mtth/avsc/issues/16 > Other changes: > + Add an optional argument to `type.getName` to expose built-in type names > (useful to implement an "optional" logical type for example). > + Document (and rename) `assertLogicalTypes` parsing option. > + Tweak logical type validity check, enabling error hooks to work even when a > logical type is valid for a subset of its underlying type's values (e.g. > when > defining an "even integer" type). Previously the path would have been > correct > but the type would have been that of the underlying one. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (AVRO-1765) Update node.js version in docker image
[
https://issues.apache.org/jira/browse/AVRO-1765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042196#comment-15042196
]
Hudson commented on AVRO-1765:
--
SUCCESS: Integrated in AvroJava #557 (See
[https://builds.apache.org/job/AvroJava/557/])
AVRO-1765: JS: Update node.js in docker to 4.x. (blue: rev 1718013)
* trunk/CHANGES.txt
* trunk/share/docker/Dockerfile
> Update node.js version in docker image
> --
>
> Key: AVRO-1765
> URL: https://issues.apache.org/jira/browse/AVRO-1765
> Project: Avro
> Issue Type: Task
> Components: docker, js
>Affects Versions: 1.8.0
>Reporter: Ryan Blue
>Assignee: Ryan Blue
> Fix For: 1.8.0
>
> Attachments: AVRO-1765.1.patch
>
>
> The docker image includes node.js version 0.10.29, which is too old to run
> the current set of JS unit tests. The latest stable version is 5.1.0 and the
> "mature and dependable" version is 4.2.2, so the version in docker (from
> ubuntu) is quite old. The install instructions for 4.2.2 aren't very
> difficult:
> {code}
> curl -sL https://deb.nodesource.com/setup_4.x | sudo -E bash -
> sudo apt-get install -y nodejs
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (AVRO-1731) Update LICENSE and NOTICE files included in C release artifacts
[ https://issues.apache.org/jira/browse/AVRO-1731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15038173#comment-15038173 ] Hudson commented on AVRO-1731: -- SUCCESS: Integrated in AvroJava #553 (See [https://builds.apache.org/job/AvroJava/553/]) AVRO-1731: C: Add LICENSE and NOTICE to binary distribution. (blue: rev 1717805) * trunk/CHANGES.txt * trunk/lang/c/CPackConfig.txt * trunk/lang/c/LICENSE * trunk/lang/c/NOTICE > Update LICENSE and NOTICE files included in C release artifacts > --- > > Key: AVRO-1731 > URL: https://issues.apache.org/jira/browse/AVRO-1731 > Project: Avro > Issue Type: Sub-task > Components: c >Affects Versions: 1.8.0 >Reporter: Ryan Blue >Assignee: Ryan Blue > Fix For: 1.8.0 > > Attachments: AVRO-1731.1.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (AVRO-1730) Update LICENSE and NOTICE files included in python and python3 release artifacts
[ https://issues.apache.org/jira/browse/AVRO-1730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15038175#comment-15038175 ] Hudson commented on AVRO-1730: -- SUCCESS: Integrated in AvroJava #553 (See [https://builds.apache.org/job/AvroJava/553/]) AVRO-1730: Python3: Add LICENSE and NOTICE to distribution. (blue: rev 1717814) * trunk/CHANGES.txt * trunk/lang/py3/README.txt * trunk/lang/py3/avro/LICENSE * trunk/lang/py3/avro/NOTICE * trunk/lang/py3/setup.py AVRO-1730: Python: Add LICENSE and NOTICE to distribution. (blue: rev 1717813) * trunk/lang/py/setup.py * trunk/lang/py/src/avro/LICENSE * trunk/lang/py/src/avro/NOTICE > Update LICENSE and NOTICE files included in python and python3 release > artifacts > > > Key: AVRO-1730 > URL: https://issues.apache.org/jira/browse/AVRO-1730 > Project: Avro > Issue Type: Sub-task > Components: python >Affects Versions: 1.8.0 >Reporter: Ryan Blue >Assignee: Ryan Blue > Fix For: 1.8.0 > > Attachments: AVRO-1730.1.diff > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (AVRO-1735) Update LICENSE and NOTICE files included in perl module
[ https://issues.apache.org/jira/browse/AVRO-1735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15038176#comment-15038176 ] Hudson commented on AVRO-1735: -- SUCCESS: Integrated in AvroJava #553 (See [https://builds.apache.org/job/AvroJava/553/]) AVRO-1735: Perl: Add LICENSE and NOTICE to distribution. (blue: rev 1717807) * trunk/CHANGES.txt * trunk/lang/perl/LICENSE * trunk/lang/perl/MANIFEST * trunk/lang/perl/NOTICE * trunk/lang/perl/NOTICE.txt > Update LICENSE and NOTICE files included in perl module > --- > > Key: AVRO-1735 > URL: https://issues.apache.org/jira/browse/AVRO-1735 > Project: Avro > Issue Type: Sub-task > Components: perl >Affects Versions: 1.8.0 >Reporter: Ryan Blue >Assignee: Ryan Blue > Fix For: 1.8.0 > > Attachments: AVRO-1735.1.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (AVRO-1736) Update LICENSE and NOTICE files included in php release artifacts
[ https://issues.apache.org/jira/browse/AVRO-1736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15038177#comment-15038177 ] Hudson commented on AVRO-1736: -- SUCCESS: Integrated in AvroJava #553 (See [https://builds.apache.org/job/AvroJava/553/]) AVRO-1736: PHP: Add LICENSE and NOTICE to distribution. (blue: rev 1717812) * trunk/CHANGES.txt * trunk/lang/php/LICENSE * trunk/lang/php/NOTICE * trunk/lang/php/build.sh > Update LICENSE and NOTICE files included in php release artifacts > - > > Key: AVRO-1736 > URL: https://issues.apache.org/jira/browse/AVRO-1736 > Project: Avro > Issue Type: Sub-task > Components: php >Affects Versions: 1.8.0 >Reporter: Ryan Blue >Assignee: Ryan Blue > Fix For: 1.8.0 > > Attachments: AVRO-1736.1.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (AVRO-1722) Fix licensing issues
[ https://issues.apache.org/jira/browse/AVRO-1722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15038431#comment-15038431 ] Hudson commented on AVRO-1722: -- SUCCESS: Integrated in AvroJava #555 (See [https://builds.apache.org/job/AvroJava/555/]) AVRO-1722 ADDENDUM: Java: Fix tests broken by adding licenses. The Java specific compiler tool's tests expect the file content to match exactly. Adding license headers broke the tests. This fix reverts the addition of a licenses and adds the test files to the RAT exclusion list. (blue: rev 1717830) * trunk/lang/java/tools/src/test/compiler/output-string/avro/examples/baseball/Player.java * trunk/lang/java/tools/src/test/compiler/output-string/avro/examples/baseball/Position.java * trunk/lang/java/tools/src/test/compiler/output/Player.java * trunk/lang/java/tools/src/test/compiler/output/Position.java * trunk/pom.xml > Fix licensing issues > > > Key: AVRO-1722 > URL: https://issues.apache.org/jira/browse/AVRO-1722 > Project: Avro > Issue Type: Task > Components: build >Affects Versions: 1.8.0 >Reporter: Ryan Blue >Assignee: Ryan Blue >Priority: Blocker > Fix For: 1.8.0 > > Attachments: AVRO-1722.2.patch > > > The 1.8.0 release vote turned up a lot of licensing issues that need to be > fixed. We need to do a scrub of the licensing. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (AVRO-1747) JavaScript implementation
[ https://issues.apache.org/jira/browse/AVRO-1747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15038745#comment-15038745 ] Hudson commented on AVRO-1747: -- SUCCESS: Integrated in AvroJava #556 (See [https://builds.apache.org/job/AvroJava/556/]) AVRO-1747: JavaScript: Add implementation. A few features: + Fast! Typically twice as fast as JSON with much smaller encodings. + Full Avro support, including recursive schemas, sort order, and evolution. + Serialization of arbitrary JavaScript objects via logical types. + Unopinionated 64-bit integer compatibility. + No dependencies, it even runs in the browser. The previous API is included with deprecation warnings (this adds `underscore` as a dependency). (blue: rev 1717850) * trunk/CHANGES.txt * trunk/lang/js/Gruntfile.js * trunk/lang/js/LICENSE * trunk/lang/js/NOTICE * trunk/lang/js/README * trunk/lang/js/README.md * trunk/lang/js/build.sh * trunk/lang/js/doc * trunk/lang/js/doc/API.md * trunk/lang/js/doc/Advanced-usage.md * trunk/lang/js/doc/Home.md * trunk/lang/js/etc * trunk/lang/js/etc/browser * trunk/lang/js/etc/browser/avro.js * trunk/lang/js/etc/browser/crypto.js * trunk/lang/js/etc/deprecated * trunk/lang/js/etc/deprecated/Gruntfile.js * trunk/lang/js/etc/deprecated/README * trunk/lang/js/etc/deprecated/test_validator.js * trunk/lang/js/etc/deprecated/validator.js * trunk/lang/js/lib/files.js * trunk/lang/js/lib/index.js * trunk/lang/js/lib/schemas.js * trunk/lang/js/lib/utils.js * trunk/lang/js/lib/validator.js * trunk/lang/js/package.json * trunk/lang/js/test/dat * trunk/lang/js/test/dat/Id.avsc * trunk/lang/js/test/dat/Person.avsc * trunk/lang/js/test/dat/person-10.avro * trunk/lang/js/test/dat/person-10.avro.raw * trunk/lang/js/test/dat/person-10.no-codec.avro * trunk/lang/js/test/test_files.js * trunk/lang/js/test/test_schemas.js * trunk/lang/js/test/test_utils.js * trunk/lang/js/test/validator.js > JavaScript implementation > - > > Key: AVRO-1747 > URL: https://issues.apache.org/jira/browse/AVRO-1747 > Project: Avro > Issue Type: Improvement > Components: javascript >Reporter: Matthieu Monsch >Assignee: Matthieu Monsch > Attachments: AVRO-1747.patch, AVRO-1747.patch, AVRO-1747.patch > > > Hello, > I'm not sure if there is still interest in a JavaScript implementation of the > Avro spec, or if this is the right place for this message (apologies if not), > but in case it's useful here is one: https://github.com/mtth/avsc > It's pretty fast, fully featured aside from protocols (AFAIK), and runs in > the browser. > Disclaimer: I wrote this library. (I initially searched around for existing > implementations, and even saw a few tickets on this board about JavaScript > decoders, but couldn't find one to support the schemas I have to process.) > Best, > -Matthieu -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (AVRO-1722) Fix licensing issues
[ https://issues.apache.org/jira/browse/AVRO-1722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15038274#comment-15038274 ] Hudson commented on AVRO-1722: -- FAILURE: Integrated in AvroJava #554 (See [https://builds.apache.org/job/AvroJava/554/]) AVRO-1722: Update root LICENSE.txt and NOTICE.txt. This updates the POM to use the Maven RAT integration and updates the LICENSE and NOTICE files for issues that update found. (blue: rev 1717817) * trunk/CHANGES.txt * trunk/LICENSE.txt * trunk/NOTICE.txt * trunk/doc/build.xml * trunk/doc/examples/example.py * trunk/doc/examples/java-example/pom.xml * trunk/doc/examples/java-example/src/main/java/example/GenericMain.java * trunk/doc/examples/java-example/src/main/java/example/SpecificMain.java * trunk/doc/examples/mr-example/pom.xml * trunk/doc/examples/mr-example/src/main/java/example/GenerateData.java * trunk/doc/forrest.properties * trunk/lang/c++/COPYING * trunk/lang/c++/Doxyfile * trunk/lang/c/COPYING * trunk/lang/c/build.sh * trunk/lang/c/tests/test_cpp.cpp * trunk/lang/c/tests/test_interop_data.c * trunk/lang/c/tests/test_refcount.c * trunk/lang/c/version.sh * trunk/lang/csharp/Avro.dox * trunk/lang/csharp/Avro.nunit * trunk/lang/java/avro/src/test/java/org/apache/avro/FooBarSpecificRecord.java * trunk/lang/java/avro/src/test/java/org/apache/avro/TypeEnum.java * trunk/lang/java/mapred/src/test/java/org/apache/avro/hadoop/io/TestAvroSerialization.java * trunk/lang/java/mapred/src/test/resources/log4j.properties * trunk/lang/java/tools/src/test/compiler/output-string/avro/examples/baseball/Player.java * trunk/lang/java/tools/src/test/compiler/output-string/avro/examples/baseball/Position.java * trunk/lang/java/tools/src/test/compiler/output/Player.java * trunk/lang/java/tools/src/test/compiler/output/Position.java * trunk/lang/perl/MANIFEST * trunk/lang/perl/MANIFEST.SKIP * trunk/lang/py/src/avro/tether/__init__.py * trunk/pom.xml * trunk/share/rat-excludes.txt > Fix licensing issues > > > Key: AVRO-1722 > URL: https://issues.apache.org/jira/browse/AVRO-1722 > Project: Avro > Issue Type: Task > Components: build >Affects Versions: 1.8.0 >Reporter: Ryan Blue >Assignee: Ryan Blue >Priority: Blocker > Fix For: 1.8.0 > > > The 1.8.0 release vote turned up a lot of licensing issues that need to be > fixed. We need to do a scrub of the licensing. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (AVRO-1584) Json output doesn't generate base64 for byte arrays
[
https://issues.apache.org/jira/browse/AVRO-1584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15057147#comment-15057147
]
Hudson commented on AVRO-1584:
--
SUCCESS: Integrated in AvroJava #560 (See
[https://builds.apache.org/job/AvroJava/560/])
AVRO-1584: Java: Escape characters not allowed in JSON in toString.
>From the JSON spec: "All Unicode characters may be placed within the
quotation marks except for the characters that must be escaped:
quotation mark, reverse solidus, and the control characters (U+
through U+001F)."
This uses the existing string escape function. (blue: rev 1720055)
* trunk/CHANGES.txt
* trunk/lang/java/avro/src/main/java/org/apache/avro/generic/GenericData.java
*
trunk/lang/java/avro/src/test/java/org/apache/avro/generic/TestGenericData.java
> Json output doesn't generate base64 for byte arrays
> ---
>
> Key: AVRO-1584
> URL: https://issues.apache.org/jira/browse/AVRO-1584
> Project: Avro
> Issue Type: Bug
> Components: java
>Affects Versions: 1.7.7
> Environment: Pure java.
>Reporter: Christophe Lorenz
> Attachments: AVRO-1584-Jackson-Base64-Default-Variant.patch,
> AVRO-1584.1.patch, AVRO-1584.patch
>
>
> The Json output of java generated code doesn't correctly encode byte arrays.
> Using this simple schema :
> {"namespace": "example.avro",
> "type": "record",
> "name": "ByteArrayEncoding",
> "fields": [ {"name": "data", "type": "bytes"} ]
> }
> The toString()
> System.out.println(new ByteArrayEncoding(ByteBuffer.wrap(new
> byte[]{0,31,65,66,67,(byte)255,(byte)182})));
> Returns raw bytes to string in the json :
> {"data": {"bytes": " ABC??"}}
> As a byte array is not tied to be a valid string, it should be converted back
> and forth to Base64 like other Json implementations :
> {"data": {"bytes": "AB9BQkP/tg=="}}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (AVRO-1728) Update LICENSE and NOTICE files included in Java binaries
[ https://issues.apache.org/jira/browse/AVRO-1728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15059106#comment-15059106 ] Hudson commented on AVRO-1728: -- SUCCESS: Integrated in AvroJava #561 (See [https://builds.apache.org/job/AvroJava/561/]) AVRO-1728: Java: Add LICENSE and NOTICE files to jars. (blue: rev 1720272) * trunk/LICENSE.txt * trunk/lang/java/compiler/pom.xml * trunk/lang/java/compiler/src/main/resources * trunk/lang/java/compiler/src/main/resources/META-INF * trunk/lang/java/compiler/src/main/resources/META-INF/LICENSE * trunk/lang/java/mapred/src/main/resources * trunk/lang/java/mapred/src/main/resources/META-INF * trunk/lang/java/mapred/src/main/resources/META-INF/NOTICE * trunk/lang/java/pom.xml * trunk/lang/java/tools/pom.xml * trunk/lang/java/tools/src/main/javadoc * trunk/lang/java/tools/src/main/javadoc/META-INF * trunk/lang/java/tools/src/main/javadoc/META-INF/LICENSE * trunk/lang/java/tools/src/main/javadoc/META-INF/NOTICE * trunk/lang/java/tools/src/main/resources * trunk/lang/java/tools/src/main/resources/META-INF * trunk/lang/java/tools/src/main/resources/META-INF/LICENSE * trunk/lang/java/tools/src/main/resources/META-INF/LICENSE.txt * trunk/lang/java/tools/src/main/resources/META-INF/NOTICE * trunk/lang/java/tools/src/main/resources/META-INF/NOTICE.txt * trunk/lang/java/tools/src/main/resources/META-INF/cddl-1.0.text * trunk/lang/java/tools/src/main/resources/META-INF/cddl-1.1.text * trunk/lang/java/tools/src/main/resources/META-INF/mpl-2.0.text * trunk/lang/java/tools/src/test/resources * trunk/lang/java/tools/src/test/resources/META-INF * trunk/lang/java/tools/src/test/resources/META-INF/LICENSE * trunk/lang/java/tools/src/test/resources/META-INF/NOTICE * trunk/pom.xml > Update LICENSE and NOTICE files included in Java binaries > - > > Key: AVRO-1728 > URL: https://issues.apache.org/jira/browse/AVRO-1728 > Project: Avro > Issue Type: Sub-task > Components: java >Affects Versions: 1.8.0 >Reporter: Ryan Blue >Assignee: Ryan Blue > Fix For: 1.8.0 > > Attachments: AVRO-1728.1.patch, AVRO-1728.2.patch, AVRO-1728.3.patch, > AVRO-1728.4.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (AVRO-1772) Ruby: load error in rubygem when loading schema normalization
[
https://issues.apache.org/jira/browse/AVRO-1772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15085496#comment-15085496
]
Hudson commented on AVRO-1772:
--
SUCCESS: Integrated in AvroJava #564 (See
[https://builds.apache.org/job/AvroJava/564/])
AVRO-1772. Ruby: load error in rubygem when loading schema normalization.
Contributed by blue and martinkl. (tomwhite: rev 1723294)
* trunk/CHANGES.txt
* trunk/lang/ruby/Manifest
* trunk/lang/ruby/build.sh
> Ruby: load error in rubygem when loading schema normalization
> -
>
> Key: AVRO-1772
> URL: https://issues.apache.org/jira/browse/AVRO-1772
> Project: Avro
> Issue Type: Bug
> Components: ruby
>Affects Versions: 1.8.0
>Reporter: Ryan Blue
>Assignee: Ryan Blue
> Fix For: 1.8.0
>
> Attachments: AVRO-1772.1.patch, AVRO-1772.2.patch
>
>
> [~martinkl] found this bug while validating the 1.8.0 release:
> {code}
> kernel_require.rb:54:in `require': cannot load such file --
> avro/schema_normalization (LoadError)
> {code}
> {quote}
> It seems that the following two files, which are present in the source, are
> missing from the gem file:
> lang/ruby/lib/avro/schema_normalization.rb
> lang/ruby/test/case_finder.rb
> {quote}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (AVRO-1770) Python 3 overwrites custom README.txt
[ https://issues.apache.org/jira/browse/AVRO-1770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15085497#comment-15085497 ] Hudson commented on AVRO-1770: -- SUCCESS: Integrated in AvroJava #564 (See [https://builds.apache.org/job/AvroJava/564/]) AVRO-1770. Python 3 overwrites custom README.txt. Contributed by blue. (tomwhite: rev 1723287) * trunk/CHANGES.txt * trunk/lang/py3/setup.py > Python 3 overwrites custom README.txt > - > > Key: AVRO-1770 > URL: https://issues.apache.org/jira/browse/AVRO-1770 > Project: Avro > Issue Type: Bug > Components: python >Affects Versions: 1.8.0 >Reporter: Ryan Blue >Assignee: Ryan Blue > Fix For: 1.8.0 > > Attachments: AVRO-1770.1.patch > > > Sean found while validating 1.8.0 rc1 that the py3 README is being changed by > the release process. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (AVRO-1771) Add LICENSE and NOTICE to avro-doc artifact
[ https://issues.apache.org/jira/browse/AVRO-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15085498#comment-15085498 ] Hudson commented on AVRO-1771: -- SUCCESS: Integrated in AvroJava #564 (See [https://builds.apache.org/job/AvroJava/564/]) AVRO-1771. Add LICENSE and NOTICE to avro-doc artifact. Contributed by blue. (tomwhite: rev 1723292) * trunk/CHANGES.txt * trunk/build.sh * trunk/doc/LICENSE * trunk/doc/NOTICE > Add LICENSE and NOTICE to avro-doc artifact > --- > > Key: AVRO-1771 > URL: https://issues.apache.org/jira/browse/AVRO-1771 > Project: Avro > Issue Type: Sub-task > Components: build >Affects Versions: 1.8.0 >Reporter: Ryan Blue >Assignee: Ryan Blue > Fix For: 1.8.0 > > Attachments: AVRO-1771.1.patch > > > Sean noticed while validating the 1.8.0 release that the avro-doc tarball > doesn't include LICENSE and NOTICE. These should be mostly copies of the > source license and notice, minus projects included for the Avro build. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (AVRO-1560) SNAPPY_INCLUDE_DIR not accounted in CMakeLists.txt
[
https://issues.apache.org/jira/browse/AVRO-1560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075214#comment-15075214
]
Hudson commented on AVRO-1560:
--
SUCCESS: Integrated in AvroJava #563 (See
[https://builds.apache.org/job/AvroJava/563/])
AVRO-1560: C: Fix build for custom libsnappy location. Contributed by Ujjwal.
(martinkl: rev 1722366)
* trunk/CHANGES.txt
* trunk/lang/c/CMakeLists.txt
> SNAPPY_INCLUDE_DIR not accounted in CMakeLists.txt
> --
>
> Key: AVRO-1560
> URL: https://issues.apache.org/jira/browse/AVRO-1560
> Project: Avro
> Issue Type: Bug
> Components: c
>Affects Versions: 1.7.7
>Reporter: Ujjwal
>Priority: Minor
> Labels: build
> Fix For: 1.8.0
>
> Attachments: AVRO-1560.patch
>
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> The current CMakeLists.txt does not account for Snappy include folders
> causing the compilation to fail when a custom snappy location is provided
> using -DSNAPPY_ROOT_DIR
> e.g .
> {code:xml}
> cmake avro-c-1.7.7 -DSNAPPY_ROOT_DIR=${SNAPPY_INSTALL_DIR}
> {code}
> In
> https://github.com/apache/avro/blob/release-1.7.7/lang/c/CMakeLists.txt#L143
> we should include
> {code:xml}
> include_directories(${SNAPPY_INCLUDE_DIR})
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (AVRO-1617) C library: schema_record_equal can return true if schemas have different # of fields
[ https://issues.apache.org/jira/browse/AVRO-1617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075213#comment-15075213 ] Hudson commented on AVRO-1617: -- SUCCESS: Integrated in AvroJava #563 (See [https://builds.apache.org/job/AvroJava/563/]) AVRO-1617: C: Fix equality checking of record schemas. Contributed by Skye Wanderman-Milne. (martinkl: rev 1722361) * trunk/CHANGES.txt * trunk/lang/c/src/schema_equal.c > C library: schema_record_equal can return true if schemas have different # of > fields > > > Key: AVRO-1617 > URL: https://issues.apache.org/jira/browse/AVRO-1617 > Project: Avro > Issue Type: Bug > Components: c >Affects Versions: 1.7.7 >Reporter: Skye Wanderman-Milne >Assignee: Skye Wanderman-Milne > Fix For: 1.8.0 > > Attachments: AVRO-1617.patch > > > schema_record_equal(a, b) will return true if schema b contains more fields > than schema a, as long as b contains all of a's fields. It should return > false in this case. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (AVRO-1572) Avro-C misses EOF on 4K boundary
[ https://issues.apache.org/jira/browse/AVRO-1572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075212#comment-15075212 ] Hudson commented on AVRO-1572: -- SUCCESS: Integrated in AvroJava #563 (See [https://builds.apache.org/job/AvroJava/563/]) AVRO-1572: C: Fix EOF handling on data files that are multiples of 4096 bytes. Contributed by Ben Walsh. (martinkl: rev 1722359) * trunk/CHANGES.txt * trunk/lang/c/src/datafile.c * trunk/lang/c/tests/CMakeLists.txt * trunk/lang/c/tests/test_avro_1572.c > Avro-C misses EOF on 4K boundary > > > Key: AVRO-1572 > URL: https://issues.apache.org/jira/browse/AVRO-1572 > Project: Avro > Issue Type: Bug > Components: c >Reporter: Ben Walsh >Assignee: Martin Kleppmann > Fix For: 1.8.0 > > Attachments: AVRO-1572.patch > > > As noted in AVRO-1405, Avro C is still missing EOF in the case that the sync > section ends exactly on a 4096 byte boundary (4096 bytes is the buffer size > used by the reader). > I have fixed this bug (the suggested fix for AVRO-1364 actually works fine). > Also I added some more extensive testing. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (AVRO-1754) C++ ValiditingDecoder handles null incorrectly
[
https://issues.apache.org/jira/browse/AVRO-1754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029212#comment-15029212
]
Hudson commented on AVRO-1754:
--
SUCCESS: Integrated in AvroJava #552 (See
[https://builds.apache.org/job/AvroJava/552/])
AVRO-1754. C++ ValiditingDecoder handles null incorrectly (thiru: rev 1716757)
* trunk/CHANGES.txt
* trunk/lang/c++/impl/parsing/ValidatingCodec.cc
> C++ ValiditingDecoder handles null incorrectly
> --
>
> Key: AVRO-1754
> URL: https://issues.apache.org/jira/browse/AVRO-1754
> Project: Avro
> Issue Type: Bug
> Components: c++
>Reporter: John McClean
>Assignee: John McClean
> Fix For: 1.8.0
>
> Attachments: AVRO-1754.patch
>
>
> When decoding null, the ValidatingDecoder does not call the underlying
> 'decodeNull' method. The result is that the next field decoded causes an
> exception.
> For example, if this json
> {quote}
> \{"a":null,"b":"bar"}
> {quote}
> is decoded with this schema
> {quote}
> \{
> "name": "foo",
> "type": "record",
> "fields": [
> \{ "name": "a", "type": ["null", "string"] },
> \{ "name": "b", "type": "string" }
> ]
> }
> {quote}
> it throws an exception with the message "Invalid operation. Expected: String
> got Null". This happens when 'b' is being decoded. I'll attach a patch.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (AVRO-1755) avro-mapred should not depend on avro-ipc:test
[
https://issues.apache.org/jira/browse/AVRO-1755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15026859#comment-15026859
]
Hudson commented on AVRO-1755:
--
SUCCESS: Integrated in AvroJava #551 (See
[https://builds.apache.org/job/AvroJava/551/])
AVRO-1755. Java: avro-mapred should not depend on avro-ipc:test. Contributed by
Clément MAHTIEU. (tomwhite: rev 1716422)
* trunk/CHANGES.txt
* trunk/lang/java/mapred/pom.xml
> avro-mapred should not depend on avro-ipc:test
> --
>
> Key: AVRO-1755
> URL: https://issues.apache.org/jira/browse/AVRO-1755
> Project: Avro
> Issue Type: Bug
> Components: java
>Affects Versions: 1.7.7
>Reporter: Clément MAHTIEU
>Assignee: Clément MAHTIEU
>Priority: Minor
> Fix For: 1.8.0
>
> Attachments: AVRO-1755.patch
>
>
> avro-ipc:test is used by some avro-mapred tests and it thus declared as a
> dependency in the POM file. However, its scope is declared as compile rather
> than test.
> {code}
> $ mvn dependency:tree -Dscope=compile -Dincludes=org.apache.avro
> [...]
> [INFO] --- maven-dependency-plugin:2.8:tree (default-cli) @ avro-mapred ---
> [INFO] org.apache.avro:avro-mapred:bundle:1.9.0-SNAPSHOT
> [INFO] +- org.apache.avro:avro-ipc:jar:1.9.0-SNAPSHOT:compile
> [INFO] | \- org.apache.avro:avro:jar:1.9.0-SNAPSHOT:compile
> [INFO] \- org.apache.avro:avro-ipc:jar:tests:1.9.0-SNAPSHOT:compile
> {code}
> It seems unfortunate to ship this extra JAR to every avro-mapred client.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (AVRO-1725) Enum schema exhibits same restriction to enum symbols as to names
[ https://issues.apache.org/jira/browse/AVRO-1725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15092723#comment-15092723 ] Hudson commented on AVRO-1725: -- SUCCESS: Integrated in AvroJava #565 (See [https://builds.apache.org/job/AvroJava/565/]) AVRO-1725. Docs: clarify restrictions on enum symbols. (martinkl: rev 1724129) * trunk/CHANGES.txt * trunk/doc/src/content/xdocs/spec.xml > Enum schema exhibits same restriction to enum symbols as to names > - > > Key: AVRO-1725 > URL: https://issues.apache.org/jira/browse/AVRO-1725 > Project: Avro > Issue Type: Bug > Components: java >Affects Versions: 1.7.7 >Reporter: Nikita Makeev > Fix For: 1.8.0 > > Attachments: AVRO-1725.patch > > > EnumSchema class in org.apache.avro.Schema has the following code: > for (String symbol : symbols) > if (ordinals.put(validateName(symbol), i++) != null) > which validates enum symbols using validateName() which makes impossible to > use symbols that are not conforming to standard for real names. > That prohibits using of symbols like "" (empty string) or anything starting > with number which does not seem to be intended. > I guess this place requires either some another type of validation or no > validation at all. Can provide a patch for both cases. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (AVRO-1780) Avro tools jar fails with NPE
[
https://issues.apache.org/jira/browse/AVRO-1780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15094358#comment-15094358
]
Hudson commented on AVRO-1780:
--
SUCCESS: Integrated in AvroJava #567 (See
[https://builds.apache.org/job/AvroJava/567/])
AVRO-1780: Java: Fix NPE in tools. Contributed by Tom White.
Changes for AVRO-1728 moved NOTICE, which was used to create the
no-argument output for Java's avro-tools. Using the new location fixed
the NPE and this also includes an update to show just the top of NOTICE
since it is now much longer. (blue: rev 1724287)
* trunk/lang/java/tools/src/main/java/org/apache/avro/tool/Main.java
> Avro tools jar fails with NPE
> -
>
> Key: AVRO-1780
> URL: https://issues.apache.org/jira/browse/AVRO-1780
> Project: Avro
> Issue Type: Bug
> Components: java
>Affects Versions: 1.8.0
>Reporter: Sean Busbey
>Assignee: Tom White
>Priority: Blocker
> Fix For: 1.8.0
>
> Attachments: AVRO-1780.patch
>
>
> following our license/notice updates, teh avro-tools jar fails with a NPE
> because it wants to print out a NOTICE.txt in the root of the jar.
> {code}
> busbey$ java -jar avro-tools-1.8.0.jar
> Version 1.8.0 of Exception in thread "main" java.lang.NullPointerException
> at org.apache.avro.tool.Main.printStream(Main.java:105)
> at org.apache.avro.tool.Main.run(Main.java:92)
> at org.apache.avro.tool.Main.main(Main.java:74)
> busbey$ java -jar avro-tools-1.8.0.jar --help
> Version 1.8.0 of Exception in thread "main" java.lang.NullPointerException
> at org.apache.avro.tool.Main.printStream(Main.java:105)
> at org.apache.avro.tool.Main.run(Main.java:92)
> at org.apache.avro.tool.Main.main(Main.java:74)
> {code}
> We should probably not print the entire NOTICE unless a cli arg is given,
> since it is much bigger now.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (AVRO-1728) Update LICENSE and NOTICE files included in Java binaries
[ https://issues.apache.org/jira/browse/AVRO-1728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15094357#comment-15094357 ] Hudson commented on AVRO-1728: -- SUCCESS: Integrated in AvroJava #567 (See [https://builds.apache.org/job/AvroJava/567/]) AVRO-1780: Java: Fix NPE in tools. Contributed by Tom White. Changes for AVRO-1728 moved NOTICE, which was used to create the no-argument output for Java's avro-tools. Using the new location fixed the NPE and this also includes an update to show just the top of NOTICE since it is now much longer. (blue: rev 1724287) * trunk/lang/java/tools/src/main/java/org/apache/avro/tool/Main.java > Update LICENSE and NOTICE files included in Java binaries > - > > Key: AVRO-1728 > URL: https://issues.apache.org/jira/browse/AVRO-1728 > Project: Avro > Issue Type: Sub-task > Components: java >Affects Versions: 1.8.0 >Reporter: Ryan Blue >Assignee: Ryan Blue > Fix For: 1.8.0 > > Attachments: AVRO-1728.1.patch, AVRO-1728.2.patch, AVRO-1728.3.patch, > AVRO-1728.4.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (AVRO-1781) Schema.parse is not thread safe
[
https://issues.apache.org/jira/browse/AVRO-1781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15096788#comment-15096788
]
Hudson commented on AVRO-1781:
--
SUCCESS: Integrated in AvroJava #568 (See
[https://builds.apache.org/job/AvroJava/568/])
AVRO-1781: Use Guava for a thread-safe weak identity cache.
This adds avro-guava-dependencies to minimize just Guava classes that
are shaded without minimizing classes from other dependencies. This
filtered artifact is then shaded and relocated in the avro module to
avoid leaking Guava classes to downstream consumers. (blue: rev 1724473)
* trunk/CHANGES.txt
* trunk/lang/java/avro/pom.xml
* trunk/lang/java/avro/src/main/java/org/apache/avro/LogicalTypes.java
* trunk/lang/java/avro/src/main/resources
* trunk/lang/java/avro/src/main/resources/META-INF
* trunk/lang/java/avro/src/main/resources/META-INF/LICENSE
* trunk/lang/java/guava
* trunk/lang/java/guava/pom.xml
* trunk/lang/java/guava/src
* trunk/lang/java/guava/src/main
* trunk/lang/java/guava/src/main/java
* trunk/lang/java/guava/src/main/java/org
* trunk/lang/java/guava/src/main/java/org/apache
* trunk/lang/java/guava/src/main/java/org/apache/avro
* trunk/lang/java/guava/src/main/java/org/apache/avro/GuavaClasses.java
* trunk/lang/java/guava/src/main/resources
* trunk/lang/java/guava/src/main/resources/META-INF
* trunk/lang/java/guava/src/main/resources/META-INF/LICENSE
* trunk/lang/java/mapred/pom.xml
* trunk/lang/java/pom.xml
* trunk/lang/java/tools/src/main/resources/META-INF/LICENSE
> Schema.parse is not thread safe
> ---
>
> Key: AVRO-1781
> URL: https://issues.apache.org/jira/browse/AVRO-1781
> Project: Avro
> Issue Type: Bug
> Components: java
>Affects Versions: 1.8.0
>Reporter: Sean Busbey
>Priority: Blocker
> Fix For: 1.8.0
>
> Attachments: AVRO-1781.1.patch, AVRO-1781.2.patch
>
>
> Post AVRO-1497, Schema.parse calls {{LogicalTypes.fromSchemaIgnoreInvalid}}
> on any schema that is expressed as a JSON object (anything except bare
> primitives).
> That static method relies on a static cache based on WeakIdentityHashMap
> (WIHM).
> WIHM clearly states that it isn't threadsafe
> [ref|https://github.com/apache/avro/blob/branch-1.8/lang/java/avro/src/main/java/org/apache/avro/util/WeakIdentityHashMap.java#L42]
> {code}
> *
> * Note that this implementation is not synchronized.
> *
> */
> public class WeakIdentityHashMap implements Map {
> {code}
> All of the Schema.Parser instances use that same static Schema.parse method.
> The end result is that as-is it's only safe to have a single thread parsing
> schemas in a given JVM.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (AVRO-1782) Test failures in Ruby 2.1/2.2
[
https://issues.apache.org/jira/browse/AVRO-1782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15097053#comment-15097053
]
Hudson commented on AVRO-1782:
--
SUCCESS: Integrated in AvroJava #569 (See
[https://builds.apache.org/job/AvroJava/569/])
AVRO-1782. Ruby: Fix unit test failures in new versions of Ruby. (martinkl: rev
1724508)
* trunk/CHANGES.txt
* trunk/lang/ruby/lib/avro/schema_normalization.rb
* trunk/lang/ruby/test/case_finder.rb
> Test failures in Ruby 2.1/2.2
> -
>
> Key: AVRO-1782
> URL: https://issues.apache.org/jira/browse/AVRO-1782
> Project: Avro
> Issue Type: Bug
> Components: ruby
>Affects Versions: 1.7.7
>Reporter: Martin Kleppmann
> Fix For: 1.8.0
>
> Attachments: AVRO-1782.patch
>
>
> When running the Avro Ruby implementation's test suite in Ruby 2.1 or 2.2, I
> get several test failures. The distinct errors are:
> {code}
> NameError: uninitialized constant Avro::SchemaNormalization::JSON
> avro/lang/ruby/lib/avro/schema_normalization.rb:28:in `to_parsing_form'
> {code}
> and
> {code}
> TestSchemaNormalization#test_shared_dataset:
> NameError: uninitialized constant CaseFinder::StringScanner
> /Users/martin/Applications/avro/lang/ruby/test/case_finder.rb:30:in
> `initialize'
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (AVRO-1760) Thread scalability problem with the use of SynchronizedMap
[ https://issues.apache.org/jira/browse/AVRO-1760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105184#comment-15105184 ] Hudson commented on AVRO-1760: -- SUCCESS: Integrated in AvroJava #570 (See [https://builds.apache.org/job/AvroJava/570/]) AVRO-1760. Java: Thread scalability problem with the use of SynchronizedMap (tomwhite: rev 1725220) * trunk/CHANGES.txt * trunk/lang/java/avro/src/main/java/org/apache/avro/generic/GenericData.java > Thread scalability problem with the use of SynchronizedMap > -- > > Key: AVRO-1760 > URL: https://issues.apache.org/jira/browse/AVRO-1760 > Project: Avro > Issue Type: Improvement > Components: java >Affects Versions: 1.7.4, 1.7.5, 1.7.6, 1.7.7, 1.8.0, 1.8.1, 1.9.0 >Reporter: Mulugeta Mammo >Assignee: Tom White >Priority: Critical > Labels: patch, performance > Fix For: 1.8.0 > > Attachments: AVRO-1760.patch, AVRO-1760.patch, AVRO-1760.patch, > AVRO-1760.pdf > > > While running Adam Genomics (which uses Avro) on Apache Spark, we discovered > that threads (tasks in Spark Context) block in Avro while executing the > getDefaultValue(Field field) method in > https://github.com/apache/avro/blob/trunk/lang/java/avro/src/main/java/org/apache/avro/generic/GenericData.java -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (AVRO-1663) C Library does not handle enum's namespace
[
https://issues.apache.org/jira/browse/AVRO-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15107651#comment-15107651
]
Hudson commented on AVRO-1663:
--
SUCCESS: Integrated in AvroJava #571 (See
[https://builds.apache.org/job/AvroJava/571/])
AVRO-1663. C: Fix handling of namespaces for enum and fixed types. (martinkl:
rev 1725614)
* trunk/CHANGES.txt
* trunk/lang/c/src/allocation.c
* trunk/lang/c/src/avro/allocation.h
* trunk/lang/c/src/avro/schema.h
* trunk/lang/c/src/schema.c
* trunk/lang/c/src/schema.h
* trunk/lang/c/src/schema_equal.c
* trunk/lang/c/tests/schema_tests/pass/namespace_enum
* trunk/lang/c/tests/schema_tests/pass/namespace_fixed
* trunk/lang/c/tests/schema_tests/pass/namespace_fullname
> C Library does not handle enum's namespace
> --
>
> Key: AVRO-1663
> URL: https://issues.apache.org/jira/browse/AVRO-1663
> Project: Avro
> Issue Type: Bug
> Components: c
>Affects Versions: 1.7.7
>Reporter: Thomas Sanchez
>Assignee: Martin Kleppmann
> Fix For: 1.8.0
>
> Attachments: AVRO-1663-2.patch, AVRO-1663-3.patch, AVRO-1663-4.patch,
> AVRO-1663.patch
>
>
> {code}{
> "type": "record",
> "name": "EventName",
> "namespace": "com.company.avro.schemas",
> "fields": [
> {"name": "eventname_model",
> "type": {
>"type": "enum",
>"namespace": "com.company.models",
>"name": "EventName",
>"symbols": [""]
> }
> }
> ]
> }
> {code}
> Such a schema is perfectly valid but the C library does no handle it because
> it does not parse the namespace field.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (AVRO-1775) Running unit tests on Ruby 2.2
[
https://issues.apache.org/jira/browse/AVRO-1775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15107652#comment-15107652
]
Hudson commented on AVRO-1775:
--
SUCCESS: Integrated in AvroJava #571 (See
[https://builds.apache.org/job/AvroJava/571/])
AVRO-1775. Ruby: Use test-unit gem for running tests. (martinkl: rev 1725625)
* trunk/CHANGES.txt
* trunk/lang/ruby/Gemfile
> Running unit tests on Ruby 2.2
> --
>
> Key: AVRO-1775
> URL: https://issues.apache.org/jira/browse/AVRO-1775
> Project: Avro
> Issue Type: Bug
> Components: ruby
>Reporter: Martin Kleppmann
> Fix For: 1.8.0
>
> Attachments: AVRO-1775-1.patch
>
>
> Ruby 2.2 [removed the test/unit framework from the standard
> library|https://bugs.ruby-lang.org/issues/9711#note-12]. As the Avro Ruby
> implementation uses it for its tests, we need to add a dependency on the
> {{test-unit}} gem in order to run the tests in Ruby 2.2.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (AVRO-1781) Schema.parse is not thread safe
[
https://issues.apache.org/jira/browse/AVRO-1781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15107993#comment-15107993
]
Hudson commented on AVRO-1781:
--
SUCCESS: Integrated in AvroJava #572 (See
[https://builds.apache.org/job/AvroJava/572/])
AVRO-1781 ADDENDUM: Remove LogicalTypes cache.
This cache maps a Schema to its corresponding LogicalType that has been
constructed from the Schema's properties, by object identity. This is no
longer needed now that the LogicalType is set on the schema instance
when it is parsed. The cache was necessary when we were trying to avoid
all changes to the Schema class. (blue: rev 1725668)
* trunk/lang/java/avro/src/main/java/org/apache/avro/LogicalTypes.java
> Schema.parse is not thread safe
> ---
>
> Key: AVRO-1781
> URL: https://issues.apache.org/jira/browse/AVRO-1781
> Project: Avro
> Issue Type: Bug
> Components: java
>Affects Versions: 1.8.0
>Reporter: Sean Busbey
>Assignee: Ryan Blue
>Priority: Blocker
> Fix For: 1.8.0
>
> Attachments: AVRO-1781-ADDENDUM.1.patch, AVRO-1781-ADDENDUM.2.patch,
> AVRO-1781.1.patch, AVRO-1781.2.patch
>
>
> Post AVRO-1497, Schema.parse calls {{LogicalTypes.fromSchemaIgnoreInvalid}}
> on any schema that is expressed as a JSON object (anything except bare
> primitives).
> That static method relies on a static cache based on WeakIdentityHashMap
> (WIHM).
> WIHM clearly states that it isn't threadsafe
> [ref|https://github.com/apache/avro/blob/branch-1.8/lang/java/avro/src/main/java/org/apache/avro/util/WeakIdentityHashMap.java#L42]
> {code}
> *
> * Note that this implementation is not synchronized.
> *
> */
> public class WeakIdentityHashMap implements Map {
> {code}
> All of the Schema.Parser instances use that same static Schema.parse method.
> The end result is that as-is it's only safe to have a single thread parsing
> schemas in a given JVM.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (AVRO-1769) Depend on external libjansson instead of a bundled copy
[ https://issues.apache.org/jira/browse/AVRO-1769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15107650#comment-15107650 ] Hudson commented on AVRO-1769: -- SUCCESS: Integrated in AvroJava #571 (See [https://builds.apache.org/job/AvroJava/571/]) AVRO-1769. C: Use operating system's libjansson instead of bundling it with Avro. Contributed by Magnus Edenhill. (martinkl: rev 1725610) * trunk/CHANGES.txt * trunk/LICENSE.txt * trunk/lang/c/CMakeLists.txt * trunk/lang/c/INSTALL * trunk/lang/c/LICENSE * trunk/lang/c/README.maintaining_win32.txt * trunk/lang/c/docs/index.txt * trunk/lang/c/jansson * trunk/lang/c/src/CMakeLists.txt * trunk/lang/c/tests/test_avro_data.c * trunk/share/docker/Dockerfile > Depend on external libjansson instead of a bundled copy > --- > > Key: AVRO-1769 > URL: https://issues.apache.org/jira/browse/AVRO-1769 > Project: Avro > Issue Type: Improvement > Components: c >Affects Versions: 1.7.7 >Reporter: Martin Kleppmann >Assignee: Martin Kleppmann > Fix For: 1.8.0 > > Attachments: AVRO-1769-2.patch.gz, AVRO-1769.patch.gz > > > To fix AVRO-1691 we need to update to a newer version of Jansson. However, > rather than updating the version of Jansson that is bundled with Avro-C, this > would be a good time to switch to a dynamically linked version. As > [~edenhill] pointed out, libjansson is widely available in distributions > nowadays. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (AVRO-1691) Error parsing schema if schema is json string
[
https://issues.apache.org/jira/browse/AVRO-1691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15107653#comment-15107653
]
Hudson commented on AVRO-1691:
--
SUCCESS: Integrated in AvroJava #571 (See
[https://builds.apache.org/job/AvroJava/571/])
AVRO-1691. C: Allow schemas consisting only of a primitive type. Contributed by
Magnus Edenhill. (martinkl: rev 1725611)
* trunk/CHANGES.txt
* trunk/lang/c/src/schema.c
* trunk/lang/c/tests/CMakeLists.txt
* trunk/lang/c/tests/test_avro_1691.c
> Error parsing schema if schema is json string
> -
>
> Key: AVRO-1691
> URL: https://issues.apache.org/jira/browse/AVRO-1691
> Project: Avro
> Issue Type: Bug
> Components: c
>Affects Versions: 1.7.7
>Reporter: Vikas Kumar
> Fix For: 1.8.0
>
> Attachments: AVRO-1691.patch
>
>
> I have a schema which looks like:
> "int"
> in file_read_header , I got an error: Cannot parse file header: Error parsing
> JSON: '[' or '{' expected near '"int"'
> I see avro-c uses json_loadb from jansson which may be populating this error.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (AVRO-1577) TestSpecificCompiler is not closing resources
[
https://issues.apache.org/jira/browse/AVRO-1577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16745491#comment-16745491
]
Hudson commented on AVRO-1577:
--
FAILURE: Integrated in Jenkins build AvroJava #586 (See
[https://builds.apache.org/job/AvroJava/586/])
[AVRO-1577] Update couple more methods to use try-with-resources (dkulp:
[https://github.com/apache/avro/commit/411cfb96db6126a06df9e8093106e690b7e35dfc])
* (edit)
lang/java/compiler/src/test/java/org/apache/avro/compiler/specific/TestSpecificCompiler.java
> TestSpecificCompiler is not closing resources
> -
>
> Key: AVRO-1577
> URL: https://issues.apache.org/jira/browse/AVRO-1577
> Project: Apache Avro
> Issue Type: Bug
> Components: java
>Affects Versions: 1.7.7
> Environment: Windows
>Reporter: Stevo Slavic
>Assignee: Daniel Kulp
>Priority: Major
> Fix For: 1.9.0
>
> Attachments: AVRO-1577.patch
>
>
> Test methods in {{TestSpecificCompiler}} are opening various {{Closable}}
> resources, but they are not closing them. Because of this, file deletion in
> {{tearDown}} silently fails (on platforms like Windows which are locking
> files that are being used). This causes few test methods to fail since they
> are using same temp file as output file - they generate new file content but
> only if file is not already present, and then assertions comparing actual and
> expected output content fail.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (AVRO-1214) Generated protocol's method should return void instead of Void like one-way message
[
https://issues.apache.org/jira/browse/AVRO-1214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16745490#comment-16745490
]
Hudson commented on AVRO-1214:
--
FAILURE: Integrated in Jenkins build AvroJava #586 (See
[https://builds.apache.org/job/AvroJava/586/])
AVRO-1214 Use void instead of Void for RPC methods (dkulp:
[https://github.com/apache/avro/commit/05171ee872bb8d6e9173a34b7832f522b2a56763])
* (edit)
lang/java/ipc/src/test/java/org/apache/avro/ipc/TestNettyServerWithCallbacks.java
* (edit) lang/java/ipc/src/test/java/org/apache/avro/TestProtocolSpecific.java
* (edit)
lang/java/compiler/src/main/java/org/apache/avro/compiler/specific/SpecificCompiler.java
* (edit)
lang/java/grpc/src/test/java/org/apache/avro/grpc/TestAvroProtocolGrpc.java
* (edit)
lang/java/compiler/src/main/velocity/org/apache/avro/compiler/specific/templates/java/classic/protocol.vm
* (edit) lang/java/ipc/src/test/java/org/apache/avro/TestNamespaceSpecific.java
* (edit) lang/java/ipc/src/test/java/org/apache/avro/TestBulkData.java
* (edit)
lang/java/ipc/src/test/java/org/apache/avro/ipc/TestNettyServerConcurrentExecution.java
> Generated protocol's method should return void instead of Void like one-way
> message
> ---
>
> Key: AVRO-1214
> URL: https://issues.apache.org/jira/browse/AVRO-1214
> Project: Apache Avro
> Issue Type: Improvement
> Components: java
>Affects Versions: 1.7.2
>Reporter: Sébastien Launay
>Assignee: Daniel Kulp
>Priority: Minor
> Fix For: 1.9.0
>
> Attachments: AVRO-1214-unbox-void-2012-12-05.patch
>
>
> Using the following IDL:
> {noformat}
> @namespace("org.apache.avro.test")
> protocol Simple {
> error TestError {
> string message;
> }
> string hello(string greeting);
> void `error`() throws TestError;
> void ping() oneway;
> }
> {noformat}
> Will produce the interface:
> {code:java}
> package org.apache.avro.test;
> public interface Simple {
> public static final org.apache.avro.Protocol PROTOCOL =
> org.apache.avro.Protocol.parse("...");
> java.lang.CharSequence hello(java.lang.CharSequence greeting) throws
> org.apache.avro.AvroRemoteException;
> java.lang.Void error() throws org.apache.avro.AvroRemoteException,
> org.apache.avro.test.TestError;
> void ping();
> public interface Callback extends Simple {
> public static final org.apache.avro.Protocol PROTOCOL =
> org.apache.avro.test.Simple.PROTOCOL;
> void hello(java.lang.CharSequence greeting,
> org.apache.avro.ipc.Callback callback) throws
> java.io.IOException;
> void error(org.apache.avro.ipc.Callback callback) throws
> java.io.IOException;
> }
> }
> {code}
> Then one is forced to add {{return null;}} statement(s) in the interface
> implementation for the {{error()}} method which can be a bit cumbersome and
> that's not the case for the oneway {{ping()}} method.
> This is fine on the Callback though because the developer can just ignore the
> callback argument.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (AVRO-1946) If user exists by default in docker, there will be an error, and the setup fails.
[ https://issues.apache.org/jira/browse/AVRO-1946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16745489#comment-16745489 ] Hudson commented on AVRO-1946: -- FAILURE: Integrated in Jenkins build AvroJava #586 (See [https://builds.apache.org/job/AvroJava/586/]) AVRO-1946 - Continue if user already exists. (dkulp: [https://github.com/apache/avro/commit/0d997e5e5952546e0bdeab3080ef7c00d8caffc1]) * (edit) build.sh > If user exists by default in docker, there will be an error, and the setup > fails. > - > > Key: AVRO-1946 > URL: https://issues.apache.org/jira/browse/AVRO-1946 > Project: Apache Avro > Issue Type: Bug > Components: docker >Affects Versions: 1.9.0 >Reporter: Suraj Acharya >Assignee: Suraj Acharya >Priority: Minor > Fix For: 1.9.0 > > Attachments: AVRO-1946.patch > > > Currently, when a user already exists in a docker, it errors and stops > running. > However, for a group it continues after throwing a warning. This is > inconsistent. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (AVRO-2303) Test C# against .NET Core instead of Mono
[ https://issues.apache.org/jira/browse/AVRO-2303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16747124#comment-16747124 ] Hudson commented on AVRO-2303: -- FAILURE: Integrated in Jenkins build AvroJava #588 (See [https://builds.apache.org/job/AvroJava/588/]) AVRO-2303: Build and test against .NET SDK instead of Mono (#431) (fokko: [https://github.com/apache/avro/commit/2eea14c10f87029dfe89e7575fbd587cb23b812d]) * (edit) lang/csharp/build.sh * (edit) lang/csharp/README.md * (edit) share/docker/Dockerfile > Test C# against .NET Core instead of Mono > - > > Key: AVRO-2303 > URL: https://issues.apache.org/jira/browse/AVRO-2303 > Project: Apache Avro > Issue Type: Improvement > Components: build, csharp >Reporter: Brian Lachniet >Assignee: Brian Lachniet >Priority: Major > Fix For: 1.9.0 > > > In AVRO-2112, we upgraded to the latest Mono v5+ to test the C# project in > the Travis CI builds. We should test against the .NET Core SDK instead for > the following reasons: > # .NET Core/Standard should become the default that we build and test > against because that is quickly becoming the default across the community. > # Installing the latest Mono significantly increased Travis CI build times, > as can be seen from the [build > history|https://travis-ci.org/apache/avro/builds]. Before build #317 (the one > that merges the C# updates), builds were generally under 40m. Following > builds regularly push the [50m Travis CI build > limit|https://docs.travis-ci.com/user/customizing-the-build/#build-timeouts]. > By switching to .NET Core SDK instead, build times drop back down to the > normal before the C# updates (see [this > example|https://travis-ci.org/blachniet/avro/builds/481154272]). -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (AVRO-2238) Update Docker image from java to openjdk
[ https://issues.apache.org/jira/browse/AVRO-2238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748256#comment-16748256 ] Hudson commented on AVRO-2238: -- SUCCESS: Integrated in Jenkins build AvroJava #589 (See [https://builds.apache.org/job/AvroJava/589/]) AVRO-2238 Update Dockerfile base image from java to openjdk Fix the PHP (iemejia: [https://github.com/apache/avro/commit/5896f1a1bdcbc2f7450b09b1dbbdeb4ad0cb13b6]) * (edit) lang/java/ipc/src/test/java/org/apache/avro/TestBulkData.java * (edit) lang/js/lib/utils.js * (edit) BUILD.md * (edit) share/test/interop/bin/test_rpc_interop.sh * (edit) lang/perl/t/04_datafile.t * (edit) share/docker/Dockerfile * (edit) lang/java/tools/src/main/java/org/apache/avro/tool/RpcSendTool.java * (edit) lang/php/test/SchemaTest.php * (edit) lang/ruby/test/tool.rb > Update Docker image from java to openjdk > > > Key: AVRO-2238 > URL: https://issues.apache.org/jira/browse/AVRO-2238 > Project: Apache Avro > Issue Type: Improvement > Components: docker >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > Fix For: 1.9.0 > > > Currently the docker image to run the tests is still using java which is > deprecated: https://hub.docker.com/_/java/ > Therefore we should move to openjdk (https://hub.docker.com/_/openjdk/). > Starting with version 8, and also adding 10 and 11 to it to make sure that > Avro is compatible with future version of Java. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (AVRO-2296) Add Java 11 build in the CI server
[ https://issues.apache.org/jira/browse/AVRO-2296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748551#comment-16748551 ] Hudson commented on AVRO-2296: -- FAILURE: Integrated in Jenkins build AvroJava #590 (See [https://builds.apache.org/job/AvroJava/590/]) AVRO-2296: Add Java 11 build in the CI server (iemejia: [https://github.com/apache/avro/commit/8643e3bd73cab8dbbbcac1203a19c2d2cdc62cfe]) * (edit) .travis.yml > Add Java 11 build in the CI server > -- > > Key: AVRO-2296 > URL: https://issues.apache.org/jira/browse/AVRO-2296 > Project: Apache Avro > Issue Type: Sub-task > Components: build >Reporter: Ismaël Mejía >Assignee: Fokko Driesprong >Priority: Minor > Fix For: 1.9.0 > > > Once the codebase fully builds with Java 11, we can integrate this into the > CI. > Two small prerrequisites will be to tune the build for Java 11 only in the > test case and to add some validation to the enforcer plugin to validate that > we accidentally don't leak Java 11 features/code to the code base. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (AVRO-2303) Test C# against .NET Core instead of Mono
[ https://issues.apache.org/jira/browse/AVRO-2303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748550#comment-16748550 ] Hudson commented on AVRO-2303: -- FAILURE: Integrated in Jenkins build AvroJava #590 (See [https://builds.apache.org/job/AvroJava/590/]) AVRO-2303: C#: Update docker image to use .net sdk 2.2 (iemejia: [https://github.com/apache/avro/commit/c3e0c4974db92bf6001a6da654870455cac70eac]) * (edit) share/docker/Dockerfile > Test C# against .NET Core instead of Mono > - > > Key: AVRO-2303 > URL: https://issues.apache.org/jira/browse/AVRO-2303 > Project: Apache Avro > Issue Type: Improvement > Components: build, csharp >Reporter: Brian Lachniet >Assignee: Brian Lachniet >Priority: Major > Fix For: 1.9.0 > > > In AVRO-2112, we upgraded to the latest Mono v5+ to test the C# project in > the Travis CI builds. We should test against the .NET Core SDK instead for > the following reasons: > # .NET Core/Standard should become the default that we build and test > against because that is quickly becoming the default across the community. > # Installing the latest Mono significantly increased Travis CI build times, > as can be seen from the [build > history|https://travis-ci.org/apache/avro/builds]. Before build #317 (the one > that merges the C# updates), builds were generally under 40m. Following > builds regularly push the [50m Travis CI build > limit|https://docs.travis-ci.com/user/customizing-the-build/#build-timeouts]. > By switching to .NET Core SDK instead, build times drop back down to the > normal before the C# updates (see [this > example|https://travis-ci.org/blachniet/avro/builds/481154272]). -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (AVRO-2306) Python 3 avro library corrupts files when using snappy codec
[ https://issues.apache.org/jira/browse/AVRO-2306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749721#comment-16749721 ] Hudson commented on AVRO-2306: -- FAILURE: Integrated in Jenkins build AvroJava #591 (See [https://builds.apache.org/job/AvroJava/591/]) AVRO-2306: Fix data corruption issue with snappy in Python 3 (iemejia: [https://github.com/apache/avro/commit/384061c05720287aa93a756a742aab2572b75e79]) * (edit) lang/py3/avro/datafile.py > Python 3 avro library corrupts files when using snappy codec > > > Key: AVRO-2306 > URL: https://issues.apache.org/jira/browse/AVRO-2306 > Project: Apache Avro > Issue Type: Bug > Components: python >Affects Versions: 1.8.2 >Reporter: Charles Chen >Priority: Critical > Fix For: 1.9.0 > > > Currently, the Python version of avro when run in Python 3 corrupts files > when using the snappy codec. Specifically, this line > [https://github.com/apache/avro/blob/8643e3bd73cab8dbbbcac1203a19c2d2cdc62cfe/lang/py3/avro/datafile.py#L286] > fails to resolve to True because of a comparison between a byte and unicode > string returning False. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (AVRO-2112) c# (.net) port to .NET Standard 2.0 and nuget (package) dependencies
[ https://issues.apache.org/jira/browse/AVRO-2112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16741246#comment-16741246 ] Hudson commented on AVRO-2112: -- SUCCESS: Integrated in Jenkins build AvroJava #582 (See [https://builds.apache.org/job/AvroJava/582/]) AVRO-2112: Target .NET Standard/Core in C# (#307) (fokko: [https://github.com/apache/avro/commit/9a05375436385b7fce75d32cfdcd359e279e0628]) * (add) lang/csharp/src/apache/ipc.test/GeneratedFiles/org/apache/avro/test/AllEnum.cs * (add) lang/csharp/src/apache/ipc.test/GeneratedFiles/org/apache/avro/test/SimpleCallback.cs * (edit) lang/csharp/src/apache/main/Avro.main.csproj * (add) lang/csharp/src/apache/ipc.test/Avro.ipc.test.csproj * (add) lang/csharp/src/apache/ipc.test/GeneratedFiles/org/apache/avro/test/Mail.cs * (delete) lang/csharp/src/apache/test/Ipc/GeneratedFiles/org/apache/avro/test/TestRecord.cs * (add) lang/csharp/src/apache/ipc.test/GeneratedFiles/org/apache/avro/test/TestRecord.cs * (delete) lang/csharp/src/apache/test/Ipc/GeneratedFiles/org/apache/avro/test/TestRecordExtensions.cs * (edit) lang/csharp/src/apache/test/Protocol/ProtocolTest.cs * (delete) lang/csharp/src/apache/test/Ipc/GeneratedFiles/org/apache/avro/test/AllEnum.cs * (delete) lang/csharp/src/apache/test/Ipc/LocalTransceiverTest.cs * (edit) lang/csharp/src/apache/test/Generic/GenericTests.cs * (add) lang/csharp/src/apache/ipc.test/SocketServerTest.cs * (edit) lang/csharp/src/apache/main/Schema/JsonHelper.cs * (delete) lang/csharp/src/apache/test/Ipc/GeneratedFiles/org/apache/avro/test/MD5.cs * (add) lang/csharp/src/apache/ipc.test/SocketServerConcurrentExecutionTest.cs * (delete) lang/csharp/README * (delete) lang/csharp/lib/main/Castle.Core.dll * (add) lang/csharp/src/apache/ipc.test/SocketTransceiverWhenServerStopsTest.cs * (delete) lang/csharp/lib/main/log4net.dll * (delete) lang/csharp/src/apache/test/Ipc/GeneratedFiles/org/apache/avro/test/All.cs * (edit) lang/csharp/.gitignore * (delete) lang/csharp/src/apache/test/Ipc/GeneratedFiles/org/apache/avro/test/FixedTest.cs * (add) lang/csharp/src/apache/ipc.test/MailResponder.cs * (edit) lang/csharp/Avro.sln * (delete) lang/csharp/src/apache/test/Ipc/SocketServerWithCallbacksTest.cs * (delete) lang/csharp/lib/main/Newtonsoft.Json.dll * (delete) lang/csharp/Avro.nunit * (add) lang/csharp/src/apache/ipc.test/GeneratedFiles/org/apache/avro/test/Message.cs * (add) lang/csharp/src/apache/ipc.test/GeneratedFiles/org/apache/avro/test/Simple.cs * (add) lang/csharp/src/apache/ipc.test/LocalTransceiverTest.cs * (delete) lang/csharp/src/apache/test/Ipc/SocketTransceiverWhenServerStopsTest.cs * (edit) pom.xml * (delete) lang/csharp/src/apache/main/Properties/Settings.Designer.cs * (add) lang/csharp/README.md * (delete) lang/csharp/src/apache/test/Ipc/SocketServerConcurrentExecutionTest.cs * (add) lang/csharp/src/apache/ipc.test/GeneratedFiles/org/apache/avro/test/AllTestRecordPartial.cs * (delete) lang/csharp/src/apache/test/Ipc/GeneratedFiles/org/apache/avro/test/Simple.cs * (edit) lang/csharp/src/apache/ipc/Avro.ipc.csproj * (delete) lang/csharp/src/apache/test/Ipc/GeneratedFiles/org/apache/avro/test/SimpleCallback.cs * (add) lang/csharp/src/apache/ipc.test/GeneratedFiles/org/apache/avro/test/FixedTest.cs * (edit) share/docker/Dockerfile * (edit) lang/csharp/src/apache/test/Avro.test.csproj * (edit) lang/csharp/src/apache/test/File/FileTests.cs * (edit) lang/csharp/src/apache/test/Schema/AliasTest.cs * (delete) lang/csharp/src/apache/test/Ipc/GeneratedFiles/org/apache/avro/test/MailCallback.cs * (delete) lang/csharp/src/apache/test/Ipc/GeneratedFiles/org/apache/avro/test/AllTestRecordPartial.cs * (add) lang/csharp/src/apache/ipc.test/Properties/AssemblyInfo.cs * (edit) lang/csharp/src/apache/codegen/Avro.codegen.csproj * (add) lang/csharp/src/apache/ipc.test/GeneratedFiles/org/apache/avro/test/MailCallback.cs * (edit) lang/csharp/src/apache/perf/Avro.perf.csproj * (add) lang/csharp/src/apache/ipc.test/SocketServerWithCallbacksTest.cs * (delete) lang/csharp/src/apache/test/Ipc/GeneratedFiles/org/apache/avro/test/TestError.cs * (add) lang/csharp/src/apache/ipc.test/GeneratedFiles/org/apache/avro/test/All.cs * (edit) lang/csharp/src/apache/test/Schema/SchemaNormalizationTests.cs * (add) lang/csharp/src/apache/ipc.test/GeneratedFiles/org/apache/avro/test/TestRecordWithUnion.cs * (delete) lang/csharp/src/apache/test/Ipc/SocketServerTest.cs * (delete) lang/csharp/src/apache/test/Ipc/GeneratedFiles/org/apache/avro/test/AllCallback.cs * (add) lang/csharp/src/apache/ipc.test/GeneratedFiles/org/apache/avro/test/TestRecordExtensions.cs * (add) lang/csharp/src/apache/ipc.test/GeneratedFiles/org/apache/avro/test/TestError.cs * (delete) lang/csharp/src/apache/test/Ipc/GeneratedFiles/org/apache/avro/test/Message.cs * (delete) lang/csharp/lib/test/nunit.framework.dll * (delete)
[jira] [Commented] (AVRO-2308) Use Java StandardCharsets
[ https://issues.apache.org/jira/browse/AVRO-2308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754075#comment-16754075 ] Hudson commented on AVRO-2308: -- FAILURE: Integrated in Jenkins build AvroJava #592 (See [https://builds.apache.org/job/AvroJava/592/]) AVRO-2308: Use Java StandardCharsets (iemejia: [https://github.com/apache/avro/commit/3c16299956d64dc4a1b76161228ebb545d3d400b]) * (edit) lang/java/ipc/src/main/java/org/apache/avro/ipc/SaslSocketTransceiver.java * (edit) lang/java/avro/src/main/java/org/apache/avro/reflect/ReflectData.java * (edit) lang/java/avro/src/test/java/org/apache/avro/TestSchemaNormalization.java * (edit) lang/java/mapred/src/main/java/org/apache/avro/mapred/AvroOutputFormat.java * (edit) lang/java/avro/src/main/java/org/apache/avro/SchemaNormalization.java * (edit) lang/java/avro/src/main/java/org/apache/avro/file/DataFileReader12.java * (edit) lang/java/mapred/src/main/java/org/apache/avro/mapred/AvroJob.java * (edit) lang/java/avro/src/main/java/org/apache/avro/util/Utf8.java * (edit) lang/java/avro/src/main/java/org/apache/avro/util/internal/JacksonUtils.java * (edit) lang/java/trevni/core/src/main/java/org/apache/trevni/MetaData.java * (edit) lang/java/avro/src/main/java/org/apache/avro/file/DataFileStream.java * (edit) lang/java/avro/src/test/java/org/apache/avro/util/TestUtf8.java * (edit) lang/java/mapred/src/test/java/org/apache/avro/mapred/TestAvroTextOutputFormat.java * (edit) lang/java/avro/src/main/java/org/apache/avro/file/DataFileWriter.java > Use Java StandardCharsets > - > > Key: AVRO-2308 > URL: https://issues.apache.org/jira/browse/AVRO-2308 > Project: Apache Avro > Issue Type: Improvement >Reporter: BELUGA BEHR >Assignee: BELUGA BEHR >Priority: Minor > Fix For: 1.9.0 > > > Use Java Standard > [StandardCharsets|https://docs.oracle.com/javase/7/docs/api/java/nio/charset/StandardCharsets.html]. > Every JDK must now include support for several common charsets. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (AVRO-2357) (ReflectData) Support for generic types in protocol definitions
[
https://issues.apache.org/jira/browse/AVRO-2357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16806215#comment-16806215
]
Hudson commented on AVRO-2357:
--
FAILURE: Integrated in Jenkins build AvroJava #632 (See
[https://builds.apache.org/job/AvroJava/632/])
AVRO-2357: Allow generic types in reflect protos (#490) (fokko:
[https://github.com/apache/avro/commit/de48a0a8a0343b61fdb255011fde38c619761046])
* (edit)
lang/java/avro/src/main/java/org/apache/avro/reflect/ReflectionUtil.java
* (edit)
lang/java/avro/src/test/java/org/apache/avro/reflect/TestReflectData.java
* (edit) lang/java/avro/src/main/java/org/apache/avro/reflect/ReflectData.java
> (ReflectData) Support for generic types in protocol definitions
> ---
>
> Key: AVRO-2357
> URL: https://issues.apache.org/jira/browse/AVRO-2357
> Project: Apache Avro
> Issue Type: Improvement
> Components: java
>Reporter: Ivan Greene
>Priority: Minor
> Fix For: 1.9.0
>
>
> For a Java interface extending another interface with type parameters, we may
> resolve actual type parameters and build the protocol definition based upon
> those.
> For example, let's say we have a generic protocol defined by a Java interface:
> {code:java}
> public interface CrudProto {
> void persist(T record);
> T fetchById(I id);
> }{code}
> It would be natural to define a set of interfaces that extend this, such as:
> {code:java}
> public interface FooBarRecordProto extends CrudProto {}
> public interface OtherRecordProto extends CrudProto {}
> {code}
> Calling ReflectData.get().getProtocol(FooBarRecordProto.class) should be able
> to resolve that this protocol deals in FooBarRecords and Strings, and build a
> protocol accordingly.
> Currently, this call will produce an exception stating that a schema for 'T'
> cannot be resolved.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (AVRO-2199) Validate that field defaults have the correct type
[ https://issues.apache.org/jira/browse/AVRO-2199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16806214#comment-16806214 ] Hudson commented on AVRO-2199: -- FAILURE: Integrated in Jenkins build AvroJava #632 (See [https://builds.apache.org/job/AvroJava/632/]) AVRO-2199: Validate that field defaults have the correct type (#497) (fokko: [https://github.com/apache/avro/commit/392c761952ec7f679b29ae28129403ea8cf307ea]) * (edit) lang/ruby/test/test_schema.rb * (edit) lang/ruby/test/test_datafile.rb * (edit) lang/ruby/.gitignore * (edit) lang/ruby/lib/avro.rb * (edit) lang/ruby/lib/avro/schema.rb > Validate that field defaults have the correct type > --- > > Key: AVRO-2199 > URL: https://issues.apache.org/jira/browse/AVRO-2199 > Project: Apache Avro > Issue Type: Improvement > Components: ruby >Affects Versions: 1.8.2 >Reporter: Daniel Orner >Assignee: Tim Perkins >Priority: Minor > Fix For: 1.9.0 > > Attachments: AVRO-2199.patch > > > Currently, on the master branch, when a schema is parsed, it is possible to > define a field with a type and a default of a totally different type. E.g. if > the field has type "string", the default can be set to "null". > I'd like to open a PR which will fix this by running the default through the > SchemaValidator whenever a new Field is created. See > [https://github.com/salsify/avro-patches/pull/16] > cc: [~tjwp] -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (AVRO-2200) Option to fail when extra fields are in the payload
[ https://issues.apache.org/jira/browse/AVRO-2200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16808545#comment-16808545 ] Hudson commented on AVRO-2200: -- FAILURE: Integrated in Jenkins build AvroJava #636 (See [https://builds.apache.org/job/AvroJava/636/]) AVRO-2200: Option to fail when extra fields are in the payload (#321) (fokko: [https://github.com/apache/avro/commit/3a7786ed1a3bedf05e6bce7924aea2f75b576912]) * (edit) lang/ruby/lib/avro/schema_validator.rb * (edit) lang/ruby/test/test_schema_validator.rb > Option to fail when extra fields are in the payload > --- > > Key: AVRO-2200 > URL: https://issues.apache.org/jira/browse/AVRO-2200 > Project: Apache Avro > Issue Type: Improvement > Components: ruby >Reporter: Daniel Orner >Assignee: Tim Perkins >Priority: Minor > Fix For: 1.9.0 > > > Currently, when passing a datum into the schema validator, the datum will > pass even if the datum has more fields than the schema does. This can be > dangerous because the client code is assuming that the schema has these > values, but they are actually being silently swallowed when they are encoded. > I'd like to open a PR where we can provide an option to make the validator > fail on any extra fields. See https://github.com/salsify/avro-patches/pull/15 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (AVRO-2353) Auto format/validate Java code
[ https://issues.apache.org/jira/browse/AVRO-2353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16801729#comment-16801729 ] Hudson commented on AVRO-2353: -- FAILURE: Integrated in Jenkins build AvroJava #623 (See [https://builds.apache.org/job/AvroJava/623/]) AVRO-2353: Configure spotless-maven-plugin to auto format/validate Java (fokko: [https://github.com/apache/avro/commit/8026c8ffe4ef67ab419dba73910636bf2c1a691c]) * (edit) lang/java/avro/src/test/java/org/apache/avro/TestSchemaCompatibilityFixedSizeMismatch.java * (edit) lang/java/ipc-netty/src/test/java/org/apache/avro/ipc/netty/TestNettyServer.java * (edit) lang/java/trevni/avro/src/test/java/org/apache/trevni/avro/mapreduce/TestKeyWordCount.java * (edit) lang/java/ipc/src/test/java/org/apache/avro/TestProtocolDatagram.java * (edit) lang/java/mapred/src/test/java/org/apache/avro/mapreduce/TestWordCount.java * (edit) lang/java/tools/pom.xml * (edit) lang/java/avro/src/main/java/org/apache/avro/file/SeekableByteArrayInput.java * (edit) lang/java/trevni/core/src/main/java/org/apache/trevni/NullChecksum.java * (edit) lang/java/avro/src/main/java/org/apache/avro/Schema.java * (edit) lang/java/avro/src/test/java/org/apache/avro/FooBarSpecificRecord.java * (edit) lang/java/thrift/src/test/java/org/apache/avro/thrift/TestThrift.java * (edit) lang/java/trevni/core/src/test/java/org/apache/trevni/TestInputBytes.java * (edit) lang/java/tools/src/test/java/org/apache/avro/tool/TestToTrevniTool.java * (edit) lang/java/mapred/src/main/java/org/apache/avro/mapred/SequenceFileReader.java * (edit) lang/java/ipc-jetty/src/main/java/org/apache/avro/ipc/jetty/StaticServlet.java * (edit) lang/java/compiler/src/test/java/org/apache/avro/compiler/idl/TestSchemaResolver.java * (edit) lang/java/thrift/src/test/java/org/apache/avro/thrift/test/Foo.java * (edit) lang/java/mapred/src/main/java/org/apache/avro/mapred/SequenceFileInputFormat.java * (edit) lang/java/tools/src/main/java/org/apache/avro/tool/IdlToSchemataTool.java * (edit) lang/java/mapred/src/main/java/org/apache/avro/hadoop/io/AvroDatumConverterFactory.java * (edit) lang/java/mapred/src/test/java/org/apache/avro/mapred/tether/TetherTaskRunner.java * (edit) lang/java/mapred/src/main/java/org/apache/avro/mapred/DelegatingMapper.java * (edit) lang/java/avro/src/main/java/org/apache/avro/reflect/ReflectionUtil.java * (edit) lang/java/integration-test/codegen-test/src/test/java/org/apache/avro/codegentest/TestNullableLogicalTypes.java * (edit) lang/java/trevni/core/src/test/java/org/apache/trevni/TestIOBuffers.java * (edit) lang/java/avro/src/main/java/org/apache/avro/io/parsing/JsonGrammarGenerator.java * (edit) lang/java/tools/src/test/java/org/apache/avro/tool/TestRecodecTool.java * (edit) lang/java/avro/src/main/java/org/apache/avro/io/Decoder.java * (edit) lang/java/avro/src/main/java/org/apache/avro/reflect/CustomEncoding.java * (edit) lang/java/avro/src/main/java/org/apache/avro/specific/SpecificFixed.java * (edit) lang/java/tools/src/main/java/org/apache/avro/tool/JsonToBinaryFragmentTool.java * (edit) lang/java/ipc/src/test/java/org/apache/avro/TestNamespaceSpecific.java * (edit) lang/java/tools/src/main/java/org/apache/avro/tool/DataFileRepairTool.java * (edit) lang/java/tools/src/test/java/org/apache/avro/tool/TestDataFileTools.java * (edit) lang/java/avro/src/main/java/org/apache/avro/io/ValidatingEncoder.java * (edit) lang/java/avro/src/main/java/org/apache/avro/file/Syncable.java * (edit) lang/java/avro/src/test/java/org/apache/avro/data/TestTimeConversions.java * (edit) lang/java/avro/src/test/java/org/apache/avro/util/CaseFinder.java * (edit) lang/java/thrift/src/test/java/org/apache/avro/thrift/test/E.java * (edit) lang/java/integration-test/pom.xml * (edit) lang/java/avro/src/test/java/org/apache/avro/TestDataFile.java * (edit) lang/java/ipc/src/test/java/org/apache/avro/TestSchema.java * (edit) lang/java/ipc/src/test/java/org/apache/avro/message/TestCustomSchemaStore.java * (edit) lang/java/avro/src/test/java/org/apache/avro/generic/TestGenericLogicalTypes.java * (edit) lang/java/ipc/src/main/java/org/apache/avro/ipc/Transceiver.java * (edit) lang/java/ipc/src/main/java/org/apache/avro/ipc/generic/GenericRequestor.java * (edit) lang/java/mapred/src/test/java/org/apache/avro/mapreduce/AvroFiles.java * (edit) lang/java/trevni/core/src/main/java/org/apache/trevni/Crc32Checksum.java * (edit) lang/java/avro/src/test/java/org/apache/avro/io/TestEncoders.java * (edit) lang/java/avro/src/main/java/org/apache/avro/io/BlockingBinaryEncoder.java * (edit) lang/java/avro/src/main/java/org/apache/avro/io/parsing/Parser.java * (edit) lang/java/thrift/src/test/java/org/apache/avro/thrift/test/Test.java * (edit) lang/java/compiler/pom.xml * (edit) lang/java/mapred/src/test/java/org/apache/avro/hadoop/io/TestAvroSerialization.java * (edit) lang/java/trevni/core/src/main/java/org/apache/trevni/SnappyCodec.java * (edit)
[jira] [Commented] (AVRO-2332) Support java_multiple_files protobuf option
[ https://issues.apache.org/jira/browse/AVRO-2332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16809683#comment-16809683 ] Hudson commented on AVRO-2332: -- FAILURE: Integrated in Jenkins build AvroJava #637 (See [https://builds.apache.org/job/AvroJava/637/]) AVRO-2332: Support java_multiple_files protobuf option (nandorkollar: [https://github.com/apache/avro/commit/bd89d59def7c3b273e122635b9a2ccfa9ada2f7f]) * (add) lang/java/protobuf/src/test/java/org/apache/avro/protobuf/multiplefiles/MOrBuilder.java * (add) lang/java/protobuf/src/test/java/org/apache/avro/protobuf/multiplefiles/Foo.java * (add) lang/java/protobuf/src/test/java/org/apache/avro/protobuf/multiplefiles/M.java * (add) lang/java/protobuf/src/test/java/org/apache/avro/protobuf/noopt/Test.java * (edit) lang/java/protobuf/pom.xml * (edit) lang/java/protobuf/src/test/protobuf/test.proto * (add) lang/java/protobuf/src/test/java/org/apache/avro/protobuf/multiplefiles/A.java * (delete) lang/java/protobuf/src/test/java/org/apache/avro/protobuf/Test.java * (add) lang/java/protobuf/src/test/java/org/apache/avro/protobuf/multiplefiles/TestMultipleFiles.java * (edit) lang/java/protobuf/src/main/java/org/apache/avro/protobuf/ProtobufData.java * (add) lang/java/protobuf/src/test/protobuf/test_multiple_files.proto * (edit) lang/java/protobuf/src/test/java/org/apache/avro/protobuf/TestProtobuf.java * (add) lang/java/protobuf/src/test/java/org/apache/avro/protobuf/multiplefiles/FooOrBuilder.java * (edit) pom.xml > Support java_multiple_files protobuf option > --- > > Key: AVRO-2332 > URL: https://issues.apache.org/jira/browse/AVRO-2332 > Project: Apache Avro > Issue Type: Improvement > Components: java >Reporter: Ryo Okubo >Assignee: Ryo Okubo >Priority: Major > Fix For: 1.9.0 > > > Support java_multiple_files option, > [https://developers.google.com/protocol-buffers/docs/proto3#options] > The option helps to get classes via reflection. > > protoc doesn't generate outer class if the option enables, but current > getNamespace() doesn't consider that. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (AVRO-732) Generated protocol's method should not throw AvroRemoteException
[ https://issues.apache.org/jira/browse/AVRO-732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16810437#comment-16810437 ] Hudson commented on AVRO-732: - FAILURE: Integrated in Jenkins build AvroJava #638 (See [https://builds.apache.org/job/AvroJava/638/]) [AVRO-732] Remove AvroRemoteException from generated interfaces Patch (dkulp: [https://github.com/apache/avro/commit/4c0e41cebc0804c563dffe98a58c06b1c39098e1]) * (edit) lang/java/ipc-jetty/src/test/java/org/apache/avro/ipc/jetty/TestStatsPluginAndServlet.java * (edit) lang/java/compiler/src/main/velocity/org/apache/avro/compiler/specific/templates/java/classic/protocol.vm * (edit) lang/java/ipc/src/test/java/org/apache/avro/compiler/specific/TestSpecificCompiler.java * (edit) lang/java/grpc/src/test/java/org/apache/avro/grpc/TestAvroProtocolGrpc.java * (edit) lang/java/ipc-netty/src/test/java/org/apache/avro/ipc/netty/TestNettyServerWithCallbacks.java * (edit) lang/java/archetypes/avro-service-archetype/src/main/resources/archetype-resources/src/main/java/service/SimpleOrderService.java * (edit) lang/java/avro/src/main/java/org/apache/avro/AvroRemoteException.java * (edit) lang/java/ipc/src/test/java/org/apache/avro/TestNamespaceSpecific.java * (edit) lang/java/ipc/src/test/java/org/apache/avro/ipc/TestLocalTransceiver.java * (edit) lang/java/archetypes/avro-service-archetype/src/main/resources/archetype-resources/src/main/java/transport/SimpleOrderServiceClient.java * (edit) lang/java/ipc-jetty/src/test/java/org/apache/avro/ipc/jetty/StatsPluginOverhead.java * (edit) lang/java/ipc/src/test/java/org/apache/avro/TestProtocolSpecific.java * (edit) lang/java/ipc/src/test/java/org/apache/avro/TestProtocolGeneric.java * (edit) lang/java/ipc/src/main/java/org/apache/avro/ipc/specific/SpecificRequestor.java * (edit) lang/java/ipc/src/test/java/org/apache/avro/ipc/TestRpcPluginOrdering.java * (edit) lang/java/ipc-jetty/src/test/java/org/apache/avro/ipc/jetty/TestProtocolHttp.java * (edit) lang/java/ipc/src/main/java/org/apache/avro/ipc/Requestor.java * (edit) lang/java/ipc/src/main/java/org/apache/avro/ipc/specific/SpecificResponder.java * (edit) lang/java/ipc/src/test/java/org/apache/avro/TestProtocolReflect.java * (edit) lang/java/avro/src/main/java/org/apache/avro/reflect/ReflectData.java * (edit) lang/java/ipc-netty/src/test/java/org/apache/avro/ipc/netty/TestNettyServerConcurrentExecution.java * (edit) lang/java/ipc/src/main/java/org/apache/avro/ipc/SocketServer.java * (edit) pom.xml * (edit) lang/java/ipc/src/main/java/org/apache/avro/ipc/generic/GenericRequestor.java > Generated protocol's method should not throw AvroRemoteException > > > Key: AVRO-732 > URL: https://issues.apache.org/jira/browse/AVRO-732 > Project: Apache Avro > Issue Type: Bug > Components: java >Reporter: Sharad Agarwal >Assignee: Daniel Kulp >Priority: Major > Fix For: 1.9.0 > > Attachments: > AVRO-732-remove-generated-remote-exception-2012-12-11.patch, > AVRO-732-remove-generated-remote-exception-2012-12-17.patch > > > If user does NOT define the throws clause in the idl, the code is generated > with "throws AvroRemoteException" clause. However on throwing the > AvroRemoteException from the implementation, the serialization fails. This is > not intuitive to users. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (AVRO-1777) Select best matching record when writing a union in python
[
https://issues.apache.org/jira/browse/AVRO-1777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811008#comment-16811008
]
Hudson commented on AVRO-1777:
--
SUCCESS: Integrated in Jenkins build AvroJava #642 (See
[https://builds.apache.org/job/AvroJava/642/])
"Reverting the changes for AVRO-1777 which failed in Travis (#413)"" (dkulp:
[https://github.com/apache/avro/commit/22d5483a1fe8a242f3a512cc0bb7131268e23e92])
* (edit) lang/py/src/avro/io.py
* (edit) lang/py/test/test_io.py
> Select best matching record when writing a union in python
> --
>
> Key: AVRO-1777
> URL: https://issues.apache.org/jira/browse/AVRO-1777
> Project: Apache Avro
> Issue Type: Improvement
> Components: python
>Affects Versions: 1.7.7
>Reporter: Steven Aerts
>Assignee: Daniel Kulp
>Priority: Major
>
> Unlike javascript, python is not using wrapped types.
> So when writing a union it needs to guess find out which type it will output.
> At the moment it takes the last validating type.
> I propose to take the type with the most matching fields.
> So I propose to change in {{io.py}}:
> {code}
> # resolve union
> index_of_schema = -1
> for i, candidate_schema in enumerate(writers_schema.schemas):
> if validate(candidate_schema, datum):
> index_of_schema = i
> if index_of_schema < 0: raise AvroTypeException(writers_schema, datum)
> {code}
> into
> {code}
> # resolve union
> index_of_schema = -1
> found_fields = -1
> for i, candidate_schema in enumerate(writers_schema.schemas):
> if validate(candidate_schema, datum):
> nr_fields = candidate_schema.type in ['record', 'error', 'request'] and
> len(candidate_schema.fields) or 1
> if nr_fields > found_fields:
> index_of_schema = i
> found_fields = nr_fields
> if index_of_schema < 0: raise AvroTypeException(writers_schema, datum)
> {code}
> If you want, I can create a pull request for this. And apply it both on py3
> as py.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (AVRO-1738) add java tool for outputting schema fingerprints
[ https://issues.apache.org/jira/browse/AVRO-1738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811007#comment-16811007 ] Hudson commented on AVRO-1738: -- SUCCESS: Integrated in Jenkins build AvroJava #642 (See [https://builds.apache.org/job/AvroJava/642/]) [AVRO-1738] add java tool for outputting schema fingerprints Patch from (dkulp: [https://github.com/apache/avro/commit/b09726d066111d3e884872960f511f97a0215d34]) * (add) lang/java/tools/src/main/java/org/apache/avro/tool/SchemaFingerprintTool.java * (edit) lang/java/tools/src/main/java/org/apache/avro/tool/Main.java * (edit) lang/java/tools/src/test/java/org/apache/avro/tool/TestMain.java * (edit) lang/java/tools/src/main/java/org/apache/avro/tool/Util.java * (edit) NOTICE.txt > add java tool for outputting schema fingerprints > > > Key: AVRO-1738 > URL: https://issues.apache.org/jira/browse/AVRO-1738 > Project: Apache Avro > Issue Type: New Feature > Components: java >Reporter: Sean Busbey >Assignee: Sean Busbey >Priority: Major > Fix For: 1.9.0 > > Attachments: AVRO-1738.1.patch > > > over in AVRO-1694 I wanted to quickly check that the Java library came up > with the same md5/sha fingerprint for some shcemas that the proposed Ruby > implementation does. > I noticed we don't have a tool that exposes the functionality yet, which > seems like a commonly useful thing to do. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (AVRO-2368) Provide way to distinguish whether a Schema.Field has a default value or its default is null
[
https://issues.apache.org/jira/browse/AVRO-2368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16810848#comment-16810848
]
Hudson commented on AVRO-2368:
--
SUCCESS: Integrated in Jenkins build AvroJava #640 (See
[https://builds.apache.org/job/AvroJava/640/])
[AVRO-2368] Provide a Field.hasDefaultValue() method to determine if a (dkulp:
[https://github.com/apache/avro/commit/1c679b12bab24c315a3547efa0aee1fd7838bbba])
* (edit) lang/java/avro/src/main/java/org/apache/avro/SchemaCompatibility.java
* (edit) lang/java/avro/src/main/java/org/apache/avro/Schema.java
* (edit) pom.xml
> Provide way to distinguish whether a Schema.Field has a default value or its
> default is null
>
>
> Key: AVRO-2368
> URL: https://issues.apache.org/jira/browse/AVRO-2368
> Project: Apache Avro
> Issue Type: Task
> Components: java
>Reporter: Ivan Greene
>Assignee: Daniel Kulp
>Priority: Blocker
> Fix For: 1.9.0
>
>
> After making {{Schema.Field#defaultValue}} package private, there is no way
> to distinguish whether a Field has a default value of 'null' or has no
> default at all. This is a breaking change, notably affecting Hortonworks
> Schema Registry. See discussion here:
> [https://github.com/hortonworks/registry/pull/547]
> I propose we should make that method public and still deprecated. Otherwise I
> don't see a clear way to release a version of the Hortonworks registry that
> will be compatible with both Avro 1.8.x and 1.9.0.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (AVRO-1777) Select best matching record when writing a union in python
[
https://issues.apache.org/jira/browse/AVRO-1777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16810903#comment-16810903
]
Hudson commented on AVRO-1777:
--
SUCCESS: Integrated in Jenkins build AvroJava #641 (See
[https://builds.apache.org/job/AvroJava/641/])
Revert "Reverting the changes for AVRO-1777 which failed in Travis (dkulp:
[https://github.com/apache/avro/commit/73506f295a7835334d31c68da35e4beabdeb4443])
* (edit) lang/py/test/test_io.py
* (edit) lang/py/src/avro/io.py
> Select best matching record when writing a union in python
> --
>
> Key: AVRO-1777
> URL: https://issues.apache.org/jira/browse/AVRO-1777
> Project: Apache Avro
> Issue Type: Improvement
> Components: python
>Affects Versions: 1.7.7
>Reporter: Steven Aerts
>Assignee: Daniel Kulp
>Priority: Major
> Fix For: 1.9.0
>
>
> Unlike javascript, python is not using wrapped types.
> So when writing a union it needs to guess find out which type it will output.
> At the moment it takes the last validating type.
> I propose to take the type with the most matching fields.
> So I propose to change in {{io.py}}:
> {code}
> # resolve union
> index_of_schema = -1
> for i, candidate_schema in enumerate(writers_schema.schemas):
> if validate(candidate_schema, datum):
> index_of_schema = i
> if index_of_schema < 0: raise AvroTypeException(writers_schema, datum)
> {code}
> into
> {code}
> # resolve union
> index_of_schema = -1
> found_fields = -1
> for i, candidate_schema in enumerate(writers_schema.schemas):
> if validate(candidate_schema, datum):
> nr_fields = candidate_schema.type in ['record', 'error', 'request'] and
> len(candidate_schema.fields) or 1
> if nr_fields > found_fields:
> index_of_schema = i
> found_fields = nr_fields
> if index_of_schema < 0: raise AvroTypeException(writers_schema, datum)
> {code}
> If you want, I can create a pull request for this. And apply it both on py3
> as py.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (AVRO-1275) GenericData's toString() method generates the wrong JSON encoding for the bytes type
[
https://issues.apache.org/jira/browse/AVRO-1275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16810902#comment-16810902
]
Hudson commented on AVRO-1275:
--
SUCCESS: Integrated in Jenkins build AvroJava #641 (See
[https://builds.apache.org/job/AvroJava/641/])
[AVRO-1275] Generate "bytes" JSON per spec (dkulp:
[https://github.com/apache/avro/commit/df9ce91231d26655ea1fc11ece5132b389fdf860])
* (edit) lang/java/avro/src/main/java/org/apache/avro/generic/GenericData.java
* (edit)
lang/java/avro/src/test/java/org/apache/avro/generic/TestGenericData.java
> GenericData's toString() method generates the wrong JSON encoding for the
> bytes type
>
>
> Key: AVRO-1275
> URL: https://issues.apache.org/jira/browse/AVRO-1275
> Project: Apache Avro
> Issue Type: Bug
> Components: java
>Reporter: Tom White
>Assignee: Daniel Kulp
>Priority: Major
> Fix For: 1.9.0
>
>
> We discovered in AVRO-1274 that for bytes GenericData.toString(Object datum)
> incorrectly generates
> {noformat}
> { "bytes" : "A" }
> {noformat}
> rather than just {{"A"}} for the JSON encoding defined in the spec
> (http://avro.apache.org/docs/current/spec.html#json_encoding).
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (AVRO-2202) Use of -fstack-protector or -D_GLIBCXX_DEBUG causes memory corruption when combined with musl libc static builds
[ https://issues.apache.org/jira/browse/AVRO-2202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811094#comment-16811094 ] Hudson commented on AVRO-2202: -- SUCCESS: Integrated in Jenkins build AvroJava #643 (See [https://builds.apache.org/job/AvroJava/643/]) [AVRO-2202] Make sure -g is not removed for debug builds, only add (dkulp: [https://github.com/apache/avro/commit/9839e2a67373a5cfd700182a15f949822ce3df99]) * (edit) lang/c++/CMakeLists.txt * (edit) lang/c++/build.sh > Use of -fstack-protector or -D_GLIBCXX_DEBUG causes memory corruption when > combined with musl libc static builds > > > Key: AVRO-2202 > URL: https://issues.apache.org/jira/browse/AVRO-2202 > Project: Apache Avro > Issue Type: Bug > Components: c++ >Affects Versions: 1.8.2 > Environment: OS: Gentoo Linux > Compiler: Gcc 6.4.0 targeting musl libc 1.19 with stdlibc++ in a static build >Reporter: Josh Scoggins >Assignee: Daniel Kulp >Priority: Major > Fix For: 1.9.0 > > > Observed with master and version 1.8.2. Inside of the C++ implementation's > CMakeLists.txt the lines 56-60 were added sometime in 2016 which activate > features inside of libstdc++ to help find errors. This change has two side > effects: > # -g is eliminated from the build so debugging gdb becomes harder as source > position data has been removed > # The safety containers that implicitly wrap all standard containers somehow > (I can't figure out exactly how) cause memory corruption when setMetadata is > called (in version 1.8.2) or when a Writer object is destroyed (on master). > Since our software uses musl libc with libstdc++ I believe that it is an > interaction with these debugging features which cause memory corruption (as I > said, I have no clue _why_ it is happening, only that these features _cause_ > it :() > Previously, we were using 1.7.7 which did not have these lines in its > CMakeLists.txt and thus did not exhibit any sort of memory corruption. I was > able to work around this by removing lines 56-60 from CMakeLists.txt so our > static libs could be built and our unit tests not crash by writing to memory > it did not own. There should be a toggle or something similar to turn off > these features for debug builds as they are for developers of avro only. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (AVRO-2369) Provide external way to construct Schema.Field with default value of 'null'
[
https://issues.apache.org/jira/browse/AVRO-2369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811207#comment-16811207
]
Hudson commented on AVRO-2369:
--
SUCCESS: Integrated in Jenkins build AvroJava #644 (See
[https://builds.apache.org/job/AvroJava/644/])
[AVRO-2369] Add a way to specify a null default for unions with a null. (dkulp:
[https://github.com/apache/avro/commit/fa1a8ef805111c4bb0d6e5fc59e635cf72d33d14])
* (edit) lang/java/avro/src/main/java/org/apache/avro/SchemaBuilder.java
* (edit)
lang/java/avro/src/test/java/org/apache/avro/TestCircularReferences.java
* (edit)
lang/java/avro/src/test/java/org/apache/avro/file/TestSeekableByteArrayInput.java
* (edit) lang/java/avro/src/test/java/org/apache/avro/TestSchemaBuilder.java
* (edit) lang/java/avro/src/main/java/org/apache/avro/Protocol.java
* (edit) lang/java/avro/src/main/java/org/apache/avro/Schema.java
> Provide external way to construct Schema.Field with default value of 'null'
> ---
>
> Key: AVRO-2369
> URL: https://issues.apache.org/jira/browse/AVRO-2369
> Project: Apache Avro
> Issue Type: Task
> Components: java
>Reporter: Ivan Greene
>Assignee: Daniel Kulp
>Priority: Blocker
> Fix For: 1.9.0
>
>
> After making the Schema.Field constructor which takes the default value as a
> JsonNode was made package private, there is no external way to construct a
> field that has a default value of 'null'. Internally that constructor will
> call {{JacksonUtils.toJsonNode(defaultValue)}}, which will return 'null' when
> passed null, and the resulting Field will not have a default value (the json
> node would need to be NullNode instead of simply null itself). This will
> affect projects that need a way to dynamically build schemas and their fields.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (AVRO-2355) Add compressionLevel to ZStandard compression
[ https://issues.apache.org/jira/browse/AVRO-2355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16803893#comment-16803893 ] Hudson commented on AVRO-2355: -- FAILURE: Integrated in Jenkins build AvroJava #625 (See [https://builds.apache.org/job/AvroJava/625/]) AVRO-2355 [java] Add level and checksum options to ZStandard compression (dan: [https://github.com/apache/avro/commit/d81bffd41c348d8ffe11506fe26c66c58a37a580]) * (edit) lang/java/mapred/pom.xml * (edit) lang/java/avro/src/main/java/org/apache/avro/file/ZstandardCodec.java * (add) lang/java/avro/src/main/java/org/apache/avro/file/ZstandardLoader.java * (edit) lang/java/avro/src/test/java/org/apache/avro/TestDataFile.java * (edit) lang/java/mapred/src/test/java/org/apache/avro/mapreduce/TestAvroKeyOutputFormat.java * (add) lang/java/avro/src/test/java/org/apache/avro/file/TestZstandardCodec.java * (edit) lang/java/avro/src/main/java/org/apache/avro/file/CodecFactory.java > Add compressionLevel to ZStandard compression > - > > Key: AVRO-2355 > URL: https://issues.apache.org/jira/browse/AVRO-2355 > Project: Apache Avro > Issue Type: New Feature > Components: java >Reporter: Scott Carey >Priority: Major > Fix For: 1.9.0 > > > ZStandard compression should not be released without support for compression > level selection. > Its biggest advantage is the massive range by which you can select the > compression level, all while keeping decompression throughput very high. > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (AVRO-2362) Cannot Run spotless:apply From Root Pom
[
https://issues.apache.org/jira/browse/AVRO-2362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16804998#comment-16804998
]
Hudson commented on AVRO-2362:
--
FAILURE: Integrated in Jenkins build AvroJava #631 (See
[https://builds.apache.org/job/AvroJava/631/])
AVRO-2362: Enable calling mvn spotless:apply to auto format code (dan:
[https://github.com/apache/avro/commit/db992cf8686ffa681b0c592696b37ad519c33ee6])
* (edit) pom.xml
* (edit) lang/java/pom.xml
> Cannot Run spotless:apply From Root Pom
> ---
>
> Key: AVRO-2362
> URL: https://issues.apache.org/jira/browse/AVRO-2362
> Project: Apache Avro
> Issue Type: Improvement
>Affects Versions: 1.9.0
>Reporter: David Mollitor
>Assignee: Ismaël Mejía
>Priority: Major
> Fix For: 1.9.0
>
>
> I was running {{mvn install}} from the root directory and it failed because
> some of my code was not 'spotless'. In response, I ran {{mvn
> spotless:apply}} but it fails to run from the root avro project directory.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (AVRO-2356) GenericDatumWriter.write must require encoder to be not null
[
https://issues.apache.org/jira/browse/AVRO-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16803750#comment-16803750
]
Hudson commented on AVRO-2356:
--
FAILURE: Integrated in Jenkins build AvroJava #624 (See
[https://builds.apache.org/job/AvroJava/624/])
AVRO-2356: Encoder Cannot Be Null (iemejia:
[https://github.com/apache/avro/commit/8f0eca6990a584707c0cc7690fc1d325803a5287])
* (edit)
lang/java/avro/src/main/java/org/apache/avro/generic/GenericDatumWriter.java
> GenericDatumWriter.write must require encoder to be not null
>
>
> Key: AVRO-2356
> URL: https://issues.apache.org/jira/browse/AVRO-2356
> Project: Apache Avro
> Issue Type: Improvement
> Components: java
>Reporter: David Mollitor
>Assignee: David Mollitor
>Priority: Minor
> Fix For: 1.9.0
>
>
> I was recently doing some debugging and writing tests for Avro and I received
> the following stack trace:
> {code}
> java.lang.NullPointerException: null of E in field f of R
> at
> org.apache.avro.generic.GenericDatumWriter.npe(GenericDatumWriter.java:147)
> at
> org.apache.avro.generic.GenericDatumWriter.writeWithoutConversion(GenericDatumWriter.java:141)
> at
> org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:77)
> at
> org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:64)
> {code}
> That took me quite awhile to decipher. How about me Avro a library for
> laypeople. I propose:
> {code}
> java.lang.NullPointerException: Encoder cannot be null
> at java.util.Objects.requireNonNull(Objects.java:228)
> at
> org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:63)
> at
> org.apache.avro.test.basic.ExtendedEnumPerf.encode(ExtendedEnumPerf.java:26)
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (AVRO-2346) Introduce JMH Performance Testing Framework
[
https://issues.apache.org/jira/browse/AVRO-2346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16804105#comment-16804105
]
Hudson commented on AVRO-2346:
--
FAILURE: Integrated in Jenkins build AvroJava #628 (See
[https://builds.apache.org/job/AvroJava/628/])
AVRO-2346: Introduce JMH Performance Testing Framework (iemejia:
[https://github.com/apache/avro/commit/48ed810a0d1352adcb3f608ff33b186ed433e784])
* (add) lang/java/perf/src/main/java/org/apache/avro/test/basic/MapTest.java
* (edit) pom.xml
* (add)
lang/java/perf/src/main/java/org/apache/avro/test/basic/ExtendedEnumTest.java
* (add) lang/java/perf/src/main/java/org/apache/avro/test/BigRecord.java
* (add) lang/java/perf/src/main/java/org/apache/avro/test/basic/StringTest.java
* (add)
lang/java/perf/src/main/java/org/apache/avro/test/record/ValidatingRecordTest.java
* (add)
lang/java/perf/src/main/java/org/apache/avro/test/record/RecordWithDefaultTest.java
* (add)
lang/java/perf/src/main/java/org/apache/avro/test/reflect/ReflectLongArrayTest.java
* (add) lang/java/perf/src/main/java/org/apache/avro/test/BasicRecord.java
* (add)
lang/java/perf/src/main/java/org/apache/avro/test/generic/GenericStringTest.java
* (add) lang/java/perf/src/main/java/org/apache/avro/test/basic/IntTest.java
* (add)
lang/java/perf/src/main/java/org/apache/avro/test/basic/UnchangedUnionTest.java
* (add) lang/java/perf/src/main/java/org/apache/avro/test/basic/BooleanTest.java
* (add)
lang/java/perf/src/main/java/org/apache/avro/test/reflect/ReflectLargeFloatArrayTest.java
* (add) lang/java/perf/pom.xml
* (add)
lang/java/perf/src/main/java/org/apache/avro/test/record/ResolvingRecordTest.java
* (add)
lang/java/perf/src/main/java/org/apache/avro/test/reflect/ReflectNestedFloatArrayTest.java
* (add) lang/java/perf/src/main/java/org/apache/avro/test/basic/DoubleTest.java
* (add) lang/java/perf/src/main/java/org/apache/avro/test/basic/LongTest.java
* (add)
lang/java/perf/src/main/java/org/apache/avro/test/generic/GenericWithDefaultTest.java
* (add) lang/java/perf/src/main/java/org/apache/avro/test/basic/ArrayTest.java
* (add)
lang/java/perf/src/main/java/org/apache/avro/test/reflect/ReflectDoubleArrayTest.java
* (add)
lang/java/perf/src/main/java/org/apache/avro/test/basic/SmallLongTest.java
* (add) lang/java/perf/src/main/java/org/apache/avro/test/basic/BytesTest.java
* (add) lang/java/perf/src/main/java/org/apache/avro/test/basic/FloatTest.java
* (add)
lang/java/perf/src/main/java/org/apache/avro/test/reflect/ReflectBigRecordTest.java
* (add)
lang/java/perf/src/main/java/org/apache/avro/test/record/RecordWithOutOfOrderTest.java
* (add)
lang/java/perf/src/main/java/org/apache/avro/test/generic/GenericNestedFakeTest.java
* (add)
lang/java/perf/src/main/java/org/apache/avro/test/reflect/ReflectLargeFloatArrayBlockedTest.java
* (add)
lang/java/perf/src/main/java/org/apache/avro/test/record/RecordWithPromotionTest.java
* (add)
lang/java/perf/src/main/java/org/apache/avro/test/reflect/ReflectIntArrayTest.java
* (add)
lang/java/perf/src/main/java/org/apache/avro/test/reflect/ReflectRecordTest.java
* (edit) lang/java/pom.xml
* (add)
lang/java/perf/src/main/java/org/apache/avro/test/reflect/ReflectFloatArrayTest.java
* (add) lang/java/perf/src/main/java/org/apache/avro/Perf.java
* (add)
lang/java/perf/src/main/java/org/apache/avro/test/generic/GenericWithPromotionTest.java
* (add)
lang/java/perf/src/main/java/org/apache/avro/test/generic/GenericNestedTest.java
* (add) lang/java/perf/src/main/java/org/apache/avro/test/record/RecordTest.java
* (add) lang/java/perf/src/main/java/org/apache/avro/test/BasicState.java
* (edit) lang/java/ipc/src/test/java/org/apache/avro/io/Perf.java
* (add) lang/java/perf/README.md
* (add) lang/java/perf/src/main/java/org/apache/avro/test/BasicArrayState.java
* (add)
lang/java/perf/src/main/java/org/apache/avro/test/generic/GenericTest.java
* (add)
lang/java/perf/src/main/java/org/apache/avro/test/reflect/ReflectNestedObjectArrayTest.java
* (add)
lang/java/perf/src/main/java/org/apache/avro/test/generic/GenericWithOutOfOrderTest.java
> Introduce JMH Performance Testing Framework
> ---
>
> Key: AVRO-2346
> URL: https://issues.apache.org/jira/browse/AVRO-2346
> Project: Apache Avro
> Issue Type: New Feature
> Components: java
>Affects Versions: 1.9.0
>Reporter: David Mollitor
>Assignee: David Mollitor
>Priority: Major
> Fix For: 1.9.0
>
>
> There exists already a {{org.apache.avro.io.Perf.java}} testing framework.
> Very well done.
> However, I would like to introduce a new module to the Avro Java project that
> leverages the OpenJDK JMH performance testing framework. The framework will
> allow the testing performance harness to keep up with the latest in
> performance testing.
>
[jira] [Commented] (AVRO-2336) Use Java Standard Charsets - Part 2
[ https://issues.apache.org/jira/browse/AVRO-2336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16804450#comment-16804450 ] Hudson commented on AVRO-2336: -- FAILURE: Integrated in Jenkins build AvroJava #630 (See [https://builds.apache.org/job/AvroJava/630/]) AVRO-2336: Use Java Standard Charsets - Part 2 (iemejia: [https://github.com/apache/avro/commit/c552c1746ff9bac97512fc7db2523f3cff1bd15d]) * (edit) lang/java/ipc-netty/src/test/java/org/apache/avro/ipc/netty/TestNettyServer.java * (edit) lang/java/ipc/src/test/java/org/apache/avro/RPCMetaTestPlugin.java * (edit) lang/java/avro/src/test/java/org/apache/avro/TestNestedRecords.java * (edit) lang/java/tools/src/main/java/org/apache/avro/tool/SchemaNormalizationTool.java * (edit) lang/java/avro/src/main/java/org/apache/avro/SchemaBuilder.java * (edit) lang/java/avro/src/main/java/org/apache/avro/file/DataFileWriter.java * (edit) lang/java/ipc/src/main/java/org/apache/avro/ipc/SaslSocketTransceiver.java * (edit) lang/java/trevni/avro/src/main/java/org/apache/trevni/avro/AvroTrevniOutputFormat.java * (edit) lang/java/trevni/avro/src/main/java/org/apache/trevni/avro/mapreduce/AvroTrevniRecordWriterBase.java * (edit) lang/java/avro/src/main/java/org/apache/avro/io/JsonDecoder.java * (edit) lang/java/avro/src/test/java/org/apache/avro/TestReadingWritingDataInEvolvedSchemas.java * (edit) lang/java/trevni/core/src/main/java/org/apache/trevni/OutputBuffer.java * (edit) lang/java/avro/src/main/java/org/apache/avro/io/JsonEncoder.java * (edit) lang/java/avro/src/main/java/org/apache/avro/io/BinaryEncoder.java * (edit) lang/java/mapred/src/main/java/org/apache/avro/mapred/AvroTextOutputFormat.java * (edit) lang/java/tools/src/main/java/org/apache/avro/tool/TrevniMetadataTool.java * (edit) lang/java/tools/src/main/java/org/apache/avro/tool/ToTextTool.java * (edit) lang/java/avro/src/main/java/org/apache/avro/io/parsing/ResolvingGrammarGenerator.java * (edit) lang/java/mapred/src/test/java/org/apache/avro/mapreduce/TestFsInput.java * (edit) lang/java/avro/src/test/java/org/apache/avro/io/TestBlockingIO.java * (edit) lang/java/avro/src/main/java/org/apache/avro/Protocol.java * (edit) lang/java/ipc/src/main/java/org/apache/avro/ipc/SaslSocketServer.java * (edit) lang/java/tools/src/test/java/org/apache/avro/tool/TestTextFileTools.java * (edit) lang/java/trevni/core/src/main/java/org/apache/trevni/MetaData.java * (edit) lang/java/avro/src/main/java/org/apache/avro/io/ResolvingDecoder.java > Use Java Standard Charsets - Part 2 > --- > > Key: AVRO-2336 > URL: https://issues.apache.org/jira/browse/AVRO-2336 > Project: Apache Avro > Issue Type: Improvement > Components: java >Reporter: David Mollitor >Assignee: David Mollitor >Priority: Major > Fix For: 1.9.0 > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (AVRO-2354) Add CombineAvroKeyValueFileInputFormat in avro-mapred to combine small avro keyvalue files into combineSplit
[ https://issues.apache.org/jira/browse/AVRO-2354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16807180#comment-16807180 ] Hudson commented on AVRO-2354: -- FAILURE: Integrated in Jenkins build AvroJava #633 (See [https://builds.apache.org/job/AvroJava/633/]) AVRO-2354: Add CombineAvroKeyValueFileInputFormat in avro-mapred to (dan: [https://github.com/apache/avro/commit/7cd66387b7a249eabcfbd57fb651613d9eb1b8c4]) * (add) lang/java/mapred/src/test/java/org/apache/avro/mapreduce/TestCombineAvroKeyValueFileInputFormat.java * (add) lang/java/mapred/src/main/java/org/apache/avro/mapreduce/CombineAvroKeyValueFileInputFormat.java > Add CombineAvroKeyValueFileInputFormat in avro-mapred to combine small avro > keyvalue files into combineSplit > > > Key: AVRO-2354 > URL: https://issues.apache.org/jira/browse/AVRO-2354 > Project: Apache Avro > Issue Type: Improvement > Components: java >Reporter: Wang, Xinglong >Assignee: Daniel Kulp >Priority: Minor > Fix For: 1.9.0 > > > In our production env, we generate avro files to track some user behavior > events. Every hour, we will have several avro files created. And daily, we > will run MR to do analysis, when using AvroKeyValueInputFormat, a lot of > small mappers started due to we have small avro files. > A combine file inputformat will be very helpful for such case. > Hadoop already provided some implementation for sequencefile and text file. > This Jira is propose a CombineAvroKeyValueFileInputFormat class to implement > the same for avro keyvalue files. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (AVRO-813) EOFException is thrown during normal operation
[
https://issues.apache.org/jira/browse/AVRO-813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16807222#comment-16807222
]
Hudson commented on AVRO-813:
-
FAILURE: Integrated in Jenkins build AvroJava #634 (See
[https://builds.apache.org/job/AvroJava/634/])
[AVRO-813] Keep the InputStream contract of -1 for eof Patch from Bruno (dkulp:
[https://github.com/apache/avro/commit/a5e0f4ad01703eb4a724e71dfcf99306819c6bf3])
* (edit)
lang/java/avro/src/main/java/org/apache/avro/util/ByteBufferInputStream.java
> EOFException is thrown during normal operation
> --
>
> Key: AVRO-813
> URL: https://issues.apache.org/jira/browse/AVRO-813
> Project: Apache Avro
> Issue Type: Bug
> Components: java
>Affects Versions: 1.5.0
>Reporter: Bruno Dumon
>Assignee: Bruno Dumon
>Priority: Major
> Labels: memex
> Fix For: 1.9.0
>
> Attachments: avro-813-patch.txt
>
>
> In an application that uses Avro as RPC mechanism (with the NettyTransceiver,
> but that's irrelevant), I've noticed in jprofiler that during normal
> operation quite some time was spent creating EOFExceptions:
> {noformat}
> 5.4% - 2,004 ms org.apache.avro.ipc.generic.GenericResponder.readRequest
> 5.0% - 1,871 ms org.apache.avro.generic.GenericDatumReader.read
> 4.9% - 1,832 ms org.apache.avro.generic.GenericDatumReader.read
> 4.9% - 1,832 ms org.apache.avro.generic.GenericDatumReader.readRecord
> 4.5% - 1,670 ms org.apache.avro.generic.GenericDatumReader.read
> 4.5% - 1,670 ms org.apache.avro.generic.GenericDatumReader.readRecord
> 4.3% - 1,596 ms org.apache.avro.generic.GenericDatumReader.read
> 2.8% - 1,048 ms org.apache.avro.generic.GenericDatumReader.readArray
> 1.3% - 477 ms org.apache.avro.io.ValidatingDecoder.arrayNext
> 1.3% - 471 ms org.apache.avro.io.BinaryDecoder.arrayNext
> 1.3% - 466 ms org.apache.avro.io.BinaryDecoder.doReadItemCount
> 1.3% - 466 ms org.apache.avro.io.BinaryDecoder.readLong
> 1.3% - 466 ms org.apache.avro.io.BinaryDecoder.ensureBounds
> 1.3% - 466 ms org.apache.avro.io.BinaryDecoder$ByteSource.compactAndFill
> 1.3% - 466 ms
> org.apache.avro.io.BinaryDecoder$InputStreamByteSource.tryReadRaw
> 1.3% - 466 ms org.apache.avro.util.ByteBufferInputStream.read
> 1.3% - 466 ms org.apache.avro.util.ByteBufferInputStream.getBuffer
> 1.3% - 466 ms java.io.EOFException.
> 1.3% - 466 ms java.io.IOException.
> 1.2% - 460 ms java.lang.Exception.
> 1.2% - 460 ms java.lang.Throwable.
> 1.2% - 460 ms java.lang.Throwable.fillInStackTrace
> {noformat}
> These exceptions are produced by the ByteBufferInputStream (which modifies
> InputStream's contract: return -1 at eof), but are catched higher up by the
> tryReadRaw method.
> What happens is this:
> The message in question has an (empty) array at the end of its message, thus
> the reader tries to read the size of this array in BinaryDecoder.readLong.
> This calls ensureBounds(10), whose contract is that it should read 10 bytes
> if they are available, and otherwise be quiet. ensureBounds calls via
> compactAndFill the tryReadRaw method. It is this method which catches the
> EOFException, because it only 'tries' to read so many bytes.
> Note that InputStreamByteSource.readRaw (without the 'try' part) does itself
> check if read < 0 in order to throw EOFException, making the throwing of
> EOFException in ByteBufferInputStream unnecessary (for this particular usage).
> There was some talk about EOFException in AVRO-392 too, though it seems this
> particular common case was not mentioned there. When using Avro RPC, or more
> in general, when using Avro to read small messages rather than large files,
> it seems like one can very easily run into this EOFException situation, which
> hurts performance.
> I'll attach a patch which simply removes the throwing of EOFException in
> ByteBufferInputStream, but this will likely break other cases which rely on
> the EOFException being thrown (haven't researched this to the bottom).
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (AVRO-2364) Use Jackson TokenBuffer in JsonDecoder
[ https://issues.apache.org/jira/browse/AVRO-2364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16807179#comment-16807179 ] Hudson commented on AVRO-2364: -- FAILURE: Integrated in Jenkins build AvroJava #633 (See [https://builds.apache.org/job/AvroJava/633/]) AVRO-2364 Use Jackson TokenBuffer in JsonDecoder (dan: [https://github.com/apache/avro/commit/dbf977989105217b37a798d30793d90e747eceb1]) * (edit) lang/java/avro/src/main/java/org/apache/avro/io/JsonDecoder.java > Use Jackson TokenBuffer in JsonDecoder > -- > > Key: AVRO-2364 > URL: https://issues.apache.org/jira/browse/AVRO-2364 > Project: Apache Avro > Issue Type: Improvement > Components: java >Affects Versions: 1.8.2 >Reporter: Anthony Miyaguchi >Assignee: Daniel Kulp >Priority: Trivial > Fix For: 1.9.0 > > > The JsonDecoder implements a class for replaying parts of the JSON stream > when accessing fields out of order. > This module can take advantage of > [TokenBuffers|http://static.javadoc.io/com.fasterxml.jackson.core/jackson-databind/2.9.8/com/fasterxml/jackson/databind/util/TokenBuffer.html] > to reduce code size. This buffer can be read back as a parser. > > [https://github.com/apache/avro/blob/db992cf8686ffa681b0c592696b37ad519c33ee6/lang/java/avro/src/main/java/org/apache/avro/io/JsonDecoder.java#L514-L754] > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (AVRO-2365) Enhancements to induce maven plugin goal
[ https://issues.apache.org/jira/browse/AVRO-2365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16807178#comment-16807178 ] Hudson commented on AVRO-2365: -- FAILURE: Integrated in Jenkins build AvroJava #633 (See [https://builds.apache.org/job/AvroJava/633/]) AVRO-2365 Enhancements to maven-plugin induce goal (dan: [https://github.com/apache/avro/commit/451deec474935db54824069dcf5cfe7ae49a1b11]) * (edit) lang/java/maven-plugin/src/main/java/org/apache/avro/mojo/InduceMojo.java * (edit) lang/java/maven-plugin/src/test/resources/unit/protocol/induce-pom.xml * (edit) lang/java/maven-plugin/src/test/resources/unit/schema/induce-pom.xml * (edit) lang/java/maven-plugin/src/test/java/org/apache/avro/mojo/TestInduceMojo.java AVRO-2365: Allow using custom ReflectData impl (dan: [https://github.com/apache/avro/commit/22c4685e1711235e7435a2acbdb4df48f39e3f92]) * (edit) lang/java/maven-plugin/src/main/java/org/apache/avro/mojo/InduceMojo.java > Enhancements to induce maven plugin goal > > > Key: AVRO-2365 > URL: https://issues.apache.org/jira/browse/AVRO-2365 > Project: Apache Avro > Issue Type: Improvement > Components: java >Reporter: Ivan Greene >Assignee: Daniel Kulp >Priority: Major > Fix For: 1.9.0 > > > Before a release of 1.8.3 or 1.9.0 which will introduce the new 'induce' > maven plugin goal (see AVRO-1749), there are a few issues with it which in my > mind are critical to enable real-world use of the goal: > * Allow excluding classes based on a pattern, and/or the ability to specify > multiple sourceDirectories > * Option to specify whether to use ReflectData.AllowNull or ReflectData > * Throw MojoExecutionException with an informative message when appropriate, > instead of just printing stacktraces. This is very important, we definitely > need a build to fail when we hit a problem. > * Use the current project defined encoding rather than hard coded UTF-8. > * Use try-with-resources to ensure the PrintWriter gets closed in the event > of exception > Nice to haves: > * Specify custom ReflectData implementation (i.e user declared extensions) > to be used > * Specify separate output directories for schemata and protocols (these > could both default to the single output directory if not specified > individually) > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (AVRO-2370) Update snappy to version 1.1.7.3
[ https://issues.apache.org/jira/browse/AVRO-2370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16812291#comment-16812291 ] Hudson commented on AVRO-2370: -- SUCCESS: Integrated in Jenkins build AvroJava #646 (See [https://builds.apache.org/job/AvroJava/646/]) AVRO-2370: Update snappy to version 1.1.7.3 (iemejia: [https://github.com/apache/avro/commit/c847de572528d64dfa28ad5a3a67deac692c3fe1]) * (edit) lang/java/pom.xml > Update snappy to version 1.1.7.3 > > > Key: AVRO-2370 > URL: https://issues.apache.org/jira/browse/AVRO-2370 > Project: Apache Avro > Issue Type: Improvement >Reporter: Ismaël Mejía >Assignee: Ismaël Mejía >Priority: Minor > Fix For: 1.9.0 > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (AVRO-2315) Update zstd-jni to version 1.3.8-6
[ https://issues.apache.org/jira/browse/AVRO-2315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16812290#comment-16812290 ] Hudson commented on AVRO-2315: -- SUCCESS: Integrated in Jenkins build AvroJava #646 (See [https://builds.apache.org/job/AvroJava/646/]) AVRO-2315 Update zstd-jni to version 1.3.8-6 (iemejia: [https://github.com/apache/avro/commit/95534f4ca63293fc51df3a533f07b5a9cae7f473]) * (edit) lang/java/pom.xml > Update zstd-jni to version 1.3.8-6 > -- > > Key: AVRO-2315 > URL: https://issues.apache.org/jira/browse/AVRO-2315 > Project: Apache Avro > Issue Type: Improvement > Components: java >Affects Versions: 1.9.0 >Reporter: Ismaël Mejía >Assignee: Ismaël Mejía >Priority: Minor > Fix For: 1.9.0 > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (AVRO-2319) Update grpc to version 1.19.0
[ https://issues.apache.org/jira/browse/AVRO-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16812292#comment-16812292 ] Hudson commented on AVRO-2319: -- SUCCESS: Integrated in Jenkins build AvroJava #646 (See [https://builds.apache.org/job/AvroJava/646/]) AVRO-2319: Update grpc to version 1.19.0 (iemejia: [https://github.com/apache/avro/commit/d0354df648e8b0067f87ee162edf322dff60523c]) * (edit) lang/java/pom.xml > Update grpc to version 1.19.0 > - > > Key: AVRO-2319 > URL: https://issues.apache.org/jira/browse/AVRO-2319 > Project: Apache Avro > Issue Type: Improvement > Components: java >Affects Versions: 1.8.2 >Reporter: Fokko Driesprong >Assignee: Ismaël Mejía >Priority: Major > Fix For: 1.9.0 > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (AVRO-2318) Test Avro's Hadoop related modules with Hadoop 3
[ https://issues.apache.org/jira/browse/AVRO-2318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16812594#comment-16812594 ] Hudson commented on AVRO-2318: -- SUCCESS: Integrated in Jenkins build AvroJava #647 (See [https://builds.apache.org/job/AvroJava/647/]) AVRO-2318: Add hadoop3 profile run to validate support of Hadoop 3 (iemejia: [https://github.com/apache/avro/commit/a02495613d514e984ff486f334890099b1c922e7]) * (edit) lang/java/ipc-jetty/pom.xml * (edit) lang/java/pom.xml * (edit) lang/java/build.sh > Test Avro's Hadoop related modules with Hadoop 3 > > > Key: AVRO-2318 > URL: https://issues.apache.org/jira/browse/AVRO-2318 > Project: Apache Avro > Issue Type: Improvement > Components: java >Affects Versions: 1.8.2 >Reporter: Fokko Driesprong >Assignee: Ismaël Mejía >Priority: Major > Fix For: 1.9.0 > > > We should provide a way to support Hadoop 3 or at least to ensure that Avro's > existing codebase does not break if Hadoop's `hadoop-client` library is > passed on version 3.x -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (AVRO-1981) ReflectionTypeLoadException
[
https://issues.apache.org/jira/browse/AVRO-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782116#comment-16782116
]
Hudson commented on AVRO-1981:
--
SUCCESS: Integrated in Jenkins build AvroJava #609 (See
[https://builds.apache.org/job/AvroJava/609/])
AVRO-1981: Catch exceptions loading types from assemblies in C# (dan:
[https://github.com/apache/avro/commit/846a9a1bb85e9832b696970c96e6089d43c3ee6b])
* (edit) lang/csharp/src/apache/main/Specific/ObjectCreator.cs
> ReflectionTypeLoadException
> ---
>
> Key: AVRO-1981
> URL: https://issues.apache.org/jira/browse/AVRO-1981
> Project: Apache Avro
> Issue Type: Bug
> Components: csharp
>Affects Versions: 1.8.2
>Reporter: Josh Steward
>Assignee: Brian Lachniet
>Priority: Minor
> Fix For: 1.9.0
>
>
> In the ObjectCreator the call to FindType(name, throwError) can throw a
> ReflectionTypeLoadException during the call to assembly.GetTypes() if any of
> the types are not able to load, MSDN link below for ref. This effectively
> kills the entire deserialization process. I put in a simple workaround to
> just continue if this happens. In my particular case it was trying to load
> types from a devexpress test runner dll.
> https://msdn.microsoft.com/en-us/library/system.reflection.assembly.gettypes(v=vs.110).aspx
> private Type FindType(string name,bool throwError)
> {
> //other code
> foreach (Assembly assembly in assemblies)
> {
> // Fix for Mono 3.0.10
> if (assembly.FullName.StartsWith("MonoDevelop.NUnit"))
> continue;
> /*Added catch in case assembly contains unloadable
> types*/
> try
> {
> types = assembly.GetTypes();
> }
> catch (ReflectionTypeLoadException ex)
> {
> continue;
> }
> //other code
> }
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (AVRO-2329) Avro C# hides inner exceptions
[
https://issues.apache.org/jira/browse/AVRO-2329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782117#comment-16782117
]
Hudson commented on AVRO-2329:
--
SUCCESS: Integrated in Jenkins build AvroJava #609 (See
[https://builds.apache.org/job/AvroJava/609/])
AVRO-2329: Set inner exception when available (dan:
[https://github.com/apache/avro/commit/a56108835a0aa35530c8f367ce8a50d0c5861192])
* (edit) lang/csharp/src/apache/test/Schema/SchemaTests.cs
* (edit) lang/csharp/src/apache/main/Generic/GenericReader.cs
* (edit) lang/csharp/src/apache/main/Generic/GenericWriter.cs
* (edit) lang/csharp/src/apache/main/File/DataFileReader.cs
* (edit) lang/csharp/src/apache/main/Specific/SpecificWriter.cs
* (edit) lang/csharp/src/apache/main/Specific/SpecificReader.cs
> Avro C# hides inner exceptions
> --
>
> Key: AVRO-2329
> URL: https://issues.apache.org/jira/browse/AVRO-2329
> Project: Apache Avro
> Issue Type: Improvement
> Components: csharp
>Affects Versions: 1.8.2
>Reporter: Brian Lachniet
>Assignee: Brian Lachniet
>Priority: Major
> Fix For: 1.9.0
>
>
> The Avro C# library hides the inner exception in many places where it throws
> {{AvroException}}. This makes it difficult to track down the root cause of
> some problems.
> Update places that throw {{AvroException}} to include the inner exception
> when available/applicable.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (AVRO-2324) Update Apache parent POM to version 21
[ https://issues.apache.org/jira/browse/AVRO-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16783234#comment-16783234 ] Hudson commented on AVRO-2324: -- FAILURE: Integrated in Jenkins build AvroJava #610 (See [https://builds.apache.org/job/AvroJava/610/]) [AVRO-2324] Bump Apache to 21 (iemejia: [https://github.com/apache/avro/commit/3ec3db79af89d5674c2cfe5cedb7c784787e9bcd]) * (edit) pom.xml > Update Apache parent POM to version 21 > -- > > Key: AVRO-2324 > URL: https://issues.apache.org/jira/browse/AVRO-2324 > Project: Apache Avro > Issue Type: Improvement >Affects Versions: 1.8.2 >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > Fix For: 1.9.0 > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (AVRO-1810) GenericDatumWriter broken with Enum
[
https://issues.apache.org/jira/browse/AVRO-1810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16783909#comment-16783909
]
Hudson commented on AVRO-1810:
--
FAILURE: Integrated in Jenkins build AvroJava #612 (See
[https://builds.apache.org/job/AvroJava/612/])
AVRO-1810: Fix GenericDatumWriter w/ enums (#462) (fokko:
[https://github.com/apache/avro/commit/4a3609cd854e9ef5bdda5b43e188a3309a93aef9])
* (edit) lang/java/tools/src/test/compiler/output-string/Position.java
* (edit) lang/java/tools/src/test/compiler/output/Position.java
* (add)
lang/java/avro/src/test/java/org/apache/avro/generic/TestGenericConcreteEnum.java
* (edit)
lang/java/compiler/src/main/velocity/org/apache/avro/compiler/specific/templates/java/classic/enum.vm
* (edit)
lang/java/avro/src/main/java/org/apache/avro/generic/GenericEnumSymbol.java
* (edit) lang/java/avro/src/test/java/org/apache/avro/TypeEnum.java
* (edit) lang/java/avro/src/main/java/org/apache/avro/generic/GenericData.java
* (edit)
lang/java/tools/src/test/compiler/output-string/avro/examples/baseball/Position.java
> GenericDatumWriter broken with Enum
> ---
>
> Key: AVRO-1810
> URL: https://issues.apache.org/jira/browse/AVRO-1810
> Project: Apache Avro
> Issue Type: Bug
> Components: java
>Affects Versions: 1.8.0
>Reporter: Ryon Day
>Assignee: Fokko Driesprong
>Priority: Blocker
> Fix For: 1.9.0, 1.8.4
>
>
> {panel:title=Description|titleBGColor=#3FA|bgColor=#DDD}
> Using the GenericDatumWriter with either Generic OR SpecificRecord will break
> if an Enum is present.
> {panel}
> {panel:title=Steps To Reproduce|titleBGColor=#8DB|bgColor=#DDD}
> I have been tracking Avro decoding oddities for a while.
> The tests for this issue can be found
> [here|https://github.com/ryonday/avroDecodingHelp/blob/master/src/test/java/com/ryonday/test/Avro180EnumFail.java]
> {panel}
> {panel:title=Notes|titleBGColor=#3AF|bgColor=#DDD}
> Due to the debacle that is the Avro "UTF8" object, we have been avoiding it
> by using the following scheme:
> * Write incoming records to a byte array using the GenericDatumWriter
> * Read back the byte array to our compiled Java domain objects using a
> SpecificDatumWriter
> This worked great with Avro 1.7.7, and this is a binary-incompatable breaking
> change with 1.8.0.
> This would appear to be caused by an addition in the
> {{GenericDatumWriter:163-164}}:
> {code}
> if (!data.isEnum(datum))
> throw new AvroTypeException("Not an enum: "+datum);
> {code}
> {panel}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (AVRO-2334) Update Docs to Reference Java 8 API
[ https://issues.apache.org/jira/browse/AVRO-2334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16786527#comment-16786527 ] Hudson commented on AVRO-2334: -- FAILURE: Integrated in Jenkins build AvroJava #614 (See [https://builds.apache.org/job/AvroJava/614/]) AVRO-2334: Update Docs to Reference Java 8 API (#469) (nandorkollar: [https://github.com/apache/avro/commit/02e08dafd35b31e9e596564b0996dc63bd2fb1ed]) * (edit) lang/java/pom.xml > Update Docs to Reference Java 8 API > --- > > Key: AVRO-2334 > URL: https://issues.apache.org/jira/browse/AVRO-2334 > Project: Apache Avro > Issue Type: Improvement > Components: java >Reporter: David Mollitor >Assignee: David Mollitor >Priority: Trivial > Fix For: 1.9.0 > > > https://github.com/apache/avro/blob/master/lang/java/pom.xml#L113-L114 > > [https://github.com/apache/avro/blob/master/lang/java/pom.xml#L193] > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (AVRO-2339) Remove Unused LengthLimitedInputStream
[ https://issues.apache.org/jira/browse/AVRO-2339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16786565#comment-16786565 ] Hudson commented on AVRO-2339: -- FAILURE: Integrated in Jenkins build AvroJava #615 (See [https://builds.apache.org/job/AvroJava/615/]) AVRO-2339: Remove Unused LengthLimitedInputStream (#472) (nandorkollar: [https://github.com/apache/avro/commit/2f2025201bf937cb163d263396a097bbc5fad1b0]) * (delete) lang/java/avro/src/main/java/org/apache/avro/file/LengthLimitedInputStream.java * (delete) lang/java/avro/src/test/java/org/apache/avro/file/TestLengthLimitedInputStream.java > Remove Unused LengthLimitedInputStream > -- > > Key: AVRO-2339 > URL: https://issues.apache.org/jira/browse/AVRO-2339 > Project: Apache Avro > Issue Type: Improvement > Components: java >Affects Versions: 1.9.0 >Reporter: David Mollitor >Assignee: David Mollitor >Priority: Minor > Fix For: 1.9.0 > > > Package scoped class and it is not used at all. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (AVRO-2338) Remove Deprecated Use of JsonStringEncoder
[
https://issues.apache.org/jira/browse/AVRO-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16786620#comment-16786620
]
Hudson commented on AVRO-2338:
--
SUCCESS: Integrated in Jenkins build AvroJava #616 (See
[https://builds.apache.org/job/AvroJava/616/])
AVRO-2338: Remove Deprecated Use of JsonStringEncoder (#471) (nandorkollar:
[https://github.com/apache/avro/commit/f173ae8d690b5f90e8cc5899b654762a9d11e17d])
* (edit) lang/java/avro/src/main/java/org/apache/avro/SchemaBuilder.java
> Remove Deprecated Use of JsonStringEncoder
> --
>
> Key: AVRO-2338
> URL: https://issues.apache.org/jira/browse/AVRO-2338
> Project: Apache Avro
> Issue Type: Improvement
> Components: java
>Affects Versions: 1.9.0
>Reporter: David Mollitor
>Assignee: David Mollitor
>Priority: Minor
> Fix For: 1.9.0
>
>
> {code:java|title=SchemaBuilder.java}
> char[] quoted = JsonStringEncoder.getInstance().quoteAsString(s);
> {code}
> [Deprecated. Since 2.9.2 use BufferRecyclers.getJsonStringEncoder()
> instead|https://fasterxml.github.io/jackson-core/javadoc/2.9/com/fasterxml/jackson/core/io/JsonStringEncoder.html#getInstance--]
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (AVRO-2352) BinaryDecoder isEnd
[ https://issues.apache.org/jira/browse/AVRO-2352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16790816#comment-16790816 ] Hudson commented on AVRO-2352: -- FAILURE: Integrated in Jenkins build AvroJava #619 (See [https://builds.apache.org/job/AvroJava/619/]) AVRO-2352: Cleanup BinaryDecoder isEnd Method (dan: [https://github.com/apache/avro/commit/6fddbae08fcf0aba1d51289d1b90681c3bfa9477]) * (edit) lang/java/avro/src/main/java/org/apache/avro/io/BinaryDecoder.java > BinaryDecoder isEnd > --- > > Key: AVRO-2352 > URL: https://issues.apache.org/jira/browse/AVRO-2352 > Project: Apache Avro > Issue Type: Improvement > Components: java >Affects Versions: 1.9.0 >Reporter: David Mollitor >Assignee: David Mollitor >Priority: Trivial > > * Add additional JavaDoc > * Simplify code -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (AVRO-2349) Review Usage of Arrays.asList
[
https://issues.apache.org/jira/browse/AVRO-2349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16790818#comment-16790818
]
Hudson commented on AVRO-2349:
--
FAILURE: Integrated in Jenkins build AvroJava #619 (See
[https://builds.apache.org/job/AvroJava/619/])
AVRO-2349: Review Usage of Arrays.asList (dan:
[https://github.com/apache/avro/commit/0e6977d1b89c9a103cec0be5bd4bbeceb740d50f])
* (edit) lang/java/avro/src/main/java/org/apache/avro/Schema.java
* (edit)
lang/java/protobuf/src/main/java/org/apache/avro/protobuf/ProtobufData.java
* (edit) lang/java/thrift/src/main/java/org/apache/avro/thrift/ThriftData.java
* (edit)
lang/java/compiler/src/main/java/org/apache/avro/compiler/specific/SpecificCompiler.java
* (edit) lang/java/avro/src/main/java/org/apache/avro/specific/SpecificData.java
* (edit)
lang/java/compiler/src/main/java/org/apache/avro/compiler/schema/Schemas.java
> Review Usage of Arrays.asList
> -
>
> Key: AVRO-2349
> URL: https://issues.apache.org/jira/browse/AVRO-2349
> Project: Apache Avro
> Issue Type: Improvement
> Components: java
>Affects Versions: 1.9.0
>Reporter: David Mollitor
>Assignee: David Mollitor
>Priority: Minor
>
> The method {{Arrays.asList}} is used in several different places in the
> project and is used differently each place. I have reviewed all uses of it
> and made it consistent and removed it in a couple of places that would be
> better implemented with a different approach.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (AVRO-2350) Use Switch Statement for Strings in LogicalTypes
[
https://issues.apache.org/jira/browse/AVRO-2350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16790817#comment-16790817
]
Hudson commented on AVRO-2350:
--
FAILURE: Integrated in Jenkins build AvroJava #619 (See
[https://builds.apache.org/job/AvroJava/619/])
AVRO-2350: Use Switch Statement for Strings in LogicalTypes (dan:
[https://github.com/apache/avro/commit/63e02101cf94d8ab0e1ae01baafe04c5767aa371])
* (edit) lang/java/avro/src/main/java/org/apache/avro/LogicalTypes.java
> Use Switch Statement for Strings in LogicalTypes
>
>
> Key: AVRO-2350
> URL: https://issues.apache.org/jira/browse/AVRO-2350
> Project: Apache Avro
> Issue Type: Improvement
> Components: java
>Affects Versions: 1.9.0
>Reporter: David Mollitor
>Assignee: David Mollitor
>Priority: Minor
>
> https://github.com/apache/avro/blob/master/lang/java/avro/src/main/java/org/apache/avro/LogicalTypes.java#L59-L101
> {quote}
> The switch statement compares the String object in its expression with the
> expressions associated with each case label as if it were using the
> String.equals method; consequently, the comparison of String objects in
> switch statements is case sensitive. The Java compiler generates generally
> more efficient bytecode from switch statements that use String objects than
> from chained if-then-else statements.
> https://docs.oracle.com/javase/7/docs/technotes/guides/language/strings-switch.html
> {quote}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (AVRO-2351) Long/Int in Binary Decoder
[
https://issues.apache.org/jira/browse/AVRO-2351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16790814#comment-16790814
]
Hudson commented on AVRO-2351:
--
FAILURE: Integrated in Jenkins build AvroJava #619 (See
[https://builds.apache.org/job/AvroJava/619/])
AVRO-2351: Long/Int in Binary Decoder (dan:
[https://github.com/apache/avro/commit/d195e1fc626f960eef7ef9a5aaeb3851cb4fda31])
* (edit) lang/java/avro/src/main/java/org/apache/avro/io/BinaryDecoder.java
> Long/Int in Binary Decoder
> --
>
> Key: AVRO-2351
> URL: https://issues.apache.org/jira/browse/AVRO-2351
> Project: Apache Avro
> Issue Type: Improvement
> Components: java
>Affects Versions: 1.9.0
>Reporter: David Mollitor
>Assignee: David Mollitor
>Priority: Minor
>
> {code:java|title=BinaryDecoder.java}
> /**
>* Returns the number of items to follow in the current array or map.
> Returns
>* 0 if there are no more items in the current array and the array/map has
>* ended.
>*
>* @throws IOException
>*/
> protected long doReadItemCount() throws IOException {
> long result = readLong();
> if (result < 0) {
> readLong(); // Consume byte-count if present
> result = -result;
> }
> return result;
> }
> /**
>* Reads the count of items in the current array or map and skip those
> items,
>* if possible. If it could skip the items, keep repeating until there are
> no
>* more items left in the array or map. If items cannot be skipped (because
>* byte count to skip is not found in the stream) return the count of the
>* items found. The client needs to skip the items individually.
>*
>* @return Zero if there are no more items to skip and end of array/map is
>* reached. Positive number if some items are found that cannot be
>* skipped and the client needs to skip them individually.
>* @throws IOException
>*/
> private long doSkipItems() throws IOException {
> long result = readInt();
> while (result < 0) {
> long bytecount = readLong();
> doSkipBytes(bytecount);
> result = readInt();
> }
> return result;
> }
> {code}
> https://github.com/apache/avro/blob/master/lang/java/avro/src/main/java/org/apache/avro/io/BinaryDecoder.java#L370-L406
> The spec states that the sizes are {{long}} values.The {{doReadItemCount}}
> method has it correct and the {{doSkipItems}} method uses {{int}} values
> values.
> https://avro.apache.org/docs/1.8.2/spec.html#binary_encode_complex
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (AVRO-2331) Remove commons-codec dependency
[ https://issues.apache.org/jira/browse/AVRO-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16787173#comment-16787173 ] Hudson commented on AVRO-2331: -- FAILURE: Integrated in Jenkins build AvroJava #617 (See [https://builds.apache.org/job/AvroJava/617/]) AVRO-2331: Use JDK Base64 (dan: [https://github.com/apache/avro/commit/e16f30abf6d1b7befcc36f49a5bc39166a75f814]) * (edit) lang/java/mapred/src/main/java/org/apache/avro/mapred/AvroMultipleInputs.java * (edit) lang/java/pom.xml * (edit) lang/java/mapred/pom.xml > Remove commons-codec dependency > --- > > Key: AVRO-2331 > URL: https://issues.apache.org/jira/browse/AVRO-2331 > Project: Apache Avro > Issue Type: Improvement >Reporter: David Mollitor >Assignee: David Mollitor >Priority: Minor > Fix For: 1.9.0 > > > Use [JDK > Base64|https://docs.oracle.com/javase/8/docs/api/java/util/Base64.html] > instead of Apache Codec. > Will allow for removal of Apache Commons Codec dependency. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (AVRO-2333) Remove commons-logging dependency
[
https://issues.apache.org/jira/browse/AVRO-2333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16787172#comment-16787172
]
Hudson commented on AVRO-2333:
--
FAILURE: Integrated in Jenkins build AvroJava #617 (See
[https://builds.apache.org/job/AvroJava/617/])
AVRO-2333: Remove commons-logging dependency (dan:
[https://github.com/apache/avro/commit/f715c974b9f7eb4d4809c1e0f04b7b4ff12837b3])
* (edit) lang/java/tools/pom.xml
* (edit) lang/java/pom.xml
> Remove commons-logging dependency
> -
>
> Key: AVRO-2333
> URL: https://issues.apache.org/jira/browse/AVRO-2333
> Project: Apache Avro
> Issue Type: Improvement
>Reporter: David Mollitor
>Assignee: David Mollitor
>Priority: Minor
>
> Remove dependency on {{commons-logging}}. Now using {{SLF4J}} + {{Log4J}}.
> https://github.com/apache/avro/blob/master/lang/java/tools/pom.xml#L221-L225
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (AVRO-2341) Simplify ByteArrayByteSource Min Buffer Size
[ https://issues.apache.org/jira/browse/AVRO-2341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789904#comment-16789904 ] Hudson commented on AVRO-2341: -- SUCCESS: Integrated in Jenkins build AvroJava #618 (See [https://builds.apache.org/job/AvroJava/618/]) AVRO-2341: Simplify ByteArrayByteSource Min Buffer Size (dan: [https://github.com/apache/avro/commit/8c3c590d7bfa6d486f5741c5e2f5214a1f2436c1]) * (edit) lang/java/avro/src/main/java/org/apache/avro/io/BinaryDecoder.java > Simplify ByteArrayByteSource Min Buffer Size > > > Key: AVRO-2341 > URL: https://issues.apache.org/jira/browse/AVRO-2341 > Project: Apache Avro > Issue Type: Improvement > Components: java >Reporter: David Mollitor >Assignee: David Mollitor >Priority: Trivial > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (AVRO-2347) Use Java8 Map API for SpecificData
[ https://issues.apache.org/jira/browse/AVRO-2347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789905#comment-16789905 ] Hudson commented on AVRO-2347: -- SUCCESS: Integrated in Jenkins build AvroJava #618 (See [https://builds.apache.org/job/AvroJava/618/]) AVRO-2347: Use Java8 Map API for SpecificData (dan: [https://github.com/apache/avro/commit/6d0698705299e67e2f463216b95bf962ab6f11a2]) * (edit) lang/java/avro/src/main/java/org/apache/avro/specific/SpecificData.java > Use Java8 Map API for SpecificData > -- > > Key: AVRO-2347 > URL: https://issues.apache.org/jira/browse/AVRO-2347 > Project: Apache Avro > Issue Type: Improvement > Components: java >Affects Versions: 1.9.0 >Reporter: David Mollitor >Assignee: David Mollitor >Priority: Minor > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (AVRO-2340) Use JDK compareTo and hashcode Methods
[
https://issues.apache.org/jira/browse/AVRO-2340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789903#comment-16789903
]
Hudson commented on AVRO-2340:
--
SUCCESS: Integrated in Jenkins build AvroJava #618 (See
[https://builds.apache.org/job/AvroJava/618/])
AVRO-2340: Use JDK compareTo and hashcode Methods (dan:
[https://github.com/apache/avro/commit/ef8349ffd6da5c6f4693ac46548c96e22eeb7cd7])
* (edit) lang/java/avro/src/main/java/org/apache/avro/reflect/ReflectData.java
* (edit) lang/java/avro/src/main/java/org/apache/avro/io/BinaryData.java
* (edit) lang/java/avro/src/main/java/org/apache/avro/generic/GenericData.java
> Use JDK compareTo and hashcode Methods
> --
>
> Key: AVRO-2340
> URL: https://issues.apache.org/jira/browse/AVRO-2340
> Project: Apache Avro
> Issue Type: Improvement
> Components: java
>Reporter: David Mollitor
>Assignee: David Mollitor
>Priority: Minor
>
> There are a few different ways that {{hashCode()}} and {{compare}} are
> implemented. Just use the JDK methods.
> I set a breakpoint and ran the 'perf' program, but it did not hit, so these
> methods are not on the critical paths. Best to do this work in a consistent
> behavior.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (AVRO-2106) Revisit dependencies on Jetty, servlet-api, and Netty
[ https://issues.apache.org/jira/browse/AVRO-2106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16763068#comment-16763068 ] Hudson commented on AVRO-2106: -- FAILURE: Integrated in Jenkins build AvroJava #602 (See [https://builds.apache.org/job/AvroJava/602/]) [AVRO-2106] Split netty/jetty out of avro-ipc (dan: [https://github.com/apache/avro/commit/ac95febf82b15ffa564cac1d92475cdf6efed9f6]) * (add) lang/java/ipc-jetty/src/test/java/org/apache/avro/ipc/jetty/StatsPluginOverhead.java * (add) lang/java/ipc-jetty/src/test/resources/org/apache/avro/ipc/servercert.p12 * (edit) lang/java/mapred/pom.xml * (edit) lang/java/ipc/pom.xml * (edit) lang/java/pom.xml * (delete) lang/java/ipc/src/test/java/org/apache/avro/ipc/TestNettyServerWithCallbacks.java * (delete) lang/java/ipc/src/test/java/org/apache/avro/ipc/stats/TestStatsPluginAndServlet.java * (delete) lang/java/ipc/src/main/java/org/apache/avro/ipc/stats/StatsServer.java * (edit) lang/java/ipc/src/main/java/org/apache/avro/ipc/Ipc.java * (edit) lang/java/archetypes/avro-service-archetype/src/main/pom/pom.xml * (delete) lang/java/ipc/src/test/java/org/apache/avro/ipc/TestNettyServerWithSSL.java * (delete) lang/java/ipc/src/test/java/org/apache/avro/ipc/TestNettyServerWithCompression.java * (add) lang/java/ipc-netty/src/main/java/org/apache/avro/ipc/netty/NettyServer.java * (delete) lang/java/ipc/src/main/java/org/apache/avro/ipc/HttpServer.java * (delete) lang/java/ipc/src/main/java/org/apache/avro/ipc/stats/StaticServlet.java * (add) lang/java/ipc-netty/src/test/java/org/apache/avro/ipc/netty/TestNettyServerConcurrentExecution.java * (add) lang/java/ipc-netty/src/test/truststore * (add) lang/java/ipc-netty/src/main/java/org/apache/avro/ipc/netty/NettyTransceiver.java * (add) lang/java/ipc-netty/src/test/resources/org/apache/avro/ipc/servercert.p12 * (delete) lang/java/ipc/src/test/java/org/apache/avro/ipc/NettyTransceiverWhenFailsToConnect.java * (edit) lang/java/ipc/src/main/java/org/apache/avro/ipc/stats/StatsPlugin.java * (add) lang/java/ipc-jetty/src/main/java/org/apache/avro/ipc/jetty/HttpServer.java * (edit) lang/java/compiler/pom.xml * (delete) lang/java/ipc/src/test/java/org/apache/avro/TestBulkData.java * (add) lang/java/ipc-jetty/src/test/java/org/apache/avro/ipc/jetty/TestBulkData.java * (delete) lang/java/ipc/src/test/java/org/apache/avro/TestProtocolHttps.java * (delete) lang/java/ipc/src/test/java/org/apache/avro/ipc/stats/StatsPluginOverhead.java * (edit) lang/java/mapred/src/main/java/org/apache/avro/mapred/tether/TetheredProcess.java * (edit) lang/java/ipc/src/main/java/org/apache/avro/ipc/stats/StatsServlet.java * (add) lang/java/ipc-jetty/src/main/java/org/apache/avro/ipc/jetty/StatsServer.java * (delete) lang/java/ipc/src/main/java/org/apache/avro/ipc/NettyTransceiver.java * (edit) lang/java/mapred/src/test/java/org/apache/avro/mapred/tether/TetherTaskRunner.java * (delete) lang/java/ipc/src/test/java/org/apache/avro/TestProtocolNetty.java * (add) lang/java/ipc-netty/pom.xml * (edit) lang/java/archetypes/avro-service-archetype/src/main/resources/archetype-resources/src/main/java/transport/SimpleOrderServiceClient.java * (delete) lang/java/ipc/src/test/java/org/apache/avro/ipc/TestNettyServer.java * (delete) lang/java/ipc/src/test/java/org/apache/avro/ipc/TestNettyServerConcurrentExecution.java * (edit) lang/java/archetypes/avro-service-archetype/src/main/resources/archetype-resources/src/main/java/transport/SimpleOrderServiceEndpoint.java * (add) lang/java/ipc-netty/src/test/java/org/apache/avro/ipc/netty/TestNettyTransceiverWhenServerStops.java * (add) lang/java/ipc-netty/src/test/java/org/apache/avro/ipc/netty/TestNettyServerWithCompression.java * (add) lang/java/ipc-netty/src/test/java/org/apache/avro/ipc/netty/TestNettyServerWithSSL.java * (add) lang/java/ipc-netty/src/test/keystore * (add) lang/java/ipc-netty/src/test/java/org/apache/avro/ipc/netty/TestNettyServer.java * (delete) lang/java/ipc/src/main/java/org/apache/avro/ipc/NettyServer.java * (edit) lang/java/ipc/src/test/java/org/apache/avro/ipc/stats/FakeTicks.java * (add) lang/java/ipc-jetty/src/main/java/org/apache/avro/ipc/jetty/StaticServlet.java * (add) lang/java/ipc-jetty/src/test/keystore * (add) lang/java/ipc-jetty/pom.xml * (add) lang/java/ipc-netty/src/test/java/org/apache/avro/ipc/netty/TestNettyServerWithCallbacks.java * (add) lang/java/ipc-netty/src/test/java/org/apache/avro/ipc/netty/TestProtocolNetty.java * (add) lang/java/ipc-jetty/src/test/java/org/apache/avro/ipc/jetty/TestProtocolHttp.java * (add) lang/java/ipc-jetty/src/test/truststore * (add) lang/java/ipc-netty/src/main/java/org/apache/avro/ipc/netty/NettyTransportCodec.java * (delete) lang/java/ipc/src/test/java/org/apache/avro/ipc/TestNettyTransceiverWhenServerStops.java * (delete) lang/java/ipc/src/main/java/org/apache/avro/ipc/NettyTransportCodec.java * (delete)
[jira] [Commented] (AVRO-2302) Invalid namespace importing Avro files generated from Protobuf
[
https://issues.apache.org/jira/browse/AVRO-2302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16763103#comment-16763103
]
Hudson commented on AVRO-2302:
--
FAILURE: Integrated in Jenkins build AvroJava #603 (See
[https://builds.apache.org/job/AvroJava/603/])
AVRO-2302 Fix invalid namespace on BigQuery import (dan:
[https://github.com/apache/avro/commit/e0ab6bd54ab632569782a577b7e9a1d419e08845])
* (edit)
lang/java/protobuf/src/main/java/org/apache/avro/protobuf/ProtobufData.java
* (edit)
lang/java/protobuf/src/test/java/org/apache/avro/protobuf/TestProtobuf.java
* (edit)
lang/java/protobuf/src/main/java/org/apache/avro/protobuf/ProtobufDatumReader.java
> Invalid namespace importing Avro files generated from Protobuf
> --
>
> Key: AVRO-2302
> URL: https://issues.apache.org/jira/browse/AVRO-2302
> Project: Apache Avro
> Issue Type: Bug
>Affects Versions: 1.8.2
>Reporter: Pedro Carneiro
>Assignee: Daniel Kulp
>Priority: Major
> Fix For: 1.9.0
>
>
> An error occurs when importing Avro files into BigQuery.
> The files were generated using a ProtobufData schema.
> The error shown is similar to:
> {code}
> BigQuery error in load operation: Error processing job
> '': Error while reading data, error message: The
> Apache Avro library failed to parse the header with the following error:
> Invalid namespace:
> some.package.SomeClassProto$
> {code}
> When using a modified version of the ProtobufData class, that yields a
> namespace like
> {noformat}
> some.package.SomeClassProto
> {noformat}
> (without the dollar), the import worked without errors.
> Potentially related to AVRO-2143?
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (AVRO-2311) Remove findbugs annotations dependency
[ https://issues.apache.org/jira/browse/AVRO-2311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16762133#comment-16762133 ] Hudson commented on AVRO-2311: -- SUCCESS: Integrated in Jenkins build AvroJava #599 (See [https://builds.apache.org/job/AvroJava/599/]) AVRO-2311: Remove findbugs annotations dependency (iemejia: [https://github.com/apache/avro/commit/c1faf3b56504de9e366000ceeb4a65ef9567f8d2]) * (edit) lang/java/grpc/pom.xml * (edit) lang/java/grpc/src/main/java/org/apache/avro/grpc/AvroInputStream.java * (edit) build.sh * (edit) pom.xml * (edit) lang/java/grpc/src/main/java/org/apache/avro/grpc/AvroRequestMarshaller.java * (edit) lang/java/pom.xml * (edit) lang/java/tools/pom.xml * (edit) lang/java/build.sh * (edit) lang/java/grpc/src/main/java/org/apache/avro/grpc/AvroResponseMarshaller.java > Remove findbugs annotations dependency > -- > > Key: AVRO-2311 > URL: https://issues.apache.org/jira/browse/AVRO-2311 > Project: Apache Avro > Issue Type: Improvement > Components: java >Affects Versions: 1.9.0 >Reporter: Ismaël Mejía >Assignee: Ismaël Mejía >Priority: Blocker > Fix For: 1.9.0 > > > Avro grpc still uses findbugs "com.google.code.findbugs" through a dependency > that leaks findbugs into the classpath. This dependency is LGPL licensed and > forbidden by the ASF -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (AVRO-2321) Replace hasattr with getattr
[ https://issues.apache.org/jira/browse/AVRO-2321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16766165#comment-16766165 ] Hudson commented on AVRO-2321: -- SUCCESS: Integrated in Jenkins build AvroJava #605 (See [https://builds.apache.org/job/AvroJava/605/]) AVRO-2321: Avoid hasattr in Python 2 (#453) (fokko: [https://github.com/apache/avro/commit/2aa4946f42541369b31094538801c2caec251c67]) * (edit) lang/py/src/avro/protocol.py * (edit) lang/py/src/avro/schema.py > Replace hasattr with getattr > > > Key: AVRO-2321 > URL: https://issues.apache.org/jira/browse/AVRO-2321 > Project: Apache Avro > Issue Type: Improvement > Components: python >Affects Versions: 1.8.2 >Reporter: Fokko Driesprong >Assignee: Michael A. Smith >Priority: Major > Fix For: 1.9.0 > > > Please refer to the blog: https://hynek.me/articles/hasattr/ -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (AVRO-1816) Add support for logical decimal type for python AVRO
[ https://issues.apache.org/jira/browse/AVRO-1816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16765997#comment-16765997 ] Hudson commented on AVRO-1816: -- SUCCESS: Integrated in Jenkins build AvroJava #604 (See [https://builds.apache.org/job/AvroJava/604/]) [AVRO-1816] Add support for logical decimal type for python AVRO (#82) (fokko: [https://github.com/apache/avro/commit/114fee5317ca2bb2b09864c66da99e86190faffb]) * (edit) lang/py/src/avro/io.py * (edit) lang/py/test/test_io.py * (edit) lang/py/test/test_schema.py * (edit) lang/py/src/avro/schema.py * (add) lang/py/src/avro/decimal_encoder.py [AVRO-1816] Add support for logical decimal type for python AVRO (fokkodriesprong: [https://github.com/apache/avro/commit/e44acccf69a0b40f12f904144df67b345a5138ad]) * (delete) lang/py/src/avro/decimal_encoder.py > Add support for logical decimal type for python AVRO > > > Key: AVRO-1816 > URL: https://issues.apache.org/jira/browse/AVRO-1816 > Project: Apache Avro > Issue Type: New Feature > Components: python >Affects Versions: 1.9.0 >Reporter: Prem Santosh >Assignee: Prem Santosh >Priority: Major > Fix For: 1.9.0 > > > Currently, python Avro does not seem to support a DECIMAL type. > I > [added|https://github.com/premsantosh/avro/commit/162bbb73bdb09c197722f33a0b4dcaf9f7c6f9b8] > support for encoding and decoding logical decimal type for python avro. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (AVRO-1989) Ruby schema validation for fixed types should use bytesize in error message
[
https://issues.apache.org/jira/browse/AVRO-1989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16766231#comment-16766231
]
Hudson commented on AVRO-1989:
--
SUCCESS: Integrated in Jenkins build AvroJava #606 (See
[https://builds.apache.org/job/AvroJava/606/])
AVRO-1989: Ruby schema validation should use bytesize in error msg (github:
[https://github.com/apache/avro/commit/c62a8f9d11c85c18a9df1f28d23fe0396f7766b9])
* (edit) lang/ruby/lib/avro/schema_validator.rb
* (edit) lang/ruby/test/test_schema_validator.rb
> Ruby schema validation for fixed types should use bytesize in error message
> ---
>
> Key: AVRO-1989
> URL: https://issues.apache.org/jira/browse/AVRO-1989
> Project: Apache Avro
> Issue Type: Bug
> Components: ruby
>Affects Versions: 1.9.0
>Reporter: Sean Busbey
>Assignee: Fokko Driesprong
>Priority: Minor
> Fix For: 1.9.0
>
> Attachments: AVRO-1989.0.patch
>
>
> From AVRO-1886:
> I'd like to get one thing improved, but it's fine as a follow-on.
> {code}
> + when :fixed
> + if datum.is_a? String
> +message = "expected fixed with size #{expected_schema.size},
> got \"#{datum}\" with size #{datum.size}"
> +result.add_error(path, message) unless datum.bytesize ==
> expected_schema.size
> + else
> +result.add_error(path, "expected fixed with size
> #{expected_schema.size}, got #{actual_value_message(datum)}")
> + end
> {code}
> the message here should use datum.bytesize instead of datum.size.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (AVRO-2315) Update zstd-jni to version 1.3.8-3
[ https://issues.apache.org/jira/browse/AVRO-2315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16762223#comment-16762223 ] Hudson commented on AVRO-2315: -- SUCCESS: Integrated in Jenkins build AvroJava #600 (See [https://builds.apache.org/job/AvroJava/600/]) AVRO-2315: Update zstd-jni to version 1.3.8-3 (#445) (fokko: [https://github.com/apache/avro/commit/ba30662a00fe5f883d643c956d7b982a5d4b8751]) * (edit) lang/java/pom.xml > Update zstd-jni to version 1.3.8-3 > -- > > Key: AVRO-2315 > URL: https://issues.apache.org/jira/browse/AVRO-2315 > Project: Apache Avro > Issue Type: Improvement > Components: java >Affects Versions: 1.9.0 >Reporter: Ismaël Mejía >Assignee: Ismaël Mejía >Priority: Minor > Fix For: 1.9.0 > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (AVRO-2317) Update hamcrest-library to version 2.1 and remove hamcrest-all
[ https://issues.apache.org/jira/browse/AVRO-2317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16762224#comment-16762224 ] Hudson commented on AVRO-2317: -- SUCCESS: Integrated in Jenkins build AvroJava #600 (See [https://builds.apache.org/job/AvroJava/600/]) AVRO-2317 Update hamcrest-library to version 2.1 and remove hamcrest-all (fokko: [https://github.com/apache/avro/commit/1f88d9ede26daad76f1343ca300f16cc824ef712]) * (edit) lang/java/pom.xml * (edit) pom.xml * (edit) lang/java/avro/pom.xml > Update hamcrest-library to version 2.1 and remove hamcrest-all > -- > > Key: AVRO-2317 > URL: https://issues.apache.org/jira/browse/AVRO-2317 > Project: Apache Avro > Issue Type: Improvement > Components: java >Affects Versions: 1.9.0 >Reporter: Ismaël Mejía >Assignee: Ismaël Mejía >Priority: Minor > Fix For: 1.9.0 > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (AVRO-2316) Update ant to version 1.10.5
[ https://issues.apache.org/jira/browse/AVRO-2316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16762225#comment-16762225 ] Hudson commented on AVRO-2316: -- SUCCESS: Integrated in Jenkins build AvroJava #600 (See [https://builds.apache.org/job/AvroJava/600/]) AVRO-2316: Update ant to version 1.10.5 (#446) (fokko: [https://github.com/apache/avro/commit/c4f880eb00b07a4cc6fbab24ae9f5c9d970d269b]) * (edit) lang/java/pom.xml > Update ant to version 1.10.5 > > > Key: AVRO-2316 > URL: https://issues.apache.org/jira/browse/AVRO-2316 > Project: Apache Avro > Issue Type: Improvement > Components: java >Affects Versions: 1.9.0 >Reporter: Ismaël Mejía >Assignee: Ismaël Mejía >Priority: Minor > Fix For: 1.9.0 > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (AVRO-2319) Bump grpc.version from 1.17.1 to 1.18.0
[ https://issues.apache.org/jira/browse/AVRO-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16762445#comment-16762445 ] Hudson commented on AVRO-2319: -- SUCCESS: Integrated in Jenkins build AvroJava #601 (See [https://builds.apache.org/job/AvroJava/601/]) AVRO-2319: Bump grpc.version from 1.17.1 to 1.18.0 (#449) (nandorKollar: [https://github.com/apache/avro/commit/95cd62055fd24910d8873b4d8ab209eec198239e]) * (edit) lang/java/pom.xml > Bump grpc.version from 1.17.1 to 1.18.0 > --- > > Key: AVRO-2319 > URL: https://issues.apache.org/jira/browse/AVRO-2319 > Project: Apache Avro > Issue Type: Improvement > Components: java >Affects Versions: 1.8.2 >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > Fix For: 1.9.0 > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (AVRO-2314) Bump protobuf to 3.6.1
[ https://issues.apache.org/jira/browse/AVRO-2314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761625#comment-16761625 ] Hudson commented on AVRO-2314: -- SUCCESS: Integrated in Jenkins build AvroJava #598 (See [https://builds.apache.org/job/AvroJava/598/]) [AVRO-2314] Bump protobuf to 3.6.1 (iemejia: [https://github.com/apache/avro/commit/6b5963d64e8c339c5266b6b14c707ea9cb10f8fa]) * (edit) lang/java/pom.xml > Bump protobuf to 3.6.1 > -- > > Key: AVRO-2314 > URL: https://issues.apache.org/jira/browse/AVRO-2314 > Project: Apache Avro > Issue Type: Improvement >Affects Versions: 1.8.2 >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > Fix For: 1.9.0 > > > There is an outstanding CVE: > https://ossindex.sonatype.org/vuln/d47d20ab-eb2a-4cfd-8064-bbf6283649cb -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (AVRO-2313) Bump libthrift from 0.11.0 to 0.12.0
[ https://issues.apache.org/jira/browse/AVRO-2313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761626#comment-16761626 ] Hudson commented on AVRO-2313: -- SUCCESS: Integrated in Jenkins build AvroJava #598 (See [https://builds.apache.org/job/AvroJava/598/]) AVRO-2313: Bump libthrift from 0.11.0 to 0.12.0 (iemejia: [https://github.com/apache/avro/commit/f4425913940a11870bc8fda602d29217cff53af0]) * (edit) lang/java/pom.xml > Bump libthrift from 0.11.0 to 0.12.0 > > > Key: AVRO-2313 > URL: https://issues.apache.org/jira/browse/AVRO-2313 > Project: Apache Avro > Issue Type: Improvement >Affects Versions: 1.8.2 >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > Fix For: 1.9.0 > > > To keep up with Parquet -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (AVRO-2323) Bump maven-jar-plugin to 3.1.1
[ https://issues.apache.org/jira/browse/AVRO-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16772410#comment-16772410 ] Hudson commented on AVRO-2323: -- FAILURE: Integrated in Jenkins build AvroJava #607 (See [https://builds.apache.org/job/AvroJava/607/]) [AVRO-2323] Bump maven-jar-plugin to 3.1.1 (iemejia: [https://github.com/apache/avro/commit/ff11298e397977b820bdeed612e61dab17f118b9]) * (edit) lang/java/pom.xml > Bump maven-jar-plugin to 3.1.1 > -- > > Key: AVRO-2323 > URL: https://issues.apache.org/jira/browse/AVRO-2323 > Project: Apache Avro > Issue Type: Improvement > Components: java >Affects Versions: 1.8.2 >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > Fix For: 1.9.0 > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
