[jira] [Commented] (AVRO-1306) Clarify documentation for hadoop input-avro output-non-avro instructions

2013-04-22 Thread Martin Kleppmann (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638069#comment-13638069 ] Martin Kleppmann commented on AVRO-1306: This looks good to me. I'll commit it soon

Re: Avro C API - Handing of Default values

2013-04-22 Thread Douglas Creager
Sorry to contact you off-list but I wasn’t sure if you saw my question in AVRO-DEV amongst all the JIRA messages. Hi Steve, you're right, that did slip through the cracks. Sorry for that! CCing the dev list so that we're back on the record. You mentioned a few weeks ago that the AVRO C API

[jira] [Created] (AVRO-1307) Add an avro-tool to extract samples from avro files

2013-04-22 Thread Vincenz Priesnitz (JIRA)
Vincenz Priesnitz created AVRO-1307: --- Summary: Add an avro-tool to extract samples from avro files Key: AVRO-1307 URL: https://issues.apache.org/jira/browse/AVRO-1307 Project: Avro Issue

[jira] [Updated] (AVRO-1307) Add an avro-tool to extract samples from avro files

2013-04-22 Thread Vincenz Priesnitz (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vincenz Priesnitz updated AVRO-1307: Attachment: AVRO-1307.patch Add an avro-tool to extract samples from avro files

[jira] [Updated] (AVRO-1307) Add an avro-tool to extract samples from avro files

2013-04-22 Thread Vincenz Priesnitz (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vincenz Priesnitz updated AVRO-1307: Status: Patch Available (was: Open) Add an avro-tool to extract samples from avro

[jira] [Created] (AVRO-1308) Don't call hasField on a repeated message

2013-04-22 Thread Steve Zesch (JIRA)
Steve Zesch created AVRO-1308: - Summary: Don't call hasField on a repeated message Key: AVRO-1308 URL: https://issues.apache.org/jira/browse/AVRO-1308 Project: Avro Issue Type: Bug

[jira] [Updated] (AVRO-1308) Don't call hasField on a repeated message

2013-04-22 Thread Steve Zesch (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Zesch updated AVRO-1308: -- Status: Patch Available (was: Open) Check to see if a field is repeated. Don't call

[jira] [Updated] (AVRO-1308) Don't call hasField on a repeated message

2013-04-22 Thread Steve Zesch (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Zesch updated AVRO-1308: -- Attachment: (was: cnfe_protobuf_stack_trace.txt) Don't call hasField on a repeated message

[jira] [Updated] (AVRO-1309) ProtobufData does not correctly handle nested enums

2013-04-22 Thread Steve Zesch (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Zesch updated AVRO-1309: -- Attachment: cnfe_protobuf_stack_trace.txt ProtobufData does not correctly handle nested enums

[jira] [Updated] (AVRO-1309) ProtobufData does not correctly handle nested enums

2013-04-22 Thread Steve Zesch (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Zesch updated AVRO-1309: -- Description: When an enum is nested in several messages, a ClassNotFoundException is thrown when

[jira] [Commented] (AVRO-1296) Python: schemas retrieved from protocol types ignore namespace

2013-04-22 Thread Jeremy Kahn (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638196#comment-13638196 ] Jeremy Kahn commented on AVRO-1296: --- Philip, have you received any objections? Could you

[jira] [Commented] (AVRO-1304) Python Avro match_schemas called redundantly

2013-04-22 Thread Jeremy Kahn (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638198#comment-13638198 ] Jeremy Kahn commented on AVRO-1304: --- Uri, what strategy are you using to try to fix this?

buildbot failure in ASF Buildbot on avro-py-ubuntu-9.10

2013-04-22 Thread buildbot
The Buildbot has detected a new failure on builder avro-py-ubuntu-9.10 while building ASF Buildbot. Full details are available at: http://ci.apache.org/builders/avro-py-ubuntu-9.10/builds/89 Buildbot URL: http://ci.apache.org/ Buildslave for this Build: bb-vm_ubuntu Build Reason: scheduler

[jira] [Commented] (AVRO-1282) Make use of the sun.misc.Unsafe class during serialization if a JDK supports it

2013-04-22 Thread Scott Carey (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638255#comment-13638255 ] Scott Carey commented on AVRO-1282: --- Other frameworks (e.g. Jackson) avoid field access

[jira] [Commented] (AVRO-1306) Clarify documentation for hadoop input-avro output-non-avro instructions

2013-04-22 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638274#comment-13638274 ] Doug Cutting commented on AVRO-1306: We might instead consider this a bug, and fix it

[jira] [Commented] (AVRO-1308) Don't call hasField on a repeated message

2013-04-22 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638284#comment-13638284 ] Doug Cutting commented on AVRO-1308: The fix looks good. We should also add something

Re: buildbot failure in ASF Buildbot on avro-py-ubuntu-9.10

2013-04-22 Thread Jeremy Kahn
uh, looks like the buildbot is using some very old version of unittest ? == [py-test] ERROR: test_inner_namespace_not_rendered (test_protocol.TestProtocol) [py-test]

Re: buildbot failure in ASF Buildbot on avro-py-ubuntu-9.10

2013-04-22 Thread Jeremy Kahn
okay, not very old; probably python 2.6. http://docs.python.org/2/library/unittest.html#unittest.TestCase.assertNotIn Looks like buildbot on Ubuntu 9.10 is probably running Python 2.6. I will submit a patch for 2.6 compatibility. --Jeremy On Mon, Apr 22, 2013 at 11:56 AM, Jeremy Kahn

Re: buildbot failure in ASF Buildbot on avro-py-ubuntu-9.10

2013-04-22 Thread Philip Zeyliger
Ideally we'd be 2.4 compatible as well. Let me know when you have a patch, and I'll get it pushed in quickly. -- Philip On Mon, Apr 22, 2013 at 12:11 PM, Jeremy Kahn troc...@trochee.net wrote: okay, not very old; probably python 2.6.

[jira] [Updated] (AVRO-867) Allow tools to read files via hadoop FileSystem class

2013-04-22 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated AVRO-867: -- Resolution: Fixed Fix Version/s: 1.7.5 Assignee: Vincenz Priesnitz (was: Joe Crobak)

[jira] [Commented] (AVRO-1296) Python: schemas retrieved from protocol types ignore namespace

2013-04-22 Thread Jeremy Kahn (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638407#comment-13638407 ] Jeremy Kahn commented on AVRO-1296: --- Looks like the Ubuntu 9.10 buildbot complains about

Re: buildbot failure in ASF Buildbot on avro-py-ubuntu-9.10

2013-04-22 Thread Jeremy Kahn
I haven't checked the 2.4 compatibility. I note that assertNotIn was introduced in 2.7, so I used only assertFalse instead. On Mon, Apr 22, 2013 at 12:23 PM, Philip Zeyliger phi...@cloudera.comwrote: Ideally we'd be 2.4 compatible as well. Let me know when you have a patch, and I'll get it

buildbot success in ASF Buildbot on avro-py-ubuntu-9.10

2013-04-22 Thread buildbot
The Buildbot has detected a restored build on builder avro-py-ubuntu-9.10 while building ASF Buildbot. Full details are available at: http://ci.apache.org/builders/avro-py-ubuntu-9.10/builds/90 Buildbot URL: http://ci.apache.org/ Buildslave for this Build: bb-vm_ubuntu Build Reason: scheduler

[jira] [Commented] (AVRO-1124) RESTful service for holding schemas

2013-04-22 Thread Scott Carey (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638447#comment-13638447 ] Scott Carey commented on AVRO-1124: --- * Validators outside of the repository. I agree,

[jira] [Commented] (AVRO-1299) SpecificRecordBase implements GenericRecord

2013-04-22 Thread Scott Carey (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638455#comment-13638455 ] Scott Carey commented on AVRO-1299: --- I guess only my sense of purity -- an Immutable

[jira] [Commented] (AVRO-1282) Make use of the sun.misc.Unsafe class during serialization if a JDK supports it

2013-04-22 Thread Scott Carey (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638471#comment-13638471 ] Scott Carey commented on AVRO-1282: --- -1 This appears to break some JVMs by assuming that

[jira] [Commented] (AVRO-1299) SpecificRecordBase implements GenericRecord

2013-04-22 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638484#comment-13638484 ] Doug Cutting commented on AVRO-1299: I think we agree. If we want to improve things

[jira] [Commented] (AVRO-1299) SpecificRecordBase implements GenericRecord

2013-04-22 Thread Scott Carey (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638491#comment-13638491 ] Scott Carey commented on AVRO-1299: --- I agree, 101039 seems best. If we didn't already

[jira] [Commented] (AVRO-1307) Add an avro-tool to extract samples from avro files

2013-04-22 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638503#comment-13638503 ] Doug Cutting commented on AVRO-1307: This looks great! I can think of possible

[jira] [Commented] (AVRO-1282) Make use of the sun.misc.Unsafe class during serialization if a JDK supports it

2013-04-22 Thread Scott Carey (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638507#comment-13638507 ] Scott Carey commented on AVRO-1282: --- Newer IBM JDK's seem to have Unsafe support -- so

[jira] [Commented] (AVRO-1282) Make use of the sun.misc.Unsafe class during serialization if a JDK supports it

2013-04-22 Thread Scott Carey (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638523#comment-13638523 ] Scott Carey commented on AVRO-1282: --- I am measuring a 2x to 7x performance increase

[jira] [Commented] (AVRO-1282) Make use of the sun.misc.Unsafe class during serialization if a JDK supports it

2013-04-22 Thread Scott Carey (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638527#comment-13638527 ] Scott Carey commented on AVRO-1282: --- Note, my measurements were with all tests active;

[jira] [Commented] (AVRO-1282) Make use of the sun.misc.Unsafe class during serialization if a JDK supports it

2013-04-22 Thread Scott Carey (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638548#comment-13638548 ] Scott Carey commented on AVRO-1282: --- After several runs in a row, the Generic performance

[jira] [Updated] (AVRO-1309) ProtobufData does not correctly handle nested enums

2013-04-22 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated AVRO-1309: --- Attachment: AVRO-1309.patch Here's a patch that should fix this. Please let me know if this works

[jira] [Updated] (AVRO-1309) ProtobufData does not correctly handle nested enums

2013-04-22 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated AVRO-1309: --- Fix Version/s: 1.7.5 Assignee: Doug Cutting Status: Patch Available (was: Open)

[jira] [Commented] (AVRO-1296) Python: schemas retrieved from protocol types ignore namespace

2013-04-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638733#comment-13638733 ] Hudson commented on AVRO-1296: -- Integrated in AvroJava #363 (See

[jira] [Commented] (AVRO-867) Allow tools to read files via hadoop FileSystem class

2013-04-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638734#comment-13638734 ] Hudson commented on AVRO-867: - Integrated in AvroJava #363 (See

[jira] [Commented] (AVRO-1300) Copy-constructor for specific record builders: Builder(Builder other) does not copy the fields from builder other

2013-04-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638735#comment-13638735 ] Hudson commented on AVRO-1300: -- Integrated in AvroJava #363 (See

[jira] [Commented] (AVRO-1277) Improve performance of reflection-based serializers

2013-04-22 Thread Leo Romanoff (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638795#comment-13638795 ] Leo Romanoff commented on AVRO-1277: Yes, AVRO-1282 includes all changes from this one

[jira] [Commented] (AVRO-1282) Make use of the sun.misc.Unsafe class during serialization if a JDK supports it

2013-04-22 Thread Scott Carey (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638813#comment-13638813 ] Scott Carey commented on AVRO-1282: --- A related issue is what happens when you run under a