Re: Radical idea for 1.9.0

2018-11-30 Thread Rob Turner
I think that recursive schemas are a powerful feature of Avro that enable the modelling of hierarchies, a pretty common data structure. l myself have used this feature in a large scale system before. The recursion is handled elegantly and naturally in the code with recursive functions so I don't

[jira] [Commented] (AVRO-1650) Avro deserialization fails depending on the value of integer/long fields

2015-03-19 Thread Rob Turner (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14369997#comment-14369997 ] Rob Turner commented on AVRO-1650: -- I suspect it is an character encoding issue

[jira] [Commented] (AVRO-677) Avro schema not properly resolved on data file read.

2015-01-06 Thread Rob Turner (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14265900#comment-14265900 ] Rob Turner commented on AVRO-677: - Looks like a duplicate of AVRO-1467. Avro schema

[jira] [Commented] (AVRO-680) Allow for non-string keys

2014-09-03 Thread Rob Turner (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14120389#comment-14120389 ] Rob Turner commented on AVRO-680: - I appreciate the work that has gone into this already

[jira] [Commented] (AVRO-1502) Avro objects should implement Serializable

2014-08-28 Thread Rob Turner (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14114438#comment-14114438 ] Rob Turner commented on AVRO-1502: -- Presumably this will not work for Utf8, ByteBuffer

[jira] [Commented] (AVRO-1502) Avro objects should implement Serializable

2014-08-28 Thread Rob Turner (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14114533#comment-14114533 ] Rob Turner commented on AVRO-1502: -- A slightly different solution would be to make

[jira] [Commented] (AVRO-1502) Avro objects should implement Serializable

2014-08-28 Thread Rob Turner (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14114575#comment-14114575 ] Rob Turner commented on AVRO-1502: -- Doug, yes the serialVersionUID would still be a good

[jira] [Commented] (AVRO-1457) ReadOnly ByteBuffer serialization state changes after writing

2014-05-24 Thread Rob Turner (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14008216#comment-14008216 ] Rob Turner commented on AVRO-1457: -- I cannot commit this at the moment due to password

[jira] [Assigned] (AVRO-1457) ReadOnly ByteBuffer serialization state changes after writing

2014-04-23 Thread Rob Turner (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rob Turner reassigned AVRO-1457: Assignee: Rob Turner ReadOnly ByteBuffer serialization state changes after writing

[jira] [Updated] (AVRO-1457) ReadOnly ByteBuffer serialization state changes after writing

2014-04-23 Thread Rob Turner (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rob Turner updated AVRO-1457: - Attachment: AVRO-1457.patch ReadOnly ByteBuffer serialization state changes after writing

[jira] [Commented] (AVRO-1457) ReadOnly ByteBuffer serialization state changes after writing

2014-04-23 Thread Rob Turner (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13979033#comment-13979033 ] Rob Turner commented on AVRO-1457: -- Please review the attached patch which resolves

[jira] [Created] (AVRO-1427) Minor issues with Resolving Decoder Tests

2014-01-05 Thread Rob Turner (JIRA)
Rob Turner created AVRO-1427: Summary: Minor issues with Resolving Decoder Tests Key: AVRO-1427 URL: https://issues.apache.org/jira/browse/AVRO-1427 Project: Avro Issue Type: Bug

[jira] [Updated] (AVRO-1427) Minor issues with Resolving Decoder Tests

2014-01-05 Thread Rob Turner (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rob Turner updated AVRO-1427: - Attachment: AVRO-1427.patch I also changed the deprecated Schema.parse to new Schema.Parser.parse

[jira] [Commented] (AVRO-1348) Improve Utf8 to String conversion

2013-12-17 Thread Rob Turner (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13850949#comment-13850949 ] Rob Turner commented on AVRO-1348: -- Here are the results on my old 32 bit Linux laptop

[jira] [Updated] (AVRO-1344) Avro(Key|KeyValue)OutputFormat: Expose sync interval configuration

2013-12-13 Thread Rob Turner (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rob Turner updated AVRO-1344: - Attachment: AVRO-1344.patch I had done the unit tests but failed to include them in the patch, attached

[jira] [Commented] (AVRO-1348) Improve Utf8 to String conversion

2013-12-13 Thread Rob Turner (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13847695#comment-13847695 ] Rob Turner commented on AVRO-1348: -- The test program I ran was org.apache.avro.io.Perf

[jira] [Updated] (AVRO-1396) Add JSON pretty option for tojson in avro-tools

2013-12-13 Thread Rob Turner (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rob Turner updated AVRO-1396: - Attachment: AVRO-1396.patch Please review this patch that resolves this issue. Add JSON pretty option

[jira] [Commented] (AVRO-1411) org.apache.avro.util.Utf8 performance improvement by remove private Charset in class

2013-12-12 Thread Rob Turner (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13846558#comment-13846558 ] Rob Turner commented on AVRO-1411: -- This is exactly the same as AVRO-1348, I have added

[jira] [Commented] (AVRO-1348) Improve Utf8 to String conversion

2013-12-12 Thread Rob Turner (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13846867#comment-13846867 ] Rob Turner commented on AVRO-1348: -- Here are results on 32 bit Linux with Sun JDK: ||jdk

[jira] [Commented] (AVRO-1396) Add JSON pretty option for tojson in avro-tools

2013-12-02 Thread Rob Turner (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13836922#comment-13836922 ] Rob Turner commented on AVRO-1396: -- I have submitted a patch for AVRO-1397 that would make

[jira] [Updated] (AVRO-1348) Improve Utf8 to String conversion

2013-11-29 Thread Rob Turner (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rob Turner updated AVRO-1348: - Attachment: AVRO-1348v2.patch Surprisingly, passing the character set name string UTF-8 performs about 15

[jira] [Updated] (AVRO-1396) Add JSON pretty option for tojson in avro-tools

2013-11-28 Thread Rob Turner (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rob Turner updated AVRO-1396: - Assignee: Rob Turner Add JSON pretty option for tojson in avro-tools

[jira] [Assigned] (AVRO-1344) Avro(Key|KeyValue)OutputFormat: Expose sync interval configuration

2013-11-28 Thread Rob Turner (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rob Turner reassigned AVRO-1344: Assignee: Rob Turner Avro(Key|KeyValue)OutputFormat: Expose sync interval configuration

[jira] [Updated] (AVRO-1344) Avro(Key|KeyValue)OutputFormat: Expose sync interval configuration

2013-11-28 Thread Rob Turner (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rob Turner updated AVRO-1344: - Affects Version/s: (was: 1.7.4) 1.7.5 Avro(Key|KeyValue)OutputFormat: Expose

[jira] [Updated] (AVRO-1344) Avro(Key|KeyValue)OutputFormat: Expose sync interval configuration

2013-11-28 Thread Rob Turner (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rob Turner updated AVRO-1344: - Attachment: AVRO-1344.patch Please review this patch that resolves this issue. Avro(Key|KeyValue

[jira] [Updated] (AVRO-1397) Binary fragment tools should allow more than one datum or JSON object

2013-11-27 Thread Rob Turner (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rob Turner updated AVRO-1397: - Attachment: AVRO-1398.patch Sorry about the whitespace changes, is there a formatter for Eclipse? h4

[jira] [Updated] (AVRO-1398) Increase DEFAULT_SYNC_INTERVAL to 64K from 16,000

2013-11-23 Thread Rob Turner (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rob Turner updated AVRO-1398: - Attachment: AVRO-1398.patch Here is a patch that changes the default sync interval from 16000 to 64000 (C

[jira] [Updated] (AVRO-1397) Binary fragment tools should allow more than one datum or JSON object

2013-11-22 Thread Rob Turner (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rob Turner updated AVRO-1397: - Attachment: AVRO-1397.patch Please review this patch that resolves this issue. Binary fragment tools

[jira] [Updated] (AVRO-1399) testWithDeflateCodeWithHadoopConfig is missing call to testGetRecordWriter

2013-11-15 Thread Rob Turner (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rob Turner updated AVRO-1399: - Attachment: AVRO-1399.patch Please review this patch that resolves this issue

[jira] [Created] (AVRO-1396) Add JSON pretty option for tojson in avro-tools

2013-11-11 Thread Rob Turner (JIRA)
Rob Turner created AVRO-1396: Summary: Add JSON pretty option for tojson in avro-tools Key: AVRO-1396 URL: https://issues.apache.org/jira/browse/AVRO-1396 Project: Avro Issue Type: New Feature

[jira] [Created] (AVRO-1397) Binary fragment tools should allow more than one datum or JSON object

2013-11-11 Thread Rob Turner (JIRA)
Rob Turner created AVRO-1397: Summary: Binary fragment tools should allow more than one datum or JSON object Key: AVRO-1397 URL: https://issues.apache.org/jira/browse/AVRO-1397 Project: Avro

[jira] [Created] (AVRO-1398) Increase DEFAULT_SYNC_INTERVAL to 64K from 16,000

2013-11-11 Thread Rob Turner (JIRA)
Rob Turner created AVRO-1398: Summary: Increase DEFAULT_SYNC_INTERVAL to 64K from 16,000 Key: AVRO-1398 URL: https://issues.apache.org/jira/browse/AVRO-1398 Project: Avro Issue Type: Improvement

[jira] [Created] (AVRO-1399) testWithDeflateCodeWithHadoopConfig is missing call to testGetRecordWriter

2013-11-11 Thread Rob Turner (JIRA)
Rob Turner created AVRO-1399: Summary: testWithDeflateCodeWithHadoopConfig is missing call to testGetRecordWriter Key: AVRO-1399 URL: https://issues.apache.org/jira/browse/AVRO-1399 Project: Avro