I support your recommendation. I've recently used ANTLR on a use-case
similar to this one and had a great experience.
Raymie
On Wed, Jan 5, 2022 at 5:13 PM Oscar Westra van Holthe - Kind <
os...@westravanholthe.nl> wrote:
> Hi everyone,
>
> One of the avro components in Java is the IDL
FWIW, nice summary, good to see Avro going strong...
On Wed, Apr 8, 2020 at 10:12 PM Sean Busbey wrote:
>
> Hi folks!
>
> Here's the report for the quarter I submitted. Let me know if there are any
> last minute changes y'all would like to see.
>
>
> ## Description:
> Apache Avro is a data
Yes, it's time to get this in.
On Fri, Jan 31, 2020 at 8:28 AM Ryan Skraba wrote:
>
> Hello! There's a long standing PR[1][2] that provides an impressive
> performance boost to deserializing Avro.
>
> The author has been patient and reactive for a LONG time (thanks Martin!),
> and it's inspired
[
https://issues.apache.org/jira/browse/AVRO-2247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027873#comment-17027873
]
Raymie Stata commented on AVRO-2247:
I'm in favor.
> Improve Java reading performance with a
These rules are written as if you're directly parsing the underlying
UTF text making up an Avro schema. It sounds like you're using a JSON
parser, which most likely implements both of those rules for you,
leaving nothing in your code to test.
(If you're paranoid, you could add tests of the
[
https://issues.apache.org/jira/browse/AVRO-2400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16850557#comment-16850557
]
Raymie Stata commented on AVRO-2400:
I don't have a horse in this race, other than getting
[
https://issues.apache.org/jira/browse/AVRO-2400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16849231#comment-16849231
]
Raymie Stata commented on AVRO-2400:
[~jtolar] made the following observation via email:
bq. Note
[
https://issues.apache.org/jira/browse/AVRO-2400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16846683#comment-16846683
]
Raymie Stata commented on AVRO-2400:
Sorry for the delay getting back to you. Thanks for reporting
ld do.
>
> Are you interested in removing this feature to improve code
> maintenance or to improve performance? both?
>
> Can you quantify the amount of complexity you're referring to?
> On Fri, Nov 30, 2018 at 12:22 PM Raymie Stata wrote:
> >
> > I understand we've been wil
types that include themselves.
> >
> > Granted, it’s an experiment that would also imply a compatibility break
> > with previous avros, but it opens what I think is an interesting set of
> > doors instead of closing them.
> >
> > My 2 cents.
> >
> >
I understand we've been willing to introduce backward-incompatible API
changes (not file-format changes) into minor release versions. If so,
here's an idea for consideration:
Let's eliminate recursive records from Avro 1.9.x. Recursion
introduces a _lot_ of complexity into many parts of the
Raymie Stata created AVRO-2275:
--
Summary: Refactor schema-resolution code from grammar-generation
Key: AVRO-2275
URL: https://issues.apache.org/jira/browse/AVRO-2275
Project: Apache Avro
Issue
Raymie Stata created AVRO-2274:
--
Summary: Improve resolving performance when schemas don't change
Key: AVRO-2274
URL: https://issues.apache.org/jira/browse/AVRO-2274
Project: Apache Avro
Issue
[
https://issues.apache.org/jira/browse/AVRO-2269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymie Stata updated AVRO-2269:
---
Description:
The class {{org.apache.avro.ipc.io.Perf}} is Avro's performance test suite.
This JIRA
[
https://issues.apache.org/jira/browse/AVRO-2269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16698096#comment-16698096
]
Raymie Stata commented on AVRO-2269:
This work has changed direction. The focus shifted away from
[
https://issues.apache.org/jira/browse/AVRO-2269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymie Stata updated AVRO-2269:
---
Summary: Improve usability of Perf.java (was: Improve variances seen
across Perf.java runs
[
https://issues.apache.org/jira/browse/AVRO-1658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymie Stata reopened AVRO-1658:
Assignee: Raymie Stata (was: Zhaonan Sun)
The file {{AvroDoc.java}} doesn't have a license
[
https://issues.apache.org/jira/browse/AVRO-2269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16689164#comment-16689164
]
Raymie Stata commented on AVRO-2269:
I took a look at JMH. I think it'd be great to convert
[
https://issues.apache.org/jira/browse/AVRO-2268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16689155#comment-16689155
]
Raymie Stata commented on AVRO-2268:
My patch for AVRO-2269 assumes this fix is in place. I wanted
Raymie Stata created AVRO-2269:
--
Summary: Improve variances seen across Perf.java runs
Key: AVRO-2269
URL: https://issues.apache.org/jira/browse/AVRO-2269
Project: Apache Avro
Issue Type: Test
[
https://issues.apache.org/jira/browse/AVRO-2252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677387#comment-16677387
]
Raymie Stata commented on AVRO-2252:
As annoying as bad style can be, large-scale changes to a code
[
https://issues.apache.org/jira/browse/AVRO-2251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymie Stata reopened AVRO-2251:
As I continue to work on performance testing, I'm wanting to experiment with
values for Perf.COUNT
Raymie Stata created AVRO-2251:
--
Summary: Modify Perf.java to better support automation scripts
Key: AVRO-2251
URL: https://issues.apache.org/jira/browse/AVRO-2251
Project: Avro
Issue Type
[
https://issues.apache.org/jira/browse/AVRO-1022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymie Stata reassigned AVRO-1022:
--
Assignee: Raymie Stata
> Error in validate n
[
https://issues.apache.org/jira/browse/AVRO-419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymie Stata reassigned AVRO-419:
-
Assignee: Raymie Stata
> Consistent laziness when resolving partially-compatible chan
[
https://issues.apache.org/jira/browse/AVRO-419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymie Stata resolved AVRO-419.
---
Resolution: Won't Fix
This is ancient history: will not fix.
> Consistent laziness when resolv
with adding/removing fields.
>
> Thanks for catching this.
>
> Doug
>
>
>
>
> On Tue, Oct 23, 2018 at 11:34 PM Raymie Stata
> wrote:
>
> > While working on AVRO-2090, I noticed what is either an implementation
> > bug or a specification bug in schema resol
As with enums, I found what looks like a discrepancy between the spec
and the implementation of resolution, this time for the case that the
reader's schema is a union and the writer's is not, so we look for the
"first matching field."
The spec for this case (I call it the "reader-union case") is
Anybody?
On Tue, Oct 23, 2018 at 11:33 PM Raymie Stata wrote:
>
> While working on AVRO-2090, I noticed what is either an implementation
> bug or a specification bug in schema resolution for enumerations.
>
> The relevant code is here: https://bit.ly/2q5tsIp. This code uses
https://bit.ly/2yuRjpw
The link above points to what looks like an aborted attempt to show
that fixed's and bytes can be promoted to each other. According to
the current Avro spec, not such promotions exists. And since this
test procedure makes no assertions, it doesn't really test this issue
[
https://issues.apache.org/jira/browse/AVRO-2244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661817#comment-16661817
]
Raymie Stata edited comment on AVRO-2244 at 10/24/18 6:51 AM:
--
{{If there's
[
https://issues.apache.org/jira/browse/AVRO-2244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661817#comment-16661817
]
Raymie Stata commented on AVRO-2244:
If there's any doubt about this issue being resolved, I just got
While working on AVRO-2090, I noticed what is either an implementation
bug or a specification bug in schema resolution for enumerations.
The relevant code is here: https://bit.ly/2q5tsIp. This code uses the
reader's default symbol, if it exists, in the case where the writer's
symbols is missing.
[
https://issues.apache.org/jira/browse/AVRO-2244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661123#comment-16661123
]
Raymie Stata commented on AVRO-2244:
I don't believe the fix for AVRO-2241 addresses the problem
[
https://issues.apache.org/jira/browse/AVRO-2090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16658852#comment-16658852
]
Raymie Stata commented on AVRO-2090:
Any more feedback on this patch?
> Improve encode/decode t
[
https://issues.apache.org/jira/browse/AVRO-2090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymie Stata updated AVRO-2090:
---
Description:
New implementation for generation of code for SpecificRecord that improves
decoding
[
https://issues.apache.org/jira/browse/AVRO-2090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymie Stata updated AVRO-2090:
---
Description:
New implementation for generation of code for SpecificRecord that improves
decoding
[
https://issues.apache.org/jira/browse/AVRO-2090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymie Stata updated AVRO-2090:
---
Description:
New implementation for generation of code for SpecificRecord that improves
decoding
[
https://issues.apache.org/jira/browse/AVRO-2244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16656687#comment-16656687
]
Raymie Stata commented on AVRO-2244:
The spec for
[ISO_LOCAL_TIME|https://docs.oracle.com/javase/8
[
https://issues.apache.org/jira/browse/AVRO-2090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654739#comment-16654739
]
Raymie Stata edited comment on AVRO-2090 at 10/18/18 7:19 AM:
--
I've attached
[
https://issues.apache.org/jira/browse/AVRO-2235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymie Stata resolved AVRO-2235.
Resolution: Won't Fix
Release Note: Based on Thiru's input, the old generate code should stay
Raymie Stata created AVRO-2244:
--
Summary: Problems with
TestSpecificLogicalTypes.testAbilityToReadJsr310RecordWrittenAsJodaRecord:148
Key: AVRO-2244
URL: https://issues.apache.org/jira/browse/AVRO-2244
[
https://issues.apache.org/jira/browse/AVRO-2235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16637359#comment-16637359
]
Raymie Stata commented on AVRO-2235:
I'm going to keep this open in case someone else wants to comment
[
https://issues.apache.org/jira/browse/AVRO-2235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16636484#comment-16636484
]
Raymie Stata commented on AVRO-2235:
I looked at the comment at the top of TestSpecificLogicalTypes
[
https://issues.apache.org/jira/browse/AVRO-2235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16636466#comment-16636466
]
Raymie Stata commented on AVRO-2235:
I want to re-regenerate TestRecordForLogicalTypes.java with my
[
https://issues.apache.org/jira/browse/AVRO-2235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16636464#comment-16636464
]
Raymie Stata commented on AVRO-2235:
Does anyone know how TestRecordWithoutLogicalTypes.java
Raymie Stata created AVRO-2235:
--
Summary: Regenerate TestRecordWithLogicalTypes
Key: AVRO-2235
URL: https://issues.apache.org/jira/browse/AVRO-2235
Project: Avro
Issue Type: Bug
[
https://issues.apache.org/jira/browse/AVRO-2091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymie Stata updated AVRO-2091:
---
Description: After the implementation of "custom coders" (AVRO-2090) is
complete and
[
https://issues.apache.org/jira/browse/AVRO-2090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymie Stata updated AVRO-2090:
---
Attachment: customcoders.md
Attaching a design document for (forthcoming) patch.
> Improve enc
Raymie Stata created AVRO-2094:
--
Summary: Extend "custom coders" to support logical types
Key: AVRO-2094
URL: https://issues.apache.org/jira/browse/AVRO-2094
Project: Avro
Raymie Stata created AVRO-2093:
--
Summary: Extend "custom coders" to fully support union types
Key: AVRO-2093
URL: https://issues.apache.org/jira/browse/AVRO-2093
Project: Avro
Raymie Stata created AVRO-2092:
--
Summary: Flip default value of
org.apache.avro.specific.use_custom_coder to true
Key: AVRO-2092
URL: https://issues.apache.org/jira/browse/AVRO-2092
Project: Avro
Raymie Stata created AVRO-2091:
--
Summary: Eliminate org.apache.avro.specific.use_custom_coder
feature flag
Key: AVRO-2091
URL: https://issues.apache.org/jira/browse/AVRO-2091
Project: Avro
Raymie Stata created AVRO-2090:
--
Summary: Improve encode/decode time for SpecificRecord using code
generation
Key: AVRO-2090
URL: https://issues.apache.org/jira/browse/AVRO-2090
Project: Avro
[
https://issues.apache.org/jira/browse/AVRO-806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymie Stata updated AVRO-806:
--
In about a month we will have some Hive benchmarks, but the data won't be very
wide, so they won't be good
[
https://issues.apache.org/jira/browse/AVRO-806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13260732#comment-13260732
]
Raymie Stata commented on AVRO-806:
---
This is the second attempt at a column-major codec
[
https://issues.apache.org/jira/browse/AVRO-1022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymie Stata updated AVRO-1022:
---
Attachment: unicode-recommendation.html
Error in validate name
[
https://issues.apache.org/jira/browse/AVRO-1022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13221634#comment-13221634
]
Raymie Stata commented on AVRO-1022:
Based on the dialog above, I propose that we turn
[
https://issues.apache.org/jira/browse/AVRO-1006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13221388#comment-13221388
]
Raymie Stata commented on AVRO-1006:
The string passed to the fingerprint method
[
https://issues.apache.org/jira/browse/AVRO-1006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13221403#comment-13221403
]
Raymie Stata commented on AVRO-1006:
Yes, this is meant to be a cross-language feature
[
https://issues.apache.org/jira/browse/AVRO-1006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymie Stata updated AVRO-1006:
---
Attachment: AVRO-1006.patch
Fingerprints for Avro Schemas
[
https://issues.apache.org/jira/browse/AVRO-1006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13219815#comment-13219815
]
Raymie Stata commented on AVRO-1006:
On the one hand, the Parsing Canonical Form
[
https://issues.apache.org/jira/browse/AVRO-1006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13215480#comment-13215480
]
Raymie Stata commented on AVRO-1006:
['fp' or 'fingerprint']
I renamed classes
[
https://issues.apache.org/jira/browse/AVRO-1006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymie Stata updated AVRO-1006:
---
Attachment: AVRO-1006.patch
Fingerprints for Avro Schemas
[
https://issues.apache.org/jira/browse/AVRO-1022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13205475#comment-13205475
]
Raymie Stata commented on AVRO-1022:
I took a look at the non-Java implementations
[
https://issues.apache.org/jira/browse/AVRO-1022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13205695#comment-13205695
]
Raymie Stata commented on AVRO-1022:
Right now, a number of Avro implementations
[
https://issues.apache.org/jira/browse/AVRO-1022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13205248#comment-13205248
]
Raymie Stata commented on AVRO-1022:
I've pulled together some documentation on how
[
https://issues.apache.org/jira/browse/AVRO-1006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymie Stata updated AVRO-1006:
---
Attachment: AVRO-1006-prelim.patch
Fingerprints for Avro Schemas
[
https://issues.apache.org/jira/browse/AVRO-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymie Stata updated AVRO-1021:
---
Attachment: AVRO-1021.patch
Fixed typo
Fix a few name-related imperfections in Avro
[
https://issues.apache.org/jira/browse/AVRO-1006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13203426#comment-13203426
]
Raymie Stata commented on AVRO-1006:
A clarification, which addresses issues raised
[
https://issues.apache.org/jira/browse/AVRO-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13203999#comment-13203999
]
Raymie Stata commented on AVRO-1021:
{quote} The types array in a protocol definition
[
https://issues.apache.org/jira/browse/AVRO-1022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13204168#comment-13204168
]
Raymie Stata commented on AVRO-1022:
The current implementation uses Character.isLetter
[
https://issues.apache.org/jira/browse/AVRO-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymie Stata updated AVRO-1021:
---
Attachment: AVRO-1021.patch
Fix a few name-related imperfections in Avro spec
Reporter: Raymie Stata
Assignee: Raymie Stata
Priority: Minor
Require names are defined before used; disallow multiple definitions of names;
clarify that name-equality is case sensitive (for type names, field names, and
enum symbols).
--
This message is automatically
[
https://issues.apache.org/jira/browse/AVRO-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymie Stata updated AVRO-1021:
---
Attachment: AVRO-1021.patch
Changes to spec.
Fix a few name-related imperfections
[
https://issues.apache.org/jira/browse/AVRO-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymie Stata updated AVRO-1021:
---
Status: Patch Available (was: Open)
Fix a few name-related imperfections in Avro spec
Error in validate name
--
Key: AVRO-1022
URL: https://issues.apache.org/jira/browse/AVRO-1022
Project: Avro
Issue Type: Bug
Components: java
Reporter: Raymie Stata
Priority: Minor
Fix
[
https://issues.apache.org/jira/browse/AVRO-1022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymie Stata updated AVRO-1022:
---
Attachment: AVRO-1022.patch
Error in validate name
--
Key
[
https://issues.apache.org/jira/browse/AVRO-1022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymie Stata updated AVRO-1022:
---
Status: Patch Available (was: Open)
Error in validate name
Reporter: Raymie Stata
Priority: Minor
Schema.parse(JsonParse) and Schema.parse(JsonNode,Names) save global state in a
local variable; they should restore that state in a finally clause but they
don't.
--
This message is automatically generated by JIRA.
If you think it was sent
[
https://issues.apache.org/jira/browse/AVRO-1023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymie Stata reassigned AVRO-1023:
--
Assignee: Raymie Stata
Saved state should be restored in finally clause
[
https://issues.apache.org/jira/browse/AVRO-1023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymie Stata updated AVRO-1023:
---
Attachment: AVRO-1023.patch
This patch looks big because I put fairly long stretches of code
[
https://issues.apache.org/jira/browse/AVRO-1023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymie Stata updated AVRO-1023:
---
Status: Patch Available (was: Open)
Saved state should be restored in finally clause
[
https://issues.apache.org/jira/browse/AVRO-1006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymie Stata updated AVRO-1006:
---
Attachment: schema-fingerprinting.html
Updated design doc based on feedback:
* Fixed typos
[
https://issues.apache.org/jira/browse/AVRO-1006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13193699#comment-13193699
]
Raymie Stata commented on AVRO-1006:
Sam writes:{quote}On the 0.001% collision rate
[
https://issues.apache.org/jira/browse/AVRO-1006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13193941#comment-13193941
]
Raymie Stata commented on AVRO-1006:
Sigh. My math is wrong. I think things are better
Fingerprints for Avro Schemas
-
Key: AVRO-1006
URL: https://issues.apache.org/jira/browse/AVRO-1006
Project: Avro
Issue Type: New Feature
Components: java
Reporter: Raymie Stata
[
https://issues.apache.org/jira/browse/AVRO-1006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymie Stata updated AVRO-1006:
---
Attachment: schema-fingerprinting.html
Detailed description of the proposed feature
[
https://issues.apache.org/jira/browse/AVRO-1006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13192909#comment-13192909
]
Raymie Stata commented on AVRO-1006:
An _Avro schema fingerprint_ is a hash of an Avro
[
https://issues.apache.org/jira/browse/AVRO-1006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymie Stata updated AVRO-1006:
---
Description: Add function that returns a standardized, 64-bit fingerprint
for schemas. Fingerprints
[
https://issues.apache.org/jira/browse/AVRO-1006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13192915#comment-13192915
]
Raymie Stata commented on AVRO-1006:
In implementing canonical forms, we identified
91 matches
Mail list logo
