[
https://issues.apache.org/jira/browse/AVRO-2474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17297252#comment-17297252
]
Ryan Skraba commented on AVRO-2474:
-----------------------------------
Time in source status: 599d 16h 35m :/
I want to say that I appreciate the engineering work that went into the
implementation and the proposal, and I watched the video. Is development work
continuing on [Coulomb|https://github.com/erikerlandson/coulomb]? It's a
project that deserves a shout out!
On our end, and in my experience, unit analysis and metadata in the schema
doesn't fit well with our company's use of Avro for persistence and data
transfer. We do things like "semantic typing" (some units and other
categories) and filtering, and I've talked about your proposal internally as a
future work, but as it stands, we just do all of our work in our toolkit on top
of Avro.
Do you think we could put this work in the wIki as [AEP
104|https://cwiki.apache.org/confluence/display/AVRO/Avro+Enhancement+Proposals]
with links to Coulomb and this JIRA for future reference? Was it ever voted
on? I could only find this [original
discussion|https://lists.apache.org/x/[email protected]:gte=1d:units].
Another idea -- there's a different JIRA AVRO-2952 that also adds a lot of
custom processing (for DI-like annotations). It might be worthwhile taking a
look to see what we would need to be able to specify things like "units" and
"di-annotations" as an opt-in part of the spec with some sort of extension
framework or entrypoint. If it were "pluggable" instead of part of core, it
would be easier to adopt and innovate.
> Support a "unit" property of schema fields
> ------------------------------------------
>
> Key: AVRO-2474
> URL: https://issues.apache.org/jira/browse/AVRO-2474
> Project: Apache Avro
> Issue Type: Improvement
> Components: spec
> Affects Versions: 1.9.0
> Reporter: Erik Erlandson
> Priority: Major
> Labels: aep
>
> Recently I have been experimenting with avro schema that are extended with a
> "unit" field. By "unit" I mean expressions like "second", or "megabyte" -
> that is "units of measure".
>
> I received some community interest in making this concept "first class" for
> avro; I'm filing this JIRA to track the idea.
>
> I delivered a short talk on my experiments at Berlin Buzzwords, which can be
> viewed here:
> [https://www.youtube.com/watch?v=qrQmB2KFKE8]
>
> I also wrote a short blog post that may be faster to ingest:
> [http://erikerlandson.github.io/blog/2019/05/23/unit-types-for-avro-schema-integrating-avro-with-coulomb/]
>
> The project itself is here:
> [https://github.com/erikerlandson/coulomb]
>
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
