[
https://issues.apache.org/jira/browse/PIG-3015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13493010#comment-13493010
]
Cheolsoo Park commented on PIG-3015:
------------------------------------
Hi Russell,
Thank you very much for offering help. :-)
{quote}
However, I don't think its acceptable to break backwards-compatibility with the
existing AvroStorage, and having two implementations at once seems confusing.
It would be best to extend this implementation with those features required to
maintain compatibility with the Piggybank AvroStorage before committing it as a
builtin.
{quote}
Sure, we can wait until completing the new AvroStorage before commit it, and I
won't insist to maintain two versions of AvroStorage if that's confusing to
others.
But given that the new AvroStorage will have different options from the current
AvroStorage, it seems unavoidable to introduce some backward incompatibility.
For example, Joseph's proposal for new options are very different from those of
the current AvroStorage. Would that be acceptable?
> Rewrite of AvroStorage
> ----------------------
>
> Key: PIG-3015
> URL: https://issues.apache.org/jira/browse/PIG-3015
> Project: Pig
> Issue Type: Improvement
> Components: piggybank
> Reporter: Joseph Adler
> Assignee: Joseph Adler
>
> The current AvroStorage implementation has a lot of issues: it requires old
> versions of Avro, it copies data much more than needed, and it's verbose and
> complicated. (One pet peeve of mine is that old versions of Avro don't
> support Snappy compression.)
> I rewrote AvroStorage from scratch to fix these issues. In early tests, the
> new implementation is significantly faster, and the code is a lot simpler.
> Rewriting AvroStorage also enabled me to implement support for Trevni.
> I'm opening this ticket to facilitate discussion while I figure out the best
> way to contribute the changes back to Apache.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
