[
https://issues.apache.org/jira/browse/FLUME-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13642941#comment-13642941
]
Tom White commented on FLUME-2010:
----------------------------------
Thanks for the review Mike.
bq. Couldn't we just store the schemas (one per line) and auto-generate the
64-bit hash? Why bother storing that?
Yes, that would work, but I kept the ID/schema mapping because that is how
AVRO-1124 does things, and I'd like to make it as easy as possible to migrate
to that scheme. There is nothing in the code that assumes the IDs are 64-bit
hashes - I just used that in the example on github.
I'll update the patch with more unit tests and documentation.
> Support Avro records in Log4jAppender and the HDFS Sink
> -------------------------------------------------------
>
> Key: FLUME-2010
> URL: https://issues.apache.org/jira/browse/FLUME-2010
> Project: Flume
> Issue Type: New Feature
> Components: Client SDK, Sinks+Sources
> Reporter: Tom White
> Assignee: Tom White
> Fix For: v1.4.0
>
> Attachments: FLUME-2010.patch, FLUME-2010.patch, FLUME-2010.patch
>
>
> It would be nice to support logging arbitrary Avro records via the Log4j
> Flume logger, and have them written to HDFS in Avro data files (using an
> appropriately configured HDFS sink).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira