[
https://issues.apache.org/jira/browse/FLUME-2459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648165#comment-14648165
]
sumeet Agrawal commented on FLUME-2459:
---------------------------------------
Flume can ingest data present in compressed form.In such cases it does not read
files but directly convert to binary objects.
You need to use correct deserializer for this.I had tried using snappy and gzip
compressed formats which was working fine.
tier2.sources.source1.deserializer =
org.apache.flume.sink.solr.morphline.BlobDeserializer$Builder
> Spooling Directory Source support for compressed files
> ------------------------------------------------------
>
> Key: FLUME-2459
> URL: https://issues.apache.org/jira/browse/FLUME-2459
> Project: Flume
> Issue Type: Improvement
> Components: Sinks+Sources
> Affects Versions: v1.5.0.1
> Reporter: Sverre Bakke
> Assignee: Johny Rufus
>
> Flume has a fantastic source for spooling files, however, many systems store
> relevant files as compressed files. The Spooling Directory Source should
> support GZip and BZip2 compressed files just as if they were plain text (e.g.
> read line by line).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
