[
https://issues.apache.org/jira/browse/FLUME-2321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13930180#comment-13930180
]
Guillermo Ortiz Fernández, Pragsis. commented on FLUME-2321:
------------------------------------------------------------
I tried to create a new report, but when I try to upload the patch I get
a error, I created the patch with "git diff origin/flume-1.4 >
FLUME-2321-0.patch"
No valid separator after the filename was found in the diff header
--
*Guillermo Ortiz*
/Big Data Developer/
Telf.: +34 917 680 490
Fax: +34 913 833 301
C/ Manuel Tovar, 49-53 - 28034 Madrid - Spain
_http://www.bidoop.es_
> New HDFSTextWritableSerializer for HDFS Sink
> --------------------------------------------
>
> Key: FLUME-2321
> URL: https://issues.apache.org/jira/browse/FLUME-2321
> Project: Flume
> Issue Type: New Feature
> Components: Configuration, Sinks+Sources
> Affects Versions: v1.4.0
> Environment: Centos 6.4, Java6_u34
> Reporter: Guillermo Ortiz Fernández, Pragsis.
> Priority: Minor
> Attachments: FLUME-2321-0.patch
>
>
> Generated a new way to save the SequenceFiles, So far, Flume has two
> different ways to write (Text and Writable) in HDFS, we must tell it in the
> configuration file like this:
> colector.sinks.SinkWritable.hdfs.writeFormat = Writable.
> I have created a new type TextWritable, where you can generated SequenceFile
> with Text as key and BytesWritable as value.
> The key must be configured with in the flume.conf, for example:
> colector.sinks.SinkWritable.hdfs.writeFormat = TextWritable.
> colector.sinks.SinkWritable.hdfs.textWritable.keyFormat =
> %{file}_%{host}_hello.
> When Flume generates the SequenceFile, the key will be the name of the file
> and the name of the host, these variables are totally configurable. If you
> don't define the property keyFormat the key will be the timestamp.
> I have the code done. I hope to improve a little the JavaDoc, modify the
> documentation today and upload the patch.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
