[ 
https://issues.apache.org/jira/browse/FLUME-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13482861#comment-13482861
 ] 

Hari Shreedharan commented on FLUME-1645:
-----------------------------------------

Steve,

Generally looks good, but it looks to me it will generate files named: 
<something>.<counter><avro> (the . between the counter and avro would be 
missing. I think you need to do :
       if (fileSuffix != null && fileSuffix.length() > 0) {
          bucketPath += ("." + fileSuffix);
        }

Also can you add a unit test to make sure it works?
                
> add hdfs.fileSuffix property to HDFSEventSink
> ---------------------------------------------
>
>                 Key: FLUME-1645
>                 URL: https://issues.apache.org/jira/browse/FLUME-1645
>             Project: Flume
>          Issue Type: Improvement
>          Components: Sinks+Sources
>    Affects Versions: v1.2.0
>            Reporter: Steve Hoffman
>         Attachments: patch.diff
>
>
> I'd like to be able to use Avro files created by flume as input to a 
> MapReduce job.  However, the AvroInputFormat requires that avro files end in 
> .avro and there appears to be no property on the hdfs sink that allows me to 
> set a suffix (default being blank, of course).
> Thoughts?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to