[ 
https://issues.apache.org/jira/browse/FLUME-1295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575192#comment-14575192
 ] 

Alan Feng commented on FLUME-1295:
----------------------------------

Can we incorporate this into the 1.7 release? There is no update to this ticket 
for more than 2 years but I think this is definitely a very important 
enhancement. It makes sense to have RollingFileSink share similar features as 
HDFS Sink, as logically they really just differ from the file IO aspect. 
This will allow me to archive large number of small log files from many systems 
to the filesystem first (as Hadoop is not good with handling many small files), 
and have a different source / sink defined to concatenate related small log 
files into large ones to put into Hadoop.

> RollingFileSink need to be able to construct directory path based on escape 
> sequence
> ------------------------------------------------------------------------------------
>
>                 Key: FLUME-1295
>                 URL: https://issues.apache.org/jira/browse/FLUME-1295
>             Project: Flume
>          Issue Type: Bug
>          Components: Sinks+Sources
>    Affects Versions: v1.2.0
>            Reporter: Bhaskar Marthi
>            Assignee: Ted Malaska
>         Attachments: FLUME-1295-A.patch, FLUME-1295-B.patch
>
>
> Currently HDFSEventSink has an ability to construct the directory path based 
> on escape sequence.  It would be beneficial to have similar patch for 
> RollingFileSink for people who just wants to use regular file system.
>  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to