[
https://issues.apache.org/jira/browse/FLUME-1295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575192#comment-14575192
]
Alan Feng commented on FLUME-1295:
----------------------------------
Can we incorporate this into the 1.7 release? There is no update to this ticket
for more than 2 years but I think this is definitely a very important
enhancement. It makes sense to have RollingFileSink share similar features as
HDFS Sink, as logically they really just differ from the file IO aspect.
This will allow me to archive large number of small log files from many systems
to the filesystem first (as Hadoop is not good with handling many small files),
and have a different source / sink defined to concatenate related small log
files into large ones to put into Hadoop.
> RollingFileSink need to be able to construct directory path based on escape
> sequence
> ------------------------------------------------------------------------------------
>
> Key: FLUME-1295
> URL: https://issues.apache.org/jira/browse/FLUME-1295
> Project: Flume
> Issue Type: Bug
> Components: Sinks+Sources
> Affects Versions: v1.2.0
> Reporter: Bhaskar Marthi
> Assignee: Ted Malaska
> Attachments: FLUME-1295-A.patch, FLUME-1295-B.patch
>
>
> Currently HDFSEventSink has an ability to construct the directory path based
> on escape sequence. It would be beneficial to have similar patch for
> RollingFileSink for people who just wants to use regular file system.
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)