[
https://issues.apache.org/jira/browse/FLUME-1295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13455932#comment-13455932
]
Ted Malaska commented on FLUME-1295:
------------------------------------
Status:
Reviewed HDFSEventSink with respect to "escape sequence" and RollingFileSink.
Here are some of the things I found:
1. Looks like we will be able to reuse BucketPath, which is good.
2. HDFSEventSink has a Object called BucketWriter. One of the major things
this BucketWriter does is manage the rollover lifecycle of the file.
3. RollingFileSink handles all the rollover lifecycle it self.
My conclusions:
1. To complete 1295 the RollingFileSink will need to have something link a
BucketWriter.
2. I would hate to make two bucket writers. So I will connect with the Flume
brain trust and see if we can build a bucketWriter that can be extended to
handle HDFS and normal filesystems.
Let me know what you think
> RollingFileSink need to be able to construct directory path based on escape
> sequence
> ------------------------------------------------------------------------------------
>
> Key: FLUME-1295
> URL: https://issues.apache.org/jira/browse/FLUME-1295
> Project: Flume
> Issue Type: Bug
> Components: Sinks+Sources
> Affects Versions: v1.2.0
> Reporter: Bhaskar Marthi
> Assignee: Ted Malaska
>
> Currently HDFSEventSink has an ability to construct the directory path based
> on escape sequence. It would be beneficial to have similar patch for
> RollingFileSink for people who just wants to use regular file system.
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
