[
https://issues.apache.org/jira/browse/FLUME-2437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14329000#comment-14329000
]
Pawel Rog commented on FLUME-2437:
----------------------------------
Hi,
{quote} Do they prefer if we rename the files? {quote}
I'm not sure if I understood it correctly. Are you asking if S3 source should
rename files after reading it? I think it shouldn't. People may use S3 log
filed not only to make it readable by Flume source but maybe also for other
purposes.
I would just see zookeeper as a good place to store information about files
which were already read and which still should be loaded. Storing the name of
last file may be enough and reading files chronologically.
Is it possible to share some partial implementation as a pull request in
repository which you created? Maybe it can help to understand the direction,
and maybe some ideas or questions can appear.
> S3 Source
> ---------
>
> Key: FLUME-2437
> URL: https://issues.apache.org/jira/browse/FLUME-2437
> Project: Flume
> Issue Type: New Feature
> Reporter: Jonathan Natkins
> Assignee: Ashish Paliwal
>
> There have been multiple requests on the mailing list for an S3 source
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
