[
https://issues.apache.org/jira/browse/FLUME-2437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14330355#comment-14330355
]
Johny Rufus commented on FLUME-2437:
------------------------------------
Yes, its in flume-ng-core, and its generic as it can represent any Inputstream
that doesnt support mark/reset, and a subclass of StreamCreator can be passed
to it, which represents the specific stream creation. Coming up with the logic
for offset handling was the tricky one
Let me know if you guys find this implementation working/sufficient as a base
version, or if you find any issues when trying it out/ submit pull requests as
needed. I can submit a patch later for review.
We can get the base version in, and later add a ZookeeperMetaDataBackingStore,
multi threaded version for multiple bucket handling, and any other requested
feature as add-ons. I will parallely start working on one of the above features
today
> S3 Source
> ---------
>
> Key: FLUME-2437
> URL: https://issues.apache.org/jira/browse/FLUME-2437
> Project: Flume
> Issue Type: New Feature
> Reporter: Jonathan Natkins
> Assignee: Ashish Paliwal
>
> There have been multiple requests on the mailing list for an S3 source
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
