[sink plugin)] Should I try to take and process events from the channel even when the implemented sink.stop() is called?

2015-08-14 Thread 吕林
Hi, all, We use flume to collect various data, and implemented one customized sink plugin to process these data. And we have a question that can we do some works like the sink.process() in the sin.stop() implemention, to try take and process events from the channel in sink.stop() function.

[jira] [Created] (FLUME-2765) ThriftSource spaws too many threads

2015-08-14 Thread Tobias Heintz (JIRA)
Tobias Heintz created FLUME-2765: Summary: ThriftSource spaws too many threads Key: FLUME-2765 URL: https://issues.apache.org/jira/browse/FLUME-2765 Project: Flume Issue Type: Bug

[jira] [Updated] (FLUME-2498) Implement Taildir Source

2015-08-14 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roshan Naik updated FLUME-2498: --- Attachment: FLUME-2498-5.patch Uploading Patch. - Changed the file consume order to be based on

[jira] [Commented] (FLUME-2765) ThriftSource spaws too many threads

2015-08-14 Thread Ashish Paliwal (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697396#comment-14697396 ] Ashish Paliwal commented on FLUME-2765: --- A thread dump plus a simple test case that

[jira] [Commented] (FLUME-1326) OutOfMemoryError in HDFSSink

2015-08-14 Thread li xiang (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697481#comment-14697481 ] li xiang commented on FLUME-1326: - Hi Dave, does it also apply to the file roll? The file

[jira] [Commented] (FLUME-1326) OutOfMemoryError in HDFSSink

2015-08-14 Thread li xiang (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697480#comment-14697480 ] li xiang commented on FLUME-1326: - Hi Dave, does it also apply to the file roll? The file

[jira] [Commented] (FLUME-2757) Hive Sink Tests failing due to incorrect permission on hive scratch dir

2015-08-14 Thread Ashish Paliwal (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697915#comment-14697915 ] Ashish Paliwal commented on FLUME-2757: --- Is it possible to use this API