Hi Otis / Flume devs,
if we could tail files in near real-time reliably using this source, it
would improve the availability of HBase-sink, Elasticsearch-sink and so on.
This patch have worked well in our production environment for more than 3
moths and seems to works well from the following
[
https://issues.apache.org/jira/browse/FLUME-2451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388303#comment-14388303
]
wangcong commented on FLUME-2451:
-
Set hdfs.closeWritersOnException to true will close
[
https://issues.apache.org/jira/browse/FLUME-2451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388302#comment-14388302
]
wangcong commented on FLUME-2451:
-
Set hdfs.closeWritersOnException to true will close
[
https://issues.apache.org/jira/browse/FLUME-2451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388827#comment-14388827
]
Roshan Naik edited comment on FLUME-2451 at 3/31/15 4:57 PM:
-
Does ELB provide any kind of status code when it rejects the request
or it just doesn't send any response?
Perhaps adding a JIRA would be great. Doesn't ELB times out connection
which are Idle for more than 60 sec?
thanks
ashish
On Tue, Mar 31, 2015 at 7:50 PM, Otis Gospodnetic
[
https://issues.apache.org/jira/browse/FLUME-2451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388827#comment-14388827
]
Roshan Naik commented on FLUME-2451:
[~hshreedharan] I am ok with that config assuming
Hi,
I don't have a very good bug report, but I want to share one problem with
Flume we observed the other day. Specifically, with Elasticsearch Sink and
AWS ELB, but others may have this problem, too.
In short, ELB has this notion of a Spillover where it can reject requests
when it can't handle
[
https://issues.apache.org/jira/browse/FLUME-2624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Deepesh Khandelwal updated FLUME-2624:
--
Attachment: FLUME-2624.2.patch
Attaching an updated patch, also updated the review
Hi,
Unfortunately don't have a patch, though I think this is just 1 method that
needs to be added. Don't think ELB provides the info needed, so one needs
to just have timeout.
Otis
--
Monitoring * Alerting * Anomaly Detection * Centralized Log Management
Solr Elasticsearch Support *
I am not very familiar with ELB, but if you do have a patch that will make
Flume work better - I’ll be glad to review it. I think the HDFS, HBase,
Morphline, Solr, Thrift, and Avro sinks will need it (similar logic, but
different impl).
Thanks, Hari
On Tue, Mar 31, 2015 at 9:27 AM, Ashish
10 matches
Mail list logo
