[
https://issues.apache.org/jira/browse/FLUME-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13866529#comment-13866529
]
Roshan Naik commented on FLUME-2277:
------------------------------------
FYI...
Based on some trial FC perf measurements i did recently and reported on the dev
list, there is lots of spare disk & cpu capacity even when FC speed is maxed
out (on single disk) with all the configuration tweaks. Consequently, adding
multiple FC instances on the same disk has helped easily improve throughput on
the host. It scaled fairly linearly till there was no more CPU capacity left.
So, before adding additional disks, it would worthwhile to add more FC
instances (after verifying disk & cpu utilization) either in the form of
separate agents or within a single agent on the same host.
Was able to do a bit of profiling recently (need to do some more) on the where
the cycles are going in FC... will report some preliminary observations soon on
the dev list.
> Improve FileChannel documentation to address commons support issues
> -------------------------------------------------------------------
>
> Key: FLUME-2277
> URL: https://issues.apache.org/jira/browse/FLUME-2277
> Project: Flume
> Issue Type: Task
> Reporter: Brock Noland
> Assignee: Brock Noland
> Attachments: FLUME-2277.patch
>
>
> Often users configure too small of batch size with File Channel, use sources
> such as Exec source which generate small batches, or do not configure
> multiple disks.
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
