[
https://issues.apache.org/jira/browse/FLUME-2450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14115552#comment-14115552
]
Hari Shreedharan commented on FLUME-2450:
-----------------------------------------
[~brocknoland] - Please take a look when you get a chance.
[~gvarada75] - It will be part of the next release if a committer reviews and
commits this soon. I can't be sure how much performance improvement you'd see.
You can try it out yourself. [~gmalouf] did try an earlier version of this
patch that I sent to him directly, which uses only direct memory - and the
performance improved by at least an order of magnitude, but that would require
the user to configure more direct memory on startup, or the channel would never
start. So this one does mmap of the files and uses a hash map, which should
give some improvement - though how much it would improve is something I am not
sure of.
> Improve replay index insertion speed.
> -------------------------------------
>
> Key: FLUME-2450
> URL: https://issues.apache.org/jira/browse/FLUME-2450
> Project: Flume
> Issue Type: Bug
> Reporter: Hari Shreedharan
> Assignee: Hari Shreedharan
> Attachments: FLUME-2450.patch
>
>
> Insertion into the replay index can take long sometimes because we use a file
> based index and tree set. We should switch this out for a memory mapped db
> and a hash set.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
