[
https://issues.apache.org/jira/browse/ACCUMULO-119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13150783#comment-13150783
]
Keith Turner commented on ACCUMULO-119:
---------------------------------------
I ran some experiments on a small cluster. I would write 4000 mutations,
flushing after each mutation, with varying numbers of threads.
1 thread w/o group commit, took around 6 secs
16 threads w/o group commit, each thread took about 15 secs
1 thread w/ group commit, took around 5 secs
16 threads w/ group commit, each thread took about 5 secs
This is a nice improvement for lots of small writes. Not sure if applications
doing lots of batch writes will see any difference, I plan to try running
continuous ingest with and without group commit.
> Implement group commit for write ahead logs
> -------------------------------------------
>
> Key: ACCUMULO-119
> URL: https://issues.apache.org/jira/browse/ACCUMULO-119
> Project: Accumulo
> Issue Type: Improvement
> Components: tserver
> Reporter: Keith Turner
> Assignee: Keith Turner
> Fix For: 1.5.0
>
> Attachments: ACCUMULO-119-2.patch
>
>
> Currently access to the tablet server write ahead logs is synchronized. It
> may be better if all writes bound for the write ahead log were put on a queue
> and processed by a background thread. This would allow writes from multiple
> clients to be grouped and written to the write ahead log at once.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
