nickva commented on issue #806: FEEDBACK ONLY: Compactor optimize emsort URL: https://github.com/apache/couchdb/pull/806#issuecomment-329798421 Wanted to test performance so built a script to benchmark compaction: https://gist.github.com/nickva/e87aa2f7f896805bfee36a044a3800b0 I see a very nice speedup with a 1M docs database where each doc has 50 revisions ``` (master) $ ./compact_bench.py -r 50 -n 1000000 **************** num=1000000,revisions=50 **************** Updating : 1045.4s docs/s:956 revs/s:47827 fsize:4320194765 Compacting : 494.2s docs/s:2023 revs/s:101180 fsize:1765470407 (compactor-optimize-emsort) ./compact_bench.py -r 50 -n 1000000 **************** num=1000000,revisions=50 **************** Updating : 961.0s docs/s:1040 revs/s:52029 fsize:4320194765 Compacting : 307.7s docs/s:3250 revs/s:162518 fsize:1765470407 ``` This looks very nice. Great work. Don't see 30-40% speedups that often. Made a few comments in the code. But otherwise looks great. +1 ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
With regards, Apache Git Services
