[
https://issues.apache.org/jira/browse/ACCUMULO-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983758#comment-13983758
]
Josh Elser commented on ACCUMULO-2749:
--------------------------------------
Interesting, I ran the same test on my box at home but had differing results
than you, [~kturner]. 8G JVM heap for tserver, 4G native map, 256M datablock
cache, 512M index block cache, 8M {{tserver.mutation.queue.max}}
I ran the test_ingest.sh 5 times and averaged the overall throughput with and
w/o WAL enabled on 1.5.1 and 1.6.0RC4
{panel:title=With WAL}
1.5.1 Average: 261,416 records/sec
1.6.0 Average: 237,364.8 records/sec
1.6.0 is 90.7% of 1.5.1
{panel}
{panel:title=Without WAL}
1.5.1 Average: 373,840.2 records/sec
1.6.0 Average: 367,572.8 records/sec
1.6.0 is 98.3% of 1.5.1
{panel}
Those are pretty darn close considering other sources of variance/entropy. I'll
try some more tests (DevNullIterator) and varying native map size and use.
> 1.6.0RC4 slower than 1.5.1
> --------------------------
>
> Key: ACCUMULO-2749
> URL: https://issues.apache.org/jira/browse/ACCUMULO-2749
> Project: Accumulo
> Issue Type: Bug
> Affects Versions: 1.6.0
> Reporter: Keith Turner
> Fix For: 1.6.1
>
>
> I am seeing consistently slower write rates when comparing 1.5.1 and 1.6.0
> RC4. Following env :
> * hadoop 2.2.0
> * Zookeeper 3.4.5
> * Centos 6 (native, not a VM)
> * using examples/3GB/native-standalone config
> * setting tserver.mutation.queue.max 4M
> * I am running test/system/test1/ingest_test.sh
> * single node
> Saw the following rates
> {noformat}
> 1.5.1 aggregate rate : 200,806 records/sec
> 1.6.0 aggregate rate : 181,264 records/sec (90%)
> {noformat}
> Reran test setting table.walog.enabled=false
> {noformat}
> 1.5.1 aggregate rate : 302,307 records/sec
> 1.6.0 aggregate rate : 232,685 records/sec (77%)
> {noformat}
> Since the relative performance gap seemed to widen when disabling walog I
> tried another test where I disabled walogs and set the devnull iterator
> {noformat}
> 1.5.1 aggregate rate : 554,853 records/sec
> 1.6.0 aggregate rate : 373,556 records/sec (67%)
> {noformat}
> The relative performance gap grew even further.
> Used the following command to enable dev null iterator in 1.5.1 and RC4
> {noformat}
> config -t test_ingest -s
> table.iterator.minc.devnull=10,org.apache.accumulo.core.iterators.DevNull
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
