[
https://issues.apache.org/jira/browse/ACCUMULO-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13984659#comment-13984659
]
Keith Turner commented on ACCUMULO-2749:
----------------------------------------
It seems a lot of the performance differences I am seeing can be explained by
1.5.1-bin.tar.gz having a magical native map.
When I do the following I see slower performance than running w/ the native map
included w/ 1.5.1-bin.tar.gz.
{noformat}
cd server/src/main/c++/nativeMap/
make clean
make
{noformat}
[~elserj] do you know what version of g++ you used to build 1.5.1 native libs?
My g++ version is the following :
{noformat}
$ g++ -v
Using built-in specs.
Target: x86_64-redhat-linux
Configured with: ../configure --prefix=/usr --mandir=/usr/share/man
--infodir=/usr/share/info --with-bugurl=http://bugzilla.redhat.com/bugzilla
--enable-bootstrap --enable-shared --enable-threads=posix
--enable-checking=release --with-system-zlib --enable-__cxa_atexit
--disable-libunwind-exceptions --enable-gnu-unique-object
--enable-languages=c,c++,objc,obj-c++,java,fortran,ada --enable-java-awt=gtk
--disable-dssi --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-1.5.0.0/jre
--enable-libgcj-multifile --enable-java-maintainer-mode
--with-ecj-jar=/usr/share/java/eclipse-ecj.jar --disable-libjava-multilib
--with-ppl --with-cloog --with-tune=generic --with-arch_32=i686
--build=x86_64-redhat-linux
Thread model: posix
gcc version 4.4.7 20120313 (Red Hat 4.4.7-4) (GCC)
{noformat}
> 1.6.0RC4 slower than 1.5.1
> --------------------------
>
> Key: ACCUMULO-2749
> URL: https://issues.apache.org/jira/browse/ACCUMULO-2749
> Project: Accumulo
> Issue Type: Bug
> Reporter: Keith Turner
> Assignee: Eric Newton
> Fix For: 1.6.0
>
> Attachments: ingest_test.diff
>
>
> I am seeing consistently slower write rates when comparing 1.5.1 and 1.6.0
> RC4. Following env :
> * hadoop 2.2.0
> * Zookeeper 3.4.5
> * Centos 6 (native, not a VM)
> * using examples/3GB/native-standalone config
> * setting tserver.mutation.queue.max 4M
> * I am running test/system/test1/ingest_test.sh
> * single node
> Saw the following rates
> {noformat}
> 1.5.1 aggregate rate : 200,806 records/sec
> 1.6.0 aggregate rate : 181,264 records/sec (90%)
> {noformat}
> Reran test setting table.walog.enabled=false
> {noformat}
> 1.5.1 aggregate rate : 302,307 records/sec
> 1.6.0 aggregate rate : 232,685 records/sec (77%)
> {noformat}
> Since the relative performance gap seemed to widen when disabling walog I
> tried another test where I disabled walogs and set the devnull iterator
> {noformat}
> 1.5.1 aggregate rate : 554,853 records/sec
> 1.6.0 aggregate rate : 373,556 records/sec (67%)
> {noformat}
> The relative performance gap grew even further.
> Used the following command to enable dev null iterator in 1.5.1 and RC4
> {noformat}
> config -t test_ingest -s
> table.iterator.minc.devnull=10,org.apache.accumulo.core.iterators.DevNull
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
