Compaction is no longer a serious problem? Close to 850GB/h ingest rate for 3 nodes cluster? Effect of 8 SSDs? Looks great, but ...
This is 78MB/sec load rate per server, taking into account compaction write amplification looks unbelievable even for 8 SSD. Can you publish test/hardware configuration and HBase version/config options: Max Heap 64GB, how much was allocated to memstores? What was JVM version/options? What GC did you use? Thanks for results -Vlad On Thu, Sep 17, 2015 at 8:37 PM, Jingcheng Du <[email protected]> wrote: > Now I've finished 3 tests for defaultWAL/singleWAL, 4 groups and 8 groups > with 1TB data. > Test env: 3 nodes, 8 SSD in each node, 64 GB heap size, pre-split 210 > regions in the cluster. > Results: > 1. DefaultWAL > RunTime(ms), 5340650.0 > Throughput(ops/sec), 187243.12583674272 > AverageLatency(us), 1060.6468652781823 > > 2. 4 groups > RunTime(ms), 4326704.0 > Throughput(ops/sec), 231122.8131159423 > AverageLatency(us), 859.4096927494501 > > 3. 8 groups > RunTime(ms), 4222285.0 > Throughput(ops/sec), 236838.58384737174 > AverageLatency(us), 849.488522633065 > > > > > > > > -- > View this message in context: > http://apache-hbase.679495.n3.nabble.com/Multiwal-performance-with-HBase-1-x-tp4074403p4074727.html > Sent from the HBase User mailing list archive at Nabble.com. >
