JingCheng's test result is similar to what we observed with multiwal enabled on our online cluster, say ~20% improvements with 4 wal groups. It's a 800 nodes cluster and each node with 3 ssd and 9 sata disks, and we set storage policy of wals to ALL_SSD.
Compaction impact could be further reduced by separating compaction IO and wal sync IO, like setting storage policy of WALs dir to ALL_SSD and data dir to HOT(default), FYI. Best Regards, Yu On 18 September 2015 at 13:30, Jingcheng Du <[email protected]> wrote: > More information for the test. > I use ycsb 0.3.0 for the test. > The command line is "./ycsb load hbase-10 -P ../workloads/workload -threads > 200 -p columnfamily=family -p clientbuffering=true -s > workload.dat" > The workload is, the data size is slightly less than 1TB: > fieldcount=5 > fieldlength=200 > recordcount=1000000000 > maxexecutiontime=86400 > > > > -- > View this message in context: > http://apache-hbase.679495.n3.nabble.com/Multiwal-performance-with-HBase-1-x-tp4074403p4074731.html > Sent from the HBase User mailing list archive at Nabble.com. >
