In a long run, it does not matter how many WAL files per RS do you have, unless you disable compaction completely. You load rate will decrease over time as 1/LOG(S), where S is RS data size, base of LOG is something between min/max files for compaction ( 3 - 10). This is because of compaction. Compactions - this is what you should worry about.
-Vlad On Thu, Sep 3, 2015 at 1:40 PM, milindshah <[email protected]> wrote: > Hi > > I have a generic question regarding the performance improvement that > Multiwal should provide over single WAL. Has anyone tried to measure the > performance gain while loading a large data set , about 1-2TB size on a > cluster? I would appreciate if someone could share numbers and observed > improvement. I would like to try this on a 10 node cluster with 12 drives > each and load 2 TB of data using YCSB. > > Thanks, > Milind > > > > -- > View this message in context: > http://apache-hbase.679495.n3.nabble.com/Multiwal-performance-with-HBase-1-x-tp4074403.html > Sent from the HBase User mailing list archive at Nabble.com. >
