Hi! Thank you for trying to help. Here are the settings. Do you need to know some more? > memstore hbase.hregion.memstore.flush.size=128MB
> compaction hbase.extendedperiod=1hour hbase.hstore.compactionThreshold=3 hbase.hstore.blockingStoreFiles=10 hbase.hstore.compaction.max=_ hbase.hregion.majorcompaction=1day hbase.offpeak.start.hour=1 hbase.offpeak.end.hour=5 2015-05-20 18:01 GMT+03:00 ramkrishna vasudevan < ramkrishna.s.vasude...@gmail.com>: > Can you specify what are the other details like the memstore size, the > compaction related configurations? > > On Wed, May 20, 2015 at 8:11 PM, Serega Sheypak <serega.shey...@gmail.com> > wrote: > > > Hi, any input here? > > > > 2015-05-19 2:26 GMT+03:00 Serega Sheypak <serega.shey...@gmail.com>: > > > > > Hi, we are using extremely cheap HW: > > > 2 HHD 7200 > > > 4*2 core (Hyperthreading) > > > 32GB RAM > > > > > > We met serious IO performance issues. > > > We have more or less even distribution of read/write requests. The same > > > for datasize. > > > > > > ServerName Request Per Second Read Request Count Write Request Count > > > node01.domain.com,60020,1430172017193 195 171871826 16761699 > > > node02.domain.com,60020,1426925053570 24 34314930 16006603 > > > node03.domain.com,60020,1430860939797 22 32054801 16913299 > > > node04.domain.com,60020,1431975656065 33 1765121 253405 > > > node05.domain.com,60020,1430484646409 27 42248883 16406280 > > > node07.domain.com,60020,1426776403757 27 36324492 16299432 > > > node08.domain.com,60020,1426775898757 26 38507165 13582109 > > > node09.domain.com,60020,1430440612531 27 34360873 15080194 > > > node11.domain.com,60020,1431989669340 28 44307 13466 > > > node12.domain.com,60020,1431927604238 30 5318096 2020855 > > > node13.domain.com,60020,1431372874221 29 31764957 15843688 > > > node14.domain.com,60020,1429640630771 41 36300097 13049801 > > > > > > ServerName Num. Stores Num. Storefiles Storefile Size Uncompressed > > Storefile > > > Size Index Size Bloom Size > > > node01.domain.com,60020,1430172017193 82 186 1052080m 76496mb 641849k > > > 310111k > > > node02.domain.com,60020,1426925053570 82 179 1062730m 79713mb 649610k > > > 318854k > > > node03.domain.com,60020,1430860939797 82 179 1036597m 76199mb 627346k > > > 307136k > > > node04.domain.com,60020,1431975656065 82 400 1034624m 76405mb 655954k > > > 289316k > > > node05.domain.com,60020,1430484646409 82 185 1111807m 81474mb 688136k > > > 334127k > > > node07.domain.com,60020,1426776403757 82 164 1023217m 74830mb 631774k > > > 296169k > > > node08.domain.com,60020,1426775898757 81 171 1086446m 79933mb 681486k > > > 312325k > > > node09.domain.com,60020,1430440612531 81 160 1073852m 77874mb 658924k > > > 309734k > > > node11.domain.com,60020,1431989669340 81 166 1006322m 75652mb 664753k > > > 264081k > > > node12.domain.com,60020,1431927604238 82 188 1050229m 75140mb 652970k > > > 304137k > > > node13.domain.com,60020,1431372874221 82 178 937557m 70042mb 601684k > > > 257607k > > > node14.domain.com,60020,1429640630771 82 145 949090m 69749mb 592812k > > > 266677k > > > > > > > > > When compaction starts random node gets I/O 100%, io wait for seconds, > > > even tenth of seconds. > > > > > > What are the approaches to optimize minor and major compactions when > you > > > are I/O bound..? > > > > > >
