"-XX:+CMSIncrementalMode" is our default but its for nodes with 2 or less CPUs according to http://java.sun.com/javase/technologies/hotspot/gc/gc_tuning_6.html. You might try without this.
But I am surprising that the node(5) which has 8CPU cores and 4GB RAM, 6 > SATA-RAID1, has problem. > > avg-cpu: %user %nice %system %iowait %steal %idle > 7.46 0.00 3.28 23.11 0.00 66.15 > Device: rrqm/s wrqm/s r/s w/s rsec/s wsec/s avgrq-sz > avgqu-sz await svctm %util > sda 84.83 25.12 485.57 2.49 53649.75 220.90 110.38 > 9.20 18.85 2.04 99.53 > dm-0 0.00 0.00 0.00 25.12 0.00 201.00 8.00 > 0.01 0.27 0.01 0.02 > dm-1 0.00 0.00 570.90 2.49 53655.72 19.90 93.61 > 10.74 18.72 1.74 99.53 > > It seems the disk I/O is very busy. > Yeah. Whats writing? Can you tell? Is it NN or ZK node? St.Ack
