Hi Piotr, What about the nodes on AGRAF? Are the pending tasks balanced between this DC nodes as well? You can check the pending compactions on each node.
Also try to run "nodetool getcompactionthroughput" on all nodes and check if the compaction throughput is set to 999. Cheers, Roni Balthazar On 25 February 2015 at 14:47, Ja Sam <ptrstp...@gmail.com> wrote: > Hi Roni, > > It is not balanced. As I wrote you last week I have problems only in DC in > which we writes (on screen it is named as AGRAF: > https://drive.google.com/file/d/0B4N_AbBPGGwLR21CZk9OV1kxVDA/view). The > problem is on ALL nodes in this dc. > In second DC (ZETO) only one node have more than 30 SSTables and pending > compactions are decreasing to zero. > > In AGRAF the minimum pending compaction is 2500 , maximum is 6000 (avg on > screen from opscenter is less then 5000) > > > Regards > Piotrek. > > p.s. I don't know why my mail client display my name as Ja Sam instead of > Piotr Stapp, but this doesn't change anything :) > > > On Wed, Feb 25, 2015 at 5:45 PM, Roni Balthazar <ronibaltha...@gmail.com> > wrote: >> >> Hi Ja, >> >> How are the pending compactions distributed between the nodes? >> Run "nodetool compactionstats" on all of your nodes and check if the >> pendings tasks are balanced or they are concentrated in only few >> nodes. >> You also can check the if the SSTable count is balanced running >> "nodetool cfstats" on your nodes. >> >> Cheers, >> >> Roni Balthazar >> >> >> >> On 25 February 2015 at 13:29, Ja Sam <ptrstp...@gmail.com> wrote: >> > I do NOT have SSD. I have normal HDD group by JBOD. >> > My CF have SizeTieredCompactionStrategy >> > I am using local quorum for reads and writes. To be precise I have a lot >> > of >> > writes and almost 0 reads. >> > I changed "cold_reads_to_omit" to 0.0 as someone suggest me. I used set >> > compactionthrouput to 999. >> > >> > So if my disk are idle, my CPU is less then 40%, I have some free RAM - >> > why >> > SSTables count is growing? How I can speed up compactions? >> > >> > On Wed, Feb 25, 2015 at 5:16 PM, Nate McCall <n...@thelastpickle.com> >> > wrote: >> >> >> >> >> >>> >> >>> If You could be so kind and validate above and give me an answer is my >> >>> disk are real problems or not? And give me a tip what should I do with >> >>> above >> >>> cluster? Maybe I have misconfiguration? >> >>> >> >>> >> >> >> >> You disks are effectively idle. What consistency level are you using >> >> for >> >> reads and writes? >> >> >> >> Actually, 'await' is sort of weirdly high for idle SSDs. Check your >> >> interrupt mappings (cat /proc/interrupts) and make sure the interrupts >> >> are >> >> not being stacked on a single CPU. >> >> >> >> >> > > >
