Slow bulk loading

2015-05-07 Thread Pierre Devops
Hi, I m streaming a big sstable using bulk loader of sstableloader but it's very slow (3 Mbytes/sec) : Summary statistics: Connections per host: : 1 Total files transferred: : 1 Total bytes transferred: : 10357947484 Total duration (ms): : 3280229

Re: Slow bulk loading

2015-05-07 Thread Mike Neir
It sounds as though you could be having troubles with Garbage Collection. Check your cassandra system logs and search for GC. If you see frequent garbage collections taking more than a second or two to complete, you're going to need to do some configuration tweaking. On 05/07/2015 04:44 AM,

Re: Slow bulk loading

2015-05-07 Thread Nate McCall
When I upload I notice one core of the cassandra node is full CPU (all other cores are idleing), Take a look at the interrupt distribution (cat /proc/interrupts). You'll probably see disk and network interrupts mostly/all bound to CPU0. If that is the case, this article has an excellent