Re: [collectd] RRDs on SSD - performance degredation [resend without images]

2013-09-24 Thread Florian Forster
Hello, On Tue, Sep 24, 2013 at 05:51:57PM +0200, Mariusz Gronczewski wrote: > You *could* just bump up flush timers in rrdtool plugin like that: As an alternative, the "WritesPerSecond" might be interesting, because the number of writes performed no longer depends on the number of metrics on your

Re: [collectd] RRDs on SSD - performance degredation [resend without images]

2013-09-24 Thread Mariusz Gronczewski
2013/9/10 Thomas Harold > On 8/16/2013 4:14 AM, Cyril Feraudet wrote: > >> rrdcached is a daemon and a Collectd plugin who replace rrdtool plugin. >> >> There is no need to modify your architecture. Just install rrdcached and >> configure rrdcached Collectd plugin to work with. >> >> Before : >>

Re: [collectd] RRDs on SSD - performance degredation [resend without images]

2013-09-10 Thread Fabien Wernli
Hi, On Tue, Sep 10, 2013 at 03:44:31PM -0400, Thomas Harold wrote: > How do you deal with the options: > > RRARows 2 # PDPs = timespan / (stepsize * rrarows) > RRATimespan 32 # 3.7 days (16s) > RRATimespan 160 # 18.5 days (80s) > RRATimespan 800 # 92.6 days (400s) > RRATimespan 80

Re: [collectd] RRDs on SSD - performance degredation [resend without images]

2013-09-10 Thread Thomas Harold
On 8/16/2013 4:14 AM, Cyril Feraudet wrote: rrdcached is a daemon and a Collectd plugin who replace rrdtool plugin. There is no need to modify your architecture. Just install rrdcached and configure rrdcached Collectd plugin to work with. Before : LoadPlugin rrdtool DataDir "/var/lib/collec

Re: [collectd] RRDs on SSD - performance degredation [resend without images]

2013-08-18 Thread Florian Forster
Hi Jesse, On Fri, Aug 16, 2013 at 06:49:25PM +0930, Jesse Reynolds wrote: > Sounds too good to be true :-) collectd's "rrdtool" plugin and RRDCacheD use the same basic principle: Cache updates to RRD files in memory and write multiple updates at once. Due to the way RRD files are laid out, this w

Re: [collectd] RRDs on SSD - performance degredation [resend without images]

2013-08-16 Thread Cyril Feraudet
Try it and you'll see. rrdcached write to disk on demand and at the latest when the time specified is out. I/O may be decreased by 10 or more depending on the "interval" on collectd side and the '-w' option on rrdcached side. There is no migration to plan. Just start properly rrdcached and c

Re: [collectd] RRDs on SSD - performance degredation [resend without images]

2013-08-16 Thread Jesse Reynolds
On 16/08/2013, at 5:16 PM, Cyril Feraudet wrote: > Do you use rrdcached ? If not, use it and all you i/o problem will disappear. > Sounds too good to be true :-) Is the scheduling improved somehow? Is it more efficient with writing the RRD files? It seems that it will still need to update the

Re: [collectd] RRDs on SSD - performance degredation [resend without images]

2013-08-16 Thread Cyril Feraudet
rrdcached is a daemon and a Collectd plugin who replace rrdtool plugin. There is no need to modify your architecture. Just install rrdcached and configure rrdcached Collectd plugin to work with. Before : LoadPlugin rrdtool DataDir "/var/lib/collectd/rrd" After : LoadPlugin rrdcached Dae

Re: [collectd] RRDs on SSD - performance degredation [resend without images]

2013-08-16 Thread Cyril Feraudet
Hello, Do you use rrdcached ? If not, use it and all you i/o problem will disappear. Regards, Cyril Le 2013-08-16 00:39, Jesse Reynolds a écrit : > Hello, > > We're noticing some interesting patterns in collectd / librrd is flushing RRD > files to disk. > > We have a 1TB volume fo

[collectd] RRDs on SSD - performance degredation [resend without images]

2013-08-15 Thread Jesse Reynolds
Hello, We're noticing some interesting patterns in collectd / librrd is flushing RRD files to disk. We have a 1TB volume for RRD files, which is at 75% capacity. Over the last few weeks the response time of the disks has slowly degraded, with a few sudden jumps (see graph below). When it jum