I'm not sure why the CQs would have started lagging, but in case it starts to happen again, you can set the CQs to recalculate prior intervals, too. That will help with the backfill:
CREATE CONTINUOUS QUERY router_rpm_1m_sum ON ac54edda_6a34_4b8b_99d3_ a949fb3c8994 *RESAMPLE FOR 5m* BEGIN SELECT sum(value) INTO ac54edda_6a34_4b8b_99d3_a949fb3c8994.retention_4w." router.rpm.1m.sum" FROM ac54edda_6a34_4b8b_99d3_a949fb3c8994.retention_1d."router.rpm" GROUP BY time(1m) END That will cause the CQ to recalculate the 1 minute buckets for the prior five minutes each time it runs. However, if the CQs are lagging because they can't execute in time, that will just make the issue worse. What are the results of "SELECT COUNT(value) FROM ac54edda_6a34_4b8b_99d3_ a949fb3c8994.retention_1d."router.rpm" WHERE time > now() - 15m GROUP BY time(1m)"? On Tue, Aug 30, 2016 at 5:23 AM, <[email protected]> wrote: > After further investigation, it seems that more than half of the inserts > were lagging by up to 1min for some reason. Since continuous queries don't > backfill, the continuous query sums were low, but checking the raw data > showed the correct numbers since the data had appeared there later. > > Rebooting the InfluxDB server has corrected the issue and the numbers are > now correct again, but I'm curious what would cause this kind of insert lag. > > On Tuesday, August 30, 2016 at 11:23:23 AM UTC+9, dave wrote: > > Hi, I've noticed recently that at least one of my continuous queries > doesn't contain all of the data that the raw series contains. See > http://imgur.com/a/R76G6 for an example comparison of the raw data vs. > the continuous query data. The continuous query is defined as follows: > > > > CREATE CONTINUOUS QUERY router_rpm_1m_sum ON > > ac54edda_6a34_4b8b_99d3_a949fb3c8994 > BEGIN > > SELECT sum(value) INTO ac54edda_6a34_4b8b_99d3_ > a949fb3c8994.retention_4w."router.rpm.1m.sum" > > FROM ac54edda_6a34_4b8b_99d3_a949fb3c8994.retention_1d."router.rpm" > > GROUP BY time(1m) END > > > > This wasn't always the case - up until several weeks ago it was > recording the correct data. I noticed a dip in our traffic graph, and > assumed that traffic had decreased, but recently checking the raw > (non-continuous) data I discovered that this was not the case. > Unfortunately the correct data has been deleted due to the retention > policy, so I can no longer compare it. > > > > Server load seems low (load average 0.09, CPU ~2%, 28% memory used, 13% > disk space used), and restarting InfluxDB hasn't helped. > > > > I'm running v0.13.0 on Ubuntu Ubuntu 14.04.4 LTS ( > https://s3.amazonaws.com/dl.influxdata.com/influxdb/ > releases/influxdb_0.13.0_amd64.deb). > > > > Any idea what is going on here, or what my next steps might be to > diagnose and fix the issue? > > > > Thanks > > -- > Remember to include the InfluxDB version number with all issue reports > --- > You received this message because you are subscribed to the Google Groups > "InfluxDB" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To post to this group, send email to [email protected]. > Visit this group at https://groups.google.com/group/influxdb. > To view this discussion on the web visit https://groups.google.com/d/ > msgid/influxdb/fe63a7ac-afac-4913-8f6b-00cc1782c9ed%40googlegroups.com. > For more options, visit https://groups.google.com/d/optout. > -- Sean Beckett Director of Support and Professional Services InfluxDB -- Remember to include the InfluxDB version number with all issue reports --- You received this message because you are subscribed to the Google Groups "InfluxDB" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at https://groups.google.com/group/influxdb. To view this discussion on the web visit https://groups.google.com/d/msgid/influxdb/CALGqCvORrF%2B_5xghkADzXOTugBL%3D-U5gpotvG%3D9PauYZKoo29w%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
