Before you get too excited, make sure the fix still gives the right answer. It uses a different query strategy.
On Sat, Apr 4, 2020 at 6:17 AM Glenn McKechnie <[email protected]> wrote: > Well, that fixed it on this machine! > > Back to the 16% mysqld usage with both 'aggregate_type = max' and > 'aggregate_interval = 300' reinstated in skin.conf > > Wouldn't have a fix as smooth as that for covid-19 would you? > > > > On 04/04/2020, Thomas Keffer <[email protected]> wrote: > > Luc, could you try the attached version of xtypes.py and see if it makes > > any difference? > > > > -tk > > > > On Sat, Apr 4, 2020 at 5:10 AM Lucas Heijst <[email protected]> > wrote: > > > >> Tom, Vince, Glenn, > >> > >> Glenn, > >> Yes, I use external mariadb5 databases. > >> And no, during the creation of the vector plots the memory use of weewx > >> is > >> not much (2.7 %). > >> Changing the aggregate_interval has effect, but is not the main cause. > >> > >> Tom, Vince, Glenn, > >> The main cause of the slow vector calculation is the aggregate_type = > max > >> on windgustvec. > >> Without the max aggregation all 5 vector plots (6h, day, week, month, > >> year) took together 24 seconds. > >> > >> Generated 76 images for report vproReport in 113.71 seconds > >> > >> Luc > >> > >> ===== > >> [[[hourwindvec]]] > >> [[[[windvec]]]] > >> plot_type = vector > >> [[[[windgustvec]]]] > >> plot_type = vector > >> ### aggregate_type = max > >> ### aggregate_interval = 900 # == 15 min > >> > >> [[[daywindvec]]] > >> [[[[windvec]]]] > >> plot_type = vector > >> [[[[windgustvec]]]] > >> plot_type = vector > >> ### aggregate_type = max > >> ### aggregate_interval = 3600 # == 1 hour > >> > >> [[[weekwindvec]]] > >> [[[[windvec]]]] > >> plot_type = vector > >> [[[[windgustvec]]]] > >> plot_type = vector > >> ### aggregate_type = max > >> > >> [[[monthwindvec]]] > >> [[[[windvec]]]] > >> plot_type = vector > >> [[[[windgustvec]]]] > >> plot_type = vector > >> ### aggregate_type = max > >> ### aggregate_interval = 3600 # == 1 hour > >> > >> [[[yearwindvec]]] > >> [[[[windvec]]]] > >> plot_type = vector > >> [[[[windgustvec]]]] > >> plot_type = vector > >> ### aggregate_type = max > >> ===== > >> > >> > >> > >> > >> On Friday, 3 April 2020 22:33:50 UTC-3, Glenn McKechnie wrote: > >>> > >>> (Sigh, and to the list) > >>> > >>> Luc, > >>> > >>> I notice a "Launch of report thread aborted: existing report thread > >>> still running" > >>> > >>> Do you use mysql (mariadb)? > >>> If you do, does its CPU usage (from top) increase? > >>> > >>> If so try dropping the aggregate interval = 900 and see if there is a > >>> difference > >>> > >>> On 04/04/2020, Lucas Heijst <[email protected]> wrote: > >>> > Tom, > >>> > > >>> > There was not much info in the syslog, thats why I didnt send it. > >>> > I included the syslog this time. > >>> > > >>> > I was wrong: the reportgenerator didn't hang, only it is VERY slow > >>> > > >>> > First I generated all other plots: 71 images in 90 seconds > >>> > Generated 71 images for report vproReport in 89.58 seconds > >>> > > >>> > Then I added a 6-hour vector plot. Extra time for that 6h plot: 70 > >>> seconds > >>> > Generated 72 images for report vproReport in 159.32 seconds > >>> > > >>> > Then added a 24-hour vector plot. Extra time for that 24h vector plot > >>> 266 > >>> > seconds > >>> > Generated 73 images for report vproReport in 425.79 seconds > >>> > > >>> > Estimated time for the other vector plots: > >>> > week vector plot 31 minutes > >>> > month vector plot: 137 minutes > >>> > year vector plot: 27 hours > >>> > > >>> > Luc > >>> > > >>> > > >>> > On Friday, 3 April 2020 20:13:16 UTC-3, Tom Keffer wrote: > >>> >> > >>> >> Worked fine for me. > >>> >> > >>> >> Luc: you know better. We need a log! Perhaps the ReportGenerator is > >>> not > >>> >> finishing before the next report is due? Perhaps the program > >>> segfaulted? > >>> >> Who knows without a log? > >>> >> > >>> >> -tk > >>> >> [image: image.png] > >>> >> > >>> >> On Fri, Apr 3, 2020 at 4:09 PM Lucas Heijst <[email protected] > >>> >> <javascript:>> wrote: > >>> >> > >>> >>> Currently running weewx 4.0.0b18. > >>> >>> > >>> >>> The reportgenerator hangs (it never finishes) during calculating of > >>> the > >>> >>> section below. > >>> >>> > >>> >>> [[[hourwindvec]]] > >>> >>> [[[[windvec]]]] > >>> >>> plot_type = vector > >>> >>> [[[[windgustvec]]]] > >>> >>> plot_type = vector > >>> >>> aggregate_type = max > >>> >>> aggregate_interval = 900 # == 15 min > >>> >>> > >>> >>> Luc > >>> >>> > >>> >>> -- > >>> >>> You received this message because you are subscribed to the Google > >>> Groups > >>> >>> > >>> >>> "weewx-development" group. > >>> >>> To unsubscribe from this group and stop receiving emails from it, > >>> send an > >>> >>> > >>> >>> email to [email protected] <javascript:>. > >>> >>> To view this discussion on the web visit > >>> >>> > >>> > https://groups.google.com/d/msgid/weewx-development/601f87df-cbe7-482c-bf49-722a7a5de7bd%40googlegroups.com > >>> >>> > >>> >>> < > >>> > https://groups.google.com/d/msgid/weewx-development/601f87df-cbe7-482c-bf49-722a7a5de7bd%40googlegroups.com?utm_medium=email&utm_source=footer > > > >>> > >>> >>> . > >>> >>> > >>> >> > >>> > > >>> > -- > >>> > You received this message because you are subscribed to the Google > >>> Groups > >>> > "weewx-development" group. > >>> > To unsubscribe from this group and stop receiving emails from it, > send > >>> an > >>> > email to [email protected]. > >>> > To view this discussion on the web visit > >>> > > >>> > https://groups.google.com/d/msgid/weewx-development/afee474f-61cb-4c8d-8bfd-5f1c9a18773f%40googlegroups.com > . > >>> > >>> > > >>> > >>> > >>> -- > >>> > >>> > >>> Cheers > >>> Glenn > >>> > >>> rorpi - read only raspberry pi & various weewx addons > >>> https://github.com/glennmckechnie > >>> > >> -- > >> You received this message because you are subscribed to the Google > Groups > >> "weewx-development" group. > >> To unsubscribe from this group and stop receiving emails from it, send > an > >> email to [email protected]. > >> To view this discussion on the web visit > >> > https://groups.google.com/d/msgid/weewx-development/a652d38c-0ed1-4171-9510-5ac601336362%40googlegroups.com > >> < > https://groups.google.com/d/msgid/weewx-development/a652d38c-0ed1-4171-9510-5ac601336362%40googlegroups.com?utm_medium=email&utm_source=footer > > > >> . > >> > > > > -- > > You received this message because you are subscribed to the Google Groups > > "weewx-development" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to [email protected]. > > To view this discussion on the web visit > > > https://groups.google.com/d/msgid/weewx-development/CAPq0zECKNtZNoPb1hTckb3ttdxzhNNwzXc872du%3DmKDDuGOAtQ%40mail.gmail.com > . > > > > > -- > > > Cheers > Glenn > > rorpi - read only raspberry pi & various weewx addons > https://github.com/glennmckechnie > -- You received this message because you are subscribed to the Google Groups "weewx-development" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-development/CAPq0zECGWaRd-7Yt47NVNYe5qNLaxQ7yfJpFbOg6J7MLdq3wEA%40mail.gmail.com.
