Tom, The plots look good to me, see attachments.
Luc On Saturday, 4 April 2020 10:19:06 UTC-3, Tom Keffer wrote: > > Before you get too excited, make sure the fix still gives the right > answer. It uses a different query strategy. > > On Sat, Apr 4, 2020 at 6:17 AM Glenn McKechnie <[email protected] > <javascript:>> wrote: > >> Well, that fixed it on this machine! >> >> Back to the 16% mysqld usage with both 'aggregate_type = max' and >> 'aggregate_interval = 300' reinstated in skin.conf >> >> Wouldn't have a fix as smooth as that for covid-19 would you? >> >> >> >> On 04/04/2020, Thomas Keffer <[email protected] <javascript:>> wrote: >> > Luc, could you try the attached version of xtypes.py and see if it makes >> > any difference? >> > >> > -tk >> > >> > On Sat, Apr 4, 2020 at 5:10 AM Lucas Heijst <[email protected] >> <javascript:>> wrote: >> > >> >> Tom, Vince, Glenn, >> >> >> >> Glenn, >> >> Yes, I use external mariadb5 databases. >> >> And no, during the creation of the vector plots the memory use of weewx >> >> is >> >> not much (2.7 %). >> >> Changing the aggregate_interval has effect, but is not the main cause. >> >> >> >> Tom, Vince, Glenn, >> >> The main cause of the slow vector calculation is the aggregate_type = >> max >> >> on windgustvec. >> >> Without the max aggregation all 5 vector plots (6h, day, week, month, >> >> year) took together 24 seconds. >> >> >> >> Generated 76 images for report vproReport in 113.71 seconds >> >> >> >> Luc >> >> >> >> ===== >> >> [[[hourwindvec]]] >> >> [[[[windvec]]]] >> >> plot_type = vector >> >> [[[[windgustvec]]]] >> >> plot_type = vector >> >> ### aggregate_type = max >> >> ### aggregate_interval = 900 # == 15 min >> >> >> >> [[[daywindvec]]] >> >> [[[[windvec]]]] >> >> plot_type = vector >> >> [[[[windgustvec]]]] >> >> plot_type = vector >> >> ### aggregate_type = max >> >> ### aggregate_interval = 3600 # == 1 hour >> >> >> >> [[[weekwindvec]]] >> >> [[[[windvec]]]] >> >> plot_type = vector >> >> [[[[windgustvec]]]] >> >> plot_type = vector >> >> ### aggregate_type = max >> >> >> >> [[[monthwindvec]]] >> >> [[[[windvec]]]] >> >> plot_type = vector >> >> [[[[windgustvec]]]] >> >> plot_type = vector >> >> ### aggregate_type = max >> >> ### aggregate_interval = 3600 # == 1 hour >> >> >> >> [[[yearwindvec]]] >> >> [[[[windvec]]]] >> >> plot_type = vector >> >> [[[[windgustvec]]]] >> >> plot_type = vector >> >> ### aggregate_type = max >> >> ===== >> >> >> >> >> >> >> >> >> >> On Friday, 3 April 2020 22:33:50 UTC-3, Glenn McKechnie wrote: >> >>> >> >>> (Sigh, and to the list) >> >>> >> >>> Luc, >> >>> >> >>> I notice a "Launch of report thread aborted: existing report thread >> >>> still running" >> >>> >> >>> Do you use mysql (mariadb)? >> >>> If you do, does its CPU usage (from top) increase? >> >>> >> >>> If so try dropping the aggregate interval = 900 and see if there is a >> >>> difference >> >>> >> >>> On 04/04/2020, Lucas Heijst <[email protected]> wrote: >> >>> > Tom, >> >>> > >> >>> > There was not much info in the syslog, thats why I didnt send it. >> >>> > I included the syslog this time. >> >>> > >> >>> > I was wrong: the reportgenerator didn't hang, only it is VERY slow >> >>> > >> >>> > First I generated all other plots: 71 images in 90 seconds >> >>> > Generated 71 images for report vproReport in 89.58 seconds >> >>> > >> >>> > Then I added a 6-hour vector plot. Extra time for that 6h plot: 70 >> >>> seconds >> >>> > Generated 72 images for report vproReport in 159.32 seconds >> >>> > >> >>> > Then added a 24-hour vector plot. Extra time for that 24h vector >> plot >> >>> 266 >> >>> > seconds >> >>> > Generated 73 images for report vproReport in 425.79 seconds >> >>> > >> >>> > Estimated time for the other vector plots: >> >>> > week vector plot 31 minutes >> >>> > month vector plot: 137 minutes >> >>> > year vector plot: 27 hours >> >>> > >> >>> > Luc >> >>> > >> >>> > >> >>> > On Friday, 3 April 2020 20:13:16 UTC-3, Tom Keffer wrote: >> >>> >> >> >>> >> Worked fine for me. >> >>> >> >> >>> >> Luc: you know better. We need a log! Perhaps the ReportGenerator is >> >>> not >> >>> >> finishing before the next report is due? Perhaps the program >> >>> segfaulted? >> >>> >> Who knows without a log? >> >>> >> >> >>> >> -tk >> >>> >> [image: image.png] >> >>> >> >> >>> >> On Fri, Apr 3, 2020 at 4:09 PM Lucas Heijst <[email protected] >> >>> >> <javascript:>> wrote: >> >>> >> >> >>> >>> Currently running weewx 4.0.0b18. >> >>> >>> >> >>> >>> The reportgenerator hangs (it never finishes) during calculating >> of >> >>> the >> >>> >>> section below. >> >>> >>> >> >>> >>> [[[hourwindvec]]] >> >>> >>> [[[[windvec]]]] >> >>> >>> plot_type = vector >> >>> >>> [[[[windgustvec]]]] >> >>> >>> plot_type = vector >> >>> >>> aggregate_type = max >> >>> >>> aggregate_interval = 900 # == 15 min >> >>> >>> >> >>> >>> Luc >> >>> >>> >> >>> >>> -- >> >>> >>> You received this message because you are subscribed to the Google >> >>> Groups >> >>> >>> >> >>> >>> "weewx-development" group. >> >>> >>> To unsubscribe from this group and stop receiving emails from it, >> >>> send an >> >>> >>> >> >>> >>> email to [email protected] <javascript:>. >> >>> >>> To view this discussion on the web visit >> >>> >>> >> >>> >> https://groups.google.com/d/msgid/weewx-development/601f87df-cbe7-482c-bf49-722a7a5de7bd%40googlegroups.com >> >>> >>> >> >>> >>> < >> >>> >> https://groups.google.com/d/msgid/weewx-development/601f87df-cbe7-482c-bf49-722a7a5de7bd%40googlegroups.com?utm_medium=email&utm_source=footer >> > >> >>> >> >>> >>> . >> >>> >>> >> >>> >> >> >>> > >> >>> > -- >> >>> > You received this message because you are subscribed to the Google >> >>> Groups >> >>> > "weewx-development" group. >> >>> > To unsubscribe from this group and stop receiving emails from it, >> send >> >>> an >> >>> > email to [email protected]. >> >>> > To view this discussion on the web visit >> >>> > >> >>> >> https://groups.google.com/d/msgid/weewx-development/afee474f-61cb-4c8d-8bfd-5f1c9a18773f%40googlegroups.com >> . >> >>> >> >>> > >> >>> >> >>> >> >>> -- >> >>> >> >>> >> >>> Cheers >> >>> Glenn >> >>> >> >>> rorpi - read only raspberry pi & various weewx addons >> >>> https://github.com/glennmckechnie >> >>> >> >> -- >> >> You received this message because you are subscribed to the Google >> Groups >> >> "weewx-development" group. >> >> To unsubscribe from this group and stop receiving emails from it, send >> an >> >> email to [email protected] <javascript:>. >> >> To view this discussion on the web visit >> >> >> https://groups.google.com/d/msgid/weewx-development/a652d38c-0ed1-4171-9510-5ac601336362%40googlegroups.com >> >> < >> https://groups.google.com/d/msgid/weewx-development/a652d38c-0ed1-4171-9510-5ac601336362%40googlegroups.com?utm_medium=email&utm_source=footer >> > >> >> . >> >> >> > >> > -- >> > You received this message because you are subscribed to the Google >> Groups >> > "weewx-development" group. >> > To unsubscribe from this group and stop receiving emails from it, send >> an >> > email to [email protected] <javascript:>. >> > To view this discussion on the web visit >> > >> https://groups.google.com/d/msgid/weewx-development/CAPq0zECKNtZNoPb1hTckb3ttdxzhNNwzXc872du%3DmKDDuGOAtQ%40mail.gmail.com >> . >> > >> >> >> -- >> >> >> Cheers >> Glenn >> >> rorpi - read only raspberry pi & various weewx addons >> https://github.com/glennmckechnie >> > -- You received this message because you are subscribed to the Google Groups "weewx-development" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-development/9cade7ad-e559-4eb5-b397-410721892a4c%40googlegroups.com.
