Tom, all times were WeeWX re-weighting during start, none were from wee_database (after seeing WeeWX start re-weighting the weewx database I thought I woudl have to manually do my other databases so had typed the wee_database command all ready to go but never needed it as the other databases were re-weighted automatically during startup). Also, hadn't realised that only records since 1 June 2020 were being re-weighted, had assumed it was all. In that case all of my databases would have been the same, they all have records from 1 June 2020 onwards.
FWIW here are some log extracts showing times. To be fair the cmon and weewxwd databases have only a handful of columns so hence the quick patch times. aurora db has more columns than cmon/weewxwd but not as many as ecowitt and weewx which both use the extended schema: ecowitt instance single MySQL db (217 seconds): Dec 30 13:46:15 cockatoo weewx-ecowitt[9395] INFO weewx.engine: StdConvert target unit is 0x10 Dec 30 13:46:15 cockatoo weewx-ecowitt[9395] INFO weewx.manager: Daily summaries at V2.0. Patching to V3.0 Dec 30 13:46:15 cockatoo weewx-ecowitt[9395] INFO weewx.manager: recalculate_weights: Using database 'ecowitt' Dec 30 13:49:52 cockatoo weewx-ecowitt[9395] INFO weewx.manager: Patch finished. Dec 30 13:49:52 cockatoo weewx-ecowitt[9395] INFO weewx.engine: Archive will use data binding wx_binding vantage instance multiple MySQL db (220/21/21 seconds): Dec 30 13:56:26 cockatoo weewx-vantage[9648] INFO weewx.engine: StdConvert target unit is 0x10 Dec 30 13:56:26 cockatoo weewx-vantage[9648] INFO weewx.manager: Daily summaries at V2.0. Patching to V3.0 Dec 30 13:56:26 cockatoo weewx-vantage[9648] INFO weewx.manager: recalculate_weights: Using database 'weewx' Dec 30 14:00:06 cockatoo weewx-vantage[9648] INFO weewx.manager: Patch finished. Dec 30 14:00:06 cockatoo weewx-vantage[9648] INFO user.cmon: service version is 0.20 Dec 30 14:00:06 cockatoo weewx-vantage[9648] INFO weewx.manager: Daily summaries at V2.0. Patching to V3.0 Dec 30 14:00:06 cockatoo weewx-vantage[9648] INFO weewx.manager: recalculate_weights: Using database 'cmon' Dec 30 14:00:27 cockatoo weewx-vantage[9648] INFO weewx.manager: Patch finished. Dec 30 14:00:27 cockatoo weewx-vantage[9648] INFO user.cmon: sysinfo: Linux cockatoo 5.4.72-v7+ #1356 SMP Thu Oct 22 13:56:54 BST 2020 armv7l Dec 30 14:00:27 cockatoo weewx-vantage[9648] INFO user.cmon: cpuinfo: processor: 3 Dec 30 14:00:27 cockatoo weewx-vantage[9648] INFO user.cmon: cpuinfo: model name: ARMv7 Processor rev 4 (v7l) Dec 30 14:00:27 cockatoo weewx-vantage[9648] INFO user.cmon: cpuinfo: BogoMIPS: 57.60 Dec 30 14:00:27 cockatoo weewx-vantage[9648] INFO user.cmon: cpuinfo: Features: half thumb fastmult vfp edsp neon vfpv3 tls vfpv4 idiva idivt vfpd32 lpae evtstrm crc32 Dec 30 14:00:27 cockatoo weewx-vantage[9648] INFO user.cmon: cpuinfo: CPU implementer: 0x41 Dec 30 14:00:27 cockatoo weewx-vantage[9648] INFO user.cmon: cpuinfo: CPU architecture: 7 Dec 30 14:00:27 cockatoo weewx-vantage[9648] INFO user.cmon: cpuinfo: CPU variant: 0x0 Dec 30 14:00:27 cockatoo weewx-vantage[9648] INFO user.cmon: cpuinfo: CPU part: 0xd03 Dec 30 14:00:27 cockatoo weewx-vantage[9648] INFO user.cmon: cpuinfo: CPU revision: 4 Dec 30 14:00:27 cockatoo weewx-vantage[9648] INFO user.cmon: cpuinfo: Hardware: BCM2835 Dec 30 14:00:27 cockatoo weewx-vantage[9648] INFO user.cmon: cpuinfo: Revision: a22082 Dec 30 14:00:27 cockatoo weewx-vantage[9648] INFO user.cmon: cpuinfo: Serial: 000000001d027eb8 Dec 30 14:00:27 cockatoo weewx-vantage[9648] INFO user.cmon: cpuinfo: Model: Raspberry Pi 3 Model B Rev 1.2 Dec 30 14:00:27 cockatoo weewx-vantage[9648] INFO weewx.engine: Archive will use data binding wx_binding Dec 30 14:00:27 cockatoo weewx-vantage[9648] INFO weewx.engine: Record generation will be attempted in 'hardware' Dec 30 14:00:27 cockatoo weewx-vantage[9648] INFO weewx.engine: Using archive interval of 300 seconds (specified by hardware) Dec 30 14:00:27 cockatoo weewx-vantage[9648] INFO user.wd: WdArchive will use data binding wd_binding Dec 30 14:00:27 cockatoo weewx-vantage[9648] INFO weewx.manager: Daily summaries at V2.0. Patching to V3.0 Dec 30 14:00:27 cockatoo weewx-vantage[9648] INFO weewx.manager: recalculate_weights: Using database 'weewxwd' Dec 30 14:00:48 cockatoo weewx-vantage[9648] INFO weewx.manager: Patch finished. Dec 30 14:00:48 cockatoo weewx-vantage[9648] INFO user.wd: Using binding 'wd_binding' to database 'weewxwd' solar PV SQLite db(49 seconds): Dec 30 14:10:52 aurora weewx[3649] INFO weewx.engine: StdConvert target unit is 0x1 Dec 30 14:10:52 aurora weewx[3649] INFO weewx.manager: Daily summaries at V2.0. Patching to V3.0 Dec 30 14:10:52 aurora weewx[3649] INFO weewx.manager: recalculate_weights: Using database 'aurora.sdb' Dec 30 14:11:41 aurora weewx[3649] INFO weewx.manager: Patch finished. Dec 30 14:11:41 aurora weewx[3649] INFO weewx.engine: Archive will use data binding aurora_binding I guess when you look at it all it doesn't mean much in terms of time taken, I was impressed that the patching was automatically applied to multiple databases. Gary On Wednesday, 30 December 2020 at 23:09:01 UTC+10 Tom Keffer wrote: > Gary, those times that you quoted. Are they from using wee_database > --reweight? > > How long did the startup reweightings take? It only does from 1-Jun-2020, > so should go very fast. > > On Tue, Dec 29, 2020 at 8:20 PM gjr80 <[email protected]> wrote: > >> Have to say I am impressed. First time upgrading a weewx-multi install >> with wee_config --upgrade and it worked just fine, on both WeeWX >> instances. Noticed the re-weighting from v2 to v3 when I upgraded the >> simple (ecowitt) install, so was preparing myself to manually re-weight a >> couple of databases in the more complex (vantage) install but all three >> databases in the vantage install were re-weighted in turn during startup. >> All databases were MariaDB. Upgraded the solar PV system as well, just a >> single instance with SQLite, again all was well. >> >> Not really an accurate comparison but the re-weighting of two MariaDB >> databases with 8 years of vantage data felt about the same (5 odd minutes) >> as the re-weighting of about 6 months of ecowitt data in another MariaDB >> and the re-weighting of about four years of SQLite solar PV data seemed >> noticeably faster at just under one minute. >> >> Gary >> >> On Sunday, 27 December 2020 at 08:10:41 UTC+10 Tom Keffer wrote: >> >>> Version 4.3.0b3 is now available. This is likely to be the last beta >>> before general release. >>> >>> On Wed, Dec 23, 2020 at 6:58 AM Andy <[email protected]> wrote: >>> >>>> moved to mariadb today. >>>> >>>> <pre class="prettyprint"> >>>> 75002 records transferred from source database 'kcameadow21.sdb' to >>>> destination database 'weewx' in 262.91 seconds. >>>> </pre> >>>> On Tuesday, December 22, 2020 at 12:58:17 PM UTC-8 Andy wrote: >>>> >>>>> I found the guide in the dev branch of the weewx repo. >>>>> >>>>> Andy >>>>> >>>>> >>>>> On Tue, Dec 22, 2020 at 12:23 PM Andy <[email protected]> wrote: >>>>> >>>>>> Changed how various undocumented parameters in [StdWXCalculate] are >>>>>> specified. >>>>>> The only one people are likely to have used is 'ignore_zero_wind'. >>>>>> Its name has >>>>>> changed to 'force_null', and it has been moved. See the Upgrading >>>>>> Guide. >>>>>> >>>>>> Where is the beta Upgrading Guide? >>>>>> On Saturday, December 19, 2020 at 6:20:27 AM UTC-8 Tom Keffer wrote: >>>>>> >>>>>>> Things are mostly under control, but what is undertested is MySQL. >>>>>>> I've tested pretty thoroughly under Debian, but only sporadically under >>>>>>> CentOS, and not at all under suse. >>>>>>> >>>>>>> -tk >>>>>>> >>>>>>> On Fri, Dec 18, 2020 at 6:45 PM Vince Skahan <[email protected]> >>>>>>> wrote: >>>>>>> >>>>>>>> Tom - do you need this one checked on the usual os suspects >>>>>>>> (centos/debian/ubuntu of both systemd+init.d variants) or is it safe >>>>>>>> to >>>>>>>> assume that you guys have already run the usual checks for os >>>>>>>> variances ? >>>>>>>> >>>>>>>> -- >>>>>>>> >>>>>>> You received this message because you are subscribed to the Google >>>>>>>> Groups "weewx-development" group. >>>>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>>>> send an email to [email protected]. >>>>>>>> >>>>>>> To view this discussion on the web visit >>>>>>>> https://groups.google.com/d/msgid/weewx-development/acda9bca-e34f-45fe-a524-7fb0cebfbc83n%40googlegroups.com >>>>>>>> >>>>>>>> <https://groups.google.com/d/msgid/weewx-development/acda9bca-e34f-45fe-a524-7fb0cebfbc83n%40googlegroups.com?utm_medium=email&utm_source=footer> >>>>>>>> . >>>>>>>> >>>>>>> -- >>>>>> >>>>> You received this message because you are subscribed to a topic in the >>>>>> Google Groups "weewx-development" group. >>>>>> To unsubscribe from this topic, visit >>>>>> https://groups.google.com/d/topic/weewx-development/8UbCU0aODJc/unsubscribe >>>>>> . >>>>>> To unsubscribe from this group and all its topics, send an email to >>>>>> [email protected]. >>>>>> To view this discussion on the web visit >>>>>> https://groups.google.com/d/msgid/weewx-development/bcef8fa2-4dd5-4ef4-90e6-56792e9b9f8bn%40googlegroups.com >>>>>> >>>>>> <https://groups.google.com/d/msgid/weewx-development/bcef8fa2-4dd5-4ef4-90e6-56792e9b9f8bn%40googlegroups.com?utm_medium=email&utm_source=footer> >>>>>> . >>>>>> >>>>> -- >>>> You received this message because you are subscribed to the Google >>>> Groups "weewx-development" group. >>>> To unsubscribe from this group and stop receiving emails from it, send >>>> an email to [email protected]. >>>> >>> To view this discussion on the web visit >>>> https://groups.google.com/d/msgid/weewx-development/e954db00-1c9a-47eb-8006-76d5acb8badan%40googlegroups.com >>>> >>>> <https://groups.google.com/d/msgid/weewx-development/e954db00-1c9a-47eb-8006-76d5acb8badan%40googlegroups.com?utm_medium=email&utm_source=footer> >>>> . >>>> >>> -- >> You received this message because you are subscribed to the Google Groups >> "weewx-development" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to [email protected]. >> > To view this discussion on the web visit >> https://groups.google.com/d/msgid/weewx-development/b768d27a-845b-4e48-8049-45d9cf44aa6fn%40googlegroups.com >> >> <https://groups.google.com/d/msgid/weewx-development/b768d27a-845b-4e48-8049-45d9cf44aa6fn%40googlegroups.com?utm_medium=email&utm_source=footer> >> . >> > -- You received this message because you are subscribed to the Google Groups "weewx-development" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-development/c8c270c4-9e04-4e2b-9298-721ce101aea4n%40googlegroups.com.
