In my backup script i stop weewx until the local copy completes. Then I restart it and then copy to Google drive. Has worked consistently for a couple of years.
On Tue, Mar 17, 2020, 7:42 AM Mike Revitt <[email protected]> wrote: > I have now gotten to the bottom of the crashes. > > The copy of the database uptp S3 takes more than 5 minutes and as my > archive interval is 5 minutes I was getting a checksum error as the source > file was getting modified before completing. > > I have fixed that by doing a local copy prior to the copy unto S3, but > that is now giving me this error > > Mar 17 14:30:19 raspberrypi weewx[8008] INFO botocore.credentials: Found > credentials in shared credentials file: ~/.aws/credentials > Mar 17 14:30:25 raspberrypi weewx[8008] INFO user.s3upload: > S3UploadGenerator: AWS-S3 copied 16 files to S3 in 6.31 seconds > Mar 17 14:30:25 raspberrypi weewx[8008] INFO botocore.credentials: Found > credentials in shared credentials file: ~/.aws/credentials > Mar 17 14:35:16 raspberrypi weewx[8008] INFO weewx.manager: Added record > 2020-03-17 14:35:00 GMT (1584455700) to database 'weewx.sdb' > Mar 17 14:35:16 raspberrypi weewx[8008] INFO weewx.manager: Added record > 2020-03-17 14:35:00 GMT (1584455700) to daily summary in 'weewx.sdb' > Mar 17 14:35:16 raspberrypi weewx[8008] INFO weewx.engine: Launch of > report thread aborted: existing report thread still running > Mar 17 14:38:09 raspberrypi weewx[8008] INFO user.s3backup: > S3BackupGenerator: S3 copied files to S3 in 0 attemps which took in 463.65 > seconds > Mar 17 14:40:16 raspberrypi weewx[8008] INFO weewx.manager: Added record > 2020-03-17 14:40:00 GMT (1584456000) to database 'weewx.sdb' > Mar 17 14:40:16 raspberrypi weewx[8008] INFO weewx.manager: Added record > 2020-03-17 14:40:00 GMT (1584456000) to daily summary in 'weewx.sdb' > Mar 17 14:40:18 raspberrypi weewx[8008] INFO weewx.cheetahgenerator: > Generated 7 files for report SeasonsReport in 1.84 seconds > > > So the upload is currently taking 463 seconds and this is blocking the > next loop of the report process, not a huge issue as I plan to only back-up > at midnight, but was wondering if the backup thread could be started as a > parallel thread rather than a serial one > > -- > You received this message because you are subscribed to the Google Groups > "weewx-user" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To view this discussion on the web visit > https://groups.google.com/d/msgid/weewx-user/c4bb69de-024b-4b67-92b8-7e734575d7c9%40googlegroups.com > <https://groups.google.com/d/msgid/weewx-user/c4bb69de-024b-4b67-92b8-7e734575d7c9%40googlegroups.com?utm_medium=email&utm_source=footer> > . > -- You received this message because you are subscribed to the Google Groups "weewx-user" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/CAA1SM235d5DBM6AL2zXWsHfrk6dky8WrY9qC34sYNt5K_FcaKQ%40mail.gmail.com.
