I’m using the standard 5 minute interval. The files being uploaded are the files generated by the standard and seasons report and the Saratoga extension. As you can see the upload takes less than 2 seconds. When I was using ftp to upload I was getting errors due to the time it took. Rsync was suggested and it has been working well. I don’t know much about how weewx and rsync work but my internet host seems to think it is a software problem.
>>>>> It appears your Pi is intermittently trying to connect with an incorrect >>>>> SSH user string, and subsequent connections are maxing the limit for >>>>> concurrent SSH connections (MaxStartups), so the excess connections are >>>>> simply dropped by the server. I suggest reviewing the SSH connection >>>>> string for the PI, as well as ensuring it is closing connections >>>>> correctly. Additionally, you will want to ensure you are not opening too >>>>> many concurrent connections for transfer. If the issue persists you may >>>>> want to increase the amount of time between uploads, as we are unable to >>>>> increase the MaxStartups setting on shared server. > On Oct 28, 2023, at 8:54 AM, cric...@pobox.com <crich...@pobox.com> wrote: > > Just an observation, but that's a LOT of files and data getting uploaded, and > the total time is > close to 5 minutes, which is the default archive interval. That MaxStartups > limit may be set to 1, > so is it possible weewx is starting another upload cycle while the last one > is in progress? You could > try changing this to 600 and see if it helps (in your weewx.conf): > > [StdArchive] > archive_interval = 300 > > Chris > On Friday, October 27, 2023 at 3:56:51 PM UTC-6 Tom -KQ5S wrote: >> It has worked in the past. I am unsure when it started the working/not >> working behavior since I don’t look at the logs that often and the error was >> not showing up in the logwatch file. >> >> I am running as user pi. >> >> version = 4.10.2 >> >> Pi OS Bullseye >> >> SKIN_NAME = Rsync >> SKIN_VERSION = 4.10.2 >> >> [Generators] >> generator_list = weewx.reportengine.RsyncGenerator >> >> >> The fact that it is intermittent makes me think the authorizations are OK. >> Below is the last couple of iterations where you can see it failed and then >> worked >> >> Oct 27 13:55:21 raspberrypi weewx[15431] ERROR weeutil.rsyncupload: rsync >> reported errors.: >> >> Oct 27 14:00:26 raspberrypi weewx[15431] INFO weeutil.rsyncupload: rsync'd >> 149 files (919,702 bytes) in 1.94 seconds >> >> Oct 27 14:05:20 raspberrypi weewx[15431] INFO weeutil.rsyncupload: rsync'd >> 29 files (448,591 bytes) in 1.34 seconds >> >> Oct 27 14:10:22 raspberrypi weewx[15431] INFO weeutil.rsyncupload: rsync'd >> 32 files (453,999 bytes) in 1.28 seconds >> >> Oct 27 14:15:19 raspberrypi weewx[15431] ERROR weeutil.rsyncupload: rsync >> reported errors. >> >> Oct 27 14:20:22 raspberrypi weewx[15431] INFO weeutil.rsyncupload: rsync'd >> 32 files (454,465 bytes) in 1.29 seconds >> >> Oct 27 14:25:19 raspberrypi weewx[15431] ERROR weeutil.rsyncupload: rsync >> reported errors. Original command: ['rsync', '--archive', '--stats', '-e', >> 'ssh -p 2222', '/home/weewx/public_html/', 'kq5...@kq5s.com <>:public_html'] >> >> Oct 27 14:30:21 raspberrypi weewx[15431] ERROR weeutil.rsyncupload: rsync >> reported errors >> >> Oct 27 14:35:20 raspberrypi weewx[15431] INFO weeutil.rsyncupload: rsync'd >> 32 files (457,673 bytes) in 1.39 seconds >> >> Oct 27 14:40:22 raspberrypi weewx[15431] INFO weeutil.rsyncupload: rsync'd >> 32 files (457,727 bytes) in 1.28 seconds >> >> On Friday, October 27, 2023 at 8:30:37 AM UTC-5 cric...@pobox.com <> wrote: >>> Is this a new setup, or has it worked in the past? >>> What userID is running weewx? >>> What version of weewx are you running? >>> The contents of my rsync/skin.conf is: >>> SKIN_NAME = Rsync >>> SKIN_VERSION = 4.10.2 >>> >>> [Generators] >>> generator_list = weewx.reportengine.RsyncGenerator >>> >>> Does rsync of your /home/weewx/public_html to your web hosting service work >>> from the command line? >>> If, as which user? >>> >>> On Friday, October 27, 2023 at 4:20:53 AM UTC-6 kq5...@gmail.com <> wrote: >>>> Anyone? >>>> >>>> >>>> >>>>> On Oct 26, 2023, at 8:24 AM, Tom -KQ5S <kq5...@gmail.com <>> wrote: >>>>> >>>> >>>>> I am getting the following error from time to time. Rsync will work fine >>>>> for a while and then I get the error. I might get the error for a couple >>>>> of cycles then it will work again, then the error again. I have included >>>>> the reply from my internet host as well. Ideas? >>>>> >>>>> Oct 26 07:50:26 raspberrypi weewx[30090] DEBUG weewx.reportengine: >>>>> Running report 'RSYNC' >>>>> Oct 26 07:50:26 raspberrypi weewx[30090] DEBUG weewx.reportengine: Found >>>>> configuration file /home/weewx/skins/Rsync/skin.conf for report 'RSYNC' >>>>> Oct 26 07:50:26 raspberrypi weewx[30090] DEBUG weewx.reportengine: Cannot >>>>> read localization file /home/weewx/skins/Rsync/lang/en.conf for report >>>>> 'RSYNC': Config file not found: "/home/weewx/skins/Rsync/lang/en.conf". >>>>> Oct 26 07:50:26 raspberrypi weewx[30090] DEBUG weewx.reportengine: **** >>>>> Using defaults instead. >>>>> Oct 26 07:50:26 raspberrypi weewx[30090] DEBUG weeutil.rsyncupload: >>>>> rsyncupload: cmd: [['rsync', '--archive', '--stats', '-e', 'ssh -p 2222', >>>>> '/home/weewx/public_html/', ‘xx...@kq5s.com <>]] >>>>> Oct 26 07:50:27 raspberrypi weewx[30090] ERROR weeutil.rsyncupload: rsync >>>>> reported errors. Original command: ['rsync', '--archive', '--stats', >>>>> '-e', 'ssh -p 2222', '/home/weewx/public_html/', ‘xxx...@kq5s.com:xxxx’] >>>>> Oct 26 07:50:27 raspberrypi weewx[30090] ERROR weeutil.rsyncupload: **** >>>>> kex_exchange_identification: Connection closed by remote host >>>>> Oct 26 07:50:27 raspberrypi weewx[30090] ERROR weeutil.rsyncupload: **** >>>>> Connection closed by xxx.xx.xxx.xx port 2222 >>>>> Oct 26 07:50:27 raspberrypi weewx[30090] ERROR weeutil.rsyncupload: **** >>>>> rsync: connection unexpectedly closed (0 bytes received so far) [sender] >>>>> Oct 26 07:50:27 raspberrypi weewx[30090] ERROR weeutil.rsyncupload: **** >>>>> rsync error: unexplained error (code 255) at io.c(228) [sender=3.2.3] >>>>> >>>>> ========================================================== >>>>> From Internet host. I'm not sure where the user weewx is coming from. >>>>> It is not the user set in my config file for rsync. >>>>> >>>>> Regarding SSH, a review of the server's logs shows two repeated >>>>> occurrences for your user ID "weewx". I've copied an example of each >>>>> error below: >>>>> >>>>> Oct 11 15:37:17 ecbiz246 sshd[55604]: Invalid user weewx from >>>>> xxx.xx.xxx.xx port 60374 >>>>> Oct 11 15:37:17 ecbiz246 sshd[55604]: Received disconnect from >>>>> xxx.xx.xxx.xx port 60374:11: Bye Bye [preauth] >>>>> Oct 11 15:37:17 ecbiz246 sshd[55604]: Disconnected from xxx.xx.xxx.xx >>>>> port 60374 [preauth] >>>>> >>>>> >>>>> Oct 11 06:46:23 ecbiz246 sshd[3762]: drop connection #28 >>>>> <https://help.inmotionhosting.com/hc/requests/28> from >>>>> [xxx.xx.xxx.xx]:42380 on [xxx.xx.xxx.xx]:2222 past MaxStartups >>>>> ... >>>>> Oct 11 09:30:20 ecbiz246 sshd[3762]: drop connection #27 >>>>> <https://help.inmotionhosting.com/hc/requests/27> from >>>>> [xxxx.xx.xxx.xx]:47222 on [xxx.xx.xxx.xx]:2222 past MaxStartups >>>>> >>>>> It appears your Pi is intermittently trying to connect with an incorrect >>>>> SSH user string, and subsequent connections are maxing the limit for >>>>> concurrent SSH connections (MaxStartups), so the excess connections are >>>>> simply dropped by the server. I suggest reviewing the SSH connection >>>>> string for the PI, as well as ensuring it is closing connections >>>>> correctly. Additionally, you will want to ensure you are not opening too >>>>> many concurrent connections for transfer. If the issue persists you may >>>>> want to increase the amount of time between uploads, as we are unable to >>>>> increase the MaxStartups setting on shared server. >>>>> >>>> >>>>> -- >>>>> You received this message because you are subscribed to the Google Groups >>>>> "weewx-user" group. >>>>> To unsubscribe from this group and stop receiving emails from it, send an >>>>> email to weewx-user+...@googlegroups.com <>. >>>>> To view this discussion on the web visit >>>>> https://groups.google.com/d/msgid/weewx-user/038c234b-113e-4ace-9a62-24c896e5bac2n%40googlegroups.com >>>>> >>>>> <https://groups.google.com/d/msgid/weewx-user/038c234b-113e-4ace-9a62-24c896e5bac2n%40googlegroups.com?utm_medium=email&utm_source=footer>. >>>> > > > -- > You received this message because you are subscribed to the Google Groups > "weewx-user" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to weewx-user+unsubscr...@googlegroups.com > <mailto:weewx-user+unsubscr...@googlegroups.com>. > To view this discussion on the web visit > https://groups.google.com/d/msgid/weewx-user/44ac6f5d-f47d-4456-be6f-ddcf1fc1391an%40googlegroups.com > > <https://groups.google.com/d/msgid/weewx-user/44ac6f5d-f47d-4456-be6f-ddcf1fc1391an%40googlegroups.com?utm_medium=email&utm_source=footer>. -- You received this message because you are subscribed to the Google Groups "weewx-user" group. To unsubscribe from this group and stop receiving emails from it, send an email to weewx-user+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/C17D342D-F61F-44BF-8E07-D9460AAC5FEF%40gmail.com.
