Thank you for mentioning rsync option Tom! I had completely forgotten this or missed it when I first set up weewx and yes indeed. It’s about an order of magnitude faster (about 18 seconds for for ftp upload and only 2sec or so for rsync).
Thanks! > On Mar 7, 2021, at 07:27, Tom Keffer <[email protected]> wrote: > > > Good idea. A PR would be welcome. > > If you have access to rsync, it effectively does this. it is a much faster > alternative to FTP. > >> On Sun, Mar 7, 2021 at 7:15 AM Karen K <[email protected]> wrote: >> From the logs of the web server I realize that huge amounts of data are >> uploaded that did not change. Today I looked into the code of the FTP >> uploader. I saw that some kind of check is included which file needs to be >> uploaded and which not. This is done by comparing the file timestamp. >> >> As the Cheetah generator re-creates a file every time it runs, unfortunately >> the file timestamp does not say anything whether the file content changed or >> not. >> >> So I wonder whether it it would be better to calculate a hash of the file >> contents and use that hash instead of file timestamp to decide about upload. >> >> The actual FTP Uploader does already maintain a file containing the file >> names of the uploaded files. So, may be, it is not that big step to include >> a hash into that file for comparison reasons. >> >> An example for a file that seldom changes is the about page. It only changes >> if an update of WeeWX or some skin was installed for the version number. >> Other examples are imprint, privacy statement, FAQs, or other general >> information. >> >> -- >> You received this message because you are subscribed to the Google Groups >> "weewx-development" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to [email protected]. >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/weewx-development/1282406b-4ce2-46bb-a0ae-4c47d68e9d28n%40googlegroups.com. > > -- > You received this message because you are subscribed to the Google Groups > "weewx-development" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To view this discussion on the web visit > https://groups.google.com/d/msgid/weewx-development/CAPq0zECvGedUCJSs9W%2B8N%2BX6r%3DRSEkGg3gNwfATOkQfx7TNCBg%40mail.gmail.com. -- You received this message because you are subscribed to the Google Groups "weewx-development" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-development/39DAB00F-D442-445C-9C2A-48369524413A%40gmail.com.
