Vince: I will also try RSYNC based on your recommendation but I'd like to get through this first since it has worked fine for me for a few years. Since FTP is working fine from Filezilla on multiple machines it seems like the issue must be on the weewx side somewhere.
On Tuesday, July 26, 2022 at 2:05:26 PM UTC-7 Stephen Rogers wrote: > I upped the debug level and below is a couple of 5-minute log output > cycles. > > Also of note, I installed vsftpd to give that a try, since it has good > documentation of how to configure it and is highly regarded. I attached > vsftpd.conf for reference. Filezilla connects fine from my desktop to the > DO FTP server, using ftpuser instead of root. Here is the weewx.conf ftp > section as modified for vsftp.conf upgrade. > [[FTP]] > # FTP'ing the results to a webserver is treated as just another > report, > # albeit one with an unusual report generator! > skin = Ftp > > # If you wish to use FTP, set "enable" to "true", then > # fill out the next four lines. > # Use quotes around passwords to guard against parsing errors. > enable = true > #user = root > #password = BoomRoot1$z > user = ftpuser > password = boomrock > server = intraprem.com # The ftp server name, e.g, > www.myserver.org > path = /home/nashwoods/weather # The destination directory, > e.g., /weather > > # Set to True for an FTP over TLS (FTPS) connection. Not all > servers > # support this. > secure_ftp = False > > # To upload files from something other than what HTML_ROOT is set > # to above, specify a different HTML_ROOT here. > #HTML_ROOT = /var/www/html/weewx > > # Most FTP servers use port 21 > port = 22 > > # Set to 1 to use passive mode, zero for active mode > passive = 0 > ----- > Neither the root user nor the new ftpuser works. I feel like I've tried > every permutation of ftp parameters... > > Stephen > > log output: > > Jul 26 13:05:15 raspberrypi weewx[3712]: vantage: Getting archive packets > since 2022-07-26 13:00:00 PDT (1658865600) > Jul 26 13:05:15 raspberrypi weewx[3712]: vantage: Gentle wake up of > console successful > Jul 26 13:05:15 raspberrypi weewx[3712]: vantage: Retrieving 1 page(s); > starting index= 1 > Jul 26 13:05:15 raspberrypi weewx[3712]: manager: Added record 2022-07-26 > 13:05:00 PDT (1658865900) to database 'weewx.sdb' > Jul 26 13:05:15 raspberrypi weewx[3712]: manager: Added record 2022-07-26 > 13:05:00 PDT (1658865900) to daily summary in 'weewx.sdb' > Jul 26 13:05:15 raspberrypi weewx[3712]: vantage: DMPAFT complete: page > timestamp 2022-07-17 15:55:00 PDT (1658098500) less than final timestamp > 2022-07-26 13:05:00 PDT (1658865900) > Jul 26 13:05:15 raspberrypi weewx[3712]: vantage: Catch up complete. > Jul 26 13:05:15 raspberrypi weewx[3712]: reportengine: Running reports for > latest time in the database. > Jul 26 13:05:15 raspberrypi weewx[3712]: vantage: Requesting 200 LOOP > packets. > Jul 26 13:05:15 raspberrypi weewx[3712]: reportengine: Running report > 'SeasonsReport' > Jul 26 13:05:15 raspberrypi weewx[3712]: vantage: Gentle wake up of > console successful > Jul 26 13:05:15 raspberrypi weewx[3712]: reportengine: Found configuration > file /etc/weewx/skins/Seasons/skin.conf for report 'SeasonsReport' > Jul 26 13:05:16 raspberrypi weewx[3712]: cheetahgenerator: using search > list ['weewx.cheetahgenerator.Almanac', 'weewx.cheetahgenerator.Station', > 'weewx.cheetahgenerator.Current', 'weewx.cheetahgenerator.Stats', > 'weewx.cheetahgenerator.UnitInfo', 'weewx.cheetahgenerator.Extras'] > Jul 26 13:05:16 raspberrypi weewx[3712]: manager: Daily summary version is > 2.0 > Jul 26 13:05:16 raspberrypi weewx[3712]: restx: Wunderground-PWS: > Published record 2022-07-26 13:05:00 PDT (1658865900) > Jul 26 13:05:16 raspberrypi weewx[3712]: restx: MQTT: Published record > 2022-07-26 13:05:00 PDT (1658865900) > Jul 26 13:05:20 raspberrypi weewx[3712]: cheetahgenerator: Generated 8 > files for report SeasonsReport in 4.92 seconds > Jul 26 13:05:21 raspberrypi weewx[3712]: manager: Daily summary version is > 2.0 > Jul 26 13:05:22 raspberrypi weewx[3712]: imagegenerator: Generated 14 > images for SeasonsReport in 1.26 seconds > Jul 26 13:05:22 raspberrypi weewx[3712]: copygenerator: copied 5 files to > /weewx_generated_reports/html/weewx > Jul 26 13:05:22 raspberrypi weewx[3712]: reportengine: Report > 'SmartphoneReport' not enabled. Skipping. > Jul 26 13:05:22 raspberrypi weewx[3712]: reportengine: Report > 'MobileReport' not enabled. Skipping. > Jul 26 13:05:22 raspberrypi weewx[3712]: reportengine: Report > 'StandardReport' not enabled. Skipping. > Jul 26 13:05:22 raspberrypi weewx[3712]: reportengine: Running report 'FTP' > Jul 26 13:05:22 raspberrypi weewx[3712]: reportengine: Found configuration > file /etc/weewx/skins/Ftp/skin.conf for report 'FTP' > Jul 26 13:05:22 raspberrypi weewx[3712]: ftpupload: Attempting connection > to intraprem.com > Jul 26 13:06:02 raspberrypi weewx[3712]: ftpupload: Unable to connect or > log into server : timed out > Jul 26 13:06:42 raspberrypi weewx[3712]: ftpupload: Unable to connect or > log into server : timed out > Jul 26 13:07:22 raspberrypi weewx[3712]: ftpupload: Unable to connect or > log into server : timed out > Jul 26 13:07:22 raspberrypi weewx[3712]: ftpupload: Attempted 3 times to > connect to server intraprem.com. Giving up. > Jul 26 13:07:22 raspberrypi weewx[3712]: ftpgenerator: ftp'd 0 files in > 120.66 seconds > Jul 26 13:07:22 raspberrypi weewx[3712]: reportengine: Report 'RSYNC' not > enabled. Skipping. > > ^[[A^[Jul 26 13:10:15 raspberrypi weewx[3712]: vantage: Getting archive > packets since 2022-07-26 13:05:00 PDT (1658865900) > Jul 26 13:10:15 raspberrypi weewx[3712]: vantage: Gentle wake up of > console successful > Jul 26 13:10:15 raspberrypi weewx[3712]: vantage: Retrieving 1 page(s); > starting index= 2 > Jul 26 13:10:15 raspberrypi weewx[3712]: manager: Added record 2022-07-26 > 13:10:00 PDT (1658866200) to database 'weewx.sdb' > Jul 26 13:10:15 raspberrypi weewx[3712]: manager: Added record 2022-07-26 > 13:10:00 PDT (1658866200) to daily summary in 'weewx.sdb' > Jul 26 13:10:15 raspberrypi weewx[3712]: vantage: DMPAFT complete: page > timestamp 2022-07-17 16:00:00 PDT (1658098800) less than final timestamp > 2022-07-26 13:10:00 PDT (1658866200) > Jul 26 13:10:15 raspberrypi weewx[3712]: vantage: Catch up complete. > Jul 26 13:10:15 raspberrypi weewx[3712]: reportengine: Running reports for > latest time in the database. > Jul 26 13:10:15 raspberrypi weewx[3712]: vantage: Requesting 200 LOOP > packets. > Jul 26 13:10:15 raspberrypi weewx[3712]: reportengine: Running report > 'SeasonsReport' > Jul 26 13:10:15 raspberrypi weewx[3712]: vantage: Gentle wake up of > console successful > Jul 26 13:10:15 raspberrypi weewx[3712]: reportengine: Found configuration > file /etc/weewx/skins/Seasons/skin.conf for report 'SeasonsReport' > Jul 26 13:10:15 raspberrypi weewx[3712]: cheetahgenerator: using search > list ['weewx.cheetahgenerator.Almanac', 'weewx.cheetahgenerator.Station', > 'weewx.cheetahgenerator.Current', 'weewx.cheetahgenerator.Stats', > 'weewx.cheetahgenerator.UnitInfo', 'weewx.cheetahgenerator.Extras'] > Jul 26 13:10:15 raspberrypi weewx[3712]: manager: Daily summary version is > 2.0 > Jul 26 13:10:16 raspberrypi weewx[3712]: restx: Wunderground-PWS: > Published record 2022-07-26 13:10:00 PDT (1658866200) > Jul 26 13:10:16 raspberrypi weewx[3712]: restx: MQTT: Published record > 2022-07-26 13:10:00 PDT (1658866200) > Jul 26 13:10:18 raspberrypi weewx[3712]: cheetahgenerator: Generated 8 > files for report SeasonsReport in 2.79 seconds > Jul 26 13:10:18 raspberrypi weewx[3712]: manager: Daily summary version is > 2.0 > Jul 26 13:10:19 raspberrypi weewx[3712]: imagegenerator: Generated 14 > images for SeasonsReport in 1.27 seconds > Jul 26 13:10:19 raspberrypi weewx[3712]: copygenerator: copied 0 files to > /weewx_generated_reports/html/weewx > Jul 26 13:10:19 raspberrypi weewx[3712]: reportengine: Report > 'SmartphoneReport' not enabled. Skipping. > Jul 26 13:10:19 raspberrypi weewx[3712]: reportengine: Report > 'MobileReport' not enabled. Skipping. > Jul 26 13:10:19 raspberrypi weewx[3712]: reportengine: Report > 'StandardReport' not enabled. Skipping. > Jul 26 13:10:19 raspberrypi weewx[3712]: reportengine: Running report 'FTP' > Jul 26 13:10:19 raspberrypi weewx[3712]: reportengine: Found configuration > file /etc/weewx/skins/Ftp/skin.conf for report 'FTP' > Jul 26 13:10:19 raspberrypi weewx[3712]: ftpupload: Attempting connection > to intraprem.com > Jul 26 13:11:00 raspberrypi weewx[3712]: ftpupload: Unable to connect or > log into server : timed out > Jul 26 13:11:40 raspberrypi weewx[3712]: ftpupload: Unable to connect or > log into server : timed out > Jul 26 13:12:20 raspberrypi weewx[3712]: ftpupload: Unable to connect or > log into server : timed out > Jul 26 13:12:20 raspberrypi weewx[3712]: ftpupload: Attempted 3 times to > connect to server intraprem.com. Giving up. > Jul 26 13:12:20 raspberrypi weewx[3712]: ftpgenerator: ftp'd 0 files in > 120.60 seconds > Jul 26 13:12:20 raspberrypi weewx[3712]: reportengine: Report 'RSYNC' not > enabled. Skipping. > Jul 26 13:15:15 raspberrypi weewx[3712]: vantage: Getting archive packets > since 2022-07-26 13:10:00 PDT (1658866200) > Jul 26 13:15:15 raspberrypi weewx[3712]: vantage: Gentle wake up of > console successful > Jul 26 13:15:15 raspberrypi weewx[3712]: vantage: Retrieving 1 page(s); > starting index= 3 > Jul 26 13:15:15 raspberrypi weewx[3712]: manager: Added record 2022-07-26 > 13:15:00 PDT (1658866500) to database 'weewx.sdb' > Jul 26 13:15:15 raspberrypi weewx[3712]: manager: Added record 2022-07-26 > 13:15:00 PDT (1658866500) to daily summary in 'weewx.sdb' > Jul 26 13:15:15 raspberrypi weewx[3712]: vantage: DMPAFT complete: page > timestamp 2022-07-17 16:05:00 PDT (1658099100) less than final timestamp > 2022-07-26 13:15:00 PDT (1658866500) > Jul 26 13:15:15 raspberrypi weewx[3712]: vantage: Catch up complete. > Jul 26 13:15:15 raspberrypi weewx[3712]: vantage: Requesting 200 LOOP > packets. > Jul 26 13:15:15 raspberrypi weewx[3712]: reportengine: Running reports for > latest time in the database. > Jul 26 13:15:15 raspberrypi weewx[3712]: reportengine: Running report > 'SeasonsReport' > Jul 26 13:15:15 raspberrypi weewx[3712]: vantage: Gentle wake up of > console successful > Jul 26 13:15:15 raspberrypi weewx[3712]: reportengine: Found configuration > file /etc/weewx/skins/Seasons/skin.conf for report 'SeasonsReport' > Jul 26 13:15:15 raspberrypi weewx[3712]: cheetahgenerator: using search > list ['weewx.cheetahgenerator.Almanac', 'weewx.cheetahgenerator.Station', > 'weewx.cheetahgenerator.Current', 'weewx.cheetahgenerator.Stats', > 'weewx.cheetahgenerator.UnitInfo', 'weewx.cheetahgenerator.Extras'] > Jul 26 13:15:15 raspberrypi weewx[3712]: manager: Daily summary version is > 2.0 > Jul 26 13:15:16 raspberrypi weewx[3712]: restx: Wunderground-PWS: > Published record 2022-07-26 13:15:00 PDT (1658866500) > Jul 26 13:15:16 raspberrypi weewx[3712]: restx: MQTT: Published record > 2022-07-26 13:15:00 PDT (1658866500) > Jul 26 13:15:18 raspberrypi weewx[3712]: cheetahgenerator: Generated 8 > files for report SeasonsReport in 2.68 seconds > Jul 26 13:15:18 raspberrypi weewx[3712]: manager: Daily summary version is > 2.0 > Jul 26 13:15:19 raspberrypi weewx[3712]: imagegenerator: Generated 14 > images for SeasonsReport in 1.28 seconds > Jul 26 13:15:19 raspberrypi weewx[3712]: copygenerator: copied 0 files to > /weewx_generated_reports/html/weewx > Jul 26 13:15:19 raspberrypi weewx[3712]: reportengine: Report > 'SmartphoneReport' not enabled. Skipping. > Jul 26 13:15:19 raspberrypi weewx[3712]: reportengine: Report > 'MobileReport' not enabled. Skipping. > Jul 26 13:15:19 raspberrypi weewx[3712]: reportengine: Report > 'StandardReport' not enabled. Skipping. > Jul 26 13:15:19 raspberrypi weewx[3712]: reportengine: Running report 'FTP' > Jul 26 13:15:19 raspberrypi weewx[3712]: reportengine: Found configuration > file /etc/weewx/skins/Ftp/skin.conf for report 'FTP' > Jul 26 13:15:19 raspberrypi weewx[3712]: ftpupload: Attempting connection > to intraprem.com > Jul 26 13:16:00 raspberrypi weewx[3712]: ftpupload: Unable to connect or > log into server : timed out > Jul 26 13:16:40 raspberrypi weewx[3712]: ftpupload: Unable to connect or > log into server : timed out > Jul 26 13:17:01 raspberrypi CRON[3771]: (root) CMD ( cd / && run-parts > --report /etc/cron.hourly) > Jul 26 13:17:20 raspberrypi weewx[3712]: ftpupload: Unable to connect or > log into server : timed out > Jul 26 13:17:20 raspberrypi weewx[3712]: ftpupload: Attempted 3 times to > connect to server intraprem.com. Giving up. > Jul 26 13:17:20 raspberrypi weewx[3712]: ftpgenerator: ftp'd 0 files in > 120.51 seconds > Jul 26 13:17:20 raspberrypi weewx[3712]: reportengine: Report 'RSYNC' not > enabled. Skipping. > Jul 26 13:20:15 raspberrypi weewx[3712]: vantage: Getting archive packets > since 2022-07-26 13:15:00 PDT (1658866500) > On Tuesday, July 26, 2022 at 12:02:11 PM UTC-7 [email protected] wrote: > >> Agree with what vince said, except I would set debug=2. This will cause a >> lot of the FTP chatter to be put in the log. >> >> On Tue, Jul 26, 2022 at 10:30 AM vince <[email protected]> wrote: >> >>> Usual answer applies - set debug=1 in weewx.conf, restart weewx, wait 10 >>> minutes, and post the log for a couple passes through the 5 minute archive >>> period. >>> >>> A quick search showed one user a while back who had this issue on a pi >>> when they had Weather Underground rapidfire enabled. Their pi was just too >>> slow to finish the FTP upload in time from within weewx. >>> >>> FWIW, I'd recommend using the 'rsync' uploader rather than FTP. It is >>> 'much' faster. Like amazingly much faster. I'm running weewx on a little >>> ARM box that is much slower than a pi and my rsync uploads to AWS finish in >>> two seconds according to the syslog. >>> >>> >>> -- >>> You received this message because you are subscribed to the Google >>> Groups "weewx-user" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to [email protected]. >>> To view this discussion on the web visit >>> https://groups.google.com/d/msgid/weewx-user/e6e73831-4ce1-4188-97cd-2cbb9da75ae7n%40googlegroups.com >>> >>> <https://groups.google.com/d/msgid/weewx-user/e6e73831-4ce1-4188-97cd-2cbb9da75ae7n%40googlegroups.com?utm_medium=email&utm_source=footer> >>> . >>> >> -- You received this message because you are subscribed to the Google Groups "weewx-user" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/cfbd1e17-4e8b-423e-b443-b75ee7b00f79n%40googlegroups.com.
