I've managed to replicate the error.
As above, leave the RPi on but stop the weeWx service for ten minutes, then
re-start it, the two records held on the data logger are found and uploaded.
However, if I power down the RPi for ten minutes and then boot it back up
again, weeWx fails to pull the two missing records.
Any ideas?
Dave
On Wednesday, 12 April 2023 at 14:47:52 UTC+1 Dave McCreath wrote:
> Tom, Greg
>
> Many thanks to both of you for getting back to me.
>
> The console is mains powered with battery backup, batteries are good, less
> than 2 weeks old.
>
> Using the Vantage driver, 5 minute interval, time is updated on each new
> boot of the Rpi.
>
> As Greg suggested, I turned debugging on, powered down the Rpi for 10
> minutes and then rebooted, missing two records. On checking the log, the
> two missing data files were found and uploaded! However, that did not
> happen earlier on today between 1040-1120hrs (see below). Not sure what
> has changed?
>
> It appears to have corrected itself, but just in case, I've appended the
> log:
>
> Apr 12 14:08:10 raspberrypi weewx[4785] DEBUG weewx.restx: Shut down
> PWSWeather thread.
> Apr 12 14:08:10 raspberrypi weewx[4785] DEBUG weewx.restx: Shut down
> Wunderground-PWS thread.
> Apr 12 14:08:10 raspberrypi weewx[4785] INFO __main__: Terminating weewx
> version 4.9.1
> Apr 12 14:08:10 raspberrypi weewx[4785] DEBUG __main__: ****
> Traceback (most recent call last):
> Apr 12 14:08:10 raspberrypi weewx[4785] DEBUG __main__: **** File
> "/usr/share/weewx/weewxd", line 154, in main
> Apr 12 14:08:10 raspberrypi weewx[4785] DEBUG __main__: ****
> engine.run()
> Apr 12 14:08:10 raspberrypi weewx[4785] DEBUG __main__: **** File
> "/usr/share/weewx/weewx/engine.py", line 208, in run
> Apr 12 14:08:10 raspberrypi weewx[4785] DEBUG __main__: **** for
> packet in self.console.genLoopPackets():
> Apr 12 14:08:10 raspberrypi weewx[4785] DEBUG __main__: **** File
> "/usr/share/weewx/weewx/drivers/vantage.py", line 539, in genLoopPackets
> Apr 12 14:08:10 raspberrypi weewx[4785] DEBUG __main__: **** for
> _loop_packet in self.genDavisLoopPackets(self.loop_batch):
> Apr 12 14:08:10 raspberrypi weewx[4785] DEBUG __main__: **** File
> "/usr/share/weewx/weewx/drivers/vantage.py", line 566, in
> genDavisLoopPackets
> Apr 12 14:08:10 raspberrypi weewx[4785] DEBUG __main__: ****
> loop_packet = self._get_packet()
> Apr 12 14:08:10 raspberrypi weewx[4785] DEBUG __main__: **** File
> "/usr/share/weewx/weewx/drivers/vantage.py", line 580, in _get_packet
> Apr 12 14:08:10 raspberrypi weewx[4785] DEBUG __main__: ****
> _buffer = self.port.read(99)
> Apr 12 14:08:10 raspberrypi weewx[4785] DEBUG __main__: **** File
> "/usr/share/weewx/weewx/drivers/vantage.py", line 277, in read
> Apr 12 14:08:10 raspberrypi weewx[4785] DEBUG __main__: ****
> _buffer = self.serial_port.read(chars)
> Apr 12 14:08:10 raspberrypi weewx[4785] DEBUG __main__: **** File
> "/usr/lib/python3/dist-packages/serial/serialposix.py", line 483, in read
> Apr 12 14:08:10 raspberrypi weewx[4785] DEBUG __main__: ****
> ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [],
> timeout.time_left())
> Apr 12 14:08:10 raspberrypi weewx[4785] DEBUG __main__: **** File
> "/usr/share/weewx/weewxd", line 245, in sigTERMhandler
> Apr 12 14:08:10 raspberrypi weewx[4785] DEBUG __main__: ****
> raise Terminate
> Apr 12 14:08:10 raspberrypi weewx[4785] DEBUG __main__: **** Terminate
> Apr 12 14:08:10 raspberrypi weewx[11059]: Stopping weewx weather system:
> weewx.
> Apr 12 14:08:10 raspberrypi systemd[1]: weewx.service: Succeeded.
> Apr 12 14:08:10 raspberrypi systemd[1]: Stopped LSB: weewx weather system.
>
> Apr 12 14:19:44 raspberrypi systemd[1]: Starting LSB: weewx weather
> system...
> Apr 12 14:19:44 raspberrypi weewx[13942] INFO __main__: Initializing weewx
> version 4.9.1
> Apr 12 14:19:44 raspberrypi weewx[13942] INFO __main__: Using Python 3.7.3
> (default, Oct 31 2022, 14:04:00) #012[GCC 8.3.0]
> Apr 12 14:19:44 raspberrypi weewx[13942] INFO __main__: Located at
> /usr/bin/python3
> Apr 12 14:19:44 raspberrypi weewx[13942] INFO __main__: Platform
> Linux-5.10.103-v7l+-armv7l-with-debian-10.13
> Apr 12 14:19:44 raspberrypi weewx[13942] INFO __main__: Locale is
> 'en_GB.UTF-8'
> Apr 12 14:19:44 raspberrypi weewx[13942] INFO __main__: Using
> configuration file /etc/weewx/weewx.conf
> Apr 12 14:19:44 raspberrypi weewx[13942] INFO __main__: Debug is 1
> Apr 12 14:19:44 raspberrypi weewx[13942] INFO __main__: PID file is
> /var/run/weewx.pid
> Apr 12 14:19:44 raspberrypi weewx[13946] DEBUG __main__: Initializing
> engine
> Apr 12 14:19:44 raspberrypi weewx[13946] INFO weewx.engine: Loading
> station type Vantage (weewx.drivers.vantage)
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.drivers.vantage:
> Driver version is 3.4.0
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.drivers.vantage:
> Option loop_request=1
> Apr 12 14:19:45 raspberrypi weewx[13928]: Starting weewx weather system:
> weewx.
> Apr 12 14:19:45 raspberrypi systemd[1]: Started LSB: weewx weather system.
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.drivers.vantage:
> Opened up serial port /dev/ttyUSB0; baud 19200; timeout 4.00
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.drivers.vantage:
> Gentle wake up of console successful
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.drivers.vantage:
> Hardware type is 17
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.drivers.vantage: ISS
> ID is 1
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.drivers.vantage:
> Hardware name: Vantage Vue
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.engine: Loading
> service weewx.engine.StdTimeSynch
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.engine: Finished
> loading service weewx.engine.StdTimeSynch
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.engine: Loading
> service weewx.engine.StdConvert
> Apr 12 14:19:45 raspberrypi weewx[13946] INFO weewx.engine: StdConvert
> target unit is 0x1
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.engine: Finished
> loading service weewx.engine.StdConvert
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.engine: Loading
> service weewx.engine.StdCalibrate
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.engine: Finished
> loading service weewx.engine.StdCalibrate
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.engine: Loading
> service weewx.engine.StdQC
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.engine: Finished
> loading service weewx.engine.StdQC
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.engine: Loading
> service weewx.wxservices.StdWXCalculate
> Apr 12 14:19:45 raspberrypi weewx[13946] INFO weewx.wxservices:
> StdWXCalculate will use data binding wx_binding
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.manager: Daily
> summary version is 4.0
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.engine: Finished
> loading service weewx.wxservices.StdWXCalculate
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.engine: Loading
> service weewx.wxxtypes.StdWXXTypes
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.engine: Finished
> loading service weewx.wxxtypes.StdWXXTypes
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.engine: Loading
> service weewx.wxxtypes.StdPressureCooker
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.engine: Finished
> loading service weewx.wxxtypes.StdPressureCooker
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.engine: Loading
> service weewx.wxxtypes.StdRainRater
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.engine: Finished
> loading service weewx.wxxtypes.StdRainRater
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.engine: Loading
> service weewx.wxxtypes.StdDelta
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.engine: Finished
> loading service weewx.wxxtypes.StdDelta
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.engine: Loading
> service weewx.engine.StdArchive
> Apr 12 14:19:45 raspberrypi weewx[13946] INFO weewx.engine: Archive will
> use data binding wx_binding
> Apr 12 14:19:45 raspberrypi weewx[13946] INFO weewx.engine: Record
> generation will be attempted in 'software'
> Apr 12 14:19:45 raspberrypi weewx[13946] INFO weewx.engine: Using archive
> interval of 300 seconds (software record generation)
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.engine: Use LOOP data
> in hi/low calculations: 1
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.engine: Finished
> loading service weewx.engine.StdArchive
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.engine: Loading
> service weewx.restx.StdStationRegistry
> Apr 12 14:19:45 raspberrypi weewx[13946] INFO weewx.restx:
> StationRegistry: Station will not be registered: no station_url specified.
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.engine: Finished
> loading service weewx.restx.StdStationRegistry
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.engine: Loading
> service weewx.restx.StdWunderground
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.restx: WU essentials:
> {}
> Apr 12 14:19:45 raspberrypi weewx[13946] INFO weewx.restx:
> Wunderground-PWS: Data for station ICAMBSLE2 will be posted
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.engine: Finished
> loading service weewx.restx.StdWunderground
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.engine: Loading
> service weewx.restx.StdPWSweather
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.manager: Daily
> summary version is 4.0
> Apr 12 14:19:45 raspberrypi weewx[13946] INFO weewx.restx: PWSWeather:
> Data for station Wisbech will be posted
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.engine: Finished
> loading service weewx.restx.StdPWSweather
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.engine: Loading
> service weewx.restx.StdCWOP
> Apr 12 14:19:45 raspberrypi weewx[13946] INFO weewx.restx: CWOP: Posting
> not enabled.
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.engine: Finished
> loading service weewx.restx.StdCWOP
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.engine: Loading
> service weewx.restx.StdWOW
> Apr 12 14:19:45 raspberrypi weewx[13946] INFO weewx.restx: WOW: Posting
> not enabled.
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.engine: Finished
> loading service weewx.restx.StdWOW
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.engine: Loading
> service weewx.restx.StdAWEKAS
> Apr 12 14:19:45 raspberrypi weewx[13946] INFO weewx.restx: AWEKAS: Data
> will be uploaded for user (REMOVED)
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.engine: Finished
> loading service weewx.restx.StdAWEKAS
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.engine: Loading
> service weewx.engine.StdPrint
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.engine: Finished
> loading service weewx.engine.StdPrint
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.engine: Loading
> service weewx.engine.StdReport
> Apr 12 14:19:45 raspberrypi weewx[13946] INFO weewx.engine: 'pyephem' not
> detected, extended almanac data is not available
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.engine: Finished
> loading service weewx.engine.StdReport
> Apr 12 14:19:45 raspberrypi weewx[13946] INFO __main__: Starting up weewx
> version 4.9.1
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.manager: Daily
> summary version is 4.0
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.drivers.vantage:
> Gentle wake up of console successful
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.manager: Daily
> summary version is 4.0
> Apr 12 14:19:45 raspberrypi weewx[13946] INFO weewx.engine: Clock error is
> -0.27 seconds (positive is fast)
> Apr 12 14:19:45 raspberrypi weewx[13946] INFO weewx.engine: Using binding
> 'wx_binding' to database 'weewx.sdb'
> Apr 12 14:19:45 raspberrypi weewx[13946] INFO weewx.manager: Starting
> backfill of daily summaries
> Apr 12 14:19:45 raspberrypi weewx[13946] INFO weewx.manager: Daily
> summaries up to date
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.drivers.vantage:
> Getting archive packets since 2023-04-12 14:05:00 BST (1681304700)
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.drivers.vantage:
> Gentle wake up of console successful
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.drivers.vantage:
> Retrieving 2 page(s); starting index= 4
> Apr 12 14:19:45 raspberrypi weewx[13946] INFO weewx.manager: Added record
> 2023-04-12 14:10:00 BST (1681305000) to database 'weewx.sdb'
> Apr 12 14:19:45 raspberrypi weewx[13946] INFO weewx.manager: Added record
> 2023-04-12 14:10:00 BST (1681305000) to daily summary in 'weewx.sdb'
> Apr 12 14:19:45 raspberrypi weewx[13946] INFO weewx.manager: Added record
> 2023-04-12 14:15:00 BST (1681305300) to database 'weewx.sdb'
> Apr 12 14:19:45 raspberrypi weewx[13946] INFO weewx.manager: Added record
> 2023-04-12 14:15:00 BST (1681305300) to daily summary in 'weewx.sdb'
> Apr 12 14:19:45 raspberrypi weewx[13946] INFO weewx.restx: AWEKAS:
> Published record 2023-04-12 14:10:00 BST (1681305000)
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.drivers.vantage:
> DMPAFT complete: page timestamp 2023-04-03 17:00:00 BST (1680537600) less
> than final timestamp 2023-04-12 14:15:00 BST (1681305300)
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.drivers.vantage:
> Catch up complete.
> Apr 12 14:19:45 raspberrypi weewx[13946] INFO weewx.engine: Starting main
> packet loop.
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.drivers.vantage:
> Gentle wake up of console successful
> Apr 12 14:19:45 raspberrypi weewx[13946] INFO weewx.restx: PWSWeather:
> Published record 2023-04-12 14:10:00 BST (1681305000)
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.drivers.vantage:
> Requesting 200 LOOP packets.
> Apr 12 14:19:45 raspberrypi weewx[13946] DEBUG weewx.drivers.vantage:
> Gentle wake up of console successful
> Apr 12 14:19:45 raspberrypi weewx[13946] INFO weewx.restx:
> Wunderground-PWS: Published record 2023-04-12 14:10:00 BST (1681305000)
> Apr 12 14:19:45 raspberrypi weewx[13946] INFO weewx.restx: PWSWeather:
> Published record 2023-04-12 14:15:00 BST (1681305300)
> Apr 12 14:19:46 raspberrypi weewx[13946] INFO weewx.restx:
> Wunderground-PWS: Published record 2023-04-12 14:15:00 BST (1681305300)
> Apr 12 14:19:46 raspberrypi weewx[13946] DEBUG weewx.restx: AWEKAS: Failed
> upload attempt 1: Server returned 'too many requests - try again later '
> Apr 12 14:19:53 raspberrypi weewx[13946] DEBUG weewx.restx: AWEKAS: Failed
> upload attempt 2: Server returned 'too many requests - try again later '
> Apr 12 14:19:58 raspberrypi weewx[13946] DEBUG weewx.restx: AWEKAS: Failed
> upload attempt 3: Server returned 'too many requests - try again later '
> Apr 12 14:19:58 raspberrypi weewx[13946] ERROR weewx.restx: AWEKAS: Failed
> to publish record 2023-04-12 14:15:00 BST (1681305300): Failed upload after
> 3 tries
> Apr 12 14:20:16 raspberrypi weewx[13946] INFO weewx.manager: Added record
> 2023-04-12 14:20:00 BST (1681305600) to database 'weewx.sdb'
> Apr 12 14:20:16 raspberrypi weewx[13946] INFO weewx.manager: Added record
> 2023-04-12 14:20:00 BST (1681305600) to daily summary in 'weewx.sdb'
> Apr 12 14:20:16 raspberrypi weewx[13946] DEBUG weewx.reportengine: Running
> reports for latest time in the database.
> Apr 12 14:20:16 raspberrypi weewx[13946] DEBUG weewx.drivers.vantage:
> Requesting 200 LOOP packets.
> Apr 12 14:20:16 raspberrypi weewx[13946] DEBUG weewx.reportengine: Running
> report 'SeasonsReport'
> Apr 12 14:20:16 raspberrypi weewx[13946] DEBUG weewx.drivers.vantage:
> Gentle wake up of console successful
> Apr 12 14:20:16 raspberrypi weewx[13946] DEBUG weewx.reportengine: Found
> configuration file /etc/weewx/skins/Seasons/skin.conf for report
> 'SeasonsReport'
> Apr 12 14:20:16 raspberrypi weewx[13946] DEBUG weewx.cheetahgenerator:
> Using search list ['weewx.cheetahgenerator.Almanac',
> 'weewx.cheetahgenerator.Current', 'weewx.cheetahgenerator.DisplayOptions',
> 'weewx.cheetahgenerator.Extras', 'weewx.cheetahgenerator.Gettext',
> 'weewx.cheetahgenerator.JSONHelpers', 'weewx.cheetahgenerator.PlotInfo',
> 'weewx.cheetahgenerator.SkinInfo', 'weewx.cheetahgenerator.Station',
> 'weewx.cheetahgenerator.Stats', 'weewx.cheetahgenerator.UnitInfo']
> Apr 12 14:20:16 raspberrypi weewx[13946] DEBUG weewx.manager: Daily
> summary version is 4.0
> Apr 12 14:20:16 raspberrypi weewx[13946] INFO weewx.restx:
> Wunderground-PWS: Published record 2023-04-12 14:20:00 BST (1681305600)
> Apr 12 14:20:18 raspberrypi weewx[13946] INFO weewx.cheetahgenerator:
> Generated 8 files for report SeasonsReport in 2.17 seconds
> Apr 12 14:20:18 raspberrypi weewx[13946] DEBUG weewx.manager: Daily
> summary version is 4.0
> Apr 12 14:20:19 raspberrypi weewx[13946] INFO weewx.restx: PWSWeather:
> Published record 2023-04-12 14:20:00 BST (1681305600)
> Apr 12 14:20:19 raspberrypi weewx[13946] INFO weewx.imagegenerator:
> Generated 14 images for report SeasonsReport in 0.77 seconds
> Apr 12 14:20:19 raspberrypi weewx[13946] INFO weewx.reportengine: Copied 5
> files to /var/www/html/weewx
> Apr 12 14:20:19 raspberrypi weewx[13946] DEBUG weewx.reportengine: Report
> 'SmartphoneReport' not enabled. Skipping.
> Apr 12 14:20:19 raspberrypi weewx[13946] DEBUG weewx.reportengine: Report
> 'MobileReport' not enabled. Skipping.
> Apr 12 14:20:19 raspberrypi weewx[13946] DEBUG weewx.reportengine: Report
> 'StandardReport' not enabled. Skipping.
> Apr 12 14:20:19 raspberrypi weewx[13946] DEBUG weewx.reportengine: Report
> 'FTP' not enabled. Skipping.
> Apr 12 14:20:19 raspberrypi weewx[13946] DEBUG weewx.reportengine: Report
> 'RSYNC' not enabled. Skipping.
>
> [image: 2023-04-12_14-44-44.jpg]
>
> Regards
>
> Dave
>
> On Wednesday, 12 April 2023 at 13:20:41 UTC+1 Greg Troxel wrote:
>
>> Dave McCreath <[email protected]> writes:
>>
>> > System: Vantage Vue with USB datalogger, RPi 4, weeWx 4.9.1.
>>
>> You didn't explain your config. Presumably the vantage driver.
>> Presumably the normal 5 minute archive interval.
>>
>> You didn't explain what you are doing about time synchronization; an
>> RPI does not by default have an RTC and weewx does not deal well with
>> being started with the wrong time. This is a common problem and needs
>> to be addressed first.
>>
>> I would recommend stopping weewx and running wee_device, all the query
>> options, to see what's going on with the logger.
>>
>> You could also enable higher levels of debugging in weewx, stop weewx
>> for 10 minutes and restart, which should result in reading the 2 archive
>> records generated in that interval. Saving logs of course.
>>
>
--
You received this message because you are subscribed to the Google Groups
"weewx-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To view this discussion on the web visit
https://groups.google.com/d/msgid/weewx-user/245f29f5-0e3e-4673-b363-12f79dfb2300n%40googlegroups.com.
