Re: [weewx-development] No archive db updates but loop works - WeeWx 5.0b15 and b17

Sat, 16 Dec 2023 14:41:17 -0800

Vince, the log is not querying a purple air device every two seconds.  A purple air could not handle that.  It is inserting purple air values from the most reading in every loop packet.

As for rsyncing every two seconds, I do it ALL THE TIME.  Between machines and also to the Google cloud.  Two seconds is an enormous amount of time.  In fact, in a single weewx instance, I’m rsyncing every two seconds to various devices (perhaps four or more places) every two seconds.  I’ve done this on Raspberry Pi 3s, 4s and now 5s.

Because this is my code, I can tell you that the rsync is on a separate thread and typically a short connection timeout.  For longer connection timeouts, if a queue develops (slow CPU, slow network), it throws away queue entries older than n seconds (configurable).  It never builds up a long queue and, if it skips a loop record, it is recorded in the log.

Looking at my public weewx instance, which rsyncs to a Google compute instance every two seconds, I can see how many skips I’ve had so far today.  I use a 1s timeout with a connection timeouts also of 1 s.

   rsync: conn timeouts                               7
   rsync: conn timeouts (banner exchg)   6
   rsync: io timeouts                                    1

I’ve also contributed this rsync code to Gary’s real time gauges.  Again, it rsyncs on every loop packet (which, for vantage, is every two seconds).

John

On Dec 16, 2023, at 1:52 PM, Chris Alemany <[email protected]> wrote:

I’m noticing this in the log, is this normal. It seems to me it is talking to the Vantage, knows it has records it needs to get, but tries twice and then gives up. Is that “empty record” a problem?

"Dec 16 13:42:16 footiMac weewxd[1741196]: DEBUG weewx.drivers.vantage: Getting archive packets since 2023-12-15 16:10:00 PST (1702685400)

Dec 16 13:42:18 footiMac weewxd[1741196]: DEBUG weewx.drivers.vantage: Successfully woke up Vantage console

Dec 16 13:42:19 footiMac weewxd[1741196]: DEBUG weewx.drivers.vantage: Retrieving 224 page(s); starting index= 0

Dec 16 13:42:19 footiMac weewxd[1741196]: DEBUG weewx.drivers.vantage: Empty record page 0; index 0

Dec 16 13:42:19 footiMac weewxd[1741196]: INFO weewx.engine: Starting main packet loop.

Dec 16 13:42:21 footiMac weewxd[1741196]: DEBUG weewx.drivers.vantage: Successfully woke up Vantage console

Dec 16 13:42:21 footiMac weewxd[1741196]: DEBUG weewx.drivers.vantage: Requesting 200 LOOP packets.

Dec 16 13:42:23 footiMac weewxd[1741196]: DEBUG weewx.drivers.vantage: Successfully woke up Vantage console”




On Dec 16, 2023, at 13:19, Vince Skahan <[email protected]> wrote:

Not really, but your rsync and purple air stuff querying and uploading every two seconds  looks very very unusual.  I'd certainly start there.

On Saturday, December 16, 2023 at 1:17:21 PM UTC-8 Chris Alemany wrote:
Do you also have a problem with people using wunderground rapid fire?
I’ve been doing this for years.
Thanks for the advice. I’ll figure it out.



On Dec 16, 2023, at 12:58, Vince Skahan <[email protected]> wrote:

My guess is you are far doing too much far too often.  Are you really querying purpleair and also rsync'ing somewhere every TWO seconds ?  That's a bit much.

Disable everything you added to vanilla core weewx (temporarily) and run just unaltered weewx and see if it works.  Then turn your additions/customizations back on one-by-one and see what is breaking things.

On Saturday, December 16, 2023 at 12:13:32 PM UTC-8 Chris Alemany wrote:
I was basically asking if there is anything more than debug=1 that I could enable.
There is nothing in the debug messages that I’ve been able to detect other than silence. The archive should be updated around Dec 16 12:05:21

--
You received this message because you are subscribed to the Google Groups "weewx-development" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [email protected].

--
You received this message because you are subscribed to the Google Groups "weewx-development" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [email protected].
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-development/c873934b-4206-46db-854e-3ed96f35bdeen%40googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "weewx-development" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [email protected].
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-development/68E3BA4F-DB82-4F56-88EF-4C5DE78DADAF%40gmail.com.

--
You received this message because you are subscribed to the Google Groups "weewx-development" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [email protected].
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-development/89D8FB38-E79D-4AC0-B92C-CF9F58BAA1E3%40johnkline.com.

Reply via email to