Well I'm not sure what you want to see. But if you want, literally, the several thousand lines of updating Wunderground and WOW records:
Nov 3 16:07:56 viking weewx[21343]: restx: Wunderground-PWS: Published record 2019-11-01 19:50:00 AEDT (1572598200) Nov 3 16:07:56 viking weewx[21343]: restx: WOW: Published record 2019-10-28 17:55:00 AEDT (1572245700) which surround that "small bit" with no other errors that I can see, I'm happy to oblige. I'm really not concerned with the cause, it seems to have recovered and is successfully recording rainfall from the station as I write this. It hasn't happened before in the 4 years I've been running weewx. I just haven't got time at the moment to re-learn the weewx database structure and how to edit it (or read all the docs again) so I was hoping weewx could recover the data for me. Weewx is so reliable that I haven't had to touch it in a couple years so honestly I've forgotten how it all works. In the meantime you've given me some clues to recover the data, for which I thank you. On Monday, 4 November 2019 22:04:58 UTC+11, Andrew Milner wrote: > > Just seeing a small bit of log is not very helpful!! > > The constraint failure at 1600 when trying to add records from 1515 onwrds > means there is already a record in the database for 1515 (and 1520 and 1525 > etc) > > without seeing more log it is impossible to know what happened, when data > was written, when weewx was restarted and so on. > > If the data is still in the station the simplest thing to do is probably > stop weewx, backup the database, delete all archive records > say 1400, > restart weewx and it should recover from the logger. To recreate NOAA > correctly you will need to delete the appropriate NOAA file(s) and weewx > will recreate them on the next report cycle. > > > > > > On Monday, 4 November 2019 11:40:46 UTC+2, Powerin wrote: >> >> Hi Andrew, thanks for the reply. Yes the 20mm definitely fell during the >> 24hrs yesterday as reported by the console (and a manual rain gauge). Weewx >> was restarted a couple hours before the rain event. >> >> The log shows it failed updating the database for a period of 50mins >> during the rain. Every 5mins it reported a new failure plus the previous >> ones. This is the final block of ten for that period: >> Nov 3 16:00:16 viking weewx[21343]: manager: unable to add record 2019- >> 11-03 15:15:00 AEDT (1572754500) to database 'weewx.sdb': UNIQUE >> constraint failed: archive.dateTime >> Nov 3 16:00:16 viking weewx[21343]: manager: unable to add record 2019- >> 11-03 15:20:00 AEDT (1572754800) to database 'weewx.sdb': UNIQUE >> constraint failed: archive.dateTime >> Nov 3 16:00:16 viking weewx[21343]: manager: unable to add record 2019- >> 11-03 15:25:00 AEDT (1572755100) to database 'weewx.sdb': UNIQUE >> constraint failed: archive.dateTime >> Nov 3 16:00:16 viking weewx[21343]: manager: unable to add record 2019- >> 11-03 15:30:00 AEDT (1572755400) to database 'weewx.sdb': UNIQUE >> constraint failed: archive.dateTime >> Nov 3 16:00:16 viking weewx[21343]: manager: unable to add record 2019- >> 11-03 15:35:00 AEDT (1572755700) to database 'weewx.sdb': UNIQUE >> constraint failed: archive.dateTime >> Nov 3 16:00:16 viking weewx[21343]: manager: unable to add record 2019- >> 11-03 15:40:00 AEDT (1572756000) to database 'weewx.sdb': UNIQUE >> constraint failed: archive.dateTime >> Nov 3 16:00:16 viking weewx[21343]: manager: unable to add record 2019- >> 11-03 15:45:00 AEDT (1572756300) to database 'weewx.sdb': UNIQUE >> constraint failed: archive.dateTime >> Nov 3 16:00:16 viking weewx[21343]: manager: unable to add record 2019- >> 11-03 15:50:00 AEDT (1572756600) to database 'weewx.sdb': UNIQUE >> constraint failed: archive.dateTime >> Nov 3 16:00:16 viking weewx[21343]: manager: unable to add record 2019- >> 11-03 15:55:00 AEDT (1572756900) to database 'weewx.sdb': UNIQUE >> constraint failed: archive.dateTime >> Nov 3 16:00:16 viking weewx[21343]: manager: unable to add record 2019- >> 11-03 16:00:00 AEDT (1572757200) to database 'weewx.sdb': UNIQUE >> constraint failed: archive.dateTime >> >> After this it seems to continue OK: >> >> Nov 3 16:10:16 viking weewx[21343]: manager: added record 2019-11-03 16: >> 10:00 AEDT (1572757800) to database 'weewx.sdb' >> Nov 3 16:10:16 viking weewx[21343]: manager: added record 2019-11-03 16: >> 10:00 AEDT (1572757800) to daily summary in 'weewx.sdb' >> >> I don't have the tools at the moment to browse the database directly but >> "Yesterday's" rainfall, the "weekly" and "monthly" web page, the NOAA >> monthy summary and a custom local PHP page that queries the database >> directly all show incorrect rainfall. The PHP page reports hourly obs and >> there is no rainfall for the hour at 1500 but there is for 1400 and 1600. >> So I assume the database doesn't have the data. >> >> The main thing I want to know is if I can ask weewx to restore the data >> for me from the station. Accurate rainfall records are important for a >> farmer :-) >> >> On Monday, 4 November 2019 15:29:48 UTC+11, Andrew Milner wrote: >>> >>> what did the log say when weewx was restarted until first archive period >>> has passed? >>> >>> not being funny, but if it took 3 days to discover weewx was not >>> updating are you 100% sure the 20mm you saw on the console was for the same >>> day that you have compared with on reports and database? >>> >>> what is actually in the database for a) daily summary and b) archive >>> periods >>> >>> are you using hardware records or weewx software records? >>> >>> >>> >>> On Monday, 4 November 2019 04:56:21 UTC+2, Powerin wrote: >>>> >>>> Hi All, >>>> >>>> Yesterday weewx (3.5) seems to have missed recording some of the rain >>>> that fell during the day. The station (Vantage Pro2) has correctly >>>> recorded >>>> 20mm but weewx only shows 10.8mm on its webpages and database. Is it >>>> possible to get weewx to re-read the correct data from the station or >>>> datalogger or do I have to manually change the database? >>>> >>>> At the time of the rain event weewx was busy catching up on a few days >>>> backlog because I had just re-started it after an un-noticed crash a few >>>> days ago. I've looked through the utilities but don't quite know which one >>>> might help. Thanks. >>>> >>>> Peter >>>> >>> -- You received this message because you are subscribed to the Google Groups "weewx-user" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/e800d40e-edb8-44f1-9d82-f9a8aa08caa8%40googlegroups.com.
