Thank you Rainer and Gary The effortnis greatly appreciated and I will find a way to give back to weewx community for this. There's a lot here on the last posts that have given me a lot of food for thought. Im going to have to launch a huge project here to find the way these other sites have created discrepancies and how I can fix that to get the data normalised.
The 824mm is the amount that matches my plastic guage and neighbouring farms, So it's the number I need to work towards. Once I have that figured out, there's still the original question of whether the new events into wee will work after the interval change. Strangest thing is getting the same weirdness from Wu, weathercloud, ecowitt, etc. That does make the console sound guilty, but with that said, that number is most correct. Confusing. But I'll then post the findings here, and possibly some code so that this thread can have the usefulness to others in the future. Thank you Marlon On Monday, 06 November 2023 at 09:04:02 UTC+2 Rainer Lang wrote: > summary data shown on the ecowitt.net dashboard are the values from the > console and can be changed by the user in the console. At ecowitt.net no > summarizing is done for the displayed tiles, just display of what the > console sends. What is shown there is user responsibility. If the user > makes adjustments, they are simply taken over and displayed. => you can > only conditionally expect accuracy in the summary counts - it may or may > not not match the really stored 5-minute (or longer period summarized data > depending on the retention policy) data. (we can see the discrepancies > between import summaries, NOAA summaries and dashboard tile summaries) > > If there is a discrepancy between this summary data shown on the dashboard > tiles and the summarized end-of-day data for rain, this is most likely user > caused. (800+ vs. 470) > Data from the import was all properly stored - discrepancies are likely to > be user caused and not we_import caused. > On 06.11.2023 05:48, gjr80 wrote: > > I have spent this morning working through the csv data, the NOAA format > reports on your web site and the data on Ecowitt.net. There are a couple of > issues going on. First, the bulk of the difference between the Ecowitt.net > yearly rainfall (presently showing 824.1mm) and that imported by > wee_import (approx 507mm) is due to data inconsistencies on Ecowitt.net. > The yearly rainfall value displayed by Ecowitt.net is taken from the yearly > rain field (presumably uploaded by the station). If you look through the > 2023 tabulated data for the station on Ecowitt.net you will see the yearly > rainfall value was non-existent until 6 June when it took on the value > 585.1mm, but if you sum the monthly rainfall values from 1 January until 6 > June you get something of the order of 254mm (it is impossible to say > exactly due to discrepancies between the values in the various Ecowitt.net > rain fields). This accounts for some 330mm of the difference. I have also > found at least one place where the Ecowitt.net rain data goes backwards (23 > February 06:00 monthly rainfall is 5.6mm, the 10:00 entry indicates 0.8mm > fell taking the monthly total to 6.6mm, the 14:00 entry shows no rain but > the monthly value jumps back to 5.6mm), whilst this may or may not impact > the import (it depends on how the import is setup) it begs the question are > there other data discrepancies that may impact the import. I haven't yet > checked for any other similar discrepancies. > > I have also noticed discrepancies in the NOAA format reports. For some > reason the 2023 report shows the March rainfall as 100.8mm, whereas the > March 2023 report shows a monthly total of 105.6mm. The archive and daily > summary tables both have 105.6mm for March, but for some reason the monthly > report is off. Ecowitt.net also shows 105.6mm for March. Similarly in > October. The October 2023 report shows 28.4mm but the 2023 reports shows > October with 27.1mm, the archive and daily summary tables both record > 28.4mm. I will have to look at this further, but at present I would be wary > of rainfall in the yearly NOAA reports; the monthly reports seem to show > the true value. > > So far I have not been able to fault wee_import. > > Gary > > -- > You received this message because you are subscribed to the Google Groups > "weewx-user" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to weewx-user+...@googlegroups.com. > > To view this discussion on the web visit > https://groups.google.com/d/msgid/weewx-user/dc17cabc-7722-4a27-ac6b-5f96ec306786n%40googlegroups.com > > <https://groups.google.com/d/msgid/weewx-user/dc17cabc-7722-4a27-ac6b-5f96ec306786n%40googlegroups.com?utm_medium=email&utm_source=footer> > . > > -- You received this message because you are subscribed to the Google Groups "weewx-user" group. To unsubscribe from this group and stop receiving emails from it, send an email to weewx-user+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/d4599cf2-5d71-4c5d-9c25-3d0b5c7a35e3n%40googlegroups.com.
