(Sorry if this is a duplicate post. Our Internet is iffy due to Hurricane Fiona)
About a month ago, I asked for an example of the weewx US NOAA data format. First, both Tom and Vince responded, and then Vince was kind enough to send me his entire set of NOAA files. Since then, I have been developing a Python program to look for trends in the weather. Unfortunately, I only have 7 years of my own data, but Vince had data back to November 2006 sans precipitation until 2009. Combined, this was enough to develop wee_trend. It's completed, and here is the URL: https://github.com/ve1dx/wee_trend My goal was to learn Python and how to use git and GitHub. Thanks to much coaching from my son, I believe wee_trend is ready to release to you developers. However, it's not likely appropriate for the general user base because it's only coded for use with Python 3.5 and above. Also, The results may not be statistically significant. The rule of thumb is 20 years of data to look for climate signals. Otherwise, we have just sampled some inter-annual variability. Climatology experts say we need 30 or 50 years to be sure, with 20 years considered a bare minimum. Still, weewx users may wish to look for trends within their data. I tested it on Ubuntu 22.04, MAC OS X (macOS Monterey 12.6), and a Raspberry Pi 4 running the Arm64 port of Debian GNU/Linux 11. For interest sake, here are the relative performance metrics: Ubuntu : (Intel i7-4790K CPU @ 4.00GHz) = 9 seconds. Mac: (3.6 GHz 10-Core Intel Core i9) = 10 seconds. Pi 4: (Cortex-A72 1.5GHz) = 43 seconds. You guys might want to try it on your own NOAA data. I opted not to read the weewx.conf file because I could obtain the unit information from the NOAA files. This has the added advantage of allowing it to be run on a non-weewx system as long as it contains NOAA files. I'd appreciate feedback, either as posts here or issues on GitHub. Go easy on me, as this is my first "toe in the water" with modern programming after a career in 3GL! On Tuesday, August 30, 2022 at 3:23:25 PM UTC-3 Paul Dunphy wrote: > Thanks, Tom (and Vince.) That's all I need. If I get this thing working, > I'll post the GitHub URL here. It would be interesting to see it with 15 > years of data. I only have 7, and that's not enough to rule out > inter-annual variability. I don't think it's worth turning loose on the > general user base, but we'll see. > > - Paul VE1DX > > On Tuesday, August 30, 2022 at 2:41:31 PM UTC-3 Tom Keffer wrote: > >> I've got 15 years worth. Here's this month's: >> https://www.threefools.org/weewx/NOAA/NOAA-2022-08.txt >> >> Just substitute year and month for others. >> >> On Tue, Aug 30, 2022 at 9:00 AM Paul Dunphy <[email protected]> wrote: >> >>> I am tinkering with a program that analyzes the NOAA data looking for >>> trends in climate. All I have to work with are my NOAA files, which are >>> metric. The units are specified in the header lines of these files. >>> >>> Would one of the developers in the US be kind enough to post one of your >>> monthly NOAA files here or send it to me by email? The files of names like >>> "NOAA-2022-04.txt" are the ones I'm using. Any file will do as long as it >>> is not metric. I do not care which month. >>> >>> Thanks, Paul VE1DX >>> >>> -- >>> You received this message because you are subscribed to the Google >>> Groups "weewx-development" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to [email protected]. >>> To view this discussion on the web visit >>> https://groups.google.com/d/msgid/weewx-development/ff115426-41ff-4f0b-a36f-e6df8cfc4c45n%40googlegroups.com >>> >>> <https://groups.google.com/d/msgid/weewx-development/ff115426-41ff-4f0b-a36f-e6df8cfc4c45n%40googlegroups.com?utm_medium=email&utm_source=footer> >>> . >>> >> -- You received this message because you are subscribed to the Google Groups "weewx-development" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-development/201a0889-3b43-4818-b980-aa3ce7b35e1dn%40googlegroups.com.
