On Sunday, 16 September 2018 06:51:59 UTC+10, Thomas Keffer wrote:
>
> On Sat, Sep 15, 2018 at 1:12 PM <[email protected] <javascript:>> wrote:
>
>> I imported the data using the wee_import utility.  I edited the 
>> import.conf file to download all the data from Weather Underground. 
>>
>
> Then we'll have to wait for Gary to chime in. But, it should be possible 
> without a big spike like that.
>

Unlike WU wee_import does not perform any magic incantations on the data 
being imported. WU records daily cumulative rain and rain in the last hour. 
wee_import uses the daily cumulative value to calculate the WeeWX rain 
field (rain per archive period) and ignores the hourly value. WeeWX field 
rainRate is calculated as a derived obs as per the StdCalculate service.

I guess we are all familiar with the issues associated with WU and the 
quality of their data. Anecdotally, I have found that successive queries on 
WU of the type wee_import uses can at times return differing numbers of 
records for a given day (try running wunderfixer 10 times in a row and I 
guarantee it will find at least three different numbers of missing 
records). I can't say that I have seen variations in the data within the 
records WU returns, just in the overall number of records returned.

What is the underlying data like when you display the tabulated observation 
data for the day concerned on WU? Is the discrepancy there? If so I guess 
all you can do is fix your WeeWX archive data for that day as Tom said (or 
import the .wlk files), if WU is showing fine you could try re-importing 
just that day. It's easy enough to do just delete the records for that day 
(a fairly simple SQL update query will do that) then run wee_import again 
but limit it to importing just that day. Of course you will need to rebuild 
your daily summaries again but you can limit that to just that one day.

As an aside, last year I did look at extending wee_import to import .wlk 
files but on my first glance it looked like substantially more effort than 
the three sources that wee_import currently handles plus wview (and Cumulus 
I think ?) provide a means to indirectly importing data via a 3rd party 
utility. I haven't taken it any further since.

Gary

-- 
You received this message because you are subscribed to the Google Groups 
"weewx-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
For more options, visit https://groups.google.com/d/optout.

Reply via email to