Thanks Rainer. This is most useful. I hope this thread will be useful to others with the same issue. With the new values, I will wait for the next rain and hope for the best!
On Wednesday, 01 November 2023 at 10:34:11 UTC+2 Rainer Lang wrote: > And, to improve your knowledge of your weather station, I recommend > reading the WiKi at > > https://www.wetterstationsforum.info/wiki/doku.php?id=wiki:wetterstationen:ecowitt-stationen > if you understand German (the Froggit brand may point to that). > If not, try https://www.wxforum.net/index.php?topic=40730.0 in English - > not as extensive but the best on the web in English language > by the same author > > On 01.11.2023 09:27, Rainer Lang wrote: > > I think you have to understand better how weewx works: > even if you set a archive interval of 300 seconds (5 minutes), each data > packet sent by your console every 16 seconds (shorter doesn't make sense > for you anyway as the outdoor sensor array only transmits every 16 seconds) > is processed by weewx and added to its Loop data according to the > accumulator setup. The "loop" is a table in which all data which occur > during an archive interval are collected [summarized, averaged etc.] and > the last version is then archived at the end of the archiving interval. So > nothing gets lost and you don't need to archive every 16 seconds ... > > You can find a proper interceptor.py and extensions.py at > https://pc-wetterstation.de/weewx/usr/share/weewx/user/interceptor.zip > and > https://pc-wetterstation.de/weewx/usr/share/weewx/user/extensions.zip > > > On 01.11.2023 09:17, Marlon wrote: > > Hi Rainer > Thank you for the reply. > You are right, that is an absurd interval (Im not sure if late nights or > desperate times caused it). > My console reports (well, POST's) every 16s (the minimum setting). I am > going to increase my archive interval to 60s, or perhaps 32s. Not sure if > it should be divisible by my console's abilities. > > As for the driver, thanks. Didn't know Interceptor was so outdated. > Unfortunately, I am not sure what else my froggit/fineOffset WH3000 can > use. I couldn't get the standard ones to work. > > Appreciated. > Marlon > > > On Wednesday, 01 November 2023 at 10:11:48 UTC+2 Rainer Lang wrote: > >> a) you should use an interceptor driver version which cleanly handles all >> your sensors - and also those you don't have >> the original version on GitHub was never extended and is a crippled >> version from a today's point of view as it covers the basic sensors only >> and its exclusion field-map is incomplete - doesn't match the current >> customized server protocol sent by a modern Ecowitt console with more than >> the basic sensors connected - extended, complete and working versions of >> interceptor.py and extensions.py (for units) exist though >> if you use the device_type ecowitt-client as you already found out >> yourself, the assignment of the rain data should work properly >> But that's "beauty talk" >> >> b) what hits my eye is your archiving interval of 15 seconds ... >> >> Nov 1 09:04:25 goatbox weewx[281767] INFO weewx.engine: Using archive >> interval of 15 seconds (software record generation) >> >> I have no idea what added value you try to get from such a short interval >> and it may overload the system and be - at least partially - responsible >> for your issue. >> On 01.11.2023 08:36, Marlon wrote: >> >> Sorry, I see a part of the log that was missing (i had it on wu-client, >> testing... correct setting is ecowitt-client in interceptor). >> Either way, the raw POST contains this: >> >> Nov 1 09:32:58 goatbox weewx[281767] DEBUG user.interceptor: POST: >> b'PASSKEY=XXXX&stationtype=EasyWeatherV1.6.6&dateutc=2023-11-01+07:32:56&tempinf=71.1&humidityin=54&baromrelin=29.540&baromabsin=29.602&tempf=69.8&humidity=57&winddir=78&windspeedmph=1.8&windgustmph=2.2&maxdailygust=11.4&rainratein=0.000&eventrainin=0.000&hourlyrainin=0.000&dailyrainin=0.000&weeklyrainin=0.008&monthlyrainin=0.000&yearlyrainin=32.445&totalrainin=32.445&solarradiation=839.34&uv=8&wh65batt=0&freq=868M&model=WS2900_V2.01.08' >> >> Nov 1 09:32:58 goatbox weewx[281767] DEBUG user.interceptor: raw data: >> b'PASSKEY=660D031A3A77C1332DFA76B2C975573C&stationtype=EasyWeatherV1.6.6&dateutc=2023-11-01+07:32:56&tempinf=71.1&humidityin=54&baromrelin=29.540&baromabsin=29.602&tempf=69.8&humidity=57&winddir=78&windspeedmph=1.8&windgustmph=2.2&maxdailygust=11.4&rainratein=0.000&eventrainin=0.000&hourlyrainin=0.000&dailyrainin=0.000&weeklyrainin=0.008&monthlyrainin=0.000&yearlyrainin=32.445&totalrainin=32.445&solarradiation=839.34&uv=8&wh65batt=0&freq=868M&model=WS2900_V2.01.08' >> >> A few types of rain params there. >> >> On Wednesday, 01 November 2023 at 09:08:32 UTC+2 Marlon wrote: >> >>> Hey there Gary >>> Your response, and the time you spent, is most appreciated. Thank you. >>> >>> To simplify things, let's ignore the "import" problem, that may >>> (probably is) just user error and config. PS: for what it's worth, my rain >>> data in the csv's are cumulative. So every hour, adds up the total until >>> midnight where it becomes 0.0 again. >>> >>> You're triggering some ideas here, regarding timing. I will share my >>> startup log head now. >>> When I know the rain data matches the other sites, ecowitt, WU, >>> Weathercloud... I will disable posting to those services and just use >>> weewx. Even simpler. >>> >>> Under-readding seems to be at a daily level (or event, which is what I >>> can humanly notice when I look at the console, WU, ecowitt and weewx). An >>> event would end, and everything would say, eg: 32.5mm, but weewx would be >>> at 26mm. Even during rain, it would be behind the console and other >>> services. >>> >>> I'm REALLY pondering the timing thing, and I think you're on to >>> something about missing intercepts/timing. >>> >>> Unfortunately, I am very much in the dark about how these timings work. >>> I use WSView to configure my FineOffset WH clone, and the minimum rate is >>> every 16s (which is my setting). >>> With what interval and "loop packets" mean, I can't figure it out. >>> >>> Again, thanks for the reply. >>> Startup log follows, ugly spam paste warning: >>> >>> root@goatbox:/etc/weewx# service weewx start && tail -f /var/log/syslog >>> | grep weewx >>> Nov 1 09:04:25 goatbox weewx[281764] INFO __main__: Locale is 'C.UTF-8' >>> Nov 1 09:04:25 goatbox weewx[281764] INFO __main__: Using configuration >>> file /etc/weewx/weewx.conf >>> Nov 1 09:04:25 goatbox weewx[281764] INFO __main__: Debug is 1 >>> Nov 1 09:04:25 goatbox weewx[281764] INFO __main__: PID file is >>> /var/run/weewx.pid >>> Nov 1 09:04:25 goatbox weewx[281767] DEBUG __main__: Initializing engine >>> Nov 1 09:04:25 goatbox weewx[281767] INFO weewx.engine: Loading station >>> type Interceptor (user.interceptor) >>> Nov 1 09:04:25 goatbox weewx[281753]: ...done. >>> Nov 1 09:04:25 goatbox systemd[1]: Started LSB: weewx weather system. >>> Nov 1 09:04:25 goatbox weewx[281767] INFO user.interceptor: driver >>> version is 0.60 >>> Nov 1 09:04:25 goatbox weewx[281767] INFO user.interceptor: device >>> type: wu-client >>> Nov 1 09:04:25 goatbox weewx[281767] INFO user.interceptor: hardware >>> name: weatherstation via interceptor >>> Nov 1 09:04:25 goatbox weewx[281767] INFO user.interceptor: mode is >>> listen >>> Nov 1 09:04:25 goatbox weewx[281767] INFO user.interceptor: listen on >>> :8066 >>> Nov 1 09:04:25 goatbox weewx[281767] INFO user.interceptor: sensor map: >>> {'pressure': 'pressure', 'barometer': 'barometer', 'outHumidity': >>> 'humidity_out', 'inHumidity': 'humidity_in', 'outTemp': 'temperature_out', >>> 'inTemp': 'temperature_in', 'windSpeed': 'wind_speed', 'windGust': >>> 'wind_gust', 'windDir': 'wind_dir', 'windGustDir': 'wind_gust_dir', >>> 'radiation': 'solar_radiation', 'dewpoint': 'dewpoint', 'windchill': >>> 'windchill', 'rain': 'rain', 'rainRate': 'rain_rate', 'UV': 'uv', >>> 'txBatteryStatus': 'battery', 'extraTemp1': 'temperature_1', 'extraTemp2': >>> 'temperature_2', 'extraTemp3': 'temperature_3', 'extraHumid1': >>> 'humidity_1', 'extraHumid2': 'humidity_2', 'soilTemp1': >>> 'soil_temperature_1', 'soilTemp2': 'soil_temperature_2', 'soilMoist1': >>> 'soil_moisture_1', 'soilMoist2': 'soil_moisture_2', 'soilMoist3': >>> 'soil_moisture_3', 'soilMoist4': 'soil_moisture_4', 'leafWet1': >>> 'leafwetness_1', 'leafWet2': 'leafwetness_2', 'pm2_5': 'pm2_5', >>> 'extraTemp4': 'temperature_4', 'extraTemp5': 'temperature_5', 'extraTemp6': >>> 'temperature_6', 'extraTemp7': 'temperature_7', 'extraTemp8': >>> 'temperature_8', 'extraHumid3': 'humidity_3', 'extraHumid4': 'humidity_4', >>> 'extraHumid5': 'humidity_5', 'extraHumid6': 'humidity_6', 'extraHumid7': >>> 'humidity_7', 'extraHumid8': 'humidity_8', 'soilTemp3': >>> 'soil_temperature_3', 'soilTemp4': 'soil_temperature_4'} >>> Nov 1 09:04:25 goatbox weewx[281767] DEBUG user.interceptor: start tcp >>> server >>> Nov 1 09:04:25 goatbox weewx[281767] DEBUG weewx.engine: Loading >>> service weewx.engine.StdTimeSynch >>> Nov 1 09:04:25 goatbox weewx[281767] DEBUG weewx.engine: Finished >>> loading service weewx.engine.StdTimeSynch >>> Nov 1 09:04:25 goatbox weewx[281767] DEBUG weewx.engine: Loading >>> service weewx.engine.StdConvert >>> Nov 1 09:04:25 goatbox weewx[281767] INFO weewx.engine: StdConvert >>> target unit is 0x10 >>> Nov 1 09:04:25 goatbox weewx[281767] DEBUG weewx.engine: Finished >>> loading service weewx.engine.StdConvert >>> Nov 1 09:04:25 goatbox weewx[281767] DEBUG weewx.engine: Loading >>> service weewx.engine.StdCalibrate >>> Nov 1 09:04:25 goatbox weewx[281767] DEBUG weewx.engine: Finished >>> loading service weewx.engine.StdCalibrate >>> Nov 1 09:04:25 goatbox weewx[281767] DEBUG weewx.engine: Loading >>> service weewx.engine.StdQC >>> Nov 1 09:04:25 goatbox weewx[281767] DEBUG weewx.engine: Finished >>> loading service weewx.engine.StdQC >>> Nov 1 09:04:25 goatbox weewx[281767] DEBUG weewx.engine: Loading >>> service weewx.wxservices.StdWXCalculate >>> Nov 1 09:04:25 goatbox weewx[281767] INFO weewx.wxservices: >>> StdWXCalculate will use data binding wx_binding >>> Nov 1 09:04:25 goatbox weewx[281767] DEBUG weewx.manager: Daily summary >>> version is 4.0 >>> Nov 1 09:04:25 goatbox weewx[281767] DEBUG weewx.engine: Finished >>> loading service weewx.wxservices.StdWXCalculate >>> Nov 1 09:04:25 goatbox weewx[281767] DEBUG weewx.engine: Loading >>> service weewx.wxxtypes.StdWXXTypes >>> Nov 1 09:04:25 goatbox weewx[281767] DEBUG weewx.engine: Finished >>> loading service weewx.wxxtypes.StdWXXTypes >>> Nov 1 09:04:25 goatbox weewx[281767] DEBUG weewx.engine: Loading >>> service weewx.wxxtypes.StdPressureCooker >>> Nov 1 09:04:25 goatbox weewx[281767] DEBUG weewx.engine: Finished >>> loading service weewx.wxxtypes.StdPressureCooker >>> Nov 1 09:04:25 goatbox weewx[281767] DEBUG weewx.engine: Loading >>> service weewx.wxxtypes.StdRainRater >>> Nov 1 09:04:25 goatbox weewx[281767] DEBUG weewx.engine: Finished >>> loading service weewx.wxxtypes.StdRainRater >>> Nov 1 09:04:25 goatbox weewx[281767] DEBUG weewx.engine: Loading >>> service weewx.wxxtypes.StdDelta >>> Nov 1 09:04:25 goatbox weewx[281767] DEBUG weewx.engine: Finished >>> loading service weewx.wxxtypes.StdDelta >>> Nov 1 09:04:25 goatbox weewx[281767] DEBUG weewx.engine: Loading >>> service weewx.engine.StdArchive >>> Nov 1 09:04:25 goatbox weewx[281767] INFO weewx.engine: Archive will >>> use data binding wx_binding >>> Nov 1 09:04:25 goatbox weewx[281767] INFO weewx.engine: Record >>> generation will be attempted in 'software' >>> Nov 1 09:04:25 goatbox weewx[281767] INFO weewx.engine: Using archive >>> interval of 15 seconds (software record generation) >>> Nov 1 09:04:25 goatbox weewx[281767] WARNING weewx.engine: Archive >>> delay (15) is unusually long >>> Nov 1 09:04:25 goatbox weewx[281767] DEBUG weewx.engine: Use LOOP data >>> in hi/low calculations: 1 >>> Nov 1 09:04:25 goatbox weewx[281767] DEBUG weewx.engine: Finished >>> loading service weewx.engine.StdArchive >>> Nov 1 09:04:25 goatbox weewx[281767] DEBUG weewx.engine: Loading >>> service weewx.restx.StdStationRegistry >>> Nov 1 09:04:25 goatbox weewx[281767] INFO weewx.restx: StationRegistry: >>> Station will be registered. >>> Nov 1 09:04:25 goatbox weewx[281767] DEBUG weewx.engine: Finished >>> loading service weewx.restx.StdStationRegistry >>> Nov 1 09:04:25 goatbox weewx[281767] DEBUG weewx.engine: Loading >>> service weewx.restx.StdWunderground >>> Nov 1 09:04:25 goatbox weewx[281767] INFO weewx.restx: Wunderground: >>> Posting not enabled. >>> Nov 1 09:04:25 goatbox weewx[281767] DEBUG weewx.engine: Finished >>> loading service weewx.restx.StdWunderground >>> Nov 1 09:04:25 goatbox weewx[281767] DEBUG weewx.engine: Loading >>> service weewx.restx.StdPWSweather >>> Nov 1 09:04:25 goatbox weewx[281767] INFO weewx.restx: PWSWeather: Data >>> for station KLEINKAROO1 will be posted >>> Nov 1 09:04:25 goatbox weewx[281767] DEBUG weewx.engine: Finished >>> loading service weewx.restx.StdPWSweather >>> Nov 1 09:04:25 goatbox weewx[281767] DEBUG weewx.engine: Loading >>> service weewx.restx.StdCWOP >>> Nov 1 09:04:25 goatbox weewx[281767] INFO weewx.restx: CWOP: Posting >>> not enabled. >>> Nov 1 09:04:25 goatbox weewx[281767] DEBUG weewx.engine: Finished >>> loading service weewx.restx.StdCWOP >>> Nov 1 09:04:25 goatbox weewx[281767] DEBUG weewx.engine: Loading >>> service weewx.restx.StdWOW >>> Nov 1 09:04:25 goatbox weewx[281767] INFO weewx.restx: WOW: Posting not >>> enabled. >>> Nov 1 09:04:25 goatbox weewx[281767] DEBUG weewx.engine: Finished >>> loading service weewx.restx.StdWOW >>> Nov 1 09:04:25 goatbox weewx[281767] DEBUG weewx.engine: Loading >>> service weewx.restx.StdAWEKAS >>> Nov 1 09:04:25 goatbox weewx[281767] INFO weewx.restx: AWEKAS: Data >>> will be uploaded for user marlonza >>> Nov 1 09:04:25 goatbox weewx[281767] DEBUG weewx.engine: Finished >>> loading service weewx.restx.StdAWEKAS >>> Nov 1 09:04:25 goatbox weewx[281767] DEBUG weewx.engine: Loading >>> service user.owm.OpenWeatherMap >>> Nov 1 09:04:25 goatbox weewx[281767] INFO user.owm: service version is >>> 0.9 >>> Nov 1 09:04:25 goatbox weewx[281767] INFO user.owm: Data will be >>> uploaded for 650d5a8e8885c200018ae241 >>> Nov 1 09:04:25 goatbox weewx[281767] DEBUG weewx.engine: Finished >>> loading service user.owm.OpenWeatherMap >>> Nov 1 09:04:25 goatbox weewx[281767] DEBUG weewx.engine: Loading >>> service weewx.engine.StdPrint >>> Nov 1 09:04:25 goatbox weewx[281767] DEBUG weewx.engine: Finished >>> loading service weewx.engine.StdPrint >>> Nov 1 09:04:25 goatbox weewx[281767] DEBUG weewx.engine: Loading >>> service weewx.engine.StdReport >>> Nov 1 09:04:25 goatbox weewx[281767] INFO weewx.engine: 'pyephem' >>> detected, extended almanac data is available >>> Nov 1 09:04:25 goatbox weewx[281767] DEBUG weewx.engine: Finished >>> loading service weewx.engine.StdReport >>> Nov 1 09:04:25 goatbox weewx[281767] INFO __main__: Starting up weewx >>> version 4.10.2 >>> Nov 1 09:04:25 goatbox weewx[281767] DEBUG weewx.engine: Station does >>> not support reading the time >>> Nov 1 09:04:25 goatbox weewx[281767] INFO weewx.engine: Using binding >>> 'wx_binding' to database 'weewx' >>> Nov 1 09:04:25 goatbox weewx[281767] INFO weewx.manager: Starting >>> backfill of daily summaries >>> Nov 1 09:04:25 goatbox weewx[281767] INFO weewx.manager: Daily >>> summaries up to date >>> Nov 1 09:04:25 goatbox weewx[281767] INFO weewx.engine: Starting main >>> packet loop. >>> Nov 1 09:04:25 goatbox weewx[281767] DEBUG weewx.manager: Daily summary >>> version is 4.0 >>> Nov 1 09:04:25 goatbox weewx[281767] message repeated 2 times: [ DEBUG >>> weewx.manager: Daily summary version is 4.0] >>> Nov 1 09:04:27 goatbox weewx[281767] DEBUG user.interceptor: POST: >>> b'PASSKEY=XXXX&stationtype=EasyWeatherV1.6.6&dateutc=2023-11-01+07:04:24&tempinf=69.4&humidityin=54&baromrelin=29.554&baromabsin=29.616&tempf=68.7&humidity=60&winddir=83&windspeedmph=0.2&windgustmph=1.1&maxdailygust=6.9&rainratein=0.000&eventrainin=0.000&hourlyrainin=0.000&dailyrainin=0.000&weeklyrainin=0.008&monthlyrainin=0.000&yearlyrainin=32.445&totalrainin=32.445&solarradiation=654.99&uv=6&wh65batt=0&freq=868M&model=WS2900_V2.01.08' >>> Nov 1 09:04:27 goatbox weewx[281767] DEBUG user.interceptor: raw data: >>> b'PASSKEY=censoredC&stationtype=EasyWeatherV1.6.6&dateutc=2023-11-01+07:04:24&tempinf=69.4&humidityin=54&baromrelin=29.554&baromabsin=29.616&tempf=68.7&humidity=60&winddir=83&windspeedmph=0.2&windgustmph=1.1&maxdailygust=6.9&rainratein=0.000&eventrainin=0.000&hourlyrainin=0.000&dailyrainin=0.000&weeklyrainin=0.008&monthlyrainin=0.000&yearlyrainin=32.445&totalrainin=32.445&solarradiation=654.99&uv=6&wh65batt=0&freq=868M&model=WS2900_V2.01.08' >>> Nov 1 09:04:27 goatbox weewx[281767] DEBUG user.interceptor: using >>> rain_total 32.445 from yearlyrainin >>> Nov 1 09:04:27 goatbox weewx[281767] INFO user.interceptor: >>> unrecognized parameter b'PASSKEY=censored >>> Nov 1 09:04:27 goatbox weewx[281767] INFO user.interceptor: >>> unrecognized parameter stationtype=EasyWeatherV1.6.6 >>> Nov 1 09:04:27 goatbox weewx[281767] INFO user.interceptor: >>> unrecognized parameter tempinf=69.4 >>> Nov 1 09:04:27 goatbox weewx[281767] INFO user.interceptor: >>> unrecognized parameter humidityin=54 >>> Nov 1 09:04:27 goatbox weewx[281767] INFO user.interceptor: >>> unrecognized parameter baromrelin=29.554 >>> Nov 1 09:04:27 goatbox weewx[281767] INFO user.interceptor: >>> unrecognized parameter baromabsin=29.616 >>> Nov 1 09:04:27 goatbox weewx[281767] INFO user.interceptor: >>> unrecognized parameter maxdailygust=6.9 >>> Nov 1 09:04:27 goatbox weewx[281767] INFO user.interceptor: >>> unrecognized parameter rainratein=0.000 >>> Nov 1 09:04:27 goatbox weewx[281767] INFO user.interceptor: >>> unrecognized parameter eventrainin=0.000 >>> Nov 1 09:04:27 goatbox weewx[281767] INFO user.interceptor: >>> unrecognized parameter hourlyrainin=0.000 >>> Nov 1 09:04:27 goatbox weewx[281767] INFO user.interceptor: >>> unrecognized parameter weeklyrainin=0.008 >>> Nov 1 09:04:27 goatbox weewx[281767] INFO user.interceptor: >>> unrecognized parameter monthlyrainin=0.000 >>> Nov 1 09:04:27 goatbox weewx[281767] INFO user.interceptor: >>> unrecognized parameter totalrainin=32.445 >>> Nov 1 09:04:27 goatbox weewx[281767] INFO user.interceptor: >>> unrecognized parameter uv=6 >>> Nov 1 09:04:27 goatbox weewx[281767] INFO user.interceptor: >>> unrecognized parameter wh65batt=0 >>> Nov 1 09:04:27 goatbox weewx[281767] INFO user.interceptor: >>> unrecognized parameter freq=868M >>> Nov 1 09:04:27 goatbox weewx[281767] INFO user.interceptor: >>> unrecognized parameter model=WS2900_V2.01.08' >>> Nov 1 09:04:27 goatbox weewx[281767] INFO user.interceptor: skipping >>> rain measurement of 32.445: no last rain >>> Nov 1 09:04:27 goatbox weewx[281767] DEBUG user.interceptor: raw >>> packet: {'dateTime': 1698822264, 'usUnits': 1, 'rain_total': 32.445, >>> 'temperature_out': 68.7, 'humidity_out': 60.0, 'wind_dir': 83.0, >>> 'wind_speed': 0.2, 'wind_gust': 1.1, 'solar_radiation': 654.99, 'rain': >>> None} >>> Nov 1 09:04:27 goatbox weewx[281767] DEBUG user.interceptor: mapped >>> packet: {'dateTime': 1698822264, 'usUnits': 1, 'outHumidity': 60.0, >>> 'outTemp': 68.7, 'windSpeed': 0.2, 'windGust': 1.1, 'windDir': 83.0, >>> 'radiation': 654.99, 'rain': None} >>> >>> Note: Rain is set to None on the first iteration. It reverts to 0.0 >>> consequently. >>> >>> >>> >>> On Tuesday, 31 October 2023 at 11:19:18 UTC+2 gjr80 wrote: >>> >>>> It can be tricky to maintain identical readings at all destinations for >>>> stations that post to multiple sources, ran in particular can be tricky >>>> due >>>> to it being a (typically) cumulative value whereas other observations are >>>> typically averages. Small changes or the loss of a single reading usually >>>> have little effect of weather obs average values but loss of a mm or two >>>> of >>>> rain is noticeable. Timing differences can also cause discrepancies. >>>> >>>> You say that 'it underreads rain by a few millimeters everytime' - what >>>> does that mean, is every packet received by WeeWX under or is every day, >>>> week or month under? How often is your station posting to ecowitt.net >>>> and WeeWX? It would be good to see a startup log extract with debug = 1 >>>> so we can see your station config. If using your station custom >>>> posting/upload you should be seeing regular intercepts from your station >>>> in >>>> the WeeWX log, are you seeing all posts from your station or are some >>>> missing, do all have a rain value or are some missing? Sorry but there is >>>> likely going to be a lot of log analysis to track this down. >>>> >>>> In terms of wee_import what does your csv file contain, does it >>>> contain cumulative rain value or per-archive period values? What does you >>>> import config file contain? There is a 'rain' config option in the CSV >>>> import config file <http://weewx.com/docs/4.10/utilities.htm#csv_rain> >>>> that determines how rain values are handled - it needs to be set >>>> correctly. >>>> if the source data is correct tracking down CSV import issues should be >>>> very straightforward once we have the data and the config being used. Feel >>>> free to post your CSV source data and import config file here or email to >>>> me at gjroderick at gmail dot com and I will run through them. >>>> >>>> Gary >>>> On Tuesday, 31 October 2023 at 17:34:53 UTC+10 marlo...@gmail.com >>>> wrote: >>>> >>>>> I nuked the DB, extracted all the data from ecowitt using @comes >>>>> https://github.com/comes/ecowitt2weewx >>>>> I then imported it all back in. The data from ecowitt seems correct, >>>>> still. My yearly rain so far is 824.1mm as per my station >>>>> https://www.ecowitt.net/home/index?id=68712 >>>>> >>>>> After all of this, I still get about half the rainfall in weewx. >>>>> (490.3mm) https://weewx.simple-earth.org/reports/?yr=2023 >>>>> >>>>> It's likely there is a weird field mapping, or table that I just don't >>>>> understand. Looking at the amount of rain related issues, I'm not alone. >>>>> Would like to beat this. >>>>> Please help me save my brain. It's breaking. >>>>> >>>>> On Monday, 30 October 2023 at 13:12:46 UTC+2 Marlon wrote: >>>>> >>>>>> Oct 30 13:08:42 goatbox weewx[116207] DEBUG weewx.reportengine: >>>>>> Report 'FTP' not enabled. Skipping. >>>>>> Oct 30 13:08:42 goatbox weewx[116207] DEBUG weewx.reportengine: >>>>>> Report 'RSYNC' not enabled. Skipping. >>>>>> Oct 30 13:08:49 goatbox weewx[116207] DEBUG user.interceptor: empty >>>>>> queue >>>>>> Oct 30 13:08:59 goatbox weewx[116207] DEBUG user.interceptor: empty >>>>>> queue >>>>>> Oct 30 13:09:01 goatbox weewx[116207] DEBUG user.interceptor: POST: >>>>>> b'PASSKEY=XXXX&stationtype=EasyWeatherV1.6.6&dateutc=2023-10-30+11:08:59&tempinf=76.6&humidityin=46&baromrelin=29.661&baromabsin=29.723&tempf=71.6&humidity=44&winddir=72&windspeedmph=3.1&windgustmph=4.5&maxdailygust=15.9&rainratein=0.000&eventrainin=0.000&hourlyrainin=0.000&dailyrainin=0.000&weeklyrainin=0.008&monthlyrainin=1.118&yearlyrainin=32.445&totalrainin=32.445&solarradiation=831.15&uv=8&wh65batt=0&freq=868M&model=WS2900_V2.01.08' >>>>>> Oct 30 13:09:01 goatbox weewx[116207] DEBUG user.interceptor: raw >>>>>> data: >>>>>> b'PASSKEY=660D031A3A77C1332DFA76B2C975573C&stationtype=EasyWeatherV1.6.6&dateutc=2023-10-30+11:08:59&tempinf=76.6&humidityin=46&baromrelin=29.661&baromabsin=29.723&tempf=71.6&humidity=44&winddir=72&windspeedmph=3.1&windgustmph=4.5&maxdailygust=15.9&rainratein=0.000&eventrainin=0.000&hourlyrainin=0.000&dailyrainin=0.000&weeklyrainin=0.008&monthlyrainin=1.118&yearlyrainin=32.445&totalrainin=32.445&solarradiation=831.15&uv=8&wh65batt=0&freq=868M&model=WS2900_V2.01.08' >>>>>> Oct 30 13:09:01 goatbox weewx[116207] DEBUG user.interceptor: using >>>>>> rain_total 32.445 from yearlyrainin >>>>>> Oct 30 13:09:01 goatbox weewx[116207] INFO user.interceptor: >>>>>> unrecognized parameter b'PASSKEY=660D031A3A77C1332DFA76B2C975573C >>>>>> Oct 30 13:09:01 goatbox weewx[116207] INFO user.interceptor: >>>>>> unrecognized parameter stationtype=EasyWeatherV1.6.6 >>>>>> Oct 30 13:09:01 goatbox weewx[116207] INFO user.interceptor: >>>>>> unrecognized parameter baromrelin=29.661 >>>>>> Oct 30 13:09:01 goatbox weewx[116207] INFO user.interceptor: >>>>>> unrecognized parameter maxdailygust=15.9 >>>>>> Oct 30 13:09:01 goatbox weewx[116207] INFO user.interceptor: >>>>>> unrecognized parameter rainratein=0.000 >>>>>> Oct 30 13:09:01 goatbox weewx[116207] INFO user.interceptor: >>>>>> unrecognized parameter eventrainin=0.000 >>>>>> Oct 30 13:09:01 goatbox weewx[116207] INFO user.interceptor: >>>>>> unrecognized parameter hourlyrainin=0.000 >>>>>> Oct 30 13:09:01 goatbox weewx[116207] DEBUG user.interceptor: ignored >>>>>> parameter weeklyrainin=0.008 >>>>>> Oct 30 13:09:01 goatbox weewx[116207] DEBUG user.interceptor: ignored >>>>>> parameter monthlyrainin=1.118 >>>>>> Oct 30 13:09:01 goatbox weewx[116207] INFO user.interceptor: >>>>>> unrecognized parameter totalrainin=32.445 >>>>>> Oct 30 13:09:01 goatbox weewx[116207] INFO user.interceptor: >>>>>> unrecognized parameter wh65batt=0 >>>>>> Oct 30 13:09:01 goatbox weewx[116207] INFO user.interceptor: >>>>>> unrecognized parameter freq=868M >>>>>> Oct 30 13:09:01 goatbox weewx[116207] INFO user.interceptor: >>>>>> unrecognized parameter model=WS2900_V2.01.08' >>>>>> Oct 30 13:09:01 goatbox weewx[116207] DEBUG user.interceptor: raw >>>>>> packet: {'dateTime': 1698664139, 'usUnits': 1, 'rain_total': 32.445, >>>>>> 'temperature_in': 76.6, 'humidity_in': 46.0, 'pressure': 29.723, >>>>>> 'temperature_out': 71.6, 'humidity_out': 44.0, 'wind_dir': 72.0, >>>>>> 'wind_speed': 3.1, 'wind_gust': 4.5, 'solar_radiation': 831.15, 'uv': >>>>>> 8.0, >>>>>> 'rain': 0.0} >>>>>> Oct 30 13:09:01 goatbox weewx[116207] DEBUG user.interceptor: mapped >>>>>> packet: {'dateTime': 1698664139, 'usUnits': 1, 'pressure': 29.723, >>>>>> 'outHumidity': 44.0, 'inHumidity': 46.0, 'outTemp': 71.6, 'inTemp': >>>>>> 76.6, >>>>>> 'windSpeed': 3.1, 'windGust': 4.5, 'windDir': 72.0, 'radiation': 831.15, >>>>>> 'rain': 0.0, 'UV': 8.0} >>>>>> Oct 30 13:09:01 goatbox weewx[116207] INFO weewx.manager: Added >>>>>> record 2023-10-30 13:08:30 SAST (1698664110) to database 'weewx' >>>>>> Oct 30 13:09:01 goatbox weewx[116207] INFO weewx.manager: Added >>>>>> record 2023-10-30 13:08:30 SAST (1698664110) to daily summary in 'weewx' >>>>>> >>>>>> On Monday, 30 October 2023 at 12:53:37 UTC+2 Marlon wrote: >>>>>> >>>>>>> Hello >>>>>>> I recently started using weewx to collect my own weather data >>>>>>> (instead of relying on external sites). The problem is strange. I tried >>>>>>> for >>>>>>> days, exhaustively, to fix this - wanted to avoid another support issue >>>>>>> here that wastes your time, but alas. >>>>>>> >>>>>>> My station is a froggit WH3000 and has always (still does), >>>>>>> accurately posted to ecowitt, WU and WeatherCloud. >>>>>>> >>>>>>> I added weewx on my vps now, and it uses interceptor to get the data >>>>>>> using my stations 'custom' posting (it has a choice of ecowitt vs wu >>>>>>> protocol). >>>>>>> >>>>>>> The data on weewx is all fine, accurate, except it underreads rain >>>>>>> by a few millimeters everytime. All the data on the station console, WU >>>>>>> and >>>>>>> ecowitt matches, but weewx underreads. >>>>>>> >>>>>>> For october for instance: 28.4mm is the correct value. Weewx has >>>>>>> 23.7mm >>>>>>> I can see it happen on daily rainfall as well. Yesterday we had >>>>>>> 0.2mm drizzle, but weewx still thinks we had 0.0 >>>>>>> >>>>>>> On a sidenote, I tried to import historic data from ecowitt (csv) to >>>>>>> weewx, and I see the same thing happening. >>>>>>> >>>>>>> I feel bested. It got the better of me. Advice or ideas could go a >>>>>>> long way. >>>>>>> Thanks in advance >>>>>>> Marlon >>>>>>> >>>>>>> -- >> You received this message because you are subscribed to the Google Groups >> "weewx-user" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to weewx-user+...@googlegroups.com. >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/weewx-user/433cd173-d2f6-466e-9f16-983ef4e772e1n%40googlegroups.com >> >> <https://groups.google.com/d/msgid/weewx-user/433cd173-d2f6-466e-9f16-983ef4e772e1n%40googlegroups.com?utm_medium=email&utm_source=footer> >> . >> >> -- > You received this message because you are subscribed to the Google Groups > "weewx-user" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to weewx-user+...@googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/weewx-user/55b97aba-2533-4be3-8c26-b00593da4155n%40googlegroups.com > > <https://groups.google.com/d/msgid/weewx-user/55b97aba-2533-4be3-8c26-b00593da4155n%40googlegroups.com?utm_medium=email&utm_source=footer> > . > > -- You received this message because you are subscribed to the Google Groups "weewx-user" group. To unsubscribe from this group and stop receiving emails from it, send an email to weewx-user+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/074f9727-7757-4c5c-af03-9805d0a1ccadn%40googlegroups.com.
