Thank you Gary for your very quick and detailed response. Nice of you! I had read the documentation on the Weewx utilities guide but had not understood it in the sense you indicate... So I modified my Python program to calculate in the csv file the amount of water that fell over the 5 minute period and modified the configuration file with rain=discrete instead of rain=cumulative.
Thanks again Gary. I'm waiting for the next rain and confirming the resolution of the problem. Unfortunately no precipitation is expected locally for the next few days... We'll have to be patient! ;-) Thanks a lot again Gary Le dimanche 27 août 2023 à 05:02:05 UTC+2, gjr80 a écrit : > If you are importing a single record and using rain = cumulative the > imported rain and rainRate values will always be zero, this is expected > behaviour. The reason being that WeeWX records rainfall data on a per > archive interval basis; in other words each archive record contains the > rainfall that was recorded in that archive period, for example in the last > five minutes if using a five minute archive interval. When the import > source rainfall data is cumulative or a running total wee_import > calculates the rain field value as the difference in this cumulative or > running total value between successive records. The If there is only one > record then this difference cannot be calculated and hence rain is > recorded as zero. Likewise for rainRate; if there is no rain data then > there can be no rainRate. > > The use of the rain config option in a CSV import config file is covered > here <http://weewx.com/docs.html/latest/utilities.htm#csv_rain> in the > Utilities > Guide <http://weewx.com/docs.html/latest/utilities.htm>. > > If you must import a single record at a time you must convert your source > rain data to be a per-record value and import using rain = discrete. > wee_import was not designed with the regular import of single records in > mind, rather it was designed for the bulk import of days/months/years of > data. > > Gary > On Sunday, 27 August 2023 at 04:34:16 UTC+10 [email protected] wrote: > >> >> >> >> *Good morning,I am using the wee_import.py utility to integrate AWEKAS >> data into my weewx database.command executed: *sudo wee_import >> --config=/etc/weewx/weewx.conf >> --import-config=/home/pi/Documents/Bresser7in1/csv-Bresser.conf --dry-run >> --verbose >> >> *My CSVFile :* >> >> >> dateTime,outTemp,outHumidity,dewpoint,appTemp,barometer,windchill,windSpeed,windDir,windGust, >> *rain,rainRate*,UV,radiation,inTemp,inHumidity,extraTemp1 >> 2023-08-26 16:35:00,23.6,61.0,15.7,18.4,1010.6,23.6,3.2,214,3.9,*6.9,0,* >> 1.1,101.0,26.1,53.0,24.9,22.0 >> >> >> >> *My wee_import configuration file:* >> >> source = CSV >> >> >> ############################################################################## >> >> [CSV] >> file = /home/pi/Documents/Bresser7in1/data5.csv >> delimiter = ',' >> decimal = '.' >> interval = conf >> qc = True >> calc_missing = True >> ignore_invalid_data = True >> tranche = 250 >> UV_sensor = True >> solar_sensor = True >> raw_datetime_format = %Y-%m-%d %H:%M:%S >> >> rain = cumulative >> wind_direction = 0,360 >> >> >> [[FieldMap]] >> dateTime = dateTime, unix_epoch >> barometer = barometer, hPa >> inTemp = inTemp, degree_C >> outTemp = outTemp, degree_C >> inHumidity = inHumidity, percent >> outHumidity = outHumidity, percent >> windSpeed = windSpeed, km_per_hour >> windDir = windDir, degree_compass >> windGust = windGust, km_per_hour >> >> * rainRate = rainRate, mm_per_hour rain = rain, mm* >> dewpoint = dewpoint, degree_C >> windchill = windchill, degree_C >> radiation = radiation, watt_per_meter_squared >> UV = UV, uv_index >> extraTemp1 = extraTemp1, degree_C >> extraTemp2 = extraTemp2, degree_C >> extraTemp3 = extraTemp3, degree_C >> extraTemp4 = extraTemp4, degree_C >> extraTemp6 = extraTemp6, degree_C >> extraHumid1 = extraHumid1, percent >> extraHumid2 = extraHumid2, percent >> extraHumid3 = extraHumid3, percent >> extraHumid4 = extraHumid4, percent >> >> >> >> *Response from WeeWX :* >> >> Using WeeWX configuration file /etc/weewx/weewx.conf >> Starting wee_import... >> A CSV import from source file '/home/pi/Documents/Bresser7in1/data5.csv' >> has been requested. >> The following options will be used: >> config=/etc/weewx/weewx.conf, >> import-config=/home/pi/Documents/Bresser7in1/csv-Bresser.conf >> source=/home/pi/Documents/Bresser7in1/data5.csv, from=None, to=None >> dry-run=True, calc_missing=True, ignore_invalid_data=True >> tranche=250, interval=conf, date/time_string_format=%Y-%m-%d %H:%M:%S >> delimiter=',', rain=cumulative, wind_direction=[0.0, 360.0] >> UV=True, radiation=True >> Using database binding 'wx_binding', which is bound to database >> 'weewx.sdb' >> Destination table 'archive' unit system is '0x01' (US). >> Missing derived observations will be calculated. >> This is a dry run, imported data will not be saved to archive. >> Starting dry run import ... >> Obtaining raw import data for period 1 ... >> The following imported field-to-WeeWX field map will be used: >> source field 'dateTime' in units 'unix_epoch' --> WeeWX field >> 'dateTime' >> source field 'barometer' in units 'hPa' --> WeeWX field 'barometer' >> source field 'inTemp' in units 'degree_C' --> WeeWX field 'inTemp' >> source field 'outTemp' in units 'degree_C' --> WeeWX field 'outTemp' >> source field 'inHumidity' in units 'percent' --> WeeWX field >> 'inHumidity' >> source field 'outHumidity' in units 'percent' --> WeeWX field >> 'outHumidity' >> source field 'windSpeed' in units 'km_per_hour' --> WeeWX field >> 'windSpeed' >> source field 'windDir' in units 'degree_compass' --> WeeWX field >> 'windDir' >> source field 'windGust' in units 'km_per_hour' --> WeeWX field >> 'windGust' >> >> * source field 'rainRate' in units 'mm_per_hour' --> WeeWX field >> 'rainRate' source field 'rain' in units 'mm' --> WeeWX field 'rain'* >> source field 'dewpoint' in units 'degree_C' --> WeeWX field >> 'dewpoint' >> source field 'windchill' in units 'degree_C' --> WeeWX field >> 'windchill' >> source field 'radiation' in units 'watt_per_meter_squared' --> WeeWX >> field 'radiation' >> source field 'UV' in units 'uv_index' --> WeeWX field 'UV' >> source field 'extraTemp1' in units 'degree_C' --> WeeWX field >> 'extraTemp1' >> source field 'extraTemp2' in units 'degree_C' --> WeeWX field >> 'extraTemp2' >> source field 'extraTemp3' in units 'degree_C' --> WeeWX field >> 'extraTemp3' >> source field 'extraTemp4' in units 'degree_C' --> WeeWX field >> 'extraTemp4' >> source field 'extraTemp6' in units 'degree_C' --> WeeWX field >> 'extraTemp6' >> source field 'extraHumid1' in units 'percent' --> WeeWX field >> 'extraHumid1' >> source field 'extraHumid2' in units 'percent' --> WeeWX field >> 'extraHumid2' >> source field 'extraHumid3' in units 'percent' --> WeeWX field >> 'extraHumid3' >> source field 'extraHumid4' in units 'percent' --> WeeWX field >> 'extraHumid4' >> Raw import data read successfully for period 1. >> Mapping raw import data for period 1 ... >> Mapped 1 records. >> Raw import data mapped successfully for period 1. >> 1 records identified for import. >> Unique records processed: 1; Last timestamp: 2023-08-26 16:55:00 CEST >> (1693061700) >> Finished dry run import >> 1 records were processed and 1 unique records would have been imported. >> >> >> >> >> *Everything seems to be correct.However, when I run the command without >> the --dry run option, ALL the fields are correctly entered in the weewx >> database except SYSTEMATIC "rain" and "rainRate" which always remain at 0!I >> don't understand why these two fields are never updated in weewx database. >> Here for example rain is at 6.9 (since 00H00) and in the database rain >> remains at 0 (option cumulative actived). Same thing for rainRate! And >> these are the only two fields that pose a problem!Is it a wee_import.py >> bug? Does anyone have a solution... Thanks a lot!* >> > -- You received this message because you are subscribed to the Google Groups "weewx-user" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/d9c66125-8258-4a7c-ad6a-400608914a8dn%40googlegroups.com.
