On Sunday, 22 March 2020 09:55:13 UTC-3, Lucas Heijst wrote:
>
> Tom,
>
> After an upgrade of mariadb10 my databases got corrupted. My most recent 
> backup was a year old, so I'm missing a year of data. :-(
> I use weewx utility wee_import of weewx version 4.0.0b16 to receive the 
> missing data from wu, but the calc_missing seems not to work (or I do 
> something wrong!).
>
> 1. file ../util/import/wu-example.conf describes a command line parameter "
> --calc-missing" which is not recognized by program wee_util.
>
> 2. My wu.conf file is listed below. Parameter "calc_missing" is set to 
> True, but none of these fields are calculated:
>     #   altimeter
>     #   ET
>     #   pressure
>     #   appTemp
>     #   cloudbase
>     #   humidex
>     #   maxSolarRad
>     #   windrun
>
> My command line at /home/weewx is:
> ./bin/wee_import --import-config=wu.conf --config=weewx_wund.conf 
> --from=2019-02-04 --to=2020-03-04
>
> Attached the first 10 exported records of the from WU imported data
>
> Luc
>
> ====
> # EXAMPLE CONFIGURATION FILE FOR IMPORTING FROM THE WEATHER UNDERGROUND
> #
> # Copyright (c) 2009-2019 Tom Keffer <[email protected]> and Gary 
> Roderick.
> # See the file LICENSE.txt for your rights.
>
>
> ##############################################################################
>
> # Specify our source. Available options are:
> #   CSV - import obs from a single CSV format file
> #   WU - import obs from a Weather Underground PWS history
> #   Cumulus - import obs from a one or more Cumulus monthly log files
> #   WD - import obs from a one or more WD monthly log files
> # Format is:
> #   source = (CSV | WU | Cumulus)
> source = WU
>
>
> ##############################################################################
>
> [WU]
>     # Parameters used when importing from a WU PWS
>
>     # WU PWS Station ID to be used for import.
>     station_id = lucs_stationid
>
>     # WU API key to be used for import.
>     api_key = lucs_apikey
>
>     #
>     # When importing WU data the following WeeWX database fields will be
>     # populated directly by the imported data (provided the corresponding 
> data
>     # exists on WU):
>     #   barometer
>     #   dateTime
>     #   dewpoint
>     #   heatindex
>     #   outHumidity
>     #   outTemp
>     #   radiation
>     #   rain
>     #   rainRate
>     #   windchill
>     #   windDir
>     #   windGust
>     #   windSpeed
>     #   UV
>     #
>     # The following WeeWX database fields will be populated from other
>     # settings/config files:
>     #   interval
>     #   usUnits
>     #
>     # The following WeeWX database fields will be populated with values 
> derived
>     # from the imported data provided the --calc-missing command line 
> option is
>     # used during import:
>     #   altimeter
>     #   ET
>     #   pressure
>     #
>     # The following WeeWX fields will be populated with derived values 
> from the
>     # imported data provided the --calc-missing command line option is used
>     # during import. These fields will only be saved to the WeeWX database 
> if
>     # the WeeWX schema has been modified to accept them. Note that the 
> pyephem
>     # module is required in order to calculate maxSolarRad - refer WeeWX 
> Users
>     # Guide.
>     #   appTemp
>     #   cloudbase
>     #   humidex
>     #   maxSolarRad
>     #   windrun
>
>     # How will the interval field be determined for the imported records.
>     # Available options are:
>     #   derive - Derive the interval field from the timestamp of successive
>     #            records. This setting is best used when the imported 
> records
>     #            are equally spaced in time and there are no missing 
> records.
>     #   conf   - Use the interval setting from weewx.conf. This setting is
>     #            best used if the records to be imported have been 
> produced by
>     #            WeeWX using the same archive interval as set in 
> weewx.conf on
>     #            this machine.
>     #   x      - Use a fixed interval of x minutes for every record. This
>     #            setting is best used if the records to be imported are
>     #            equally based in time but there are some missing records.
>     #            This setting is recommended for WU imports.
>     # Due to WU frequently missing uploaded records, use of 'derive' may 
> give
>     # incorrect or inconsistent interval values. Better results may be
>     # achieved by using the 'conf' setting (if WeeWX has been doing the WU
>     # uploading and the WeeWX archive_interval matches the WU observation
>     # spacing in time) or setting the interval to a fixed value (eg 5). The
>     # most appropriate setting will depend on the completeness and (time)
>     # accuracy of the WU data being imported.
>     # Format is:
>     #   interval = (derive | conf | x)
>     interval = conf
>
>     # Should the [StdQC] max/min limits in weewx.conf be applied to the
>     # imported data. This may be useful if the source has extreme values 
> that
>     # are clearly incorrect for some observations. This is particulalrly 
> useful
>     # for WU imports where WU often records clearly erroneous values 
> against
>     # obs that are not reported. Available options are:
>     #   True  - weewx.conf [StdQC] max/min limits are applied.
>     #   False - weewx.conf [StdQC] max/min limits are not applied.
>     # Format is:
>     #   qc = (True | False)
>     qc = True
>
>     # Should any missing derived observations be calculated from the 
> imported
>     # data if possible. Available options are:
>     #   True  - Any missing derived observations are calculated.
>     #   False - Any missing derived observations are not calculated.
>     # Format is:
>     #   calc_missing = (True | False)
>     calc_missing = True
>
>     # Specify how imported data fields that contain invalid data (eg a 
> numeric
>     # field containing non-numeric data) are handled. Available options 
> are:
>     #   True  - The invalid data is ignored, the WeeWX target field is set 
> to
>     #           None and the import continues.
>     #   False - The import is halted.
>     # Format is:
>     #   ignore_invalid_data = (True | False)
>     # Default is True.
>     ignore_invalid_data = True
>
>     # Imported records are written to archive in transactions of tranche
>     # records at a time. Increase for faster throughput, decrease to reduce
>     # memory requirements. Format is:
>     #   tranche = x
>     # where x is an integer
>     tranche = 250
>
>     # Lower and upper bounds for imported wind direction. It is possible,
>     # particularly for a calculated direction, to have a value (eg -45) 
> outside
>     # of the WeeWX limits (0 to 360 inclusive). Format is:
>     #
>     # wind_direction = lower,upper
>     #
>     # where :
>     #   lower is the lower limit of acceptable wind direction in degrees
>     #   (may be negative)
>     #   upper is the upper limit of acceptable wind direction in degrees
>     #
>     # WU has at times been known to store large values (eg -9999) for wind
>     # direction, often no wind direction was uploaded to WU. The 
> wind_direction
>     # parameter sets a lower and upper bound for valid wind direction 
> values.
>     # Values inside these bounds are normalised to the range 0 to 360. 
> Values
>     # outside of the bounds will be stored as None. Default is 0,360
>     wind_direction = 0,360
> ====
>

-- 
You received this message because you are subscribed to the Google Groups 
"weewx-development" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
To view this discussion on the web visit 
https://groups.google.com/d/msgid/weewx-development/40fafbaf-584a-4f86-a17b-48263dba874e%40googlegroups.com.

Reply via email to