Hi Thomas, I started the data import as follows: wee_import --config=/home/weewx/weewx.conf --import-config=/home/weewx/NexusImport/csv.conf csv.conf ist attached
and here is the result of the query: MariaDB [weewx]> select count(dateTime) from archive where dateTime < 1527811200; +-----------------+ | count(dateTime) | +-----------------+ | 427392 | +-----------------+ 1 row in set (1.37 sec) MariaDB [weewx]> select count(dateTime) from archive_day_outTemp where dateTime < 1527811200; +-----------------+ | count(dateTime) | +-----------------+ | 1499 | +-----------------+ 1 row in set (0.00 sec) Thanks, Michael Am Samstag, 2. März 2019 16:57:09 UTC+1 schrieb Thomas Keffer: > > Do you recall how you did wee_import? Are you sure the missing data was > actually imported? > > We can check what is actually in your database, but, first, you will need > to locate it. If you used a package installer (apt-get), it will be in > /var/lib/weewx/weewx.sdb. If you used setup.py, it will be in > /home/weewx/archive/weewx.sdb. > > You may have to install the tool sqlite3: > > *sudo apt-get install sqlite3* > > Then using the tool (substitute the location of your database for > weewx.sdb): > > *sqlite3 weewx.sdb* > sqlite> *select count(dateTime) from archive where dateTime < 1527811200;* > sqlite> *select count(dateTime) from archive_day_outTemp where dateTime > < 1527811200;* > > This will tell us how many record are in your archive and daily summaries > before 1-June-2018 UTC. > > -tk > > > -- You received this message because you are subscribed to the Google Groups "weewx-user" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
# EXAMPLE CONFIGURATION FILE FOR IMPORTING FROM CSV FILES # # Copyright (c) 2009-2016 Tom Keffer <[email protected]> and Gary Roderick. # See the file LICENSE.txt for your rights. ############################################################################## # Specify the source. Available options are: # CSV - import obs from a single CSV format file # WU - import obs from a Weather Underground PWS history # Cumulus - import obs from a one or more Cumulus monthly log files # Format is: # source = (CSV | WU | Cumulus) source = CSV ############################################################################## [CSV] # Parameters used when importing from a CSV file # Path and name of our CSV source file. Format is: # file = full path and filename file = /home/weewx/NexusImport/NexusOrg-3.csv # If there is no mapped interval field how will the interval field be # determined for the imported records. Available options are: # derive - Derive the interval field from the timestamp of successive # records. This setting is best used when the imported records # are equally spaced in time and there are no missing records. # conf - Use the interval setting from weewx.conf. This setting is # best used if the records to be imported have been produced by # weeWX using the same archive interval as set in weewx.conf on # this machine. # x - Use a fixed interval of x minutes for every record. This # setting is best used if the records to be imported are # equally based in time but there are some missing records. # # Note: If there is a mapped interval field then this setting will be # ignored. # Format is: # interval = (derive | conf | x) interval = 5 # Should the [StdQC] max/min limits in weewx.conf be applied to the # imported data. This may be useful if the source has extreme values that # are clearly incorrect for some observations. Available options are: # True - weewx.conf [StdQC] max/min limits are applied. # False - weewx.conf [StdQC] max/min limits are not applied. # Format is: # qc = (True | False) qc = True # Should any missing derived observations be calculated from the imported # data if possible. Available options are: # True - Any missing derived observations are calculated. # False - Any missing derived observations are not calculated. # Format is: # calc_missing = (True | False) calc_missing = True # Imported records are written to archive in transactions of tranche # records at a time. Increase for faster throughput, decrease to reduce # memory requirements. Format is: # tranche = x # where x is an integer tranche = 250 # Specify whether a UV sensor was used to produce any UV observations. # Available options are: # True - UV sensor was used and UV data will be imported. # False - UV sensor was not used and any UV data will not be imported. # UV fields will be set to None/NULL. # For a CSV import UV_sensor should be set to False if a UV sensor was # NOT present when the import data was created. Otherwise it may be set to # True or omitted. Format is: # UV_sensor = (True | False) UV_sensor = False # Specify whether a solar radiation sensor was used to produce any solar # radiation observations. Available options are: # True - Solar radiation sensor was used and solar radiation data will # be imported. # False - Solar radiation sensor was not used and any solar radiation # data will not be imported. radiation fields will be set to # None/NULL. # For a CSV import solar_sensor should be set to False if a solar radiation # sensor was NOT present when the import data was created. Otherwise it may # be set to True or omitted. Format is: # solar_sensor = (True | False) solar_sensor = False # Date-time format of CSV field from which the weeWX archive record # dateTime field is to be extracted. wee_import first attempts to interpret # date/time info in this format, if this fails it then attempts to # interpret it as a timestamp and if this fails it then raises an error. # Uses Python strptime() format codes. # raw_datetime_format = Python strptime() format string # %Y-%m-%d %H:%M:%S raw_datetime_format = %d.%m.%Y %H:%M # Does the imported rain field represent the total rainfall since the last # record or a cumulative value. Available options are: # discrete - rain field represents total rainfall since last record # cumulative - rain field represents a cumulative rainfall reset at # midnight # rain = (discrete | cumulative) rain = cumulative # Lower and upper bounds for imported wind direction. It is possible, # particularly for a calculated direction, to have a value (eg -45) outside # of the weeWX limits (0 to 360 inclusive). Format is: # # wind_direction = lower,upper # # where : # lower is the lower limit of acceptable wind direction in degrees # (may be negative) # upper is the upper limit of acceptable wind direction in degrees # # Imported values from lower to upper will be normalised to the range 0 to # 360. Values outside of the parameter range will be stored as None. # Default is -360,360. wind_direction = -360,360 # Map CSV record fields to weeWX archive fields. Format is: # # weewx_archive_field_name = csv_field_name, weewx_unit_name # # where: # weewx_archive_field_name - An observation name in the weeWX database # schema. # csv_field_name - The name of a field from the CSV file. # weewx_unit_name - The name of the units, as defined in weeWX, # used by csv_field_name. wee_import will do # the necessary conversions to the unit system # used by the weeWX archive. # For example, # outTemp = Temp, degree_C # would map the CSV field Temp, in degrees C, to the archive field outTemp. # # If a field mapping exists for the weeWX usUnits archive field then the # units option may be omitted for each mapped field. # # weeWX archive fields that do not exist in the CSV data may be omitted. # Any omitted fields that are derived (eg dewpoint) may be calculated # during import using the equivalent of the weeWX StdWXCalculate service # through setting the calc-missing parameter above. [[FieldMap]] dateTime = DATE_TIME usUnits = interval = barometer = PRES_ABS, inHg pressure = PRES_LOC, inHg altimeter = inTemp = CHN0_DEG, degree_C outTemp = CHN1_DEG, degree_C inHumidity = CHN0_RF, percent outHumidity = CHN1_RF, percent extraTemp1 = CHN2_DEG, degree_C extraTemp2 = CHN3_DEG, degree_C extraHumid1 = CHN2_RF, percent extraHumid2 = CHN3_RF, percent windSpeed = windDir = windGust = windGustDir = rainRate = rain = dewpoint = windchill = heatindex = ET = radiation = UV =
