Hi Gary,
I'm going to start it all over again this weekend, when having time. I
organized all logdata from each year into a separate directory.
When importing it, I just edit the import path in the configfile and then
start wee_import with --import-config=myimportconfig.con --verbose, and the
Hi Peter,
Before you start it off again can you describe how you are doing the
import; ie time period per import, one big import, multiple smaller
periods? How is you data organised on disc, one large directory with all
file, year by year directories etc.
Gary
On Tuesday, 16 February 2021
Hi Gary,
today my Raspberry 4 arrived, which will hopefully be my long-running
weather computer.
I tried to import all my data on Pi3. It worked back for about 8 years, but
then the performance crashed into hell.
The import of one year took about 1 week and was getting worse.
Now I'm starting
Hi Peter,
On Tuesday, 2 February 2021 at 06:03:36 UTC+10 peter.su...@gmail.com wrote:
> Hey Gary,
> its looking perfect. I just separated the logs for each year and right now
> I am testing the 6th year in a row, doing a quick dry-run.
> The script is finding some duplicates, but it looks like
Hey Gary,
its looking perfect. I just separated the logs for each year and right now
I am testing the 6th year in a row, doing a quick dry-run.
The script is finding some duplicates, but it looks like every complete
year from 01/01 to 12/31 should be imported into the database.
One more
Thank you Gary.
This might be the error from my side. I just copied the whole bunch of logs
into my import directory.
I will make subdir for every year, then I am going to test again.
Maybe going backward from 2020 to 2005 might be a good idea to find out my
problems.
Version of my WeeWX is
Peter,
I ran wee_import under WeeWX v4.4.0/python3 using the import config file
and log files posted and the import processed without error:
gary@buster31:~$ /home/weewx/bin/wee_import
--import-config=/var/tmp/wd-import-test.conf --from=2020-12-01T00:00
--to=2020-12-31T23:59 --verbose
Using
Hi Gary,
thanks for your quick answer.
Please check the attached file. All I edited was the path to data and
filenames. I limited it to only one type of file, with my last change.
No, problem when it takes time.
Thanks for checking out
Peter
gjr80 schrieb am Sonntag, 31. Januar 2021 um
Hi,
Nothing leaps out at me having a quick look at the output and log files you
posted. I'll endeavour to have a look at this tomorrow (bit late here).
Could I ask you to post the import config file you are using,
/etc/weewx/wd-import-test.conf. There should be nothing sensitive in the
file.
