Re: [weewx-user] 'wee_database --calc-missing' long to execute

This is a year of data. It works much better if you process it in small chunks. *I think this is a bug. * I changed the schema so it was necessary to add --rebuild-daily first. The following script behaves radically differently depending on the step size (+4 is good). If the step size is too

Re: [weewx-user] 'wee_database --calc-missing' long to execute

I am having the same problem. I have about 130,000 different datetimes (records) in weewx.sdb. I also tried moving it to a ramdisk. Still extremely slow. Any help please? Should I run calc-missing on individual timeslices like one week periods? The data covers one year of measurements.

Re: [weewx-user] wee_database --update Error

> Replace /usr/share/weewx/weecfg/database.py with this version. it works without any error. thanks > On Sun, Dec 25, 2022 at 9:44 AM Joachim Puttkammer > wrote: > >> Raspi4, Debian Buster, weewx 4.9.1, two instancen >> Hello, >> the command ended with an error: >> >> sudo wee_database

Re: [weewx-user] wee_database --update Error

My fault. The signature of archiveDaySpan() changed and I forgot to fix weecfg/database.py so it uses the new signature. Replace /usr/share/weewx/weecfg/database.py with this version . On Sun, Dec 25, 2022 at 9:44 AM

[weewx-user] wee_database --update Error

Raspi4, Debian Buster, weewx 4.9.1, two instancen Hello, the command ended with an error: sudo wee_database --config=/etc/weewx/dav.conf --update --dry-run Using configuration file /etc/weewx/dav.conf Using database binding 'wx_binding', which is bound to database 'archive_sqlite' Preparing

Re: [weewx-user] wee_database

On 08/11/2022 12:45, Tom Keffer wrote: Don't know why you'd have to edit weewx.conf, but that looks reasonable. On Tue, Nov 8, 2022 at 4:33 AM Mark Fraser > wrote: On 08/11/2022 12:30, Tom Keffer wrote: > For any mutating change you should not only stop

Re: [weewx-user] wee_database

Don't know why you'd have to edit weewx.conf, but that looks reasonable. On Tue, Nov 8, 2022 at 4:33 AM Mark Fraser wrote: > On 08/11/2022 12:30, Tom Keffer wrote: > > For any mutating change you should not only stop weewx, but backup the > > database. > > > > On Tue, Nov 8, 2022 at 1:24 AM

Re: [weewx-user] wee_database

On 08/11/2022 12:30, Tom Keffer wrote: For any mutating change you should not only stop weewx, but backup the database. On Tue, Nov 8, 2022 at 1:24 AM Mark Fraser > wrote: I'm planning on renaming 2 columns in my weewx database using wee_database

Re: [weewx-user] wee_database

For any mutating change you should not only stop weewx, but backup the database. On Tue, Nov 8, 2022 at 1:24 AM Mark Fraser wrote: > I'm planning on renaming 2 columns in my weewx database using > wee_database --rename-column --to-name. > > Before I do this is it recommended that I stop weewx

[weewx-user] wee_database

I'm planning on renaming 2 columns in my weewx database using wee_database --rename-column --to-name. Before I do this is it recommended that I stop weewx first? -- You received this message because you are subscribed to the Google Groups "weewx-user" group. To unsubscribe from this group and

Re: [weewx-user] 'wee_database --calc-missing' long to execute

i reduced the --calc-missing time from 7 *hours* to 7 *minutes* by such a simple trick that i kick myself for not seeing it earlier - i moved the database to ramdisk and symlinked it under archive, ran wee_database, then moved the database back. chalk this one under 'handy tips' On Thursday,

Re: [weewx-user] 'wee_database --calc-missing' long to execute

for gw1000 dataset, i had been using top and iotop previously to ascertain that cpu, memory and i/o usage were extremely low, and ps-efl showed it was spending its time waiting on interrupt. i would usually just conclude it was slow disk and spending all its time waiting on i/o completion

Re: [weewx-user] 'wee_database --calc-missing' long to execute

Well I'd still try either splitting it up into pieces, or running it and measuring its resource usage in another shell. If it's not out of ram and you're not pegging the CPU than waiting for i/o is the only thing left I'd guess. Run htop or the like to see. On Tuesday, March 8, 2022 at

Re: [weewx-user] 'wee_database --calc-missing' long to execute

it’s an 8MB RPi 4B and RAM is abundant, though using μSD card for filesys. the interesting thing is that there are two datasets, one large and one small, and the large one is quick but the small one is orders of magnitude slower. the larger dataset (vp2-originated) gobbles >95% cpu but the

[weewx-user] 'wee_database --calc-missing' long to execute

presently my vp2 and gw1000 data are merged in one database, and i am splitting them. i took the weewx.sdb and placed it in new weewx 4.7.0 environment. i ran weewx a couple of times configured to create empty vp2.sdb and gw1000.sdb (with vp2.conf and gw1000.conf respectively pointing to their

[weewx-user] wee_database transfer - out of memory

I am trying to convert my MYSQL DB to SQLite on my RaspberryPi with the wee_database --transfer command. The dry run was just fine, but when running in real the process fails after some time with a Out of Memory exception. >From 572643 records only 10034 were transferred. I guess the memory of

Re: [weewx-user] wee_database sdb --create success but --check fails

i also get ./bin/wee_database --update Using configuration file /usr/local/share/weewx/weewx.conf Using database binding 'wx_binding', which is bound to database 'archive_sqlite' The update process does not affect archive data, but does alter the database. Continue (y/n)? y Preparing Interval

Re: [weewx-user] wee_database sdb --create success but --check fails

Not exactly a big problem, but fixed in commit 0f67337 . On Thu, Jan 21, 2021 at 12:53 PM John Kline wrote: > Tom, the lines starting at line number 846 in wee_database need to be > skipped if records == 0. Not

Re: [weewx-user] wee_database sdb --create success but --check fails

Tom, the lines starting at line number 846 in wee_database need to be skipped if records == 0. Not sure how you want to do that and whether you want a summary that says “no records in database”. It will be easier for you to fix than to go back and forth with a PR. > On Jan 21, 2021, at 12:42

Re: [weewx-user] wee_database sdb --create success but --check fails

I had a look. This does not mean the database is bad. The code needs a small fix as it’s using a variable that isn’t set if there are no records in the database. > On Jan 21, 2021, at 12:37 PM, S R wrote: > >  > if i run wee_database -- check on the sdb that was installed during the >

[weewx-user] wee_database sdb --create success but --check fails

if i run wee_database -- check on the sdb that was installed during the installed, it passes. if i rename the original sdb and then run wee_database --create, the file creates without error, but if i then immediately run the --check i get the below error sudo wee_database --check Using

Re: [weewx-user] wee_database: ImportError

For some reason, the Python MySQL client library has not been installed. Try this: sudo apt-get install mysql-client sudo apt-get install python-mysqldb -tk On Tue, Feb 25, 2020 at 6:11 AM Eric Gammeter wrote: > > Goal: > Wanting to switch from sqlite to MySql database. > > I am consulting

[weewx-user] wee_database: ImportError

Goal: Wanting to switch from sqlite to MySql database. I am consulting the github /weewx/wiki "Usingwee_database". The --dry-run doesn't show any error. pi@raspberrypi:~ $ wee_database --transfer --dest-binding=dest_binding --dry-run Using configuration file /etc/weewx/weewx.conf Using

[weewx-user] wee_database --check-strings give clean report but database has NULL values

Hi, I am using mqysql as my weewx database. I run the wee_database --check-strings and it comes back clean but if I run mysql command to look for NULL I get a lot of results. Anyone know why this would be the case? Thanks wee_database --check-strings Using configuration file

[weewx-user] wee_database backfill only a range of dates

I am looking for a way to backfill a range of dates into my summary tables. When I look at the weewx website, the documentation states that you can do this with wee_database but it seems that the latest version of the utility only allows for a backfill where data is not present already in the

Re: [weewx-user] wee_database --update fail

Daily summaries without corresponding archive records is definitely an undefined situation, so wee_database probably did the right thing by raising an exception. But, I'd like to know how it came to be. Did you (Eelco) delete some rows in the archive database? -tk On Fri, Mar 17, 2017 at 2:27

[weewx-user] wee_database --update fail

Hi, Put simply --update will weight a number of daily summary fields according to the interval used in the archive. Judging by the error trace provided you appear to have daily summary records for days that have no records in your archive. I think you have 2 options: - The quick fix is to run

[weewx-user] wee_database --update fail

After upgrading to 3.7.0 I tried to update the database becuase of the max_wind issues. Running wee_database --update results in. Using configuration file /etc/weewx/weewx.conf Using database binding 'wx_binding', which is bound to database 'archive_sqlite' The update process does not affect

[weewx-user] wee_database --drop-daily followed by --backfill-daily producing "Unit system mismatch"

G'day, Was following the instructions to clean up a bad rain reading from https://github.com/weewx/weewx/wiki/Cleaning-up-old-'bad'-data But, when I execute the --backfill-daily option I am getting a "Unit system mismatch" error. $ wee_database --drop-daily Using configuration file