Thank you. I built a db from it and ran rebuild-daily and it worked just fine with no errors in 2.5 minutes. No errors running database check. No errors running database update.
Computer was a m1 mac mini with 16 GB of RAM. I wonder if you're running out of memory and need to split your rebuild-daily up into pieces with the --from and --to options. Just a guess. On Wednesday, December 25, 2024 at 1:56:50 PM UTC-8 mihec wrote: > This is the dump: https://we.tl/t-X3r6gbimBx > > sreda, 25. december 2024 ob 22:48:59 UTC+1 je oseba mihec napisala: > >> I replaced the original manager.py with attached one. That file is in the >> /usr/share/weewx/weewx/ directory. >> I will prepare the dump of the database. >> >> username@hostname:~$ sudo weectl database rebuild-daily >> >> Using configuration file /etc/weewx/weewx.conf >> All daily summaries will be rebuilt. >> Rebuild the daily summaries in the database 'weewx.sdb' (y/n)? y >> Rebuilding daily summaries in database 'weewx.sdb' ... >> Daily summaries at V2.0. Patching to V4.0 >> Traceback (most recent call last):0:00 CEST (1628719200) >> File "/usr/share/weewx/weedb/sqlite.py", line 38, in guarded_fn >> return fn(*args, **kwargs) >> File "/usr/share/weewx/weedb/sqlite.py", line 233, in execute >> return sqlite3.Cursor.execute(self, *args, **kwargs) >> sqlite3.OperationalError: no such column: inf >> >> During handling of the above exception, another exception occurred: >> >> Traceback (most recent call last): >> File "/usr/share/weewx/weectl.py", line 75, in <module> >> main() >> File "/usr/share/weewx/weectl.py", line 67, in main >> namespace.func(namespace) >> File "/usr/share/weewx/weectllib/__init__.py", line 90, in dispatch >> namespace.action_func(config_dict, namespace) >> File "/usr/share/weewx/weectllib/database_cmd.py", line 329, in >> rebuild_daily >> weectllib.database_actions.rebuild_daily(config_dict, >> File "/usr/share/weewx/weectllib/database_actions.py", line 134, in >> rebuild_daily >> with weewx.manager.open_manager(manager_dict, initialize=True) as dbm: >> File "/usr/share/weewx/weewx/manager.py", line 924, in open_manager >> return manager_cls.open_with_create(manager_dict['database_dict'], >> File "/usr/share/weewx/weewx/manager.py", line 244, in open_with_create >> dbmanager = cls(connection, table_name=table_name, schema=schema) >> File "/usr/share/weewx/weewx/manager.py", line 1076, in __init__ >> self.patch_sums() >> File "/usr/share/weewx/weewx/manager.py", line 1537, in patch_sums >> >> self.recalculate_weights(start_d=datetime.date(2020, 6, 1)) >> File "/usr/share/weewx/weewx/manager.py", line 1451, in >> recalculate_weights >> self._do_tranche(mark_d, end_of_tranche_d, weight_fn, progress_fn) >> File "/usr/share/weewx/weewx/manager.py", line 1490, in _do_tranche >> self._set_day_sums(day_accum, cursor) >> File "/usr/share/weewx/weewx/manager.py", line 1516, in _set_day_sums >> >> cursor.execute(update_sql, (day_accum.timespan.start,)) >> File "/usr/share/weewx/weedb/sqlite.py", line 50, in guarded_fn >> raise weedb.NoColumnError(e) >> weedb.NoColumnError: no such column: inf >> >> >> sreda, 25. december 2024 ob 21:13:17 UTC+1 je oseba Tom Keffer napisala: >> >>> Thanks. That tells me what I needed to know to create a useful >>> instrumented version of manager.py. Replace the one you have with the >>> attached version. It will give more information about exactly what created >>> the error. Post the log. >>> >>> -tk >>> >>> On Wed, Dec 25, 2024 at 9:29 AM mihec <[email protected]> wrote: >>> >>>> Hi, first I want to wish you Merry Christmas and Happy Holidays! >>>> >>>> This is the output of the "weectl database rebuild-daily". Please note >>>> that I've copied the weewx.sdb database file to a desktop PC to make it >>>> run >>>> much faster. I've replaced the real username and hostname with something >>>> generic. The weewx's version is same as in RPi. >>>> >>>> When executed, the 'rebuild' process starts around June 2020 and goes >>>> on normally until it fails on August 12, 2021 (epoch 1628719200). In >>>> the output below, you only see the status when it fails already. I can >>>> provide with a screenshot if that helps. >>>> The thing is that any command on the database (update, check or >>>> rebuild) fails on the same date (record?). >>>> >>>> username@host:~$ ls -la weewx.sdb >>>> -rwxrwxr-x 1 username username 682086400 dec 25 18:18 weewx.sdb >>>> username@host:~$ weewxd -v >>>> 5.1.0 >>>> username@host:~$ weectl -v >>>> weectl 5.1.0 >>>> username@host:~$ sudo weectl database rebuild-daily >>>> [sudo] password for username: >>>> Using configuration file /etc/weewx/weewx.conf >>>> All daily summaries will be rebuilt. >>>> Rebuild the daily summaries in the database 'weewx.sdb' (y/n)? y >>>> Rebuilding daily summaries in database 'weewx.sdb' ... >>>> Daily summaries at V2.0. Patching to V4.0 >>>> Traceback (most recent call last):0:00 CEST (1628719200) >>>> File "/usr/share/weewx/weedb/sqlite.py", line 38, in guarded_fn >>>> return fn(*args, **kwargs) >>>> File "/usr/share/weewx/weedb/sqlite.py", line 233, in execute >>>> return sqlite3.Cursor.execute(self, *args, **kwargs) >>>> sqlite3.OperationalError: no such column: inf >>>> >>>> During handling of the above exception, another exception occurred: >>>> >>>> Traceback (most recent call last): >>>> File "/usr/share/weewx/weectl.py", line 75, in <module> >>>> main() >>>> File "/usr/share/weewx/weectl.py", line 67, in main >>>> namespace.func(namespace) >>>> File "/usr/share/weewx/weectllib/__init__.py", line 90, in dispatch >>>> namespace.action_func(config_dict, namespace) >>>> File "/usr/share/weewx/weectllib/database_cmd.py", line 329, in >>>> rebuild_daily >>>> weectllib.database_actions.rebuild_daily(config_dict, >>>> File "/usr/share/weewx/weectllib/database_actions.py", line 134, in >>>> rebuild_daily >>>> with weewx.manager.open_manager(manager_dict, initialize=True) as >>>> dbm: >>>> File "/usr/share/weewx/weewx/manager.py", line 924, in open_manager >>>> return manager_cls.open_with_create(manager_dict['database_dict'], >>>> File "/usr/share/weewx/weewx/manager.py", line 244, in >>>> open_with_create >>>> dbmanager = cls(connection, table_name=table_name, schema=schema) >>>> File "/usr/share/weewx/weewx/manager.py", line 1076, in __init__ >>>> self.patch_sums() >>>> File "/usr/share/weewx/weewx/manager.py", line 1531, in patch_sums >>>> self.recalculate_weights(start_d=datetime.date(2020, 6, 1)) >>>> File "/usr/share/weewx/weewx/manager.py", line 1451, in >>>> recalculate_weights >>>> self._do_tranche(mark_d, end_of_tranche_d, weight_fn, progress_fn) >>>> File "/usr/share/weewx/weewx/manager.py", line 1490, in _do_tranche >>>> self._set_day_sums(day_accum, cursor) >>>> File "/usr/share/weewx/weewx/manager.py", line 1515, in _set_day_sums >>>> cursor.execute(update_sql, (day_accum.timespan.start,)) >>>> File "/usr/share/weewx/weedb/sqlite.py", line 50, in guarded_fn >>>> raise weedb.NoColumnError(e) >>>> weedb.NoColumnError: no such column: inf >>>> username@host:~$ >>>> >>>> torek, 24. december 2024 ob 15:15:16 UTC+1 je oseba Tom Keffer napisala: >>>> >>>>> Let's put aside the database update and just focus on rebuilding the >>>>> daily summaries. >>>>> >>>>> Could you please include the stack trace when doing "weectl database >>>>> rebuild-daily"? Once I see where it fails, I can send you an instrumented >>>>> version of the database code so we can see exactly what is happening. >>>>> >>>>> -tk >>>>> >>>>> On Tue, Dec 24, 2024 at 3:39 AM mihec <[email protected]> wrote: >>>>> >>>>>> Well, I've checked also the weectl database check which fails at the >>>>>> same point as the update. >>>>>> >>>>>> >>>>>> torek, 24. december 2024 ob 12:31:36 UTC+1 je oseba Auchtermuchty >>>>>> Weather napisala: >>>>>> >>>>>>> That's not what it does now. >>>>>>> >>>>>>> " Databases created earlier than 3.7.0 (released 11-March-2017) >>>>>>> have a flaw that prevents them from being used with archive intervals >>>>>>> that >>>>>>> change with time. This utility check whether your database is affected." >>>>>>> >>>>>>> $ weectl database check >>>>>>> Using configuration file /etc/weewx/weewx.conf >>>>>>> Checking daily summary tables version... >>>>>>> Daily summary tables are at version 4.0. >>>>>>> Interval Weighting Fix is not required. >>>>>>> $ >>>>>>> >>>>>>> On Tuesday, 24 December 2024 at 11:13:48 UTC Graham Eddy wrote: >>>>>>> >>>>>>>> weewx used to include a tool for picking up things like a string >>>>>>>> where a number should be. maybe `weectl database check’ still does this >>>>>>>> *⊣GE⊢* >>>>>>>> >>>>>>>> On 24 Dec 2024, at 4:17 pm, mihec <[email protected]> wrote: >>>>>>>> >>>>>>>> I think there must be an invalid entry in my database (Aug 12, >>>>>>>> 2021). My SQLite database management knowledge is basically zero, so >>>>>>>> I'm >>>>>>>> looking for advice >>>>>>>> >>>>>>>> >>>>>>>> -- >>>>>> You received this message because you are subscribed to the Google >>>>>> Groups "weewx-user" group. >>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>> send an email to [email protected]. >>>>>> >>>>> To view this discussion visit >>>>>> https://groups.google.com/d/msgid/weewx-user/e60483cc-3910-45f8-aff4-7b4e95939cd9n%40googlegroups.com >>>>>> >>>>>> <https://groups.google.com/d/msgid/weewx-user/e60483cc-3910-45f8-aff4-7b4e95939cd9n%40googlegroups.com?utm_medium=email&utm_source=footer> >>>>>> . >>>>>> >>>>> -- >>>> You received this message because you are subscribed to the Google >>>> Groups "weewx-user" group. >>>> To unsubscribe from this group and stop receiving emails from it, send >>>> an email to [email protected]. >>>> >>> To view this discussion visit >>>> https://groups.google.com/d/msgid/weewx-user/e92cf44c-d06f-4de1-ba04-440bceed755fn%40googlegroups.com >>>> >>>> <https://groups.google.com/d/msgid/weewx-user/e92cf44c-d06f-4de1-ba04-440bceed755fn%40googlegroups.com?utm_medium=email&utm_source=footer> >>>> . >>>> >>> -- You received this message because you are subscribed to the Google Groups "weewx-user" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion visit https://groups.google.com/d/msgid/weewx-user/124fd290-b296-4c56-a4d4-43e7b30ae2d7n%40googlegroups.com.
