I was thinking the same. On Wed, Dec 25, 2024 at 2:10 PM vince <[email protected]> wrote:
> Thank you. I built a db from it and ran rebuild-daily and it worked just > fine with no errors in 2.5 minutes. No errors running database check. No > errors running database update. > > Computer was a m1 mac mini with 16 GB of RAM. I wonder if you're running > out of memory and need to split your rebuild-daily up into pieces with the > --from and --to options. Just a guess. > > > On Wednesday, December 25, 2024 at 1:56:50 PM UTC-8 mihec wrote: > >> This is the dump: https://we.tl/t-X3r6gbimBx >> >> sreda, 25. december 2024 ob 22:48:59 UTC+1 je oseba mihec napisala: >> >>> I replaced the original manager.py with attached one. That file is in >>> the /usr/share/weewx/weewx/ directory. >>> I will prepare the dump of the database. >>> >>> username@hostname:~$ sudo weectl database rebuild-daily >>> >>> Using configuration file /etc/weewx/weewx.conf >>> All daily summaries will be rebuilt. >>> Rebuild the daily summaries in the database 'weewx.sdb' (y/n)? y >>> Rebuilding daily summaries in database 'weewx.sdb' ... >>> Daily summaries at V2.0. Patching to V4.0 >>> Traceback (most recent call last):0:00 CEST (1628719200) >>> File "/usr/share/weewx/weedb/sqlite.py", line 38, in guarded_fn >>> return fn(*args, **kwargs) >>> File "/usr/share/weewx/weedb/sqlite.py", line 233, in execute >>> return sqlite3.Cursor.execute(self, *args, **kwargs) >>> sqlite3.OperationalError: no such column: inf >>> >>> During handling of the above exception, another exception occurred: >>> >>> Traceback (most recent call last): >>> File "/usr/share/weewx/weectl.py", line 75, in <module> >>> main() >>> File "/usr/share/weewx/weectl.py", line 67, in main >>> namespace.func(namespace) >>> File "/usr/share/weewx/weectllib/__init__.py", line 90, in dispatch >>> namespace.action_func(config_dict, namespace) >>> File "/usr/share/weewx/weectllib/database_cmd.py", line 329, in >>> rebuild_daily >>> weectllib.database_actions.rebuild_daily(config_dict, >>> File "/usr/share/weewx/weectllib/database_actions.py", line 134, in >>> rebuild_daily >>> with weewx.manager.open_manager(manager_dict, initialize=True) as >>> dbm: >>> File "/usr/share/weewx/weewx/manager.py", line 924, in open_manager >>> return manager_cls.open_with_create(manager_dict['database_dict'], >>> File "/usr/share/weewx/weewx/manager.py", line 244, in open_with_create >>> dbmanager = cls(connection, table_name=table_name, schema=schema) >>> File "/usr/share/weewx/weewx/manager.py", line 1076, in __init__ >>> self.patch_sums() >>> File "/usr/share/weewx/weewx/manager.py", line 1537, in patch_sums >>> >>> self.recalculate_weights(start_d=datetime.date(2020, 6, 1)) >>> File "/usr/share/weewx/weewx/manager.py", line 1451, in >>> recalculate_weights >>> self._do_tranche(mark_d, end_of_tranche_d, weight_fn, progress_fn) >>> File "/usr/share/weewx/weewx/manager.py", line 1490, in _do_tranche >>> self._set_day_sums(day_accum, cursor) >>> File "/usr/share/weewx/weewx/manager.py", line 1516, in _set_day_sums >>> >>> cursor.execute(update_sql, (day_accum.timespan.start,)) >>> File "/usr/share/weewx/weedb/sqlite.py", line 50, in guarded_fn >>> raise weedb.NoColumnError(e) >>> weedb.NoColumnError: no such column: inf >>> >>> >>> sreda, 25. december 2024 ob 21:13:17 UTC+1 je oseba Tom Keffer napisala: >>> >>>> Thanks. That tells me what I needed to know to create a useful >>>> instrumented version of manager.py. Replace the one you have with the >>>> attached version. It will give more information about exactly what created >>>> the error. Post the log. >>>> >>>> -tk >>>> >>>> On Wed, Dec 25, 2024 at 9:29 AM mihec <[email protected]> wrote: >>>> >>>>> Hi, first I want to wish you Merry Christmas and Happy Holidays! >>>>> >>>>> This is the output of the "weectl database rebuild-daily". Please note >>>>> that I've copied the weewx.sdb database file to a desktop PC to make it >>>>> run >>>>> much faster. I've replaced the real username and hostname with something >>>>> generic. The weewx's version is same as in RPi. >>>>> >>>>> When executed, the 'rebuild' process starts around June 2020 and goes >>>>> on normally until it fails on August 12, 2021 (epoch 1628719200). In >>>>> the output below, you only see the status when it fails already. I can >>>>> provide with a screenshot if that helps. >>>>> The thing is that any command on the database (update, check or >>>>> rebuild) fails on the same date (record?). >>>>> >>>>> username@host:~$ ls -la weewx.sdb >>>>> -rwxrwxr-x 1 username username 682086400 dec 25 18:18 weewx.sdb >>>>> username@host:~$ weewxd -v >>>>> 5.1.0 >>>>> username@host:~$ weectl -v >>>>> weectl 5.1.0 >>>>> username@host:~$ sudo weectl database rebuild-daily >>>>> [sudo] password for username: >>>>> Using configuration file /etc/weewx/weewx.conf >>>>> All daily summaries will be rebuilt. >>>>> Rebuild the daily summaries in the database 'weewx.sdb' (y/n)? y >>>>> Rebuilding daily summaries in database 'weewx.sdb' ... >>>>> Daily summaries at V2.0. Patching to V4.0 >>>>> Traceback (most recent call last):0:00 CEST (1628719200) >>>>> File "/usr/share/weewx/weedb/sqlite.py", line 38, in guarded_fn >>>>> return fn(*args, **kwargs) >>>>> File "/usr/share/weewx/weedb/sqlite.py", line 233, in execute >>>>> return sqlite3.Cursor.execute(self, *args, **kwargs) >>>>> sqlite3.OperationalError: no such column: inf >>>>> >>>>> During handling of the above exception, another exception occurred: >>>>> >>>>> Traceback (most recent call last): >>>>> File "/usr/share/weewx/weectl.py", line 75, in <module> >>>>> main() >>>>> File "/usr/share/weewx/weectl.py", line 67, in main >>>>> namespace.func(namespace) >>>>> File "/usr/share/weewx/weectllib/__init__.py", line 90, in dispatch >>>>> namespace.action_func(config_dict, namespace) >>>>> File "/usr/share/weewx/weectllib/database_cmd.py", line 329, in >>>>> rebuild_daily >>>>> weectllib.database_actions.rebuild_daily(config_dict, >>>>> File "/usr/share/weewx/weectllib/database_actions.py", line 134, in >>>>> rebuild_daily >>>>> with weewx.manager.open_manager(manager_dict, initialize=True) as >>>>> dbm: >>>>> File "/usr/share/weewx/weewx/manager.py", line 924, in open_manager >>>>> return manager_cls.open_with_create(manager_dict['database_dict'], >>>>> File "/usr/share/weewx/weewx/manager.py", line 244, in >>>>> open_with_create >>>>> dbmanager = cls(connection, table_name=table_name, schema=schema) >>>>> File "/usr/share/weewx/weewx/manager.py", line 1076, in __init__ >>>>> self.patch_sums() >>>>> File "/usr/share/weewx/weewx/manager.py", line 1531, in patch_sums >>>>> self.recalculate_weights(start_d=datetime.date(2020, 6, 1)) >>>>> File "/usr/share/weewx/weewx/manager.py", line 1451, in >>>>> recalculate_weights >>>>> self._do_tranche(mark_d, end_of_tranche_d, weight_fn, progress_fn) >>>>> File "/usr/share/weewx/weewx/manager.py", line 1490, in _do_tranche >>>>> self._set_day_sums(day_accum, cursor) >>>>> File "/usr/share/weewx/weewx/manager.py", line 1515, in _set_day_sums >>>>> cursor.execute(update_sql, (day_accum.timespan.start,)) >>>>> File "/usr/share/weewx/weedb/sqlite.py", line 50, in guarded_fn >>>>> raise weedb.NoColumnError(e) >>>>> weedb.NoColumnError: no such column: inf >>>>> username@host:~$ >>>>> >>>>> torek, 24. december 2024 ob 15:15:16 UTC+1 je oseba Tom Keffer >>>>> napisala: >>>>> >>>>>> Let's put aside the database update and just focus on rebuilding the >>>>>> daily summaries. >>>>>> >>>>>> Could you please include the stack trace when doing "weectl database >>>>>> rebuild-daily"? Once I see where it fails, I can send you an instrumented >>>>>> version of the database code so we can see exactly what is happening. >>>>>> >>>>>> -tk >>>>>> >>>>>> On Tue, Dec 24, 2024 at 3:39 AM mihec <[email protected]> wrote: >>>>>> >>>>>>> Well, I've checked also the weectl database check which fails at >>>>>>> the same point as the update. >>>>>>> >>>>>>> >>>>>>> torek, 24. december 2024 ob 12:31:36 UTC+1 je oseba Auchtermuchty >>>>>>> Weather napisala: >>>>>>> >>>>>>>> That's not what it does now. >>>>>>>> >>>>>>>> " Databases created earlier than 3.7.0 (released 11-March-2017) >>>>>>>> have a flaw that prevents them from being used with archive intervals >>>>>>>> that >>>>>>>> change with time. This utility check whether your database is >>>>>>>> affected." >>>>>>>> >>>>>>>> $ weectl database check >>>>>>>> Using configuration file /etc/weewx/weewx.conf >>>>>>>> Checking daily summary tables version... >>>>>>>> Daily summary tables are at version 4.0. >>>>>>>> Interval Weighting Fix is not required. >>>>>>>> $ >>>>>>>> >>>>>>>> On Tuesday, 24 December 2024 at 11:13:48 UTC Graham Eddy wrote: >>>>>>>> >>>>>>>>> weewx used to include a tool for picking up things like a string >>>>>>>>> where a number should be. maybe `weectl database check’ still does >>>>>>>>> this >>>>>>>>> *⊣GE⊢* >>>>>>>>> >>>>>>>>> On 24 Dec 2024, at 4:17 pm, mihec <[email protected]> wrote: >>>>>>>>> >>>>>>>>> I think there must be an invalid entry in my database (Aug 12, >>>>>>>>> 2021). My SQLite database management knowledge is basically zero, so >>>>>>>>> I'm >>>>>>>>> looking for advice >>>>>>>>> >>>>>>>>> >>>>>>>>> -- >>>>>>> You received this message because you are subscribed to the Google >>>>>>> Groups "weewx-user" group. >>>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>>> send an email to [email protected]. >>>>>>> >>>>>> To view this discussion visit >>>>>>> https://groups.google.com/d/msgid/weewx-user/e60483cc-3910-45f8-aff4-7b4e95939cd9n%40googlegroups.com >>>>>>> <https://groups.google.com/d/msgid/weewx-user/e60483cc-3910-45f8-aff4-7b4e95939cd9n%40googlegroups.com?utm_medium=email&utm_source=footer> >>>>>>> . >>>>>>> >>>>>> -- >>>>> You received this message because you are subscribed to the Google >>>>> Groups "weewx-user" group. >>>>> To unsubscribe from this group and stop receiving emails from it, send >>>>> an email to [email protected]. >>>>> >>>> To view this discussion visit >>>>> https://groups.google.com/d/msgid/weewx-user/e92cf44c-d06f-4de1-ba04-440bceed755fn%40googlegroups.com >>>>> <https://groups.google.com/d/msgid/weewx-user/e92cf44c-d06f-4de1-ba04-440bceed755fn%40googlegroups.com?utm_medium=email&utm_source=footer> >>>>> . >>>>> >>>> -- > You received this message because you are subscribed to the Google Groups > "weewx-user" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To view this discussion visit > https://groups.google.com/d/msgid/weewx-user/124fd290-b296-4c56-a4d4-43e7b30ae2d7n%40googlegroups.com > <https://groups.google.com/d/msgid/weewx-user/124fd290-b296-4c56-a4d4-43e7b30ae2d7n%40googlegroups.com?utm_medium=email&utm_source=footer> > . > -- You received this message because you are subscribed to the Google Groups "weewx-user" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion visit https://groups.google.com/d/msgid/weewx-user/CAPq0zEASZ8Nf5RNAY%3Dk-Vx3_5MjpqiZM9g%2BshKKqu9rV8zdD%3Dg%40mail.gmail.com.
