That's what looks like is going on. Your reports are stepping on each other and the database is locked.
You can either disable the highcharts portion by setting highcharts_enabled = 0 <https://github.com/poblabs/weewx-belchertown#general-options> in options or disable the skin all together. I'm going to be tinkering around with the chart generations this week. I'll keep you updated on anything that needs some testing On Monday, September 3, 2018 at 8:04:07 PM UTC-4, Philip Kutzenco wrote: > > Pat > > It actually may be running a bit better now, though the Belchertown web > page update time is behind my SteelSeries web page. And both are behind my > archive period. I'm not using mqtt at this point. Just want to get this > running. > > So maybe it's now just that report generation is extremely slow. I hope > there is a way to resolve that without buying a new box to run weewx on. > > It looks like it's taking about 575 seconds to generate the files for the > Belchertown report. I am also still seeing notes about report thread launch > being aborted as one is already running. My archive period is 300 seconds. > > > Best, > Phil > > On Monday, September 3, 2018 at 7:46:07 PM UTC-4, Philip Kutzenco wrote: > > Pat, > > I installed WeeWX with install.py. So everything lives underneath > /home/weewx/. > > I replaced the file in /Belchertown/records folder with the one you gave > me. Then I re-enabled the Belchertown skin in weewx.conf, restarted WeeWX > and ran wee_reports. Per the log extract below, after about 8 minutes, > weewx hung with the database locked. WeeWX automatically restarted 2 > minutes later. > > In between my efforts to run Belchertown, I've been disabling the > Belchertown extension by commenting out the three lines in weewx.conf > starting with [[Belchertown]] and then stopping and then starting weewx > again. I re-enable it to test the next change. > > I wonder if locking the file is also the cause of the complaints that > header.html.tmpl doesn't exist in earlier efforts. I noticed that a > report thread couldn't be started as one was already running. Maybe that > running report thread locked the file as it (or something) locked the > archive database? > > Also, it seems that typing sudo /etc/init.d/weewx stop doesn't always stop > weewx when Belchertown is running. Even though I return to the prompt, when > I looked at ps, WeeWX was still running. I ended up rebooting once and > Killing the PID the last time. > > Will the Belchertown report generation time decrease after the initial run > through the database? Or will it take the same time each report generation > cycle? > > Thoughts? I saw a note on disabling the charts to speed things up, but I'd > really hate to do that. > > Best, > Phil > > Sep 3 19:02:38 Weather-pi wee_reports[3281]: cheetahgenerator: Generated > 14 files for report StandardReport in 19.27 seconds > Sep 3 19:02:51 Weather-pi systemd[1]: Started Session c7 of user pi. > Sep 3 19:02:53 Weather-pi wee_reports[3281]: imagegenerator: Generated 24 > images for StandardReport in 14.84 seconds > Sep 3 19:02:53 Weather-pi wee_reports[3281]: copygenerator: copied 14 > files to /home/weewx/public_html > Sep 3 19:02:53 Weather-pi wee_reports[3281]: copygenerator: copied 6 > files to /home/weewx/public_html/ss > Sep 3 19:02:58 Weather-pi wee_reports[3281]: cheetahgenerator: Generated > 2 files for report SteelSeries in 4.53 seconds > Sep 3 19:03:01 Weather-pi wee_reports[3281]: imagegenerator: Generated 11 > images for SteelSeries in 3.43 seconds > Sep 3 19:03:16 Weather-pi wee_reports[3281]: cheetahgenerator: Generated > 12 files for report forecast in 14.73 seconds > Sep 3 19:03:16 Weather-pi wee_reports[3281]: copygenerator: copied 87 > files to /home/weewx/public_html/forecast > Sep 3 19:03:17 Weather-pi wee_reports[3281]: Belchertown Extension: > version 0.6 > Sep 3 19:05:15 Weather-pi weewx[3254]: manager: Added record 2018-09-03 > 19:05:00 EDT (1536015900) to database 'weewx.sdb' > Sep 3 19:05:15 Weather-pi weewx[3254]: manager: Added record 2018-09-03 > 19:05:00 EDT (1536015900) to daily summary in 'weewx.sdb' > Sep 3 19:05:56 Weather-pi weewx[3254]: cheetahgenerator: Generated 14 > files for report StandardReport in 39.86 seconds > Sep 3 19:06:03 Weather-pi weewx[3254]: imagegenerator: Generated 12 > images for StandardReport in 7.67 seconds > Sep 3 19:06:04 Weather-pi weewx[3254]: copygenerator: copied 14 files to > /home/weewx/public_html > Sep 3 19:06:04 Weather-pi weewx[3254]: copygenerator: copied 6 files to > /home/weewx/public_html/ss > Sep 3 19:06:12 Weather-pi weewx[3254]: cheetahgenerator: Generated 2 > files for report SteelSeries in 8.29 seconds > Sep 3 19:06:19 Weather-pi weewx[3254]: imagegenerator: Generated 11 > images for SteelSeries in 6.76 seconds > Sep 3 19:06:49 Weather-pi weewx[3254]: cheetahgenerator: Generated 12 > files for report forecast in 30.19 seconds > Sep 3 19:06:50 Weather-pi weewx[3254]: copygenerator: copied 87 files to > /home/weewx/public_html/forecast > Sep 3 19:06:50 Weather-pi weewx[3254]: Belchertown Extension: version 0.6 > Sep 3 19:09:01 Weather-pi CRON[3321]: (root) CMD ( [ -x > /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then > /usr/lib/php/sessionclean; fi) > Sep 3 19:09:07 Weather-pi systemd[1]: Starting Clean php session files... > Sep 3 19:09:09 Weather-pi systemd[1]: Started Clean php session files. > Sep 3 19:10:15 Weather-pi weewx[3254]: manager: Added record 2018-09-03 > 19:10:00 EDT (1536016200) to database 'weewx.sdb' > Sep 3 19:10:16 Weather-pi weewx[3254]: manager: Added record 2018-09-03 > 19:10:00 EDT (1536016200) to daily summary in 'weewx.sdb' > Sep 3 19:10:21 Weather-pi weewx[3254]: engine: Shutting down StdReport > thread > Sep 3 19:10:24 Weather-pi wee_reports[3281]: reportengine: Caught > unrecoverable exception in generator weewx.cheetahgenerator.CheetahGenerator > Sep 3 19:10:24 Weather-pi wee_reports[3281]: **** database is > locked > Sep 3 19:10:24 Weather-pi wee_reports[3281]: **** Traceback > (most recent call last): > Sep 3 19:10:24 Weather-pi wee_reports[3281]: **** File > "/home/weewx/bin/weewx/reportengine.py", line 239, in run > Sep 3 19:10:24 Weather-pi wee_reports[3281]: **** obj.start() > Sep 3 19:10:24 Weather-pi wee_reports[3281]: **** File > "/home/weewx/bin/weewx/reportengine.py", line 273, in start > Sep 3 19:10:24 Weather-pi wee_reports[3281]: **** self.run() > Sep 3 19:10:24 Weather-pi wee_reports[3281]: **** File > "/home/weewx/bin/weewx/cheetahgenerator.py", line 158, in run > Sep 3 19:10:24 Weather-pi wee_reports[3281]: **** ngen = > self.generate(gen_dict[section_name], self.gen_ts) > Sep 3 19:10:24 Weather-pi wee_reports[3281]: **** File > "/home/weewx/bin/weewx/cheetahgenerator.py", line 232, in generate > Sep 3 19:10:24 Weather-pi wee_reports[3281]: **** ngen += > self.generate(section[subsection], gen_ts) > Sep 3 19:10:24 Weather-pi wee_reports[3281]: **** File > "/home/weewx/bin/weewx/cheetahgenerator.py", line 320, in generate > Sep 3 19:10:24 Weather-pi wee_reports[3281]: **** > default_binding) > Sep 3 19:10:24 Weather-pi wee_reports[3281]: **** File > "/home/weewx/bin/weewx/cheetahgenerator.py", line 372, in _getSearchList > Sep 3 19:10:24 Weather-pi wee_reports[3281]: **** searchList > += obj.get_extension_list(timespan, db_lookup) > Sep 3 19:10:24 Weather-pi wee_reports[3281]: **** File > "/home/weewx/bin/user/belchertown_highchartsSearchX.py", line 1053, in > get_extension_list > Sep 3 19:10:24 Weather-pi wee_reports[3281]: **** for > rainsql in _pob_rain_totals_lookup: > Sep 3 19:10:24 Weather-pi wee_reports[3281]: **** File > "/home/weewx/bin/weewx/manager.py", line 406, in genSql > Sep 3 19:10:24 Weather-pi wee_reports[3281]: **** for _row > in _cursor.execute(sql, sqlargs): > Sep 3 19:10:24 Weather-pi wee_reports[3281]: **** File > "/home/weewx/bin/weedb/sqlite.py", line 43, in guarded_fn > Sep 3 19:10:24 Weather-pi wee_reports[3281]: **** raise > weedb.OperationalError(e) > Sep 3 19:10:24 Weather-pi wee_reports[3281]: **** > OperationalError: database is locked > Sep 3 19:10:24 Weather-pi wee_reports[3281]: **** Generator > terminated > Sep 3 19:10:25 Weather-pi wee_reports[3281]: copygenerator: copied 22 > files to /home/weewx/public_html/belchertown > Sep 3 19:10:29 Weather-pi weewx[3254]: reportengine: Caught unrecoverable > exception in generator weewx.cheetahgenerator.CheetahGenerator > Sep 3 19:10:29 Weather-pi weewx[3254]: **** database is locked > Sep 3 19:10:29 Weather-pi weewx[3254]: **** Traceback (most > recent call last): > Sep 3 19:10:29 Weather-pi weewx[3254]: **** File > "/home/weewx/bin/weewx/reportengine.py", line 239, in run > Sep 3 19:10:29 Weather-pi weewx[3254]: **** obj.start() > Sep 3 19:10:29 Weather-pi weewx[3254]: **** File > "/home/weewx/bin/weewx/reportengine.py", line 273, in start > Sep 3 19:10:29 Weather-pi weewx[3254]: **** self.run() > Sep 3 19:10:29 Weather-pi weewx[3254]: **** File > "/home/weewx/bin/weewx/cheetahgenerator.py", line 158, in run > Sep 3 19:10:29 Weather-pi weewx[3254]: **** ngen = > self.generate(gen_dict[section_name], self.gen_ts) > Sep 3 19:10:29 Weather-pi weewx[3254]: **** File > "/home/weewx/bin/weewx/cheetahgenerator.py", line 232, in generate > Sep 3 19:10:29 Weather-pi weewx[3254]: **** ngen += > self.generate(section[subsection], gen_ts) > Sep 3 19:10:29 Weather-pi weewx[3254]: **** File > "/home/weewx/bin/weewx/cheetahgenerator.py", line 232, in generate > Sep 3 19:10:29 Weather-pi weewx[3254]: **** ngen += > self.generate(section[subsection], gen_ts) > Sep 3 19:10:29 Weather-pi weewx[3254]: **** File > "/home/weewx/bin/weewx/cheetahgenerator.py", line 320, in generate > Sep 3 19:10:29 Weather-pi weewx[3254]: **** default_binding) > Sep 3 19:10:29 Weather-pi weewx[3254]: **** File > "/home/weewx/bin/weewx/cheetahgenerator.py", line 372, in _getSearchList > Sep 3 19:10:29 Weather-pi weewx[3254]: **** searchList += > obj.get_extension_list(timespan, db_lookup) > Sep 3 19:10:29 Weather-pi weewx[3254]: **** File > "/home/weewx/bin/user/belchertown_highchartsSearchX.py", line 1566, in > get_extension_list > Sep 3 19:10:29 Weather-pi weewx[3254]: **** (time_start_vt, > time_stop_vt, radiation_vt) = db_lookup().getSqlVectors(TimeSpan(_start_ts, > timespan.stop), 'radiation', 'max', 86400) > Sep 3 19:10:29 Weather-pi weewx[3254]: **** File > "/home/weewx/bin/weewx/manager.py", line 512, in getSqlVectors > Sep 3 19:10:29 Weather-pi weewx[3254]: **** aggregate_type, > aggregate_interval) > Sep 3 19:10:29 Weather-pi weewx[3254]: **** File > "/home/weewx/bin/weewx/manager.py", line 756, in _getSqlVectors > Sep 3 19:10:29 Weather-pi weewx[3254]: **** > _cursor.execute(sql_str, stamp) > Sep 3 19:10:29 Weather-pi weewx[3254]: **** File > "/home/weewx/bin/weedb/sqlite.py", line 43, in guarded_fn > Sep 3 19:10:29 Weather-pi weewx[3254]: **** raise > weedb.OperationalError(e) > Sep 3 19:10:29 Weather-pi weewx[3254]: **** OperationalError: > database is locked > Sep 3 19:10:29 Weather-pi weewx[3254]: **** Generator terminated > Sep 3 19:10:29 Weather-pi weewx[3254]: copygenerator: copied 22 files to > /home/weewx/public_html/belchertown > Sep 3 19:10:29 Weather-pi weewx[3254]: engine: Database OperationalError > exception: database is locked > Sep 3 19:10:29 Weather-pi weewx[3254]: **** Waiting 2 minutes then > retrying... > Sep 3 19:12:29 Weather-pi weewx[3254]: engine: retrying... > Sep 3 19:12:29 Weather-pi weewx[3254]: engine: Using configuration file > /home/weewx/weewx.conf > Sep 3 19:12:29 Weather-pi weewx[3254]: engine: Loading station type > Vantage (weewx.drivers.vantage) > Sep 3 19:12:30 Weather-pi weewx[3254]: engine: StdConvert target unit is > 0x1 > Sep 3 19:12:30 Weather-pi weewx[3254]: wxcalculate: The following values > will be calculated: barometer=prefer_hardware, windchill=prefer_hardware, > dewpoint=prefer_hardware, appTemp=prefer_hardware, > rainRate=prefer_hardware, windrun=prefer_hardware, > heatindex=prefer_hardware, maxSolarRad=prefer_hardware, > humidex=prefer_hardware, pressure=prefer_hardware, > inDewpoint=prefer_hardware, ET=prefer_hardware, altimeter=prefer_hardware, > cloudbase=prefer_hardware > Sep 3 19:12:30 Weather-pi weewx[3254]: wxcalculate: The following > algorithms will be used for calculations: altimeter=aaNOAA, maxSolarRad=RS > Sep 3 19:12:30 Weather-pi weewx[3254]: engine: Archive will use data > binding wx_binding > Sep 3 19:12:30 Weather-pi weewx[3254]: engine: Record generation will be > attempted in 'hardware' > Sep 3 19:12:30 Weather-pi weewx[3254]: engine: Using archive interval of > 300 seconds (specified by hardware) > Sep 3 19:12:30 Weather-pi weewx[3254]: engine: Using binding 'wx_binding' > to database 'weewx.sdb' > Sep 3 19:12:30 Weather-pi weewx[3254]: manager: Starting backfill of > daily summaries > Sep 3 19:12:30 Weather-pi weewx[3254]: forecast: MainThread: Zambretti: > forecast version 3.2.19 > Sep 3 19:12:30 Weather-pi weewx[3254]: forecast: MainThread: Zambretti: > interval=600 max_age=604800 winddir_period=1800 pressure_period=10800 > hemisphere=NORTH lower_pressure=950.0 upper_pressure=1050.0 > Sep 3 19:12:30 Weather-pi weewx[3254]: forecast: MainThread: NWS: > forecast version 3.2.19 > Sep 3 19:12:30 Weather-pi weewx[3254]: forecast: MainThread: NWS: > location ID (lid) is not specified > Sep 3 19:12:30 Weather-pi weewx[3254]: forecast: MainThread: NWS: > forecast office ID (foid) is not specified > Sep 3 19:12:30 Weather-pi weewx[3254]: forecast: MainThread: NWS: > forecast will not be run > Sep 3 19:12:30 Weather-pi weewx[3254]: forecast: MainThread: WU: forecast > version 3.2.19 > Sep 3 19:12:30 Weather-pi weewx[3254]: forecast: MainThread: WU: API key > (api_key) is not specified > Sep 3 19:12:30 Weather-pi weewx[3254]: forecast: MainThread: WU: forecast > will not be run > Sep 3 19:12:30 Weather-pi weewx[3254]: forecast: MainThread: OWM: > forecast version 3.2.19 > Sep 3 19:12:30 Weather-pi weewx[3254]: forecast: MainThread: OWM: API key > (api_key) is not specified > Sep 3 19:12:30 Weather-pi weewx[3254]: forecast: MainThread: OWM: > forecast will not be run > Sep 3 19:12:30 Weather-pi weewx[3254]: forecast: MainThread: UKMO: > forecast version 3.2.19 > Sep 3 19:12:30 Weather-pi weewx[3254]: forecast: MainThread: UKMO: API > key (api_key) is not specified > Sep 3 19:12:30 Weather-pi weewx[3254]: forecast: MainThread: UKMO: > forecast will not be run > Sep 3 19:12:30 Weather-pi weewx[3254]: forecast: MainThread: Aeris: > forecast version 3.2.19 > Sep 3 19:12:30 Weather-pi weewx[3254]: forecast: MainThread: Aeris: > client identifier (client_id) is not specified > Sep 3 19:12:30 Weather-pi weewx[3254]: forecast: MainThread: Aeris: > client secret (client_secret) is not specified > Sep 3 19:12:30 Weather-pi weewx[3254]: forecast: MainThread: Aeris: > forecast will not be run > Sep 3 19:12:30 Weather-pi weewx[3254]: forecast: MainThread: WWO: > forecast version 3.2.19 > Sep 3 19:12:30 Weather-pi weewx[3254]: forecast: MainThread: WWO: API key > (api_key) is not specified > Sep 3 19:12:30 Weather-pi weewx[3254]: forecast: MainThread: WWO: > forecast will not be run > Sep 3 19:12:30 Weather-pi weewx[3254]: forecast: MainThread: XTide: > forecast version 3.2.19 > Sep 3 19:12:30 Weather-pi weewx[3254]: forecast: MainThread: XTide: > location (location) has not been specified > Sep 3 19:12:30 Weather-pi weewx[3254]: forecast: MainThread: XTide: > forecast will not be run > Sep 3 19:12:30 Weather-pi weewx[3254]: restx: StationRegistry: Regi > > ... -- You received this message because you are subscribed to the Google Groups "weewx-user" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
