Re: Can not start Buildbot by rc scripts, but 'buildbot start master' works (built from -current)
Hi Landry, Buildbot won't start from rc scripts anyway during system boot process automatically. I tried to run it by setting: rcctl enable buildbot ... stating network daemons: sshd bgpd relayd dhcpd smtpd vmd sndiod. starting package daemons: buildbot(failed). ... But it runs successfully manually from fully booted system by command even after buildbot(failed) return: rcctl start buildbot buildbot(failed) rcctl check buildbot buildbot(ok) I think it could be timeout because of long time needed to start buildbot. Could you check this to confirm? Do you think can it be solved? Martin ‐‐‐ Original Message ‐‐‐ On Thursday, July 23, 2020 8:17 AM, Martin wrote: > I confirm buildbot-worker works since automat has been updated to > py-automat-0.8.0. > > Great job, Landry! > > Martin > > ‐‐‐ Original Message ‐‐‐ > On Wednesday, July 22, 2020 7:18 PM, Landry Breuil lan...@openbsd.org wrote: > > > On Wed, Jul 22, 2020 at 12:59:44PM +, Martin wrote: > > > > > It seems latest py-automat-20.2.0 should be used with updated > > > py-setuptools-49.x to run buildbot-worker correctly. > > > > good catch, i think 0.8.0 is enough per > > https://github.com/buildbot/buildbot/commit/a89eddb4acfdaa23bcb53806674a960e28cfccc1 > > > > - that's probably the switch to python 3.8 that broke it. > > Landry > >
Re: Can not start Buildbot by rc scripts, but 'buildbot start master' works (built from -current)
On 2020/08/28 11:55, Landry Breuil wrote: > On Fri, Aug 28, 2020 at 09:46:31AM +, Martin wrote: > > Hi Landry, > > > > Buildbot won't start from rc scripts anyway during system boot process > > automatically. > > I tried to run it by setting: > > > > rcctl enable buildbot > > > > ... > > stating network daemons: sshd bgpd relayd dhcpd smtpd vmd sndiod. > > starting package daemons: buildbot(failed). > > ... > > > > But it runs successfully manually from fully booted system by command even > > after buildbot(failed) return: > > > > rcctl start buildbot > > buildbot(failed) > > rcctl check buildbot > > buildbot(ok) > > check twistd.log for details in buildbot workdir, and check the list of > processes running matching the pexep, ie > > pgrep -f '/usr/local/bin/python3.8 .*logfile=twistd.log --python=buildbot.tac' > > > I think it could be timeout because of long time needed to start buildbot. > > the default timeout set by rc.subr is 30s; check if adding > daemon_timeout=60 to /etc/rc.d/buildbot helps. In my experience it didnt > change anything. don't modify rc.d/buildbot, just set buildbot_timeout=60 in rc.conf.local > > > Could you check this to confirm? > > Do you think can it be solved? > > Dunno without more details. >
Re: Can not start Buildbot by rc scripts, but 'buildbot start master' works (built from -current)
On Fri, Aug 28, 2020 at 09:46:31AM +, Martin wrote: > Hi Landry, > > Buildbot won't start from rc scripts anyway during system boot process > automatically. > I tried to run it by setting: > > rcctl enable buildbot > > ... > stating network daemons: sshd bgpd relayd dhcpd smtpd vmd sndiod. > starting package daemons: buildbot(failed). > ... > > But it runs successfully manually from fully booted system by command even > after buildbot(failed) return: > > rcctl start buildbot > buildbot(failed) > rcctl check buildbot > buildbot(ok) check twistd.log for details in buildbot workdir, and check the list of processes running matching the pexep, ie pgrep -f '/usr/local/bin/python3.8 .*logfile=twistd.log --python=buildbot.tac' > I think it could be timeout because of long time needed to start buildbot. the default timeout set by rc.subr is 30s; check if adding daemon_timeout=60 to /etc/rc.d/buildbot helps. In my experience it didnt change anything. > Could you check this to confirm? > Do you think can it be solved? Dunno without more details.
Re: Can not start Buildbot by rc scripts, but 'buildbot start master' works (built from -current)
I confirm buildbot-worker works since automat has been updated to py-automat-0.8.0. Great job, Landry! Martin ‐‐‐ Original Message ‐‐‐ On Wednesday, July 22, 2020 7:18 PM, Landry Breuil wrote: > On Wed, Jul 22, 2020 at 12:59:44PM +, Martin wrote: > > > It seems latest py-automat-20.2.0 should be used with updated > > py-setuptools-49.x to run buildbot-worker correctly. > > good catch, i think 0.8.0 is enough per > https://github.com/buildbot/buildbot/commit/a89eddb4acfdaa23bcb53806674a960e28cfccc1 > > - that's probably the switch to python 3.8 that broke it. > > Landry >
Re: Can not start Buildbot by rc scripts, but 'buildbot start master' works (built from -current)
On Wed, Jul 22, 2020 at 12:59:44PM +, Martin wrote: > It seems latest py-automat-20.2.0 should be used with updated > py-setuptools-49.x to run buildbot-worker correctly. good catch, i think 0.8.0 is enough per https://github.com/buildbot/buildbot/commit/a89eddb4acfdaa23bcb53806674a960e28cfccc1 - that's probably the switch to python 3.8 that broke it. Landry
Re: Can not start Buildbot by rc scripts, but 'buildbot start master' works (built from -current)
It seems latest py-automat-20.2.0 should be used with updated py-setuptools-49.x to run buildbot-worker correctly. Martin ‐‐‐ Original Message ‐‐‐ On Monday, July 20, 2020 8:45 PM, Martin wrote: > Master has been created in /var/buildbot by: > > buildbot create-master master > buildbot start master > works. > > But I can't start Buildbot by > rcctl start buildbot > > Any suggestions? > > Martin
Re: Can not start Buildbot by rc scripts, but 'buildbot start master' works (built from -current)
Landry, thanks for reply. Buildbot now starts from rc scripts successfully. It was /var/buildbot folder contents permissions problem. But now I'm stuck with buildbot-worker built from -current. I've just created a worker by commands from README: su -m _buildslave -c "buildbot-worker create-worker /var/buildslave localhost worker-obsd test Worker created successfully. When I try to start it: # rcctl -d start buildbot_worker doing _rc_parse_conf doing _rc_quirks buildbot_sorker_flags empty, using default >/var/buildslave< doing rc_check buildbot_worker doing rc_start doing_rc_wait start doing rc_check doing rc_check Alarm clock /etc/rc.d/buildbot_worker: kill: 2092: Nosuch process doing _rc_write_runfile (ok) Nothing started since then. # cat twisted.log show some errors with automat (py3-twisted-20.3.0p0, py3-automaat-0.6.0p1): 2020-07-22 11:08:58+ [-] Loading buildbot.tac... 2020-07-22 11:08:59+ [-] Loaded. 2020-07-22 11:08:59+ [-] twistd 20.3.0 (/usr/local/bin/python3.8 3.8.3) starting up. 2020-07-22 11:08:59+ [-] reactor class: twisted.internet.pollreactor.PollReactor. 2020-07-22 11:08:59+ [-] Starting Worker -- version: 2.8.1 2020-07-22 11:08:59+ [-] recording hostname in twistd.hostname 2020-07-22 11:08:59+ [-] Traceback (most recent call last): 2020-07-22 11:08:59+ [-] File "/usr/local/bin/buildbot-worker", line 11, in 2020-07-22 11:08:59+ [-] load_entry_point('buildbot-worker==2.8.1', 'console_scripts', 'buildbot-worker')() 2020-07-22 11:08:59+ [-] File "/usr/local/lib/python3.8/site-packages/buildbot_worker/scripts/runner.py", line 266, in run 2020-07-22 11:08:59+ [-] sys.exit(subcommandFunction(subconfig)) 2020-07-22 11:08:59+ [-] File "/usr/local/lib/python3.8/site-packages/buildbot_worker/scripts/start.py", line 80, in startCommand 2020-07-22 11:08:59+ [-] return startWorker(basedir, config['quiet'], config['nodaemon']) 2020-07-22 11:08:59+ [-] File "/usr/local/lib/python3.8/site-packages/buildbot_worker/scripts/start.py", line 103, in startWorker 2020-07-22 11:08:59+ [-] return launch(nodaemon) 2020-07-22 11:08:59+ [-] File "/usr/local/lib/python3.8/site-packages/buildbot_worker/scripts/start.py", line 142, in launch 2020-07-22 11:08:59+ [-] run() 2020-07-22 11:08:59+ [-] File "/usr/local/lib/python3.8/site-packages/twisted/scripts/twistd.py", line 31, in run 2020-07-22 11:08:59+ [-] app.run(runApp, ServerOptions) 2020-07-22 11:08:59+ [-] File "/usr/local/lib/python3.8/site-packages/twisted/application/app.py", line 674, in run 2020-07-22 11:08:59+ [-] runApp(config) 2020-07-22 11:08:59+ [-] File "/usr/local/lib/python3.8/site-packages/twisted/scripts/twistd.py", line 25, in runApp 2020-07-22 11:08:59+ [-] runner.run() 2020-07-22 11:08:59+ [-] File "/usr/local/lib/python3.8/site-packages/twisted/application/app.py", line 385, in run 2020-07-22 11:08:59+ [-] self.postApplication() 2020-07-22 11:08:59+ [-] File "/usr/local/lib/python3.8/site-packages/twisted/scripts/_twistd_unix.py", line 254, in postApplication 2020-07-22 11:08:59+ [-] self.startApplication(self.application) 2020-07-22 11:08:59+ [-] File "/usr/local/lib/python3.8/site-packages/twisted/scripts/_twistd_unix.py", line 453, in startApplication 2020-07-22 11:08:59+ [-] app.startApplication(application, not self.config['no_save']) 2020-07-22 11:08:59+ [-] File "/usr/local/lib/python3.8/site-packages/twisted/application/app.py", line 690, in startApplication 2020-07-22 11:08:59+ [-] service.IService(application).startService() 2020-07-22 11:08:59+ [-] File "/usr/local/lib/python3.8/site-packages/twisted/application/service.py", line 288, in startService 2020-07-22 11:08:59+ [-] service.startService() 2020-07-22 11:08:59+ [-] File "/usr/local/lib/python3.8/site-packages/buildbot_worker/pb.py", line 236, in startService 2020-07-22 11:08:59+ [-] WorkerBase.startService(self) 2020-07-22 11:08:59+ [-] File "/usr/local/lib/python3.8/site-packages/buildbot_worker/base.py", line 418, in startService 2020-07-22 11:08:59+ [-] service.MultiService.startService(self) 2020-07-22 11:08:59+ [-] File "/usr/local/lib/python3.8/site-packages/twisted/application/service.py", line 288, in startService 2020-07-22 11:08:59+ [-] service.startService() 2020-07-22 11:08:59+ [-] File "/usr/local/lib/python3.8/site-packages/twisted/application/internet.py", line 1138, in startService 2020-07-22 11:08:59+ [-] self._machine.start() 2020-07-22 11:08:59+ [-] File "/usr/local/lib/python3.8/site-packages/automat/_methodical.py", line 126, in __get__ 2020-07-22 11:08:59+ [-] def doInput(*args, **kwargs): 2020-07-22 11:08:59+ [-] File "/usr/local/lib/python3.8/site-packages/automat/_introspection.py", line 39, in decorator 2020-07-22
Re: Can not start Buildbot by rc scripts, but 'buildbot start master' works (built from -current)
On Mon, Jul 20, 2020 at 08:45:53PM +, Martin wrote: > Master has been created in /var/buildbot by: > > buildbot create-master master > buildbot start master > works. > > But I can't start Buildbot by > rcctl start buildbot > > Any suggestions? rcctl -d start buildbot, and look at /var/buildbot/twistd.log ? maybe you didnt follow readme, which advised to run those commands as _buildbot user, and now perms dont match what's expected ?
Can not start Buildbot by rc scripts, but 'buildbot start master' works (built from -current)
Master has been created in /var/buildbot by: buildbot create-master master buildbot start master works. But I can't start Buildbot by rcctl start buildbot Any suggestions? Martin