Re: Can not start Buildbot by rc scripts, but 'buildbot start master' works (built from -current)

2020-08-28 Thread Martin
Hi Landry,

Buildbot won't start from rc scripts anyway during system boot process 
automatically.
I tried to run it by setting:

rcctl enable buildbot

...
stating network daemons: sshd bgpd relayd dhcpd smtpd vmd sndiod.
starting package daemons: buildbot(failed).
...

But it runs successfully manually from fully booted system by command even 
after buildbot(failed) return:

rcctl start buildbot
buildbot(failed)
rcctl check buildbot
buildbot(ok)

I think it could be timeout because of long time needed to start buildbot.

Could you check this to confirm?
Do you think can it be solved?

Martin

‐‐‐ Original Message ‐‐‐
On Thursday, July 23, 2020 8:17 AM, Martin  wrote:

> I confirm buildbot-worker works since automat has been updated to 
> py-automat-0.8.0.
>
> Great job, Landry!
>
> Martin
>
> ‐‐‐ Original Message ‐‐‐
> On Wednesday, July 22, 2020 7:18 PM, Landry Breuil lan...@openbsd.org wrote:
>
> > On Wed, Jul 22, 2020 at 12:59:44PM +, Martin wrote:
> >
> > > It seems latest py-automat-20.2.0 should be used with updated 
> > > py-setuptools-49.x to run buildbot-worker correctly.
> >
> > good catch, i think 0.8.0 is enough per
> > https://github.com/buildbot/buildbot/commit/a89eddb4acfdaa23bcb53806674a960e28cfccc1
> >
> > -   that's probably the switch to python 3.8 that broke it.
> > Landry
> >




Re: Can not start Buildbot by rc scripts, but 'buildbot start master' works (built from -current)

2020-08-28 Thread Stuart Henderson
On 2020/08/28 11:55, Landry Breuil wrote:
> On Fri, Aug 28, 2020 at 09:46:31AM +, Martin wrote:
> > Hi Landry,
> > 
> > Buildbot won't start from rc scripts anyway during system boot process 
> > automatically.
> > I tried to run it by setting:
> > 
> > rcctl enable buildbot
> > 
> > ...
> > stating network daemons: sshd bgpd relayd dhcpd smtpd vmd sndiod.
> > starting package daemons: buildbot(failed).
> > ...
> > 
> > But it runs successfully manually from fully booted system by command even 
> > after buildbot(failed) return:
> > 
> > rcctl start buildbot
> > buildbot(failed)
> > rcctl check buildbot
> > buildbot(ok)
> 
> check twistd.log for details in buildbot workdir, and check the list of
> processes running matching the pexep, ie
> 
> pgrep -f '/usr/local/bin/python3.8 .*logfile=twistd.log --python=buildbot.tac'
> 
> > I think it could be timeout because of long time needed to start buildbot.
> 
> the default timeout set by rc.subr is 30s; check if adding
> daemon_timeout=60 to /etc/rc.d/buildbot helps. In my experience it didnt
> change anything.

don't modify rc.d/buildbot, just set buildbot_timeout=60 in rc.conf.local

> 
> > Could you check this to confirm?
> > Do you think can it be solved?
> 
> Dunno without more details.
> 



Re: Can not start Buildbot by rc scripts, but 'buildbot start master' works (built from -current)

2020-08-28 Thread Landry Breuil
On Fri, Aug 28, 2020 at 09:46:31AM +, Martin wrote:
> Hi Landry,
> 
> Buildbot won't start from rc scripts anyway during system boot process 
> automatically.
> I tried to run it by setting:
> 
> rcctl enable buildbot
> 
> ...
> stating network daemons: sshd bgpd relayd dhcpd smtpd vmd sndiod.
> starting package daemons: buildbot(failed).
> ...
> 
> But it runs successfully manually from fully booted system by command even 
> after buildbot(failed) return:
> 
> rcctl start buildbot
> buildbot(failed)
> rcctl check buildbot
> buildbot(ok)

check twistd.log for details in buildbot workdir, and check the list of
processes running matching the pexep, ie

pgrep -f '/usr/local/bin/python3.8 .*logfile=twistd.log --python=buildbot.tac'

> I think it could be timeout because of long time needed to start buildbot.

the default timeout set by rc.subr is 30s; check if adding
daemon_timeout=60 to /etc/rc.d/buildbot helps. In my experience it didnt
change anything.

> Could you check this to confirm?
> Do you think can it be solved?

Dunno without more details.



Re: Can not start Buildbot by rc scripts, but 'buildbot start master' works (built from -current)

2020-07-23 Thread Martin
I confirm buildbot-worker works since automat has been updated to 
py-automat-0.8.0.

Great job, Landry!

Martin

‐‐‐ Original Message ‐‐‐
On Wednesday, July 22, 2020 7:18 PM, Landry Breuil  wrote:

> On Wed, Jul 22, 2020 at 12:59:44PM +, Martin wrote:
>
> > It seems latest py-automat-20.2.0 should be used with updated 
> > py-setuptools-49.x to run buildbot-worker correctly.
>
> good catch, i think 0.8.0 is enough per
> https://github.com/buildbot/buildbot/commit/a89eddb4acfdaa23bcb53806674a960e28cfccc1
>
> -   that's probably the switch to python 3.8 that broke it.
>
> Landry
>




Re: Can not start Buildbot by rc scripts, but 'buildbot start master' works (built from -current)

2020-07-22 Thread Landry Breuil
On Wed, Jul 22, 2020 at 12:59:44PM +, Martin wrote:
> It seems latest py-automat-20.2.0 should be used with updated 
> py-setuptools-49.x to run buildbot-worker correctly.

good catch, i think 0.8.0 is enough per
https://github.com/buildbot/buildbot/commit/a89eddb4acfdaa23bcb53806674a960e28cfccc1
- that's probably the switch to python 3.8 that broke it.

Landry



Re: Can not start Buildbot by rc scripts, but 'buildbot start master' works (built from -current)

2020-07-22 Thread Martin
It seems latest py-automat-20.2.0 should be used with updated 
py-setuptools-49.x to run buildbot-worker correctly.

Martin

‐‐‐ Original Message ‐‐‐
On Monday, July 20, 2020 8:45 PM, Martin  wrote:

> Master has been created in /var/buildbot by:
>
> buildbot create-master master
> buildbot start master
> works.
>
> But I can't start Buildbot by
> rcctl start buildbot
>
> Any suggestions?
>
> Martin




Re: Can not start Buildbot by rc scripts, but 'buildbot start master' works (built from -current)

2020-07-22 Thread Martin
Landry, thanks for reply.

Buildbot now starts from rc scripts successfully. It was /var/buildbot folder 
contents permissions problem.

But now I'm stuck with buildbot-worker built from -current.

I've just created a worker by commands from README:
su -m _buildslave -c "buildbot-worker create-worker /var/buildslave localhost 
worker-obsd test

Worker created successfully.

When I try to start it:

# rcctl -d start buildbot_worker
doing _rc_parse_conf
doing _rc_quirks
buildbot_sorker_flags empty, using default >/var/buildslave<
doing rc_check
buildbot_worker
doing rc_start
doing_rc_wait start
doing rc_check
doing rc_check
Alarm clock
/etc/rc.d/buildbot_worker: kill: 2092: Nosuch process
doing _rc_write_runfile
(ok)

Nothing started since then.

# cat twisted.log show some errors with automat (py3-twisted-20.3.0p0, 
py3-automaat-0.6.0p1):

2020-07-22 11:08:58+ [-] Loading buildbot.tac...
2020-07-22 11:08:59+ [-] Loaded.
2020-07-22 11:08:59+ [-] twistd 20.3.0 (/usr/local/bin/python3.8 3.8.3) 
starting up.
2020-07-22 11:08:59+ [-] reactor class: 
twisted.internet.pollreactor.PollReactor.
2020-07-22 11:08:59+ [-] Starting Worker -- version: 2.8.1
2020-07-22 11:08:59+ [-] recording hostname in twistd.hostname
2020-07-22 11:08:59+ [-] Traceback (most recent call last):
2020-07-22 11:08:59+ [-]   File "/usr/local/bin/buildbot-worker", line 11, 
in 
2020-07-22 11:08:59+ [-] load_entry_point('buildbot-worker==2.8.1', 
'console_scripts', 'buildbot-worker')()
2020-07-22 11:08:59+ [-]   File 
"/usr/local/lib/python3.8/site-packages/buildbot_worker/scripts/runner.py", 
line 266, in run
2020-07-22 11:08:59+ [-] sys.exit(subcommandFunction(subconfig))
2020-07-22 11:08:59+ [-]   File 
"/usr/local/lib/python3.8/site-packages/buildbot_worker/scripts/start.py", line 
80, in startCommand
2020-07-22 11:08:59+ [-] return startWorker(basedir, config['quiet'], 
config['nodaemon'])
2020-07-22 11:08:59+ [-]   File 
"/usr/local/lib/python3.8/site-packages/buildbot_worker/scripts/start.py", line 
103, in startWorker
2020-07-22 11:08:59+ [-] return launch(nodaemon)
2020-07-22 11:08:59+ [-]   File 
"/usr/local/lib/python3.8/site-packages/buildbot_worker/scripts/start.py", line 
142, in launch
2020-07-22 11:08:59+ [-] run()
2020-07-22 11:08:59+ [-]   File 
"/usr/local/lib/python3.8/site-packages/twisted/scripts/twistd.py", line 31, in 
run
2020-07-22 11:08:59+ [-] app.run(runApp, ServerOptions)
2020-07-22 11:08:59+ [-]   File 
"/usr/local/lib/python3.8/site-packages/twisted/application/app.py", line 674, 
in run
2020-07-22 11:08:59+ [-] runApp(config)
2020-07-22 11:08:59+ [-]   File 
"/usr/local/lib/python3.8/site-packages/twisted/scripts/twistd.py", line 25, in 
runApp
2020-07-22 11:08:59+ [-] runner.run()
2020-07-22 11:08:59+ [-]   File 
"/usr/local/lib/python3.8/site-packages/twisted/application/app.py", line 385, 
in run
2020-07-22 11:08:59+ [-] self.postApplication()
2020-07-22 11:08:59+ [-]   File 
"/usr/local/lib/python3.8/site-packages/twisted/scripts/_twistd_unix.py", line 
254, in postApplication
2020-07-22 11:08:59+ [-] self.startApplication(self.application)
2020-07-22 11:08:59+ [-]   File 
"/usr/local/lib/python3.8/site-packages/twisted/scripts/_twistd_unix.py", line 
453, in startApplication
2020-07-22 11:08:59+ [-] app.startApplication(application, not 
self.config['no_save'])
2020-07-22 11:08:59+ [-]   File 
"/usr/local/lib/python3.8/site-packages/twisted/application/app.py", line 690, 
in startApplication
2020-07-22 11:08:59+ [-] service.IService(application).startService()
2020-07-22 11:08:59+ [-]   File 
"/usr/local/lib/python3.8/site-packages/twisted/application/service.py", line 
288, in startService
2020-07-22 11:08:59+ [-] service.startService()
2020-07-22 11:08:59+ [-]   File 
"/usr/local/lib/python3.8/site-packages/buildbot_worker/pb.py", line 236, in 
startService
2020-07-22 11:08:59+ [-] WorkerBase.startService(self)
2020-07-22 11:08:59+ [-]   File 
"/usr/local/lib/python3.8/site-packages/buildbot_worker/base.py", line 418, in 
startService
2020-07-22 11:08:59+ [-] service.MultiService.startService(self)
2020-07-22 11:08:59+ [-]   File 
"/usr/local/lib/python3.8/site-packages/twisted/application/service.py", line 
288, in startService
2020-07-22 11:08:59+ [-] service.startService()
2020-07-22 11:08:59+ [-]   File 
"/usr/local/lib/python3.8/site-packages/twisted/application/internet.py", line 
1138, in startService
2020-07-22 11:08:59+ [-] self._machine.start()
2020-07-22 11:08:59+ [-]   File 
"/usr/local/lib/python3.8/site-packages/automat/_methodical.py", line 126, in 
__get__
2020-07-22 11:08:59+ [-] def doInput(*args, **kwargs):
2020-07-22 11:08:59+ [-]   File 
"/usr/local/lib/python3.8/site-packages/automat/_introspection.py", line 39, in 
decorator
2020-07-22 

Re: Can not start Buildbot by rc scripts, but 'buildbot start master' works (built from -current)

2020-07-21 Thread Landry Breuil
On Mon, Jul 20, 2020 at 08:45:53PM +, Martin wrote:
> Master has been created in /var/buildbot by:
> 
> buildbot create-master master
> buildbot start master
> works.
> 
> But I can't start Buildbot by
> rcctl start buildbot
> 
> Any suggestions?

rcctl -d start buildbot, and look at /var/buildbot/twistd.log ?
maybe you didnt follow readme, which advised to run those commands as
_buildbot user, and now perms dont match what's expected ?



Can not start Buildbot by rc scripts, but 'buildbot start master' works (built from -current)

2020-07-20 Thread Martin
Master has been created in /var/buildbot by:

buildbot create-master master
buildbot start master
works.

But I can't start Buildbot by
rcctl start buildbot

Any suggestions?

Martin