bug#30644: Cuirass runs out of build users

Hello, This should no longer be an issue with the new remote building mechanism in Cuirass. Thanks, Mathieu

bug#30644: Cuirass runs out of build users

Hi Danny, Danny Milosavljevic skribis: > I've checked it some more. The shared cache uses unlock_notify, and the > actual > database uses sqlite3_busy_handler (sqlite3_busy_timeout) when BUSY is > returned. > > The 5 in > > ice-9/eval.scm:619:8: Throw to key `sqlite-error' with args `(#f 5 "d

bug#30644: Cuirass runs out of build users

Hi Ludo, I've checked it some more. The shared cache uses unlock_notify, and the actual database uses sqlite3_busy_handler (sqlite3_busy_timeout) when BUSY is returned. The 5 in ice-9/eval.scm:619:8: Throw to key `sqlite-error' with args `(#f 5 "database is locked")'.

bug#30644: Cuirass runs out of build users

Hi, Danny Milosavljevic skribis: > On Thu, 08 Mar 2018 13:01:01 +0100 > l...@gnu.org (Ludovic Courtès) wrote: > >> So what’s your take on this? > > sqlite has a sqlite-unlock-notify. We should wrap it and use it when we get > the > "locked" error code. > > We should also enable extended error

bug#30644: Cuirass runs out of build users

Hi Ludo, On Thu, 08 Mar 2018 13:01:01 +0100 l...@gnu.org (Ludovic Courtès) wrote: > So what’s your take on this? sqlite has a sqlite-unlock-notify. We should wrap it and use it when we get the "locked" error code. We should also enable extended error codes https://sqlite.org/c3ref/extended_re

bug#30644: Cuirass runs out of build users

Danny Milosavljevic skribis: > Oops, I had an old bin/evaluate . bin/evaluate.in doesn't contain it anymore. > My bad... Yes, see . > Anyway, sqlite contains some cool stuff to find out who's locking it. > > But as things are it seems that sqlite access is now done

bug#30644: Cuirass runs out of build users

Oops, I had an old bin/evaluate . bin/evaluate.in doesn't contain it anymore. My bad... So please disregard. Anyway, sqlite contains some cool stuff to find out who's locking it. But as things are it seems that sqlite access is now done only by one thread. How can it then be locked? Weird..

bug#30644: Cuirass runs out of build users

As for what's causing this, cuirass's bin/evaluate seems to connect to the sqlite database and then write stuff into it. If a query is being done by the http server at the same time, you are going to be really careful with the sqlite open mode. There would be ways to still be able to do this, b

bug#30644: Cuirass runs out of build users

Hi Ludo, > > 69:18 2 (%sqlite-exec _ _ . _) > > In ice-9/eval.scm: > >293:34 1 (_ #(#(# #< ?))) > > 619:8 0 (_ #(#(#(#(# #) #) 5) 5)) > > ice-9/eval.scm:619:8: Throw to key `sqlite-error' with args `(#f 5 > > "database is locked")'. > > Bah. :-/ sqlite3.h contains quite nice d

bug#30644: Cuirass runs out of build users

Andreas Enge skribis: > Right now, I do not seem to be running out of build users, but I think > that cuirass nevertheless behaves strangely; so I am asking here instead > of opening a new bug (maybe there is no bug, actually). Good. :-) > There is still one occurrence of this: > In ice-9/boot

bug#30644: Cuirass runs out of build users

Okay, this evening, I see 10 packages being built and lots of messages "build started"/"build succeeded"; so maybe there is no bug at work here. Andreas

bug#30644: Cuirass runs out of build users

Right now, I do not seem to be running out of build users, but I think that cuirass nevertheless behaves strangely; so I am asking here instead of opening a new bug (maybe there is no bug, actually). I reconfigured bayfront this morning with the latest git checkout. Right now, there are only two p

bug#30644: Cuirass runs out of build users

On Fri, Mar 02, 2018 at 04:08:33PM +0200, Efraim Flashner wrote: > When I use a shell script to build all the packages, if a package hangs > and gets eaten by the timout-limit then it holds the build user and > space in /tmp until all 10 builders are taken and building stops or all > the builds fin

bug#30644: Cuirass runs out of build users

On Wed, Feb 28, 2018 at 10:07:14AM +0100, Andreas Enge wrote: > Hello, > > in trying out the new bayfront machine, I raised the number of concurrent > build jobs to 10; the number of build accounts is programmatically set to > twice this number. > > Looking at the build directories in /tmp, 9 bui

bug#30644: Cuirass runs out of build users

On Thu, Mar 01, 2018 at 03:01:30PM +0100, Ludovic Courtès wrote: > > Hm, the directories in /tmp are created by guixbuilder01 to guixbuilder10. > > 10 is the default value, but it should have been overwritten. > > > > And in /etc/passwd, I see 20 users. But apparently, they are not used! > > There

bug#30644: Cuirass runs out of build users

Hello, Andreas Enge skribis: > in trying out the new bayfront machine, I raised the number of concurrent > build jobs to 10; the number of build accounts is programmatically set to > twice this number. Indeed, (sysadmin services) in guix-maintenance.git does that. > 2018-02-27T18:31:16 batch o

bug#30644: Cuirass runs out of build users

Hello, in trying out the new bayfront machine, I raised the number of concurrent build jobs to 10; the number of build accounts is programmatically set to twice this number. Looking at the build directories in /tmp, 9 build jobs were started on February 26 at around 21:50, a 10th one at 22:24. L