Re: [Patchwork-maintainers] patchwork.ozlabs.org downtime for maintenance - 15/16 August

2024-01-17 Thread Stephen Rothwell
Hi all,

On Thu, 18 Jan 2024 00:36:39 +0800 Jeremy Kerr  wrote:
>
> > When and how long do those run? I'm pretty much working your
> > overnight.  
> 
> I'd have to defer to Stephen on that, but I had been assuming 4am /
> 17:00 UTC.

Yeah, 4am to 6am our time (currently +1100) ... it takes a long time to
backup a 25GB database :-(  We may need to consider alternative backup
methods?

See https://munin.ozlabs.org/ozlabs.org/legolas.ozlabs.org/index.html
(legolas is patchwork.ozlabs.org).
-- 
Cheers,
Stephen Rothwell


pgpQQHbHCn8Er.pgp
Description: OpenPGP digital signature
___
Patchwork mailing list
Patchwork@lists.ozlabs.org
https://lists.ozlabs.org/listinfo/patchwork


Re: [Patchwork-maintainers] patchwork.ozlabs.org downtime for maintenance - 15/16 August

2024-01-17 Thread Jeremy Kerr
Hi Rob,

> When was recent? The 503s have been happening for probably a month or
> 2 now, but seem to be increasing in frequency to the point of PW
> being unusable now.

That was early Jan, so you've been seeing those since before the
upgrade.

I do see quite a bit of spider traffic now though, so might have some
options to limit load there too.

> > So far it does seem time of day related, so possibly conflicting
> > with load from overnight backups.
> 
> When and how long do those run? I'm pretty much working your
> overnight.

I'd have to defer to Stephen on that, but I had been assuming 4am /
17:00 UTC.

Cheers,


Jeremy
___
Patchwork mailing list
Patchwork@lists.ozlabs.org
https://lists.ozlabs.org/listinfo/patchwork


Re: [Patchwork-maintainers] patchwork.ozlabs.org downtime for maintenance - 15/16 August

2024-01-17 Thread Rob Herring
On Tue, Jan 16, 2024 at 6:56 PM Jeremy Kerr  wrote:
>
> Hi Rob & Konstantin,
>
> >
> > > I'm still seeing this slowness and now to add to that intermittent
> > > 503 errors.
>
> OK, I've heard the same yesterday from the ovn folks. Sounds like this
> is continuing after a recent hardware upgrade too.

When was recent? The 503s have been happening for probably a month or
2 now, but seem to be increasing in frequency to the point of PW being
unusable now.

> So far it does seem time of day related, so possibly conflicting with
> load from overnight backups.

When and how long do those run? I'm pretty much working your overnight.

Rob
___
Patchwork mailing list
Patchwork@lists.ozlabs.org
https://lists.ozlabs.org/listinfo/patchwork