Re: koji down?
On Wed, Nov 16, 2022 at 5:38 PM Richard Shaw wrote: > I recently switched internet providers so I was looking for an ACK that it > wasn't just me. I am curious, did you try https://status.fedoraproject.org and did it show the outage at the time (since it is manually updated, it would typically lag the actual status, but it might have provided a hint)? ___ devel mailing list -- devel@lists.fedoraproject.org To unsubscribe send an email to devel-le...@lists.fedoraproject.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org Do not reply to spam, report it: https://pagure.io/fedora-infrastructure/new_issue
Re: koji down?
On Wed, Nov 16, 2022 at 11:37:43AM -0600, Richard Shaw wrote: > On Wed, Nov 16, 2022 at 11:32 AM Kevin Fenzi wrote: > > > Everything should be back up now... > > > > I'm watching it for a bit before I declare things are back fully to > > normal though. ;) > > > > Do note that mailing list threads aren't a great place to report > > outages. Please report them to the infrastructure ticket tracker: > > https://pagure.io/fedora-infrastructure/ > > > I recently switched internet providers so I was looking for an ACK that it > wasn't just me. > > But on a related note, it can be somewhat difficult to remember all the > different sites and which is appropriate for what when you don't deal with > them on a regular basis.. Yeah. I'm not sure how to make things more visible, but really the best link to know is the one you get to via docs.fedoraproject.org, engineering teams, fedora infra, working with fedora infra. ie, https://docs.fedoraproject.org/en-US/infra/day_to_day_fedora/ kevin signature.asc Description: PGP signature ___ devel mailing list -- devel@lists.fedoraproject.org To unsubscribe send an email to devel-le...@lists.fedoraproject.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org Do not reply to spam, report it: https://pagure.io/fedora-infrastructure/new_issue
Re: koji down?
On Wed, Nov 16, 2022 at 11:32 AM Kevin Fenzi wrote: > Everything should be back up now... > > I'm watching it for a bit before I declare things are back fully to > normal though. ;) > > Do note that mailing list threads aren't a great place to report > outages. Please report them to the infrastructure ticket tracker: > https://pagure.io/fedora-infrastructure/ I recently switched internet providers so I was looking for an ACK that it wasn't just me. But on a related note, it can be somewhat difficult to remember all the different sites and which is appropriate for what when you don't deal with them on a regular basis.. Thanks, Richard ___ devel mailing list -- devel@lists.fedoraproject.org To unsubscribe send an email to devel-le...@lists.fedoraproject.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org Do not reply to spam, report it: https://pagure.io/fedora-infrastructure/new_issue
Re: koji down?
Everything should be back up now... I'm watching it for a bit before I declare things are back fully to normal though. ;) Do note that mailing list threads aren't a great place to report outages. Please report them to the infrastructure ticket tracker: https://pagure.io/fedora-infrastructure/ Thanks. kevin signature.asc Description: PGP signature ___ devel mailing list -- devel@lists.fedoraproject.org To unsubscribe send an email to devel-le...@lists.fedoraproject.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org Do not reply to spam, report it: https://pagure.io/fedora-infrastructure/new_issue
Re: koji down?
On Wed, 16 Nov 2022 at 08:20, Richard Shaw wrote: > I didn't see any other threads but I can't have been the first to notice... > > I can't access the koji web interface or initiate builds... > > Kerberos authentication fails: unable to obtain a session (gssapi auth > failed: requests.exceptions.ReadTimeout: HTTPSConnectionPool(host=' > koji.fedoraproject.org', port=443): Read timed out. (read timeout=60)) > > Anyone else seeing this? > > Currently the backend database is running out of memory (128GB) and CPU (90 cpus) and is running at a continuous load average of over 300. The system earlier crashed hard and needed to be rebooted but that did not seem to help any. The release engineers are looking into it but I do not have any information than that. > Thanks, > Richard > ___ > devel mailing list -- devel@lists.fedoraproject.org > To unsubscribe send an email to devel-le...@lists.fedoraproject.org > Fedora Code of Conduct: > https://docs.fedoraproject.org/en-US/project/code-of-conduct/ > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines > List Archives: > https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org > Do not reply to spam, report it: > https://pagure.io/fedora-infrastructure/new_issue > -- Stephen Smoogen, Red Hat Automotive Let us be kind to one another, for most of us are fighting a hard battle. -- Ian MacClaren ___ devel mailing list -- devel@lists.fedoraproject.org To unsubscribe send an email to devel-le...@lists.fedoraproject.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org Do not reply to spam, report it: https://pagure.io/fedora-infrastructure/new_issue
Re: koji down?
Did notice it too, and reported it on Pagure and IRC and smooge said it was sad due to the database using too much RAM memory On Wed, Nov 16, 2022 at 2:20 PM Richard Shaw wrote: > > I didn't see any other threads but I can't have been the first to notice... > > I can't access the koji web interface or initiate builds... > > Kerberos authentication fails: unable to obtain a session (gssapi auth > failed: requests.exceptions.ReadTimeout: > HTTPSConnectionPool(host='koji.fedoraproject.org', port=443): Read timed out. > (read timeout=60)) > > Anyone else seeing this? > > Thanks, > Richard > ___ > devel mailing list -- devel@lists.fedoraproject.org > To unsubscribe send an email to devel-le...@lists.fedoraproject.org > Fedora Code of Conduct: > https://docs.fedoraproject.org/en-US/project/code-of-conduct/ > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines > List Archives: > https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org > Do not reply to spam, report it: > https://pagure.io/fedora-infrastructure/new_issue ___ devel mailing list -- devel@lists.fedoraproject.org To unsubscribe send an email to devel-le...@lists.fedoraproject.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org Do not reply to spam, report it: https://pagure.io/fedora-infrastructure/new_issue
Re: koji down?
On Wed, Nov 16, 2022 at 07:19:37AM -0600, Richard Shaw wrote: > I didn't see any other threads but I can't have been the first to notice... > > I can't access the koji web interface or initiate builds... > > Kerberos authentication fails: unable to obtain a session (gssapi auth failed: > requests.exceptions.ReadTimeout: HTTPSConnectionPool(host=' > koji.fedoraproject.org', port=443): Read timed out. (read timeout=60)) > > Anyone else seeing this? Yes, up and down most of the morning. Rich. -- Richard Jones, Virtualization Group, Red Hat http://people.redhat.com/~rjones Read my programming and virtualization blog: http://rwmj.wordpress.com libguestfs lets you edit virtual machines. Supports shell scripting, bindings from many languages. http://libguestfs.org ___ devel mailing list -- devel@lists.fedoraproject.org To unsubscribe send an email to devel-le...@lists.fedoraproject.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org Do not reply to spam, report it: https://pagure.io/fedora-infrastructure/new_issue
Re: Koji down?
Ah, didn’t know about that url for some reason. I’ll check there next time, thanks. On 1 Apr 2022, at 12:02, Kevin Fenzi wrote: > On Thu, Mar 31, 2022 at 06:19:06AM -0500, Ron Olson wrote: >> I submitted some builds yesterday and didn’t get any emails, >> and at least as of 6:18 CDT every link I click on the main webpage replies >> with “server is offline”. > > This was likely during our scheduled outage. > > https://pagure.io/fedora-infrastructure/issue/10613 > > https://lists.fedoraproject.org/archives/list/devel-annou...@lists.fedoraproject.org/thread/K6CEBZYIWOXNGB556GTW26UFEP5J4CUL/ > > make sure you are on the devel-announce list and/or check > https://www.fedorastatus.org/ > > kevin > ___ > devel mailing list -- devel@lists.fedoraproject.org > To unsubscribe send an email to devel-le...@lists.fedoraproject.org > Fedora Code of Conduct: > https://docs.fedoraproject.org/en-US/project/code-of-conduct/ > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines > List Archives: > https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org > Do not reply to spam on the list, report it: > https://pagure.io/fedora-infrastructure ___ devel mailing list -- devel@lists.fedoraproject.org To unsubscribe send an email to devel-le...@lists.fedoraproject.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org Do not reply to spam on the list, report it: https://pagure.io/fedora-infrastructure
Re: Koji down?
On Thu, Mar 31, 2022 at 06:19:06AM -0500, Ron Olson wrote: > I submitted some builds yesterday and didn’t get any emails, > and at least as of 6:18 CDT every link I click on the main webpage replies > with “server is offline”. This was likely during our scheduled outage. https://pagure.io/fedora-infrastructure/issue/10613 https://lists.fedoraproject.org/archives/list/devel-annou...@lists.fedoraproject.org/thread/K6CEBZYIWOXNGB556GTW26UFEP5J4CUL/ make sure you are on the devel-announce list and/or check https://www.fedorastatus.org/ kevin signature.asc Description: PGP signature ___ devel mailing list -- devel@lists.fedoraproject.org To unsubscribe send an email to devel-le...@lists.fedoraproject.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org Do not reply to spam on the list, report it: https://pagure.io/fedora-infrastructure
Re: Koji down?
On Fri, 2013-07-19 at 09:03 +0200, Joachim Backes wrote: Getting this when connecting to http://koji.fedoraproject.org/koji --- Internal Server Error It's a planned outage: $ koji --debug moshimoshi [... snip ...] koji.ServerOffline: Planned outage for storage move. See: https://fedorahosted.org/fedora-infrastructure/ticket/3882 -- Mathieu -- devel mailing list devel@lists.fedoraproject.org https://admin.fedoraproject.org/mailman/listinfo/devel
Re: Koji down?
On 19/07/13 08:03, Joachim Backes wrote: Getting this when connecting to http://koji.fedoraproject.org/koji --- Internal Server Error The server encountered an internal error or misconfiguration and was unable to complete your request. Please contact the server administrator, ad...@fedoraproject.org and inform them of the time the error occurred, and anything you might have done that may have caused the error. More information about this error may be available in the server error log. Apache/2.2.15 (Red Hat) Server at koji.fedoraproject.org Port 80 Storage migration http://status.fedoraproject.org/ https://lists.fedoraproject.org/pipermail/devel-announce/2013-July/001176.html Kind regards, -- Jamie Nguyen -- devel mailing list devel@lists.fedoraproject.org https://admin.fedoraproject.org/mailman/listinfo/devel
