[Wikitech-l] gitlab maintenance downtime tomorrow
Tomorrow at 8.30am PST / 4.30pm UTC there will be an expected downtime of https://gitlab.wikimedia.org services for a few minutes. A server is physically moving to a new rack. We expect maximum 10 minutes but more likely just 5 minutes of downtime. Nothing will change about the software or data itself. Just don't plan a deployment during this time please. Thank you -- Daniel Zahn Site Reliability Engineer ___ Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
[Wikitech-l] Re: Request MediaWiki +2 for Paladox
Support. Paladox has been contributing literally thousands of patches to various repos, including SRE puppet and especially Gerrit. He is also part of Gerrit upstream. see 3500 merged patches here: https://gerrit.wikimedia.org/r/q/owner:thomasmulhall410%2540yahoo.com+status:merged,3500 On Mon, Jan 22, 2024 at 3:20 PM Tim Starling wrote: > Please consider my request for Paladox to be given +2 rights in > MediaWiki repositories: > > https://phabricator.wikimedia.org/T355619 > > -- Tim Starling > > ___ > Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org > To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org > https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/ > -- Daniel Zahn Site Reliability Engineer ___ Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
[Wikitech-l] Re: [Ops] Re: contint Jenkins maintenance Tue, 11 Jul 2023 08:00-9:30 UTC
Great work! Thank you Jelto and Antoine for wrapping this up. I am happy that our prod CI server is on fresh hardware under warranty again. On Tue, Jul 11, 2023 at 2:32 AM Jelto Wodstrcil wrote: > > Hello all, > the maintenance is done and went as expected. contint2002 is serving > integration.wikimedia.org, jenkins and zuul now. > > If you face any problems, please let us know in > https://phabricator.wikimedia.org/T324659. > > Greetings > Jelto > > On Mon, Jul 10, 2023 at 3:15 PM Jelto Wodstrcil > wrote: >> >> Hi all, >> >> We will perform a short maintenance on contint hosts tomorrow 11 Jul 2023 >> 08:00-9:30 UTC. We will switchover from the old host contin2001 to the new >> host contint2002 due to a hardware refresh. >> The machines host integration.wikimedia.org, an instance of jenkins and >> zuul. Services have to be stopped and restarted, so expect some >> unavailability. Alias/cname contint.wikimedia.org also maps to these >> machines. >> >> If you have any questions, reach out to me or @Antoine Musso in >> https://phabricator.wikimedia.org/T324659. >> >> Greetings >> Jelto > > _______ > Ops mailing list -- o...@lists.wikimedia.org > To unsubscribe send an email to ops-le...@lists.wikimedia.org -- Daniel Zahn Site Reliability Engineer ___ Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
[Wikitech-l] Re: Automatic import of users to /repos/mediawiki on GitLab
> "Your account is pending approval from your GitLab administrator and hence > blocked. Please contact your GitLab administrator if you think this is an > error.". I approved your user just now. On Tue, Jun 6, 2023 at 10:37 PM Zoran Dori wrote: > > Hello, > I don't know if this is related, but when I want to sign in with "Kizule" > account (registered on wikitech.wikimedia.org), I'm having this error "Your > account is pending approval from your GitLab administrator and hence blocked. > Please contact your GitLab administrator if you think this is an error.". > > Can you fix this? :) > > Thank you for your understanding! > > Best regards, > Zoran > > пон, 5. јун 2023. у 23:45 Ahmon Dancy је написао/ла: >> >> Today (Monday June 5th, 2023) at 15:00 UTC (8am US/Pacific) we ran the >> account import operation that was announced a few days ago. The operation >> completed successfully. >> >> You may have received an email from GitLab telling you that SSH keys were >> added to your account. These are SSH keys that are associated with your >> Wikitech account that have been copied into GitLab. >> >> There have been reports of users having difficulty setting up two factor >> authentication (2FA) on their accounts. The problem and workaround is >> described in an existing GitLab issue: >> https://gitlab.com/gitlab-org/gitlab/-/issues/344527. >> >> -- Release Engineering >> >> On Fri, Jun 2, 2023 at 3:22 PM Ahmon Dancy wrote: >>> >>> Hey all, >>> >>> On Monday June 5th, 2023 at 15:00 UTC (8am US/Pacific) we (the Release >>> Engineering Team) will run scripts[0] to add a bunch of users to the >>> /repos/mediawiki group[1] on GitLab. You may see mail from GitLab as a >>> result. >>> >>> We're adding accounts from the wmf and ops LDAP groups, to be synchronized >>> regularly. We'll also be doing a one-time import of the mediawiki group >>> defined in Gerrit. Users will initially be added with a GitLab role of >>> "Developer". If a user has not yet logged into GitLab with their developer >>> account, this process will first create a GitLab account for them. >>> >>> While there's a lot to be done yet, this is one step in migrating MediaWiki >>> development to GitLab. You can track our progress on this at T335921[2], >>> and review a draft of the proposed namespace layout and permissions policy >>> on mw.org[3]. >>> >>> Thanks! >>> >>> -- Release Engineering >>> >>> [0]. >>> https://gitlab.wikimedia.org/repos/releng/gitlab-settings/-/tree/main/group-management >>> [1]. https://gitlab.wikimedia.org/repos/mediawiki/ >>> [2]. https://phabricator.wikimedia.org/T335921 >>> [3]. https://www.mediawiki.org/wiki/GitLab/Policy#MediaWiki_namespace >> >> ___ >> Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org >> To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org >> https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/ > > ___ > Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org > To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org > https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/ -- Daniel Zahn Site Reliability Engineer ___ Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
[Wikitech-l] Gerrit replica downtime (up to 2 hours) on Thu, 25 May
Hello The read-only Gerrit replica[0] will be down for up to 2 hours in 2 days (Thu, 25 May 2023) between 15:00–17:00 UTC[1] due to a scheduled OS upgrade [2]. During this window, git reads from the replica will not work. To my knowledge, this affects bots which rely on the replica for git read operations. Codesearch is currently using gerrit.wikimedia.org and not gerrit-replica.wikimedia.org so should not be affected. If this affects you yoy may consider switching to gerrit.wikimedia.org instead of the replica. Apologies for any inconvenience. Daniel [0]: <https://wikitech.wikimedia.org/wiki/Gerrit/Replica> [1]: <https://zonestamp.toolforge.org/1685026803> [2]: <https://phabricator.wikimedia.org/T334521> -- Daniel Zahn Site Reliability Engineer ___ Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
[Wikitech-l] Re: Gerrit replica downtime (30 minutes) tomorrow Tue, 16 May 13:00-15:00 UTC
> Does this include other uses of gerrit replica? Should extension distributor > be switched to main gerrit? Personally I think so, yes. We can make a list of users and discuss on https://phabricator.wikimedia.org/T336710 I also don't know yet which of the users is causing the highest load compared to others. On Mon, May 15, 2023 at 9:12 PM Brian Wolff wrote: > > Does this include other uses of gerrit replica? Should extension distributor > be switched to main gerrit? > > -- > Brian > > On Tuesday, May 16, 2023, Daniel Zahn wrote: >> >> > This means codesearch will be affected (and won't get updated) and >> > possibly even will be down during that time. >> >> We, at least in my team, would like to switch codesearch (and other >> clients) back to just use gerrit.wikimedia.org and not the replica >> directly. >> >> Just today we agreed to make a new ticket for specifically this, >> because soon we have to reimage the replica to bullseye and add more >> downtime. >> >> The reason we did the split in the past was to reduce load on the main >> gerrit server but meanwhile first the issue has been fixed in newer >> Gerrit >> versions and then also just a few days ago we switched to brand new hardware. >> >> So now if anything it should be beefier than before and even without >> that it seemed already a thing of the past. >> >> And we pay for this with this issue that the replica becomes a second >> production system, with the need for downtimes. It complicates >> fail-over scenarios >> too and in a way means there is never a passive host when we do DC >> switch-over. >> >> So yea, I suggest we change the config of codesearch now to use the >> main gerrit unless you have concerns about that. >> >> On Mon, May 15, 2023 at 1:18 PM Amir Sarabadani wrote: >> > >> > This means codesearch will be affected (and won't get updated) and >> > possibly even will be down during that time. >> > >> > Best >> > >> > Am Mo., 15. Mai 2023 um 22:03 Uhr schrieb Tyler Cipriani >> > : >> >> >> >> Hello >> >> >> >> The read-only Gerrit replica[0] will be down for 30 minutes tomorrow >> >> (Tue, 16 May 2023) between 13:00–15:00 UTC[1] due to network switch >> >> upgrades in codfw row D[2]. >> >> >> >> During this window, git reads from the replica will not work. >> >> >> >> To my knowledge, this affects bots which rely on the replica for git read >> >> operations. >> >> >> >> Apologies for any inconvenience. >> >> >> >> Tyler Cipriani (he/him) >> >> Engineering Manager, Release Engineering >> >> Wikimedia Foundation >> >> >> >> [0]: <https://wikitech.wikimedia.org/wiki/Gerrit/Replica> >> >> [1]: <https://zonestamp.toolforge.org/1684242019> >> >> [2]: <https://phabricator.wikimedia.org/T335042> >> >> _______ >> >> Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org >> >> To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org >> >> https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/ >> > >> > >> > >> > -- >> > Amir (he/him) >> > >> > ___ >> > Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org >> > To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org >> > https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/ >> >> >> >> -- >> Daniel Zahn >> Site Reliability Engineer >> ___ >> Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org >> To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org >> https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/ > > ___ > Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org > To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org > https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/ -- Daniel Zahn Site Reliability Engineer ___ Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
[Wikitech-l] Re: Gerrit replica downtime (30 minutes) tomorrow Tue, 16 May 13:00-15:00 UTC
Thank you Amir! Also here: https://gerrit.wikimedia.org/r/c/labs/codesearch/+/919925 Sorry for duplicate work, merge / abandon either at will from my side. But I used commit message for reasoning and needed a ticket, so linked to new: https://phabricator.wikimedia.org/T336710 Just today in our team meeting it came up and that we should create a dedicated ticket for it. So the patch would either be temporary or simply never be reverted, even after the maintenance. On Mon, May 15, 2023 at 3:27 PM Amir Sarabadani wrote: > > I made the patch: https://gerrit.wikimedia.org/r/c/labs/codesearch/+/919924 I > can merge and deploy it soon. > > Am Di., 16. Mai 2023 um 00:23 Uhr schrieb Daniel Zahn : >> >> I have used codesearch to search for the config of codesearch with things >> like >> >> https://codesearch.wmcloud.org/search/?q=codesearch=== >> >> I did find the puppet module codesearch and a hound config file in there. >> >> But somehow I have not found yet where the "gerrit-replica" URL s configured. >> >> Do you see it? Could that be in Horizon Hiera instead of the repos maybe? >> ___ >> Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org >> To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org >> https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/ > > > > -- > Amir (he/him) > > ___ > Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org > To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org > https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/ -- Daniel Zahn Site Reliability Engineer ___ Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
[Wikitech-l] Re: Gerrit replica downtime (30 minutes) tomorrow Tue, 16 May 13:00-15:00 UTC
I have used codesearch to search for the config of codesearch with things like https://codesearch.wmcloud.org/search/?q=codesearch=== I did find the puppet module codesearch and a hound config file in there. But somehow I have not found yet where the "gerrit-replica" URL s configured. Do you see it? Could that be in Horizon Hiera instead of the repos maybe? ___ Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
[Wikitech-l] Re: Gerrit replica downtime (30 minutes) tomorrow Tue, 16 May 13:00-15:00 UTC
> This means codesearch will be affected (and won't get updated) and possibly > even will be down during that time. We, at least in my team, would like to switch codesearch (and other clients) back to just use gerrit.wikimedia.org and not the replica directly. Just today we agreed to make a new ticket for specifically this, because soon we have to reimage the replica to bullseye and add more downtime. The reason we did the split in the past was to reduce load on the main gerrit server but meanwhile first the issue has been fixed in newer Gerrit versions and then also just a few days ago we switched to brand new hardware. So now if anything it should be beefier than before and even without that it seemed already a thing of the past. And we pay for this with this issue that the replica becomes a second production system, with the need for downtimes. It complicates fail-over scenarios too and in a way means there is never a passive host when we do DC switch-over. So yea, I suggest we change the config of codesearch now to use the main gerrit unless you have concerns about that. On Mon, May 15, 2023 at 1:18 PM Amir Sarabadani wrote: > > This means codesearch will be affected (and won't get updated) and possibly > even will be down during that time. > > Best > > Am Mo., 15. Mai 2023 um 22:03 Uhr schrieb Tyler Cipriani > : >> >> Hello >> >> The read-only Gerrit replica[0] will be down for 30 minutes tomorrow (Tue, >> 16 May 2023) between 13:00–15:00 UTC[1] due to network switch upgrades in >> codfw row D[2]. >> >> During this window, git reads from the replica will not work. >> >> To my knowledge, this affects bots which rely on the replica for git read >> operations. >> >> Apologies for any inconvenience. >> >> Tyler Cipriani (he/him) >> Engineering Manager, Release Engineering >> Wikimedia Foundation >> >> [0]: <https://wikitech.wikimedia.org/wiki/Gerrit/Replica> >> [1]: <https://zonestamp.toolforge.org/1684242019> >> [2]: <https://phabricator.wikimedia.org/T335042> >> ___ >> Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org >> To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org >> https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/ > > > > -- > Amir (he/him) > > ___ > Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org > To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org > https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/ -- Daniel Zahn Site Reliability Engineer ___ Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
[Wikitech-l] Re: [engineering-all] Gerrit downtime maintenance Wed, 10 May 2023 14:00–15:00 UTC
This happened today, Thu, 11 May 2023 at 14:00 UTC. gerrit.wikimedia.org is now on fresh hardware and was upgraded from buster to bullseye. The IP address changed to 208.80.154.151. Also a day before the gerrit version itself was upgraded. We had a little follow-up having to fix CI, to allow the new IP to be contacted by cloud VPSes and a typo in a IPv6 address but these things are now fixed. On Mon, May 8, 2023 at 12:08 PM Tyler Cipriani wrote: > > Hi All > > We're moving the primary Gerrit host to new hardware on Wed, 10 May 2023 at > 14:00 UTC[0] > > There will be downtime during the move. I expect downtime to be less than the > full hour, but please plan for a full hour. > > Apologies for the inconvenience :( > > Tyler Cipriani (he/him) > Engineering Manager, Release Engineering > Wikimedia Foundation > > [0]: <https://phabricator.wikimedia.org/T326368> -- Daniel Zahn Site Reliability Engineer ___ Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
[Wikitech-l] Re: Phabricator migration on Mon Nov 22 - 22:00 UTC (14:00 PST)
We believe we have fixed the issues and have scheduled a new window for this for: this coming Monday, Nov 28th, at 22:00 UTC (14:00 PST) (A new migration plan is linked in the ticket T280597.) On Mon, Nov 21, 2022 at 6:07 PM Daniel Zahn wrote: > > Due to unexpected problems with the phd daemon crashing after some > time on the new server > we had to revert. > > For the moment phab1001 is again the production server as before. > > We will do this again after additional debugging. > > On Thu, Nov 17, 2022 at 1:35 PM Daniel Zahn wrote: > > > > On this coming Monday, Nov 22, at 22:00 UTC (14:00 PST) we are > > planning to migrate the production Phabricator instance from old > > hardware to newer > > hardware. (phab1001 -> phab1004) > > > > We are reserving a 30 minute window to switch over but expect actual > > user impact to be much shorter. > > > > You should not notice much, it's not a Phabricator version or distro > > upgrade, it's all about moving away from old hardware. > > > > We picked a time slot where we expect user traffic to be low. > > > > note: The git-ssh.wikimedia.org service (git over ssh for repos on > > Phabricator) has been disabled > > a while ago already already and has been deprecated. Please use Gitlab > > or Gerrit for all your repo needs. > > > > https://phabricator.wikimedia.org/T280597 > > > > -- > > Daniel Zahn > > Site Reliability Engineer > > > > -- > Daniel Zahn > Site Reliability Engineer -- Daniel Zahn Site Reliability Engineer ___ Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
[Wikitech-l] Re: Phabricator migration on Mon Nov 22 - 22:00 UTC (14:00 PST)
Due to unexpected problems with the phd daemon crashing after some time on the new server we had to revert. For the moment phab1001 is again the production server as before. We will do this again after additional debugging. On Thu, Nov 17, 2022 at 1:35 PM Daniel Zahn wrote: > > On this coming Monday, Nov 22, at 22:00 UTC (14:00 PST) we are > planning to migrate the production Phabricator instance from old > hardware to newer > hardware. (phab1001 -> phab1004) > > We are reserving a 30 minute window to switch over but expect actual > user impact to be much shorter. > > You should not notice much, it's not a Phabricator version or distro > upgrade, it's all about moving away from old hardware. > > We picked a time slot where we expect user traffic to be low. > > note: The git-ssh.wikimedia.org service (git over ssh for repos on > Phabricator) has been disabled > a while ago already already and has been deprecated. Please use Gitlab > or Gerrit for all your repo needs. > > https://phabricator.wikimedia.org/T280597 > > -- > Daniel Zahn > Site Reliability Engineer -- Daniel Zahn Site Reliability Engineer ___ Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
[Wikitech-l] Phabricator migration on Mon Nov 22 - 22:00 UTC (14:00 PST)
On this coming Monday, Nov 22, at 22:00 UTC (14:00 PST) we are planning to migrate the production Phabricator instance from old hardware to newer hardware. (phab1001 -> phab1004) We are reserving a 30 minute window to switch over but expect actual user impact to be much shorter. You should not notice much, it's not a Phabricator version or distro upgrade, it's all about moving away from old hardware. We picked a time slot where we expect user traffic to be low. note: The git-ssh.wikimedia.org service (git over ssh for repos on Phabricator) has been disabled a while ago already already and has been deprecated. Please use Gitlab or Gerrit for all your repo needs. https://phabricator.wikimedia.org/T280597 -- Daniel Zahn Site Reliability Engineer ___ Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
[Wikitech-l] Re: Gitlab Runner on Toolforge
> The Cloud VPS seems to me a bit like an overkill in this particular > situation, but I may be mistaken. This should be mostly limited to: - request project / quota - create VM (by clicking in web UI) - apply puppet role (role::gitlab_runner) (also in web UI) - run puppet agent... and the runner gets created for you On Tue, Nov 15, 2022 at 11:59 AM Marcin Szwarc wrote: > > Hi Tyler > > Thanks for the response. The project is at > https://gitlab.wikimedia.org/toolforge-repos/vector-dark/ > > The Cloud VPS seems to me a bit like an overkill in this particular > situation, but I may be mistaken. > > Marcin > > From: Tyler Cipriani > Sent: Tuesday, November 15, 2022 1:29:16 AM > To: Wikitech-l > Subject: [Wikitech-l] Re: Gitlab Runner on Toolforge > > Hi Marcin! > > It may be possible to set up a runner on toolforge, but I am unaware of > anyone doing that yet. > > We have runners available under the "repos" namespace (that is any project > under the umbrella of https://gitlab.wikimedia.org/repos ). > > But instance-wide runners are still in the works—you can follow progress on > Phabricator task T297426[1]. > > Thanks! > – Tyler > > [0]: > <https://wikitech.wikimedia.org/wiki/Help:Cloud_Services_introduction#Cloud_VPS> > [1]: <https://phabricator.wikimedia.org/T297426> > > Hi Marcin! > > It may be possible to set up a runner on toolforge, but it seems like this > might be a case where a Cloud VPS instance[0] would be more appropriate. > > What's your project on GitLab? > > There are some available runners under the "repos" namespace (that is any > project under the umbrella of https://gitlab.wikimedia.org/repos ). > > Instance-wide generally available runners are something we're working on—you > can follow progress on Phabricator task T297426[1]. > > [0]: > <https://wikitech.wikimedia.org/wiki/Help:Cloud_Services_introduction#Cloud_VPS> > [1]: <https://phabricator.wikimedia.org/T297426> > > On Mon, Nov 14, 2022 at 8:11 AM Marcin Szwarc > wrote: > > Hello, > > > > I made a dark vector skin some time ago and recently I’ve been trying to set > up a CI/CD in order to find regressions (ie. When the Vector skin is updated > and some white elements appear). In order to do so I need a Gitlab Runner > installed. For now, I’ve set it up on my PC, however I’d prefer it to be > hosted on some always-up machine. > > > > I already have a Toolforge tool related to this skin so question arises: Is > it possible to set up Gitlab Runner on Toolforge? Or maybe there’s other way > to do it (perhaps GitHub Actions)? > > > > Thanks in advance, > > Marcin (User:Msz2001) > > ___ > Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org > To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org > https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/ > > ___ > Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org > To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org > https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/ -- Daniel Zahn Site Reliability Engineer ___ Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
[Wikitech-l] Re: Request to post on mailing list.
Welcome to the list, Asif! By the way, there are many lists on our list server. Wikitech-l is one of them but there are also many others. https://lists.wikimedia.org/postorius/lists/?count=200 On Fri, Oct 14, 2022 at 9:01 AM Andre Klapper wrote: > > Hi, > > On Fri, 2022-10-14 at 20:31 +0530, Asif Rahaman wrote: > > I recently contacted Wikimedia and subscribe for the mailing list. I > > would like to post on your mailing list. > > You just did. :) > https://lists.wikimedia.org/hyperkitty/list/wikitech-l@lists.wikimedia.org/ > > Cheers, > andre > -- > Andre Klapper (he/him) | Bugwrangler / Developer Advocate > https://blogs.gnome.org/aklapper/ > ___ > Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org > To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org > https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/ -- Daniel Zahn Site Reliability Engineer ___ Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
[Wikitech-l] Re: Discussing two feature requests?
Hallo Siegfried, ich bin Deutscher mit Wohnsitz in USA. Wenn du willst kann ich deinen Vorschlag ins Englische uebersetzen. Wuerde allerdings empfehlen das dann direkt als Ticket in https://phabricator.wikimedia.org anzulegen. Mfg, Daniel On Sat, Jun 25, 2022 at 11:23 PM Siegfried Schmitt wrote: > > Hello Everyone, > > I would like to propose two - probably new - features for MediaWiki. > Since my native language is German, I would like to discuss these > features with some developers from Germany, Austria, or Switzerland. > My Englisch is really bad and therefore, I would prefer to discuss in > German language. Please feel free to contact me via e-mail. > > Best regards, > > Siegfried > > -- > siegfried.schm...@web.de > ___ > Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org > To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org > https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/ -- Daniel Zahn Site Reliability Engineer ___ Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
[Wikitech-l] Re: [Wikidata] [Small wiki toolkits] Upcoming bots & scripts workshop on Thursday, June 30th, 16:00 UTC
On Sat, Jun 18, 2022 at 2:54 AM Samuel Klein wrote: > Is there any sort of list of mothballed bots looking for good homes / > maintainers? I think basically every bot in the list would benefit from (more) maintainers: IRC bots: https://wikitech.wikimedia.org/wiki/Category:Bots on wiki bots: https://wikitech.wikimedia.org/wiki/Category:Bot_accounts And in general bots that work on Gerrit probably need their equivalent in Gitlab and bots working on IRC might need their equivalent on Slack (which unfortunately became standard for many but lack both volunteers and bots). ___ Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
[Wikitech-l] Re: Amir Sarabadani receives Web Perf Hero award!
> awards should be accompained with some merch giveaway. or how about an extra day off? :) Congratulations Amir! On Thu, May 26, 2022 at 10:51 AM Vi to wrote: > > Half joking half seriously I think awards should be accompained with some > merch giveaway. > > Vito > > Il giorno gio 26 mag 2022 alle ore 16:22 Krinkle ha > scritto: >> >> I'm happy to share that the first Web Perf Hero award of 2022 goes to Amir >> Sarabadani! >> >> This award is in recognition of Amir's work (@Ladsgroup) over the past six >> months, in which he demonstrated deep expertise of the MediaWiki platform >> and significantly sped up the process of saving edits in MediaWiki. This >> improved both the potential of MediaWiki core, and as experienced concretely >> on WMF wikis, especially on Wikidata.org. >> >> Refer to the below medawiki.org page to read about what it took to cut >> latencies by half: >> https://www.mediawiki.org/wiki/Wikimedia_Performance_Team/Web_Perf_Hero_award#Amir_Sarabadani >> >> This award is given on a quarterly basis, and manifests as a Phabricator >> badge: >> https://phabricator.wikimedia.org/badges/view/17/ >> >> -- Timo Tijhof, on behalf of WMF Performance Team. >> >> ___ >> Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org >> To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org >> https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/ > > ___ > Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org > To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org > https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/ -- Daniel Zahn Site Reliability Engineer ___ Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
[Wikitech-l] Re: Etherpad maintenance this Thursday
This has happened today. The scheduled downtime was fully maxed out since we ran into an unexpected issue related to IPv6 at first which has been fixed now. We are now on the new Etherpad version 1.8.16 and on Debian bullseye. On Tue, Feb 8, 2022 at 2:13 PM Daniel Zahn wrote: > > The service Etherpad (https://etherpad.wikimedia.org) might be unreachable > during the following maintenance window: > > This Thursday, Feb 10th 2022, from 17:00 UTC to 18:30 UTC (9 to 10:30 AM PST). > > It will be upgraded to a new version on a new server during this time. > We hope the > actual downtime will be much shorter than that but you should not count on it. > > While existing pads should not be affected by this in any way, please > keep in mind that in general this is a service without an SLO > supported on a best effort basis. > > Best regards, > > Daniel > > -- > Daniel Zahn > Operations Engineer -- Daniel Zahn Operations Engineer ___ Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
[Wikitech-l] Etherpad maintenance this Thursday
The service Etherpad (https://etherpad.wikimedia.org) might be unreachable during the following maintenance window: This Thursday, Feb 10th 2022, from 17:00 UTC to 18:30 UTC (9 to 10:30 AM PST). It will be upgraded to a new version on a new server during this time. We hope the actual downtime will be much shorter than that but you should not count on it. While existing pads should not be affected by this in any way, please keep in mind that in general this is a service without an SLO supported on a best effort basis. Best regards, Daniel -- Daniel Zahn Operations Engineer ___ Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
[Wikitech-l] Re: [Ops] Re: Tendril shutdown
Yes, it's much prettier than dbtree. Nice! On Thu, Feb 3, 2022 at 4:48 PM Aaron Schulz wrote: > > I really like the visual tree on https://orchestrator.wikimedia.org/ . Good > work! > > On Tue, Jan 4, 2022 at 3:18 AM Manuel Arostegui > wrote: >> >> Hello, >> >> If you don’t use tendril.wikimedia.org or dbtree.wikimedia.org, feel free to >> ignore this message. >> >> >> As of today, tendril is now retired and the main page is replaced with a >> list of replacement for different services tendril used to provide: >> >> >> For checking out our dbtree and replication data: >> >> if you are in the NDA LDAP group, use Orchestrator >> >> otherwise, use the information page on noc.wikimedia.org. For more detail >> you can also check eqiad.json or codfw.json >> >> If you are looking for slow queries log, go to slow queries dashboard using >> our standard observability platform (logstash) (NDA required) >> >> >> Tendril has been a great tool for us during the years, but unfortunately it >> is impossible to maintain with modern MariaDB versions (it uses TokuDB, >> which is no longer available on MariaDB after 10.1 and needs to be compiled >> separately) nor its webservice is compatible with modern php versions. Its >> database is still running on Stretch and on MariaDB 10.1 (which has not been >> supported for a year already) and it is having serious scalability issues. >> This would unblock us from removing a lot of legacy home-brew craft and >> replace them with more modern toolings such as orchestrator. >> >> >> Orchestrator has been in place for a few months now, and provides us with a >> great way to see and (in the future) manage replication topologies. For now >> we are using it only for visualization purposes but in the future we’d like >> it to also help us to handle replication changes (it can be done from the UI >> or via CLI) and recover topologies automatically if they fail and involve >> masters or intermediate masters. >> >> >> The slow queries dashboard in logstash offer multiple advantages over >> tendril. You can set the threshold to see slow queries that took longer to >> run. You can filter out code paths you’re not interested in or zoom in to >> relevenet code paths. You can limit it to write queries or read queries >> only. Also, it provides id of the request making the slow query, so you can >> cross check it with the rest of logstash or hadoop to identify problematic >> behavior. >> >> >> If you need it for the transition period, you can still access it in >> tendril-legacy.wikimedia.org. But it will be shut down in a month. You can >> follow the work of shutting down tendril in >> https://phabricator.wikimedia.org/T297605. >> >> >> Thank you. >> >> >> ___ >> Ops mailing list -- o...@lists.wikimedia.org >> To unsubscribe send an email to ops-le...@lists.wikimedia.org > > ___ > Ops mailing list -- o...@lists.wikimedia.org > To unsubscribe send an email to ops-le...@lists.wikimedia.org -- Daniel Zahn Operations Engineer ___ Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
[Wikitech-l] Re: Contributions to Infra
Hello Soham, that would be the SRE team. It has been split into multiple sub teams. Here is a short description of the sub teams and their different work areas: https://www.mediawiki.org/wiki/Wikimedia_Site_Reliability_Engineering Best, Daniel ___ Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
[Wikitech-l] Re: [Ops] Re: Gerrit upgrade August 3rd 16:00 UTC
Thanks for the upgrade! You may have noticed a new feature, "attention set" that is a smarter version of the previous "assignee" feature. I am quite hopeful it can have a positive impact on our review workflows / patterns. For example "If a reviewer replies, then the change owner (and uploader) are added to the attention set." and the other new rules listed on: https://gerrit-review.googlesource.com/Documentation/user-attention-set.html Take a look!:) ___ Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
[Wikitech-l] Re: [Ops] Mailman2 is now shut down (T52864)
congrats! ___ Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
Re: [Wikitech-l] Performance regression expected with Debian Buster upgrade
And additionally I would also delete mwdebug1003, the ganeti VM on stretch that was also there just for the special stretch/buster comparison use case. Would anyone miss it? mwdebug1001/1002 are on buster all this time and won't be changing. On Thu, Apr 15, 2021 at 2:58 PM Daniel Zahn wrote: > > Hi all, one final follow-up, > > It's been a while since 99% of appservers are on buster but we had > still kept 1 special case in each role on stretch, > so that people could make stretch vs. buster comparisons. Some people > had asked for that. > > They are: mw1307 jobrunner/videoscaler,mw1402 API server, > m1403 appserver. > > Now planning to finally upgrade them to buster as well tomorrow to > make that 99% a 100%. > > Please stop me if you still see a reason for having any stretch appserver. -- Daniel Zahn Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Performance regression expected with Debian Buster upgrade
Hi all, one final follow-up, It's been a while since 99% of appservers are on buster but we had still kept 1 special case in each role on stretch, so that people could make stretch vs. buster comparisons. Some people had asked for that. They are: mw1307 jobrunner/videoscaler,mw1402 API server, m1403 appserver. Now planning to finally upgrade them to buster as well tomorrow to make that 99% a 100%. Please stop me if you still see a reason for having any stretch appserver. ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] deployment server upgrade and switch to deploy1002
deploy1001 is being decom'ed now and won't be able to boot anymore. The contents of home dirs has been synced to deploy1002. On Mon, Mar 1, 2021 at 2:58 PM Daniel Zahn wrote: > > deploy1002.eqiad.wmnet is now the active production deployment server :) > > Please stop using deploy1001. scap will also be locked though and the > MOTD will remind you of it. > > On Fri, Feb 26, 2021 at 5:20 PM Daniel Zahn wrote: > > > > Hello deployers, > > > > TLDR: We are upgrading deployment servers, both physical hardware > > (older R430-> newer R440) and OS version (stretch->buster) [1] > > > > What happened so far: > > > > Today we switched the deployment server and scap master for codfw from > > deploy2001 to deploy2002. [2] > > > > What happens next: > > > > On Monday, March 1st, we want to switch the deployment server and scap > > master for eqiad from deploy1001 to deploy1002. [3][4] > > > > The window is "20:00–22:00 UTC # 12:00–14:00 PST" after the morning > > backport window for up to 2 hours. In this time you won't be able to > > deploy. > > > > https://wikitech.wikimedia.org/wiki/Deployments#Monday,_March_01 > > > > Do you have to do anything? > > > > If you connect to "deployment.eqiad.wmnet" the host key will change, > > you can use the scripts to update host keys though and the > > fingerprints are also on wiktech on new (and protected) pages. [5] > > > > Yes, you'll have to retrain muscle memory to switch to deploy1002, > > sorry for that but it's just a new generation every couple of years > > and this way we can also fall back to something if needed. In return > > you should get more performance from the new hardware. > > > > No, you don't need to worry about losing data in your home dir, > > everything has been rsynced over straight into /home on these hosts. > > > > Let us know if you have any questions, > > > > Daniel & Mukunda > > > > [1] https://phabricator.wikimedia.org/T265963 > > [2] https://gerrit.wikimedia.org/r/c/operations/puppet/+/667043 > > [3] https://wikitech.wikimedia.org/wiki/Deployments#Monday,_March_01 > > [4] > > https://gerrit.wikimedia.org/r/q/topic:%22deployment-switch%22+(status:open) > > [5] https://wikitech.wikimedia.org/wiki/Deploy1002 > > > > -- > > Daniel Zahn > > Operations Engineer > > > > -- > Daniel Zahn > Operations Engineer -- Daniel Zahn Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Problem with git clone
On Thu, Mar 4, 2021 at 1:18 PM Bartosz Dziewoński wrote: > As a workaround I usually clone/pull from the GitHub mirrors instead. There is also a replica of gerrit in the other data center that you can clone from. example: git clone https://gerrit-replica.wikimedia.org/r/p/operations/puppet -- Daniel Zahn Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] deployment server upgrade and switch to deploy1002
deploy1002.eqiad.wmnet is now the active production deployment server :) Please stop using deploy1001. scap will also be locked though and the MOTD will remind you of it. On Fri, Feb 26, 2021 at 5:20 PM Daniel Zahn wrote: > > Hello deployers, > > TLDR: We are upgrading deployment servers, both physical hardware > (older R430-> newer R440) and OS version (stretch->buster) [1] > > What happened so far: > > Today we switched the deployment server and scap master for codfw from > deploy2001 to deploy2002. [2] > > What happens next: > > On Monday, March 1st, we want to switch the deployment server and scap > master for eqiad from deploy1001 to deploy1002. [3][4] > > The window is "20:00–22:00 UTC # 12:00–14:00 PST" after the morning > backport window for up to 2 hours. In this time you won't be able to > deploy. > > https://wikitech.wikimedia.org/wiki/Deployments#Monday,_March_01 > > Do you have to do anything? > > If you connect to "deployment.eqiad.wmnet" the host key will change, > you can use the scripts to update host keys though and the > fingerprints are also on wiktech on new (and protected) pages. [5] > > Yes, you'll have to retrain muscle memory to switch to deploy1002, > sorry for that but it's just a new generation every couple of years > and this way we can also fall back to something if needed. In return > you should get more performance from the new hardware. > > No, you don't need to worry about losing data in your home dir, > everything has been rsynced over straight into /home on these hosts. > > Let us know if you have any questions, > > Daniel & Mukunda > > [1] https://phabricator.wikimedia.org/T265963 > [2] https://gerrit.wikimedia.org/r/c/operations/puppet/+/667043 > [3] https://wikitech.wikimedia.org/wiki/Deployments#Monday,_March_01 > [4] > https://gerrit.wikimedia.org/r/q/topic:%22deployment-switch%22+(status:open) > [5] https://wikitech.wikimedia.org/wiki/Deploy1002 > > -- > Daniel Zahn > Operations Engineer -- Daniel Zahn Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
[Wikitech-l] deployment server upgrade and switch to deploy1002
Hello deployers, TLDR: We are upgrading deployment servers, both physical hardware (older R430-> newer R440) and OS version (stretch->buster) [1] What happened so far: Today we switched the deployment server and scap master for codfw from deploy2001 to deploy2002. [2] What happens next: On Monday, March 1st, we want to switch the deployment server and scap master for eqiad from deploy1001 to deploy1002. [3][4] The window is "20:00–22:00 UTC # 12:00–14:00 PST" after the morning backport window for up to 2 hours. In this time you won't be able to deploy. https://wikitech.wikimedia.org/wiki/Deployments#Monday,_March_01 Do you have to do anything? If you connect to "deployment.eqiad.wmnet" the host key will change, you can use the scripts to update host keys though and the fingerprints are also on wiktech on new (and protected) pages. [5] Yes, you'll have to retrain muscle memory to switch to deploy1002, sorry for that but it's just a new generation every couple of years and this way we can also fall back to something if needed. In return you should get more performance from the new hardware. No, you don't need to worry about losing data in your home dir, everything has been rsynced over straight into /home on these hosts. Let us know if you have any questions, Daniel & Mukunda [1] https://phabricator.wikimedia.org/T265963 [2] https://gerrit.wikimedia.org/r/c/operations/puppet/+/667043 [3] https://wikitech.wikimedia.org/wiki/Deployments#Monday,_March_01 [4] https://gerrit.wikimedia.org/r/q/topic:%22deployment-switch%22+(status:open) [5] https://wikitech.wikimedia.org/wiki/Deploy1002 -- Daniel Zahn Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Introducing VideoCutTool version 0.4
On Mon, Feb 22, 2021 at 11:08 AM Gopa Vasanth wrote: > We are excited to announce the release of version 0.4 of VideoCutTool [1]. > VideoCutTool helps users to edit videos in commons Congratulations on the release and thank you very much. Being able to edit videos in commons is always something I was hoping one day would become possible. Nowadays it is. Very nice! -- Daniel Zahn Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Performance regression expected with Debian Buster upgrade
Users who would like to follow the upgrade status / want exact information which server is currently on which distro version are welcome to do so at: https://docs.google.com/spreadsheets/d/1Ris18-joRFfd3OHjGJIraVUk-bpmIRORsPoms9D7BcM/edit?usp=sharing It also tells you which servers have the special roles of scap proxy, mcrouter proxy, canary, and which are VMs (just mwdebug). There is currently one debug server on buster (mwdebug1003) but we are going to provide the full set soon (https://phabricator.wikimedia.org/T274023). For canary servers we are aiming to have both for the transitional period and the situation is currently as follows: mw1261.eqiad.wmnet stretch mw1262.eqiad.wmnet stretch mw1263.eqiad.wmnet buster mw1264.eqiad.wmnet buster mw1265.eqiad.wmnet buster Additionally one appserver (mw1403) and one API server (mw1402) on new hardware have been designated to stay on stretch until the end to allow for comparisons. We appreciate reports of any issues just showing up on buster servers of all types (app, API, jobrunner/videoscaler). ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Thank you Tuesday
Rightfully labeled "Epic" :) ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] List of all articles about cities?
Another way to do it is: Start at https://en.wikipedia.org/wiki/Category:Cities Click through the category tree.. for example from there to "Category:Cities by country" then "Category:Cities in the United States" -> "Category:Cities in the United States by county" -> and so on until you get to a leaf category like "Category:Cities in Pemiscot County, Missouri" that contains actual pages instead of more subcategories. Now go to: https://en.wikipedia.org/wiki/Special:Export and paste the Category:... name into the form field "Add pages from category:". Click "Add" and then "Export". Now you have a single XML file with the contents of the articles of these cities. https://en.wikipedia.org/wiki/Special:Export -> "Add pages from category:"and click 'add' button. ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] WikiContrib 2.0 released!
Easy to use, works and looks nice. The activity list of my own contributions is useful and will probably replace looking at Phabricator feed for me for some purposes. Congrats, Raymond. ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] realtime notifications disabled in Phabricator
re: > "aphlict" service had been disabled on Phabricator because it caused stability issues. I am happy to announce that aphlict, the notification service for Phabricator using websockets, is now finally back again. If you allow it in your Phabricator settings you should get realtime pop-up notifications again (or for the first time ever if you are newer). Also when tasks are moved around on workboards you should see that again without having to reload the page. In your Phabricator Settings -> Applications -> Notifications you can choose from "Web Only", "Desktop Only, "Web and Desktop" or "No Notifications". Up to you which you like most. --- snip --- some technical details follow if you care --- aphlict is now running on a dedicated VM just that is separate from the main Phabricator server, called aphlict1001.eqiad.wmnet. It is running on Debian buster with nodejs 10. We are not using Apache with "mod_proxy_wstunnel" any longer which caused the original instability and even if it was still unstable it would not affect the main Phabricator anymore as it did in the past. Also our caching servers (ATS/Varnish) now speak TLS to an envoy-proxy on the dedicated backend which then proxies to the aphlict service locally. So traffic is encrypted also behind the caching layer and no more httpd is involved. The flow is now: user client -> wss://phabricator.wikimedia.org (ATS) -> ws://:3120 (Varnish) -> wss://aphlict.discovery.wmnet (Envoy) -> (local) nodejs:22280 and separately phab1001 -> aphlict1001:22281 This resolved https://phabricator.wikimedia.org/T238593 ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Request for checking two patches on Gerrit
With all due respect but i believe it does not scale to use this mailing list to ping for individual code reviews. Yes, we really need to fix the issue that getting reviews is too hard and too many users seem to filter Gerrit mail but moving that to "everyone gets mail about all changes" does not appear to be the solution to me. ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Phabricator monthly statistics - 2020-07
> confused why I got this same mail twice, There was a duplicate cron job. Sorry about that. Should be fixed now. -- Daniel Zahn Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Gerrit SSH host keys will change on July 14th
TL;DR: the Gerrit host key change is getting postponed. There will be no Gerrit host key change tomorrow on 2020-07-14. You do not need to take action for now. The host key change will happen, but at a later time. Once there is a new date, we'll announce it on this list again. If you have a service and need help to prepare for the migration or have other specific requirements, please let us know. Knowing that the Gerrit host key will impact many people, we wanted to give an early heads-up and hence announced 7 days early to give every Gerrit user and every maintainer of a service that uses Gerrit plenty time to adjust to the host key change. It turns out that the 7 days have been too optimistic, and for one reason or the other, some services need more time to prepare for the host key switch. So we rather re-schedule and give more time than lock users or services out. If you run a service that talks to Gerrit through SSH, please let us know if you need help with preparing for the change. (We won't re-schedule again :-) ) Also, please let us know if you want to be kept in the loop with the date finding. ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Gerrit SSH host keys will change on July 14th
> that's around 11:00 UTC. Correction: My bad, that is actually 16:00 UTC. ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
[Wikitech-l] Gerrit SSH host keys will change on July 14th
This is a heads-up that we are planning to replace the host keys for the Gerrit SSH server at gerrit.wikimedia.org:29418. The change is planned for Tuesday, July 14th in the PDT morning right after the MediaWiki train, that's around 11:00 UTC. (https://wikitech.wikimedia.org/wiki/Deployments#Tuesday,_July_14) The RSA key will be replaced with a longer version and additionally we will start to offer ecdsa_256, ecdsa_384, ecdsa_521 and ed25519. The service will not be RSA-only anymore which some users had already reported as an issue. After the change on Gerrit, your git / git-review / direct ssh commands are expected to fail with errors about mismatched or changed host keys or host identification. This is expected. You will need to remove the old, no longer used host key, and verify the new one. To remove the old host key, follow the instructions on screen or consult the manual of your SSH software. Once that is done, retry the command, and you'll be prompted to verify the new host key. You can find the new keys for verification in this email below and on https://wikitech.wikimedia.org/wiki/Help:SSH_Fingerprints/gerrit.wikimedia.org:29418 If they match, confirm, and your command should continue. Once you have successfully updated the host key you should no longer see any errors. If you are running any bots talking to gerrit-ssh please also update their configuration accordingly and restart where needed. https://wikitech.wikimedia.org/wiki/Help:SSH_Fingerprints/gerrit.wikimedia.org:29418 ssh_host_rsa_key 2048 SHA256:j9/pXXc9WzjQwYP0t7nlzqH9EBOTw6q7DgcfnamJtsY gerrit-code-rev...@gerrit1001.wikimedia.org (RSA) ssh_host_ecdsa_256_key 256 SHA256:58swSiByT+4LVqs30/FqJpEPj+Mwjtn3WJY5hitlEgM gerrit-code-rev...@gerrit1001.wikimedia.org (ECDSA) ssh_host_ecdsa_384_key 384 SHA256:vFEVzNGuagPmYiw9EIwBStzd0X+gtprZzOi8vbLxAfc gerrit-code-rev...@gerrit1001.wikimedia.org (ECDSA) ssh_host_ecdsa_521_key 521 SHA256:OWb1uenhapK7AFPfEB+NRxgfxhktZ1Q6C5eCy+VbgsY gerrit-code-rev...@gerrit1001.wikimedia.org (ECDSA) ssh_host_ed25519_key 256 SHA256:njCmWMsshq3MqQxyIFO36UNwCwzTamXERqylF1XJhd8 gerrit-code-rev...@gerrit1001.wikimedia.org (ED25519) -- Daniel Zahn Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] "Library" for sharing useful resources for learning technical topics
> let me know if you think it's a horrible idea No, I think it's a good idea. > (mediawiki.org? maybe we should move it to wikitech.wikimedia.org?) Yes, I think we should do that if it's not going to be limited to just MediaWiki. ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Commons app update - v2.13 beta
> the app will check for Nearby places that need photos around that location, > and one is found, it will ask the user "Is this a picture of Place X?" Wow, that's a really nice feature. Thanks for that, Josephine and Commons app team. ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
[Wikitech-l] backend for people.wikimedia.org changed to people1002
Hello WMF shell users, all of you have access to the backend behind https://people.wikimedia.org/ where you can publish your own files. The backend for this is a dedicated VM running on ganeti which until today was people1001.eqiad.wmnet running on stretch (Debian oldstable). Today it has been replaced by people1002.eqiad.wmnet running on buster (Debian stable). All your files have already been rsynced over. You should not have to do anything except remember to now use people1002 instead of people1001 when uploading new files. I have already removed access to people1001 to avoid uploads there but files have not been deleted and I will keep it up for another day or so just in case. https://wikitech.wikimedia.org/wiki/People.wikimedia.org (general info about the service) https://wikitech.wikimedia.org/wiki/People1002 (you can find the fingerprints of the new server here) Ticket if any unexpected issues: https://phabricator.wikimedia.org/T247649 -- Daniel Zahn Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Codelab: Getting Started with Git & Gerrit
Nice work! Feel free to link it on https://wikitech.wikimedia.org/wiki/Gerrit One thing i'd like to add is nowadays we recommend to use ed25519 instead of rsa keys. (or a 4096 bit RSA) https://wikitech.wikimedia.org/wiki/Production_access#Generating_your_SSH_key On Mon, Jan 6, 2020 at 4:24 PM Manuel Alcaraz wrote: > > Hi community, > > I've written a codelab to help new contributors to getting started with Git > and Gerrit. > It's available in the following webpage: > https://dev-codelabs.web.app/codelabs/getting-started-with-git-and-gerrit/index.html?index=..%2F..index=UA-144197354-4#0 > > Regards, > Manuel Alcaraz > > PS: Many thanks to Martin for reviewing my work. > ___ > Wikitech-l mailing list > Wikitech-l@lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/wikitech-l -- Daniel Zahn Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Phabricator upgrade window next Wednesday 00:00 UTC
It turned out BIOS settings on phab1001 were such that disks were running under "legacy IDE" mode and write cache was turned off. This was really bad for performance. Changing that in BIOS unfortunately also means complete data loss. So we had to go back to phab1003 yesterday, fix phab1001, reimage it, rsync all the data again and finally (today) switch to phab1001 for real. The good part is that the process to switch is now simplified and there was basically no downtime for users besides the rarely used git-ssh service, which is also fixed now. This is done now. On Wed, Dec 4, 2019 at 12:14 AM Daniel Zahn wrote: > This has happened. The Phabricator production server is now phab1001 > (again) and not phab1003 anymore. > > Phabricator now runs on Debian stable (buster) and PHP 7.3. > > https://phabricator.wikimedia.org/T238956 shows all the related patches > and can be used to report issues. > -- Daniel Zahn Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Phabricator upgrade window next Wednesday 00:00 UTC
This has happened. The Phabricator production server is now phab1001 (again) and not phab1003 anymore. Phabricator now runs on Debian stable (buster) and PHP 7.3. https://phabricator.wikimedia.org/T238956 shows all the related patches and can be used to report issues. ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] realtime notifications disabled in Phabricator
You voices have been heard. We'll have a meeting next week to talk about how to reactivate it. On Tue, Nov 26, 2019 at 10:50 AM Trey Jones wrote: > * work on a board with multiple people remotely, with everyone having an >> up to date view of the board, avoiding interference and confusion. This was >> REALLY helpful. > > > This use case is very valuable for our remote team as well. We got > confused and interfered with each other during sprint planning just > yesterday because we forgot this feature was disabled. It has been much > easier to collectively update the workboards since it was introduced; we'd > love to have it back. > > Trey Jones > Sr. Software Engineer, Search Platform > Wikimedia Foundation > UTC-5 / EST > > > On Tue, Nov 26, 2019 at 5:38 AM Daniel Kinzler > wrote: > >> While I don't care much about the "this task was updated" popups, I do >> miss the >> immediate updates of workboards. It enables two use cases previously >> missing: >> >> * have a board open in a tab to keep track on progress, without the need >> to >> reload every time you look at it >> >> * work on a board with multiple people remotely, with everyone having an >> up to >> date view of the board, avoiding interference and confusion. This was >> REALLY >> helpful. >> >> Can we get this back, please? >> >> Am 26.11.19 um 02:10 schrieb Daniel Zahn: >> > Ah. Yes, this sounds like the relatively new feature from: >> > >> > https://secure.phabricator.com/T13357 >> > https://secure.phabricator.com/T4900 >> > >> > It is affected then. >> > >> > On Mon, Nov 25, 2019 at 6:30 PM David Barratt >> > wrote: >> > >> >> I think they mean that if you have the board open and someone else >> moves a >> >> task, it will update on your end in realtime. >> >> >> >> I imagine this *would* be affected by the change. >> >> >> >> On Mon, Nov 25, 2019 at 6:28 PM Daniel Zahn >> wrote: >> >> >> >>> On Mon, Nov 25, 2019 at 11:21 AM Sebastian Berlin < >> >>> sebastian.ber...@wikimedia.se> wrote: >> >>> >> >>>> Is that also the reason why tasks don't update in realtime on the >> >>>> workboards anymore? >> >>>> >> >>> >> >>> If you mean tasks moving from column to column in workboards, no that >> is >> >>> unrelated and done by the >> >>> Phabricator maintenance bot by Amir Sarabadani, afaik. >> >>> >> >>> -- >> >>> Daniel Zahn >> >>> Operations Engineer >> >>> ___ >> >>> Wikitech-l mailing list >> >>> Wikitech-l@lists.wikimedia.org >> >>> https://lists.wikimedia.org/mailman/listinfo/wikitech-l >> >> ___ >> >> Wikitech-l mailing list >> >> Wikitech-l@lists.wikimedia.org >> >> https://lists.wikimedia.org/mailman/listinfo/wikitech-l >> > >> > >> > >> >> -- >> Daniel Kinzler >> Principal Software Engineer, Core Platform >> Wikimedia Foundation >> >> ___ >> Wikitech-l mailing list >> Wikitech-l@lists.wikimedia.org >> https://lists.wikimedia.org/mailman/listinfo/wikitech-l > > -- Daniel Zahn Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
[Wikitech-l] Phabricator upgrade window next Wednesday 00:00 UTC
Next Wednesday, December 4th, at 00:00 UTC (4pm San Francisco) there will be a Phabricator upgrade window that might last up to 2 hours. While we expect downtime to be much shorter than that Phabricator might be unreachable in that time frame. We are switching the production Phabricator server to a buster (Debian stable) machine. https://phabricator.wikimedia.org/T238956 -- Daniel Zahn Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] realtime notifications disabled in Phabricator
Ah. Yes, this sounds like the relatively new feature from: https://secure.phabricator.com/T13357 https://secure.phabricator.com/T4900 It is affected then. On Mon, Nov 25, 2019 at 6:30 PM David Barratt wrote: > I think they mean that if you have the board open and someone else moves a > task, it will update on your end in realtime. > > I imagine this *would* be affected by the change. > > On Mon, Nov 25, 2019 at 6:28 PM Daniel Zahn wrote: > > > On Mon, Nov 25, 2019 at 11:21 AM Sebastian Berlin < > > sebastian.ber...@wikimedia.se> wrote: > > > > > Is that also the reason why tasks don't update in realtime on the > > > workboards anymore? > > > > > > > If you mean tasks moving from column to column in workboards, no that is > > unrelated and done by the > > Phabricator maintenance bot by Amir Sarabadani, afaik. > > > > -- > > Daniel Zahn > > Operations Engineer > > ___ > > Wikitech-l mailing list > > Wikitech-l@lists.wikimedia.org > > https://lists.wikimedia.org/mailman/listinfo/wikitech-l > _______ > Wikitech-l mailing list > Wikitech-l@lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/wikitech-l -- Daniel Zahn Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] realtime notifications disabled in Phabricator
On Mon, Nov 25, 2019 at 11:21 AM Sebastian Berlin < sebastian.ber...@wikimedia.se> wrote: > Is that also the reason why tasks don't update in realtime on the > workboards anymore? > If you mean tasks moving from column to column in workboards, no that is unrelated and done by the Phabricator maintenance bot by Amir Sarabadani, afaik. -- Daniel Zahn Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
[Wikitech-l] realtime notifications disabled in Phabricator
Phabricator users, this is to let you know that the "aphlict" service has been disabled on Phabricator (for now) because it caused stability issues. This means you will not get realtime (pop-up) notifications on Phabricator. (If you had those enabled in the first place). Regular notifications (that do not pop-up) and emails are not affected by this. https://phabricator.wikimedia.org/T238593 -- Daniel Zahn Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Gerrit: Server maintenance
If you happen to notice weird behaviour with some Gerrit patches that show as unmerged when they are actually merged or similar, please just leave them as they are for now but do add links to this ticket: https://phabricator.wikimedia.org/T236114 Unfortunately some got in a bad state during the migration but it is being worked on. ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Gerrit: Server maintenance
This has been completed. Gerrit is now running on Debian Buster and a new server, gerrit1001, with 64GB RAM. Next will be tuning the config to make use of it. ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Phabricator monthly statistics - 2019-07
On Tue, Aug 27, 2019 at 5:59 PM Zppix wrote: > Why are we receiving this now? > Because i ran it after https://gerrit.wikimedia.org/r/c/operations/puppet/+/532711 for https://phabricator.wikimedia.org/T231320 and mail delivery is delayed a bit. ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Difference between #goal and #epic
#goal means a team has picked it as one of their goals to finish it in this or an upcoming quarter and #epic just means it is the opposite of trivial.. as in "takes really long / is complex / involves many people". afaict On Tue, Jul 16, 2019 at 1:23 PM Martin Urbanec wrote: > Hello everyone, > > what is the exact difference between #goal and #epic on Phabricator? > > Thanks > > Martin / Urbanecm > ___ > Wikitech-l mailing list > Wikitech-l@lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/wikitech-l -- Daniel Zahn Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] planned Phabricator upgrade tomorrow
It took a bit longer than expected but this is now done and we are read-write again and serving Phabricator from the new server phab1003. ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
[Wikitech-l] planned Phabricator upgrade tomorrow
Tomorrow we have planned a major upgrade of the Phabricator prod server. Starting from around 00:00 UTC (after Evening SWAT) we want to switch from phab1001 to phab1003 as the production server. This will involve: - switching from jessie to stretch - switching from mod_php to php-fpm - switching from PHP 5 to PHP 7.2 - upgrading apache from 2.4.10 to 2.4.25 We are also hoping it will finally fix the httpd memory leaks we have been seeing on the current server for a long time and which require periodic service restarts. In case we run into any unexpected issue we will simply fall back to phab1001 and keep running as before. https://phabricator.wikimedia.org/T221389 https://phabricator.wikimedia.org/T182832 https://phabricator.wikimedia.org/T190568 https://phabricator.wikimedia.org/T151070 Cheers, Daniel and Mukunda -- Daniel Zahn Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Gerrit Vandalism
On Tue, Mar 19, 2019 at 7:46 AM David Barratt wrote: > Several of my patches were vandalized, should I fix them or leave them > alone? > They should have been fixed. Are they still broken now? Please send a link to them. -- Daniel Zahn Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] PolyGerrit theme has been updated for gerrit.wikimedia.org
Thanks Paladox and Tyler. This made me finally opt-in and switch to Polygerrit now for my own everyday UI. ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Industry news: GitHub policy change for free private repos with up to 3 collaborators
> students and developers of small projects where privacy of code is a concern These examples strike me more as a reason to (encourage to) keep the code public though. ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
[Wikitech-l] mwmaint1001 has been replaced by mwmaint1002
PSA: if you need access to the mediawiki maintenance server, we are back in eqiad and mwmaint1001 was just a temporary replacement for terbium. The correct server name to use is now: mwmaint1002.eqiad.wmnet The fingerprints are on: https://wikitech.wikimedia.org/wiki/Help:SSH_Fingerprints/mwmaint1002.eqiad.wmnet https://wikitech.wikimedia.org/wiki/Mwmaint1002 -- Daniel Zahn Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Collecting UI feedback for PolyGerrit - Gerrit
On Thu, Oct 4, 2018 at 11:15 AM, Gergo Tisza wrote: > * Avatars are really nice and make the whole experience more human. (They > are not enabled on the Wikimedia Gerrit yet, right?) > Yes, that is/was a bit more complicated than it may seem. For security reasons we have a separate domain for user uploads. As you might have noticed on Phabricator we use phab.wmfusercontent.org for uploaded files. In the same way we needed to first create gerrit.wmfusercontent.org to make this possible, followed by Varnish config for it, then Apache and so on. As Paladox pointed out a bunch of things have already been merged but at least 2 are left open. Having reviewed/merged most of the previous ones i will look into pushing this forward again to finalize it. Then we will have avatars on Gerrit. https://phabricator.wikimedia.org/T191183#4278525 https://gerrit.wikimedia.org/r/#/q/project:operations/puppet+branch:production+topic:gerrit-avatars -- Daniel Zahn Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Sensitive IRC bots - be careful out there!
Also these can help preventing it from happening again even if you mention a lot of nicks: < legoktm> he should also auth with freenode < paladox> if he gets a wikimedia cloak or a wikipedia cloak the bot will not kick him. ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Sensitive IRC bots - be careful out there!
Hey Jon, you should be unbanned. I asked in #freenode and they removed it. <@Unit193> mutante: I've removed it at this point. -- Daniel Zahn Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Can/should my extensions be deleted from the Wikimedia Git repository?
On Thu, Jun 7, 2018 at 11:40 PM, Max Semenik wrote: > My personal opinion is twofold: > I agree with Max here. The CoC applies anyways whether the file is in the repo or not because Wikimedia infrastructure is being used. But we should not make it mandatory to keep a copy of this file in each and every repo. I don't see how "not having the file is against the CoC itself" because it certainly doesn't say anything about that, in that regard Yaron is correct. -- Daniel Zahn Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Planet Wikimedia using new software "rawdog"
I made a ticket for it to check which ones we may want and which we don't. https://phabricator.wikimedia.org/T196231 On Sat, Jun 2, 2018 at 10:12 PM, Sam Wilson wrote: > Good idea for some of them, but I'm not sure everyone wants to read the > latest Stack Exchange and Reddit posts with random questions about > MediaWiki. Although, it's not like the planet gets *all* that many posts a > day at the moment, so perhaps it'd be okay? > > > On 02/06/18 23:12, Daniel Zahn wrote: > >> Nice. Let's add these MediaWiki feeds to the en.planet feeds, assuming >> they >> are all English and since Mediawiki is like >> a subgroup of Wikimedia. >> >> On Sat, Jun 2, 2018 at 3:53 AM, Sam Wilson wrote: >> >> At the hackathon last week I had a play with setting up a similar thing >>> just for MediaWiki feeds: >>> >>> https://tools-static.wmflabs.org/mediawiki-feeds/ >>> >>> >>> >>> On 31/05/18 09:33, Daniel Zahn wrote: >>> >>> Hi, >>>> >>>> this is an announcement to let you know that the service ($lang). >>>> planet.wikimedia.org, an RSS feed aggregator for all Wikimedia related >>>> blogs, has switched software. >>>> >>>> You can find the English version at https://en.planet.wikimedia.org/ >>>> >>>> Other existing languages are listed on >>>> https://wikitech.wikimedia.org/wiki/Planet.wikimedia.org#Whi >>>> ch_languages_exist >>>> ? >>>> >>>> Today we moved away from planet-venus and to a newer package called >>>> "rawdog" that does the same thing as before, fetching a bunch of RSS >>>> feed >>>> and combining them into a single page and feed. >>>> >>>> The reason is that planet-venus has been dropped in Debian stable >>>> (stretch) >>>> because it was unmaintained, so we had to find an alternative to be able >>>> to >>>> upgrade the underlying servers to a current OS version. >>>> >>>> If you never heard of planet, here you can find more info: >>>> >>>> https://wikitech.wikimedia.org/wiki/Planet.wikimedia.org >>>> >>>> If you already use it but just subscribe to the "feed of feeds" then >>>> nothing should change for you. >>>> >>>> (Though note that we support RSS 2.0 but not a separate Atom feed >>>> anymore. >>>> We are redirecting the old atom.xml URL to the new (and old) URL >>>> rss20.xml.) >>>> >>>> If you already use it and look at the web UI, enjoy the new theme that >>>> Paladox imported from KDE to make it look about 150% better than before. >>>> (thanks to him for that theming work!) >>>> >>>> We also applied patches to make it look more like our former planet for >>>> a >>>> smooth transition. A "wmf1" package has been built and uploaded at >>>> https://apt.wikimedia.org/wikimedia/pool/main/r/rawdog/ >>>> >>>> If you want to know more about "rawdog": >>>> >>>> https://offog.org/code/rawdog/ >>>> https://packages.debian.org/stretch/rawdog >>>> >>>> If you want to add your blog feed, feel free to upload changes or just >>>> drop >>>> me a mail. >>>> >>>> Bugs can be reported here: >>>> https://phabricator.wikimedia.org/project/view/413/ >>>> >>>> Tickets are: https://phabricator.wikimedia.org/T180498 , >>>> https://phabricator.wikimedia.org/T168490 >>>> >>>> Cheers, >>>> >>>> Daniel >>>> >>>> >>>> ___ >>> Wikitech-l mailing list >>> Wikitech-l@lists.wikimedia.org >>> https://lists.wikimedia.org/mailman/listinfo/wikitech-l >>> >>> >> >> >> > ___ > Wikitech-l mailing list > Wikitech-l@lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/wikitech-l > -- Daniel Zahn Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Planet Wikimedia using new software "rawdog"
Nice. Let's add these MediaWiki feeds to the en.planet feeds, assuming they are all English and since Mediawiki is like a subgroup of Wikimedia. On Sat, Jun 2, 2018 at 3:53 AM, Sam Wilson wrote: > At the hackathon last week I had a play with setting up a similar thing > just for MediaWiki feeds: > > https://tools-static.wmflabs.org/mediawiki-feeds/ > > > > On 31/05/18 09:33, Daniel Zahn wrote: > >> Hi, >> >> this is an announcement to let you know that the service ($lang). >> planet.wikimedia.org, an RSS feed aggregator for all Wikimedia related >> blogs, has switched software. >> >> You can find the English version at https://en.planet.wikimedia.org/ >> >> Other existing languages are listed on >> https://wikitech.wikimedia.org/wiki/Planet.wikimedia.org#Whi >> ch_languages_exist >> ? >> >> Today we moved away from planet-venus and to a newer package called >> "rawdog" that does the same thing as before, fetching a bunch of RSS feed >> and combining them into a single page and feed. >> >> The reason is that planet-venus has been dropped in Debian stable >> (stretch) >> because it was unmaintained, so we had to find an alternative to be able >> to >> upgrade the underlying servers to a current OS version. >> >> If you never heard of planet, here you can find more info: >> >> https://wikitech.wikimedia.org/wiki/Planet.wikimedia.org >> >> If you already use it but just subscribe to the "feed of feeds" then >> nothing should change for you. >> >> (Though note that we support RSS 2.0 but not a separate Atom feed anymore. >> We are redirecting the old atom.xml URL to the new (and old) URL >> rss20.xml.) >> >> If you already use it and look at the web UI, enjoy the new theme that >> Paladox imported from KDE to make it look about 150% better than before. >> (thanks to him for that theming work!) >> >> We also applied patches to make it look more like our former planet for a >> smooth transition. A "wmf1" package has been built and uploaded at >> https://apt.wikimedia.org/wikimedia/pool/main/r/rawdog/ >> >> If you want to know more about "rawdog": >> >> https://offog.org/code/rawdog/ >> https://packages.debian.org/stretch/rawdog >> >> If you want to add your blog feed, feel free to upload changes or just >> drop >> me a mail. >> >> Bugs can be reported here: >> https://phabricator.wikimedia.org/project/view/413/ >> >> Tickets are: https://phabricator.wikimedia.org/T180498 , >> https://phabricator.wikimedia.org/T168490 >> >> Cheers, >> >> Daniel >> >> > ___ > Wikitech-l mailing list > Wikitech-l@lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/wikitech-l > -- Daniel Zahn Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] wgEmergencyContact - n...@wikipedia.org
n...@wikipedia.org is a real working address. It is an alias for n...@wikimedia.org and that is an alias for root@ and that is an alias for all people with root on the cluster. You would reach real people there. ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Planet Wikimedia using new software "rawdog"
On Wed, May 30, 2018 at 9:58 PM, Brion Vibber wrote: > > I would probably recommend googling software names for common > alternate meanings Fair enough. yea, i wasn't really aware / noticed this. Though i think we might have a Barbara-Streisand-effect and now everybody looked it up. > before choosing to put them in a public-facing role, > The end-user isn't really exposed to it besides a small "powered by" link at the bottom. Also not the name of the puppet module, just a package name in Debian. Not like we are running rawdog.wikimedia or anything. On Thu, May 31, 2018 at 2:08 AM, David Cuenca Tudela wrote: > I like the new design :) It's from Planet KDE and customized. Paladox did that. Files are here: https://gerrit.wikimedia.org/r/#/c/435327/ > missing some information about the source of each post. Please see the screenshot Paladox just sent. Is that what you meant? > could the Planet be linked from the Wikimedia blog Sure, i'm all for that. As Andre pointed out this would be something for people maintaining the blog though. That is hosted outside our infrastructure and i don't personally have access to that. -- Daniel Zahn Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Planet Wikimedia using new software "rawdog"
On Wed, May 30, 2018 at 6:57 PM, Brion Vibber wrote: > ... Well, that's a bit of an unfortunate name. o_O > :p "rawdog is an RSS Aggregator Without Delusions Of Grandeur" -- Daniel Zahn Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
[Wikitech-l] Planet Wikimedia using new software "rawdog"
Hi, this is an announcement to let you know that the service ($lang). planet.wikimedia.org, an RSS feed aggregator for all Wikimedia related blogs, has switched software. You can find the English version at https://en.planet.wikimedia.org/ Other existing languages are listed on https://wikitech.wikimedia.org/wiki/Planet.wikimedia.org#Which_languages_exist ? Today we moved away from planet-venus and to a newer package called "rawdog" that does the same thing as before, fetching a bunch of RSS feed and combining them into a single page and feed. The reason is that planet-venus has been dropped in Debian stable (stretch) because it was unmaintained, so we had to find an alternative to be able to upgrade the underlying servers to a current OS version. If you never heard of planet, here you can find more info: https://wikitech.wikimedia.org/wiki/Planet.wikimedia.org If you already use it but just subscribe to the "feed of feeds" then nothing should change for you. (Though note that we support RSS 2.0 but not a separate Atom feed anymore. We are redirecting the old atom.xml URL to the new (and old) URL rss20.xml.) If you already use it and look at the web UI, enjoy the new theme that Paladox imported from KDE to make it look about 150% better than before. (thanks to him for that theming work!) We also applied patches to make it look more like our former planet for a smooth transition. A "wmf1" package has been built and uploaded at https://apt.wikimedia.org/wikimedia/pool/main/r/rawdog/ If you want to know more about "rawdog": https://offog.org/code/rawdog/ https://packages.debian.org/stretch/rawdog If you want to add your blog feed, feel free to upload changes or just drop me a mail. Bugs can be reported here: https://phabricator.wikimedia.org/project/view/413/ Tickets are: https://phabricator.wikimedia.org/T180498 , https://phabricator.wikimedia.org/T168490 Cheers, Daniel -- Daniel Zahn Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Commons app - version 2.7 release
> - New "Nearby places that need pictures" UI with direct uploads (and associated category suggestions) - Woohoo. That's exactly what i was always missing and was so great about the old WikiLovesMonuments app. Thank you very much! > Enabled two-factor authentication login Also very nice, just wondering what the second factor is on mobile, since usually that's a mobile app as well. Does that still make it 2 factors? P.S. Crossposting to multiple mailing lists at once with CC: can be tricky, maybe better send a separate mail to each. ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Dead Links
Please mail the list owners directly at wikitech-l-ow...@lists.wikimedia.org ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] [Ops] new deployment server (tin -> deploy)
After some more discussion on IRC we agreed that re-installing deploy1001 with jessie is best for now since it let's us decom tin and solve the problem that it is old hardware without mixing it with the stretch upgrade. The upgrade can then be done separately. I reinstalled deploy1001 with jessie and re-added it to dsh groups but we have not switched back to it yet. We are still on tin right now. ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] [Ops] new deployment server (tin -> deploy)
There is also the option to reinstall deploy1001 with jessie so that we get out of the old hardware out of warranty (the real motivator to replace it) without doing the jessie->stretch upgrade. I had offered both. > terbium/wasat do rely on mwscript for production critical jobs. I guarantee they will magically explode Nobody has suggested to upgrade these yet. It's strictly deployment_servers we are doing here. ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] You can now translate Phabricator to your language
Great work! It made me create a fresh TranslateWiki user and add some German translations of Phabricator strings. ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Thank you 2017 code reviewers
> Inspired by that, for 2018, my goal will be to review one MediaWiki patch by a volunteer for each day I'm working That's an impressive goal. Very cool. I'll try to merge volunteer patches in operations/puppet repo where they appear :) -- Daniel Zahn <dz...@wikimedia.org> Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Phabricator monthly statistics - 2017-12
I'll run it on the server if somebody creates a ticket for it and optionally pastes the new queries. Is it really just replacing "INTERVAL 1 MONTH" with "INTERVAL 1 YEAR" across the whole file? The optimal outcome would be a patch in Gerrit that makes the INTERVAL in community_metrics.sh a parameter and adds an additional cronjob in puppet. So that it automatically runs it with 1 YEAR interval on Jan 1st and there is no more need for manual things in the future... if there is enough demand for this. ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
[Wikitech-l] ganglia.wikimedia.org has been retired
This is a notice that as part of "T177195 Reduce technical debt in metrics monitoring <https://phabricator.wikimedia.org/T177195>" the service ganglia.wikimedia.org has been retired and removed from DNS. It had already been in a deprecation period and served a notice about it for a while. The replacement service is https://grafana.wikimedia.org/ If you see references to it in wiki or code, please feel free to update and/or create/request new grafana dashboards. --- refs: https://phabricator.wikimedia.org/T177225 https://gerrit.wikimedia.org/r/#/q/topic:kill-ganglia+(status:open+OR+status:merged) https://phabricator.wikimedia.org/T177195 -- Daniel Zahn <dz...@wikimedia.org> Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Try out the commit message validator
There is the file "typos" in the operations/puppet repo: https://github.com/wikimedia/puppet/blob/production/typos There is an existing CI check that checks against words in that fil. If you know common typos you can just add them to that file. This could probably be copied from ops/puppet to another repos the same way. ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Question Pertaining to the "stats.grok.se" Page Containing Pre-2015 Page-View Data
Karl, you should probably ask Erik Zachte about grok.se https://www.wired.com/2013/12/erik-zachte-wikistats/ https://en.wikipedia.org/wiki/User:Erik_Zachte ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Technical Debt SIG...
> discussion regarding MediaWiki Technical Debt. Is it limited to MediaWiki or is it all Wikimedia Tech Debt? On Thu, Aug 17, 2017 at 2:11 PM, Jean-Rene Branaa <jbra...@wikimedia.org> wrote: > Hello All, > > I'm reaching out to invite you to an ongoing discussion regarding MediaWiki > Technical Debt. The topic of technical debt has been discussed in a number > of forums, and there's even been some work towards reducing it. > > This SIG's purpose is to get better alignment on what technical debt is, > how to approach reducing it, and what are things we can do to avoid it > moving forward. > > If you'd like to attend, please register here by August 22nd: > > https://goo.gl/forms/6sFWuBxfgGfwNUZ93 > > I'm trying to get a sense of those that are interested in attending and > their timezone. I look to schedule sessions that are timezone friendly. > > Thanks and look forward to some good discussion. > > Cheers, > > JR > > Jean-Rene Branaa (irc: jrbranaa) > RelEng Team > ___ > Wikitech-l mailing list > Wikitech-l@lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/wikitech-l -- Daniel Zahn <dz...@wikimedia.org> Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Phabricator monthly statistics - 2017-07
I ran those scripts manually, after i noticed they had failed.. and then were fixed: - 03:55 mutante: phab1001 /usr/local/bin/community_metrics.sh | /usr/local/bin/project_changes.sh creating stats mails to admins (which failed before) (T163938 <https://phabricator.wikimedia.org/T163938>) - 03:25 mutante: phab1001 /srv/phab/tools/public_task_dump.py to create dump, was failed cron due to missing /srv/dumps/ On Tue, Aug 8, 2017 at 11:18 AM, Pine W <wiki.p...@gmail.com> wrote: > It seems that two messages were sent which should have covered July: > > https://lists.wikimedia.org/pipermail/wikitech-l/2017-August/088550.html > > https://lists.wikimedia.org/pipermail/wikitech-l/2017-August/088578.html > > Pine > > > On Mon, Aug 7, 2017 at 8:54 PM, <communitymetr...@wikimedia.org> wrote: > > > > > Hi Community Metrics team, > > > > This is your automatic monthly Phabricator statistics mail. > > > > Accounts created in (2017-07): 432 > > Active Maniphest users (any activity) in (2017-07): 888 > > Task authors in (2017-07): 499 > > Users who have closed tasks in (2017-07): 280 > > > > Projects which had at least one task moved from one column to another on > > their workboard in (2017-07): 293 > > > > Tasks created in (2017-07): 2776 > > Tasks closed in (2017-07): 2267 > > Open and stalled tasks in total: 35271 > > > > Median age in days of open tasks by priority: > > > > Unbreak now: 18 > > Needs Triage: 297 > > High: 536 > > Normal: 727 > > Low: 973 > > Lowest: 954 > > > > (How long tasks have been open, not how long they have had that priority) > > > > Active Differential users (any activity) in (2017-07): 24 > > > > TODO: Numbers which refer to closed tasks might not be correct, as > > described in https://phabricator.wikimedia.org/T1003 . > > > > Yours sincerely, > > Fab Rick Aytor > > > > (via community_metrics.sh on phab1001 at Tue Aug 8 03:54:29 UTC 2017) > > > > ___ > > Wikitech-l mailing list > > Wikitech-l@lists.wikimedia.org > > https://lists.wikimedia.org/mailman/listinfo/wikitech-l > ___ > Wikitech-l mailing list > Wikitech-l@lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/wikitech-l > -- Daniel Zahn <dz...@wikimedia.org> Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] [AI] ORES service is having trouble
I merged Gabriel's patch to limit memory usage to 2G. ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] [AI] ORES service is having trouble
- 19:24 mutante: scb1001 - killed process 10971 (pdfrendering/electron) This apparently fixed it. I see there is already this https://gerrit.wikimedia.org/r/35 now ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
[Wikitech-l] irc.wikimedia.org (kraz) reboot
Hi, this is to let you know that kraz, the server that runs irc.wikimedia.org had to be rebooted for a kernel upgrade. If you have IRC clients on that server (i know some use it for anti-vandal tools etc), and the clients don't auto-reconnect, please make them connect again now. (And ideally fix them so they automatically do it in the future). Thank you -- Daniel Zahn <dz...@wikimedia.org> Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Maintainers needed for Grrrit-wm
You might want to remove yourself from https://www.mediawiki.org/wiki/Grrrit-wm and the translated versions of that, like https://www.mediawiki.org/wiki/Grrrit-wm/es https://www.mediawiki.org/wiki/Grrrit-wm/ja I just ran into that via Google, like "grrritt-wm es un bot de IRC manejado por Yuvipanda." and Paladox pointed out this mail. On Mon, Sep 12, 2016 at 9:34 AM, Yuvi Panda <yuvipa...@gmail.com> wrote: > Hello! > > Grrrit-wm[1] is an IRC bot that reports gerrit activiy to IRC. I've > been maintaining it for a few years now, but I no longer have the > bandwidth to do this. I'm going to remove myself as maintainer > shortly. It already has a bunch of people as maintainers on tool labs, > and anyone with +2 on mediawiki core can merge changes in it. > Hopefully that's all good enough :) > > Thanks for all the fish! > > [1] https://wikitech.wikimedia.org/wiki/Grrrit-wm > > -- > Yuvi Panda T > http://yuvi.in/blog > > ___ > Wikitech-l mailing list > Wikitech-l@lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/wikitech-l -- Daniel Zahn <dz...@wikimedia.org> Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] [Engineering] git.wikimedia.org (Gitblit) going away on June 29th, redirected to Phabricator
This is done now. We stopped using gitblit for good!:) git.wikimedia.org URLs now redirect to Diffusion. redirect rules here: https://gerrit.wikimedia.org/r/#/c/296138/ tested URLs here: https://phabricator.wikimedia.org/P3318 https://phabricator.wikimedia.org/T137224 was resolved https://phabricator.wikimedia.org/T111465 can be closed antimony was removed from varnish config: https://gerrit.wikimedia.org/r/#/c/293789/ one more precise host can be shut down ... thanks to Paladox, Danny_B and JanZerebecki ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
[Wikitech-l] upgrade of irc.wikimedia.org
Hello, today the server that runs irc.wikimedia.org has been upgraded. Or actually, we have installed a new, second server running on Debian jessie and ported the puppet manifests and the IRC bot to work on that, while the old server still exists. MW appservers are sending RC data to both of them. If you are making a new connection to irc.wikimedia.org you should now be served by the new host, kraz.wikimedia.org but old connections have not been broken. The old server is still running unchanged and is reachable as argon.wikimedia.org (as it was before too). We have also made the change "URLs in the recent changes IRC feed will no longer be rewritten to unencrypted HTTP." which was announced and scheduled for today, May 2nd. No action is required if your bot automatically reconnects, but bot owners should ensure no IP addresses are hardcoded (see T123729 for details.) DNS caches slowly roll over and new connections will use kraz. Existing sessions on argon and clients that hardcoded the argon IP won't be affected yet, but after a grace period we are going to shut down the old server argon. refs: https://phabricator.wikimedia.org/T123729#2216681 https://meta.wikimedia.org/wiki/Tech/News/2016/02 Best regards, Daniel -- Daniel Zahn <dz...@wikimedia.org> Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] scheduled downtime for bast1001 tomorrow 1800 UTC
done for real now. back with a RAID1 setup. fingerprints here: https://phabricator.wikimedia.org/T123721#2204676 files have been copied again like before On Wed, Apr 13, 2016 at 11:54 AM, Daniel Zahn <dz...@wikimedia.org> wrote: > apologies, we have to install it one more time because we did not have > the right RAID setup > on this host. doing that right now and will mail again. you can use > bast2001 or 3001 meanwhile. > > On Wed, Apr 13, 2016 at 11:04 AM, Daniel Zahn <dz...@wikimedia.org> wrote: >> bast1001 is back, now on Debian jessie, and you can use it again. >> >> All users have been created by puppet and i rsynced /home dirs back from a >> temp. >> backup location, so all your old files are back. >> >> If you get an error "Host key verification failed.", remove the old >> key with something like: >> >> ssh-keygen -f "/home/yourusername/.ssh/known_hosts" -R >> bast1001.wikimedia.org >> >> and accept the new keys, which have these fingerprints: >> >> https://phabricator.wikimedia.org/T123721#2204201 >> >> >> +-+-+-+ >> | Cipher | Algo| Fingerprint | >> +-+-+-+ >> | RSA | MD5 | 74:9a:74:e2:3b:ec:5d:fd:d4:45:8c:84:11:c8:9a:4e | >> | RSA | SHA-256 | rLmcE2r1JRrHrsOZIGZ3YHNJUzf4IOyTEg9wuCpDJjM=| >> +-+-+-+ >> | DSA | MD5 | 45:f4:34:3a:c1:34:66:ef:a8:45:ad:ff:30:c4:d7:b2 | >> | DSA | SHA-256 | GlqVy4JESiO/j7ELqXyhIbl5oZGmWO8tgroavpPOX/s=| >> +-+-+-+ >> | ECDSA | MD5 | 9f:2b:ab:10:de:52:13:87:34:4c:20:52:be:0f:91:c3 | >> | ECDSA | SHA-256 | uJjbBNi8661vAbuk6i9N5lc65AxT31nLEAO87/vJgcE=| >> +-+-+-+ >> | ED25519 | MD5 | 8d:e2:1f:1b:4f:76:89:91:c1:99:dd:d5:a9:d9:0d:47 | >> | ED25519 | SHA-256 | cyZDMw0Oon1OJrNWD0xY+CETCaAZlyIBazYL1vtb1TE=| >> +-+-+-+ >> >> >> >> >> On Tue, Apr 12, 2016 at 5:41 PM, Daniel Zahn <dz...@wikimedia.org> wrote: >>> >>> Hi, >>> >>> tomorrow at 1800 UTC (10am PST) i would like to upgrade bast1001 and >>> schedule some downtime. I anticipate about an hour. >>> >>> Data from home dirs has already been rsynced elsewhere (and is in Bacula). >>> >>> Please switch to bast3001 or bast2001 during this period (or permanently if >>> they are closer for you anyways). >>> >>> >>> -- >>> Daniel Zahn <dz...@wikimedia.org> >>> Operations Engineer >> >> >> >> >> -- >> Daniel Zahn <dz...@wikimedia.org> >> Operations Engineer > > > > -- > Daniel Zahn <dz...@wikimedia.org> > Operations Engineer -- Daniel Zahn <dz...@wikimedia.org> Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] scheduled downtime for bast1001 tomorrow 1800 UTC
apologies, we have to install it one more time because we did not have the right RAID setup on this host. doing that right now and will mail again. you can use bast2001 or 3001 meanwhile. On Wed, Apr 13, 2016 at 11:04 AM, Daniel Zahn <dz...@wikimedia.org> wrote: > bast1001 is back, now on Debian jessie, and you can use it again. > > All users have been created by puppet and i rsynced /home dirs back from a > temp. > backup location, so all your old files are back. > > If you get an error "Host key verification failed.", remove the old > key with something like: > > ssh-keygen -f "/home/yourusername/.ssh/known_hosts" -R > bast1001.wikimedia.org > > and accept the new keys, which have these fingerprints: > > https://phabricator.wikimedia.org/T123721#2204201 > > > +-+-+-+ > | Cipher | Algo| Fingerprint | > +-+-+-+ > | RSA | MD5 | 74:9a:74:e2:3b:ec:5d:fd:d4:45:8c:84:11:c8:9a:4e | > | RSA | SHA-256 | rLmcE2r1JRrHrsOZIGZ3YHNJUzf4IOyTEg9wuCpDJjM=| > +-+-+-+ > | DSA | MD5 | 45:f4:34:3a:c1:34:66:ef:a8:45:ad:ff:30:c4:d7:b2 | > | DSA | SHA-256 | GlqVy4JESiO/j7ELqXyhIbl5oZGmWO8tgroavpPOX/s=| > +-+-+-+ > | ECDSA | MD5 | 9f:2b:ab:10:de:52:13:87:34:4c:20:52:be:0f:91:c3 | > | ECDSA | SHA-256 | uJjbBNi8661vAbuk6i9N5lc65AxT31nLEAO87/vJgcE=| > +-+-+-+ > | ED25519 | MD5 | 8d:e2:1f:1b:4f:76:89:91:c1:99:dd:d5:a9:d9:0d:47 | > | ED25519 | SHA-256 | cyZDMw0Oon1OJrNWD0xY+CETCaAZlyIBazYL1vtb1TE=| > +-----+-+-+ > > > > > On Tue, Apr 12, 2016 at 5:41 PM, Daniel Zahn <dz...@wikimedia.org> wrote: >> >> Hi, >> >> tomorrow at 1800 UTC (10am PST) i would like to upgrade bast1001 and >> schedule some downtime. I anticipate about an hour. >> >> Data from home dirs has already been rsynced elsewhere (and is in Bacula). >> >> Please switch to bast3001 or bast2001 during this period (or permanently if >> they are closer for you anyways). >> >> >> -- >> Daniel Zahn <dz...@wikimedia.org> >> Operations Engineer > > > > > -- > Daniel Zahn <dz...@wikimedia.org> > Operations Engineer -- Daniel Zahn <dz...@wikimedia.org> Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] scheduled downtime for bast1001 tomorrow 1800 UTC
bast1001 is back, now on Debian jessie, and you can use it again. All users have been created by puppet and i rsynced /home dirs back from a temp. backup location, so all your old files are back. If you get an error "Host key verification failed.", remove the old key with something like: ssh-keygen -f "/home/yourusername/.ssh/known_hosts" -R bast1001.wikimedia.org and accept the new keys, which have these fingerprints: https://phabricator.wikimedia.org/T123721#2204201 +-+-+-+ | Cipher | Algo| Fingerprint | +-+-+-+ | RSA | MD5 | 74:9a:74:e2:3b:ec:5d:fd:d4:45:8c:84:11:c8:9a:4e | | RSA | SHA-256 | rLmcE2r1JRrHrsOZIGZ3YHNJUzf4IOyTEg9wuCpDJjM=| +-+-+-+ | DSA | MD5 | 45:f4:34:3a:c1:34:66:ef:a8:45:ad:ff:30:c4:d7:b2 | | DSA | SHA-256 | GlqVy4JESiO/j7ELqXyhIbl5oZGmWO8tgroavpPOX/s=| +-+-+-+ | ECDSA | MD5 | 9f:2b:ab:10:de:52:13:87:34:4c:20:52:be:0f:91:c3 | | ECDSA | SHA-256 | uJjbBNi8661vAbuk6i9N5lc65AxT31nLEAO87/vJgcE=| +-+-+-+ | ED25519 | MD5 | 8d:e2:1f:1b:4f:76:89:91:c1:99:dd:d5:a9:d9:0d:47 | | ED25519 | SHA-256 | cyZDMw0Oon1OJrNWD0xY+CETCaAZlyIBazYL1vtb1TE=| +-+-+-+ On Tue, Apr 12, 2016 at 5:41 PM, Daniel Zahn <dz...@wikimedia.org> wrote: > > Hi, > > tomorrow at 1800 UTC (10am PST) i would like to upgrade bast1001 and > schedule some downtime. I anticipate about an hour. > > Data from home dirs has already been rsynced elsewhere (and is in Bacula). > > Please switch to bast3001 or bast2001 during this period (or permanently if > they are closer for you anyways). > > > -- > Daniel Zahn <dz...@wikimedia.org> > Operations Engineer -- Daniel Zahn <dz...@wikimedia.org> Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
[Wikitech-l] scheduled downtime for bast1001 tomorrow 1800 UTC
Hi, tomorrow at 1800 UTC (10am PST) i would like to upgrade bast1001 and schedule some downtime. I anticipate about an hour. Data from home dirs has already been rsynced elsewhere (and is in Bacula). Please switch to bast3001 or bast2001 during this period (or permanently if they are closer for you anyways). -- Daniel Zahn <dz...@wikimedia.org> Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
[Wikitech-l] new bastion host in Europe available, bast3001 replaces hooft
If you have shell access on Wikimedia servers and you are located in Europe (or EMEA region), this is for you: There is now the new bastion host: bast3001.wikimedia.org to (finally) match with the existing bastion hosts 1001, 2001 and 4001. It replaces hooft.esams.wikimedia.org and runs Debian jessie now. If you had "hooft" in your ssh config, please replace it with bast3001.wikimedia.org (yes, we also dropped the .esams. suffix special case). wikitech: https://wikitech.wikimedia.org/wiki/Bast3001 overview of bastions hosts with map: https://wikitech.wikimedia.org/wiki/Bastion to actually answer the host key question and not just hit yes: https://wikitech.wikimedia.org/wiki/Help:SSH_Fingerprints/bast3001.wikimedia.org ticket: https://phabricator.wikimedia.org/T123712 -- Daniel Zahn <dz...@wikimedia.org> Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] restarting of stream.wikimedia.org backend servers in ~ 48hours
This has happened today, with about 24 hours delay. Sorry about that. The maintenance is over and servers and service is back up. We had to intervene a tiny bit with a manual fix to start redis, but i see the service running and some connectings again. On Mon, Feb 1, 2016 at 12:29 PM, Daniel Zahn <dz...@wikimedia.org> wrote: > Hello, > > to anyone who is a client of stream.wikimedia.org > (https://wikitech.wikimedia.org/wiki/RCStream), so people who run tools > relying on the RC stream. > > In about 48 hours, on February 3rd at 20:00 UTC, we will have to reboot > the backend servers of the stream.wm.org service, rcs1001 and 1002. > > This service is loadbalanced and we will only reboot the 2 servers one at > a time, > so there should be no service downtime. > > But nevertheless your clients will get disconnected and may need your > intervention to reconnect. > > Please be prepared to do so if your client will not automatically > reconnect. > > I will send another mail once this has happened. > > Best regards, > > Daniel > > -- > Daniel Zahn <dz...@wikimedia.org> > Operations Engineer > -- Daniel Zahn <dz...@wikimedia.org> Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
[Wikitech-l] restarting of stream.wikimedia.org backend servers in ~ 48hours
Hello, to anyone who is a client of stream.wikimedia.org (https://wikitech.wikimedia.org/wiki/RCStream), so people who run tools relying on the RC stream. In about 48 hours, on February 3rd at 20:00 UTC, we will have to reboot the backend servers of the stream.wm.org service, rcs1001 and 1002. This service is loadbalanced and we will only reboot the 2 servers one at a time, so there should be no service downtime. But nevertheless your clients will get disconnected and may need your intervention to reconnect. Please be prepared to do so if your client will not automatically reconnect. I will send another mail once this has happened. Best regards, Daniel -- Daniel Zahn <dz...@wikimedia.org> Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
[Wikitech-l] releases.wikimedia.org server has moved
TLDR: The backend server used for releases.wikimedia.org has moved. use bromine.eqiad.wmnet instead of caesium.eqiad.wmnet Do i care? You do if you are a "releaser" in one of the admin groups who upload files to releases.wm.org. Hi, the backend of releases.wm.org has moved away from caesium.eqiad.wmnet over to bromine.eqiad.wmnet. The reason was to get rid of yet another outdated Ubuntu system and replace it with a Debian jessie system. All the releases files in /srv/org and your /home directories have been copied over, everything should be like before, just use the new server name please. The task for that was https://phabricator.wikimedia.org/T124261 While on it i made the directory index page look a bit nicer and sort files differently so that new release versions are on top. The details for that were in https://phabricator.wikimedia.org/T125164 Let me know if you see any issues, Best, Daniel -- Daniel Zahn <dz...@wikimedia.org> Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
[Wikitech-l] people.wikimedia.org moved, access for all shell users
Hi, crossposting from the operations list, so that all shell users see it. this is to let you know that the service https://people.wikimedia.org has moved to a new backend server. From terbium to "rutherfordium.eqiad.wmnet", which is a ganeti VM. Also, all shelll users have access now. We don't limit it to deployers anymore and this service is now completely separate from any mediawiki maintenance work that is happening on terbium, and terbium can be upgraded to hhvm. If you are an existing user: Please just switch from using terbium.eqiad.wmnet to the new backend rutherfordium.eqiad.wmnet. All files have been copied with rsync from terbium, you should not have to copy anything manually, and all URLs should still work. You just have to connect to the new place to update files. Both home directories are backed up in Bacula. If you did not have access to this before, but have any kind of shell access: Now you also have access to people.wikimedia.org and can have an URL like https://people.wikimedia.org/~youruser. (as opposed to just deployers having this feature in the past). To upload files copy them (with scp) to rutherfordium.eqiad.wmnet into a directory called "public_html". If that doesn't exist yet, simply create it with "mkdir public_html". Files in that directory will be publicly accessible as https://people.wikimedia.org/~youruser/yourfile. I also added a message to SAL and will update https://wikitech.wikimedia.org/wiki/People.wikimedia.org right now. -- Daniel Zahn <dz...@wikimedia.org> Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] mailman upgrade next week - Sep 9th 1400 UTC
Happy to announce that the mailman migration is over. We are now on version 2.1.18 and running on a jessie machine, fermium. Here is a summary of changes that are relevant to users and list admins: Administrators / Moderators - Emails are validated more accurately. Spam prevention. - Poster password added. Allows users who may meet moderation standards to automatically have their emails accepted. - Cookies now set the secure flag when over HTTPS (default). - Sessions can be invalidated through logouts on administrator and moderation interfaces. Users - DMARC improvements solve issues users have with Yahoo and Outlook regarding mail. This isn't done yet but unblocked with the new version. - Password reminder link is now on the roster page (private archives). - Emails can be automatically accepted to private lists if a poster password is used provided by list administrators. If you want more details see -> https://phabricator.wikimedia.org/T110140#1582771 All tickets are linked on https://phabricator.wikimedia.org/T105756 On Mon, Sep 14, 2015 at 6:46 PM, Daniel Zahn <dz...@wikimedia.org> wrote: > There will be another scheduled maintenance window for this upgrade at: > > Friday, September 18, 2015 at 2:00:00 PM UTC > (Friday, September 18, 2015 at 7:00:00 AM PDT) > > for 3 hour mails to lists will not be delivered and i will follow-up > once this is over. > > Thank you, > > -- Daniel Zahn <dz...@wikimedia.org> Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
