Re: [Wikitech-l] [Engineering] Announcement: Tyler Cipriani joins Wikimedia as Release Engineer

2015-02-09 Thread Tyler Cipriani
Thanks everybody for the warm welcome! After a whirlwind first day, it's time to retreat to Chipotle and Seinfield re-runs to help digest this massive information intake. Thanks again! Tyler ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org

[Wikitech-l] Migrating to Scap from Trebuchet, Timelines and Such

2016-04-05 Thread Tyler Cipriani
to troubleshoot their own deployments. In the end, the goal is to scale knowledge of how to use Wikimedia's deployment tooling to the wider organization instead of a handful of people. "Teach a person to fish"[2] and all... <3, Tyler Cipriani WMF Release Engingeeri

[Wikitech-l] [Breaking Change] Scap change for deployers now live!

2016-05-11 Thread Tyler Cipriani
--help` (or `scap [subcommand] --help`). If you have any questions feel free to ask them on-list or in IRC on #scap3 or #wikimedia-releng. Thanks! Tyler Cipriani and the Deployment Working Group [0]. Mediawiki: https://doc.wikimedia.org/mw-tools-scap/scap2/commands.html Scap3: https

Re: [Wikitech-l] [Breaking Change] Scap change for deployers

2016-05-14 Thread Tyler Cipriani
On 16-05-13 20:32:37, Legoktm wrote: Would it be possible to have tab completion for the new scap subcommands? "mwv" → mwversionsinuse versus typing out all of "scap wikiversions-inuse" ;) Same with "sync-f", etc. Hadn't thought about command expansion. Bash autocompletion is now tracked in a

[Wikitech-l] [Breaking Change] Scap3 stage changes will break custom checks

2016-05-18 Thread Tyler Cipriani
This is a change that affects services that have moved to deployment via Scap3 (not MediaWiki deployments). The 3.2.0-1 release that is currently live makes an important change to the stages in which custom checks may be run. There is now a new stage called `restart_service` that occurs after the

[Wikitech-l] [Breaking Change] Scap change for deployers

2016-05-10 Thread Tyler Cipriani
t;3, Tyler Cipriani and the Deployment Working Group [0]. https://gerrit.wikimedia.org/r/#/c/287918 [1]. https://doc.wikimedia.org/mw-tools-scap/ [2]. https://phabricator.wikimedia.org/P3027 ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org ht

[Wikitech-l] Canary Deploys for MediaWiki

2016-07-25 Thread Tyler Cipriani
tl;dr: Scap will deploy to canary servers and check for error-log spikes in the next version (to be released Soon™). In light of recent incidents[0] which have created outages accompanied by large, easily detectable, error-rate spikes, a patch has recently landed in Scap[1] that will: 1.

[Wikitech-l] New scap version is live

2016-08-04 Thread Tyler Cipriani
tl;dr: The new scap version is live in production. It has canary deploys. Scap v.3.2.2-1 was deployed to production today. There are some new internal improvements as well as some that are user-facing. The improvements you'll probably notice are: * Tab completion works for scap

Re: [Wikitech-l] New scap version is live

2016-08-08 Thread Tyler Cipriani
On 16-08-07 13:50:33, Legoktm wrote: Does scap/whatever make any requests against those hosts? Or is it just depending upon normal traffic to those hosts to possibly cause errors? The script that scap is using to query logstash is logstash_checker.py[0]. There are no requests being generated

[Wikitech-l] Scap 3.5.1-1 is live

2017-01-30 Thread Tyler Cipriani
Hi all, Scap version 3.5.1-1 has been released and with it comes a few changes. tl;dr highlights: == MediaWiki Deploys == * Subcommands are the only way to scap (e.g., scap sync-file vs. sync-file) Old stub entry points for scap (e.g., sync-file, sync-dir, mwversionsinuse, etc) are gone.

[Wikitech-l] This week in logspam

2017-02-16 Thread Tyler Cipriani
Hi all! Logspam makes it difficult to glance at error logs after a deployment and reason about a deployment's impact [0]. Release Engineering is making a conscious effort (in Scrum of Scrums, in Phabricator, and on mailing lists) to connect logspam tasks with folks that can make an impact on

Re: [Wikitech-l] Wikis paused at 1.28.0-wmf.18 (was: Re: Upgrade of 1.28.0-wmf.19 to group 1 is on hold)

2016-09-20 Thread Tyler Cipriani
I have cut 1.28.0-wmf.20[0] for MediaWiki and extensions as the branch cut was blocking merges to master for developers. The state of deployed code has not changed – all wikis are running the 1.28.0-wmf.18 branch of MediaWiki and extensions. Plans for moving forward are still being discussed on

[Wikitech-l] Wikis paused at 1.28.0-wmf.18 (was: Re: Upgrade of 1.28.0-wmf.19 to group 1 is on hold)

2016-09-20 Thread Tyler Cipriani
tl;dr: All wikis are staying at 1.28.0-wmf.18 for now Last week all wikis were rolled back to MediaWiki version 1.28.0-wmf.18 due to several problems that were spotted on Friday (2016-09-16)[0][1]. The problems with wmf.19 seemed resolved by Monday (2016-09-19). The plan was to roll wmf.19 out

[Wikitech-l] Group0 on wmf.20, all to wmf.20 tomorrow (was: Re: Upgrade of 1.28.0-wmf.19 to group 1 is on hold)

2016-09-21 Thread Tyler Cipriani
Group0 wikis (mediawikiwiki, test2wiki, testwiki, testwikidatawiki, and zerowiki) are running version 1.28.0-wmf.20 of MediaWiki and extensions. All other wikis are running 1.28.0-wmf.18. Tomorrow there will be a shortened train schedule in the normal train deployment window during which

[Wikitech-l] CI maintenance on Thursday 3rd Nov 16:00 UTC

2016-10-27 Thread Tyler Cipriani
More info: It will be done by Antoine Musso, Tyler Cipriani and Daniel Zahn. You will be able to watch progress on IRC in the #wikimedia-operations channel. See also: https://phabricator.wikimedia.org/T95757 ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia

[Wikitech-l] Scap 3.4.0-1 is live

2016-11-28 Thread Tyler Cipriani
Hi all, A new version of Scap has been released and with it comes a few changes. tl;dr highlights: * Old scap bin stubs (e.g., /usr/bin/sync-file, /usr/bin/sync-dir, /usr/bin/mwversionsinuse, etc) will now exit 1. Subcommands are now the only way to interact with scap, i.e., `sync-file` is

[Wikitech-l] MediaWiki and extensions .gitreview now uses track=1

2016-10-31 Thread Tyler Cipriani
Hi all! Last week .gitreview for MediaWiki branches and extensions switched from targeting a specific branch to using track=1[0]. This is a change that, going forward, should make it easier to do weekly branching and releases without being too disruptive for developer workflows. The git-review

[Wikitech-l] First release candidate for 1.28 (1.28.0-rc.0)

2016-11-02 Thread Tyler Cipriani
Hi all! I am pleased to announce that the first release candidate for MediaWiki 1.28 is now available. Full release notes: * https://phabricator.wikimedia.org/diffusion/MW/browse/REL1_28/RELEASE-NOTES-1.28 * https://www.mediawiki.org/wiki/Release_notes/1.28 Known issues and final release

Re: [Wikitech-l] 1.28 branching release dates and such :)

2016-11-01 Thread Tyler Cipriani
On 16-10-24 21:55:04, Chad wrote: Tyler Cipriani's assisting me with this release, so expect to see some RCs with his name (and signatures) on them :) As noted in Chad's email, I will be creating 1.28.0-rc.0 tomorrow. I've gotten all the backports from 1.28.0-wmf.23 into the REL1_28 branch.

[Wikitech-l] [scap] Scap3-deployed repo owners

2017-04-13 Thread Tyler Cipriani
Hiya! tl;dr: if your repo has a patch from me[0], please merge it :) The longer explanation for these patches is that the deployment server from which your code is fetched by targets is set via the git_server configuration variable. This variable will be updated in Puppet when the primary

[Wikitech-l] 1.30.0-wmf.9 train halted due to new log messages

2017-07-13 Thread Tyler Cipriani
Hello all, There are a few new log messages that have crept their way into the 1.30.0-wmf.9 train release currently winding its way down the track - on group0 and group1 wikis[0]. I've halted the train for the time being due to these new messages[1]. 1. T170599[2] - Wikibase:

Re: [Wikitech-l] 1.30.0-wmf.9 train halted due to new log messages

2017-07-13 Thread Tyler Cipriani
be appreciated. We will get through this train. Together. Thanks! -- Tyler [1] <https://phabricator.wikimedia.org/T170648> On 17-07-13 12:32:31, Tyler Cipriani wrote: Hello all, There are a few new log messages that have crept their way into the 1.30.0-wmf.9 train release cur

[Wikitech-l] MediaWiki and extensions 1.30.0-wmf.14 group1 deployment blocked

2017-08-16 Thread Tyler Cipriani
The deployment of MediaWiki and extensions version 1.30.0-wmf.14 is blocked as a message in the error log gradually worsened following the roll out 1.30.0-wmf.14 to group1 wikis. The error: Cannot flush pre-lock snapshot because writes are pending is detailed on phabricator[0]. As of

Re: [Wikitech-l] [Ops] Changes to SWAT deployment policies, effective Monday April 30th

2018-04-27 Thread Tyler Cipriani
On 18-04-27 10:49:28, Stas Malyshev wrote: Hi! First, we now disallow multi-sync patch deployments. See T187761[0]. This means that the sync order of files is determined by git commit parent relationships (or Gerrit's "depends-on"). This is to prevent SWAT deployers from accidentally syncing

Re: [Wikitech-l] [Ops] Changes to SWAT deployment policies, effective Monday April 30th

2018-04-27 Thread Tyler Cipriani
On 18-04-27 21:00:35, Gergo Tisza wrote: On Fri, Apr 27, 2018 at 7:05 PM, Niharika Kohli wrote: Also, I think dropping the limit to 4 patches per window is extreme, especially if we are asking people to start splitting their patches now. Very often we can +2 multiple

Re: [Wikitech-l] [Engineering] Phabricator spam - account approval requirement enabled

2018-07-01 Thread Tyler Cipriani
I wrote a short, quick fixer script that is terrible, but is saving me some time in fixing some tasks today. I figured I'd share the script[0] on this list even thought it's very very (very) alpha and was written very quickly. Thank you to everyone looking at and thinking about this issue.

[Wikitech-l] New Beta Cluster Deployment Servers

2018-08-02 Thread Tyler Cipriani
Hi All! There are new deployment servers in beta cluster: deployment-deploy01 and deployment-deploy02. These servers replace deployment-tin and deployment-mira (which I just shut down today). If you had a home directory on either deployment-tin or deployment-mira I've moved it to the new

[Wikitech-l] This Week's Log Health

2018-08-24 Thread Tyler Cipriani
Hi all! The state of the Wikimedia error logs makes determining the health of a deployment difficult. This week there were a number of log messages that made determining the health of this week's train difficult. This email is a request for help for a couple of troubling messages currently

[Wikitech-l] 1.31.0-wmf.23 MediaWiki train rollback

2018-02-28 Thread Tyler Cipriani
Hi all! Wednesday Train update: we're currently running 1.31.0-wmf.23 on group0 only, so we're a day behind schedule. I decided to rollback based on a particularly noisy notice[0]. The right folks are already aware and working on it (thanks all!). Reminder that we have a task for each

Re: [Wikitech-l] [Engineering] Gerrit now automatically adds reviewers

2019-01-18 Thread Tyler Cipriani
Hi all, Gerrit no longer automatically adds reviewers[0]. Unfortunately, this plugin appears (given the replies on this thread) to be missing key features needed to be useful for us at this time. Apologies to those folks whose inboxes were destroyed. I would like to re-enable this plugin at

Re: [Wikitech-l] [Engineering] Gerrit now automatically adds reviewers

2019-01-19 Thread Tyler Cipriani
On 19-01-18 22:12:22, Pine W wrote: I'm glad that this problematic change to communications was reverted. Clarification: Enabling this plugin wasn't reverted, a configuration change was made to the default settings of the plugin. Thanks to the helpful suggestions on this thread, it's my

Re: [Wikitech-l] [Engineering] Gerrit now automatically adds reviewers

2019-01-22 Thread Tyler Cipriani
Hi all! This plugin has been removed entirely from Wikimedia Gerrit[0]. I know of no one who intended to experiment with the plugin in its current form so it is now removed. I have created a task to track suggestions for this plugin's improvement[1]. This task's scope is to track

[Wikitech-l] Gerrit ACL updates/phab mirroring

2019-04-05 Thread Tyler Cipriani
Hi All, I wanted to send a heads-up that I've reverted some recent Gerrit ACL changes that I believe have been problematic from a Gerrit operational stability standpoint. These ACL changes have been blocking some Phabricator mirroring, and you may receive emails from Phabricator about old

[Wikitech-l] [Train] 1.33.0-wmf.18 status update

2019-02-19 Thread Tyler Cipriani
Hello all! I have not yet started the 1.33.0-wmf.18 train; however, at the end of last week, I noticed some errors that (AFAICT) are regressions in 1.33.0-wmf.17. There were two new errors that started showing up in 1.33.0-wmf.17: 1. ErrorException from includes/HeaderCallback.php: PHP

Re: [Wikitech-l] Gerrit outage

2019-03-18 Thread Tyler Cipriani
Hello, As part of cleanup and response Gerrit's use of http tokens has been disabled. You should still be able to use the http REST api using your LDAP password. Gerrit's command-line tools [0] that operate via SSH are also still available. -- Tyler [0].

Re: [Wikitech-l] Uploading new versions of other people's patches to gerrit

2019-04-09 Thread Tyler Cipriani
Hello, On 19-04-09 17:50:12, Isarra Yos wrote: To clarify, I get what you're trying to do, but there has got to be a better solution besides denying key features to and thus impairing long-term contributors, because disabling this for everyone (but apparently WMDE (?!)) does exactly that. On

[Wikitech-l] Gerrit HTTP Token Auth re-enabled

2019-06-24 Thread Tyler Cipriani
Hi all! tl;dr: Gerrit HTTP token auth has been re-enabled. To use it you'll need to generate a token via your preferences page[0]. Gerrit HTTP token auth was disabled in mid-march due to concerns about its implementation[1]. Thanks to the work of Paladox and Gerrit upstream in Gerrit

Re: [Wikitech-l] Gerrit HTTP Token Auth re-enabled

2019-06-25 Thread Tyler Cipriani
org/T224448> On 19-06-24 15:53:25, Tyler Cipriani wrote: Hi all! tl;dr: Gerrit HTTP token auth has been re-enabled. To use it you'll need to generate a token via your preferences page[0]. Gerrit HTTP token auth was disabled in mid-march due to concerns about its implementation[1].

Re: [Wikitech-l] Uploading new versions of other people's patches to gerrit

2019-04-09 Thread Tyler Cipriani
On 19-04-09 05:17:17, Isarra Yos wrote: This seems to be broken, or something. It's causing problems for collaboration. Please fix. This is the addPatchSet permission in Gerrit. That particular permission was recently abused, and at that time the permission was modified. The current status

[Wikitech-l] Github: WMFGerrit closing pull requests

2019-08-05 Thread Tyler Cipriani
tl;dr: If your team doesn't do any development on GitHub then this email likely doesn't affect you. As you may or may not know there is now a read-only replica of Gerrit available at https://gerrit-replica.wikimedia.org/ (hooray); however, over the weekend we noticed some missing tags from

[Wikitech-l] Fwd: [RelEng] deployment-prep outage this Friday

2019-07-18 Thread Tyler Cipriani
The beta cluster will be intermittently unavailable tomorrow due to WMCS maintenance. See forwarded message for details. Thanks! -- Tyler - Forwarded message from Andrew Bogott - Date: Wed, 17 Jul 2019 15:51:57 -0500 From: Andrew Bogott To: Release Engineering Subject: [RelEng]

[Wikitech-l] Blubber v0.8.0/blubber.yaml update

2019-07-25 Thread Tyler Cipriani
Hi all! CAVEAT EMPTOR: If you don't use the Deployment Pipeline[0] or Blubber[1] then this email may mean nothing to you. A new version of Blubber has been released -- v0.8.0[2]. The main change is that we've eliminated the "artifacts" command for use in multistage builds. The details of

[Wikitech-l] December Deployment Freeze

2019-10-16 Thread Tyler Cipriani
Hi All! tl;dr: December deployment freeze 2019-12-19–2020-01-02. Train resumes 2020-01-06. We're coming up to the time of year where we freeze our production deployments to allow for the holiday season's limited availability as well as to ensure the stability of our holiday fundraising. After

Re: [Wikitech-l] Gerrit: Server maintenance

2019-10-21 Thread Tyler Cipriani
On Mon, Oct 21, 2019 at 11:52 AM Tyler Cipriani wrote: > > On Thu, Oct 17, 2019 at 3:43 PM Patrick Mulhall > wrote: > > > > Just a reminder that this will be happening on Monday next week. > > This is happening in a few minutes. Progress will be logged in > #wi

Re: [Wikitech-l] Gerrit: Server maintenance

2019-10-21 Thread Tyler Cipriani
On Thu, Oct 17, 2019 at 3:43 PM Patrick Mulhall wrote: > > Just a reminder that this will be happening on Monday next week. This is happening in a few minutes. Progress will be logged in #wikimedia-operations -- Tyler > ___ > Wikitech-l mailing list

Re: [Wikitech-l] Gerrit: Server maintenance

2019-10-22 Thread Tyler Cipriani
After quite a bit of thought and experimentation we've managed to, I believe, resolve the issue of reappearing patchsets on the new gerrit server. All the gory details are available on the Phabricator task[0]. Thank you everyone, as always, for your patience and support. -- Tyler [0].

Re: [Wikitech-l] Being logged out of gerrit

2019-10-13 Thread Tyler Cipriani
On Sun, Oct 13, 2019 at 10:11 AM Amir Sarabadani wrote: > > The ticket implies this is fixed for a while, but I get logged out three > times last week. I'm not sure if it's the only reason. That's probably still the right ticket in my view. That's the task where I tracked my investigation of

Re: [Wikitech-l] New, simple Docker development environment for MediaWiki core

2020-02-24 Thread Tyler Cipriani
On Mon, Feb 24, 2020 at 9:44 AM Brennen Bearnes wrote: > TL;DR: `docker-compose up` gets you a Docker environment with which > to develop. > > The Engineering Productivity group is happy to announce the > availability of a new, official Docker environment for MediaWiki > core. [0] This is a

[Wikitech-l] Deployments next week: no train, no deploys Tuesday–Friday

2020-04-15 Thread Tyler Cipriani
Hi All, Reminder that there is no train next week and there are no deployments Tuesday–Friday. A large number of folks will be unavailable Wednesday through Friday, so we're cancelling the deployment train next week and treating next Tuesday like a Friday (which means only deploying in cases of

[Wikitech-l] Deployment Guidance Office Hours

2020-04-07 Thread Tyler Cipriani
Hi all! Just a friendly reminder: We’re hosting office hours on Mondays at 17:00 UTC in #wikimedia-office on freenode where you can ask questions regarding the COVID-19 deployment guidelines (https://wikitech.wikimedia.org/wiki/Deployments/Covid-19). This week's train deployment branch was cut

Re: [Wikitech-l] Namespace Localisations & Updates

2020-05-18 Thread Tyler Cipriani
. -- Tyler [0]: <https://wikitech.wikimedia.org/wiki/Deployments> On Mon, 18 May 2020 at 16:25, Tyler Cipriani wrote: Hi Samuel On 20-05-18 09:57:54, RhinosF1 - wrote: >On https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/596424/, it was >raised correctly that namespaceDupes.ph

Re: [Wikitech-l] Namespace Localisations & Updates

2020-05-18 Thread Tyler Cipriani
Hi Samuel On 20-05-18 09:57:54, RhinosF1 - wrote: On https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/596424/, it was raised correctly that namespaceDupes.php would need to be ran. https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/596424/ and

[Wikitech-l] COVID-19 Deployment Guidance

2020-03-20 Thread Tyler Cipriani
Hi all! In response to COVID-19, we are putting in place stricter guidelines around deployments with an emphasis on site reliability. To support this change, we have the following guidelines for software development: - While we are not going to go into full emergency or holiday mode

Re: [Wikitech-l]  Wikimedia production errors help

2020-09-15 Thread Tyler Cipriani
Hi! Thanks for the feedback, this is useful information. On Tue, Sep 15, 2020 at 3:00 AM Niklas Laxström wrote: > ma 14. syysk. 2020 klo 23.49 Tyler Cipriani (tcipri...@wikimedia.org) > kirjoitti: > If there is an increase in the amount of real new issues and/or > decrease i

Re: [Wikitech-l]  Wikimedia production errors help

2020-09-15 Thread Tyler Cipriani
On Tue, Sep 15, 2020 at 5:24 AM Derk-Jan Hartman wrote: > > In particular I count 13 frontend problems with the old TMH kaltura player. > There is clearly no intent to fix those (volunteer or employee), as the > Kaltura player has been unmaintained for 8 years. > The choices as far as I can tell

[Wikitech-l]  Wikimedia production errors help

2020-09-14 Thread Tyler Cipriani
Hello all! Over the past few months we've reached the ignominious milestone of the most open tasks of all time on the wikimedia-production-error dashboard[0]. Background: The wikimedia-production-error dashboard is a workboard of tasks created while digging through the Wikimedia production error

Re: [Wikitech-l] Wikimedia's GitHub org help

2020-09-01 Thread Tyler Cipriani
_GitHub> On Mon, Aug 24, 2020 at 4:46 PM Tyler Cipriani wrote: > > Hi all! > > If you've never created a repo or fork on the Wikimedia GitHub > organization you can skip this email. > > I know that some repos are developed on our GitHub org for reasons. > What is d

Re: [Wikitech-l] Wikimedia's GitHub org help

2020-09-01 Thread Tyler Cipriani
On Tue, Sep 1, 2020 at 12:11 PM Isaac Johnson wrote: > Thanks Tyler for doing this work! Is there an easy way (if not, no big > deal) to also see the list of repos that were archived/deleted just to make > sure lack of response didn't mean something disappeared that would have > been useful to

[Wikitech-l] Wikimedia GitHub OAuth restrictions enabled

2020-08-25 Thread Tyler Cipriani
Hi! Today we have enabled OAuth app access restrictions on the Wikimedia GitHub organization[0]. As a result, any attempt to add an OAuth app requires the approval of the WIkimedia organization's owners[1]. This restriction was enabled to prevent accidentally granting OAuth permissions to the

Re: [Wikitech-l] Wikimedia's GitHub org help

2020-08-25 Thread Tyler Cipriani
s-AddMetaAndTitle/blob/master/.gitreview> [1]: <https://github.com/thcipriani/wikimedia-github-projects> [2]: <https://phabricator.wikimedia.org/T237470#6406876> > > On Mon, 24 Aug 2020 at 23:47, Tyler Cipriani > wrote: > > > Hi all! > > > > If yo

[Wikitech-l] No train next week; no deployments next Tuesday

2020-08-24 Thread Tyler Cipriani
Hi all There is a planned switchover to our secondary datacenter scheduled for Tuesday, September 2nd 2020. To avoid creating problems for our SREs we'll be skipping the train for next week -- the week of 2020-08-31 -- and not doing any deployments the day of the switchover -- 2020-09-01. The

[Wikitech-l] Wikimedia's GitHub org help

2020-08-24 Thread Tyler Cipriani
Hi all! If you've never created a repo or fork on the Wikimedia GitHub organization you can skip this email. I know that some repos are developed on our GitHub org for reasons. What is developed on our GitHub org? How many things are actively being developed on GitHub org? I have no idea :) I

Re: [Wikitech-l]  Wikimedia production errors help

2020-09-16 Thread Tyler Cipriani
On Tue, Sep 15, 2020 at 11:06 AM Brennen Bearnes wrote: > On 9/15/20 9:43 AM, Alex Ezell wrote: > > Do we use levels for any of these error log outputs? That is, are they > > classified on output as High, Medium, Low, Info, or something like that? > > Teasing out more detail about reported error

[Wikitech-l] No train next week; no deployments next Tuesday

2020-10-21 Thread Tyler Cipriani
Hi all There is a planned datacenter switchback next week scheduled for Tuesday, October 27th 2020[0]. To avoid creating problems for our SREs we'll be skipping the train for next week -- the week of 2020-10-26. Additionally, we want to avoid deploys for a full 24 hours following the switchover.

Re: [Wikitech-l] Replacement for Helm chart repository

2020-08-03 Thread Tyler Cipriani
On Mon, Aug 3, 2020 at 9:02 AM Janis Meybohm wrote: > Developers may now stop the process of packaging helm charts manually, > rebuilding the index and pushing all that to git. As of now, increasing > the charts version number in Chart.yaml is sufficient to have the chart > being packaged and

Re: [Wikitech-l] realtime notifications disabled in Phabricator

2020-08-12 Thread Tyler Cipriani
On 20-08-11 15:04:56, Daniel Zahn wrote: re: > "aphlict" service had been disabled on Phabricator because it caused stability issues. I am happy to announce that aphlict, the notification service for Phabricator using websockets, is now finally back again. \o/ This is great news! Thank you

[Wikitech-l] Deployments for (short) week of 2020-08-10

2020-08-09 Thread Tyler Cipriani
Hi All tl;dr: Don't deploy on Thursday except for emergencies; the deployment calendar on Wikitech is up-to-date. Friday of next week (2020-08-14) is a wmf holiday. As such, Thursday should be treated as Friday for the purposes

[Wikitech-l] [Train] Risky change template

2020-06-17 Thread Tyler Cipriani
Hi all! A pattern of adding a note on the train-blocker phab task[0] for risky changes has recently emerged. Folks on RelEng have found this information useful, and we would like to codify this, encouraging developers to continue this pattern. We've added a page to Wikitech, with a template to

[Wikitech-l] Deployments next week (2020-06-29)

2020-06-25 Thread Tyler Cipriani
Hi All, Next week is a bit of a shortened week as US Independence Day is observed on 2020-07-03 (next Friday). I've updated the Wikitech deployment calendar to reflect that we normally discourage deploying on the last working day of any week

Re: [Wikitech-l] Subject: New train branch time: Tuesday 02:00UTC

2020-06-15 Thread Tyler Cipriani
Hi all! Reminder that 1.35.0-wmf.37 will be branched automatically at 02:00 UTC tomorrow — Tue, 16 Jun. Thanks! -- Tyler On Tue, Jun 2, 2020 at 3:11 PM Mukunda Modell wrote: > > The Branch cut for our weekly MediaWiki release train is moving to full > automation, starting with

[Wikitech-l] [Train] 1.36.0-wmf.20 status update

2020-12-03 Thread Tyler Cipriani
MediaWiki and extensions 1.36.0-wmf.20[0] is only deployed to testwikis[1]. We rolled back[2] today due to: * T269396 Parser cache serving old results[3] If these issues are resolved we can roll the train forward Monday.[4] Thanks all! -- Tyler [0]:

[Wikitech-l] Last deployments of 2020 next week

2020-12-09 Thread Tyler Cipriani
Hi All, Every year we stop deployments for the last full week of the year. As we enter the last couple weeks of the year, I wanted to send out a reminder that next week is the final deployment week of the year and that wmf/1.36.0-wmf.22 will be the last train release of the year. The deployment

[Wikitech-l] Deployment train next two weeks (2020-11-02, 2020-11-09)

2020-10-29 Thread Tyler Cipriani
Hi all, We've entered that special time of year where the weekly deployment train has a few disruptions coming up. I've added a list of train disruptions through the end of the year to the Deployments page on Wikitech[0]. Next week's train will happen, but the schedule will be different

[Wikitech-l]  2021 Developer satisfaction survey results

2021-06-14 Thread Tyler Cipriani
resources to improve. ➡️ Folks should read it, talk about it, and ask questions (please ;))! <3 - Tyler Cipriani (he/him) Engineering Manager, Release Engineering Wikimedia Foundation [0]: <https://lists.wikimedia.org/pipermail/wikitech-l/2021-March/094317.html> [1]: <https://www.mediaw

[Wikitech-l] No deploys next week (week of 2021-06-14)

2021-06-07 Thread Tyler Cipriani
/Yearly_calendar Thanks! Tyler Cipriani (he/him) Engineering Manager, Release Engineering Wikimedia Foundation ___ Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org https

[Wikitech-l] No train the week of 2021-05-31

2021-05-18 Thread Tyler Cipriani
Hi All There will be no train 2021-05-31 (2021-05-31–2021-06-04) — having our Engineering Productivity offsite. There is a long-term calendar of upcoming known deployment disruptions available on Wikitech: https://wikitech.wikimedia.org/wiki/Deployments/Yearly_calendar Thanks! Tyler Cipriani

[Wikitech-l] MediaWiki 1.36 Release Bugfix Bugging

2021-05-10 Thread Tyler Cipriani
se notes <https://gerrit.wikimedia.org/g/mediawiki/core/+/REL1_36/RELEASE-NOTES-1.36>  Tyler Cipriani (he/him) Engineering Manager, Release Engineering Wikimedia Foundation ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lis

[Wikitech-l] Summary of *last week*'s deployment of 1.37.0-wmf.4

2021-05-12 Thread Tyler Cipriani
This is a belated summary of *last week*'s deployment of the 1.37.0-wmf.4 train. The primary train conductor for the week was Brennen Bearnes, with Lars Wirzenius as backup in European timezones and considerable assistance from Ahmon Dancy. The blocker task for the week was:

[Wikitech-l] Re: No train the week of 2021-05-31

2021-05-26 Thread Tyler Cipriani
A quick reminder ICYMI that there is no train next week. <3 – Tyler On Tue, May 18, 2021 at 5:44 PM Tyler Cipriani wrote: > Hi All > > There will be no train 2021-05-31 (2021-05-31–2021-06-04) — having our > Engineering Productivity offsite. > > There is a long-term calen

[Wikitech-l] The More You Know*: Wikimedia’s Kubernetes Pipeline

2021-05-27 Thread Tyler Cipriani
experience with a class or tutorial. Otherwise stay tuned and watch that page for additional resources to be added. You will hear from us again as we have additional things to report. – <3 Tyler Cipriani (he/him) (On behalf of all the fine folks working on Kubernetes for MediaWiki) Engineering Mana

[Wikitech-l] Re: Why does the train start on Tuesday?

2021-07-12 Thread Tyler Cipriani
(Late reply: I was out the week this was sent, then another week of vacation happened) On Wed, Jun 23, 2021 at 2:59 AM Jaime Crespo wrote: > * How often are issues surfaced in the group0 -> group1 vs group1 -> > group2, are there any stats to back the need for a change there? > The closest

[Wikitech-l] Backport deployment training!

2021-04-27 Thread Tyler Cipriani
Hello potential deployers! We're starting backport deployment training for people interested in learning how to deploy safely . Training happens in the #wikimedia-operations IRC channel as

[Wikitech-l] MediaWiki 1.36.0-rc.0 is ready for testing

2021-04-29 Thread Tyler Cipriani
I'm pleased to announce the immediate availability of MediaWiki 1.36.0-rc.0, the first release candidate for 1.36.x. Download links are at the end of the e-mail. The tag has been signed and pushed to Git. Please note that MediaWiki 1.36 now requires the PHP internationalization extension,

Re: [Wikitech-l] MediaWiki 1.36-beta has been branched

2021-04-23 Thread Tyler Cipriani
Hi All On Tue, Apr 13, 2021 at 5:36 PM Tyler Cipriani wrote: > We hope to issue the first release candidate, 1.36.0-rc.0, in two weeks' > time, and if all goes well, to release MediaWiki 1.36.0 a few weeks after > that. > With the "two weeks" deadline of the

[Wikitech-l] [Train] 1.36.0-wmf.30 status -- wmf.28, wmf.29: abandoned

2021-02-09 Thread Tyler Cipriani
Hi all All wikis except testwikis are on 1.36.0-wmf.27; testwikis are running 1.36.0-wmf.30. We've rolled back to wmf.27 so that we have a stable base version from which to roll out wmf.30. We will proceed with rollout of wmf.30 once this cherry-pick for wmf.30 is code-reviewed:

Re: [Wikitech-l] Gerrit authentication fails

2021-03-22 Thread Tyler Cipriani
Hi Swathi! In looking in the gerrit logs it looks like you have two wikitech developer accounts and there are failures signing in with the most recent one. This is because Gerrit uses a single primary email per account and since you've already signed in with your previous username that email is

[Wikitech-l] Deployment calendar format change

2021-03-26 Thread Tyler Cipriani
tl;dr: The deployment calendar format will change in 2 weeks (2021-04-05) to make it easier to edit with visual editor https://w.wiki/a3b I updated the deployment calendar for the week of 2021-04-05[0] to use a different format than in the past (compare to next week[1]). My hope is that this new

Re: [Wikitech-l] Train vs Backport for Wikimedia Deployment

2021-03-23 Thread Tyler Cipriani
Hi! On Tue, Mar 23, 2021 at 2:59 PM Kunal Mehta wrote: > > As with all things, some exceptions may apply. The Release Engineering > > team has created some guidelines[0] that will hopefully help explain > > when something MUST, SHOULD, or MAY[1] be deployed via the train or via > > backport. >

[Wikitech-l] Train vs Backport for Wikimedia Deployment

2021-03-18 Thread Tyler Cipriani
Hi All! tl;dr: if you're a developer looking for guidance on how to deploy changes to Wikimedia's MediaWiki cluster read https://w.wiki/36nY ; if you have thoughts on our existing deployment documentation comment on https://w.wiki/36nZ --- Over time The Train™ has become the default way to

[Wikitech-l] No train the week of 2021-04-19

2021-04-14 Thread Tyler Cipriani
Hi All There will be no train next week (the week of 2021-04-19) due to a wmf holiday on 2021-04-22. There is a long-term calendar of upcoming deployment disruptions available on Wikitech: https://wikitech.wikimedia.org/wiki/Deployments/Yearly_calendar Thanks! – Tyler

[Wikitech-l] MediaWiki 1.36-beta has been branched

2021-04-13 Thread Tyler Cipriani
Hey all, This is a quick note to highlight that the REL1_36 branch has now been created for MediaWiki core and each of the extensions and skins in Wikimedia git[0]. This is the first step in the release process for MediaWiki 1.36, which should be out in late May 2021, approximately nine months

[Wikitech-l] [Train] 1.36.0-wmf.30 is in danger

2021-02-11 Thread Tyler Cipriani
Hiya all tl;dr: help us fix (or convince us not to care about): * No atomic section is open (got LocalFile::lockingTransaction)[0] Longer: We've been on 1.36.0-wmf.27 for two weeks which is 1,038 changes behind 1.36.0-wmf.30 (the latest branch). The remaining issue is: "No atomic section is

[Wikitech-l] Re: (no subject)

2021-08-18 Thread Tyler Cipriani
Hi Siddhi Here's the link to the Wikimedia organization on Github: https://github.com/wikimedia Here's a link to MediaWiki on GitHub in case that's helpful: https://github.com/wikimedia/mediawiki These repositories are (mostly) mirrored from our Gerrit instance where we do code reviews and

[Wikitech-l] MediaWiki 1.37-alpha will be branched as a beta on 14 September 2021

2021-08-24 Thread Tyler Cipriani
iki/Bundled_extensions_and_skins> [1]: <https://www.mediawiki.org/wiki/Backporting_fixes> [2]: <https://phabricator.wikimedia.org/tag/mw-1.37-release/> Tyler Cipriani (he/him) Engineering Manager, Release Engineering Wikimedia Foundation ___ Wikitech-l mailin

[Wikitech-l] No train the week of 2021-09-06

2021-08-24 Thread Tyler Cipriani
on Wikitech: https://wikitech.wikimedia.org/wiki/Deployments/Yearly_calendar Thank you! Tyler Cipriani (he/him) Engineering Manager, Release Engineering Wikimedia Foundation ___ Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send

[Wikitech-l]  Summary of 1.37.0-wmf.18 train deployment

2021-08-16 Thread Tyler Cipriani
This email is a summary of the Wikimedia production deployment of 1.37.0-wmf.18. - Conductor: Jeena Huneidi - Backup: Mukunda Modell - Blocker task: T281159 - Status: Live on all wikis *Stats* - 244

[Wikitech-l] Re: Why does the train start on Tuesday?

2021-07-14 Thread Tyler Cipriani
On Mon, Jul 12, 2021 at 10:47 PM Risker wrote: > On Mon, 12 Jul 2021 at 19:26, Tyler Cipriani > wrote: > >> * Can we do something to improve the speed from "a user notices an issue >>> with the site" to "the right team/owner is aware of it and acts o

[Wikitech-l]  Summary of 1.37.0-wmf.16 train deployment

2021-08-02 Thread Tyler Cipriani
This email is a summary of the Wikimedia production deployment of 1.37.0-wmf.16. Mukunda Modell was the train conductor last week. Antoine Musso (hashar) was the backup conductor. Blocker task: https://phabricator.wikimedia.org/T281157 The new version is live on all sites:

[Wikitech-l] Re: How we deploy code

2021-09-30 Thread Tyler Cipriani
ails that you couldn't understand without the gist and >>important details >> >> >> 1. https://en.wikipedia.org/wiki/Inverted_pyramid_(journalism) >> >> On Mon, Sep 27, 2021 at 4:04 PM Greg Grossmeier >> wrote: >> >>> This is great, th

[Wikitech-l] Backport window name updates

2021-10-04 Thread Tyler Cipriani
d-day backport window* - *UTC evening* – 18UTC/11PDT – previously named *Morning backport window* - *UTC late* – 23UTC/16PDT – previously named *Evening backport window* ___ Thanks to Kosta <https://phabricator.wikimedia.org/T290859> for the suggestion and review. <

  1   2   >