[Wikitech-l] [Train] 1.35.0-wmf.23 status update (blocked)

The 1.35.0-wmf.23 version of MediaWiki is blocked[0]. The new version can't proceed to group2 [1] until these issues are resolved, and may be rolled back to group0 if necessary: * T247458 PHP Notice: Undefined index: wgKartographerLiveData - https://phabricator.wikimedia.org/T247458 *

Re: [Wikitech-l] [Train] 1.35.0-wmf.19 status update

The 1.35.0-wmf.19 version of MediaWiki has been promoted for all wikis.[0] Thanks to all that helped with remediation and re-deployment, but particularly hearty thanks to James Forrester for his help sifting through logs to identify the root cause and to Erik Bernhardson for implementing fix.[1]

[Wikitech-l] [Train] 1.35.0-wmf.19 status update

The 1.35.0-wmf.19 version of MediaWiki is blocked[0]. The new version is deployed to group1[1], but can proceed no further until these issues are resolved: * Varnish 5xx 2k/min spike - https://phabricator.wikimedia.org/T245202 Once these issues are resolved train can resume. If these issues are

[Wikitech-l] [Train] 1.35.0-wmf.16 status update: Remains blocked

The 1.35.0-wmf.16 version of MediaWiki is blocked[0] from moving to group2. (A previous iteration of this mail that I sent on the 23rd of January indicated that the train had only rolled as far as group0 - that was an error on my part.) The new version can't proceed to group2 [1] until this

[Wikitech-l] [Train] 1.35.0-wmf.16 status update (blocked)

The 1.35.0-wmf.16 version of MediaWiki is blocked[0]. The new version can't proceed to group1 and group2 [1] until this issue is resolved: * T243548: Elevated response times and CPU usage after deploy of 1.35.0-wmf.16 to all wikis - https://phabricator.wikimedia.org/T243548 If all issues are

[Wikitech-l] [Train] 1.35.0-wmf.11 status update

The 1.35.0-wmf.11 version of MediaWiki is blocked[0]. The new version is deployed to group 0[1], but can proceed no further until these issues are resolved: * VisualEditor throwing "PHP Notice: Undefined index: etag" on officewiki as of wmf.11 - https://phabricator.wikimedia.org/T240961 *

[Wikitech-l] [Train] 1.35.0-wmf.8 status update (blocked)

The 1.35.0-wmf.8 version of MediaWiki is blocked[0]. The train was tentatively unblocked on Friday. Details can be read here: * After deploy of 1.35.0-wmf.8 to group1, surge of "Cannot access the database: Unknown error" - https://phabricator.wikimedia.org/T239877 The new version can't

[Wikitech-l] [Train] 1.35.0-wmf.8 status update (blocked)

The 1.35.0-wmf.8 version of MediaWiki is blocked[0]. The new version can't proceed to group1 and group2 [1] until these issues are resolved: * After deploy of 1.35.0-wmf.8 to group1, surge of "Cannot access the database: Unknown error" - https://phabricator.wikimedia.org/T239877 Additionally,

[Wikitech-l] [Train] 1.35.0-wmf.3 status update

The 1.35.0-wmf.3 version of MediaWiki is no longer blocked[0], and was deployed to group 0 earlier today at 19:27 UTC, using the American deploy window. Thanks to andrewbogott for supplying helpful context in unblocking the train, as well as hashar, thcipriani, mutante, and paladox for dealing

[Wikitech-l] [Train] 1.35.0-wmf.3 status update]

(Re-send to wikitech-l, first attampt had wrong address.) The 1.35.0-wmf.3 version of MediaWiki is blocked[0]. The new version is not deployed anywhere[1], and can proceed no further until these issues are resolved: * scap sync failed, database error - https://phabricator.wikimedia.org/T236166

[Wikitech-l] Train 1.35.0-wmf.2 Status Update

The 1.35.0-wmf.2 version of MediaWiki is no longer blocked[0]! Thanks to Krinkle, Mobrovac, Nikerabbit, and everyone else who worked on unblocking the train. We plan to deploy the new version to group2 today. -- Your humble train toiler [0]. --

[Wikitech-l] Train 1.35.0-wmf.2 Status Update

The 1.35.0-wmf.2 version of MediaWiki is blocked[0]. The new version is deployed to group(s) 0 & 1[1], but can proceed no further until these issues are resolved: * Some revisions' contents are incorrect in the cache - wrong contents shown in history & diffs -

[Wikitech-l] Train status for 1.34.0-wmf.24

The deployment of 1.34.0-wmf.24 to group0 was delayed until late Tuesday, night/evening. More specifically, I promoted the branch to group0 just about 20 minutes ago at approximately 03:30 UTC / 8:30 PM San Francisco. Group 1 is scheduled for tomorrow between 19:00 - 21:00 UTC. There are

Re: [Wikitech-l] [Train] 1.34.0-wmf.22 status update

On 12/09/2019 23:42, Antoine Musso wrote: Hello, Deployment of MediaWiki 1.34.0-wmf.22 on the Wikimedia cluster is currently blocked. It is blocked on a php7.2 bug that has yet to be tracked and determined. Immediately after deploying to group1 (which has commons and wikidata), I noticed

[Wikitech-l] [Train] 1.34.0-wmf.22 status update

Hello, Deployment of MediaWiki 1.34.0-wmf.22 on the Wikimedia cluster is currently blocked. It is blocked on a php7.2 bug that has yet to be tracked and determined. Immediately after deploying to group1 (which has commons and wikidata), I noticed an infamous error in the logs: PHP

Re: [Wikitech-l] [Train] 1.34.0-wmf.20 status update

Can you give an update on the status of the train? Will Group 2 be moved to wmf.20 or will it skip that version? https://tools.wmflabs.org/versions/ Thanks! On Thu, Aug 29, 2019 at 12:48 PM Željko Filipin wrote: > The 1.34.0-wmf.20 version of MediaWiki is blocked[0]. > > The new version is

Re: [Wikitech-l] [Train] 1.34.0-wmf.20 status update

The 1.34.0-wmf.20 version of MediaWiki is blocked[0]. The new version is deployed to groups{0,1}[1], but can proceed no further until these issues are resolved: * T231542 AFPData.php: Refusing to cast DUNDEFINED to something else * T231554 ApiQueryMapData.php: Call to a member function

Re: [Wikitech-l] [Train] 1.34.0-wmf.20 status update

Hi! # TLDR 1.34.0-wmf.20 is at group 0, but blocked https://phabricator.wikimedia.org/T220745 # Blockers Train will not move forward until the following tasks are resolved or removed from blockers: * DefaultPreferencesFactory.php: Global default '' is invalid for field incubatortestwiki-code

Re: [Wikitech-l] [Train] 1.34.0-wmf.20 status update

I would like to thank everybody that worked on resolving train blockers. These tasks are now resolved. * L10n cache is completely broken https://phabricator.wikimedia.org/T231183 I've found more problems that are blocking the train from even starting. * RevisionBasedEntityLookup.php: Revision

[Wikitech-l] [Train] 1.34.0-wmf.20 status update

The 1.34.0-wmf.20 version of MediaWiki is blocked. https://phabricator.wikimedia.org/T220745 The new version is not deployed anywhere yet. It will not be deployed until these issues are resolved: * ServiceContainer.php: Circular dependency when creating MobileFrontend service "AMC.UserMode >

[Wikitech-l] [Train] 1.34.0-wmf.16 status update

The 1.34.0-wmf.16 version of MediaWiki is no longer blocked[0], and has been deployed to group1 and group2[1] as of 21:23 UTC. Thanks to andre__, Krinkle, aaron, thcipriani, everyone else who worked on unblocking the train, and everyone who has been so helpful during my first week of train duty.

[Wikitech-l] [Train] 1.34.0-wmf.16 status update

The 1.34.0-wmf.16 version of MediaWiki is blocked[0]. The new version can't proceed to group1 and group2 [1] until these issues are resolved: * File pages are not created: Fatal exception of type "Wikimedia\Rdbms\DBQueryError" - https://phabricator.wikimedia.org/T229605 * PHP Notice: Undefined

[Wikitech-l] [Train] 1.34.0-wmf.16 status update

The 1.34.0-wmf.16 version of MediaWiki is no longer blocked[0]! Thanks to mdholloway, Amir1, egardner, alaa_wmde, tstarling, and everyone else who helped unblock the train. We plan to deploy the new version to both group1 and group2[1] today. [0].

[Wikitech-l] [Train] 1.34.0-wmf.16 status update

The 1.34.0-wmf.16 version of MediaWiki is blocked[0], after a brief period of being unblocked. Thanks to Jdlrobson and everyone else who worked on unblocking the earlier issues. 1.34.0-wmf.16 cannot proceed to group1[1] until these issues are resolved: * PHP Warning:

[Wikitech-l] [Train] 1.34.0-wmf.16 status update

The 1.34.0-wmf.16 version of MediaWiki is blocked[0]. The new version can't proceed to group1[1] until these issues are resolved: * Disable grouped results on RecentChanges page on mobile - https://phabricator.wikimedia.org/T228280 * Inform AMC users that grouped results are not available on

[Wikitech-l] [Train] 1.34.0-wmf.16 status update

The 1.34.0-wmf.16 version of MediaWiki is no longer blocked[0]! Thanks to Krinkle, tstarling, and everyone else who worked on unblocking the train. We plan to deploy the new version to both group0 and group1[1] today. [0]. [1].

[Wikitech-l] [Train] 1.34.0-wmf.16 status update

The 1.34.0-wmf.16 version of MediaWiki is blocked[0]. The new version can't proceed to group0[1] until this issue is resolved: * serialize(): "" returned as member variable from __sleep() but does not exist - https://phabricator.wikimedia.org/T229366 Once this issue is resolved train can

Re: [Wikitech-l] Train

Hi greg, I did know about the versions tool and checked both to work it out. I actually was chatting with someone on discord and worked out that it saying 'all wikis' is from the commit that pushed it which sent 'all wikis' to .14 even though it only affected group2 as 0 and 1 were already on

Re: [Wikitech-l] Train

Hi RhinosF1, On Thu, Jul 18, 2019 at 09:21:05PM +0100, RhinosF1 Wikipedia wrote: > Hi, > Am I mistaken that based on > https://phabricator.wikimedia.org/T220739 the train should be fully rolled > back? You are probably reading the commit message of: Revert "all wikis to 1.34.0-wmf.14", correct?

[Wikitech-l] Train

Hi, Am I mistaken that based on https://phabricator.wikimedia.org/T220739 the train should be fully rolled back? https://noc.wikimedia.org/conf/highlight.php?file=wikiversions.json seems to show otherwise. RhinosF1 ___ Wikitech-l mailing list

[Wikitech-l] [Train] 1.34.0-wmf.13 status update

The 1.34.0-wmf.13 version of MediaWiki is no longer blocked[0]! Thanks to Anomie, Krinkle, Jforrester, Tgr, Ebernhardsen, and everyone else who worked on unblocking the train. We plan to deploy the new version to both group1 and group2 today. -- Your humble train toiler [0].

[Wikitech-l] [Train] 1.34.0-wmf.13 status update

The 1.34.0-wmf.13 version of MediaWiki is blocked[0]. The new version is deployed to group0[1], but can proceed no further until these issues are resolved: * PHP error from Special:OAuth: "Indirect modification of overloaded property User::$oAuthUserData" -

[Wikitech-l] [Train] 1.34.0-wmf.13 status update

The 1.34.0-wmf.13 version of MediaWiki is blocked[0]. The new version is deployed to group0[1], but can proceed no further until these issues are resolved: * action=history shows "username removed" for anonymous editors on mediawiki.org instead of IP addresses -

[Wikitech-l] [Train] 1.34-wmf.13 status update

The 1.34.0-wmf.13 version of MediaWiki is no longer blocked[0]! Thanks to aaron, Krinkle, Jforrester, and everyone else who worked to unblock the train. The new version will proceed on schedule tomorrow. -- Your humble train toiler [0]. -- Jeena

[Wikitech-l] [Train] 1.34.0-wmf.13 status update

The 1.34.0-wmf.13 version of MediaWiki is blocked[0]. The new version can not be deployed proceed until these issues are resolved: * Cannot save on 1.34.0-wmf.13 - "Cannot access the database: Unknown error"- https://phabricator.wikimedia.org/T227613

[Wikitech-l] Train status for 1.34.0-wmf.10 and wmf.11

The status of wmf.10 as of now: * Group 1 wikis are on wmf.10 [1] * There is one open blocker: T226448 [2] Assuming the remaining blocker is fixed, then we will deploy wmf.10 to all wikis tomorrow afternoon coincident with cutting the branch for wmf.11. Tomorrow, Jeena is in charge of the train

Re: [Wikitech-l] [Train] 1.33.0-wmf.24 status update

The 1.33.0-wmf.24 version of MediaWiki was successfully promoted to all wikis today. Thanks to everyone who helped fix outstanding issues from last week! Kindly, Dan On Thu, Apr 4, 2019 at 2:36 PM Dan Duvall wrote: > The 1.33.0-wmf.24 version of MediaWiki remains blocked[0], holding at >

Re: [Wikitech-l] [Train] 1.33.0-wmf.24 status update

The 1.33.0-wmf.24 version of MediaWiki remains blocked[0], holding at group0 pending resolution of the following issue: * RefreshLinksJob::runForTitle: transaction round 'RefreshLinksJob::run' already started on commons - https://phabricator.wikimedia.org/T220037 Errors related to the issue were

[Wikitech-l] [Train] 1.33.0-wmf.24 status update

The 1.33.0-wmf.24 version of MediaWiki is blocked[0]. The new version is deployed to group0[1], but can proceed no further until these issues are resolved: * Citoid should only usurp "https://phabricator.wikimedia.org/T219510 * RefreshLinksJob::runForTitle: transaction round

Re: [Wikitech-l] [Train] 1.33.0-wmf.19 status update

On 27/02/2019 22:04, Antoine Musso wrote: Hello, 1.33.0-wmf.19 has been deployed to group0. Tonight when promoting group1 I encountered Wikibase exceptions on commonswiki for requests reaching the File: namespace: Postcondition failed: Namespace for entity type property must be defined! I

[Wikitech-l] [Train] 1.33.0-wmf.19 status update

Hello, 1.33.0-wmf.19 has been deployed to group0. Tonight when promoting group1 I encountered Wikibase exceptions on commonswiki for requests reaching the File: namespace: Postcondition failed: Namespace for entity type property must be defined! I promptly rolled back group1. The task is

Re: [Wikitech-l] [Train] 1.33.0-wmf.18 status update

> In addition to those, I'm not sure whether we should be pushing out a > new train while beta cluster is unusable (locked in read-only mode): > . It is incredibly unfortunate that the Beta Cluster is down due to the corruption fallout. However, given

Re: [Wikitech-l] [Train] 1.33.0-wmf.18 status update

-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Hi, On 2/19/19 6:36 AM, Tyler Cipriani wrote: > I have not yet started the 1.33.0-wmf.18 train; however, at the end > of last week, I noticed some errors that (AFAICT) are regressions > in 1.33.0-wmf.17. In addition to those, I'm not sure whether

[Wikitech-l] [Train] 1.33.0-wmf.18 status update

Hello all! I have not yet started the 1.33.0-wmf.18 train; however, at the end of last week, I noticed some errors that (AFAICT) are regressions in 1.33.0-wmf.17. There were two new errors that started showing up in 1.33.0-wmf.17: 1. ErrorException from includes/HeaderCallback.php: PHP

Re: [Wikitech-l] [Train] 1.32.0-wmf.14 status update

Hi, all problems have been resolved and I have deployed 1.32.0-wmf.14 to all wikis about 30 minutes ago. So far logs look good to me. I have started working on incident report: https://wikitech.wikimedia.org/wiki/Incident_documentation/20180724-Train If you can help me finish it, please do.

Re: [Wikitech-l] [Train] 1.32.0-wmf.14 status update

Hi, the train is still blocked. Problems from the previous e-mail message are resolved, the new version is deployed to groups 0 and 1 but can proceed no further until these issues are resolved: - MapCacheLRU::has called with invalid key. Must be string or integer -

Re: [Wikitech-l] [Train] 1.32.0-wmf.14 status update

The train is still blocked. Problems from the previous e-mail message are resolved, the new version is deployed to groups 0 and 1 (except wikidata) but can proceed no further until these issues are resolved: * Wikidata dispatching stuck - https://phabricator.wikimedia.org/T200420 Once these

[Wikitech-l] [Train] 1.32.0-wmf.14 status update

Hi, 1.32.0-wmf.14 version of MediaWiki is blocked [0]. The new version is deployed to group 0 [1], but can proceed no further until these issues are resolved: - Wikibase\DataModel\Entity\EntityIdParsingException $serialization must not be an empty string -

[Wikitech-l] Train halted - Cirrus and DB issues

Hiya! I halted the train this afternoon. tl;dr: I rolled wmf.20 to group1 and I saw a huge spike in DB replag and Cirrus errors. Rolling back made them go away! There are tasks: https://phabricator.wikimedia.org/T186765 https://phabricator.wikimedia.org/T186764 I think Eric/Stas already fixed

Re: [Wikitech-l] Train status report: MediaWiki 1.30.0-wmf.6 blocked by T168681

Correction: the train will resume on Monday since there are no deployments on Fridays. On Thu, Jun 22, 2017 at 6:49 PM, Mukunda Modell wrote: > Starting today, immediately after SWAT, thcipriani noticed a new error in > fatalmonitor which appeared to coincide with running

[Wikitech-l] Train status report: MediaWiki 1.30.0-wmf.6 blocked by T168681

Starting today, immediately after SWAT, thcipriani noticed a new error in fatalmonitor which appeared to coincide with running scap. The curious thing is that scap only affected localization, no code was changed. At that point I took over for thcipriani and filed an UBN bug:

<    1   2