[Wikitech-l] Tidy replacement on final Wikimedia wikis on 5 July 2018

2018-06-14 Thread Subramanya Sastry

Hello everyone,

That time is finally upon us. [1]

On 6 July 2017, we made an announcement [2] about our plans to replace
Tidy with RemexHtml on the Wikimedia cluster.

Over the last year, we have progressively replaced Tidy on about 800
wikis in a phased manner. [3]

A year later, as announced and planned, on 5 July 2018, the last 100 or
so wikis [6] will have Tidy replaced to complete this transition. [3]

If you are an editor of one of these last remaining wikis, we have a
query [4] which gives you counts of linter issues in the main namespace
that might need fixing.

Many thanks to all the hundreds of editors on all the wikis who have
been fixing markup on pages and templates. You have enabled us to do
this much-required upgrade of a key part of our core technical platform
with the minimum of disruption to readers.

If you have any questions or concerns, please leave a comment on the
relevant Phabricator ticket [3] or leave a message on mediawiki.org. [5]

Thanks,

Subbu.

[1] https://www.mediawiki.org/wiki/Parsing/Replacing_Tidy
[2] 
https://lists.wikimedia.org/pipermail/wikitech-ambassadors/2017-July/001625.html

[3] https://phabricator.wikimedia.org/T175706
[4] https://quarry.wmflabs.org/query/27652
[5] https://www.mediawiki.org/wiki/Talk:Parsing/Replacing_Tidy
[6] List of wikis that will get Tidy replaced on 5 July 2018:

Wikipedias
--
af an ar as ast av az azb ba be bn bpy ce ckb cy
da diq el en eo es eu fr fy gd gu hak hi hr hu hy
id ja ka kk kn koi kv lrc lv mg mk ml mr ms myv nah nn
oc pam pl pnb pt ro roa_rup sd sh simple sl sr su sw
ta te tg th tr tt ug uk ur vi xmf yi yo zh zh_min_nan zh_yue

Wiktionaries

bg eo eu fr io ka lt mn ru th uz wa

Wikibooks
-
en fr

Wikisources
---
ar en fa fr he ru sa sl sr sourceswiki

Others
--
commons incubator

___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

[Wikitech-l] Heads up: multi-content revision patches landed in master

2018-06-14 Thread Daniel Kinzler
Hello all!

Several patches related to multi-content[1] revisions landed on master today.
The big ones are:

* https://gerrit.wikimedia.org/r/c/mediawiki/core/+/405015
* https://gerrit.wikimedia.org/r/c/mediawiki/core/+/406595
* https://gerrit.wikimedia.org/r/c/mediawiki/core/+/416465

These patches *should* by themselves not change any behavior. All new features
are still disabled, new database tables are not used yet.

We plan to have these on testwiki for more than a week before they go live with
the train in the week of the 25th. We made a plan with releng for this[2].
Deployment to testwiki (group0) will probably happen tonight.

Until then, the new code can already be tested on the beta cluster. We did
extensive manual testing beforehand on a dedicated vps. Test logs are available
at [3].

If you find any problems, please file tickets on phabricator and tag them with
the #Multi-Content-Revisions project.

Overall progress of the MCR storage layer deployment ins tracked on phabricator
[4]. Next steps will be to further refactor the code that is now in the
(intermediate/internal) DerivedPageDataUpdater class, and to change core code to
use the new interfaces. We will also look into providing alternatives to several
of the hook points triggered during page edits.

Cheers,
Daniel

[1] https://www.mediawiki.org/wiki/Requests_for_comment/Multi-Content_Revisions
[2] https://phabricator.wikimedia.org/T196585
[3]
https://www.mediawiki.org/wiki/User:Daniel_Kinzler_(WMDE)/MCR-StorageLayerTesting
[4] https://phabricator.wikimedia.org/T174044

-- 
Daniel Kinzler
Principal Platform Engineer

Wikimedia Deutschland
Gesellschaft zur Förderung Freien Wissens e.V.
\o/\o/ff

___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] [Cloud] Help us build Toolhub

2018-06-14 Thread Petr Bena
Hello,

Interesting, but I think that more data should be collected about the
tools, especially the technologies and programming languages used, so
that another similar portal could be built with these data for
programmers / volunteers looking for a technical project to work on.

IDK what is current status of our own alternative for
https://whatcanidoformozilla.org/ but it would be really nice to have
some similar portal for new programmers that are simply looking for a
project to work on based on technology or programming language they
like. If this toolhub contained this information as well, we could
reuse the data for such portal as well.

On Thu, Jun 14, 2018 at 4:51 AM, James Hare  wrote:
> Hello everyone, sorry for cross-posting.
>
> What does your participation on the Wikimedia projects look like? Do you
> edit articles? Upload files? Patrol vandalism? Translate articles? Translate
> interface messages? Do you organize people, online or offline? Do you train
> new editors, or new trainers? Do you write code?
>
> There are many different ways to contribute to Wikimedia – more than you
> would expect just from reading Wikipedia articles. With many kinds of
> contributions there are many tools you can use, most of which have been
> developed by our volunteer community. But do you know how to find these
> tools?
>
> Since January the Wikimedia Cloud Services team at the Wikimedia Foundation
> has been meeting with contributors, organizers, and tool developers to learn
> more about the role tools play in our communities' work. We have also been
> researching existing methods for organizing lists of tools – at least 14 of
> them, including popular tool catalogs like Hay's Tool Directory.[0] With
> this research, we hope to figure out how best to put the right tools in
> front of the right people.
>
> For this, we need your help. We have a page on Meta summarizing our current
> work,[1] as well as a proposed data model for describing tools.[2] Consider
> what work you currently do, whether you contribute content, code, organizing
> support, what have you – and ask: if there was a tool you needed to complete
> a certain task, would you know where to look? How would you look for it?
> Please look over [1] and [2] and let us know what you think. Feedback is
> welcome in any language. If you would like to get in touch privately, you
> are also welcome to email me at jh...@wikimedia.org.
>
>
> Best regards,
> James Hare
>
> [0] https://tools.wmflabs.org/hay/directory/
> [1] https://meta.wikimedia.org/wiki/Toolhub
> [2] https://meta.wikimedia.org/wiki/Toolhub/Data_model
>
> 
> James Hare
> Associate Product Manager
> Wikimedia Foundation
> https://wikimediafoundation.org
>
> ___
> Wikimedia Cloud Services mailing list
> cl...@lists.wikimedia.org (formerly lab...@lists.wikimedia.org)
> https://lists.wikimedia.org/mailman/listinfo/cloud

___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

[Wikitech-l] LAST CALL for Nomination of new TechCom members!

2018-06-14 Thread Daniel Kinzler
This is the last call for nominations of new TechCom members. Nominations are
open until Monday, June 18.

If you are interested in joining TechCom, or you believe someone else should
join TechCom, please read the call for nominations below.

 Weitergeleitete Nachricht 
Betreff: Call for Nominations: TechCom is looking for new members
Datum: Mon, 4 Jun 2018 16:00:57 +0200
Von: Daniel Kinzler 
Organisation: Wikimedia Deutschland e.V.
An: wikitec...@wikimedia.org

Dear all,

We, the Wikimedia Technical Committee (TechCom), are looking for two new members
to broaden the committee’s area of expertise. If you can think of anyone
(including yourself) who may be a good addition to TechCom, please read on, here
or on the wiki [2].

TechCom is the guardian of the integrity, consistency, stability, and
performance of all software supporting the Wikimedia projects. It acts as the
senior advisor and the convergence point of all decisions related to technical
work that is strategic, cross-cutting, and/or hard to undo [1].

Traditionally, TechCom members have mainly been experts for MediaWiki core. We
have been slowly growing the committee to get a broader perspective, and now
want to try harder to cover our blind spots by starting this nomination process.

Some areas of expertise that we hope new members would bring to the table
include: internationalization, deployment and releases, mobiles apps, security,
performance, and analytics. We are also interested in expertise in areas at the
fringes of TechCom’s scope, such as privacy, interaction design, and bug 
wrangling.

Of course, we will not be able to cover all these areas perfectly with the
addition of just two people and we will likely expand the size of the committee
further in the future. For now however, we want to be careful to not to grow the
committee too quickly, so that we have time to adjust existing processes to a
larger group.

TechCom members are expected to be available at least 4 hours per week for
committee work. This includes meetings, administrative work, and technical work
[1], and also taking care of the RFC process [4]. As we evolve the committee to
become more proactive, we also expect to spend more time drafting and discussing
guidelines and policies.

You can find the list of current members on the TechCom page [3]. If you would
like to join, or want to nominate somebody else, please send an email to
 by June 18 with “Nomination for ” in the subject
line. The email should contain an overview of the nominee’s skill set and
experience as well as a short pitch explaining why this person would be a good
addition to TechCom.

Nominations are now open until June 18, 2018; and we will review the submissions
and vet the potential new members over the following weeks. We hope that we can
announce new members before the end of July.


Daniel Kinzler,
Chair of the Wikimedia Technical Committee


[1] https://www.mediawiki.org/wiki/Wikimedia_Technical_Committee/Charter
[2]
https://www.mediawiki.org/wiki/Wikimedia_Technical_Committee/Call_for_Nominations
[3] https://www.mediawiki.org/wiki/Wikimedia_Technical_Committee
[4] https://www.mediawiki.org/wiki/Requests_for_comment/Process

-- 
Daniel Kinzler
Principal Platform Engineer

Wikimedia Deutschland
Gesellschaft zur Förderung Freien Wissens e.V.

___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] [MediaWiki-announce] MediaWiki 1.31.0 now available!

2018-06-14 Thread Derk-Jan Hartman
Chad,

On this last release email, I just want to thank you for your tireless
contributions in the past years both as a Wikipedian (2005), a volunteer
developer (2008?) and as a WMF employee (2010?). Your commitment to open
source and our projects has been amazing and you moved us forward while at
the same time doing the stuff that just needs to happen with a project like
this. You didn't shy from controversial or difficult discussions and stood
up for things that mattered.
I've also had the pleasure of meeting you in person at events and you
always managed to light up the room with your joy and enthusiasm.

Hope to see you lurking on IRC and maybe some more Wikipedia edits ?

Smiley, no tears.
DJ

On Thu, Jun 14, 2018 at 8:22 AM Chad Horohoe  wrote:

> Hello everyone,
>
> I am happy to announce the availability of the general release of MediaWiki
> 1.31!
>
> MediaWiki 1.31 includes all changes released in the smaller 1.31.0-wmf.*
> software deployments to Wikimedia sites over six months, totaling over 2100
> commits by roughly 130 unique authors. This is a very large release that
> contains many new features and bug fixes. It is also an LTS release.
>
> This is a summary of the major changes of interest to users and
> administrators:
> * https://www.mediawiki.org/wiki/MediaWiki_1.31
>
> You can always consult the RELEASE-NOTES-1.31 file for the full list of
> changes in this version.
>
> Full release notes:
> *
>
> https://phabricator.wikimedia.org/diffusion/MW/browse/REL1_31/RELEASE-NOTES-1.31
> * https://www.mediawiki.org/wiki/Release_notes/1.31
>
> **
>
> Download:
> https://releases.wikimedia.org/mediawiki/1.31/mediawiki-1.31.0.tar.gz
> https://releases.wikimedia.org/mediawiki/1.31/mediawiki-core-1.31.0.tar.gz
>
> GPG signatures:
> https://releases.wikimedia.org/mediawiki/1.31/mediawiki-1.31.0.tar.gz.sig
>
> https://releases.wikimedia.org/mediawiki/1.31/mediawiki-core-1.31.0.tar.gz.sig
>
> Public keys:
> https://www.mediawiki.org/keys/keys.html
>
> **
>
> On a personal note, this will be the last release that I shall be handling.
> As many probably know I left Wikimedia this month for a new career and as
> such I won't have the time to dedicate to releasing MediaWiki anymore.
> Whomever picks up the torch will do fantastic. See you all around the
> Internet :)
>
> -Chad
> ___
> MediaWiki announcements mailing list
> To unsubscribe, go to:
> https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce
> ___
> Wikitech-l mailing list
> Wikitech-l@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikitech-l
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

[Wikitech-l] [MediaWiki-announce] MediaWiki 1.31.0 now available!

2018-06-14 Thread Chad Horohoe
Hello everyone,

I am happy to announce the availability of the general release of MediaWiki
1.31!

MediaWiki 1.31 includes all changes released in the smaller 1.31.0-wmf.*
software deployments to Wikimedia sites over six months, totaling over 2100
commits by roughly 130 unique authors. This is a very large release that
contains many new features and bug fixes. It is also an LTS release.

This is a summary of the major changes of interest to users and
administrators:
* https://www.mediawiki.org/wiki/MediaWiki_1.31

You can always consult the RELEASE-NOTES-1.31 file for the full list of
changes in this version.

Full release notes:
*
https://phabricator.wikimedia.org/diffusion/MW/browse/REL1_31/RELEASE-NOTES-1.31
* https://www.mediawiki.org/wiki/Release_notes/1.31

**

Download:
https://releases.wikimedia.org/mediawiki/1.31/mediawiki-1.31.0.tar.gz
https://releases.wikimedia.org/mediawiki/1.31/mediawiki-core-1.31.0.tar.gz

GPG signatures:
https://releases.wikimedia.org/mediawiki/1.31/mediawiki-1.31.0.tar.gz.sig
https://releases.wikimedia.org/mediawiki/1.31/mediawiki-core-1.31.0.tar.gz.sig

Public keys:
https://www.mediawiki.org/keys/keys.html

**

On a personal note, this will be the last release that I shall be handling.
As many probably know I left Wikimedia this month for a new career and as
such I won't have the time to dedicate to releasing MediaWiki anymore.
Whomever picks up the torch will do fantastic. See you all around the
Internet :)

-Chad
___
MediaWiki announcements mailing list
To unsubscribe, go to:
https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l