Re: [Wikitech-l] [MediaWiki-l] Announcing the Core Platform team

[Pine W]

Hi Victoria and Toby.

Thank you for this information. I am a little hazy about a couple of points
and I hope that you can provide more detail.

1. My understanding from your email is that the converged Core Platform
Team will exist inside of the Technology Department, but the Platform
Evolution Program is a cross-department program. Can you explain further
how the single-department nature of the Core Platform Team will be
harmonized with the cross-department nature of the Platform Evolution CDP?

2. I have a concern regarding the statement "The Platform Evolution (PE)
cross-departmental program (CDP) is approved in the annual plan for next
fiscal year". That statement seems to conflict with the 2018-2019 WMF
Annual Plan's current nature of being a draft that has not been approved by
the WMF Board. Has the Platform Evolution CDP been approved for inclusion
in the annual plan *draft*, or did this program get approved by the Board
in advance of the rest of the WMF Annual Plan?

Thank you,

Pine
( https://meta.wikimedia.org/wiki/User:Pine )


On Tue, Apr 10, 2018 at 10:57 AM, Victoria Coleman 
wrote:

> Hi everyone,
>
> We are very pleased to be making three big announcements:
>
> 1. The Platform Evolution (PE) cross-departmental program (CDP) is
> approved in the annual plan for next fiscal year.
>
> This PE CDP was developed with input from staff across our organization in
> the Audiences and Technology Working Group. Together, these staff worked to
> identify some of our most pressing issues while opening healthy discussions
> between both departments and WMDE.
>
> Along with the other Technology programs funded in the annual plan,
> funding of this program represents a renewed commitment by the Foundation
> to the long term health of the technology that is key to supporting our
> mission, staff and communities.
>
>
> 2. We are creating the Core Platform team, a new converged platform and
> services team to be the focus of the Platform Evolution CDP.
>
>
> We are doing this in order to better support the PE CDP and begin the hard
> work of re-architecting our technology stack into a more sustainable and
> flexible platform, in support of the Wikimedia movement strategic
> direction. The MediaWiki Platform team alongside the Services Platform team
> hold some of the most senior technologists of our community. Their skill
> sets and experience are vitally important for the success of the CDP so
> they will be moving into the new Core Platform team. We want to thank Tim
> Starling and Marko Obrovac for their hard work, leadership and dedication
> which has brought us to this point. They and their teams are doing
> incredibly  important work to sustain our software stack day in day out
> while also looking into the future and guiding the reengineering of our
> platform to support the mission for the years ahead.
>
>
> 3. Corey Floyd will be joining the Technology Department to lead the Core
> Platform team.
>
> In addition to day to day management, Corey will operate in the program
> management capacity for the PE CDP. Corey was instrumental in formulating
> the PE CDP, assembling the program through extensive needs analysis,
> synthesis, and collaboration with Foundation team members and WMDE. He
> brings a proven track record in clarifying stakeholder needs and
> translating them into amazing products.
>
> As many of you know, Corey started at the Foundation as an iOS engineer,
> was promoted to manage the iOS and Android native apps engineers who worked
> tirelessly to evolve the open source apps into award winners beloved by
> millions of our users, and has been operating in an
> engineering product owner capacity for the Infrastructure team within
> Audiences-Readers. He is known for his work ethic, thought leadership, real
> world experience, and collegial spirit.
>
> Audiences will be working to backfill the duties of Corey in Apps
> engineering management and Reading Infrastructure product ownership, and
> work is already underway to close these gap in conjunction with Corey’s
> cutover to Technology.
>
> We’re happy to make the Platform Evolution CDP official. And please join
> me in welcoming Corey to Technology, where he’ll transition on July 1,
> 2018. We’ll be sharing more updates about the team and the PE CDP in the
> coming weeks.
>
>
> We are incredibly excited!
>
>
> Victoria and Toby
> ___
> MediaWiki-l mailing list
> To unsubscribe, go to:
> https://lists.wikimedia.org/mailman/listinfo/mediawiki-l
>
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

[Wikitech-l] Proposal to remove $wgValidateAllHtml and MWTidy::checkErrors() without deprecation

[Kunal Mehta]

Hi,

As part of the goal to have MediaWiki 1.31 default to using RemexHtml
and replacing tidy, we want to remove MWTidy::checkErrors() and
$wgValidateAllHtml as part of MediaWiki 1.31, without a deprecation period.

MWTidy::checkErrors() basically ran the provided input through tidy, and
checked if it complained. This doesn't make sense using an HTML 5
parser, since they provide recovery conditions to fix parse errors.

If $wgValidateAllHtml was set, MediaWiki would output an error page
instead of the content if tidy reported errors in the output.

Technically, this also means removing TidyDriverBase::validate() (unused
besides MWTidy::checkErrors()), and
MediaWikiTestCase::assertValidHtmlDocument/assertValidHtmlSnippet() (now
unused; previously only used in Capiunto as a defensive check).

There is some more rationale and discussion on the task for this: [2].
The Gerrit patch is [3].

[1] https://phabricator.wikimedia.org/T185753
[2] https://phabricator.wikimedia.org/T191670
[3] https://gerrit.wikimedia.org/r/#/c/425093/

-- James & Legoktm


___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] [Wmfall] Announcing the Core Platform team

[Joshua Minor]

Its been my privilege to work with Corey as a tech lead, then engineering
manager and peer product owner for 3 years. We will miss Corey immensely in
app land, and I will miss him personally as a day-in-day-out partner on our
apps, but I am so glad to see Corey's "work ethic, thought leadership, real
world experience, and collegial spirit" being put to work to bridge the
gaps and move us forward together.

I look forward to seeing the platform evolution plans turn into reality,
and wish Corey, the new Core Platform team and all involved with bringing
the working-group/CDP together all the best with this hugely important
undertaking.

On Tue, Apr 10, 2018 at 10:57 AM, Victoria Coleman 
wrote:

> Hi everyone,
>
> We are very pleased to be making three big announcements:
>
> 1. The Platform Evolution (PE) cross-departmental program (CDP) is
> approved in the annual plan for next fiscal year.
>
> This PE CDP was developed with input from staff across our organization in
> the Audiences and Technology Working Group. Together, these staff worked to
> identify some of our most pressing issues while opening healthy discussions
> between both departments and WMDE.
>
> Along with the other Technology programs funded in the annual plan,
> funding of this program represents a renewed commitment by the Foundation
> to the long term health of the technology that is key to supporting our
> mission, staff and communities.
>
>
> 2. We are creating the Core Platform team, a new converged platform and
> services team to be the focus of the Platform Evolution CDP.
>
>
> We are doing this in order to better support the PE CDP and begin the hard
> work of re-architecting our technology stack into a more sustainable and
> flexible platform, in support of the Wikimedia movement strategic
> direction. The MediaWiki Platform team alongside the Services Platform team
> hold some of the most senior technologists of our community. Their skill
> sets and experience are vitally important for the success of the CDP so
> they will be moving into the new Core Platform team. We want to thank Tim
> Starling and Marko Obrovac for their hard work, leadership and dedication
> which has brought us to this point. They and their teams are doing
> incredibly  important work to sustain our software stack day in day out
> while also looking into the future and guiding the reengineering of our
> platform to support the mission for the years ahead.
>
>
> 3. Corey Floyd will be joining the Technology Department to lead the Core
> Platform team.
>
> In addition to day to day management, Corey will operate in the program
> management capacity for the PE CDP. Corey was instrumental in formulating
> the PE CDP, assembling the program through extensive needs analysis,
> synthesis, and collaboration with Foundation team members and WMDE. He
> brings a proven track record in clarifying stakeholder needs and
> translating them into amazing products.
>
> As many of you know, Corey started at the Foundation as an iOS engineer,
> was promoted to manage the iOS and Android native apps engineers who worked
> tirelessly to evolve the open source apps into award winners beloved by
> millions of our users, and has been operating in an
> engineering product owner capacity for the Infrastructure team within
> Audiences-Readers. He is known for his work ethic, thought leadership, real
> world experience, and collegial spirit.
>
> Audiences will be working to backfill the duties of Corey in Apps
> engineering management and Reading Infrastructure product ownership, and
> work is already underway to close these gap in conjunction with Corey’s
> cutover to Technology.
>
> We’re happy to make the Platform Evolution CDP official. And please join
> me in welcoming Corey to Technology, where he’ll transition on July 1,
> 2018. We’ll be sharing more updates about the team and the PE CDP in the
> coming weeks.
>
>
> We are incredibly excited!
>
>
> Victoria and Toby
>
> ___
> Wmfall mailing list
> wmf...@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wmfall
>
>
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

[Wikitech-l] Announcing the Core Platform team

[Victoria Coleman]

Hi everyone, 

We are very pleased to be making three big announcements:

1. The Platform Evolution (PE) cross-departmental program (CDP) is approved in 
the annual plan for next fiscal year. 

This PE CDP was developed with input from staff across our organization in the 
Audiences and Technology Working Group. Together, these staff worked to 
identify some of our most pressing issues while opening healthy discussions 
between both departments and WMDE. 

Along with the other Technology programs funded in the annual plan, funding of 
this program represents a renewed commitment by the Foundation to the long term 
health of the technology that is key to supporting our mission, staff and 
communities. 


2. We are creating the Core Platform team, a new converged platform and 
services team to be the focus of the Platform Evolution CDP.


We are doing this in order to better support the PE CDP and begin the hard work 
of re-architecting our technology stack into a more sustainable and flexible 
platform, in support of the Wikimedia movement strategic direction. The 
MediaWiki Platform team alongside the Services Platform team hold some of the 
most senior technologists of our community. Their skill sets and experience are 
vitally important for the success of the CDP so they will be moving into the 
new Core Platform team. We want to thank Tim Starling and Marko Obrovac for 
their hard work, leadership and dedication which has brought us to this point. 
They and their teams are doing incredibly  important work to sustain our 
software stack day in day out while also looking into the future and guiding 
the reengineering of our platform to support the mission for the years ahead. 


3. Corey Floyd will be joining the Technology Department to lead the Core 
Platform team.

In addition to day to day management, Corey will operate in the program 
management capacity for the PE CDP. Corey was instrumental in formulating the 
PE CDP, assembling the program through extensive needs analysis, synthesis, and 
collaboration with Foundation team members and WMDE. He brings a proven track 
record in clarifying stakeholder needs and translating them into amazing 
products.

As many of you know, Corey started at the Foundation as an iOS engineer, was 
promoted to manage the iOS and Android native apps engineers who worked 
tirelessly to evolve the open source apps into award winners beloved by 
millions of our users, and has been operating in an 
engineering product owner capacity for the Infrastructure team within 
Audiences-Readers. He is known for his work ethic, thought leadership, real 
world experience, and collegial spirit. 

Audiences will be working to backfill the duties of Corey in Apps engineering 
management and Reading Infrastructure product ownership, and work is already 
underway to close these gap in conjunction with Corey’s cutover to Technology.

We’re happy to make the Platform Evolution CDP official. And please join me in 
welcoming Corey to Technology, where he’ll transition on July 1, 2018. We’ll be 
sharing more updates about the team and the PE CDP in the coming weeks. 


We are incredibly excited!


Victoria and Toby
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

[Wikitech-l] pagecounts-ez missing April files (was Re: changes coming to large dumps)

[Ariel Glenn WMF]

If it's gone, that's coincidence. Flagging this to look into, thanks for
the report. Please follow that ticket,
https://phabricator.wikimedia.org/T184258 for more info.

On Tue, Apr 10, 2018 at 5:35 PM, Derk-Jan Hartman <
d.j.hartman+wmf...@gmail.com> wrote:

> It seems that the pagecounts-ez sets disappeared from
> dumps.wikimedia.org starting this date. Is that a coincidence ?
> Is it https://phabricator.wikimedia.org/T189283 perhaps ?
>
> DJ
>
> On Thu, Mar 29, 2018 at 2:42 PM, Ariel Glenn WMF 
> wrote:
> > Here it comes:
> >
> > For the April 1st run and all following runs, the Wikidata dumps of
> > pages-meta-current.bz2 will be produced only as separate downloadable
> > files, no recombined single file will be produced.
> >
> > No other dump jobs will be impacted.
> >
> > A reminder that each of the single downloadable pieces has the siteinfo
> > header and the mediawiki footer so they may all be processed separately
> by
> > whatever tools you use to grab data out of the combined file. If your
> > workflow supports it, they may even be processed in parallel.
> >
> > I am still looking into what the best approach is for the pags-articles
> > dumps.
> >
> > Please forward wherever you deem appropriate. For further updates, don't
> > forget to check the Phab ticket!  https://phabricator.wikimedia.
> org/T179059
> >
> > On Mon, Mar 19, 2018 at 2:00 PM, Ariel Glenn WMF 
> > wrote:
> >
> >> A reprieve!  Code's not ready and I need to do some timing tests, so the
> >> March 20th run will do the standard recombining.
> >>
> >> For updates, don't forget to check the Phab ticket!
> >> https://phabricator.wikimedia.org/T179059
> >>
> >> On Mon, Mar 5, 2018 at 1:10 PM, Ariel Glenn WMF 
> >> wrote:
> >>
> >>> Please forward wherever you think appropriate.
> >>>
> >>> For some time we have provided multiple numbered pages-articles bz2
> file
> >>> for large wikis, as well as a single file with all of the contents
> combined
> >>> into one.  This is consuming enough time for Wikidata that it is no
> longer
> >>> sustainable.  For wikis where the sizes of these files to recombine is
> "too
> >>> large", we will skip this recombine step. This means that downloader
> >>> scripts relying on this file will need to check its existence, and if
> it's
> >>> not there, fall back to downloading the multiple numbered files.
> >>>
> >>> I expect to get this done and deployed by the March 20th dumps run.
> You
> >>> can follow along here: https://phabricator.wikimedia.org/T179059
> >>>
> >>> Thanks!
> >>>
> >>> Ariel
> >>>
> >>
> >>
> > ___
> > Wikitech-l mailing list
> > Wikitech-l@lists.wikimedia.org
> > https://lists.wikimedia.org/mailman/listinfo/wikitech-l
>
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] changes coming to large dumps

[Derk-Jan Hartman]

It seems that the pagecounts-ez sets disappeared from
dumps.wikimedia.org starting this date. Is that a coincidence ?
Is it https://phabricator.wikimedia.org/T189283 perhaps ?

DJ

On Thu, Mar 29, 2018 at 2:42 PM, Ariel Glenn WMF  wrote:
> Here it comes:
>
> For the April 1st run and all following runs, the Wikidata dumps of
> pages-meta-current.bz2 will be produced only as separate downloadable
> files, no recombined single file will be produced.
>
> No other dump jobs will be impacted.
>
> A reminder that each of the single downloadable pieces has the siteinfo
> header and the mediawiki footer so they may all be processed separately by
> whatever tools you use to grab data out of the combined file. If your
> workflow supports it, they may even be processed in parallel.
>
> I am still looking into what the best approach is for the pags-articles
> dumps.
>
> Please forward wherever you deem appropriate. For further updates, don't
> forget to check the Phab ticket!  https://phabricator.wikimedia.org/T179059
>
> On Mon, Mar 19, 2018 at 2:00 PM, Ariel Glenn WMF 
> wrote:
>
>> A reprieve!  Code's not ready and I need to do some timing tests, so the
>> March 20th run will do the standard recombining.
>>
>> For updates, don't forget to check the Phab ticket!
>> https://phabricator.wikimedia.org/T179059
>>
>> On Mon, Mar 5, 2018 at 1:10 PM, Ariel Glenn WMF 
>> wrote:
>>
>>> Please forward wherever you think appropriate.
>>>
>>> For some time we have provided multiple numbered pages-articles bz2 file
>>> for large wikis, as well as a single file with all of the contents combined
>>> into one.  This is consuming enough time for Wikidata that it is no longer
>>> sustainable.  For wikis where the sizes of these files to recombine is "too
>>> large", we will skip this recombine step. This means that downloader
>>> scripts relying on this file will need to check its existence, and if it's
>>> not there, fall back to downloading the multiple numbered files.
>>>
>>> I expect to get this done and deployed by the March 20th dumps run.  You
>>> can follow along here: https://phabricator.wikimedia.org/T179059
>>>
>>> Thanks!
>>>
>>> Ariel
>>>
>>
>>
> ___
> Wikitech-l mailing list
> Wikitech-l@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikitech-l

___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

[Wikitech-l] Tomorrow: Technical Advice IRC Meeting

[Michael Schönitzer]

Sorry for cross-posting!

Reminder: Technical Advice IRC meeting again **tomorrow, Wednesday 3-4 pm
UTC** on #wikimedia-tech.

The Technical Advice IRC meeting is open for all volunteer developers,
topics and questions. This can be anything from "how to get started" over
"who would be the best contact for X" to specific questions on your project.

If you know already what you would like to discuss or ask, please add your
topic to the next meeting:
https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting

Hope to see you there!
Michi (for WMDE’s tech team)


-- 
Michael F. Schönitzer



Wikimedia Deutschland e.V. | Tempelhofer Ufer 23-24 | 10963 Berlin
Tel. (030) 219 158 26-0
http://wikimedia.de

Stellen Sie sich eine Welt vor, in der jeder Mensch an der Menge allen
Wissens frei teilhaben kann. Helfen Sie uns dabei!
http://spenden.wikimedia.de/

Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e.V.
Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter
der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für
Körperschaften I Berlin, Steuernummer 27/681/51985.
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

[Wikitech-l] Code of Conduct for Wikimedia technical spaces - Code of Conduct Committee - Candidates

[Sébastien Santoro]

Hello all,

The Code of Conduct Committee has published the list of candidates for
the next 6 months term:

https://www.mediawiki.org/wiki/Code_of_Conduct/Committee/Candidates/2018-I

If nominated, these candidates will be trusted to enforce the code of
conduct for Wikimedia
technical spaces. You can read it at
https://www.mediawiki.org/wiki/Code_of_Conduct.

Any feedback or concern about a candidate can be submitted in private
to techcond...@wikimedia.org
for the next two weeks, until Tuesday 2018-04-24.

If there is any need to change the candidates slate following the
community feedback,
the committee will submit a new list, and a new two weeks period will
take place.

--
For the Code of Conduct Committee,
Sébastien Santoro aka Dereckson
https://www.dereckson.be/

___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l