Re: [Wikitech-l] Tidy will be replaced by RemexHTML on Wikimedia wikis latest by June 2018

2017-07-07 Thread Pine W
Thanks very much for the detailed comments, Subbu. And thanks to the folks
who are working on tools to help automate the necessary changes. It sounds
like there's cooperative effort and careful planning that hopefully will
make the Tidy to RemexHTML process a smooth one.

Pine
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

[Wikitech-l] Human-readable section IDs

2017-07-07 Thread Max Semenik
Hey, the way non-Latin characters are displayed in section has always been
a serious complaint from our communities:
https://phabricator.wikimedia.org/T152540

Community tech has done some work in this area and it's ready to get more
eyeballs:
https://gerrit.wikimedia.org/r/#/c/362326/

A few words about implementation plan:
* There is now a concept of primary vs. fallback IDs. Primary are used for
linking, fallbacks are used so that old links still work.
* To transition to the new system, a wiki should first continue serving
legacy-encoded sections with new encoding as a fallback, then switch the
two after all older parser/HTTP caches have been filled with new HTML.
Legacy encoding should remain enabled as long as there is a noticeable
traffic using it, on WMF sites that probably means years.
* By default, MediaWiki will still behave exactly like before. Changing the
defaults to something more modern will be discussed later, after all the
initial issues are resolved.
* Because it's being used without escaping in so many places outside of
core and because there is now a fine distinction between ID escaping for
different purposes, Sanitizer::escapeId() is deprecated. It will never
output new encoding and should be replaced with one of escapeIdForHtml(),
escapeIdForLink() or escapeIdForExternalInterwiki() AFTER making sure it's
getting properly escaped.

Your help reviewing/testing/discussing this is highly appreciated!

-- 
Best regards,
Max Semenik ([[User:MaxSem]])
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Tidy will be replaced by RemexHTML on Wikimedia wikis latest by June 2018

2017-07-07 Thread Subramanya Sastry



- On the Full Analysis window, the second button with a globe and a
broom (Subbu, would you have a recommended icon for Linter 
related stuff ?)


I will have to get back to you on this. I'll have to get some help 
from someone who can design / recommend something appropriate here.


I added a logo to https://www.mediawiki.org/wiki/Extension:Linter

Subbu.

___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Tidy will be replaced by RemexHTML on Wikimedia wikis latest by June 2018

2017-07-07 Thread Subramanya Sastry

On 07/07/2017 04:05 PM, Chad wrote:


On Thu, Jul 6, 2017 at 5:02 AM Subramanya Sastry 
wrote:


6. Tools to assist editors: Linter & ParserMigration

In October 2016, at the parsing team offsite, Kunal ([[User:Legoktm
(WMF)]])
dusted off the stalled wikitext linting project [11] and (with the help
from
a bunch of people on the Parsoid, db/security/code review areas) built the
Linter extension that surfaces wikitext errors that Parsoid knows about to
let editors fix them.

Earlier this year, we decided to use Linter in service of Tidy replacement.
Based on our earlier testing results, we have added a set of high-priority
linter categories that identifies specific wikitext markup patterns on wiki
pages that need to be fixed [12].



Linter is certainly awesome and kudos to Kunal for getting that done and
pushed out. [[Special:LintErrors]] is super useful, I'm wondering if there's
a dashboard somewhere that summarizes this across all wikis? If so, I
missed it. If not, it should be pretty easy to wire something up to grab
info from api.php on all wikis.

I think it'd help for coordinating cross-wiki efforts (bots, tools) as well
as seeing which wikis are "done" and could be early candidates for migration.


Kunal did an early pass on 
https://tools.wmflabs.org/wikitext-deprecation/ but it needs to be 
picked up again and worked on. Help welcome. :-)


Subbu.

___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Tidy will be replaced by RemexHTML on Wikimedia wikis latest by June 2018

2017-07-07 Thread Chad
On Thu, Jul 6, 2017 at 5:02 AM Subramanya Sastry 
wrote:

> 6. Tools to assist editors: Linter & ParserMigration
> 
> In October 2016, at the parsing team offsite, Kunal ([[User:Legoktm
> (WMF)]])
> dusted off the stalled wikitext linting project [11] and (with the help
> from
> a bunch of people on the Parsoid, db/security/code review areas) built the
> Linter extension that surfaces wikitext errors that Parsoid knows about to
> let editors fix them.
>
> Earlier this year, we decided to use Linter in service of Tidy replacement.
> Based on our earlier testing results, we have added a set of high-priority
> linter categories that identifies specific wikitext markup patterns on wiki
> pages that need to be fixed [12].
>
>
Linter is certainly awesome and kudos to Kunal for getting that done and
pushed out. [[Special:LintErrors]] is super useful, I'm wondering if there's
a dashboard somewhere that summarizes this across all wikis? If so, I
missed it. If not, it should be pretty easy to wire something up to grab
info
from api.php on all wikis.

I think it'd help for coordinating cross-wiki efforts (bots, tools) as well
as
seeing which wikis are "done" and could be early candidates for migration.

-Chad
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Readers monthly update for June 2017

2017-07-07 Thread Chris Koerner
Hey Jan,
I asked Nizar who did the analysis.
He has updated the phab card with the details:
https://phabricator.wikimedia.org/T166698

Yours,
Chris Koerner
Community Liaison
Wikimedia Foundation
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Wikilabels downtime due to maintenance

2017-07-07 Thread zppix e
Be advised, there was a typo in the original information the downtime is
actually expected to be approximately 5 minutes but the maintenance window
is set for 1 hour. Sorry for the confusion.

Thanks,
Zppix
Volunteer Developer for WMF
www.enwp.org/User:Zppix


On Thu, Jul 6, 2017 at 5:16 PM, zppix e  wrote:

> Hello,
> On  2017-07-11 at 1400 UTC
> 
>  Wiki
> Labels will be going under DB maintenance. The expected downtime is approx.
> 60 seconds. See See T169933  for
> our tracking task and T168584  for
> the reboot task.
> You can also check out this
> page on Meta, for
> information  as we get it.
> Thanks,
> Zppix
> Volunteer Developer for WMF
> www.enwp.org/User:Zppix
>
>
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l