Re: [Wikitech-l] 1.30.0-wmf.9 train halted due to new log messages

2017-07-13 Thread Tyler Cipriani 
The previous blockers have been resolved. Thanks to everyone for their 
quick work and replies.


However, when I rolled forward 1.30.0-wmf.9 to the wikipedia wikis I hit 
a new problem:


T170648[1] - Timeout reached waiting for an available pooled curl 
connection!


Any input on that task would be appreciated. We will get through this 
train. Together.


Thanks!

-- Tyler

[1] 


On 17-07-13 12:32:31, Tyler Cipriani wrote:

Hello all,

There are a few new log messages that have crept their way into the 
1.30.0-wmf.9 train release currently winding its way down the track - 
on group0 and group1 wikis[0]. I've halted the train for the time 
being due to these new messages[1].


1. T170599[2] - Wikibase: $idSerialization must match /^Q[1-9]\d{0,9}\z/i
2. T170596[3] - Could not acquire lock 'LinksUpdate:job:pageid:xxx'
3. T170597[4] - Wikidata/extensions/Constraints: 
InvalidArgumentException:$itemId must be either ItemId or string


RelEng makes an attempt during train to keep the introduction of new 
log messages per-release to a minimum. Logspam masks real problems and 
can make the job of deployers and developers unpleasant.


Any help or guidance on any of these three tasks would be very much 
appreciated!


Thanks!

-- Tyler

[0]. 
[1].  

[2]. 
[3]. 
[4]. 


___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] [MediaWiki-announce] MediaWiki 1.29 Available!

2017-07-13 Thread Victoria Coleman 
Well done everyone!!

Victoria


> On Jul 13, 2017, at 1:26 PM, Chad Horohoe  wrote:
> 
> Hello everyone,
> 
> I am happy to announce the availability the general release of MediaWiki
> 1.29!
> 
> MediaWiki 1.29 includes all changes released in the smaller 1.29.0-wmf.*
> software deployments to Wikimedia sites over six months, totaling
> approximately 1640 commits by around 140 authors. This is a large release
> that contains many new features and bug fixes.
> 
> This is a summary of the major changes of interest to users and
> administrators:
> * https://www.mediawiki.org/wiki/MediaWiki_1.29
> 
> You can always consult the RELEASE-NOTES-1.29 file for the full list of
> changes in this version.
> 
> Full release notes:
> *
> https://phabricator.wikimedia.org/diffusion/MW/browse/REL1_29/RELEASE-NOTES-1.29
> * https://www.mediawiki.org/wiki/Release_notes/1.29
> 
> **
> Download:
> https://releases.wikimedia.org/mediawiki/1.29/mediawiki-1.29.0.tar.gz
> https://releases.wikimedia.org/mediawiki/1.29/mediawiki-core-1.29.0.tar.gz
> 
> GPG signatures:
> https://releases.wikimedia.org/mediawiki/1.29/mediawiki-1.29.0.tar.gz.sig
> https://releases.wikimedia.org/mediawiki/1.29/mediawiki-core-1.29.0.tar.gz.sig
> 
> Public keys:
> https://www.mediawiki.org/keys/keys.html
> 
> -Chad
> ___
> MediaWiki announcements mailing list
> To unsubscribe, go to:
> https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce
> ___
> Wikitech-l mailing list
> Wikitech-l@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikitech-l


___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

[Wikitech-l] [MediaWiki-announce] MediaWiki 1.29 Available!

2017-07-13 Thread Chad Horohoe 
Hello everyone,

I am happy to announce the availability the general release of MediaWiki
1.29!

MediaWiki 1.29 includes all changes released in the smaller 1.29.0-wmf.*
software deployments to Wikimedia sites over six months, totaling
approximately 1640 commits by around 140 authors. This is a large release
that contains many new features and bug fixes.

This is a summary of the major changes of interest to users and
administrators:
* https://www.mediawiki.org/wiki/MediaWiki_1.29

You can always consult the RELEASE-NOTES-1.29 file for the full list of
changes in this version.

Full release notes:
*
https://phabricator.wikimedia.org/diffusion/MW/browse/REL1_29/RELEASE-NOTES-1.29
* https://www.mediawiki.org/wiki/Release_notes/1.29

**
Download:
https://releases.wikimedia.org/mediawiki/1.29/mediawiki-1.29.0.tar.gz
https://releases.wikimedia.org/mediawiki/1.29/mediawiki-core-1.29.0.tar.gz

GPG signatures:
https://releases.wikimedia.org/mediawiki/1.29/mediawiki-1.29.0.tar.gz.sig
https://releases.wikimedia.org/mediawiki/1.29/mediawiki-core-1.29.0.tar.gz.sig

Public keys:
https://www.mediawiki.org/keys/keys.html

-Chad
___
MediaWiki announcements mailing list
To unsubscribe, go to:
https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] [AI] Scoring Platform Team update

2017-07-13 Thread Jonathan Morgan 
Congratulations to the new Scoring Platform team! - J

On Wed, Jul 12, 2017 at 4:07 PM, Aaron Halfaker 
wrote:

> Hey folks!
>
> I just posted a new update to the blog.   This update covers roughly the
> last month.
>
> https://phabricator.wikimedia.org/phame/post/view/58/status_
> update_july_11th_2017/
>
> As of July 1st, we are officially the Scoring Platform team. We're
> welcoming Adam Wight to the team officially.  There will be a nice
> announcement that we'll post to the Wikimedia Blog in a few days.
>
> The last ~month was very productive, but we had two major production
> issues[1,2]. As you will see in the blog post, there's a series of tasks
> that address problems that were related to these issues.
>
> Despite dealing with production issues, we've been able to get a very
> substantial change to the revscoring library merged. This change will make
> accessing information about models (build environment, test statistics,
> scoring thresholds, etc.) much easier. This will cause a breaking change in
> ORES UI so we'll be making an announcement when we roll it out. Stay tuned.
>
> We've also increased our language and model coverage substantially. We
> even built and deployed a totally new type of model to help out French
> Wikisource!
>
> See the post for more details :)
>
> 1. https://wikitech.wikimedia.org/wiki/Incident_
> documentation/20170613-ORES
> 2. https://wikitech.wikimedia.org/wiki/Incident_
> documentation/20170623-ORES
>
> -Aaron
> Principal research scientist
> Lead of the Scoring Platform team
> Defender of the universe
> Eater of toast
> Wiki of the media foundation
>
> ___
> AI mailing list
> a...@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/ai
>
>


-- 
Jonathan T. Morgan
Senior Design Researcher
Wikimedia Foundation
User:Jmorgan (WMF) 
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Tidy will be replaced by RemexHTML on Wikimedia wikis latest by June 2018

2017-07-13 Thread Pine W 
Hi folks,

Do you think that the implementation discussion should move to Phabricator?

Pine
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

[Wikitech-l] 1.30.0-wmf.9 train halted due to new log messages

2017-07-13 Thread Tyler Cipriani 

Hello all,

There are a few new log messages that have crept their way into the 
1.30.0-wmf.9 train release currently winding its way down the track - on 
group0 and group1 wikis[0]. I've halted the train for the time being due 
to these new messages[1].


1. T170599[2] - Wikibase: $idSerialization must match /^Q[1-9]\d{0,9}\z/i
2. T170596[3] - Could not acquire lock 'LinksUpdate:job:pageid:xxx'
3. T170597[4] - Wikidata/extensions/Constraints: 
InvalidArgumentException:$itemId must be either ItemId or string


RelEng makes an attempt during train to keep the introduction of new log 
messages per-release to a minimum. Logspam masks real problems and can 
make the job of deployers and developers unpleasant.


Any help or guidance on any of these three tasks would be very much 
appreciated!


Thanks!

-- Tyler

[0]. 
[1].  

[2]. 
[3]. 
[4]. 

___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

[Wikitech-l] ArchCom Radar, 2017-07-12

2017-07-13 Thread Daniel Kinzler 
Hi all!

Here are the minutes from the last ArchCom meeting. You can also find the
minutes at .

See also the ArchCom status page at
 and the RFC board
.

Here are the minutes, for your convenience:


* Approved after Last Call: bump MediaWiki's minimum supported MySQL Version to
5.5 

* Approved after Last Call: change wikipage redirects to be proper HTTP
redirects . This is currently 
unresourced!

* ArchCom is in the process of finalizing the Charter. Here are the changes made
based on feedback given on the talk page:


* Discussion ongoing: Usage of FauxRequest for internal API calls
. ArchCom is skeptical, but has not
formulated a position. Daniel will prepare a position paper soonish.

* RFC discussion next week: Migrate to HTML5 section ids

As always, the discussion will take place in the IRC channel
#wikimedia-office on Wednesday 21:00 UTC (2pm PDT, 23:00 CEST).

-- 
Daniel Kinzler
Principal Platform Engineer

Wikimedia Deutschland
Gesellschaft zur Förderung Freien Wissens e.V.

___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Tidy will be replaced by RemexHTML on Wikimedia wikis latest by June 2018

2017-07-13 Thread Arlo Breault 

> On Jul 13, 2017, at 10:35 AM, Subramanya Sastry  wrote:
> 
> (2) There is a Parsoid bug in detection of self-closing tags where presence 
> of a "/>" in an HTML attribute triggers a false positive. This has been 
> reported previously ... so I suppose it is not as uncommon as I thought. 
> We'll take a look at that.

No, Parsoid is doing that by design to match the php parser.

See T97157 and https://phabricator.wikimedia.org/T170582#3435855


___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Tidy will be replaced by RemexHTML on Wikimedia wikis latest by June 2018

2017-07-13 Thread Subramanya Sastry 

On 07/13/2017 02:18 AM, Nicolas Vervelle wrote:



I think I've found some discrepancy between Linter reports. On frwiki, the
page "Discussion:Yasser Arafat" is reported in the list for self-closed-tag
[1], but when run the text of the page through the transform API [2], I
only get errors for obsolete-tag and mixed-content and nothing for
self-closed-tag.


When I pasted the wikitext for Discussion:Yasser_Arafat page in the 
wikitext box AND entered the page title in the title box on 
https://fr.wikipedia.org/api/rest_v1/#!/Transforms/post_transform_wikitext_to_lint_title_revision, 
I do see the following among others:

...

|{ "type": "self-closed-tag", "params": { "name": "span" }, "dsr": [ 
183063, 183134, null, null ], "templateInfo": { "name": "Modèle:Censuré" 
} },|


...

However, if I don't add the page title in the title box, I can reproduce 
your problem ... so, clearly this is something to do with a template 
depending on the page title.


I can reproduce this on the commandline with the specific wikitext 
substring that the Linter interface shows you. This output below shows 
that the linter error is dependent on having the page title there.


---
[subbu@earth parsoid] echo '{{Censuré|Tu remarqueras que je ne te 
retourne pas la question.}}' | parse.js --page 
Discussion:Yasser_Arafat --prefix frwiki --lint > /dev/null
[info/lint/self-closed-tag][frwiki/Discussion:Yasser_Arafat] 
{"type":"self-closed-tag","params":{"name":"span"},"dsr":[0,71,null,null],"templateInfo":{"name":"Modèle:Censuré"}}
[info/lint/stripped-tag][frwiki/Discussion:Yasser_Arafat] 
{"type":"stripped-tag","params":{"name":"SPAN"},"dsr":[0,71,null,null],"templateInfo":{"name":"Modèle:Censuré"}}
[subbu@earth parsoid] echo '{{Censuré|Tu remarqueras que je ne te 
retourne pas la question.}}' | parse.js --prefix frwiki --lint > 
/dev/null

[subbu@earth parsoid]
---

When I add a --dump tplsrc flag to parsoid (which you can also get by 
using the expandtemplates action api endpoint), I see the following:


---
title="Tu remarqueras que je ne te retourne pas la question./>">Tu remarqueras que je ne te retourne 
pas la question.

---

So, it looks like Parsoid's tokenizer is tripping on the /> that is 
present in the span title attribute and false assumes it is a 
self-closing tag.


In any case, in conclusion:

(1) Please provide page title when you use the API
(2) There is a Parsoid bug in detection of self-closing tags where 
presence of a "/>" in an HTML attribute triggers a false positive. This 
has been reported previously ... so I suppose it is not as uncommon as I 
thought. We'll take a look at that.


Subbu.
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Tidy will be replaced by RemexHTML on Wikimedia wikis latest by June 2018

2017-07-13 Thread Nicolas Vervelle 
On Tue, Jul 11, 2017 at 5:05 PM, Subramanya Sastry 
wrote:

> On 07/11/2017 05:13 AM, Nicolas Vervelle wrote:
>
> - In the page dedicated to a category, there's a column telling if the
>>
> problem is due to one template (and which one) or by several
>> templates, but
>> I don't get this information in the REST API for Linter. Is it
>> possible to
>> have it in the API result or should I deduce it myself where the
>> offset
>> given by the API matches a call to a template?
>>
>
> Look for this in the template response.
>
> |"templateInfo": { "multiPartTemplateBlock": true }|
>

Thanks ! I have updated WPCleaner to display the information about the
template (template name or multiple templates).


I think I've found some discrepancy between Linter reports. On frwiki, the
page "Discussion:Yasser Arafat" is reported in the list for self-closed-tag
[1], but when run the text of the page through the transform API [2], I
only get errors for obsolete-tag and mixed-content and nothing for
self-closed-tag.

[1] https://fr.wikipedia.org/wiki/Sp%C3%A9cial:LintErrors/self-closed-tag
[2]
https://fr.wikipedia.org/api/rest_v1/#!/Transforms/post_transform_wikitext_to_lint_title_revision
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l