[Wikidata-bugs] [Maniphest] [Changed Status] T145712: Statement counts from pageprops do not match actual ones ( wikibase:statements and wikibase:sitelinks )

[Smalyshev]

Smalyshev changed the task status from "Open" to "Stalled".
TASK DETAILhttps://phabricator.wikimedia.org/T145712EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Tgr, MZMcBride, aaron, Addshore, Multichill, hoo, Esc3300, Pasleim, thiemowmde, daniel, Aklapper, Smalyshev, QZanden, EBjune, merbst, Avner, debt, Gehel, D3r1ck01, Jonas, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Deskana, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Retitled] T138214: CORS policies should allow scripts from query.wikidata.org to edit www.wikidata.org

[Smalyshev]

Smalyshev changed the title from "query.wikidata.org  CORS policies" to "CORS policies should allow scripts from query.wikidata.org  to edit www.wikidata.org".
TASK DETAILhttps://phabricator.wikimedia.org/T138214EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Deskana, Gehel, Aklapper, Zppix, Smalyshev, Lydia_Pintscher, Legoktm, Anomie, Jonas, QZanden, EBjune, merbst, Avner, debt, D3r1ck01, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T116298: SPARQL endpoint should gracefully handle cycles and loops in transitive properties

[Smalyshev]

Smalyshev closed this task as "Resolved".Smalyshev added a comment.
This works now:

SELECT DISTINCT ?city WHERE {
  ?city wdt:P31/wdt:P279* wd:Q515 . # find instances of subclasses of city
  ?city wdt:P131* wd:Q1202 .
  hint:Prior hint:gearing "forward" .
}

See also https://wiki.blazegraph.com/wiki/index.php/QueryHints
Basically what is going on is that query optimizer doesn't always knows which way it should traverse the path queries, especially if there are many clauses. Playing with gearing hint allows to tell it the right way.

If the query doesn't work with any direction, please add it here and I'll take a look, but for now I think this resolves the task. The optimizer may be improved, but I imagine there will always be cases where we need to give some hints.TASK DETAILhttps://phabricator.wikimedia.org/T116298EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: abian, Nikki, Jheald, Aklapper, daniel, QZanden, EBjune, merbst, Avner, debt, Gehel, D3r1ck01, Jonas, FloNight, Xmlizer, Izno, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Deskana, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T153893: [EPIC] Support limited federation for WDQS

[Smalyshev]

Smalyshev closed this task as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T153893EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Harej, Tarrow, Aklapper, Smalyshev, QZanden, EBjune, merbst, Avner, debt, Gehel, D3r1ck01, Jonas, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Deskana, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T145899: Path query for taxons times out

[Smalyshev]

Smalyshev closed this task as "Resolved".Smalyshev added a comment.
This one works now:

SELECT ?item ?taxonName ?taxonRank ?parentName ?parentRank ?higherParent WHERE {
  BIND("Rivasmartinezia" AS ?taxonName) .
  BIND(wd:Q34740 AS ?taxonRank) . # Genus
  BIND(wd:Q756 AS ?higherParent) . # Plantae
  ?item wdt:P225 ?taxonName .
  ?item wdt:P105 ?taxonRank .
  ?item wdt:P171/wdt:P225 ?parentName .
  ?item wdt:P171/wdt:P105 ?parentRank .
  ?item (wdt:P171)* ?higherParent .
  hint:Prior hint:gearing "forward" .
}

(note the hint). The hint allows to control in which direction the path is traversed.  
See also https://wiki.blazegraph.com/wiki/index.php/QueryHints

Since this is probably the only solution for this now (it's very hard to make optimizer always guess correctly which way to go) and upstream ticket is considered resolved for now, I'm resolving this too.TASK DETAILhttps://phabricator.wikimedia.org/T145899EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Aklapper, Smalyshev, QZanden, EBjune, merbst, Avner, debt, Gehel, D3r1ck01, Jonas, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Deskana, Manybubbles, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T161527: Canonical data URIs and URLs for machine readable page content

[MZMcBride]

MZMcBride added a comment.
From the current task description:

Problem:
There is currently no canonical URI/URL for referring to and retrieving these data sets.

Can someone please elaborate on this? This task has a whole lot of text about potential solutions and it's not clear to me why a "nice" URL is needed at all. I don't follow the use-cases mentioned in T161527#3135095:

https://commons.wikimedia.org/data/Avignon_City_Wall as canonical URI (we can add .map if it's important, but if we can avoid it, it looks nicer without it). This URI would be redirected to the following places [...]

Who's going to be typing this URL or using it? Actual readers and users? Why does the URL need to look nice?

If the idea is for computer code to access these URLs, who cares if the URL is "ugly"? I don't ever give any thought to whether an api.php URL looks clean or not, for example. Plus api.php URLs, with their standardized and supported query strings, can support arbitrary additions like =json that make the request more explicit than "data" about what's going to come back to the client from the server. What's wrong with query strings?

If the idea really is for human beings and real-life users to be using these /data/ URLs, personally I would think that you would want to support the simplest URL transformation possible, as I often am forced to mangle a URL by hand. (You should see me trying to add 2000 to a Phabricator Maniphest URL that's using a Bugzilla ID.) Replacing "wiki" in the URL with "data" could be somewhat convenient if the page title is used. But again, it's really unclear to me who the audience is, given that most users don't pay any attention to pretty URLs at all. Most users also rarely type URLs. And it's not clear to me why a regular user would want to access the raw data about an entity anyway.

(It feels like we're discussing programmatic access and computers really do not care about pretty URLs. As I said to Tim after office hours, the last resort argument of people to defend pretty URLs is then to say, well the URL is used for caching!)TASK DETAILhttps://phabricator.wikimedia.org/T161527EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MZMcBrideCc: MZMcBride, Rybesh, Dzahn, GWicke, tstarling, Aklapper, Jonas, Smalyshev, mkroetzsch, Lydia_Pintscher, daniel, QZanden, D3r1ck01, Izno, suriyaa, Eevans, mobrovac, Hardikj, Wikidata-bugs, aude, jayvdb, Southparkfan, fbstj, RobLa-WMF, santhosh, Mbch331, Jay8g, Ltrlg, Glaisher, bd808, Krenair, Legoktm___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T161527: Canonical data URIs and URLs for machine readable page content

[daniel]

daniel added a comment.
/wiki/{title} is the user interface URL. I think it makes sense to have a separate URL for the data. This will also make it much easier to introduce a URL that supports content negotiation via 303 redirects.TASK DETAILhttps://phabricator.wikimedia.org/T161527EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Rybesh, Dzahn, GWicke, tstarling, Aklapper, Jonas, Smalyshev, mkroetzsch, Lydia_Pintscher, daniel, QZanden, D3r1ck01, Izno, suriyaa, Eevans, mobrovac, Hardikj, Wikidata-bugs, aude, jayvdb, Southparkfan, fbstj, RobLa-WMF, santhosh, Mbch331, Jay8g, Ltrlg, Glaisher, bd808, Krenair, Legoktm___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T161718: WikibaseQualityExternalValidation covers docs incorrect namespaces

[Reedy]

Reedy added a comment.
Poking at this further, not sure if it's actually a PhpStorm bug.. Filed upstream https://youtrack.jetbrains.com/issue/WI-35736TASK DETAILhttps://phabricator.wikimedia.org/T161718EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ReedyCc: Aklapper, Reedy, QZanden, D3r1ck01, Scott_WUaS, Izno, abian, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T161721: WikibaseQuality covers docs incorrect namespaces

[Reedy]

Reedy added a comment.
Poking at this further, not sure if it's actually a PhpStorm bug.. Filed upstream https://youtrack.jetbrains.com/issue/WI-35736TASK DETAILhttps://phabricator.wikimedia.org/T161721EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ReedyCc: Aklapper, Reedy, QZanden, D3r1ck01, Izno, abian, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T161720: WikibaseQualityConstraints covers docs incorrect namespaces

[Reedy]

Reedy added a comment.
Poking at this further, not sure if it's actually a PhpStorm bug.. Filed upstream https://youtrack.jetbrains.com/issue/WI-35736TASK DETAILhttps://phabricator.wikimedia.org/T161720EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ReedyCc: Aklapper, Reedy, QZanden, D3r1ck01, Izno, abian, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T161527: Canonical data URIs and URLs for machine readable page content

[matmarex]

matmarex edited the task description. (Show Details)
EDIT DETAILS...* Wikidata uses  as the canonical URI of concepts, and :Q23/Q23> as the canonical URI of the description. Both apply content negotiation and trigger a 303 redirect. The canonical URL for a specific serialization has the form :Q23/Q23.ttl>TASK DETAILhttps://phabricator.wikimedia.org/T161527EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: matmarexCc: Rybesh, Dzahn, GWicke, tstarling, Aklapper, Jonas, Smalyshev, mkroetzsch, Lydia_Pintscher, daniel, QZanden, D3r1ck01, Izno, suriyaa, Eevans, mobrovac, Hardikj, Wikidata-bugs, aude, jayvdb, Southparkfan, fbstj, RobLa-WMF, santhosh, Mbch331, Jay8g, Ltrlg, Glaisher, bd808, Krenair, Legoktm___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T161527: Canonical data URIs and URLs for machine readable page content

[Smalyshev]

Smalyshev added a comment.
/wiki/{title} assumes HTML representation. If we could make it content-negotiate to another representation (JSON, CSV or whatever is appropriate for map data - geoJSON?) it'd be fine. But if it's hard to do, we'd better use URI that makes it easier.TASK DETAILhttps://phabricator.wikimedia.org/T161527EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Rybesh, Dzahn, GWicke, tstarling, Aklapper, Jonas, Smalyshev, mkroetzsch, Lydia_Pintscher, daniel, QZanden, D3r1ck01, Izno, suriyaa, Eevans, mobrovac, Hardikj, Wikidata-bugs, aude, jayvdb, Southparkfan, fbstj, RobLa-WMF, santhosh, Mbch331, Jay8g, Ltrlg, Glaisher, bd808, Krenair, Legoktm___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T160422: wdqs-app-footer-updated not transcluded

[Smalyshev]

Smalyshev closed this task as "Invalid".Smalyshev added a comment.
Looks like may be a case of cache not updating. Closing for now, if it happens again please reopen.TASK DETAILhttps://phabricator.wikimedia.org/T160422EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Smalyshev, Jonas, Alicia_Fagerving_WMSE, Lokal_Profil, Aklapper, QZanden, EBjune, merbst, Avner, debt, Gehel, D3r1ck01, FloNight, Xmlizer, MuhammadShuaib, Izno, Psychoslave, jkroll, Wikidata-bugs, Jdouglas, aude, Deskana, Manybubbles, Gryllida, Shizhao, Arrbee, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T161751: WikibaseQualityExternalValidation test failures

[Reedy]

Reedy edited the task description. (Show Details)
EDIT DETAILS...```
16:25:45 [90.0MB/20.46s] Updating dependencies (including require-dev)
16:25:46 [124.0MB/21.39s]   [merge-plugin] Adding dependency wikibase/external-validation requires php (>= 5.5.0.0-dev)
16:25:46 [124.0MB/21.39s]   [merge-plugin] Adding dependency mediawiki/elastica requires php (>= 5.5.9.0-dev)
16:25:46 [124.0MB/21.39s]   [merge-plugin] Adding dependency wikibase/wikibase requires php (>= 5.5.9.0-dev)
16:25:46 [124.0MB/21.39s]   [merge-plugin] Adding dependency wikibase/wikibase requires data-values/common ([>= 0.3.0.0-dev < 0.4.0.0-dev])
16:25:46 [124.0MB/21.39s]   [merge-plugin] Adding dependency wikibase/wikibase requires data-values/geo ([>= 1.2.1.0-dev < 2.0.0.0-dev])
16:25:46 [124.0MB/21.39s]   [merge-plugin] Adding dependency wikibase/wikibase requires data-values/number ([>= 0.8.2.0-dev < 0.9.0.0-dev])
16:25:46 [124.0MB/21.39s]   [merge-plugin] Adding dependency wikibase/wikibase requires data-values/time ([>= 0.8.4.0-dev < 0.9.0.0-dev])
16:25:46 [124.0MB/21.39s]   [merge-plugin] Adding dependency wikibase/wikibase requires wikibase/data-model ([>= 7.0.0.0-dev < 8.0.0.0-dev])
16:25:46 [124.0MB/21.39s]   [merge-plugin] Adding dependency wikibase/wikibase requires wikibase/data-model-serialization ([>= 2.1.0.0-dev < 3.0.0.0-dev])
16:25:46 [124.0MB/21.39s]   [merge-plugin] Adding dependency wikibase/wikibase requires wikibase/data-model-services ([>= 3.7.0.0-dev < 4.0.0.0-dev])
16:25:46 [124.0MB/21.39s]   [merge-plugin] Adding dependency wikibase/quality requires php (>= 5.5.0.0-dev)
16:25:46 [124.0MB/21.39s]   [merge-plugin] Adding dependency wikibase/quality requires wikibase/data-model ([[>= 4.0.0.0-dev < 5.0.0.0-dev] || [>= 5.0.0.0-dev < 6.0.0.0-dev] || [>= 6.0.0.0-dev < 7.0.0.0-dev] || [>= 7.0.0.0-dev < 8.0.0.0-dev]])
16:25:46 [124.0MB/21.39s]   [merge-plugin] Adding dependency wikibase/quality requires wikibase/data-model-services ([>= 2.0.0.0-dev < 4.0.0.0-dev])
16:25:46 [124.0MB/21.39s]   [merge-plugin] Adding dependency wikibase/quality requires serialization/serialization ([>= 3.2.1.0-dev < 4.0.0.0-dev])
16:25:46 [124.0MB/21.39s]   [merge-plugin] Adding dependency mediawiki/cldr requires php (>= 5.5.9.0-dev)
16:25:46 [124.0MB/21.39s]   [merge-plugin] Adding dependency mediawiki/cldr requires composer/installers (>= 1.0.1.0-dev)
16:25:50 [160.0MB/25.67s] Dependency resolution completed in 0.748 seconds
16:25:50 [160.0MB/25.71s] Your requirements could not be resolved to an installable set of packagesTASK DETAILhttps://phabricator.wikimedia.org/T161751EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ReedyCc: Aklapper, Reedy, QZanden, D3r1ck01, Scott_WUaS, Izno, abian, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Triaged] T161751: WikibaseQualityExternalValidation test failures

[Reedy]

Reedy triaged this task as "High" priority.Reedy added a project: Wikibase-Quality.
TASK DETAILhttps://phabricator.wikimedia.org/T161751EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ReedyCc: Aklapper, Reedy, QZanden, D3r1ck01, Scott_WUaS, Izno, abian, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T161751: WikibaseQualityExternalValidation test failures

[Reedy]

Reedy created this task.Reedy added a project: Wikibase-Quality-External-Validation.Herald added a subscriber: Aklapper.Herald added a project: Wikidata.
TASK DESCRIPTIONOn https://gerrit.wikimedia.org/r/#/c/345390/1 it seems https://integration.wikimedia.org/ci/job/mwext-testextension-hhvm-composer-jessie/637/console and https://integration.wikimedia.org/ci/job/mwext-qunit-composer-jessie/6070/console are failing for the same issue

Symptomatic of a wider problem?

16:25:50 [160.0MB/25.71s] Your requirements could not be resolved to an installable set of packages.
16:25:50 [160.0MB/25.71s] 
16:25:50   Problem 1
16:25:50 - The requested package wikibase/data-model ^7.0.0 is satisfiable by wikibase/data-model[7.0.0, 7.0.x-dev] but these conflict with your requirements or minimum-stability.TASK DETAILhttps://phabricator.wikimedia.org/T161751EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ReedyCc: Aklapper, Reedy, QZanden, D3r1ck01, Scott_WUaS, Izno, abian, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T160422: wdqs-app-footer-updated not transcluded

[Lokal_Profil]

Lokal_Profil added a comment.

In T160422#3123366, @Smalyshev wrote:
@Lokal_Profil where are you seeing this?


On the day I reported it I saw it when visiting query.wikidata.org (bottom right corner) from my laptop (on mobile now so can't confirm)TASK DETAILhttps://phabricator.wikimedia.org/T160422EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lokal_ProfilCc: Smalyshev, Jonas, Alicia_Fagerving_WMSE, Lokal_Profil, Aklapper, QZanden, EBjune, merbst, Avner, debt, Gehel, D3r1ck01, FloNight, Xmlizer, MuhammadShuaib, Izno, Psychoslave, jkroll, Wikidata-bugs, Jdouglas, aude, Deskana, Manybubbles, Gryllida, Shizhao, Arrbee, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T161527: Canonical data URIs and URLs for machine readable page content

[GWicke]

GWicke added a comment.
I think the URL most users would consider canonical is /wiki/{title}. Wouldn't this already provide a reasonable URL for the concept of the page?TASK DETAILhttps://phabricator.wikimedia.org/T161527EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: GWickeCc: Rybesh, Dzahn, GWicke, tstarling, Aklapper, Jonas, Smalyshev, mkroetzsch, Lydia_Pintscher, daniel, QZanden, D3r1ck01, Izno, suriyaa, Eevans, mobrovac, Hardikj, Wikidata-bugs, aude, jayvdb, Southparkfan, fbstj, RobLa-WMF, santhosh, Mbch331, Jay8g, Ltrlg, Glaisher, bd808, Krenair, Legoktm___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Changed Project Column] T161527: Canonical data URIs and URLs for machine readable page content

[daniel]

daniel moved this task from ArchCom-Approved to Request IRC meeting on the ArchCom-RfC board.daniel edited projects, added ArchCom-RfC; removed ArchCom-RfC (ArchCom-Approved).
TASK DETAILhttps://phabricator.wikimedia.org/T161527WORKBOARDhttps://phabricator.wikimedia.org/project/board/52/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Rybesh, Dzahn, GWicke, tstarling, Aklapper, Jonas, Smalyshev, mkroetzsch, Lydia_Pintscher, daniel, QZanden, D3r1ck01, Izno, suriyaa, Eevans, mobrovac, Hardikj, Wikidata-bugs, aude, jayvdb, Southparkfan, fbstj, RobLa-WMF, santhosh, Mbch331, Jay8g, Ltrlg, Glaisher, bd808, Krenair, Legoktm___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T161527: Canonical data URIs and URLs for machine readable page content

[daniel]

daniel added a comment.
@GWicke yes, indeed. This ticket is not about concept URIs, but about URIs for page content. Page content may be a description of a real world concept, or be otherwise related to such concepts. In order to express such a relation ship, both (the concept and the description) need canonical URIs. At least the URI for the description should be resolvable.

On the next level, we may want URIs/URLs for specific serializations/formats/projections as well as for for specific revisions. In my mind, RESTbase URLs are suitable for that. But for the "abstract" description URI (basically, page title level), RESTbase URLs expose too much technical detail for my taste.TASK DETAILhttps://phabricator.wikimedia.org/T161527EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Rybesh, Dzahn, GWicke, tstarling, Aklapper, Jonas, Smalyshev, mkroetzsch, Lydia_Pintscher, daniel, QZanden, D3r1ck01, Izno, suriyaa, Eevans, mobrovac, Hardikj, Wikidata-bugs, aude, jayvdb, Southparkfan, fbstj, RobLa-WMF, santhosh, Mbch331, Jay8g, Ltrlg, Glaisher, bd808, Krenair, Legoktm___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T161527: Canonical data URIs and URLs for machine readable page content

[GWicke]

GWicke added a comment.

In T161527#3135095, @Smalyshev wrote:
I think we have several concepts there that needs to be refined.


Canonical object URI - this is the URI that uniquely identifies an object in Wikimedia world, and, by extension, in the whole world of linked data.



I think there is a spectrum here between reserving the object domain only for abstract concepts & treating most things as representations, and making some of those representations first-class objects, related to the underlying concept via an is-representation-of edge. For addressable resources in the REST sense, I think that usability concerns should play a prominent role in finding the right balance between URLs and headers. For example, I don't think that using a single URL for all resources related to the concept of "Barack Obama" would make a lot of sense to API users.TASK DETAILhttps://phabricator.wikimedia.org/T161527EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: GWickeCc: Rybesh, Dzahn, GWicke, tstarling, Aklapper, Jonas, Smalyshev, mkroetzsch, Lydia_Pintscher, daniel, QZanden, D3r1ck01, Izno, suriyaa, Eevans, mobrovac, Hardikj, Wikidata-bugs, aude, jayvdb, Southparkfan, fbstj, RobLa-WMF, santhosh, Mbch331, Jay8g, Ltrlg, Glaisher, bd808, Krenair, Legoktm___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T160140: Wikidata accepts invalid geo coordinates, causing indexing failures

[gerritbot]

gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T160140EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, aude, Smalyshev, Deskana, thiemowmde, daniel, Lydia_Pintscher, Aklapper, MaxSem, EBernhardson, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, Avner, Lewizho99, Maathavan, debt, Gehel, D3r1ck01, FloNight, Izno, Wikidata-bugs, jayvdb, Mbch331, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T160140: Wikidata accepts invalid geo coordinates, causing indexing failures

[gerritbot]

gerritbot added a comment.
Change 345419 had a related patch set uploaded (by MaxSem):
[mediawiki/extensions/GeoData@master] Don't attempt to index invalid coordinates

https://gerrit.wikimedia.org/r/345419TASK DETAILhttps://phabricator.wikimedia.org/T160140EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, aude, Smalyshev, Deskana, thiemowmde, daniel, Lydia_Pintscher, Aklapper, MaxSem, EBernhardson, QZanden, EBjune, Avner, debt, Gehel, D3r1ck01, FloNight, Izno, Wikidata-bugs, jayvdb, Mbch331, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T161240: Expose wikidata query service LDF endpoint in a scalable and available way

[Smalyshev]

Smalyshev added a comment.
The problem is as follows:


Blazegraph stores the triples in BTree. Btree does have an ordering, and it is stable, but what is stored are not strings but terms generated from strings, which seem to be identified and ordered by essentially running ID - i.e. Term(1), Term(2), etc.
Since different servers are loaded in different times from different dump/update combinations, same URIs/strings get different Term IDs - same URI may be Term(123) on one server and Term(3456) on another. This means order of the triples in indexes will be different on different servers.
When paginating through results, different page requests may be directed to different servers, thus creating completely wrong picture in the summary data.
Due to the way we do load balancing (IP-based kernel balancing) we can not ensure any request affinity, as the balancer does not even look inside the packets.
Using client IP for balancing (pretty much the only thing we have that is not inside the packet) is not possible since we have varnish in front of LVS, which means client IPs are always the ones from Varnish servers. We do have real client IPs, but the are also inside the packets, so LVS can't use them.
TASK DETAILhttps://phabricator.wikimedia.org/T161240EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Smalyshev, Gehel, Aklapper, QZanden, EBjune, merbst, Avner, debt, D3r1ck01, Jonas, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Deskana, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T161695: Wikidata dump maintenance scripts cause HHVM to leak memory heavily

[Stashbot]

Stashbot added a comment.
Mentioned in SAL (#wikimedia-operations) [2017-03-29T18:43:07Z]  Started a Wikidata TTL dump run on snapshot1007 using Zend (due to T161695).TASK DETAILhttps://phabricator.wikimedia.org/T161695EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: StashbotCc: Stashbot, Stas, daniel, ArielGlenn, Lydia_Pintscher, Aklapper, hoo, QZanden, D3r1ck01, Izno, Wikidata-bugs, aude, Svick, Mbch331, Joe, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T161731: Create reliable change stream for specific wiki

[Smalyshev]

Smalyshev added a comment.
I think EventStreams is closest to the goal too, but I want to have a complete description of the pony for the record so that we know what we need and what is missing. If and once it's implemented (T152731) covers part of it but not all - still need seeking and longer backlog) we could close it, it doesn't have to have any patches dedicated for it, being an epic.TASK DETAILhttps://phabricator.wikimedia.org/T161731EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Anomie, Aklapper, Smalyshev, QZanden, EBjune, merbst, Avner, debt, Gehel, D3r1ck01, Jonas, FloNight, Xmlizer, Izno, JAllemandou, mobrovac, jkroll, Wikidata-bugs, Jdouglas, aude, GWicke, Deskana, Manybubbles, Mbch331, Krenair, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T161731: Create reliable change stream for specific wiki

[Anomie]

Anomie removed a project: MediaWiki-API.Anomie added a comment.
The pony being requested here is not going to happen in the action API, removing tag. This is probably an effective duplicate of T152731: Implement server side filtering (if we should) because EventStreams the most likely place for something like this to be implemented.TASK DETAILhttps://phabricator.wikimedia.org/T161731EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AnomieCc: Anomie, Aklapper, Smalyshev, QZanden, EBjune, merbst, Avner, debt, Gehel, D3r1ck01, Jonas, FloNight, Xmlizer, Izno, JAllemandou, mobrovac, jkroll, Wikidata-bugs, Jdouglas, aude, GWicke, Deskana, Manybubbles, Mbch331, Krenair, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Triaged] T161731: Create reliable change stream for specific wiki

[Smalyshev]

Smalyshev triaged this task as "Normal" priority.
TASK DETAILhttps://phabricator.wikimedia.org/T161731EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Aklapper, Smalyshev, QZanden, EBjune, merbst, Sethakill, Avner, debt, dg711, Gehel, D3r1ck01, Jonas, FloNight, Xmlizer, Izno, JAllemandou, mobrovac, jkroll, Wikidata-bugs, Jdouglas, aude, GWicke, Deskana, Manybubbles, jayvdb, Anomie, Mbch331, Krenair, jeremyb, Legoktm___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T161731: Create reliable change stream for specific wiki

[Smalyshev]

Smalyshev created this task.Smalyshev added projects: MediaWiki-API, Wikidata-Query-Service, Epic, Wikimedia-Stream, EventBus.Herald added a subscriber: Aklapper.Herald added projects: Wikidata, Discovery, Analytics.
TASK DESCRIPTIONRequirements:


Real-time - I can get changes from wiki within small time (<30 seconds) of the time they happened, with that time being defined as the time the changes have been committed to the database and visible to the users on wiki.
Reliable - if I consume every individual change message in the stream in the sequence the stream provides, I will know about all the changes in the wiki content.
Seekable - I can connect to the stream in a predictable point at wiki history (either by timestamp or by RC ID) and get all the messages. At least 14 days of messages back should be available, but larger availability is not a must.
Resumable - I can disconnect from the stream and then reconnect later and resume consumption from the same point I have left it. The service should not require constant connection for getting the updates, and the stream from disconnected and resumed connection should be the same as if connection has never been interrupted (except the obvious difference in message delivery times, etc.)
Scalable - there's no hard limit on the number of clients connecting, within the reasonable limits of infrastructure, networking, etc.
Stateless - the server does not keep per-client state and the client always has all the information to continue stream consumption from the point it has stopped at (this may be not a very important one if scalability is kept).


Current use case:

Supplying update stream for Wikidata Query Service.

Delta for existing services:

API:Recentchanges


Not reliable - messages can be backfilled into the stream with timestamp many seconds in the past, which means sequential reading of the stream by timestamp would miss those (T161342). Even if reading by RCID is implemented, parallel commits could still lead to backfilling and thus unreliable stream.
Does not have events for page props updates (T145712) which happen asynchronously from main article update.
May miss some deletion events if it is combined with revision hiding.


EventStreams


Not consumable per-wiki due to the lack of filtering (T152731)
Not seekable
Does not have data back more than 7 days
TASK DETAILhttps://phabricator.wikimedia.org/T161731EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Aklapper, Smalyshev, QZanden, EBjune, merbst, Sethakill, Avner, debt, dg711, Gehel, D3r1ck01, Jonas, FloNight, Xmlizer, Izno, JAllemandou, mobrovac, jkroll, Wikidata-bugs, Jdouglas, aude, GWicke, Deskana, Manybubbles, jayvdb, Anomie, Mbch331, Krenair, jeremyb, Legoktm___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Retitled] T161342: Missing updates due to recentchanges backfilling

[Smalyshev]

Smalyshev changed the title from "Some data not uploaded to WDQS ?" to "Missing updates due to recentchanges backfilling".Smalyshev triaged this task as "Normal" priority.
TASK DETAILhttps://phabricator.wikimedia.org/T161342EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Smalyshev, Aklapper, Jheald, QZanden, EBjune, merbst, Avner, debt, Gehel, D3r1ck01, Jonas, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Deskana, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Declined] T160413: Duplicate claims are shown as one in query results

[Smalyshev]

Smalyshev closed this task as "Declined".Smalyshev added a comment.
Unable to reproduce, declining for now. Please reopen with reproduction if it still happens.TASK DETAILhttps://phabricator.wikimedia.org/T160413EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Smalyshev, Aklapper, Alicia_Fagerving_WMSE, QZanden, EBjune, merbst, Avner, debt, Gehel, D3r1ck01, Jonas, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Deskana, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T160969: Federation needs proxy settings on WDQS servers

[Smalyshev]

Smalyshev closed this task as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T160969EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: gerritbot, Gehel, Aklapper, Smalyshev, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, Avner, Lewizho99, Maathavan, debt, D3r1ck01, Jonas, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Deskana, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T141620: Allow = in wbsearchentities

[matej_suchanek]

matej_suchanek edited projects, added MediaWiki-extensions-WikibaseRepository; removed Wikibase-DataModel.
TASK DETAILhttps://phabricator.wikimedia.org/T141620EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: matej_suchanekCc: gerritbot, Addshore, Aklapper, DaBPunkt, QZanden, D3r1ck01, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T161596: Allow logged in users on desktop Wikipedia to see and quickly edit Wikidata descriptions

[Jdlrobson]

Jdlrobson added a comment.
(although apparently it only works on the mobile skin now.. but easily fixable)TASK DETAILhttps://phabricator.wikimedia.org/T161596EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: JdlrobsonCc: BethNaught, Yoshi24517, TheDJ, Jdlrobson, MoushiraEl, JEumerus, Samwalton9, Aklapper, QZanden, Winter, D3r1ck01, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T57549: [Story] Add a new datatype for geoshapes

[Lokal_Profil]

Lokal_Profil added a comment.
If I enter a geo-shape thorugh the api does the validator only check that the target page:


Is on Commons
Has content type Map.JsonConfig


Or does it also look at the page name/namespace etc?
Wondering for the sake of T161726: Suport new geo-shape datatype in PywikibotTASK DETAILhttps://phabricator.wikimedia.org/T57549EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Jonas, Lokal_ProfilCc: Lokal_Profil, WMDE-leszek, Pasleim, LikeLifer, jmac, TheDJ, Jonas, Micru, gerritbot, mxn, Yurik, abian, Evad37, Abbe98, daniel, RolandUnger, Boshomi, Susannaanas, Christopher, Yair_rand, Kopiersperre, putnik, StudiesWorld, esbranson, DixonD, Aklapper, Sannita, Ricordisamoa, Cavila, Rits, Kolossos, El_Grafo, Wikidata-bugs, Tobias1984, aude, Rschen7754, Ainali, Lydia_Pintscher, Adik2382, Soteriaspace, Th3d3v1ls, JakeTheDeveloper, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, D3r1ck01, Izno, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T161596: Allow logged in users on desktop Wikipedia to see and quickly edit Wikidata descriptions

[Jdlrobson]

Jdlrobson added a comment.
I have! 
mw.loader.load('/w/index.php?title=User:Jdlrobson/wikidataInfobox.js="">TASK DETAILhttps://phabricator.wikimedia.org/T161596EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: JdlrobsonCc: BethNaught, Yoshi24517, TheDJ, Jdlrobson, MoushiraEl, JEumerus, Samwalton9, Aklapper, QZanden, Winter, D3r1ck01, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T124055: [Task] Convert PropertySuggester to use extension registration

[matej_suchanek]

matej_suchanek added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T124055EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: matej_suchanekCc: Reedy, Liuxinyu970226, Aklapper, aude, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, D3r1ck01, Izno, Wikidata-bugs, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T159709: Security review for WikibaseMediaInfo extension

[dpatrick]

dpatrick added a comment.
@Lydia_Pintscher Ping.TASK DETAILhttps://phabricator.wikimedia.org/T159709EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: dpatrickCc: dpatrick, Ricordisamoa, Aklapper, Lydia_Pintscher, QZanden, Acer, D3r1ck01, Izno, Luke081515, Wikidata-bugs, Base, matthiasmullie, aude, Deskana, JanZerebecki, Fabrice_Florin, csteipp, Mbch331, Jay8g, Legoktm, Tgr___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T160524: [Story] Add Form to list of Forms

[Aleksey_WMDE]

Aleksey_WMDE added a comment.
I remember someone was complaining that we don't experiment.
Statement like "This is a subclass of the existing listview JS code" or "This uses the toolbar infrastructure", as I see it, instantly throw away any opportunity to make things differently and everything will stay more or less the same.

Correct me if I'm wrong.TASK DETAILhttps://phabricator.wikimedia.org/T160524EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Aleksey_WMDECc: Aleksey_WMDE, thiemowmde, Jan_Dittrich, Jonas, Aklapper, QZanden, D3r1ck01, Izno, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T161718: WikibaseQualityExternalValidation covers docs incorrect namespaces

[Reedy]

Reedy edited the task description. (Show Details)
EDIT DETAILSThere's literally loads of these wrong namespaces according to PhpStorm (in most test files). They should be fixed up...TASK DETAILhttps://phabricator.wikimedia.org/T161718EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ReedyCc: Aklapper, Reedy, QZanden, D3r1ck01, Scott_WUaS, Izno, abian, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T161721: WikibaseQuality covers docs incorrect namespaces

[Reedy]

Reedy created this task.Reedy added a project: Wikibase-Quality.Herald added a subscriber: Aklapper.Herald added a project: Wikidata.
TASK DESCRIPTIONNot as bad as T161718 or T161720 but the Html tests all need fixing

F7081878: Screen Shot 2017-03-29 at 17.29.34.pngTASK DETAILhttps://phabricator.wikimedia.org/T161721EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ReedyCc: Aklapper, Reedy, QZanden, D3r1ck01, Izno, abian, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T161720: WikibaseQualityConstraints covers docs incorrect namespaces

[Reedy]

Reedy created this task.Reedy added projects: Wikibase-Quality, Wikibase-Quality-Constraints.Herald added a subscriber: Aklapper.Herald added a project: Wikidata.
TASK DESCRIPTIONLike T161718 there are many
F7081813: Screen Shot 2017-03-29 at 17.25.29.pngTASK DETAILhttps://phabricator.wikimedia.org/T161720EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ReedyCc: Aklapper, Reedy, QZanden, D3r1ck01, Izno, abian, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T161716: Turn WikibaseQualityExternalValidation constants into config variables

[gerritbot]

gerritbot added a comment.
Change 345390 had a related patch set uploaded (by Reedy):
[mediawiki/extensions/WikibaseQualityExternalValidation@master] Convert constants to global config

https://gerrit.wikimedia.org/r/345390TASK DETAILhttps://phabricator.wikimedia.org/T161716EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Reedy, JanZerebecki, Aklapper, QZanden, D3r1ck01, Scott_WUaS, Izno, abian, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T161716: Turn WikibaseQualityExternalValidation constants into config variables

[gerritbot]

gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T161716EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Reedy, JanZerebecki, Aklapper, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, D3r1ck01, Scott_WUaS, Izno, abian, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T161718: WikibaseQualityExternalValidation covers docs incorrect namespaces

[Reedy]

Reedy added a project: Wikibase-Quality.
TASK DETAILhttps://phabricator.wikimedia.org/T161718EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ReedyCc: Aklapper, Reedy, QZanden, D3r1ck01, Scott_WUaS, Izno, abian, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T113037: [Task] Run some Wikibase tests with different languages

[Krinkle]

Krinkle added a comment.
Un-tagging CI-config as this seems like something that should be done within the PHPUnit and/or browser tests run just for a few test suites. Not to fragment the entire matrix.

You can even run all PHPUnit tests (if desired) by creating a TestSuite subclass that iterates the tests directory a second time with some default config change applied.TASK DETAILhttps://phabricator.wikimedia.org/T113037EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: KrinkleCc: Krinkle, aude, JanZerebecki, Aklapper, QZanden, D3r1ck01, Izno, Wikidata-bugs, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Retitled] T113037: [Task] Run some Wikibase tests with different languages

[Krinkle]

Krinkle changed the title from "[Task] run some Wikibase CI jobs with different languages" to "[Task] Run some Wikibase tests with different languages".Krinkle edited projects, added MediaWiki-extensions-WikibaseClient; removed Continuous-Integration-Config.Krinkle edited the task description. (Show Details)
EDIT DETAILSRun some of the Wikibase CI jobs withPHPUnit tests and/or browser tests in different languages to catch missing language fixtures and problems with other languages.

One with LANG=ar and one with LANG=ru should cover most. Travis CI also has de`de` in addition to these, that might not exercises something not covered by the others?TASK DETAILhttps://phabricator.wikimedia.org/T113037EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: KrinkleCc: aude, JanZerebecki, Aklapper, QZanden, D3r1ck01, Izno, Wikidata-bugs, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T161718: WikibaseQualityExternalValidation covers docs incorrect namespaces

[Reedy]

Reedy created this task.Reedy added a project: Wikibase-Quality-External-Validation.Herald added a subscriber: Aklapper.Herald added a project: Wikidata.
TASK DESCRIPTIONThere's literally loads of these wrong namespaces according to PhpStorm. They should be fixed up

F7081710: Screen Shot 2017-03-29 at 17.07.54.pngTASK DETAILhttps://phabricator.wikimedia.org/T161718EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ReedyCc: Aklapper, Reedy, QZanden, D3r1ck01, Scott_WUaS, Izno, abian, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Claimed] T159828: Use redis-based lock manager for dispatchChanges on test sites.

[daniel]

daniel claimed this task.
TASK DETAILhttps://phabricator.wikimedia.org/T159828EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: gerritbot, aaron, Marostegui, jcrespo, Aklapper, Jonas, Lydia_Pintscher, hoo, daniel, Ladsgroup, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Minhnv-2809, Maathavan, D3r1ck01, Izno, Luke081515, Wikidata-bugs, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T159828: Use redis-based lock manager for dispatchChanges on test sites.

[daniel]

daniel added a comment.
@hoo Can you confirm that we are actually running multiple instances of dispatchChanges.php for test.wikidata.org? Which clients does it dispatch to?TASK DETAILhttps://phabricator.wikimedia.org/T159828EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, danielCc: gerritbot, aaron, Marostegui, jcrespo, Aklapper, Jonas, Lydia_Pintscher, hoo, daniel, Ladsgroup, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Minhnv-2809, Maathavan, D3r1ck01, Izno, Luke081515, Wikidata-bugs, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Block] T106104: [Task] Convert WikibaseQuality, WikibaseQualityConstraints and WikibaseQualityExternalValidation to use extension registration

[Reedy]

Reedy created subtask T161716: Turn WikibaseQualityExternalValidation constants into config variables.
TASK DETAILhttps://phabricator.wikimedia.org/T106104EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MtDu, ReedyCc: MtDu, gerritbot, Ricordisamoa, Paladox, Lydia_Pintscher, Aklapper, aude, JanZerebecki, Liuxinyu970226, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, D3r1ck01, Scott_WUaS, Izno, abian, Wikidata-bugs, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T161716: Turn WikibaseQualityExternalValidation constants into config variables

[Reedy]

Reedy created this task.Reedy added projects: Wikidata, Wikibase-Quality, Wikibase-Quality-External-Validation.Herald added a subscriber: Aklapper.
TASK DESCRIPTION
In T106104#1929640, @JanZerebecki wrote:
Those 3 constants (created with the define php function) INSTANCE_OF_PID, DENTIFIER_PROPERTY_QID and STATED_IN_PID, should be changed in the code to be configuration options. This is because they are different for each installation, like test and beta. (This can be done in a separate patch before converting to extension registration.)
TASK DETAILhttps://phabricator.wikimedia.org/T161716EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ReedyCc: Reedy, JanZerebecki, Aklapper, QZanden, D3r1ck01, Scott_WUaS, Izno, abian, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T159828: Use redis-based lock manager for dispatchChanges on test sites.

[gerritbot]

gerritbot added a comment.
Change 345387 had a related patch set uploaded (by Daniel Kinzler):
[operations/mediawiki-config@master] Try using redisLockManager for test.wikidata.org

https://gerrit.wikimedia.org/r/345387TASK DETAILhttps://phabricator.wikimedia.org/T159828EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, gerritbotCc: gerritbot, aaron, Marostegui, jcrespo, Aklapper, Jonas, Lydia_Pintscher, hoo, daniel, Ladsgroup, QZanden, Minhnv-2809, D3r1ck01, Izno, Luke081515, Wikidata-bugs, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T159828: Use redis-based lock manager for dispatchChanges on test sites.

[gerritbot]

gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T159828EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, gerritbotCc: gerritbot, aaron, Marostegui, jcrespo, Aklapper, Jonas, Lydia_Pintscher, hoo, daniel, Ladsgroup, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Minhnv-2809, Maathavan, D3r1ck01, Izno, Luke081515, Wikidata-bugs, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T124055: [Task] Convert PropertySuggester to use extension registration

[Reedy]

Reedy added a comment.
https://github.com/Wikidata-lib/PropertySuggester/pull/198TASK DETAILhttps://phabricator.wikimedia.org/T124055EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ReedyCc: Reedy, Liuxinyu970226, Aklapper, aude, QZanden, D3r1ck01, Izno, Wikidata-bugs, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T159828: Use redis-based lock manager for dispatchChanges on test sites.

[jcrespo]

jcrespo added a comment.
Sorry about this- you are not the only "sufferers" of beta not being a reliable place for testing in a truly distributed fashion- we were just discussing this on IRC. I also support a test on test, and offer my help if I can provide it. Thanks again for working on this.TASK DETAILhttps://phabricator.wikimedia.org/T159828EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, jcrespoCc: aaron, Marostegui, jcrespo, Aklapper, Jonas, Lydia_Pintscher, hoo, daniel, Ladsgroup, QZanden, Minhnv-2809, D3r1ck01, Izno, Luke081515, Wikidata-bugs, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Merged] T125050: [Task] Add Scribunto to extension-gate in CI

[Anomie]

Anomie added a subscriber: WMDE-leszek.Anomie merged a task: T161698: LuaStandalone: LuaWikibaseLibraryTests - proc_open(): fork failed - Cannot allocate memory.
TASK DETAILhttps://phabricator.wikimedia.org/T125050EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AnomieCc: WMDE-leszek, Anomie, hashar, aude, thcipriani, Addshore, Paladox, hoo, Aklapper, JanZerebecki, StudiesWorld, QZanden, D3r1ck01, Izno, Wikidata-bugs, Dinoguy1000, jayvdb, MrStradivarius, Jackmcbarn, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T161698: LuaStandalone: LuaWikibaseLibraryTests - proc_open(): fork failed - Cannot allocate memory

[Anomie]

Anomie added a comment.
This seems to be starting from a false premise: as noted in T125050#3140483 these tests have been enabled since Feb 27 2016.

It's probably best to have the discussion there instead of trying to have it in two places, so I'm going to close this even though it's not exactly a duplicate.TASK DETAILhttps://phabricator.wikimedia.org/T161698EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AnomieCc: Anomie, WMDE-leszek, hoo, aude, Aklapper, QZanden, D3r1ck01, Izno, Wikidata-bugs, Dinoguy1000, jayvdb, MrStradivarius, Jackmcbarn, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T161698: LuaStandalone: LuaWikibaseLibraryTests - proc_open(): fork failed - Cannot allocate memory

[Anomie]

Anomie closed this task as a duplicate of T125050: [Task] Add Scribunto to extension-gate in CI.
TASK DETAILhttps://phabricator.wikimedia.org/T161698EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AnomieCc: WMDE-leszek, hoo, aude, Aklapper, QZanden, D3r1ck01, Izno, Wikidata-bugs, Dinoguy1000, jayvdb, MrStradivarius, Anomie, Jackmcbarn, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T92980: [Story] Convert all extensions that are part of the Wikidata build to use the new extension registration

[Reedy]

Reedy added subscribers: tstarling, Reedy.Reedy added a comment.

In T140852#3139266, @tstarling wrote:
It would be really nice if we could complete this and get O(1) setup time for $wgAutoloadClasses
TASK DETAILhttps://phabricator.wikimedia.org/T92980EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ReedyCc: Reedy, tstarling, Ricordisamoa, Legoktm, Liuxinyu970226, JanZerebecki, aude, Aklapper, QZanden, D3r1ck01, Izno, Wikidata-bugs, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T125050: [Task] Add Scribunto to extension-gate in CI

[Anomie]

Anomie added a comment.

In T125050#3140483, @hashar wrote:
For Wikibase tests, the job mwext-testextension-php55-composer-trusty fails. The end of debug log shows a spam of:

1016.5270 1799.0M  Scribunto_LuaStandaloneInterpreter::terminate: terminating


I note that the CLI log for #149 (which passed) shows the same thing at the end.

It seems we can tell the difference in the CLI log between the tests that succeed and the tests that fail:

mw-debug-clu.log for 149472.9353 1693.0M  Parser: using preprocessor: Preprocessor_DOM
[gitinfo] Computed cacheFile=/home/jenkins/workspace/mwext-testextension-php55-composer-trusty/src/gitinfo.json for /home/jenkins/workspace/mwext-testextension-php55-composer-trusty/src
[gitinfo] Cache incomplete for /home/jenkins/workspace/mwext-testextension-php55-composer-trusty/src
472.9565 1693.0M  Parser: using preprocessor: Preprocessor_DOM
472.9585 1693.0M  Scribunto_LuaStandaloneInterpreter::__construct: creating interpreter: 'exec' '/bin/sh' '/home/jenkins/workspace/mwext-testextension-php55-composer-trusty/src/extensions/Scribunto/engines/LuaStandalone/lua_ulimit.sh' '30' '31' '48828' ''\''/home/jenkins/workspace/mwext-testextension-php55-composer-trusty/src/extensions/Scribunto/engines/LuaStandalone/binaries/lua5_1_5_linux_64_generic/lua'\'' '\''/home/jenkins/workspace/mwext-testextension-php55-composer-trusty/src/extensions/Scribunto/engines/LuaStandalone/mw_main.lua'\'' '\''/home/jenkins/workspace/mwext-testextension-php55-composer-trusty/src/extensions/Scribunto'\'' '\''1330'\'''
[gitinfo] Computed cacheFile=/home/jenkins/workspace/mwext-testextension-php55-composer-trusty/src/gitinfo.json for /home/jenkins/workspace/mwext-testextension-php55-composer-trusty/src
[gitinfo] Cache incomplete for /home/jenkins/workspace/mwext-testextension-php55-composer-trusty/src
473.0784 1693.0M  Scribunto_LuaStandaloneInterpreter::terminate: terminating
473.0808 1693.0M  Parser: using preprocessor: Preprocessor_DOM
473.0828 1693.0M  Scribunto_LuaStandaloneInterpreter::__construct: creating interpreter: 'exec' '/bin/sh' '/home/jenkins/workspace/mwext-testextension-php55-composer-trusty/src/extensions/Scribunto/engines/LuaStandalone/lua_ulimit.sh' '30' '31' '48828' ''\''/home/jenkins/workspace/mwext-testextension-php55-composer-trusty/src/extensions/Scribunto/engines/LuaStandalone/binaries/lua5_1_5_linux_64_generic/lua'\'' '\''/home/jenkins/workspace/mwext-testextension-php55-composer-trusty/src/extensions/Scribunto/engines/LuaStandalone/mw_main.lua'\'' '\''/home/jenkins/workspace/mwext-testextension-php55-composer-trusty/src/extensions/Scribunto'\'' '\''1331'\'''
[gitinfo] Computed cacheFile=/home/jenkins/workspace/mwext-testextension-php55-composer-trusty/src/gitinfo.json for /home/jenkins/workspace/mwext-testextension-php55-composer-trusty/src
[gitinfo] Cache incomplete for /home/jenkins/workspace/mwext-testextension-php55-composer-trusty/src
473.2470 1693.0M  Scribunto_LuaStandaloneInterpreter::terminate: terminating
473.2498 1693.0M  Parser: using preprocessor: Preprocessor_DOM

mw-debug-clu.log for 152617.9261 1692.8M  Parser: using preprocessor: Preprocessor_DOM
[gitinfo] Computed cacheFile=/home/jenkins/workspace/mwext-testextension-php55-composer-trusty/src/gitinfo.json for /home/jenkins/workspace/mwext-testextension-php55-composer-trusty/src
[gitinfo] Cache incomplete for /home/jenkins/workspace/mwext-testextension-php55-composer-trusty/src
617.9486 1692.8M  Parser: using preprocessor: Preprocessor_DOM
617.9512 1692.8M  Scribunto_LuaStandaloneInterpreter::__construct: creating interpreter: 'exec' '/bin/sh' '/home/jenkins/workspace/mwext-testextension-php55-composer-trusty/src/extensions/Scribunto/engines/LuaStandalone/lua_ulimit.sh' '30' '31' '48828' ''\''/home/jenkins/workspace/mwext-testextension-php55-composer-trusty/src/extensions/Scribunto/engines/LuaStandalone/binaries/lua5_1_5_linux_64_generic/lua'\'' '\''/home/jenkins/workspace/mwext-testextension-php55-composer-trusty/src/extensions/Scribunto/engines/LuaStandalone/mw_main.lua'\'' '\''/home/jenkins/workspace/mwext-testextension-php55-composer-trusty/src/extensions/Scribunto'\'' '\''1330'\'''
617.9587 1692.8M  Parser: using preprocessor: Preprocessor_DOM
617.9608 1692.8M  Scribunto_LuaStandaloneInterpreter::__construct: creating interpreter: 'exec' '/bin/sh' '/home/jenkins/workspace/mwext-testextension-php55-composer-trusty/src/extensions/Scribunto/engines/LuaStandalone/lua_ulimit.sh' '30' '31' '48828' ''\''/home/jenkins/workspace/mwext-testextension-php55-composer-trusty/src/extensions/Scribunto/engines/LuaStandalone/binaries/lua5_1_5_linux_64_generic/lua'\'' '\''/home/jenkins/workspace/mwext-testextension-php55-composer-trusty/src/extensions/Scribunto/engines/LuaStandalone/mw_main.lua'\'' '\''/home/jenkins/workspace/mwext-testextension-php55-composer-trusty/src/extensions/Scribunto'\'' '\''1331'\'''
617.9664 1692.8M  Parser: using preprocessor: Preprocessor_DOM

Note the second lacks the "[gitinfo]" and "terminating" 

[Wikidata-bugs] [Maniphest] [Commented On] T159828: Use redis-based lock manager for dispatchChanges on test sites.

[daniel]

daniel added a comment.
@Ladsgroup thanks for pointing that out. Let's do this on test.wikidata.org, then.TASK DETAILhttps://phabricator.wikimedia.org/T159828EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, danielCc: aaron, Marostegui, jcrespo, Aklapper, Jonas, Lydia_Pintscher, hoo, daniel, Ladsgroup, QZanden, Minhnv-2809, D3r1ck01, Izno, Luke081515, Wikidata-bugs, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Retitled] T159828: Use redis-based lock manager for dispatchChanges on test sites.

[daniel]

daniel changed the title from "Use redis-based lock manager in dispatch changes in beta cluster" to "Use redis-based lock manager for dispatchChanges on test sites.".daniel reopened this task as "Open".daniel removed a project: Performance.daniel edited the task description. (Show Details)
EDIT DETAILSWhen dispatching changes from test.wikidata.org to test.wikipedia.org, use redis-based locking.

NOTE: This ticket originally asked for the test to be set up on the beta cluster. It changed to ask for the test to be set up on the "test" (staging) sites. This preserves the intent of testing in a live-like environment.TASK DETAILhttps://phabricator.wikimedia.org/T159828EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, danielCc: aaron, Marostegui, jcrespo, Aklapper, Jonas, Lydia_Pintscher, hoo, daniel, Ladsgroup, QZanden, Minhnv-2809, D3r1ck01, Izno, Luke081515, Wikidata-bugs, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Block] T159826: Use redis-based lock manager in dispatch changes in production

[daniel]

daniel reopened subtask T159828: Use redis-based lock manager for dispatchChanges on test sites. as "Open".
TASK DETAILhttps://phabricator.wikimedia.org/T159826EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, danielCc: daniel, hoo, Lydia_Pintscher, Jonas, Aklapper, jcrespo, Marostegui, aaron, Ladsgroup, QZanden, Vali.matei, Minhnv-2809, D3r1ck01, Izno, Luke081515, Wikidata-bugs, aude, GWicke, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T160524: [Story] Add Form to list of Forms

[thiemowmde]

thiemowmde added a comment.

[Bug] Fix error in incurrent Lexeme view
It straight goes to edit mode when calling a Lexeme page, and editing does not work as expected




[Task] Write browser test as seen in the ticket
Including all support files.
Expectation is that the browser test runs without errors, with the new test failing.
This tasks includes comming up with a naming scheme for the HTML elements under test.
Suggestion is something like "wikibase-lexeme-…".
Decision: never use IDs in HTML, only class names.
Acceptance criteria is as follows: If I comment out the failing browser test line, the next should fail with a useful error message. And so on. If all are commented out, the test should succeed (with being empty).




[Task] Introduce HTML templates infrastructure
Key element is a new templates.php file, and a RessourceLoader module. Copy-paste from Wikibase.git.
Try to reuse code from Wikibase.git if it makes sense.
The templates list is (almost) empty, and the templating is unused at this point. Do not touch existing view code in this patch.
Add a comment that suggests a clean naming scheme, e.g. each template name starts with "wikibase-lexeme-…".




[Task] Move existing HTML from views to templates.php
Note: May not make sense for all HTML. Focus on extracting HTML that is actually needed in JS.




[Task] Create "formlist" widget for list of Forms
This is a subclass of the existing listview JS code.
Does not need to create it's own HTML. Keep it simple and do not implement this if it is not needed. Always instantiate on top of existing HTML pre-rendered via the backend.
This widget takes care of adding and displaying the Form added via "add".
This widget will later have a "remove" feature. Not part of the current story. Just keep this in mind.




[Task] Implement Form widget as shown in M210
Must support view as well as edit mode.
Should be able to instantiate on top of existing HTML pre-rendered via the backend, as well as create it's own HTML using a template.
Super-trivial with nothing but an input field for a single representation.
No input for gramatical role or anything.
No input for ID.
Note: We did investigation if existing JQuery UI modules can be reused for the new widgets. We had a look at ValueView as well as terms widgets. Conclusion: Create a new subclasses of EditableTemplatedWidget. Use labelview as a blueprint, but do not copy everything. Reuse elements that make sense. Start with a straight  field.
Note: We may use OOJS elements later. Do not do this for this story, but keep it in mind.




[Task] Create an "add" button to add a Form to a list of Forms
This uses the toolbar infrastructure.
In the first patch the button doesn't do anything.
Note: It might not be possible to split this from the next task that wires the add button.
Make sure the browser test succeeds at this step.

[Task] Make the "add" button display the "add Form" form
This patch creates the wiring to the Form widget previously created.




[Task] Make the "save" button add the new form to the list widget
This patch creates the wiring to the "FormList" widget previously created.




[Task] Assign an ID to each new Form
In the first patch this is allowed to reuse old numbers.

TASK DETAILhttps://phabricator.wikimedia.org/T160524EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: thiemowmdeCc: thiemowmde, Jan_Dittrich, Jonas, Aklapper, QZanden, D3r1ck01, Izno, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T125050: [Task] Add Scribunto to extension-gate in CI

[hashar]

hashar added a comment.
So nothing specific has changed.  T126670 has been closed as a cleanup task since  we have $wgScribuntoDefaultEngine = 'luasandbox'; since Feb 27 2016.

For Wikibase tests, the job mwext-testextension-php55-composer-trusty fails. The end of debug log shows a spam of:

1016.5270 1799.0M  Scribunto_LuaStandaloneInterpreter::terminate: terminating

The HHVM equivalent has 610MBytes

We have the tests running on instances with 4GBytes of memory.  An empty one has 3.3 GBytes free and I have confirmed that on Trusty we have:

/etc/php5/cli/php.inimemory_limit = -1

I noticed the luastandalone process are invoked with lua_ulimit.sh which set the maximum virtual memory to 48828.  Maybe we have reach that limit, but the tests shows they can't fork so I am a bit puzzled.

Also the jobs run ALL tests of ALL extensions added as dependencies, so a Wikibase patch also run:


LuaStandalone: Scribunto_LuaUriLibraryTests1 mn 24 s
LuaStandalone: Scribunto_LuaUstringLibraryTests43 s






In short most probably the suite uses too much memory and ends up reaching the 4GB limit.  Or alternatively, maybe the ulimit kicks in and prevents the fork from completing.TASK DETAILhttps://phabricator.wikimedia.org/T125050EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hasharCc: hashar, aude, thcipriani, Addshore, Paladox, hoo, Aklapper, JanZerebecki, StudiesWorld, QZanden, D3r1ck01, Izno, Wikidata-bugs, Dinoguy1000, jayvdb, MrStradivarius, Anomie, Jackmcbarn, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T128724: [Bug] Using wbeditentity, properties with arbitrary data type id can be created

[gerritbot]

gerritbot added a comment.
Change 345296 merged by Daniel Kinzler:
[mediawiki/extensions/Wikibase@master] Minimize DataTypeDefinitions usage in EditEntity further

https://gerrit.wikimedia.org/r/345296TASK DETAILhttps://phabricator.wikimedia.org/T128724EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: matej_suchanek, gerritbotCc: gerritbot, Aklapper, hoo, aude, daniel, Lydia_Pintscher, Bene, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, D3r1ck01, Izno, Wikidata-bugs, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T159851: Add a column for full entity ID to wb_terms table

[daniel]

daniel added a comment.
The schema update is not sufficient, we also need code to populate the new column. That code should be triggered by a schema update, but also needs a maintenance script. The script needs to operate in batches of configurable size, and should wait for slaves to catch up between batches.

Besides this, the code that updates the terms table needs to be able to write to the old and the new column at the same time. Similarly, the code that reads from the table needs to fall back to using the old columns in case the new column doesn't exist, or is empty. So we will need a feature switch with three states: numeric ids (legacy), full ids (new), and both (compat).TASK DETAILhttps://phabricator.wikimedia.org/T159851EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: gerritbot, Aklapper, daniel, Lydia_Pintscher, WMDE-leszek, QZanden, D3r1ck01, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T161527: Canonical data URIs and URLs for machine readable page content

[daniel]

daniel added a comment.
This RFC is scheduled for discussion on IRC tonight, at 21:00 UTC (2pm PDT, 23:00 CEST), on freenode, in the channel  #wikimedia-office.TASK DETAILhttps://phabricator.wikimedia.org/T161527EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Dzahn, GWicke, tstarling, Aklapper, Jonas, Smalyshev, mkroetzsch, Lydia_Pintscher, daniel, QZanden, D3r1ck01, Izno, suriyaa, Eevans, mobrovac, Hardikj, Wikidata-bugs, aude, jayvdb, Southparkfan, fbstj, RobLa-WMF, santhosh, Mbch331, Jay8g, Ltrlg, Glaisher, bd808, Krenair, Legoktm___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T160524: [Story] Add Form to list of Forms

[WMDE-leszek]

WMDE-leszek edited the task description. (Show Details)
EDIT DETAILS...{M209}

{M210}

Cucumber:... And I enter random string as Forma form representation
 And I save
Then randomepresentation string should be displayed as Form in list of Forms...TASK DETAILhttps://phabricator.wikimedia.org/T160524EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: WMDE-leszekCc: thiemowmde, Jan_Dittrich, Jonas, Aklapper, QZanden, D3r1ck01, Izno, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T161592: Account for foreign repositories in RDF mapping

[gerritbot]

gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T161592EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: WMDE-leszek, gerritbotCc: gerritbot, daniel, Lydia_Pintscher, Aklapper, WMDE-leszek, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, D3r1ck01, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T161592: Account for foreign repositories in RDF mapping

[gerritbot]

gerritbot added a comment.
Change 345332 had a related patch set uploaded (by WMDE-leszek):
[mediawiki/extensions/Wikibase@master] [WIP]Consider foreign entities in RDF mapping

https://gerrit.wikimedia.org/r/345332TASK DETAILhttps://phabricator.wikimedia.org/T161592EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: WMDE-leszek, gerritbotCc: gerritbot, daniel, Lydia_Pintscher, Aklapper, WMDE-leszek, QZanden, D3r1ck01, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T160524: [Story] Add Form to list of Forms

[Lydia_Pintscher]

Lydia_Pintscher added a project: Wikidata-Sprint.
TASK DETAILhttps://phabricator.wikimedia.org/T160524EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lydia_PintscherCc: thiemowmde, Jan_Dittrich, Jonas, Aklapper, QZanden, D3r1ck01, Izno, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T161543: Enable geoshape datatype on Wikidata

[Lydia_Pintscher]

Lydia_Pintscher added subscribers: hoo, aude.Lydia_Pintscher added a comment.
This has been announced to go live on April 17th.TASK DETAILhttps://phabricator.wikimedia.org/T161543EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lydia_PintscherCc: aude, hoo, Dalba, Rschen7754, Aklapper, Lydia_Pintscher, QZanden, D3r1ck01, Izno, Wikidata-bugs, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T161523: [Story] Section header for Senses

[gerritbot]

gerritbot added a comment.
Change 345329 had a related patch set uploaded (by Jakob):
[mediawiki/extensions/WikibaseLexeme@master] Add section header for senses.

https://gerrit.wikimedia.org/r/345329TASK DETAILhttps://phabricator.wikimedia.org/T161523EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Jakob_WMDE, gerritbotCc: gerritbot, Aklapper, Lydia_Pintscher, QZanden, D3r1ck01, Izno, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T161523: [Story] Section header for Senses

[gerritbot]

gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T161523EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Jakob_WMDE, gerritbotCc: gerritbot, Aklapper, Lydia_Pintscher, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, D3r1ck01, Izno, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T161523: [Story] Section header for Senses

[Jakob_WMDE]

Jakob_WMDE added a project: Wikidata-Sprint.
TASK DETAILhttps://phabricator.wikimedia.org/T161523EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Jakob_WMDECc: Aklapper, Lydia_Pintscher, QZanden, D3r1ck01, Izno, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Block] T158705: Inject dependencies in Wikibase API modules and special pages

[Ladsgroup]

Ladsgroup created subtask T161705: Inject EditEntity API module dependencies.
TASK DETAILhttps://phabricator.wikimedia.org/T158705EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: LadsgroupCc: Lydia_Pintscher, Aklapper, Ladsgroup, QZanden, D3r1ck01, Izno, Wikidata-bugs, aude, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T161705: Inject EditEntity API module dependencies

[Ladsgroup]

Ladsgroup added a comment.
https://gerrit.wikimedia.org/r/345324TASK DETAILhttps://phabricator.wikimedia.org/T161705EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: LadsgroupCc: Aklapper, Lydia_Pintscher, Ladsgroup, QZanden, D3r1ck01, Izno, Wikidata-bugs, aude, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T161705: Inject EditEntity API module dependencies

[Ladsgroup]

Ladsgroup created this task.Ladsgroup added projects: Wikidata-Sprint, Technical-Debt, MediaWiki-extensions-WikibaseRepository, Wikidata, User-Ladsgroup.
TASK DESCRIPTIONTASK DETAILhttps://phabricator.wikimedia.org/T161705EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: LadsgroupCc: Aklapper, Lydia_Pintscher, Ladsgroup, QZanden, D3r1ck01, Izno, Wikidata-bugs, aude, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T159828: Use redis-based lock manager in dispatch changes in beta cluster

[Ladsgroup]

Ladsgroup added a comment.
Beta cluser doesn't have dispatching.TASK DETAILhttps://phabricator.wikimedia.org/T159828EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: LadsgroupCc: aaron, Marostegui, jcrespo, Aklapper, Jonas, Lydia_Pintscher, hoo, daniel, Ladsgroup, QZanden, Vali.matei, Minhnv-2809, D3r1ck01, Izno, Luke081515, Wikidata-bugs, aude, GWicke, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Unblock] T159826: Use redis-based lock manager in dispatch changes in production

[Ladsgroup]

Ladsgroup closed subtask T159828: Use redis-based lock manager in dispatch changes in beta cluster as "Invalid".
TASK DETAILhttps://phabricator.wikimedia.org/T159826EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: LadsgroupCc: daniel, hoo, Lydia_Pintscher, Jonas, Aklapper, jcrespo, Marostegui, aaron, Ladsgroup, QZanden, Vali.matei, Minhnv-2809, D3r1ck01, Izno, Luke081515, Wikidata-bugs, aude, GWicke, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T159828: Use redis-based lock manager in dispatch changes in beta cluster

[Ladsgroup]

Ladsgroup closed this task as "Invalid".
TASK DETAILhttps://phabricator.wikimedia.org/T159828EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: LadsgroupCc: aaron, Marostegui, jcrespo, Aklapper, Jonas, Lydia_Pintscher, hoo, daniel, Ladsgroup, QZanden, Vali.matei, Minhnv-2809, D3r1ck01, Izno, Luke081515, Wikidata-bugs, aude, GWicke, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T161674: Implement LexemeFieldDefinitions (for search) and register with LexemeHandler

[gerritbot]

gerritbot added a comment.
Change 345279 merged by WMDE-leszek:
[mediawiki/extensions/WikibaseLexeme@master] Introduce LexemeFieldDefinitions

https://gerrit.wikimedia.org/r/345279TASK DETAILhttps://phabricator.wikimedia.org/T161674EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, aude, Aklapper, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, D3r1ck01, Izno, Wikidata-bugs, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T161698: LuaStandalone: LuaWikibaseLibraryTests - proc_open(): fork failed - Cannot allocate memory

[aude]

aude edited the task description. (Show Details)
EDIT DETAILS...https://integration.wikimedia.org/ci/job/mwext-testextension-php55-composer-trusty/160/artifact/log/mw-debug-cli.log/*view*/

Scribunto tests were re-enabled to run at gate and submit (see T126670). It would be nice if we can find a way that they can run without this issueTASK DETAILhttps://phabricator.wikimedia.org/T161698EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: audeCc: hoo, aude, Aklapper, QZanden, D3r1ck01, Izno, Wikidata-bugs, Dinoguy1000, jayvdb, MrStradivarius, Anomie, Jackmcbarn, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T161698: LuaStandalone: LuaWikibaseLibraryTests - proc_open(): fork failed - Cannot allocate memory

[aude]

aude edited the task description. (Show Details)
EDIT DETAILS...1016.3283 1799.0M  Scribunto_LuaStandaloneInterpreter::terminate: terminating

https://integration.wikimedia.org/ci/job/mwext-testextension-php55-composer-trusty/160/artifact/log/mw-debug-cli.log/*view*/TASK DETAILhttps://phabricator.wikimedia.org/T161698EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: audeCc: aude, Aklapper, QZanden, D3r1ck01, Izno, Wikidata-bugs, Dinoguy1000, jayvdb, MrStradivarius, Anomie, Jackmcbarn, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T161698: LuaStandalone: LuaWikibaseLibraryTests - proc_open(): fork failed - Cannot allocate memory

[aude]

aude created this task.aude added projects: Wikidata, MediaWiki-extensions-Scribunto.Herald added a subscriber: Aklapper.
TASK DESCRIPTIONWikibase-related gate and submit tests are failing due to issues with scribunto:

https://integration.wikimedia.org/ci/job/mwext-testextension-php55-composer-trusty/151/console

03:32:45 153) LuaStandalone: LuaWikibaseLibraryTests[38]: mw.wikibase.resolvePropertyId (label not found)
03:32:45 proc_open(): fork failed - Cannot allocate memory
03:32:45 
03:32:45 /home/jenkins/workspace/mwext-testextension-php55-composer-trusty/src/extensions/Scribunto/engines/LuaStandalone/LuaStandaloneEngine.php:267
03:32:45 /home/jenkins/workspace/mwext-testextension-php55-composer-trusty/src/extensions/Scribunto/engines/LuaStandalone/LuaStandaloneEngine.php:115
03:32:45 /home/jenkins/workspace/mwext-testextension-php55-composer-trusty/src/extensions/Scribunto/engines/LuaCommon/LuaCommon.php:95
03:32:45 /home/jenkins/workspace/mwext-testextension-php55-composer-trusty/src/extensions/Scribunto/engines/LuaStandalone/LuaStandaloneEngine.php:9
03:32:45 /home/jenkins/workspace/mwext-testextension-php55-composer-trusty/src/extensions/Scribunto/engines/LuaCommon/LuaCommon.php:198
03:32:45 /home/jenkins/workspace/mwext-testextension-php55-composer-trusty/src/extensions/Scribunto/engines/LuaCommon/LuaCommon.php:884
03:32:45 /home/jenkins/workspace/mwext-testextension-php55-composer-trusty/src/extensions/Scribunto/tests/engines/LuaCommon/LuaDataProvider.php:21
03:32:45 /home/jenkins/workspace/mwext-testextension-php55-composer-trusty/src/extensions/Scribunto/tests/engines/LuaCommon/LuaEngineTestBase.php:237
03:32:45 /home/jenkins/workspace/mwext-testextension-php55-composer-trusty/src/extensions/Scribunto/tests/engines/LuaCommon/LuaEngineTestBase.php:249
03:32:45 /home/jenkins/workspace/mwext-testextension-php55-composer-trusty/src/tests/phpunit/MediaWikiTestCase.php:400
03:32:45 /home/jenkins/workspace/mwext-testextension-php55-composer-trusty/src/maintenance/doMaintenance.php:111

this is using 1.8G of memory (same tests on hhvm use 610mb), so could be a memory leak or something.  I'm not sure if we can fix in the code or not.

1016.3283 1799.0M  Scribunto_LuaStandaloneInterpreter::terminate: terminatingTASK DETAILhttps://phabricator.wikimedia.org/T161698EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: audeCc: aude, Aklapper, QZanden, D3r1ck01, Izno, Wikidata-bugs, Dinoguy1000, jayvdb, MrStradivarius, Anomie, Jackmcbarn, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T161695: Wikidata dump maintenance scripts cause HHVM to leak memory heavily

[Stashbot]

Stashbot added a comment.
Mentioned in SAL (#wikimedia-operations) [2017-03-29T11:30:30Z]  Started a Wikidata JSON dump run on snapshot1007 using Zend (due to T161695).TASK DETAILhttps://phabricator.wikimedia.org/T161695EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: StashbotCc: Stashbot, Stas, daniel, ArielGlenn, Lydia_Pintscher, Aklapper, hoo, QZanden, D3r1ck01, Izno, Wikidata-bugs, aude, Svick, Mbch331, Joe, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T161695: Wikidata dump maintenance scripts cause HHVM to leak memory heavily

[hoo]

hoo edited the task description. (Show Details)
EDIT DETAILS...This has been an issue with hhvm 3.12.7, I didn't test it with7 and the new hhvm 3.18.1.TASK DETAILhttps://phabricator.wikimedia.org/T161695EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: ArielGlenn, Lydia_Pintscher, Aklapper, hoo, QZanden, D3r1ck01, Izno, Wikidata-bugs, aude, Svick, Mbch331, Joe, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T161695: Wikidata dump maintenance scripts cause HHVM to leak memory heavily

[hoo]

hoo added a comment.
Same on mwdebug1001 with hhvm 3.18:

23336 www-data  20   0 2264696 912092  5 R 91.5 22.5  13:00.97 php /srv/mediawiki/multiversion/MWScript.php extensions/Wikidata/extensions/Wikibase/repo/maintenance/dumpRdf.php --wiki wikidatawiki --sharding-factor 5 --shard 0 --snippet
Processed 35667 entities.

hoo@mwdebug1001:~$ php --version
HipHop VM 3.18.1 (rel)
Compiler: 3.18.1+dfsg-1+wmf1
Repo schema: 47e86d9e41dac7800783dc589035875b00f7231TASK DETAILhttps://phabricator.wikimedia.org/T161695EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: ArielGlenn, Lydia_Pintscher, Aklapper, hoo, QZanden, D3r1ck01, Izno, Wikidata-bugs, aude, Svick, Mbch331, Joe, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T43807: Support for pseudo-language "mul" to indicate multilingual content

[Liuxinyu970226]

Liuxinyu970226 removed a subscriber: wikibugs-l-list.Liuxinyu970226 edited the task description. (Show Details)
EDIT DETAILS...**See Also**:
https://bugzilla.wikimedia.org/show_bug.cgi?id=32189{T34189}TASK DETAILhttps://phabricator.wikimedia.org/T43807EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Liuxinyu970226Cc: adrianheine, Aklapper, Logicwiki, Nikola_Smolenski, liangent, Wikidata-bugs, siebrand, Nemo_bis, SPQRobin, Denny, Micru, DanielFriesen, Liuxinyu970226, Nikerabbit, daniel, Seb35, MuhammadShuaib, Psychoslave, Arrbee, KartikMistry, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T161695: Wikidata dump maintenance scripts cause HHVM to leak memory heavily

[MoritzMuehlenhoff]

MoritzMuehlenhoff added a project: HHVM.
TASK DETAILhttps://phabricator.wikimedia.org/T161695EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MoritzMuehlenhoffCc: ArielGlenn, Lydia_Pintscher, Aklapper, hoo, QZanden, D3r1ck01, Izno, Wikidata-bugs, aude, Svick, Mbch331, Joe, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T161577: OOM problems with snapshot1007 due to wikidata dumpRdf jobs taking all 60GB+ of main memory

[hoo]

hoo added a comment.
I created a new bug for the memory leak: T161695: Wikidata dump maintenance scripts cause HHVM to leak memory heavily.TASK DETAILhttps://phabricator.wikimedia.org/T161577EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: daniel, WMDE-leszek, gerritbot, hoo, ArielGlenn, Gehel, EBernhardson, Adik2382, Lunewa, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, D3r1ck01, Izno, gnosygnu, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T161695: Wikidata dump maintenance scripts cause HHVM to leak memory heavily

[hoo]

hoo created this task.hoo added projects: Wikidata, Datasets-General-or-Unknown.Herald added a subscriber: Aklapper.
TASK DESCRIPTIONThis has been discovered in T161577 and tested in T161577#3139796, though we still don't know the exact cause.

This has been an issue with hhvm 3.12.7, I didn't test it with the new hhvm 3.18.TASK DETAILhttps://phabricator.wikimedia.org/T161695EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: ArielGlenn, Lydia_Pintscher, Aklapper, hoo, QZanden, D3r1ck01, Izno, Wikidata-bugs, aude, Svick, Mbch331, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T161577: OOM problems with snapshot1007 due to wikidata dumpRdf jobs taking all 60GB+ of main memory

[hoo]

hoo added a comment.
Snapshot1007 currently has:

hoo@snapshot1007:~$ hhvm --version
HipHop VM 3.12.7 (rel)
Compiler: 3.12.7+dfsg-1+wmf1~trusty1
Repo schema: a28132f015144d07eea2af17c422c8d422b7111eTASK DETAILhttps://phabricator.wikimedia.org/T161577EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: daniel, WMDE-leszek, gerritbot, hoo, ArielGlenn, Gehel, EBernhardson, Adik2382, Lunewa, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, D3r1ck01, Izno, gnosygnu, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T161577: OOM problems with snapshot1007 due to wikidata dumpRdf jobs taking all 60GB+ of main memory

[gerritbot]

gerritbot added a comment.
Change 345303 merged by ArielGlenn:
[operations/puppet@production] Use Zend php to create the Wikidata entity dumps

https://gerrit.wikimedia.org/r/345303TASK DETAILhttps://phabricator.wikimedia.org/T161577EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: daniel, WMDE-leszek, gerritbot, hoo, ArielGlenn, Gehel, EBernhardson, Adik2382, Lunewa, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, D3r1ck01, Izno, gnosygnu, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T161577: OOM problems with snapshot1007 due to wikidata dumpRdf jobs taking all 60GB+ of main memory

[gerritbot]

gerritbot added a comment.
Change 345303 had a related patch set uploaded (by Hoo man):
[operations/puppet@production] Use Zend php to create the Wikidata entity dumps

https://gerrit.wikimedia.org/r/345303TASK DETAILhttps://phabricator.wikimedia.org/T161577EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: daniel, WMDE-leszek, gerritbot, hoo, ArielGlenn, Gehel, EBernhardson, Adik2382, Lunewa, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, D3r1ck01, Izno, gnosygnu, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Claimed] T161523: [Story] Section header for Senses

[Jakob_WMDE]

Jakob_WMDE claimed this task.
TASK DETAILhttps://phabricator.wikimedia.org/T161523EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Jakob_WMDECc: Aklapper, Lydia_Pintscher, QZanden, D3r1ck01, Izno, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T161577: OOM problems with snapshot1007 due to wikidata dumpRdf jobs taking all 60GB+ of main memory

[hoo]

hoo added a comment.
HHVM on snapshot1007:
22079 datasets  20   0 10.522g 9.948g  22216 R  88.5 15.8  78:49.10 php /srv/mediawiki/multiversion/MWScript.php extensions/Wikidata/extensions/Wikibase/repo/maintenance/dumpRdf.php --wiki wikidatawiki --sharding-factor 5 --shard 0 --snippet
Processed 424796 entities.

Zend on terbium:
16514 www-data  20   0  494840 217436  10144 R  86.9  0.7  82:10.50 php5 /srv/mediawiki-staging/multiversion/MWScript.php extensions/Wikidata/extensions/Wikibase/repo/maintenance/dumpRdf.php --wiki wikidatawiki --sharding-factor 5 --shard 0 --snippet
Processed 313032 entities.

Both processes were started at about the same time, they might have used different database slaves though (that might affect the speed, but not the memory leak).TASK DETAILhttps://phabricator.wikimedia.org/T161577EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: daniel, WMDE-leszek, gerritbot, hoo, ArielGlenn, Gehel, EBernhardson, Adik2382, Lunewa, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, D3r1ck01, Izno, gnosygnu, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T128724: [Bug] Using wbeditentity, properties with arbitrary data type id can be created

[gerritbot]

gerritbot added a comment.
Change 345132 merged by jenkins-bot:
[mediawiki/extensions/Wikibase@master] Don't allow creating properties with arbitrary datatypes

https://gerrit.wikimedia.org/r/345132TASK DETAILhttps://phabricator.wikimedia.org/T128724EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: matej_suchanek, gerritbotCc: gerritbot, Aklapper, hoo, aude, daniel, Lydia_Pintscher, Bene, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, D3r1ck01, Izno, Wikidata-bugs, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs