[Wikidata-bugs] [Maniphest] [Unblock] T189811: Set up user for automatic WDQS GUI builds

2018-04-26 Thread Dzahn 
Dzahn closed subtask T189810: Create private mailing list for WDQS GUI builds as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T189811EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: DzahnCc: greg, mmodell, Lucas_Werkmeister_WMDE, Jonas, Smalyshev, hashar, Aklapper, God, Lahi, Gq86, Darkminds3113, Tommy_Kronkvist, herron, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Avner, Gehel, D3r1ck01, Liudvikas, FloNight, Xmlizer, Luke081515, Barras, jkroll, Wikidata-bugs, Jdouglas, RobH, aude, Tobias1984, Manybubbles, Jalexander, zeljkofilipin, Jdforrester-WMF, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T192308: Upgrade LDF server to latest version

2018-04-26 Thread gerritbot 
gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T192308EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Smalyshev, gerritbotCc: gerritbot, Aklapper, Smalyshev, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Avner, Lewizho99, Maathavan, Gehel, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T192308: Upgrade LDF server to latest version

2018-04-26 Thread gerritbot 
gerritbot added a comment.
Change 429361 had a related patch set uploaded (by Smalyshev; owner: Smalyshev):
[wikidata/query/rdf@master] Upgrade LDF server to latest

https://gerrit.wikimedia.org/r/429361TASK DETAILhttps://phabricator.wikimedia.org/T192308EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Smalyshev, gerritbotCc: gerritbot, Aklapper, Smalyshev, Lahi, Gq86, Darkminds3113, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Avner, Gehel, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T192270: [Bug] deepcategory created empty result set for umlauts

2018-04-26 Thread Smalyshev 
Smalyshev closed this task as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T192270EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: gerritbot, MichaelSchoenitzer_WMDE, debt, Smalyshev, Aklapper, Niedzielski, bzimport, Cpiral, Ricordisamoa, Luke081515, jeremyb-phone, KasiaWMDE, Tobi_WMDE_SW, jeremyb, MGChecker, He7d3r, jayvdb, Deskana, Bawolff, Manybubbles, Lea_WMDE, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, LawExplorer, Avner, Lewizho99, Maathavan, Gehel, FloNight, Bmueller, Wikidata-bugs, aude, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Claimed] T192308: Upgrade LDF server to latest version

2018-04-26 Thread Smalyshev 
Smalyshev claimed this task.Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint.
TASK DETAILhttps://phabricator.wikimedia.org/T192308EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Aklapper, Smalyshev, Lahi, Gq86, Darkminds3113, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Avner, Gehel, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Unblock] T181549: [epic] Subcategory searching

2018-04-26 Thread Smalyshev 
Smalyshev closed subtask T188350: Produce search error if deepcat search returns too many categories as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T181549EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: MichaelSchoenitzer_WMDE, Manybubbles, Bawolff, Deskana, jayvdb, He7d3r, MGChecker, jeremyb, Tobi_WMDE_SW, KasiaWMDE, jeremyb-phone, Luke081515, Ricordisamoa, Cpiral, bzimport, Niedzielski, Aklapper, Lea_WMDE, Smalyshev, debt, Lahi, Gq86, Darkminds3113, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Avner, Gehel, Jonas, FloNight, Xmlizer, Bmueller, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Unblock] T181549: [epic] Subcategory searching

2018-04-26 Thread Smalyshev 
Smalyshev closed subtask T192270: [Bug] deepcategory created empty result set for umlauts as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T181549EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: MichaelSchoenitzer_WMDE, Manybubbles, Bawolff, Deskana, jayvdb, He7d3r, MGChecker, jeremyb, Tobi_WMDE_SW, KasiaWMDE, jeremyb-phone, Luke081515, Ricordisamoa, Cpiral, bzimport, Niedzielski, Aklapper, Lea_WMDE, Smalyshev, debt, Lahi, Gq86, Darkminds3113, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Avner, Gehel, Jonas, FloNight, Xmlizer, Bmueller, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T193180: Clean up archive rows with duplicate revision IDs

2018-04-26 Thread gerritbot 
gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T193180EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Anomie, gerritbotCc: gerritbot, CCicalese_WMF, daniel, Addshore, aude, Aklapper, Jdforrester-WMF, Abit, Anomie, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, PDrouin-WMF, Gq86, Baloch007, E1presidente, Ramsey-WMF, Cparle, Darkminds3113, SandraF_WMF, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Tramullas, Acer, LawExplorer, Lewizho99, Maathavan, Agabi10, Susannaanas, Aschroet, Jane023, Wikidata-bugs, PKM, Base, matthiasmullie, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T193180: Clean up archive rows with duplicate revision IDs

2018-04-26 Thread gerritbot 
gerritbot added a comment.
Change 429345 had a related patch set uploaded (by Anomie; owner: Anomie):
[mediawiki/core@master] Deduplicate archive.ar_rev_id

https://gerrit.wikimedia.org/r/429345TASK DETAILhttps://phabricator.wikimedia.org/T193180EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Anomie, gerritbotCc: gerritbot, CCicalese_WMF, daniel, Addshore, aude, Aklapper, Jdforrester-WMF, Abit, Anomie, Lahi, PDrouin-WMF, Gq86, E1presidente, Ramsey-WMF, Cparle, SandraF_WMF, GoranSMilovanovic, QZanden, Tramullas, Acer, LawExplorer, Agabi10, Susannaanas, Aschroet, Jane023, Wikidata-bugs, PKM, Base, matthiasmullie, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T192759: WDQS endpoint timeout

2018-04-26 Thread Smalyshev 
Smalyshev added a comment.
Maybe, 4915 seems reasonable. I don't think there's internal limits in Blazegraph so theoretically we could go over 4915. Maybe we should add this metric to graph. It seems to be easy t take it from /sys/fs/cgroup/pids/system.slice/wdqs-blazegraph.service/pids.current - can prometheus do that?TASK DETAILhttps://phabricator.wikimedia.org/T192759EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Smalyshev, Gehel, Aklapper, Lucas_Werkmeister_WMDE, Jonas, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T192759: WDQS endpoint timeout

2018-04-26 Thread Gehel 
Gehel added a comment.
gehel@wdqs1004:~$ cat /sys/fs/cgroup/pids/system.slice/wdqs-blazegraph.service/pids.max 
4915

The max number of tasks seems to be 4915 (which is 15% of /proc/sys/kernel/pid_max - thanks @Volans). If blazegraph is really trying to start almost 5k threads, it seems reasonable that it should fail. We probably want to start monitoring the number of threads...TASK DETAILhttps://phabricator.wikimedia.org/T192759EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: GehelCc: Smalyshev, Gehel, Aklapper, Lucas_Werkmeister_WMDE, Jonas, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T192759: WDQS endpoint timeout

2018-04-26 Thread Smalyshev 
Smalyshev added a comment.
Interestingly enough, ps -eT for Blazegraph PID shows 673 threads, which is more than 512, so maybe we're running with different default? Updater seems to use 83 threads.TASK DETAILhttps://phabricator.wikimedia.org/T192759EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Smalyshev, Gehel, Aklapper, Lucas_Werkmeister_WMDE, Jonas, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T192759: WDQS endpoint timeout

2018-04-26 Thread Smalyshev 
Smalyshev added a comment.
From https://github.com/systemd/systemd/blob/master/NEWS#L2518:

* There's a new system.conf setting DefaultTasksMax= to
  control the default TasksMax= setting for services and
  scopes running on the system. (TasksMax= is the primary
  setting that exposes the "pids" cgroup controller on systemd
  and was introduced in the previous systemd release.) The
  setting now defaults to 512, which means services that are
  not explicitly configured otherwise will only be able to
  create 512 processes or threads at maximum, from this
  version on. Note that this means that thread- or
  process-heavy services might need to be reconfigured to set
  TasksMax= to a higher value. It is sufficient to set
  TasksMax= in these specific unit files to a higher value, or
  even "infinity". Similar, there's now a logind.conf setting
  UserTasksMax= that defaults to 4096 and limits the total
  number of processes or tasks each user may own
  concurrently. nspawn containers also have the TasksMax=
  value set by default now, to 8192. Note that all of this
  only has an effect if the "pids" cgroup controller is
  enabled in the kernel. The general benefit of these changes
  should be a more robust and safer system, that provides a
  certain amount of per-service fork() bomb protection.

This may be relevant - 512 thread may be not enough.TASK DETAILhttps://phabricator.wikimedia.org/T192759EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Smalyshev, Gehel, Aklapper, Lucas_Werkmeister_WMDE, Jonas, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T192942: Identify and migrate existing internal clients of wdqs to the new internal cluster

2018-04-26 Thread Smalyshev 
Smalyshev added a comment.
I plan to merge this on Monday 30th (so I could keep eye on it - I might be not able to do it on Thursday).TASK DETAILhttps://phabricator.wikimedia.org/T192942EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: gerritbot, Lydia_Pintscher, Lucas_Werkmeister_WMDE, Smalyshev, Lea_WMDE, Gehel, Aklapper, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Avner, Lewizho99, Maathavan, Agabi10, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Triaged] T192759: WDQS endpoint timeout

2018-04-26 Thread Smalyshev 
Smalyshev triaged this task as "Normal" priority.
TASK DETAILhttps://phabricator.wikimedia.org/T192759EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Smalyshev, Gehel, Aklapper, Lucas_Werkmeister_WMDE, Jonas, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Triaged] T192308: Upgrade LDF server to latest version

2018-04-26 Thread Smalyshev 
Smalyshev triaged this task as "Normal" priority.
TASK DETAILhttps://phabricator.wikimedia.org/T192308EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Aklapper, Smalyshev, Lahi, Gq86, Darkminds3113, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Avner, Gehel, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T181549: [epic] Subcategory searching

2018-04-26 Thread Smalyshev 
Smalyshev closed this task as "Resolved".Smalyshev claimed this task.Smalyshev added a comment.
I think this is mostly done. Remaining sub-issues can be handled independently.TASK DETAILhttps://phabricator.wikimedia.org/T181549EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: MichaelSchoenitzer_WMDE, Manybubbles, Bawolff, Deskana, jayvdb, He7d3r, MGChecker, jeremyb, Tobi_WMDE_SW, KasiaWMDE, jeremyb-phone, Luke081515, Ricordisamoa, Cpiral, bzimport, Niedzielski, Aklapper, Lea_WMDE, Smalyshev, debt, Lahi, Gq86, Darkminds3113, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Avner, Gehel, Jonas, FloNight, Xmlizer, Bmueller, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Changed Status] T186076: Set up WDQS test server on relforge

2018-04-26 Thread Smalyshev 
Smalyshev changed the task status from "Open" to "Stalled".Smalyshev added a comment.
May not be needed if {T186713} is done soon.TASK DETAILhttps://phabricator.wikimedia.org/T186076EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Gehel, SmalyshevCc: mark, Aklapper, dcausse, EBernhardson, Smalyshev, Gehel, Lahi, Gq86, Darkminds3113, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Avner, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T192800: WDQS could allow discovery of skos:exactMatch links via autocomplete

2018-04-26 Thread Smalyshev 
Smalyshev added a comment.
I think this task could use a more detailed example - I am for one not 100% clear what this is supposed to do.TASK DETAILhttps://phabricator.wikimedia.org/T192800EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Smalyshev, Daniel_Mietchen, LJ, Andrawaag, Aklapper, Lahi, Gq86, Darkminds3113, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Avner, Gehel, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Lydia_Pintscher, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T174298: Figure out a way for WDQS example parsing not rely on parsoid

2018-04-26 Thread Smalyshev 
Smalyshev edited projects, added Wikidata Query UI; removed Wikidata-Query-Service.
TASK DETAILhttps://phabricator.wikimedia.org/T174298EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: daniel, Jonas, Smalyshev, Anomie, gerritbot, Lucas_Werkmeister_WMDE, Addshore, Wikidata-Query-Service, Aklapper, Yurik, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Avner, Lewizho99, Maathavan, Gehel, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Lydia_Pintscher, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T190875: Security review for Wikidata queries data release proposal

2018-04-26 Thread Smalyshev 
Smalyshev removed a project: WMF-Legal.
TASK DETAILhttps://phabricator.wikimedia.org/T190875EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Adrian_Bielefeldt, Bawolff, APalmer_WMF, Aklapper, DarTar, mkroetzsch, EBjune, Smalyshev, leila, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Avner, dpatrick, ZhouZ, Luke081515, Wikidata-bugs, aude, Capt_Swing, JanZerebecki, Slaporte, csteipp, Mbch331, Jay8g, Krenair, Legoktm, Mpaulson, jayvdb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T190875: Security review for Wikidata queries data release proposal

2018-04-26 Thread Smalyshev 
Smalyshev added a comment.
@Bawolff do we have any other concerns or this is fine?TASK DETAILhttps://phabricator.wikimedia.org/T190875EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Adrian_Bielefeldt, Bawolff, APalmer_WMF, Aklapper, DarTar, mkroetzsch, EBjune, Smalyshev, leila, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Avner, dpatrick, ZhouZ, Luke081515, Mpaulson, Wikidata-bugs, aude, Capt_Swing, jayvdb, JanZerebecki, Slaporte, csteipp, Mbch331, Jay8g, Krenair, Legoktm___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T192759: WDQS endpoint timeout

2018-04-26 Thread Gehel 
Gehel added a comment.
It looks like cgroup is preventing the fork:

Apr 23 07:39:09 wdqs1004 kernel: [3861112.854423] cgroup: fork rejected by pids controller in /system.slice/wdqs-blazegraph.service

Not sure what the limit is. Time to learn about cgroups...TASK DETAILhttps://phabricator.wikimedia.org/T192759EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: GehelCc: Smalyshev, Gehel, Aklapper, Lucas_Werkmeister_WMDE, Jonas, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T192459: Allow SearchUpdate to process multiple slots

2018-04-26 Thread EBjune 
EBjune added a comment.
Search Platform will keep an eye on this as MCR gets further alongTASK DETAILhttps://phabricator.wikimedia.org/T192459EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: EBjuneCc: EBjune, Smalyshev, Aklapper, gerritbot, daniel, Lahi, PDrouin-WMF, Gq86, E1presidente, Ramsey-WMF, Cparle, SandraF_WMF, GoranSMilovanovic, QZanden, Tramullas, Acer, LawExplorer, Agabi10, Susannaanas, Aschroet, Jane023, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T192919: What kind of information should the Wikibase registry have about a given Wikibase / WDQS instance registered in there?

2018-04-26 Thread Lucas_Werkmeister_WMDE 
Lucas_Werkmeister_WMDE updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTIONBasically, a data model for Wikibase instances and associated WDQS instances.

Wikibase Registry: https://wikibase-registry.wmflabs.org/wiki/Main_PageTASK DETAILhttps://phabricator.wikimedia.org/T192919EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lucas_Werkmeister_WMDECc: Aklapper, Daniel_Mietchen, LJ, Lahi, Gq86, Darkminds3113, Andrawaag, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Avner, Gehel, Jonas, FloNight, Xmlizer, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Lydia_Pintscher, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T57755: allow time values more precise than day

2018-04-26 Thread Jc3s5h 
Jc3s5h added a comment.
All existing dates have been entered without the ability to specify time zones. Sources for dates would typically include encyclopedias, biographic dictionaries (like ''American National Biography''), newspaper obituaries, etc. For such sources, the time zone is the time zone where the event took place, but this was '''falsely''' entered into Wikidata as UTC. The sources generally do not give the time of day of the event, so it is impossible to convert the date in local time to UTC.

I see two possible approaches.


Rewrite the data model to limit precision to day or looser, and define all dates to be in unspecified local time. Rewrite all the output routines to omit timezone and not put a Z at the end of ISO-8601-like strings. Create a new data type that fully supports time zones.



Create a new data type that supports local time (time zone unspeified). Rewrite all date-holding fields to accept either the existing data type, or the new local time data type. When implementing the change, lock the database and run a bot to change all existing data types to the new local time data type. All old data will be deemed to have an unspecified time zone; only data added after the change will have the possibility of having a time zone. A disadvantage of this approach is that existing external tools that accomodated themselves to the bad behavior of WIkidata will continue to add local times and falsely proclaim them to be UTC.
TASK DETAILhttps://phabricator.wikimedia.org/T57755EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Jc3s5hCc: MisterSynergy, Lea_Lacroix_WMDE, Realworldobject, Marsupium, robbi5, Andrei_Stroe, Jklamo, sladen, Liuxinyu970226, Esc3300, Edgars2007, ChristianKl, Saehrimnir, Jc3s5h, Mike_Peel, Thryduulf, Jobu0101, Laddo, Aklapper, MGChecker, Yair_rand, Apsdehal, Wikidata-bugs, Ricordisamoa, Lydia_Pintscher, Ltrlg, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Claimed] T174035: Allow the view action to show multiple slots [MCR]

2018-04-26 Thread Tgr 
Tgr claimed this task.
TASK DETAILhttps://phabricator.wikimedia.org/T174035EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: TgrCc: gerritbot, Aklapper, daniel, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, PDrouin-WMF, Gq86, Baloch007, E1presidente, Ramsey-WMF, Cparle, Darkminds3113, SandraF_WMF, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Tramullas, Acer, LawExplorer, Lewizho99, Maathavan, Agabi10, Susannaanas, Aschroet, Jane023, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Anomie, Steinsplitter, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T174035: Allow the view action to show multiple slots [MCR]

2018-04-26 Thread gerritbot 
gerritbot added a comment.
Change 421794 had a related patch set uploaded (by Daniel Kinzler; owner: Daniel Kinzler):
[mediawiki/core@master] [MCR][WIP] Intropduce RevisionRenderer

https://gerrit.wikimedia.org/r/421794TASK DETAILhttps://phabricator.wikimedia.org/T174035EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Aklapper, daniel, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, PDrouin-WMF, Gq86, Baloch007, E1presidente, Ramsey-WMF, Cparle, Darkminds3113, SandraF_WMF, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Tramullas, Acer, LawExplorer, Lewizho99, Maathavan, Agabi10, Susannaanas, Aschroet, Jane023, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Anomie, Steinsplitter, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T192270: [Bug] deepcategory created empty result set for umlauts

2018-04-26 Thread Smalyshev 
Smalyshev removed a project: Wikidata-Query-Service.
TASK DETAILhttps://phabricator.wikimedia.org/T192270EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: gerritbot, MichaelSchoenitzer_WMDE, debt, Smalyshev, Aklapper, Niedzielski, bzimport, Cpiral, Ricordisamoa, Luke081515, jeremyb-phone, KasiaWMDE, Tobi_WMDE_SW, jeremyb, MGChecker, He7d3r, jayvdb, Deskana, Bawolff, Manybubbles, Lea_WMDE, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, LawExplorer, Avner, Lewizho99, Maathavan, Gehel, FloNight, Bmueller, Wikidata-bugs, aude, Mbch331, Jay8g, Lucas_Werkmeister_WMDE, merbst, Jonas, Xmlizer, jkroll, Jdouglas, Tobias1984___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T192835: Monitoring for internal cluster

2018-04-26 Thread Smalyshev 
Smalyshev closed this task as "Resolved".Smalyshev claimed this task.Smalyshev added a comment.
yes I think soTASK DETAILhttps://phabricator.wikimedia.org/T192835EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Gehel, debt, Aklapper, Jonas, Volans, Lydia_Pintscher, BBlack, Daniel_Mietchen, Smalyshev, Lahi, Gq86, Darkminds3113, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Avner, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Unblock] T178492: Create a more controlled WDQS cluster

2018-04-26 Thread Smalyshev 
Smalyshev closed subtask T192835: Monitoring for internal cluster as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T178492EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Daniel_Mietchen, BBlack, Lydia_Pintscher, Volans, mobrovac, Jonas, Aklapper, debt, Smalyshev, Gehel, Lahi, PDrouin-WMF, Gq86, E1presidente, Ramsey-WMF, Cparle, Darkminds3113, SandraF_WMF, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, Tramullas, Acer, merbst, LawExplorer, Avner, FloNight, Xmlizer, Susannaanas, Eevans, Aschroet, Jane023, jkroll, Hardikj, Wikidata-bugs, Jdouglas, PKM, Base, matthiasmullie, aude, Tobias1984, Manybubbles, Ricordisamoa, Fabrice_Florin, Raymond, Steinsplitter, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T192835: Monitoring for internal cluster

2018-04-26 Thread Gehel 
Gehel added a comment.
That dashboard has a parameter that allows selecting the cluster. @Smalyshev is that enough for now?TASK DETAILhttps://phabricator.wikimedia.org/T192835EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: GehelCc: Gehel, debt, Aklapper, Jonas, Volans, Lydia_Pintscher, BBlack, Daniel_Mietchen, Smalyshev, Lahi, Gq86, Darkminds3113, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Avner, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T192759: WDQS endpoint timeout

2018-04-26 Thread Gehel 
Gehel added a comment.

In T192759#4151679, @Smalyshev wrote:
Looking at the logs on wdq1003, I see a string of java.lang.OutOfMemoryError: unable to create new native thread starting with:

Apr 23 08:02:57 wdqs1003 bash[25917]: java.lang.OutOfMemoryError: unable to create new native thread

I am not sure why at this point Java process haven't exited - -XX:+ExitOnOutOfMemoryError should have caused exit but it did not happen.


That's a known limitation of the JVM.

I'm not entirely sure which limit we are hitting here. The process limit for blazegraph (515307, see below) are high enough that it is probably not the issue. Or if we are reaching that limit, that's probably more a consequence than a cause. I sadly did not take a thread dump before restarting blazegraph, so it is hard to say how many threads were running at that time. My guess is that we have an oversized threadpool somewhere that started growing to increase parallelism when things started to slow down. But that's just a guess...

We might get away with reducing stack size, but that also sounds more like treating the symptoms than the cause.

I also see this:

Apr 23 08:02:57 wdqs1003 bash[25917]: 08:02:44.187 [qtp764977973-306148] INFO  o.w.q.r.b.t.ThrottlingFilter IP:WIKIMEDIA_IPV6-IP UA:MediaWiki/1.31.0-wmf.29 - A request is being throttled.

Which means we're getting throttling on Mediawiki requests - possibly constraint checks?

Yep, but that looks like a consequence of the issue. We throttle on request time. If everything slows down (which seems to be the case here), more requests will start to be throttled. I think that's a reasonable behaviour. Killing requests early instead of serving slow requests. In any case, mw requests should move to the hopefully more stable internal cluster.

blazegraph limits

gehel@wdqs1004:~$ cat /proc/2428/limits 
Limit Soft Limit   Hard Limit   Units 
Max cpu time  unlimitedunlimitedseconds   
Max file size unlimitedunlimitedbytes 
Max data size unlimitedunlimitedbytes 
Max stack size8388608  unlimitedbytes 
Max core file size0unlimitedbytes 
Max resident set  unlimitedunlimitedbytes 
Max processes 515307   515307   processes 
Max open files4096 4096 files 
Max locked memory 6553665536bytes 
Max address space unlimitedunlimitedbytes 
Max file locksunlimitedunlimitedlocks 
Max pending signals   515307   515307   signals   
Max msgqueue size 819200   819200   bytes 
Max nice priority 00
Max realtime priority 00
Max realtime timeout  unlimitedunlimitedusTASK DETAILhttps://phabricator.wikimedia.org/T192759EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: GehelCc: Smalyshev, Gehel, Aklapper, Lucas_Werkmeister_WMDE, Jonas, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Changed Policy] T192759: WDQS endpoint timeout

2018-04-26 Thread Smalyshev 
Smalyshev changed the visibility from "Custom Policy" to "Custom Policy".
TASK DETAILhttps://phabricator.wikimedia.org/T192759EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Smalyshev, Gehel, Aklapper, Lucas_Werkmeister_WMDE, Jonas, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T192306: Create MCR test wiki on WM Cloud

2018-04-26 Thread aude 
aude added a subtask: T193185: Increase quota for wikidata-federation project.
TASK DETAILhttps://phabricator.wikimedia.org/T192306EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: audeCc: CCicalese_WMF, Abit, Addshore, Aklapper, daniel, Lahi, PDrouin-WMF, Gq86, E1presidente, Ramsey-WMF, Cparle, SandraF_WMF, GoranSMilovanovic, QZanden, Tramullas, Acer, LawExplorer, Agabi10, Susannaanas, Aschroet, Jane023, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T193180: Clean up archive rows with duplicate revision IDs

2018-04-26 Thread daniel 
daniel added a subscriber: CCicalese_WMF.daniel added a comment.
ping @CCicalese_WMFTASK DETAILhttps://phabricator.wikimedia.org/T193180EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Anomie, danielCc: CCicalese_WMF, daniel, Addshore, aude, Aklapper, Jdforrester-WMF, Abit, Anomie, Lahi, PDrouin-WMF, Gq86, E1presidente, Ramsey-WMF, Cparle, SandraF_WMF, GoranSMilovanovic, QZanden, Tramullas, Acer, LawExplorer, Agabi10, Susannaanas, Aschroet, Jane023, Wikidata-bugs, PKM, Base, matthiasmullie, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T193180: Clean up archive rows with duplicate revision IDs

2018-04-26 Thread Anomie 
Anomie updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...We can probably define "same change" based on the title, sha1, timestamp, and userTASK DETAILhttps://phabricator.wikimedia.org/T193180EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AnomieCc: daniel, Addshore, aude, Aklapper, Jdforrester-WMF, Abit, Anomie, Lahi, PDrouin-WMF, Gq86, E1presidente, Ramsey-WMF, Cparle, SandraF_WMF, GoranSMilovanovic, QZanden, Tramullas, Acer, LawExplorer, Agabi10, Susannaanas, Aschroet, Jane023, Wikidata-bugs, PKM, Base, matthiasmullie, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Block] T183488: MCR schema migration stage 2: populate new fields

2018-04-26 Thread Anomie 
Anomie reopened subtask T183489: MCR schema migration stage 1: Fix Legacy Archive Rows as "Open".
TASK DETAILhttps://phabricator.wikimedia.org/T183488EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AnomieCc: Abit, gerritbot, Jdforrester-WMF, Anomie, Addshore, aude, Aklapper, daniel, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, PDrouin-WMF, Gq86, Baloch007, E1presidente, Ramsey-WMF, Cparle, Darkminds3113, SandraF_WMF, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Tramullas, Acer, LawExplorer, Lewizho99, Maathavan, Agabi10, Susannaanas, Aschroet, Jane023, Wikidata-bugs, PKM, Base, matthiasmullie, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Reopened] T183489: MCR schema migration stage 1: Fix Legacy Archive Rows

2018-04-26 Thread Anomie 
Anomie reopened this task as "Open".Anomie added a comment.
Reopening for T193180: Clean up archive rows with duplicate revision IDsTASK DETAILhttps://phabricator.wikimedia.org/T183489EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AnomieCc: Abit, Jdforrester-WMF, Aklapper, aude, Addshore, Anomie, daniel, Lahi, PDrouin-WMF, Gq86, E1presidente, Ramsey-WMF, Cparle, SandraF_WMF, GoranSMilovanovic, QZanden, Tramullas, Acer, LawExplorer, Agabi10, Susannaanas, Aschroet, Jane023, Wikidata-bugs, PKM, Base, matthiasmullie, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T193180: Clean up archive rows with duplicate revision IDs

2018-04-26 Thread Anomie 
Anomie created this task.Anomie triaged this task as "Normal" priority.Anomie added projects: Structured-Data-Commons, Multi-Content-Revisions, MediaWiki-Platform-Team (MWPT-Q4-Apr-Jun-2018).Herald added a project: Wikidata.
TASK DESCRIPTIONThere are, broadly, four classes of "duplicates" that may exist and need cleaning up:


Cases where both a revision and an archive row exist for the same change.
Cases where an archive row exists with the same revision ID as some other change in revision.
Cases where multiple archive rows exist for the same change.
Cases where multiple archive rows use the same revision ID for different changes.


We can probably define "same change" based on the sha1, timestamp, and user.

Fixing this should be reasonably straightforward: find the duplicates, classify them, delete the archive rows for the two "same change" cases, and assign new revision IDs (as in T182678) for the "different change" cases.TASK DETAILhttps://phabricator.wikimedia.org/T193180EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AnomieCc: daniel, Addshore, aude, Aklapper, Jdforrester-WMF, Abit, Anomie, Lahi, PDrouin-WMF, Gq86, E1presidente, Ramsey-WMF, Cparle, SandraF_WMF, GoranSMilovanovic, QZanden, Tramullas, Acer, LawExplorer, Agabi10, Susannaanas, Aschroet, Jane023, Wikidata-bugs, PKM, Base, matthiasmullie, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T192984: Label in Special:NewItem is too much escaped

2018-04-26 Thread matej_suchanek 
matej_suchanek closed this task as a duplicate of T108533: [Bug] Escaping problem when creating an item from search.
TASK DETAILhttps://phabricator.wikimedia.org/T192984EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: matej_suchanekCc: Envlh, Aklapper, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Merged] T108533: [Bug] Escaping problem when creating an item from search

2018-04-26 Thread matej_suchanek 
matej_suchanek added a subscriber: Envlh.matej_suchanek merged a task: T192984: Label in Special:NewItem is too much escaped.
TASK DETAILhttps://phabricator.wikimedia.org/T108533EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: matej_suchanekCc: Envlh, TerraCodes, IvanFon, Aklapper, Multichill, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T193175: Implement UI for constructing 'depicts' search query

2018-04-26 Thread Cparle 
Cparle created this task.Cparle triaged this task as "Normal" priority.Cparle added projects: Wikidata, Structured-Data-Commons, Multimedia, Epic, Discovery-Search, Multimedia-Team-Working-Board.
TASK DESCRIPTIONFiles can be found based on their 'depicts' statements using the haswbstatement: search keyword.

A normal user won't know the property id for 'depicts', or the item ids for any of the items that might be depicted, so we need a UI where they can choose these easily. Probably will be the same as the UI for entered depicts data for a file (possibly based on or using wikidata code).

Don't have designs yet, but that probably isn't a blockerTASK DETAILhttps://phabricator.wikimedia.org/T193175EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: CparleCc: Aklapper, Ramsey-WMF, Cparle, Lahi, PDrouin-WMF, Gq86, E1presidente, SandraF_WMF, GoranSMilovanovic, QZanden, EBjune, Tramullas, Acer, V4switch, LawExplorer, Susannaanas, Wong128hk, Aschroet, Jane023, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Matanya, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Unassigned] T192000: Create formatters for displaying a form as a statement value

2018-04-26 Thread Addshore 
Addshore removed Addshore as the assignee of this task.
TASK DETAILhttps://phabricator.wikimedia.org/T192000EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: Addshore, gerritbot, Pablo-WMDE, Lydia_Pintscher, Aklapper, thiemowmde, Jonas, PokestarFan, Aleksey_WMDE, WMDE-leszek, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T192000: Create formatters for displaying a form as a statement value

2018-04-26 Thread Addshore 
Addshore added a comment.
As far as I can tell the formatting is all okay.

Multiple representations:

F17323834: image.png

Single representation:

F17323839: image.png

Once  T192766 is fixed I guess this will end up being closedTASK DETAILhttps://phabricator.wikimedia.org/T192000EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: gerritbot, Pablo-WMDE, Lydia_Pintscher, Aklapper, thiemowmde, Jonas, PokestarFan, Aleksey_WMDE, WMDE-leszek, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T190875: Security review for Wikidata queries data release proposal

2018-04-26 Thread Adrian_Bielefeldt 
Adrian_Bielefeldt added a comment.
The extractAnonymized.py-script is indeed not used anywhere, so I've removed it.

Quick rundown of the anonymization process and its code locations:
Stage 1: Parsing of the query here. This uses a slightly modified version of the OpenRDF-Parser, among others setting the default prefixes.
Stage 2, Point 1: Not exactly in the code, but parsing ignores comments.
Stage 2, Point 2: Replacing the strings is done here.
Stage 2, Point 3: The variable renaming code is here.
Stage 2, Point 4: The geographic coordinates are handled here.
Stage 3: The entire rendering is done here.

The python script is just for convenience, supplying the default locations on the server and building the maven call.TASK DETAILhttps://phabricator.wikimedia.org/T190875EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Adrian_BielefeldtCc: Adrian_Bielefeldt, Bawolff, APalmer_WMF, Aklapper, DarTar, mkroetzsch, EBjune, Smalyshev, leila, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Avner, dpatrick, ZhouZ, Luke081515, Mpaulson, Wikidata-bugs, aude, Capt_Swing, jayvdb, JanZerebecki, Slaporte, csteipp, Mbch331, Jay8g, Krenair, Legoktm___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T183804: Citations from Wikidata generate errors on huWiki: "Invalid tag; name defined multiple times with different content"

2018-04-26 Thread Bencemac 
Bencemac added a comment.
1.) Yes.
2.) T189376 and T185423 would be my next ’what should I do?’, so I will write a little note. I know that you cannot magically solve everything, but at least you know guys who are able to. :) I hope I can take part in the next meeting.TASK DETAILhttps://phabricator.wikimedia.org/T183804EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: BencemacCc: WMDE-Fisch, gabriel-wmde, Pzgulyas, Lucas_Werkmeister_WMDE, daniel, Izno, Tacsipacsi, Bencemac, Aklapper, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T178222: WDQS UP arrow is broken (upper right corner)

2018-04-26 Thread Lucas_Werkmeister_WMDE 
Lucas_Werkmeister_WMDE closed this task as "Resolved".Lucas_Werkmeister_WMDE assigned this task to Jonas.Lucas_Werkmeister_WMDE added a comment.
Removed in I53b82b1b5f.TASK DETAILhttps://phabricator.wikimedia.org/T178222EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Jonas, Lucas_Werkmeister_WMDECc: Lucas_Werkmeister_WMDE, Aklapper, Yurik, Lahi, Gq86, Darkminds3113, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Avner, Gehel, Jonas, FloNight, Xmlizer, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Lydia_Pintscher, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T189863: Set up SPARQL query service on FactGrid

2018-04-26 Thread Lucas_Werkmeister_WMDE 
Lucas_Werkmeister_WMDE added a comment.
Oops, certainly :) UI is at https://database.factgrid.de/query and direct endpoint at https://database.factgrid.de/sparql.TASK DETAILhttps://phabricator.wikimedia.org/T189863EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lucas_Werkmeister_WMDECc: Lydia_Pintscher, Lucas_Werkmeister_WMDE, Aklapper, Lahi, Gq86, GoranSMilovanovic, lisong, QZanden, LawExplorer, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T192723: Allowed Units Constraint: accept class (P2308) and relation (P2309) as qualifiers instead of item of property constraint (P2305)

2018-04-26 Thread Lucas_Werkmeister_WMDE 
Lucas_Werkmeister_WMDE added a project: Wikibase-Quality.Lucas_Werkmeister_WMDE added a subscriber: Ivan_A_Krestinin.Lucas_Werkmeister_WMDE added a comment.
As far as I’m aware, {{Constraint:Units}} has never supported “class” and “relation” parameters, so this would be a new feature not only for WikibaseQualityConstraints but also for KrBot.TASK DETAILhttps://phabricator.wikimedia.org/T192723EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lucas_Werkmeister_WMDECc: Ivan_A_Krestinin, Lucas_Werkmeister_WMDE, Aklapper, Dhx1, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Agabi10, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T96478: Provide Lua function to check if an item is a redirect and what the target is

2018-04-26 Thread Jarekt 
Jarekt added a comment.
Opps the task is already closed after code change. If there is such a function than it should be documented at https://www.mediawiki.org/wiki/Extension:Wikibase_Client/LuaTASK DETAILhttps://phabricator.wikimedia.org/T96478EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: JarektCc: Jarekt, matej_suchanek, Ricordisamoa, hoo, Bene, Lydia_Pintscher, Aklapper, Multichill, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T96478: Provide Lua function to check if an item is a redirect and what the target is

2018-04-26 Thread Jarekt 
Jarekt added subscribers: matej_suchanek, Jarekt.Jarekt added a comment.

In T96478#1961396, @matej_suchanek wrote:
Workaround: mw.wikibase.getEntity() always returns the target entity with the new id. So you can do:

local id = ...
local entity = mw.wikibase.getEntity(id)
if id ~= entity.id then
it's redirected
end


Matej, workaround seems to solve the problem. Maybe we should document the way to check for redirects and close this task, or do we want to add short trivial function to mw.wikibase to do the test?TASK DETAILhttps://phabricator.wikimedia.org/T96478EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: JarektCc: Jarekt, matej_suchanek, Ricordisamoa, hoo, Bene, Lydia_Pintscher, Aklapper, Multichill, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T151269: Add English names for languages which don't yet have one

2018-04-26 Thread Raymond 
Raymond closed this task as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T151269EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: RaymondCc: gerritbot, jhsoby-WMNO, PokestarFan, santhosh, Nemo_bis, abian, Pigsonthewing, Lydia_Pintscher, jhsoby, Nikerabbit, thiemowmde, Liuxinyu970226, Lea_Lacroix_WMDE, Aklapper, revi, Nikki, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, lisong, Adik2382, RazeSoldier, Jayprakash12345, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Taiwania_Justo, Srdjan_m, MuhammadShuaib, LNDDYL, Psychoslave, Fuzheado, Cwek, Wikidata-bugs, aude, Gryllida, zhuyifei1999, Shizhao, Arrbee, KartikMistry, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Unblock] T124286: [Epic] Wikidata language support

2018-04-26 Thread Raymond 
Raymond closed subtask T151269: Add English names for languages which don't yet have one as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T124286EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: RaymondCc: PokestarFan, Liuxinyu970226, Ricordisamoa, adrianheine, Aklapper, Lahi, Gq86, GoranSMilovanovic, Jayprakash12345, QZanden, LawExplorer, Srdjan_m, MuhammadShuaib, LNDDYL, Psychoslave, Wikidata-bugs, aude, Gryllida, Shizhao, Arrbee, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T193071: permit a phabricator page for the FactGrid project

2018-04-26 Thread Olaf_Simons 
Olaf_Simons added a comment.
cool, I will try to find out how to do things properly.TASK DETAILhttps://phabricator.wikimedia.org/T193071EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Olaf_SimonsCc: Franziska_Heine, Daniel_Mietchen, Lydia_Pintscher, samuwmde, Aklapper, Olaf_Simons, Danny_B, Luke081515, Wikidata-bugs, Jdforrester-WMF, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T57755: allow time values more precise than day

2018-04-26 Thread MisterSynergy 
MisterSynergy added a comment.
According to mw:Wikibase/DataModel#Dates and times, there are already most requirements for timezone support contained in the data model. What prevents us from just activating it? Sure, there will be some GUI changes necessary to enable HH:MM:SS modifications, and to show a timezone selector, but it does not appear too complex to find something there. The highest precision should be seconds (precision=14) to my opinion, as already defined in the data model.

An alternative approach with more required changes could be to save the timezone as URIs instead of “diff minutes to UTC”, akin to the calendarmodel approach. I am not sure whether that would really have advantages, though; maybe display would be easier, since times could be witten as “26 April 2018, 13:43:51 (MESZ / UTC+2)”, rather than “26 April 2018, 13:43:51 (UTC+2)”.TASK DETAILhttps://phabricator.wikimedia.org/T57755EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MisterSynergyCc: MisterSynergy, Lea_Lacroix_WMDE, Realworldobject, Marsupium, robbi5, Andrei_Stroe, Jklamo, sladen, Liuxinyu970226, Esc3300, Edgars2007, ChristianKl, Saehrimnir, Jc3s5h, Mike_Peel, Thryduulf, Jobu0101, Laddo, Aklapper, MGChecker, Yair_rand, Apsdehal, Wikidata-bugs, Ricordisamoa, Lydia_Pintscher, Ltrlg, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T193071: permit a phabricator page for the FactGrid project

2018-04-26 Thread Aklapper 
Aklapper added a project: Project-Admins.Aklapper added a comment.

In T193071#4159248, @Olaf_Simons wrote:
I think I need a project to create workboards - should be a proect then.


In short: One [sub]project has one workboard and one workboard has one [sub]project. Projects can have subprojects. See mw:Phabricator/Project_management.TASK DETAILhttps://phabricator.wikimedia.org/T193071EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Olaf_Simons, AklapperCc: Franziska_Heine, Daniel_Mietchen, Lydia_Pintscher, samuwmde, Aklapper, Olaf_Simons, Danny_B, Luke081515, Wikidata-bugs, Jdforrester-WMF, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T193007: Only store numeric property IDs in SqlEntityInfoBuilder

2018-04-26 Thread gerritbot 
gerritbot added a comment.
Change 429166 had a related patch set uploaded (by Jakob; owner: Jakob):
[mediawiki/extensions/Wikibase@master] Store only numeric property IDs in SqlEntityInfoBuilder

https://gerrit.wikimedia.org/r/429166TASK DETAILhttps://phabricator.wikimedia.org/T193007EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Jakob_WMDE, Aklapper, Lydia_Pintscher, WMDE-leszek, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T193007: Only store numeric property IDs in SqlEntityInfoBuilder

2018-04-26 Thread gerritbot 
gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T193007EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Jakob_WMDE, Aklapper, Lydia_Pintscher, WMDE-leszek, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T192292: Request to return 405 on POST calls to SPARQL endpoint, Wikidata primary sources tool VPS project

2018-04-26 Thread Hjfocs 
Hjfocs updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...- Instance: https://tools.wmflabs.org/openstack-browser/server/pst.wikidata-primary-sources-tool.eqiad.wmflabs
- base URI: https://pst.wmflabs.org/v2

**Use case:** the client should not be allowed to modify data on the server storage engine (Blazegraph);...**Request:** please add the following NGINX directive to the VPS instance virtual server (**updated** as per T192292#4160588)location /~ /(sparql {l|dataloader|tx|status|namespace) {
if ($request_method = POS!= GET) {...TASK DETAILhttps://phabricator.wikimedia.org/T192292EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: HjfocsCc: Aklapper, Hjfocs, 1978Gage2001, Lahi, aborrero, Gq86, GoranSMilovanovic, Kiailandi, Chicocvenancio, QZanden, Tbscho, dachary, LawExplorer, JJMC89, srodlund, Luke081515, Wikidata-bugs, aude, Gryllida, Ricordisamoa, Sjoerddebruin, Tpt, scfc, Mbch331, bd808, Krenair, chasemp___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T151269: Add English names for languages which don't yet have one

2018-04-26 Thread ReleaseTaggerBot 
ReleaseTaggerBot added a project: MW-1.32-release-notes (WMF-deploy-2018-05-01 (1.32.0-wmf.2)).
TASK DETAILhttps://phabricator.wikimedia.org/T151269EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Raymond, ReleaseTaggerBotCc: gerritbot, jhsoby-WMNO, PokestarFan, santhosh, Nemo_bis, abian, Pigsonthewing, Lydia_Pintscher, jhsoby, Nikerabbit, thiemowmde, Liuxinyu970226, Lea_Lacroix_WMDE, Aklapper, revi, Nikki, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, lisong, Adik2382, RazeSoldier, Jayprakash12345, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Taiwania_Justo, Srdjan_m, MuhammadShuaib, LNDDYL, Psychoslave, Fuzheado, Cwek, Wikidata-bugs, aude, Gryllida, zhuyifei1999, Shizhao, Arrbee, KartikMistry, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T192292: Request to return 405 on POST calls to SPARQL endpoint, Wikidata primary sources tool VPS project

2018-04-26 Thread Hjfocs 
Hjfocs added a comment.
Important updates:


all non-GET requests should be disallowed;
the same behavior should also apply to the following endpoints: /dataloader /namespace /tx /status


Task description edited accordingly.TASK DETAILhttps://phabricator.wikimedia.org/T192292EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: HjfocsCc: Aklapper, Hjfocs, 1978Gage2001, Lahi, aborrero, Gq86, GoranSMilovanovic, Kiailandi, Chicocvenancio, QZanden, Tbscho, dachary, LawExplorer, JJMC89, srodlund, Luke081515, Wikidata-bugs, aude, Gryllida, Ricordisamoa, Sjoerddebruin, Tpt, scfc, Mbch331, bd808, Krenair, chasemp___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T151269: Add English names for languages which don't yet have one

2018-04-26 Thread gerritbot 
gerritbot added a comment.
Change 424556 merged by jenkins-bot:
[mediawiki/extensions/cldr@master] Add English names for languages which don't yet have one

https://gerrit.wikimedia.org/r/424556TASK DETAILhttps://phabricator.wikimedia.org/T151269EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Raymond, gerritbotCc: gerritbot, jhsoby-WMNO, PokestarFan, santhosh, Nemo_bis, abian, Pigsonthewing, Lydia_Pintscher, jhsoby, Nikerabbit, thiemowmde, Liuxinyu970226, Lea_Lacroix_WMDE, Aklapper, revi, Nikki, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, lisong, Adik2382, RazeSoldier, Jayprakash12345, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Taiwania_Justo, Srdjan_m, MuhammadShuaib, LNDDYL, Psychoslave, Fuzheado, Cwek, Wikidata-bugs, aude, Gryllida, zhuyifei1999, Shizhao, Arrbee, KartikMistry, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T183804: Citations from Wikidata generate errors on huWiki: "Invalid tag; name defined multiple times with different content"

2018-04-26 Thread WMDE-Fisch 
WMDE-Fisch added a comment.
Oh great, that's good to hear. I just looked at the template page again, so I guess these things did it {1]?

And again, we are happy to help. If you have anything else just poke is in the next Technical Advice IRC session. For some cases like that one it's also good to post the question beforehand on the page so we have a chance to prepare a bit [2] ;-).

[1] https://hu.wikipedia.org/w/index.php?diff=19870709&oldid=19870644&title=Sablon:Cite_web 
[2] https://www.mediawiki.org/wiki/Technical_Advice_IRC_MeetingTASK DETAILhttps://phabricator.wikimedia.org/T183804EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Bencemac, WMDE-FischCc: WMDE-Fisch, gabriel-wmde, Pzgulyas, Lucas_Werkmeister_WMDE, daniel, Izno, Tacsipacsi, Bencemac, Aklapper, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Reassigned] T192364: Add OAuth extension to wikibase bundle container

2018-04-26 Thread WMDE-leszek 
WMDE-leszek reassigned this task from Tarrow to Addshore.Herald added a project: User-Addshore.
TASK DETAILhttps://phabricator.wikimedia.org/T192364EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Addshore, WMDE-leszekCc: Lydia_Pintscher, Aklapper, Tarrow, Addshore, Magnus, Lucas_Werkmeister_WMDE, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, lisong, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Abbe98, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T192869: Image link should link to Commons and not local file

2018-04-26 Thread gerritbot 
gerritbot added a comment.
Change 428687 merged by jenkins-bot:
[mediawiki/extensions/Wikibase@master] CommonsMediaImageGallery: Link image captions to commons

https://gerrit.wikimedia.org/r/428687TASK DETAILhttps://phabricator.wikimedia.org/T192869EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, gerritbotCc: Liuxinyu970226, Multichill, Lydia_Pintscher, Aklapper, hoo, gerritbot, Lea_Lacroix_WMDE, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, lisong, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T193005: EntityHandler::getTitleForId should handle FormIDs

2018-04-26 Thread gerritbot 
gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T193005EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Jakob_WMDE, gerritbotCc: gerritbot, Jakob_WMDE, Aklapper, Lydia_Pintscher, WMDE-leszek, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T193005: EntityHandler::getTitleForId should handle FormIDs

2018-04-26 Thread gerritbot 
gerritbot added a comment.
Change 429157 had a related patch set uploaded (by Jakob; owner: Jakob):
[mediawiki/extensions/WikibaseLexeme@master] EntityHandler::getTitleForId should handle FormIds

https://gerrit.wikimedia.org/r/429157TASK DETAILhttps://phabricator.wikimedia.org/T193005EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Jakob_WMDE, gerritbotCc: gerritbot, Jakob_WMDE, Aklapper, Lydia_Pintscher, WMDE-leszek, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T57755: allow time values more precise than day

2018-04-26 Thread Lea_Lacroix_WMDE 
Lea_Lacroix_WMDE added a comment.
Hello all,

This issue has been described in this discussion. The goal seems to add, in the date values, the possibility to have the exact time.

In order to investigate on the feasibility of this, I'd like to have a better understanding of what you want, what behaviour should the feature have. Can you help me by answering a few questions?


What would be the input format of the field? How would you like to be able to enter data (format, interface)
How do you expect the data to be displayed once it's validated?
What degree of precision do you require?
How would you prefer to deal with time zones?


Thanks a lot!TASK DETAILhttps://phabricator.wikimedia.org/T57755EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lea_Lacroix_WMDECc: Lea_Lacroix_WMDE, Realworldobject, Marsupium, robbi5, Andrei_Stroe, Jklamo, sladen, Liuxinyu970226, Esc3300, Edgars2007, ChristianKl, Saehrimnir, Jc3s5h, Mike_Peel, Thryduulf, Jobu0101, Laddo, Aklapper, MGChecker, Yair_rand, Apsdehal, Wikidata-bugs, Ricordisamoa, Lydia_Pintscher, Ltrlg, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T191504: inconsistency between language fields on the Lexeme page

2018-04-26 Thread WMDE-leszek 
WMDE-leszek updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...**Code pointer**: the entered lang code is checked using validator provided by LexemeValidatorFactory::getLanguageCodeValidator
**NOTE**: as of 25.04.2018 the language code validation is not strict enough, as "de-x-foobar" would be recognized as the valid language, whereas it has been defined that a valid language code should include a Q-ID-like string after '-x-' tag.TASK DETAILhttps://phabricator.wikimedia.org/T191504EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: WMDE-leszekCc: WMDE-leszek, Aklapper, Lydia_Pintscher, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T191504: inconsistency between language fields on the Lexeme page

2018-04-26 Thread WMDE-leszek 
WMDE-leszek updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...- if the input contains a part '-x-' in it, the part before '-x-' is a language code recognized as valid by "core" wikibase, and the part after '-x-' is of form: 'Q' followed by digits

== Examples of valid language codes ==...- de-Q1996
- de-x-foobar
- de-x-Q1996-foobar
- foobar-x-Q1996...TASK DETAILhttps://phabricator.wikimedia.org/T191504EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: WMDE-leszekCc: WMDE-leszek, Aklapper, Lydia_Pintscher, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T192766: Statements with data type "form" cannot be saved on properties

2018-04-26 Thread Addshore 
Addshore updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...The SetClaim request calls `ReferencedEntitiesDataUpdater::addLinksToParserOutput` when saving the property which in turn attempts to do an `EntityTitleLookup` and calls `EntityHandler::getTitleForId` on the `LexemeHandler` with a `FormId` at which point it breaks because it expected a `LexemeId`.

>>! In T192766#4156688, @Lydia_Pintscher wrote:
> Léa and I just saw the same thing happening when adding a statement on the Lexeme-level of a Lexeme. It was fine on a Form.TASK DETAILhttps://phabricator.wikimedia.org/T192766EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: Lydia_Pintscher, Aklapper, Jakob_WMDE, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T192000: Create formatters for displaying a form as a statement value

2018-04-26 Thread WMDE-leszek 
WMDE-leszek added a comment.
Problem with statement on property is tracked as T192766. If there is any other issue, could you please @Lydia_Pintscher describe it at least here as a comment, so we know it?TASK DETAILhttps://phabricator.wikimedia.org/T192000EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Addshore, WMDE-leszekCc: gerritbot, Pablo-WMDE, Lydia_Pintscher, Aklapper, thiemowmde, Jonas, PokestarFan, Aleksey_WMDE, WMDE-leszek, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T163642: Index Wikidata strings in statements in the search engine

2018-04-26 Thread Lydia_Pintscher 
Lydia_Pintscher added a comment.
Yeah let's leave them out for now.TASK DETAILhttps://phabricator.wikimedia.org/T163642EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lydia_PintscherCc: Liuxinyu970226, Smalyshev, debt, aude, Lydia_Pintscher, Aklapper, Multichill, Lahi, Gq86, Darkminds3113, GoranSMilovanovic, QZanden, EBjune, LawExplorer, Avner, Gehel, FloNight, Wikidata-bugs, jayvdb, Mbch331, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T40968: Keyboard-navigability of the repo UI

2018-04-26 Thread Envlh 
Envlh added a comment.

In T40968#3762249, @Charlie_WMDE wrote:
I'm gonna stall this until the new UI happens.


Can you link to the corresponding Phabricator ticket, please? I couldn't find it.TASK DETAILhttps://phabricator.wikimedia.org/T40968EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: EnvlhCc: Envlh, Charlie_WMDE, PokestarFan, Jan_Dittrich, Aklapper, Liuxinyu970226, Wikidata-bugs, Jaredzimmerman-WMF, thiemowmde, Denny, adrianheine, Snaterlicious, Ricordisamoa, Lydia_Pintscher, Lahi, Gq86, GoranSMilovanovic, QZanden, Orienteerix, LawExplorer, EHCliffe, Zppix, JGirault, Volker_E, aude, Dinoguy1000, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T191981: Enable finding forms using wbsearchentities API

2018-04-26 Thread WMDE-leszek 
WMDE-leszek added a comment.
Very cool!TASK DETAILhttps://phabricator.wikimedia.org/T191981EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Addshore, WMDE-leszekCc: Lea_Lacroix_WMDE, Smalyshev, gerritbot, Lydia_Pintscher, Aklapper, thiemowmde, Jonas, PokestarFan, Aleksey_WMDE, WMDE-leszek, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T189596: Run deleteAutopatrolLogs script for Wikidata (WMF)

2018-04-26 Thread jcrespo 
jcrespo added a comment.
@Ladsgroup after the table rebuilding on dbstore2001, purging is going at a good pace:
https://grafana.wikimedia.org/dashboard/db/mysql?panelId=11&fullscreen&orgId=1&var-dc=codfw%20prometheus%2Fops&var-server=dbstore2001&var-port=13318&from=1524683251842&to=1524726451842

As soon as the counter gets close to 0, the row deletion can continue. At the current pace I predict it will be around 1 day of waitinf, if purge keeps happening at the same rate.TASK DETAILhttps://phabricator.wikimedia.org/T189596EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, jcrespoCc: jcrespo, GeoffreyT2000, kaldari, gerritbot, Stashbot, Lucas_Werkmeister_WMDE, Aklapper, Ladsgroup, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, lisong, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Wikidata-bugs, aude, Dcljr, Lydia_Pintscher, Mbch331, Rxy, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs