[Wikidata-bugs] [Maniphest] T280108: WDQS data-transfer cookbook needs to wait for updater to catchup on lag

2021-05-05 Thread Gehel
Gehel closed this task as "Resolved".
Gehel claimed this task.

TASK DETAIL
  https://phabricator.wikimedia.org/T280108

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: RKemper, Gehel, Aklapper, Invadibot, MPhamWMF, maantietaja, CBogen, 
Akuckartz, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org


[Wikidata-bugs] [Maniphest] T267927: Reload wikidata journal from fresh dumps

2021-05-05 Thread Gehel
Gehel closed subtask T280108: WDQS data-transfer cookbook needs to wait for 
updater to catchup on lag as Resolved.

TASK DETAIL
  https://phabricator.wikimedia.org/T267927

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper, Gehel
Cc: jbond, Zbyszko, Gehel, Aklapper, dcausse, Invadibot, MPhamWMF, maantietaja, 
CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org


[Wikidata-bugs] [Maniphest] T280001: Set up puppet configuration for new WCQS cluster

2021-05-03 Thread Gehel
Gehel updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T280001

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Aklapper, Zbyszko, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, 
Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, 
QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, 
Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T262265: Provide real-time updates for WCQS

2021-05-03 Thread Gehel
Gehel updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T262265

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Salgo60, Gehel, Aklapper, Zbyszko, Invadibot, MPhamWMF, maantietaja, 
CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T281671: [Epic] Import WikibaseQualityConstraint check data in WDQS

2021-05-03 Thread Gehel
Gehel created this task.
Gehel added projects: Epic, Wikidata, Wikidata-Query-Service.
Restricted Application added a subscriber: Aklapper.

TASK DESCRIPTION
  As an editor of Wikidata, I want to have WikibaseQualityConstraint check data 
imported to WDQS so that I can build higher level workflows to improve the 
quality of Wikidata.
  
  As part of the WDQS Streaming Updater work (T244590 
<https://phabricator.wikimedia.org/T244590>), import of Constraint Checks will 
stop being imported into WDQS. The current way constraint checks were imported 
was problematic and failed to import a large amount of the data (citation 
needed). Instead of reimplementing a problematic solution, we want to have a 
robust one from the start. The exact strategy still needs to be defined.
  
  A few notes:
  
  - a robust implementation will need Store WikibaseQualityConstraint check 
data in persistent storage instead of in the cache (T204024 
<https://phabricator.wikimedia.org/T204024>)
  - Wikibase will probably need to expose a stream of constraint check changes
  - constraint checks will need to be identifiable (so that they can be removed 
from WDQS)
  - the WDQS Flink based Streaming Updater will need to be modified to support 
constraint checks
  
  AC:
  
  - Constraint check data is available in a SPARQL endpoint and available to be 
queried with WDQS

TASK DETAIL
  https://phabricator.wikimedia.org/T281671

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Aklapper, Gehel, Invadibot, MPhamWMF, maantietaja, NavinRizwi, CBogen, 
Akuckartz, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Dinoguy1000, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T280001: Set up puppet configuration for new WCQS cluster

2021-04-26 Thread Gehel
Gehel updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T280001

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Aklapper, Zbyszko, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, 
Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, 
QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, 
Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

2021-04-26 Thread Gehel
Gehel closed subtask T269331: wdqs.data-reload cookbook fails when deleting the 
old namespace as Resolved.

TASK DETAIL
  https://phabricator.wikimedia.org/T269204

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper, Gehel
Cc: Gehel, RKemper, dcausse, Aklapper, Invadibot, MPhamWMF, maantietaja, lmata, 
CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, herron, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, QZanden, EBjune, 
merbst, LawExplorer, Volans, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331, 
fgiunchedi
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T269331: wdqs.data-reload cookbook fails when deleting the old namespace

2021-04-26 Thread Gehel
Gehel closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T269331

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Zbyszko, Gehel
Cc: RKemper, dcausse, Aklapper, Invadibot, MPhamWMF, maantietaja, CBogen, 
Akuckartz, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T280579: New service request: WDQS Flink based Streaming Updater

2021-04-21 Thread Gehel
Gehel updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T280579

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Aklapper, Gehel, dcausse, Zbyszko, RKemper, Invadibot, Ramtin0071, 
MPhamWMF, Devnull, maantietaja, lmata, JMeybohm, Muchiri124, Alter-paule, 
Beast1978, CBogen, Un1tY, Akuckartz, Hook696, Kent7301, RhinosF1, joker88john, 
Legado_Shulgin, ReaperDawn, CucyNoiD, Nandana, Namenlos314, Gaboe420, 
Giuliamocci, Davinaclare77, Qtn1293, Cpaulf30, Techguru.pc, Lahi, Gq86, Af420, 
Bsandipan, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, 
QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, _jensen, 
rosalieper, Scott_WUaS, Jonas, Xmlizer, Wong128hk, Eevans, jkroll, Hardikj, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, 
Jdforrester-WMF, Addshore, Mbch331, Jay8g, fgiunchedi
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T280579: New service request: WDQS Flink based Streaming Updater

2021-04-21 Thread Gehel
Gehel renamed this task from "[Draft] New service request: WDQS Flink based 
Streaming Updater" to "New service request: WDQS Flink based Streaming Updater".

TASK DETAIL
  https://phabricator.wikimedia.org/T280579

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Aklapper, Gehel, dcausse, Zbyszko, RKemper, Invadibot, Ramtin0071, 
MPhamWMF, Devnull, maantietaja, lmata, JMeybohm, Muchiri124, Alter-paule, 
Beast1978, CBogen, Un1tY, Akuckartz, Hook696, Kent7301, RhinosF1, joker88john, 
Legado_Shulgin, ReaperDawn, CucyNoiD, Nandana, Namenlos314, Gaboe420, 
Giuliamocci, Davinaclare77, Qtn1293, Cpaulf30, Techguru.pc, Lahi, Gq86, Af420, 
Bsandipan, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, 
QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, _jensen, 
rosalieper, Scott_WUaS, Jonas, Xmlizer, Wong128hk, Eevans, jkroll, Hardikj, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, 
Jdforrester-WMF, Addshore, Mbch331, Jay8g, fgiunchedi
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T280579: [Draft] New service request: WDQS Flink based Streaming Updater

2021-04-21 Thread Gehel
Gehel updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T280579

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Aklapper, Gehel, dcausse, Zbyszko, RKemper, Invadibot, Ramtin0071, 
MPhamWMF, Devnull, maantietaja, lmata, JMeybohm, Muchiri124, Alter-paule, 
Beast1978, CBogen, Un1tY, Akuckartz, Hook696, Kent7301, RhinosF1, joker88john, 
Legado_Shulgin, ReaperDawn, CucyNoiD, Nandana, Namenlos314, Gaboe420, 
Giuliamocci, Davinaclare77, Qtn1293, Cpaulf30, Techguru.pc, Lahi, Gq86, Af420, 
Bsandipan, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, 
QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, _jensen, 
rosalieper, Scott_WUaS, Jonas, Xmlizer, Wong128hk, Eevans, jkroll, Hardikj, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, 
Jdforrester-WMF, Addshore, Mbch331, Jay8g, fgiunchedi
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T280579: [Draft] New service request: WDQS Flink based Streaming Updater

2021-04-21 Thread Gehel
Gehel updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T280579

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Aklapper, Gehel, dcausse, Zbyszko, RKemper, Invadibot, Ramtin0071, 
MPhamWMF, Devnull, maantietaja, lmata, JMeybohm, Muchiri124, Alter-paule, 
Beast1978, CBogen, Un1tY, Akuckartz, Hook696, Kent7301, RhinosF1, joker88john, 
Legado_Shulgin, ReaperDawn, CucyNoiD, Nandana, Namenlos314, Gaboe420, 
Giuliamocci, Davinaclare77, Qtn1293, Cpaulf30, Techguru.pc, Lahi, Gq86, Af420, 
Bsandipan, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, 
QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, _jensen, 
rosalieper, Scott_WUaS, Jonas, Xmlizer, Wong128hk, Eevans, jkroll, Hardikj, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, 
Jdforrester-WMF, Addshore, Mbch331, Jay8g, fgiunchedi
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T280579: [Draft] New service request: WDQ Flink based Streaming Updater

2021-04-19 Thread Gehel
Gehel updated the task description.
Restricted Application added a project: wdwb-tech.

TASK DETAIL
  https://phabricator.wikimedia.org/T280579

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Aklapper, Gehel, dcausse, Zbyszko, RKemper, Invadibot, Ramtin0071, 
MPhamWMF, Devnull, maantietaja, lmata, JMeybohm, Muchiri124, CBogen, Akuckartz, 
RhinosF1, Legado_Shulgin, ReaperDawn, Nandana, Namenlos314, Davinaclare77, 
Qtn1293, Techguru.pc, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, 
Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, Zppix, _jensen, 
rosalieper, Scott_WUaS, Jonas, Xmlizer, Wong128hk, Eevans, jkroll, Hardikj, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, 
Jdforrester-WMF, Addshore, Mbch331, Jay8g, fgiunchedi
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T280579: [Draft] New service request: WDQ Flink based Streaming Updater

2021-04-19 Thread Gehel
Gehel created this task.
Gehel added projects: Wikidata-Query-Service, Service-deployment-requests.
Restricted Application added a subscriber: Aklapper.
Restricted Application added projects: Wikidata, Services, SRE.

TASK DESCRIPTION
  **Name:** WDQS Streaming Updater
  **Description:** The WDQS Streaming Updater allows generating a stream of 
updates for WDQS. This service is a replacement for part of the current updater 
that is deployed on each WDQS server. It allows consolidating the common part 
of that update process instead duplicating that processing on each node and 
improves throughput by 5-10x.
  **Timeline:** Q4 2021, hopefully May. Discussions have been ongoing for a few 
month, so while this timeline is short, it is not unexpected.
  **Point person:** @RKemper as SRE, @dcausse and @Zbyszko as SWE, Search 
Platform as a team.
  **Technologies:**
  
  - Flink <https://flink.apache.org/>: a stateful stream processing framework 
(Java based)
  - Java / JVM
  - Kafka (both as a consumer and a producer)
  - Running on k8s, with some direct dependencies (ability to publish config 
maps)
  
  **Request flow diagram:** - a link to a diagram that explains the interaction 
between your service and any other parts of the operational stack inside the 
production cluster, such as requests made to MediaWiki, RESTBase, etc.
  **Misc:**
  
  - https://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Streaming_Updater

TASK DETAIL
  https://phabricator.wikimedia.org/T280579

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Aklapper, Gehel, dcausse, Zbyszko, RKemper, Invadibot, Ramtin0071, 
MPhamWMF, Devnull, maantietaja, lmata, JMeybohm, Muchiri124, CBogen, Akuckartz, 
RhinosF1, Legado_Shulgin, ReaperDawn, Nandana, Namenlos314, Davinaclare77, 
Qtn1293, Techguru.pc, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, 
Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, Zppix, _jensen, 
rosalieper, Scott_WUaS, Jonas, Xmlizer, Wong128hk, Eevans, jkroll, Hardikj, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, 
Jdforrester-WMF, Mbch331, Jay8g, fgiunchedi
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T280166: Investigate using session cluster for Flink

2021-04-19 Thread Gehel
Gehel updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T280166

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: dcausse, JMeybohm, jijiki, Aklapper, Gehel, akosiaris, Mstyles, Invadibot, 
MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T280166: Investigate using session cluster for Flink

2021-04-19 Thread Gehel
Gehel updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T280166

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: dcausse, JMeybohm, jijiki, Aklapper, Gehel, akosiaris, Mstyles, Invadibot, 
MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T280166: Investigate using session cluster for Flink

2021-04-19 Thread Gehel
Gehel updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T280166

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: dcausse, JMeybohm, jijiki, Aklapper, Gehel, akosiaris, Mstyles, Invadibot, 
MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T279691: Add query service lag of WCQS to Commons maxlag

2021-04-19 Thread Gehel
Gehel added a comment.


  At the moment, we don't have any idea if a similar mechanism is needed for 
Commons / WCQS. We might revisit this once we are in a production context and 
have measurements.

TASK DETAIL
  https://phabricator.wikimedia.org/T279691

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Zbyszko, Aklapper, Gehel, Salgo60, Bugreporter, Invadibot, MPhamWMF, 
maantietaja, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T280487: Redirect requests from wcqs-beta.wmflabs.org to the final URL for WCQS

2021-04-19 Thread Gehel
Gehel created this task.
Gehel added a project: Wikidata-Query-Service.
Restricted Application added a subscriber: Aklapper.
Restricted Application added a project: Wikidata.

TASK DESCRIPTION
  As a user of WCQS Beta, I want my links to continue working when WCQS moves 
to its final location.
  
  WMCS provides support for URL redirection, once WCQS is available in its 
final location this needs to be configured appropriately.
  
  AC:
  
  - URLs on WCQS Beta are redirected to the final WCQS location

TASK DETAIL
  https://phabricator.wikimedia.org/T280487

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Gehel, Aklapper, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, 
Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, 
QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, 
Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T280485: Additional capacity on the k8s Flink cluster for WCQS updater

2021-04-19 Thread Gehel
Gehel removed a project: Wikidata.

TASK DETAIL
  https://phabricator.wikimedia.org/T280485

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Aklapper, RKemper, Gehel, MPhamWMF, CBogen, Namenlos314, Gq86, 
Lucas_Werkmeister_WMDE, EBjune, merbst, Jonas, Xmlizer, jkroll, Wikidata-bugs, 
Jdouglas, aude, Tobias1984, Manybubbles, Invadibot, maantietaja, Akuckartz, 
Nandana, Lahi, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T280485: Additional capacity on the k8s Flink cluster for WCQS updater

2021-04-19 Thread Gehel
Gehel updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T280485

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Aklapper, RKemper, Gehel, Invadibot, MPhamWMF, maantietaja, CBogen, 
Akuckartz, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T280485: Additional capacity on the k8s Flink cluster for WCQS updater

2021-04-19 Thread Gehel
Gehel created this task.
Gehel added a project: Wikidata-Query-Service.
Restricted Application added a subscriber: Aklapper.
Restricted Application added a project: Wikidata.

TASK DESCRIPTION
  As an operator of WCQS I want to ensure that there is enough capacity in our 
k8s cluster so that deploying WCQS Flink Updater isn't blocked.
  
  For context, WCQS is a service similar to WDQS but consuming data from 
Commons. The WCQS Updater is similar to the WDQS Updater, but with a different 
source of data (Commons instead of Wikidata) and an expected lower rate of 
edits.
  
  AC:
  
  - validation that there is enough capacity or a plan to increase the capacity

TASK DETAIL
  https://phabricator.wikimedia.org/T280485

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Aklapper, RKemper, Gehel, Invadibot, MPhamWMF, maantietaja, CBogen, 
Akuckartz, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T267927: Reload wikidata journal from fresh dumps

2021-04-14 Thread Gehel
Gehel added a comment.


  Multiple transfers from the same source host is not supported. The various 
cookbook instances don't synchronize, so blazegraph is likely to be restarted 
before all transfers are completed, leading to corruption of data. Note that in 
any case, this would not speed up operations much since the bottleneck is the 
outgoing network bandwidth on the source server.
  
  At the moment, wdqs1003 and wdqs1004 have corrupted data and have been 
depooled.

TASK DETAIL
  https://phabricator.wikimedia.org/T267927

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper, Gehel
Cc: jbond, Zbyszko, Gehel, Aklapper, dcausse, Invadibot, MPhamWMF, maantietaja, 
Alter-paule, Beast1978, CBogen, Un1tY, Akuckartz, Hook696, Kent7301, 
joker88john, CucyNoiD, Nandana, Namenlos314, Gaboe420, Giuliamocci, Cpaulf30, 
Lahi, Gq86, Af420, Bsandipan, Lucas_Werkmeister_WMDE, GoranSMilovanovic, 
QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, _jensen, 
rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, 
Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T267927: Reload wikidata journal from fresh dumps

2021-04-14 Thread Gehel
Gehel added a subtask: T280108: WDQS data-transfer cookbook needs to wait for 
updater to catchup on lag.

TASK DETAIL
  https://phabricator.wikimedia.org/T267927

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper, Gehel
Cc: jbond, Zbyszko, Gehel, Aklapper, dcausse, Invadibot, MPhamWMF, maantietaja, 
Alter-paule, Beast1978, CBogen, Un1tY, Akuckartz, Hook696, Kent7301, 
joker88john, CucyNoiD, Nandana, Namenlos314, Gaboe420, Giuliamocci, Cpaulf30, 
Lahi, Gq86, Af420, Bsandipan, Lucas_Werkmeister_WMDE, GoranSMilovanovic, 
QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, _jensen, 
rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, 
Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T280108: WDQS data-transfer cookbook needs to wait for updater to catchup on lag

2021-04-14 Thread Gehel
Gehel added a parent task: T267927: Reload wikidata journal from fresh dumps.

TASK DETAIL
  https://phabricator.wikimedia.org/T280108

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: RKemper, Gehel, Aklapper, Invadibot, MPhamWMF, maantietaja, CBogen, 
Akuckartz, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T280108: WDQS data-transfer cookbook needs to wait for updater to catchup on lag

2021-04-14 Thread Gehel
Gehel updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T280108

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: RKemper, Gehel, Aklapper, Invadibot, MPhamWMF, maantietaja, CBogen, 
Akuckartz, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T280108: WDQS data-transfer cookbook needs to wait for updater to catchup on lag

2021-04-14 Thread Gehel
Gehel created this task.
Gehel added a project: Wikidata-Query-Service.
Restricted Application added a subscriber: Aklapper.
Restricted Application added a project: Wikidata.

TASK DESCRIPTION
  As a user of WDQS, I only want non-lagged servers to be pooled.
  As an operator of WDQS I don't want to be alerted transient issues that are 
part of normal operations during data reload.
  
  WDQS data-transfer cookbook needs to wait for updater to catchup on lag 
before removing icinga downtime and repooling servers.
  
  We already have code to wait for updater to catch up on lag in the 
data-reload cookbook. This code should be moved to Spicerack (so that it is in 
a central location) and should be used for both the data-reload and 
data-transfer cookbooks.
  
  AC:
  
  - no alert are raised during normal operations of the data-transfer cookbook
  - wdqs servers are not pooled until they are fully catched up on lag

TASK DETAIL
  https://phabricator.wikimedia.org/T280108

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: RKemper, Gehel, Aklapper, Invadibot, MPhamWMF, maantietaja, CBogen, 
Akuckartz, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T269302: Many files on Commons cannot be found in WCQS

2021-04-07 Thread Gehel
Gehel closed this task as "Resolved".
Gehel added a comment.


  Looks like this is resolved. If you find more issues, feel free to re-open.

TASK DETAIL
  https://phabricator.wikimedia.org/T269302

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Zbyszko, Gehel
Cc: Gehel, CBogen, Lydia_Pintscher, Vojtech.dostal, Dipsacus_fullonum, 
Aklapper, Invadibot, GFontenelle_WMF, MPhamWMF, maantietaja, FRomeo_WMF, 
Muchiri124, Nintendofan885, Akuckartz, Nandana, JKSTNK, Namenlos314, Lahi, 
Gq86, E1presidente, Ramsey-WMF, Cparle, Anooprao, SandraF_WMF, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, Tramullas, Acer, 
merbst, LawExplorer, Salgo60, Silverfish, Poyekhali, _jensen, rosalieper, 
Taiwania_Justo, Scott_WUaS, Jonas, Xmlizer, Susannaanas, Ixocactus, Wong128hk, 
Jane023, jkroll, Wikidata-bugs, Jdouglas, Base, matthiasmullie, aude, 
Tobias1984, El_Grafo, Dinoguy1000, Manybubbles, Ricordisamoa, Wesalius, 
Raymond, Steinsplitter, Mbch331, Keegan
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T270476: Linked Data Fragments endpoint returns IllegalStateException

2021-04-07 Thread Gehel
Gehel closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T270476

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse, Gehel
Cc: RKemper, Gehel, Aklapper, Invadibot, MPhamWMF, maantietaja, CBogen, 
Akuckartz, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T277637: Report latency metric to the wdqs-ui from the wdqs streaming updater

2021-04-07 Thread Gehel
Gehel closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T277637

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse, Gehel
Cc: dcausse, Aklapper, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, 
Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, 
QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, 
Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T276784: Recover lexemes on wdqs1009

2021-04-07 Thread Gehel
Gehel closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T276784

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse, Gehel
Cc: Aklapper, dcausse, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, 
Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, 
QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, 
Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T278693: Manually purge obsolete/outdated entites from WDQS (2021-03)

2021-03-29 Thread Gehel
Gehel set the point value for this task to "1".

TASK DETAIL
  https://phabricator.wikimedia.org/T278693

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Aklapper, MisterSynergy, Invadibot, MPhamWMF, maantietaja, CBogen, 
Akuckartz, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T278693: Manually purge obsolete/outdated entites from WDQS (2021-03)

2021-03-29 Thread Gehel
Gehel moved this task from All WDQS-related tasks to Current work on the 
Wikidata-Query-Service board.
Gehel added a project: Discovery-Search (Current work).

TASK DETAIL
  https://phabricator.wikimedia.org/T278693

WORKBOARD
  https://phabricator.wikimedia.org/project/board/891/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Aklapper, MisterSynergy, Invadibot, MPhamWMF, maantietaja, CBogen, 
Akuckartz, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T278246: Report WDQS update latency when displaying/serving results

2021-03-29 Thread Gehel
Gehel triaged this task as "Medium" priority.

TASK DETAIL
  https://phabricator.wikimedia.org/T278246

WORKBOARD
  https://phabricator.wikimedia.org/project/board/891/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: dcausse, Aklapper, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, 
Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, 
QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, 
Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T264006: Deploy Flink to kubernetes (k8s)

2021-03-24 Thread Gehel
Gehel closed subtask Restricted Task as Resolved.

TASK DETAIL
  https://phabricator.wikimedia.org/T264006

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: akosiaris, Mstyles, Gehel, Aklapper, Invadibot, MPhamWMF, maantietaja, 
Alter-paule, Beast1978, CBogen, Un1tY, Akuckartz, Hook696, Kent7301, 
joker88john, CucyNoiD, Nandana, Namenlos314, Gaboe420, Giuliamocci, Cpaulf30, 
Lahi, Gq86, Af420, Bsandipan, Lucas_Werkmeister_WMDE, GoranSMilovanovic, 
QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, _jensen, 
rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, 
Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T264006: Deploy Flink to kubernetes (k8s)

2021-03-24 Thread Gehel
Gehel closed subtask T276131: Fix Serialization Bug as Resolved.

TASK DETAIL
  https://phabricator.wikimedia.org/T264006

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: akosiaris, Mstyles, Gehel, Aklapper, Invadibot, MPhamWMF, maantietaja, 
Alter-paule, Beast1978, CBogen, Un1tY, Akuckartz, Hook696, Kent7301, 
joker88john, CucyNoiD, Nandana, Namenlos314, Gaboe420, Giuliamocci, Cpaulf30, 
Lahi, Gq86, Af420, Bsandipan, Lucas_Werkmeister_WMDE, GoranSMilovanovic, 
QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, _jensen, 
rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, 
Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T276131: Fix Serialization Bug

2021-03-24 Thread Gehel
Gehel closed this task as "Resolved".
Gehel claimed this task.

TASK DETAIL
  https://phabricator.wikimedia.org/T276131

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Aklapper, Gehel, akosiaris, Mstyles, Invadibot, MPhamWMF, maantietaja, 
CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T263427: Unable to process a particular wikibase dump using munge.sh (localised namespace name)

2021-03-22 Thread Gehel
Gehel added a comment.


  In this case, `Special:EntityData` in the dump is a technical identifier and 
should not be translated. We should have a way to create dumps in a language 
agnostic way.
  
  @Addshore : would it be possible to fix this on the Wikibase side? Having an 
option to standardize dumps, independent of the language?

TASK DETAIL
  https://phabricator.wikimedia.org/T263427

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Gehel, despens, Addshore, Andrawaag, JeroenDeDauw, WMDE-leszek, dcausse, 
Aklapper, Nikerabbit, Invadibot, MPhamWMF, maantietaja, CBogen, 
Samantha_Alipio_WMDE, Akuckartz, Jelabra, Nandana, Namenlos314, Lahi, Gq86, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, Asahiko, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Nemo_bis, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T258895: Wikimedia Commons Query Service should use Wikimedia url shortener instead of tinyurl

2021-03-18 Thread Gehel
Gehel added a comment.


  In T258895#6382143 <https://phabricator.wikimedia.org/T258895#6382143>, 
@Legoktm wrote:
  
  > The general requirements are (we should document this somewhere):
  >
  > - No open redirects (allows bypassing the allowed domains list)
  > - No dangerous actions on GET requests
  > - No reflective XSS
  
  The code is the same as the production WDQS and should support the 
requirements above.
  
  > - Should fall under the Wikimedia privacy policy / or anyone who has access 
to private information should have signed an NDA.
  
  This project has quite a few members. Most of them are WMF staff and are 
under NDA, but a few are not and even if that was the case, we don't have a 
good way to enforce NDA for future access.
  
  > URL stability explicitly isn't a consideration, e.g. wiki pages can 
disappear at any time. It's up to each service to maintain stable URLs (Cool 
URIs don't change!) - I would expect `wcqs-beta.wmflabs.org` eventually 
redirects to the production instance.
  
  `wcqs-beta.wmflabs.org` will disappear once a production service is in place, 
URLs will be broken and won't be redirected.

TASK DETAIL
  https://phabricator.wikimedia.org/T258895

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Nirmos, Legoktm, Nikki, Bugreporter, Jheald, Lucas_Werkmeister_WMDE, 
Nintendofan885, Ladsgroup, Aklapper, Gehel, Multichill, MPhamWMF, maantietaja, 
Muchiri124, CBogen, Akuckartz, DannyS712, Nandana, Namenlos314, Lahi, Gq86, 
Ramsey-WMF, GoranSMilovanovic, Chicocvenancio, QZanden, EBjune, merbst, 
LawExplorer, Poyekhali, _jensen, rosalieper, Taiwania_Justo, Scott_WUaS, Jonas, 
Xmlizer, Ixocactus, Wong128hk, abian, jkroll, Wikidata-bugs, Jdouglas, aude, 
Tobias1984, El_Grafo, Dinoguy1000, Manybubbles, Alchimista, Steinsplitter, 
Mbch331, Keegan
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T244590: [Epic] Rework the WDQS updater as an event driven application

2021-03-04 Thread Gehel
Gehel added a subtask: T276469: Cookbooks and / or operation procedures are 
adapted for the new Flink based WDQS Streaming Updater.

TASK DETAIL
  https://phabricator.wikimedia.org/T244590

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Daniel_Mietchen, Thadguidry, tfmorris, revi, Ladsgroup, Multichill, 
darthmon_wmde, Iamamz3, Smalyshev, Ottomata, JAllemandou, Aklapper, Zbyszko, 
Gehel, dcausse, MPhamWMF, maantietaja, NavinRizwi, CBogen, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
abian, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Dinoguy1000, 
Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T276469: Cookbooks and / or operation procedures are adapted for the new Flink based WDQS Streaming Updater

2021-03-04 Thread Gehel
Gehel created this task.
Gehel added a project: Wikidata-Query-Service.
Restricted Application added a subscriber: Aklapper.
Restricted Application added a project: Wikidata.

TASK DESCRIPTION
  As an operator, I want to have automation or documented procedures to 
standard operations so that I can react to issues in a timely manner.
  
  AC:
  
  The following cookbooks are to be adapted, or verified that they still work:
  
  - data reload
  - data transfer
  
  The following documentation is reviewed:
  
  - https://wikitech.wikimedia.org/wiki/Wikidata_query_service
  - https://wikitech.wikimedia.org/wiki/Wikidata_query_service/Runbook

TASK DETAIL
  https://phabricator.wikimedia.org/T276469

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Aklapper, Gehel, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
abian, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T276469: Cookbooks and / or operation procedures are adapted for the new Flink based WDQS Streaming Updater

2021-03-04 Thread Gehel
Gehel added a parent task: T244590: [Epic] Rework the WDQS updater as an event 
driven application.

TASK DETAIL
  https://phabricator.wikimedia.org/T276469

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Aklapper, Gehel, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
abian, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T244590: [Epic] Rework the WDQS updater as an event driven application

2021-03-04 Thread Gehel
Gehel added a subtask: T276467: Ensure we have proper monitoring / alerting on 
the new Flink based WDQS Streaming Updater.

TASK DETAIL
  https://phabricator.wikimedia.org/T244590

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Daniel_Mietchen, Thadguidry, tfmorris, revi, Ladsgroup, Multichill, 
darthmon_wmde, Iamamz3, Smalyshev, Ottomata, JAllemandou, Aklapper, Zbyszko, 
Gehel, dcausse, MPhamWMF, maantietaja, NavinRizwi, CBogen, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
abian, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Dinoguy1000, 
Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T276467: Ensure we have proper monitoring / alerting on the new Flink based WDQS Streaming Updater

2021-03-04 Thread Gehel
Gehel added a parent task: T244590: [Epic] Rework the WDQS updater as an event 
driven application.

TASK DETAIL
  https://phabricator.wikimedia.org/T276467

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Aklapper, Gehel, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
abian, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T276467: Ensure we have proper monitoring / alerting on the new Flink based WDQS Streaming Updater

2021-03-04 Thread Gehel
Gehel created this task.
Gehel added a project: Wikidata-Query-Service.
Restricted Application added a subscriber: Aklapper.
Restricted Application added a project: Wikidata.

TASK DESCRIPTION
  As an operator of WDQS, I want to know the status of the service, so that I 
can react in a timely manner in case of issues.
  
  We need to replicate the kind of metrics and alerting that we have related to 
the current updater. Either the current metrics / alerts are still working, or 
they need to be adapted, or we decide that they are not relevant anymore.
  
  AC:
  
  - Alerts are raised on high update lag (with similar threshold as currently).
  - Relevant metrics in the WDQS Grafana dashboard are still working or adapted 
to the new updater. In particular:
- lag
- imported triple rate
- imported entity rate

TASK DETAIL
  https://phabricator.wikimedia.org/T276467

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Aklapper, Gehel, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
abian, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T273901: Automate event stream ingestion into HDFS for streams that don't use EventGate

2021-03-03 Thread Gehel
Gehel added a project: Discovery-Search (Current work).
Gehel moved this task from Tracking to Current work on the 
Wikidata-Query-Service board.

TASK DETAIL
  https://phabricator.wikimedia.org/T273901

WORKBOARD
  https://phabricator.wikimedia.org/project/board/891/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ottomata, Gehel
Cc: Gehel, Aklapper, JAllemandou, dcausse, Mstyles, Ottomata, MPhamWMF, CBogen, 
Akuckartz, 4748kitoko, holger.knust, Nandana, Namenlos314, Akovalyov, Lahi, 
Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, abian, 
terrrydactyl, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, GWicke, 
Manybubbles, Mbch331, jeremyb
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T273901: Automate event stream ingestion into HDFS for streams that don't use EventGate

2021-03-03 Thread Gehel
Gehel added a comment.


  @Ottomata this is going to block the deployment of the WDQS Flink based 
Streaming Updater. Any chance you could raise the priority?

TASK DETAIL
  https://phabricator.wikimedia.org/T273901

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ottomata, Gehel
Cc: Gehel, Aklapper, JAllemandou, dcausse, Mstyles, Ottomata, MPhamWMF, CBogen, 
Akuckartz, 4748kitoko, holger.knust, Nandana, Namenlos314, Akovalyov, Lahi, 
Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, abian, 
terrrydactyl, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, GWicke, 
Manybubbles, Mbch331, jeremyb
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T275736: Bug: stack traces are shown to the user in WDQS at time-out

2021-03-03 Thread Gehel
Gehel edited projects, added Wikidata Query UI; removed Wikidata-Query-Service.
Gehel added a comment.


  This is definitely something we don't want to implement in the backend 
(blazegraph). As responses are streamed to the client, an exception can occur 
at any point during that stream. This is especially true of timeouts. At that 
point, part of the response is already committed, so it can't be modified. 
There are ways around that limitation (buffering for example), but those are 
expensive at runtime and would significantly increase the complexity of the 
implementation.
  
  This might still be something that could be implemented in the UI itself, but 
that's not my area of expertise, I'll delegate that to @Lydia_Pintscher.

TASK DETAIL
  https://phabricator.wikimedia.org/T275736

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Gehel, Aklapper, Lydia_Pintscher, So9q, MPhamWMF, CBogen, Akuckartz, 
Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, 
Mahir256, QZanden, EBjune, merbst, LawExplorer, Salgo60, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, abian, jkroll, Wikidata-bugs, Jdouglas, aude, 
Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T275196: Add the IDSM/Sachem Wikidata endpoint to the list of federated endpoints

2021-03-03 Thread Gehel
Gehel closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T275196

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Mstyles, Gehel
Cc: Aklapper, Galgonek, MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, 
Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, abian, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T269451: Possible flink optimizations/cleanups

2021-03-03 Thread Gehel
Gehel closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T269451

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Zbyszko, Gehel
Cc: dcausse, Aklapper, MPhamWMF, Alter-paule, Beast1978, CBogen, Un1tY, 
Akuckartz, Hook696, Kent7301, joker88john, CucyNoiD, Nandana, Namenlos314, 
Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, Lewizho99, Maathavan, _jensen, rosalieper, Scott_WUaS, Jonas, 
Xmlizer, abian, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, 
Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T244590: [Epic] Rework the WDQS updater as an event driven application

2021-03-03 Thread Gehel
Gehel closed subtask T269451: Possible flink optimizations/cleanups as 
Resolved.

TASK DETAIL
  https://phabricator.wikimedia.org/T244590

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Daniel_Mietchen, Thadguidry, tfmorris, revi, Ladsgroup, Multichill, 
darthmon_wmde, Iamamz3, Smalyshev, Ottomata, JAllemandou, Aklapper, Zbyszko, 
Gehel, dcausse, MPhamWMF, NavinRizwi, CBogen, Akuckartz, Nandana, Namenlos314, 
Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, abian, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Dinoguy1000, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T275077: wikibase/wdqs:0.3.40 - loadData.sh script cannot parse BNode with unlabeled white space

2021-03-01 Thread Gehel
Gehel closed this task as "Declined".
Gehel added a comment.


  This is the only case we know of blank nodes being written with blank space. 
While this is valid, it's not very much used. If you can modify the dump 
format, that would be an easy workaround. This is definitely a bug in the 
parser library, and you might want to report this upstream.

TASK DETAIL
  https://phabricator.wikimedia.org/T275077

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Gehel, Aklapper, Wagonhelm, MPhamWMF, CBogen, Samantha_Alipio_WMDE, 
Akuckartz, Jelabra, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, Asahiko, abian, despens, jkroll, Wikidata-bugs, 
Jdouglas, aude, Tobias1984, Manybubbles, Addshore, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T274270: WDQS servers taking up to 30 minutes to reboot

2021-03-01 Thread Gehel
Gehel moved this task from Operations to Current work on the 
Wikidata-Query-Service board.
Gehel added a project: Discovery-Search (Current work).

TASK DETAIL
  https://phabricator.wikimedia.org/T274270

WORKBOARD
  https://phabricator.wikimedia.org/project/board/891/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: RKemper, Gehel, Aklapper, MPhamWMF, CBogen, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
abian, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T275782: "Execute Query" button on WDQS not visible for long text query

2021-03-01 Thread Gehel
Gehel edited projects, added Wikidata Query UI; removed Wikidata-Query-Service.

TASK DETAIL
  https://phabricator.wikimedia.org/T275782

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Bouzinac, amy_rc, Lydia_Pintscher, Aklapper, Mohammed_Sadat_WMDE, MPhamWMF, 
CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, Mahir256, QZanden, EBjune, merbst, LawExplorer, Salgo60, 
_jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, abian, jkroll, Wikidata-bugs, 
Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T274751: Upgrade firmware on wdqs1009

2021-02-27 Thread Gehel
Gehel added a comment.


  Note that wdqs1011 had a similar issue today (might not be related at all)

TASK DETAIL
  https://phabricator.wikimedia.org/T274751

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Cmjohnson, Gehel
Cc: Jclark-ctr, RKemper, Cmjohnson, Gehel, MoritzMuehlenhoff, Ramtin0071, 
MPhamWMF, Devnull, lmata, Muchiri124, CBogen, Akuckartz, Legado_Shulgin, 
Nandana, Namenlos314, Davinaclare77, Qtn1293, Techguru.pc, Lahi, Gq86, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, 
merbst, LawExplorer, Zppix, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
Wong128hk, abian, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Southparkfan, faidon, Addshore, Mbch331, Rxy, Jay8g, fgiunchedi
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T264006: Deploy Flink to kubernetes (k8s)

2021-02-24 Thread Gehel
Gehel closed subtask T269619: Create pipelines for late/spurious/failed events 
as Resolved.

TASK DETAIL
  https://phabricator.wikimedia.org/T264006

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: akosiaris, Mstyles, Gehel, Aklapper, MPhamWMF, Alter-paule, Beast1978, 
CBogen, Un1tY, Akuckartz, Hook696, Kent7301, joker88john, CucyNoiD, Nandana, 
Namenlos314, Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, Lewizho99, Maathavan, _jensen, rosalieper, Scott_WUaS, Jonas, 
Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T269619: Create pipelines for late/spurious/failed events

2021-02-24 Thread Gehel
Gehel closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T269619

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse, Gehel
Cc: Ottomata, Aklapper, Gehel, Mstyles, MPhamWMF, CBogen, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T267927: Reload wikidata journal from fresh dumps

2021-02-24 Thread Gehel
Gehel added a subscriber: Zbyszko.
Gehel added a comment.


  Data load on wdqs2008 has resulted (again) in what looks like a corrupted 
journal. This will need to be restarted, but I'll wait on feedback from 
@dcausse / @Zbyszko to see if we have any short term ideas on how to improve 
this.

TASK DETAIL
  https://phabricator.wikimedia.org/T267927

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper, Gehel
Cc: Zbyszko, ayounsi, Gehel, Aklapper, dcausse, MPhamWMF, CBogen, Akuckartz, 
Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, 
QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, 
Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T267927: Reload wikidata journal from fresh dumps

2021-02-24 Thread Gehel
Gehel added a comment.


  loading the dump is completed on wdqs1009, restarting the updater

TASK DETAIL
  https://phabricator.wikimedia.org/T267927

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper, Gehel
Cc: ayounsi, Gehel, Aklapper, dcausse, MPhamWMF, CBogen, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T267927: Reload wikidata journal from fresh dumps

2021-02-24 Thread Gehel
Gehel added a comment.


  In T267927#6855514 <https://phabricator.wikimedia.org/T267927#6855514>, 
@ayounsi wrote:
  
  >> The last Puppet run was at Tue Feb 16 13:22:35 UTC 2021 (11219 minutes 
ago). Puppet is disabled. T267927 <https://phabricator.wikimedia.org/T267927>: 
Reload wikidata jnl from fresh dumps - gehel@cumin2001 - T267927 
<https://phabricator.wikimedia.org/T267927>
  >
  > Because Puppet has been disabled for more than 2 weeks, the host has been 
removed from Puppet, and thus is alerting in the `PhysicalHosts` Netbox report.
  > Is it possible to re-enable Puppet?
  
  Yep, will do.

TASK DETAIL
  https://phabricator.wikimedia.org/T267927

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper, Gehel
Cc: ayounsi, Gehel, Aklapper, dcausse, MPhamWMF, CBogen, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T199219: WDQS should use internal endpoint to communicate to Wikidata

2021-02-24 Thread Gehel
Gehel added a comment.


  In terms of implementation in our new updater, the comment from @BBlack is 
the starting point:
  
  In T199219#4416896 <https://phabricator.wikimedia.org/T199219#4416896>, 
@BBlack wrote:
  
  > For this very particular case, the simplest way would be to do your 
language/platform/library's equivalent of:
  >
  >   curl -H 'Host: www.wikidata.org' 
'https://appservers-ro.discovery.wmnet/wiki/Special:EntityData/Q2408871.ttl?nocache=1530836328152=dump'
  >
  > That is, use the internal service endpoint hostname in the URI for TLS 
connection purposes, but then explicitly set the request `Host` header to 
`www.wikidata.org` for use at the HTTP level.

TASK DETAIL
  https://phabricator.wikimedia.org/T199219

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: dcausse, Ladsgroup, akosiaris, BBlack, Aklapper, Smalyshev, Gehel, 
MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, Jony, Lahi, Gq86, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, Vali.matei, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T274751: Upgrade firmware on wdqs1009

2021-02-23 Thread Gehel
Gehel added a subscriber: RKemper.
Gehel added a comment.


  In T274751#6853205 <https://phabricator.wikimedia.org/T274751#6853205>, 
@Cmjohnson wrote:
  
  > @gehel updating firmware requires rebooting a few times. Let me know if 
this will be okay, if it needs to be a scheduled downtime, Let's plan for 
tomorrow Wednesday at 1400UTC or Thursday  same time
  
  We have a data reload in progress at the moment, I'd prefer not to interrupt 
it (T267927 <https://phabricator.wikimedia.org/T267927>). I'll ping you (or 
@RKemper will) once it's done. This is a test server, so once the data reload 
is done, we can shutdown that server whenever, with no user impact.

TASK DETAIL
  https://phabricator.wikimedia.org/T274751

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Jclark-ctr, Gehel
Cc: RKemper, Cmjohnson, Gehel, MoritzMuehlenhoff, Ramtin0071, MPhamWMF, 
Devnull, lmata, Muchiri124, CBogen, Akuckartz, Legado_Shulgin, Nandana, 
Namenlos314, Davinaclare77, Qtn1293, Techguru.pc, Lahi, Gq86, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, 
merbst, LawExplorer, Zppix, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, 
Southparkfan, faidon, Addshore, Mbch331, Rxy, Jay8g, fgiunchedi
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T216601: Allow download of Wikidata query results in GPS-friendly format(s)

2021-02-23 Thread Gehel
Gehel added a project: Wikidata Query UI.

TASK DETAIL
  https://phabricator.wikimedia.org/T216601

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Gehel, MPhamWMF, Lydia_Pintscher, JeanFred, Nemo_bis, Husky, Peb, Frettie, 
Geertivp, Salgo60, Pigsonthewing, Aklapper, CBogen, Akuckartz, darthmon_wmde, 
Ferenczy, sarhan.alaa, Samuditha24, IM3847, Nandana, Namenlos314, kostajh, 
Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Jayprakash12345, 
Chicocvenancio, MichaelSchoenitzer_WMDE, Mahir256, QZanden, EBjune, merbst, 
LawExplorer, Jogi_don, _jensen, rosalieper, xSavitar, Scott_WUaS, Jonas, 
Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, 
Mbch331, jayantanth, Rxy
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T216601: Allow download of Wikidata query results in GPS-friendly format(s)

2021-02-23 Thread Gehel
Gehel edited projects, added Wikidata Query UI; removed Wikidata-Query-Service.
Gehel added a comment.


  This was discussed by the Search Platform team. Brief summary:
  
  Some of the download formats are managed by Blazegraph directly, via content 
negotiation. This is definitely not something we would like to extend as it 
would increase our reliance on Blazegraph. Having this implemented as part of 
WDQS-UI seems reasonably fine. Even better would be a dedicated service which 
could be reused on other SPARQL endpoint.

TASK DETAIL
  https://phabricator.wikimedia.org/T216601

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Gehel, MPhamWMF, Lydia_Pintscher, JeanFred, Nemo_bis, Husky, Peb, Frettie, 
Geertivp, Salgo60, Pigsonthewing, Aklapper, CBogen, Akuckartz, darthmon_wmde, 
Ferenczy, sarhan.alaa, Samuditha24, IM3847, Nandana, Namenlos314, kostajh, 
Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Jayprakash12345, 
Chicocvenancio, MichaelSchoenitzer_WMDE, Mahir256, QZanden, EBjune, merbst, 
LawExplorer, Jogi_don, _jensen, rosalieper, xSavitar, Scott_WUaS, Jonas, 
Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, 
Mbch331, jayantanth, Rxy
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T216601: Allow download of Wikidata query results in GPS-friendly format(s)

2021-02-23 Thread Gehel
Gehel removed a project: Wikidata-Query-Service.

TASK DETAIL
  https://phabricator.wikimedia.org/T216601

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Gehel, MPhamWMF, Lydia_Pintscher, JeanFred, Nemo_bis, Husky, Peb, Frettie, 
Geertivp, Salgo60, Pigsonthewing, Aklapper, Akuckartz, darthmon_wmde, Ferenczy, 
sarhan.alaa, Samuditha24, IM3847, Nandana, kostajh, Lahi, Gq86, 
GoranSMilovanovic, Jayprakash12345, Chicocvenancio, MichaelSchoenitzer_WMDE, 
QZanden, LawExplorer, Jogi_don, _jensen, rosalieper, xSavitar, Scott_WUaS, 
Wikidata-bugs, aude, Mbch331, jayantanth, Rxy, CBogen, Namenlos314, 
Lucas_Werkmeister_WMDE, EBjune, merbst, Jonas, Xmlizer, jkroll, Jdouglas, 
Tobias1984, Manybubbles
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T216601: Allow download of Wikidata query results in GPS-friendly format(s)

2021-02-23 Thread Gehel
Gehel edited projects, added Wikidata-Query-Service; removed Wikidata Query UI.

TASK DETAIL
  https://phabricator.wikimedia.org/T216601

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Gehel, MPhamWMF, Lydia_Pintscher, JeanFred, Nemo_bis, Husky, Peb, Frettie, 
Geertivp, Salgo60, Pigsonthewing, Aklapper, CBogen, Akuckartz, darthmon_wmde, 
Ferenczy, sarhan.alaa, Samuditha24, IM3847, Nandana, Namenlos314, kostajh, 
Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Jayprakash12345, 
Chicocvenancio, MichaelSchoenitzer_WMDE, QZanden, EBjune, merbst, LawExplorer, 
Jogi_don, _jensen, rosalieper, xSavitar, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331, jayantanth, 
Rxy, Mahir256
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T199219: WDQS should use internal endpoint to communicate to Wikidata

2021-02-22 Thread Gehel
Gehel added a comment.


  In T199219#6836794 <https://phabricator.wikimedia.org/T199219#6836794>, 
@dcausse wrote:
  
  > The new updater is currently running on the analytics network (working on 
getting k8s deployment reading), we could set it up to appservers-ro but I 
think a hole needs to be open between the two networks (see similar issue in 
T274951 <https://phabricator.wikimedia.org/T274951>).
  
  We're moving to production on k8s soon enough, I don't think we should fix 
this on the analytics network.

TASK DETAIL
  https://phabricator.wikimedia.org/T199219

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: dcausse, Ladsgroup, akosiaris, BBlack, Aklapper, Smalyshev, Gehel, 
MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, Jony, Lahi, Gq86, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, Vali.matei, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T275077: wikibase/wdqs:0.3.40 - loadData.sh script cannot parse BNode with unlabeled white space

2021-02-22 Thread Gehel
Gehel added a comment.


  This looks like a bug in the Rio parser (3rd party dependency). We'll need to 
dig a bit more into the code to confirm, but if that's the case, we're probably 
not going to fix it.

TASK DETAIL
  https://phabricator.wikimedia.org/T275077

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Gehel, Aklapper, Wagonhelm, MPhamWMF, CBogen, Samantha_Alipio_WMDE, 
Akuckartz, Jelabra, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, Asahiko, despens, jkroll, Wikidata-bugs, Jdouglas, 
aude, Tobias1984, Manybubbles, Addshore, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T244590: [Epic] Rework the WDQS updater as an event driven application

2021-02-22 Thread Gehel
Gehel added a subtask: T199219: WDQS should use internal endpoint to 
communicate to Wikidata.

TASK DETAIL
  https://phabricator.wikimedia.org/T244590

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Daniel_Mietchen, Thadguidry, tfmorris, revi, Ladsgroup, Multichill, 
darthmon_wmde, Iamamz3, Smalyshev, Ottomata, JAllemandou, Aklapper, Zbyszko, 
Gehel, dcausse, MPhamWMF, NavinRizwi, CBogen, Akuckartz, Nandana, Namenlos314, 
Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Dinoguy1000, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T199219: WDQS should use internal endpoint to communicate to Wikidata

2021-02-22 Thread Gehel
Gehel added a parent task: T244590: [Epic] Rework the WDQS updater as an event 
driven application.

TASK DETAIL
  https://phabricator.wikimedia.org/T199219

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: dcausse, Ladsgroup, akosiaris, BBlack, Aklapper, Smalyshev, Gehel, 
MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, Jony, Lahi, Gq86, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, Vali.matei, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T274788: potential disk issue on wdqs1010

2021-02-19 Thread Gehel
Gehel added a comment.


  scheduled a week of downtime, we're not ready for the data import yet (see 
T267927 <https://phabricator.wikimedia.org/T267927>)

TASK DETAIL
  https://phabricator.wikimedia.org/T274788

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Volans, Gehel, Aklapper, MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, 
Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T274788: potential disk issue on wdqs1010

2021-02-19 Thread Gehel
Gehel added a subscriber: Volans.
Gehel added a comment.


  After discussion with @Volans:
  
  We see no errors at hardware level. Badblocks does find a bad block, but 
going through mdraid creates enough levels of indirections that this might not 
be hardware related. Filesystem is corrupted.
  
  At this point, we can try blaming the error on cosmic rays, reimage to get 
into a sane configuration and hope it does not happen again. There is no 
certainty that this will resolve the issue for good, but it seems a good 
compromise, not spending too much time investigating further at the moment.
  
  Next step: reimage and copy data from another server (note that wdqs2008 is 
running an initial import at the moment).

TASK DETAIL
  https://phabricator.wikimedia.org/T274788

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Volans, Gehel, Aklapper, MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, 
Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T241128: EPIC: Reduce the time needed to do the initial WDQS import

2021-02-19 Thread Gehel
Gehel raised the priority of this task from "Medium" to "High".

TASK DETAIL
  https://phabricator.wikimedia.org/T241128

WORKBOARD
  https://phabricator.wikimedia.org/project/board/891/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Gehel, Addshore, dcausse, Aklapper, MPhamWMF, NavinRizwi, CBogen, 
Akuckartz, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Dinoguy1000, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T244590: [Epic] Rework the WDQS updater as an event driven application

2021-02-18 Thread Gehel
Gehel added a subtask: T275133: Limit query parallelism from Flink based WDQS 
updater to Wikidata.

TASK DETAIL
  https://phabricator.wikimedia.org/T244590

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Daniel_Mietchen, Thadguidry, tfmorris, revi, Ladsgroup, Multichill, 
darthmon_wmde, Iamamz3, Smalyshev, Ottomata, JAllemandou, Aklapper, Zbyszko, 
Gehel, dcausse, MPhamWMF, NavinRizwi, CBogen, Akuckartz, Nandana, Namenlos314, 
Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Dinoguy1000, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T275133: Limit query parallelism from Flink based WDQS updater to Wikidata

2021-02-18 Thread Gehel
Gehel added a parent task: T244590: [Epic] Rework the WDQS updater as an event 
driven application.

TASK DETAIL
  https://phabricator.wikimedia.org/T275133

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Gehel, Aklapper, MPhamWMF, wkandek, JMeybohm, CBogen, Akuckartz, Nandana, 
Namenlos314, jijiki, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, 
QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, 
Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, 
Mbch331, Dzahn
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T275133: Limit query parallelism from Flink based WDQS updater to Wikidata

2021-02-18 Thread Gehel
Gehel created this task.
Gehel added projects: serviceops, Wikidata-Query-Service.
Restricted Application added a subscriber: Aklapper.
Restricted Application added a project: Wikidata.

TASK DESCRIPTION
  As an operator of WDQS, I want to ensure that the Updater isn't overloading 
dependent services by limiting max concurrent requests.
  
  Given the recent incident where the WDQS Flink based streaming updater was 
blocked as it seemed to generate too much traffic, we want to enforce 
appropriate limits on the query parallelism it can generate. The implementation 
is already in place, this is just a matter of finding the appropriate 
configuration. This new updater is a lot more efficient than the current one 
(which is the whole point), so it can potentially generate a lot more load.
  
  As a distributed application, this updater has concurrency limits on each 
node (currently, 12 nodes x 6 thread = 72 concurrent requests max). Note that 
this max number is never reached, each nodes does other things than querying 
Wikidata.
  
  In normal operations, the number of requests is limited by the edit rate on 
Wikidata, and whatever limit we set must be sufficient to support that edit 
rate.
  
  During initial data load, the backlog of edits is consumed as fast as 
possible, limited by whatever concurrency we set. This is where having a 
reasonable limit is necessary.
  
  The current updater duplicates requests to wikidata for each node (18 nodes 
at the moment). The new updater centralises this, so we can expect a 18x 
reduction in queries during normal operation once the new updater is pushed to 
production.
  
  AC:
  
  - parallelism limits are agreed on with Service Ops and configured

TASK DETAIL
  https://phabricator.wikimedia.org/T275133

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Gehel, Aklapper, MPhamWMF, wkandek, JMeybohm, CBogen, Akuckartz, Nandana, 
Namenlos314, jijiki, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, 
QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, 
Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, 
Mbch331, Dzahn
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T274788: potential disk issue on wdqs1010

2021-02-17 Thread Gehel
Gehel added a comment.


  block 65 seems to be bad and kernel is throwing a number of errors similar to:
  
[702641.004691] EXT4-fs error (device dm-2): ext4_map_blocks:614: inode 
#38928414: block 155721773: comm git: lblock 0 mapped to illegal pblock 
155721773 (length 1)
[702641.021024] EXT4-fs warning (device dm-2): htree_dirblock_to_tree:995: 
inode #38928414: lblock 0: comm git: error -117 reading directory block
[704406.562031] EXT4-fs error (device dm-2): ext4_map_blocks:614: inode 
#38993923: block 155722274: comm git: lblock 0 mapped to illegal pblock 
155722274 (length 1)
  
  SMART does not report any errors.
  
  Now let's try to find out which disk is problematic.

TASK DETAIL
  https://phabricator.wikimedia.org/T274788

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Gehel, Aklapper, MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, 
Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T272265: Resolve WDQS changelog situation

2021-02-17 Thread Gehel
Gehel closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T272265

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Mstyles, Gehel
Cc: Gehel, Addshore, Aklapper, Zbyszko, MPhamWMF, CBogen, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T264006: Deploy Flink to kubernetes (k8s)

2021-02-17 Thread Gehel
Gehel closed subtask T267310: Allow job name configuration for Streaming 
Updater as Resolved.

TASK DETAIL
  https://phabricator.wikimedia.org/T264006

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: akosiaris, Mstyles, Gehel, Aklapper, MPhamWMF, Alter-paule, Beast1978, 
CBogen, Un1tY, Akuckartz, Hook696, Kent7301, joker88john, CucyNoiD, Nandana, 
Namenlos314, Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, Lewizho99, Maathavan, _jensen, rosalieper, Scott_WUaS, Jonas, 
Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T267310: Allow job name configuration for Streaming Updater

2021-02-17 Thread Gehel
Gehel closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T267310

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Zbyszko, Gehel
Cc: Aklapper, Zbyszko, MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, 
Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T267825: Outdated data still present in WCQS a month after statement update

2021-02-17 Thread Gehel
Gehel closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T267825

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Zbyszko, Gehel
Cc: Mstyles, CBogen, JeanFred, Aklapper, GFontenelle_WMF, MPhamWMF, FRomeo_WMF, 
Nintendofan885, Akuckartz, Nandana, JKSTNK, Namenlos314, Lahi, PDrouin-WMF, 
Gq86, E1presidente, Ramsey-WMF, Cparle, Anooprao, SandraF_WMF, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, Tramullas, Acer, 
merbst, LawExplorer, Salgo60, Silverfish, _jensen, rosalieper, Scott_WUaS, 
Jonas, Xmlizer, Susannaanas, Jane023, jkroll, Wikidata-bugs, Jdouglas, Base, 
matthiasmullie, aude, Tobias1984, Manybubbles, Ricordisamoa, Wesalius, 
Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T274788: potential disk issue on wdqs1010

2021-02-17 Thread Gehel
Gehel added a comment.


  Running `sudo badblocks -v -o badblocks -w -f /dev/mapper/vg0-srv &> 
badblocks.log` on wdqs1010

TASK DETAIL
  https://phabricator.wikimedia.org/T274788

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Gehel, Aklapper, MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, 
Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T274788: potential disk issue on wdqs1010

2021-02-17 Thread Gehel
Gehel claimed this task.

TASK DETAIL
  https://phabricator.wikimedia.org/T274788

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Gehel, Aklapper, MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, 
Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T274990: Better identify the multiple WDQS updaters via User-Agents

2021-02-17 Thread Gehel
Gehel created this task.
Gehel added a project: Wikidata-Query-Service.
Restricted Application added a subscriber: Aklapper.
Restricted Application added a project: Wikidata.

TASK DESCRIPTION
  As an operator, I want to be able to quickly identify where traffic is coming 
from so that I can react (and potentially block it) with a good understanding 
of the impact.
  
  During a recent appserver overload issue, the new Flink based WDQS updater 
was blocked by shutting down webproxy. During the outage, it wasn't clear that 
only the new updater was blocked and the old one wasn't. The user-agent strings 
are very similar. Having a more descriptive user-agent would allow a better 
understanding of the situation, especially under stress.
  
  AC:
  
  - old and new updaters have user-agent strings that are different enough and 
unambiguous

TASK DETAIL
  https://phabricator.wikimedia.org/T274990

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Aklapper, Gehel, MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, 
Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T274982: Disable fetching constraints from the wdqs updater

2021-02-17 Thread Gehel
Gehel edited projects, added Discovery-Search (Current work); removed 
Wikidata-Query-Service.

TASK DETAIL
  https://phabricator.wikimedia.org/T274982

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: WMDE-leszek, dcausse, Aklapper, MPhamWMF, Alter-paule, Beast1978, CBogen, 
Un1tY, Akuckartz, Hook696, Kent7301, joker88john, CucyNoiD, Nandana, Gaboe420, 
Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, GoranSMilovanovic, 
QZanden, EBjune, LawExplorer, Lewizho99, Maathavan, _jensen, rosalieper, 
Scott_WUaS, Wikidata-bugs, aude, Mbch331, Namenlos314, Lucas_Werkmeister_WMDE, 
merbst, Jonas, Xmlizer, jkroll, Jdouglas, Tobias1984, Manybubbles
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T274984: [Epic] Extract lexemes out of WDQS

2021-02-17 Thread Gehel
Gehel created this task.
Gehel added projects: Wikidata-Query-Service, Epic.
Restricted Application added a subscriber: Aklapper.
Restricted Application added a project: Wikidata.

TASK DESCRIPTION
  As an operator of WDQS, I want ensure that the service can scale and 
accommodate growth due to new projects by extracting lexemes out of WDQS.
  
  As a user of WDQS / Lexemes, I want to have a stable service that can provide 
reliability and performances.
  
  Given the push to increase Lexeme usage 
<https://lists.wikimedia.org/pipermail/wikidata/2021-February/014506.html>, we 
need to be ready to accommodate this growth. Lexemes are a well identified 
subset of Wikdiata (identified by a separate namespace), so it is a good 
candidate to be split out as an independent sub-graph. Spinning up a new 
blazegraph instance seems like a reasonable strategy toward growth.
  
  A few thoughts:
  
  - Since we are increasing the number of query service instances, we need to 
rationalize this approach so that the maintenance burden does not grow linearly 
with the number of instances. This includes identifying and addressing 
opportunities for automation, hardware allocation, etc...
  - Increasing the number of backends will require also increasing the number 
of UI / frontends, or rearchitecture them to support multiple backends from a 
single UI.
  - Updates needs to be split out of the current update flow.

TASK DETAIL
  https://phabricator.wikimedia.org/T274984

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Aklapper, Gehel, MPhamWMF, NavinRizwi, CBogen, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Dinoguy1000, Manybubbles, 
Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T199219: WDQS should use internal endpoint to communicate to Wikidata

2021-02-17 Thread Gehel
Gehel added a comment.


  The new Flink based WDQS updater (T244590 
<https://phabricator.wikimedia.org/T244590>) will mitigate the potential 
caching issues since it will be running centrally and not duplicate the work 
for each WDQS node. Since this is expected to be completed this quarter, it 
make sense to leave the current updater as-is, but ensure we go through the 
proper channels for the new one.

TASK DETAIL
  https://phabricator.wikimedia.org/T199219

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Ladsgroup, akosiaris, BBlack, Aklapper, Smalyshev, Gehel, MPhamWMF, CBogen, 
Akuckartz, Nandana, Namenlos314, Jony, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Vali.matei, _jensen, 
rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, 
Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T199219: WDQS should use internal endpoint to communicate to Wikidata

2021-02-17 Thread Gehel
Gehel raised the priority of this task from "Low" to "High".
Gehel moved this task from Operations to All WDQS-related tasks on the 
Wikidata-Query-Service board.
Gehel added a comment.


  Let's reprioritize this given the recent issues we've seen.

TASK DETAIL
  https://phabricator.wikimedia.org/T199219

WORKBOARD
  https://phabricator.wikimedia.org/project/board/891/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Ladsgroup, akosiaris, BBlack, Aklapper, Smalyshev, Gehel, MPhamWMF, CBogen, 
Akuckartz, Nandana, Namenlos314, Jony, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Vali.matei, _jensen, 
rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, 
Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T274788: potential disk issue on wdqs1010

2021-02-15 Thread Gehel
Gehel set the point value for this task to "2".

TASK DETAIL
  https://phabricator.wikimedia.org/T274788

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Gehel, Aklapper, MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, 
Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T274788: potential disk issue on wdqs1010

2021-02-15 Thread Gehel
Gehel updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T274788

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Gehel, Aklapper, MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, 
Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T274788: potential disk issue on wdqs1010

2021-02-15 Thread Gehel
Gehel moved this task from All WDQS-related tasks to Current work on the 
Wikidata-Query-Service board.
Gehel added a project: Discovery-Search (Current work).

TASK DETAIL
  https://phabricator.wikimedia.org/T274788

WORKBOARD
  https://phabricator.wikimedia.org/project/board/891/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Gehel, Aklapper, MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, 
Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T274270: WDQS servers taking up to 30 minutes to reboot

2021-02-15 Thread Gehel
Gehel triaged this task as "High" priority.
Gehel moved this task from All WDQS-related tasks to Operations on the 
Wikidata-Query-Service board.

TASK DETAIL
  https://phabricator.wikimedia.org/T274270

WORKBOARD
  https://phabricator.wikimedia.org/project/board/891/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: RKemper, Gehel, Aklapper, MPhamWMF, CBogen, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T274249: Offboard wdqs-admins from legacy pager in Icinga

2021-02-15 Thread Gehel
Gehel triaged this task as "High" priority.
Gehel moved this task from All WDQS-related tasks to Operations on the 
Wikidata-Query-Service board.

TASK DETAIL
  https://phabricator.wikimedia.org/T274249

WORKBOARD
  https://phabricator.wikimedia.org/project/board/891/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: fgiunchedi, Gehel, RKemper, Aklapper, MPhamWMF, lmata, CBogen, Akuckartz, 
Nandana, Namenlos314, Lahi, Gq86, herron, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, Chicocvenancio, QZanden, EBjune, merbst, LawExplorer, 
Volans, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, 
Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T274751: Upgrade firmware on wdqs1009

2021-02-15 Thread Gehel
Gehel moved this task from All WDQS-related tasks to Current work on the 
Wikidata-Query-Service board.
Gehel added a project: Discovery-Search (Current work).

TASK DETAIL
  https://phabricator.wikimedia.org/T274751

WORKBOARD
  https://phabricator.wikimedia.org/project/board/891/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Gehel, MoritzMuehlenhoff, Ramtin0071, MPhamWMF, Devnull, lmata, Muchiri124, 
CBogen, Akuckartz, Legado_Shulgin, Nandana, Namenlos314, Davinaclare77, 
Qtn1293, Techguru.pc, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, 
Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, Zppix, _jensen, 
rosalieper, Scott_WUaS, Jonas, Xmlizer, Wong128hk, Cmjohnson, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Southparkfan, faidon, 
Addshore, Mbch331, Rxy, Jay8g, fgiunchedi
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T267927: Reload wikidata journal from fresh dumps

2021-02-15 Thread Gehel
Gehel added a comment.


  data reload started on wdqs2008:
  
gehel@cumin2001:~$ sudo -i cookbook sre.wdqs.data-reload --task-id T267927 
--reload-data wikidata --reason 'T267927: Reload wikidata jnl from fresh dumps' 
wdqs2008.codfw.wmnet --depool --proxy-server http://webproxy.eqiad.wmnet:8080

TASK DETAIL
  https://phabricator.wikimedia.org/T267927

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper, Gehel
Cc: Gehel, Aklapper, dcausse, MPhamWMF, CBogen, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T267927: Reload wikidata journal from fresh dumps

2021-02-15 Thread Gehel
Gehel added a comment.


  Data reload failed on both wdqs1009 and wdqs1010.
  
  wdqs1009: the host crashed, data reload continued manually, starting from 
chunk 407 (`/srv/deployment/wdqs/wdqs/loadData.sh -n wdq -d /srv/wdqs/munged/ 
-s 407`).
  
  wdqs1010: looks like a disk error, investigation will continue on T274788 
<https://phabricator.wikimedia.org/T274788>. In the meantime, data reload will 
be done on wdqs2008 instead.

TASK DETAIL
  https://phabricator.wikimedia.org/T267927

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper, Gehel
Cc: Gehel, Aklapper, dcausse, MPhamWMF, CBogen, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T274788: potential disk issue on wdqs1010

2021-02-15 Thread Gehel
Gehel created this task.
Gehel added a project: Wikidata-Query-Service.
Restricted Application added a subscriber: Aklapper.
Restricted Application added a project: Wikidata.

TASK DESCRIPTION
  Data reload on wdqs1010 (T267927 <https://phabricator.wikimedia.org/T267927>) 
failed with journal corruption, which could look like disk error. SMART data 
does not show and failed IO. More investigation with badblocks (as done in 
T263125 <https://phabricator.wikimedia.org/T263125>) would make sense.

TASK DETAIL
  https://phabricator.wikimedia.org/T274788

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Gehel, Aklapper, MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, 
Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T274751: Upgrade firmware on wdqs1009

2021-02-15 Thread Gehel
Gehel created this task.
Gehel added projects: DC-Ops, ops-eqiad, Wikidata-Query-Service.
Restricted Application added a project: Wikidata.

TASK DESCRIPTION
  wdqs1009 crashed around Feb 13 15:41:01. Syslog and System Event Log don't 
show anything obviously suspicious. @MoritzMuehlenhoff suggested updating the 
firmware, which might resolve the issue and would probably be the first step if 
we need to report this to the vendor.

TASK DETAIL
  https://phabricator.wikimedia.org/T274751

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Gehel, MoritzMuehlenhoff, MPhamWMF, CBogen, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
Cmjohnson, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, 
Southparkfan, Mbch331, Jay8g, fgiunchedi
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T254232: New clusters for SPARQL Endpoint for Commons

2021-02-12 Thread Gehel
Gehel added a subtask: Unknown Object (Task).

TASK DETAIL
  https://phabricator.wikimedia.org/T254232

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: EBernhardson, dcausse, RKemper, akosiaris, Addshore, Aklapper, Gehel, 
MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T254232: New clusters for SPARQL Endpoint for Commons

2021-02-11 Thread Gehel
Gehel updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T254232

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: EBernhardson, dcausse, RKemper, akosiaris, Addshore, Aklapper, Gehel, 
MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


  1   2   3   4   5   6   7   8   9   10   >