[Wikidata-bugs] [Maniphest] T243701: Wikidata maxlag repeatedly over 5s since Jan 20, 2020 (primarily caused by the query service)

2020-10-21 Thread Lydia_Pintscher
Lydia_Pintscher closed this task as "Resolved".
Lydia_Pintscher claimed this task.
Lydia_Pintscher added a comment.


  Yeah let's call this resolved. Additional work is ongoing around improving 
the updater of the query service that will further improve the situation.

TASK DETAIL
  https://phabricator.wikimedia.org/T243701

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lydia_Pintscher
Cc: Huji, BeatEstermann, Ciell, tfmorris, Multichill, Majavah, PeterBowman, 
matej_suchanek, Masti, THE_IT, Jony, Lydia_Pintscher, Vojtech.dostal, 
William_Avery, valhallasw, SilentSpike, Bugreporter, Demian, Legoktm, Aschroet, 
ArielGlenn, Ladsgroup, JeanFred, Pasleim, Gehel, Lea_Lacroix_WMDE, 
ArthurPSmith, Albertvillanovadelmoral, Xqt, Lucas_Werkmeister_WMDE, Addshore, 
jcrespo, Dvorapa, Aklapper, Strainu, lmata, CBogen, Akuckartz, darthmon_wmde, 
ET4Eva, Legado_Shulgin, Nandana, Namenlos314, Davinaclare77, Qtn1293, 
Techguru.pc, Lahi, Gq86, Darkminds3113, GoranSMilovanovic, Th3d3v1ls, Hfbn0, 
QZanden, EBjune, merbst, LawExplorer, Vali.matei, Avner, Zppix, _jensen, 
rosalieper, Scott_WUaS, Jonas, FloNight, Xmlizer, Volker_E, Wong128hk, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, GWicke, Dinoguy1000, Manybubbles, 
faidon, Mbch331, Rxy, Jay8g, fgiunchedi
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T243701: Wikidata maxlag repeatedly over 5s since Jan 20, 2020 (primarily caused by the query service)

2020-10-21 Thread Ladsgroup
Ladsgroup added a comment.


  @Lydia_Pintscher with the T258354: remove noratelimit from bot group for 
Wikidata  being done, Can this be 
called done now?

TASK DETAIL
  https://phabricator.wikimedia.org/T243701

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ladsgroup
Cc: Huji, BeatEstermann, Ciell, tfmorris, Multichill, Majavah, PeterBowman, 
matej_suchanek, Masti, THE_IT, Jony, Lydia_Pintscher, Vojtech.dostal, 
William_Avery, valhallasw, SilentSpike, Bugreporter, Demian, Legoktm, Aschroet, 
ArielGlenn, Ladsgroup, JeanFred, Pasleim, Gehel, Lea_Lacroix_WMDE, 
ArthurPSmith, Albertvillanovadelmoral, Xqt, Lucas_Werkmeister_WMDE, Addshore, 
jcrespo, Dvorapa, Aklapper, Strainu, lmata, CBogen, Akuckartz, darthmon_wmde, 
ET4Eva, Legado_Shulgin, Nandana, Namenlos314, Davinaclare77, Qtn1293, 
Techguru.pc, Lahi, Gq86, Darkminds3113, GoranSMilovanovic, Th3d3v1ls, Hfbn0, 
QZanden, EBjune, merbst, LawExplorer, Vali.matei, Avner, Zppix, _jensen, 
rosalieper, Scott_WUaS, Jonas, FloNight, Xmlizer, Volker_E, Wong128hk, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, GWicke, Dinoguy1000, Manybubbles, 
faidon, Mbch331, Rxy, Jay8g, fgiunchedi
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T243701: Wikidata maxlag repeatedly over 5s since Jan 20, 2020 (primarily caused by the query service)

2020-10-20 Thread Huji
Huji added a comment.


  It seems like since 8/25, WD maxlag has rarely approached 5 seconds (graph 
)
 which is substantially better than before.

TASK DETAIL
  https://phabricator.wikimedia.org/T243701

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Huji
Cc: Huji, BeatEstermann, Ciell, tfmorris, Multichill, Majavah, PeterBowman, 
matej_suchanek, Masti, THE_IT, Jony, Lydia_Pintscher, Vojtech.dostal, 
William_Avery, valhallasw, SilentSpike, Bugreporter, Demian, Legoktm, Aschroet, 
ArielGlenn, Ladsgroup, JeanFred, Pasleim, Gehel, Lea_Lacroix_WMDE, 
ArthurPSmith, Albertvillanovadelmoral, Xqt, Lucas_Werkmeister_WMDE, Addshore, 
jcrespo, Dvorapa, Aklapper, Strainu, lmata, CBogen, Akuckartz, darthmon_wmde, 
ET4Eva, Legado_Shulgin, Nandana, Namenlos314, Davinaclare77, Qtn1293, 
Techguru.pc, Lahi, Gq86, Darkminds3113, GoranSMilovanovic, Th3d3v1ls, Hfbn0, 
QZanden, EBjune, merbst, LawExplorer, Vali.matei, Avner, Zppix, _jensen, 
rosalieper, Scott_WUaS, Jonas, FloNight, Xmlizer, Volker_E, Wong128hk, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, GWicke, Dinoguy1000, Manybubbles, 
faidon, Mbch331, Rxy, Jay8g, fgiunchedi
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T243701: Wikidata maxlag repeatedly over 5s since Jan 20, 2020 (primarily caused by the query service)

2020-08-22 Thread BeatEstermann
BeatEstermann added a comment.


  Same problem here. Using Open Refine to edit Wikidata didn't work today when 
I tried to do a small ingest of 5 items (2 existing, 3 new).
  
  Copying the code generated in Open Refine to QuickStatements 1 worked for the 
addition of claims to the 2 existing items; but created dozens of new items 
without statements for the 3 new items. - I have no idea whether this latter 
issue is related in any way to this ticket.

TASK DETAIL
  https://phabricator.wikimedia.org/T243701

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: BeatEstermann
Cc: BeatEstermann, Ciell, Pintoch, tfmorris, Multichill, Majavah, PeterBowman, 
matej_suchanek, Masti, THE_IT, Jony, Lydia_Pintscher, Vojtech.dostal, 
William_Avery, valhallasw, SilentSpike, Bugreporter, Demian, Legoktm, Aschroet, 
ArielGlenn, Ladsgroup, Alicia_Fagerving_WMSE, JeanFred, Pasleim, Gehel, 
Lea_Lacroix_WMDE, ArthurPSmith, Albertvillanovadelmoral, Xqt, 
Lucas_Werkmeister_WMDE, Addshore, jcrespo, Dvorapa, Aklapper, Strainu, lmata, 
CBogen, Akuckartz, darthmon_wmde, ET4Eva, Legado_Shulgin, Nandana, Namenlos314, 
Davinaclare77, Qtn1293, Techguru.pc, Lahi, Gq86, Darkminds3113, 
GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, 
Vali.matei, Avner, Zppix, _jensen, rosalieper, Scott_WUaS, Jonas, FloNight, 
Xmlizer, Volker_E, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, 
Tobias1984, GWicke, Dinoguy1000, Manybubbles, faidon, Mbch331, Rxy, Jay8g, 
fgiunchedi
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T243701: Wikidata maxlag repeatedly over 5s since Jan 20, 2020 (primarily caused by the query service)

2020-08-02 Thread Ciell
Ciell added subscribers: Pintoch, Ciell.
Ciell added a comment.


  I haven't been able to do any edits through Open Refine, and in 
https://phabricator.wikimedia.org/T255344 it was mentioned it could be due to 
the server lag.
  
  I haven't uploaded this way before and am therefore trying a test-set with 
just 20 item that need to be newly created. I have restarted Open Refine 
several times yesterday evening and today during the day again. It just keeps 
0% for 1-2 hours, after which I decide to shut down the upload.
  
  According to @Pintoch it is not a problem with OR, and I am logged in to 
Wikidata. 
  Looking for a solution, he directed me here.
  
  Are there some tips you could give me?

TASK DETAIL
  https://phabricator.wikimedia.org/T243701

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ciell
Cc: Ciell, Pintoch, tfmorris, Multichill, Majavah, PeterBowman, matej_suchanek, 
Masti, THE_IT, Jony, Lydia_Pintscher, Vojtech.dostal, William_Avery, 
valhallasw, SilentSpike, Bugreporter, Demian, Legoktm, Aschroet, ArielGlenn, 
Ladsgroup, Alicia_Fagerving_WMSE, JeanFred, Pasleim, Gehel, Lea_Lacroix_WMDE, 
ArthurPSmith, Albertvillanovadelmoral, Xqt, Lucas_Werkmeister_WMDE, Addshore, 
jcrespo, Dvorapa, Aklapper, Strainu, lmata, CBogen, Akuckartz, darthmon_wmde, 
ET4Eva, Legado_Shulgin, Nandana, Namenlos314, Davinaclare77, Qtn1293, 
Techguru.pc, Lahi, Gq86, Darkminds3113, GoranSMilovanovic, Th3d3v1ls, Hfbn0, 
QZanden, EBjune, merbst, LawExplorer, Vali.matei, Avner, Zppix, _jensen, 
rosalieper, Scott_WUaS, Jonas, FloNight, Xmlizer, Volker_E, Wong128hk, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, GWicke, Dinoguy1000, Manybubbles, 
faidon, Mbch331, Rxy, Jay8g, fgiunchedi
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T243701: Wikidata maxlag repeatedly over 5s since Jan 20, 2020 (primarily caused by the query service)

2020-07-21 Thread ArthurPSmith
ArthurPSmith added a comment.


  Something seems to be going on very recently that's a different pattern - did 
something change on the infrastructure side, or is there a change in usage 
pattern for the last few hours? Basically maxlag (WDQS lag specifically) has 
NOT gone below 5 (5 minutes for WDQS) for more than 1 hour. This hasn't 
happened, as far as I can tell, for many days, perhaps weeks or months. 
Typically maxlag recovers when bots stop editing after about 20-30 minutes, 
sometimes it takes almost an hour, but this is the longest delay in a long 
time. Specifically around 2020-07-21 14:04 the lag went over 5, and as of 15:18 
it's grown to over 16.

TASK DETAIL
  https://phabricator.wikimedia.org/T243701

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: ArthurPSmith
Cc: tfmorris, Multichill, Majavah, PeterBowman, matej_suchanek, Masti, THE_IT, 
Jony, Lydia_Pintscher, Vojtech.dostal, William_Avery, valhallasw, SilentSpike, 
Bugreporter, Demian, Legoktm, Aschroet, ArielGlenn, Ladsgroup, 
Alicia_Fagerving_WMSE, JeanFred, Pasleim, Gehel, Lea_Lacroix_WMDE, 
ArthurPSmith, Albertvillanovadelmoral, Xqt, Lucas_Werkmeister_WMDE, Addshore, 
jcrespo, Dvorapa, Aklapper, Strainu, lmata, CBogen, Akuckartz, darthmon_wmde, 
ET4Eva, Legado_Shulgin, Nandana, Namenlos314, Davinaclare77, Qtn1293, 
Techguru.pc, Lahi, Gq86, Darkminds3113, GoranSMilovanovic, Th3d3v1ls, Hfbn0, 
QZanden, EBjune, merbst, LawExplorer, Vali.matei, Avner, Zppix, _jensen, 
rosalieper, Scott_WUaS, Jonas, FloNight, Xmlizer, Volker_E, Wong128hk, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, GWicke, Dinoguy1000, Manybubbles, 
faidon, Mbch331, Rxy, Jay8g, fgiunchedi
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T243701: Wikidata maxlag repeatedly over 5s since Jan 20, 2020 (primarily caused by the query service)

2020-07-20 Thread Ladsgroup
Ladsgroup added a comment.


  I, in my volunteer capacity and out of frustration, requested bot flag of two 
bots that each edited 50K in the past 12 hours (= 2 per second) to be revoked. 
That would fix the issue here. Out of interest of anyone who wants to 
participate: 
https://www.wikidata.org/wiki/Wikidata:Administrators%27_noticeboard#Request_to_revoke_bot_flags_of_Edoderoobot_and_LargeDatasetBot

TASK DETAIL
  https://phabricator.wikimedia.org/T243701

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ladsgroup
Cc: tfmorris, Multichill, Majavah, PeterBowman, matej_suchanek, Masti, THE_IT, 
Jony, Lydia_Pintscher, Vojtech.dostal, William_Avery, valhallasw, SilentSpike, 
Bugreporter, Demian, Legoktm, Aschroet, ArielGlenn, Ladsgroup, 
Alicia_Fagerving_WMSE, JeanFred, Pasleim, Gehel, Lea_Lacroix_WMDE, 
ArthurPSmith, Albertvillanovadelmoral, Xqt, Lucas_Werkmeister_WMDE, Addshore, 
jcrespo, Dvorapa, Aklapper, Strainu, lmata, CBogen, Akuckartz, darthmon_wmde, 
ET4Eva, Legado_Shulgin, Nandana, Namenlos314, Davinaclare77, Qtn1293, 
Techguru.pc, Lahi, Gq86, Darkminds3113, GoranSMilovanovic, Th3d3v1ls, Hfbn0, 
QZanden, EBjune, merbst, LawExplorer, Vali.matei, Avner, Zppix, _jensen, 
rosalieper, Scott_WUaS, Jonas, FloNight, Xmlizer, Volker_E, Wong128hk, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, GWicke, Dinoguy1000, Manybubbles, 
faidon, Mbch331, Rxy, Jay8g, fgiunchedi
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs