[Wikidata-bugs] [Maniphest] T346456: Improve concurrency limits configuration of the wdqs updater

2023-12-08 Thread Gehel 
Gehel closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T346456

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse, Gehel
Cc: Aklapper, bking, Clement_Goubert, dcausse, Danny_Benjafield_WMDE, 
Kappakayala, Astuthiodit_1, AWesterinen, Arnoldokoth, karapayneWMDE, Invadibot, 
maantietaja, wkandek, JMeybohm, ItamarWMDE, Akuckartz, Nandana, Namenlos314, 
jijiki, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, 
merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T346456: Improve concurrency limits configuration of the wdqs updater

2023-11-10 Thread Maintenance_bot 
Maintenance_bot removed a project: Patch-For-Review.

TASK DETAIL
  https://phabricator.wikimedia.org/T346456

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse, Maintenance_bot
Cc: Aklapper, bking, Clement_Goubert, dcausse, Danny_Benjafield_WMDE, 
Kappakayala, Astuthiodit_1, AWesterinen, Arnoldokoth, karapayneWMDE, Invadibot, 
maantietaja, wkandek, JMeybohm, ItamarWMDE, Akuckartz, Nandana, Namenlos314, 
jijiki, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, 
merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331, 
Isabelladantes1983, Themindcoder, Adamm71, Jersione, Hellket777, LisafBia6531, 
786, Biggs657, Juan90264, Alter-paule, Beast1978, Un1tY, Hook696, Kent7301, 
joker88john, CucyNoiD, Gaboe420, Giuliamocci, Cpaulf30, Af420, Bsandipan, 
Lewizho99, Maathavan, Neuronton
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T346456: Improve concurrency limits configuration of the wdqs updater

2023-11-10 Thread gerritbot 
gerritbot added a comment.


  Change 961138 **abandoned** by DCausse:
  
  [wikidata/query/deploy@master] flink: simplify parallelism setup
  
  Reason:
  
  hopefully won't be needed as we move away from this deployment process
  
  https://gerrit.wikimedia.org/r/961138

TASK DETAIL
  https://phabricator.wikimedia.org/T346456

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse, gerritbot
Cc: Aklapper, bking, Clement_Goubert, dcausse, Danny_Benjafield_WMDE, 
Isabelladantes1983, Themindcoder, Kappakayala, Adamm71, Jersione, Hellket777, 
LisafBia6531, Astuthiodit_1, AWesterinen, 786, Arnoldokoth, Biggs657, 
karapayneWMDE, Invadibot, maantietaja, Juan90264, wkandek, JMeybohm, 
Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, Hook696, Kent7301, 
joker88john, CucyNoiD, Nandana, Namenlos314, jijiki, Gaboe420, Giuliamocci, 
Cpaulf30, Lahi, Gq86, Af420, Bsandipan, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, 
_jensen, rosalieper, Neuronton, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T346456: Improve concurrency limits configuration of the wdqs updater

2023-11-07 Thread gerritbot 
gerritbot added a comment.


  Change 961024 **abandoned** by DCausse:
  
  [operations/deployment-charts@master] rdf-streaming-updater: simplify 
parallelism configuration
  
  Reason:
  
  superseded by Id9a9ec3873f1eebfdc53a97218cef417dcc2e8bd
  
  https://gerrit.wikimedia.org/r/961024

TASK DETAIL
  https://phabricator.wikimedia.org/T346456

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse, gerritbot
Cc: Aklapper, bking, Clement_Goubert, dcausse, Danny_Benjafield_WMDE, 
Isabelladantes1983, Themindcoder, Kappakayala, Adamm71, Jersione, Hellket777, 
LisafBia6531, Astuthiodit_1, AWesterinen, 786, Arnoldokoth, Biggs657, 
karapayneWMDE, Invadibot, maantietaja, Juan90264, wkandek, JMeybohm, 
Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, Hook696, Kent7301, 
joker88john, CucyNoiD, Nandana, Namenlos314, jijiki, Gaboe420, Giuliamocci, 
Cpaulf30, Lahi, Gq86, Af420, Bsandipan, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, 
_jensen, rosalieper, Neuronton, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T346456: Improve concurrency limits configuration of the wdqs updater

2023-11-03 Thread gerritbot 
gerritbot added a comment.


  Change 961020 **merged** by Bking:
  
  [operations/alerts@master] search: simplify flink parallelism configuration
  
  https://gerrit.wikimedia.org/r/961020

TASK DETAIL
  https://phabricator.wikimedia.org/T346456

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse, gerritbot
Cc: Aklapper, bking, Clement_Goubert, dcausse, Danny_Benjafield_WMDE, 
Isabelladantes1983, Themindcoder, Kappakayala, Adamm71, Jersione, Hellket777, 
LisafBia6531, Astuthiodit_1, AWesterinen, 786, Arnoldokoth, Biggs657, 
karapayneWMDE, Invadibot, maantietaja, Juan90264, wkandek, JMeybohm, 
Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, Hook696, Kent7301, 
joker88john, CucyNoiD, Nandana, Namenlos314, jijiki, Gaboe420, Giuliamocci, 
Cpaulf30, Lahi, Gq86, Af420, Bsandipan, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, 
_jensen, rosalieper, Neuronton, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T346456: Improve concurrency limits configuration of the wdqs updater

2023-10-27 Thread bking 
bking removed a parent task: T326409: Migrate the wdqs streaming updater flink 
jobs to flink-k8s-operator deployment model.

TASK DETAIL
  https://phabricator.wikimedia.org/T346456

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse, bking
Cc: Aklapper, bking, Clement_Goubert, dcausse, Danny_Benjafield_WMDE, 
Isabelladantes1983, Themindcoder, Kappakayala, Adamm71, Jersione, Hellket777, 
LisafBia6531, Astuthiodit_1, AWesterinen, 786, Arnoldokoth, Biggs657, 
karapayneWMDE, Invadibot, maantietaja, Juan90264, wkandek, JMeybohm, 
Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, Hook696, Kent7301, 
joker88john, CucyNoiD, Nandana, Namenlos314, jijiki, Gaboe420, Giuliamocci, 
Cpaulf30, Lahi, Gq86, Af420, Bsandipan, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, 
_jensen, rosalieper, Neuronton, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T346456: Improve concurrency limits configuration of the wdqs updater

2023-10-27 Thread bking 
bking added a parent task: T326409: Migrate the wdqs streaming updater flink 
jobs to flink-k8s-operator deployment model.

TASK DETAIL
  https://phabricator.wikimedia.org/T346456

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse, bking
Cc: Aklapper, bking, Clement_Goubert, dcausse, Danny_Benjafield_WMDE, 
Isabelladantes1983, Themindcoder, Kappakayala, Adamm71, Jersione, Hellket777, 
LisafBia6531, Astuthiodit_1, AWesterinen, 786, Arnoldokoth, Biggs657, 
karapayneWMDE, Invadibot, maantietaja, Juan90264, wkandek, JMeybohm, 
Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, Hook696, Kent7301, 
joker88john, CucyNoiD, Nandana, Namenlos314, jijiki, Gaboe420, Giuliamocci, 
Cpaulf30, Lahi, Gq86, Af420, Bsandipan, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, 
_jensen, rosalieper, Neuronton, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T346456: Improve concurrency limits configuration of the wdqs updater

2023-10-03 Thread gerritbot 
gerritbot added a comment.


  Change 963105 **merged** by Bking:
  
  [operations/deployment-charts@master] rdf-streaming-updater: simplify 
parallelism and use newer kafka APIs
  
  https://gerrit.wikimedia.org/r/963105

TASK DETAIL
  https://phabricator.wikimedia.org/T346456

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse, gerritbot
Cc: Aklapper, bking, Clement_Goubert, dcausse, Danny_Benjafield_WMDE, 
Isabelladantes1983, Themindcoder, Kappakayala, Adamm71, Jersione, Hellket777, 
LisafBia6531, Astuthiodit_1, AWesterinen, 786, Arnoldokoth, Biggs657, 
karapayneWMDE, Invadibot, maantietaja, Juan90264, wkandek, JMeybohm, 
Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, Hook696, Kent7301, 
joker88john, CucyNoiD, Nandana, Namenlos314, jijiki, Gaboe420, Giuliamocci, 
Cpaulf30, Lahi, Gq86, Af420, Bsandipan, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, 
_jensen, rosalieper, Neuronton, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T346456: Improve concurrency limits configuration of the wdqs updater

2023-10-03 Thread gerritbot 
gerritbot added a comment.


  Change 963105 had a related patch set uploaded (by DCausse; author: DCausse):
  
  [operations/deployment-charts@master] rdf-streaming-updater: simplify 
parallelism and use newer kafka APIs
  
  https://gerrit.wikimedia.org/r/963105

TASK DETAIL
  https://phabricator.wikimedia.org/T346456

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse, gerritbot
Cc: Aklapper, bking, Clement_Goubert, dcausse, Danny_Benjafield_WMDE, 
Isabelladantes1983, Themindcoder, Kappakayala, Adamm71, Jersione, Hellket777, 
LisafBia6531, Astuthiodit_1, AWesterinen, 786, Arnoldokoth, Biggs657, 
karapayneWMDE, Invadibot, maantietaja, Juan90264, wkandek, JMeybohm, 
Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, Hook696, Kent7301, 
joker88john, CucyNoiD, Nandana, Namenlos314, jijiki, Gaboe420, Giuliamocci, 
Cpaulf30, Lahi, Gq86, Af420, Bsandipan, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, 
_jensen, rosalieper, Neuronton, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T346456: Improve concurrency limits configuration of the wdqs updater

2023-09-26 Thread gerritbot 
gerritbot added a comment.


  Change 961138 had a related patch set uploaded (by DCausse; author: DCausse):
  
  [wikidata/query/deploy@master] flink: simplify parallelism setup
  
  https://gerrit.wikimedia.org/r/961138

TASK DETAIL
  https://phabricator.wikimedia.org/T346456

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse, gerritbot
Cc: Aklapper, bking, Clement_Goubert, dcausse, Danny_Benjafield_WMDE, 
Isabelladantes1983, Themindcoder, Kappakayala, Adamm71, Jersione, Hellket777, 
LisafBia6531, Astuthiodit_1, AWesterinen, 786, Arnoldokoth, Biggs657, 
karapayneWMDE, Invadibot, maantietaja, Juan90264, wkandek, JMeybohm, 
Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, Hook696, Kent7301, 
joker88john, CucyNoiD, Nandana, Namenlos314, jijiki, Gaboe420, Giuliamocci, 
Cpaulf30, Lahi, Gq86, Af420, Bsandipan, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, 
_jensen, rosalieper, Neuronton, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T346456: Improve concurrency limits configuration of the wdqs updater

2023-09-26 Thread gerritbot 
gerritbot added a comment.


  Change 960554 **merged** by jenkins-bot:
  
  [wikidata/query/rdf@master] Add mediawiki_max_concurrent_requests
  
  https://gerrit.wikimedia.org/r/960554

TASK DETAIL
  https://phabricator.wikimedia.org/T346456

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse, gerritbot
Cc: Aklapper, bking, Clement_Goubert, dcausse, Danny_Benjafield_WMDE, 
Isabelladantes1983, Themindcoder, Kappakayala, Adamm71, Jersione, Hellket777, 
LisafBia6531, Astuthiodit_1, AWesterinen, 786, Arnoldokoth, Biggs657, 
karapayneWMDE, Invadibot, maantietaja, Juan90264, wkandek, JMeybohm, 
Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, Hook696, Kent7301, 
joker88john, CucyNoiD, Nandana, Namenlos314, jijiki, Gaboe420, Giuliamocci, 
Cpaulf30, Lahi, Gq86, Af420, Bsandipan, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, 
_jensen, rosalieper, Neuronton, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T346456: Improve concurrency limits configuration of the wdqs updater

2023-09-26 Thread gerritbot 
gerritbot added a comment.


  Change 961024 had a related patch set uploaded (by DCausse; author: DCausse):
  
  [operations/deployment-charts@master] rdf-streaming-updater: simplify 
parallelism configuration
  
  https://gerrit.wikimedia.org/r/961024

TASK DETAIL
  https://phabricator.wikimedia.org/T346456

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse, gerritbot
Cc: Aklapper, bking, Clement_Goubert, dcausse, Danny_Benjafield_WMDE, 
Isabelladantes1983, Themindcoder, Kappakayala, Adamm71, Jersione, Hellket777, 
LisafBia6531, Astuthiodit_1, AWesterinen, 786, Arnoldokoth, Biggs657, 
karapayneWMDE, Invadibot, maantietaja, Juan90264, wkandek, JMeybohm, 
Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, Hook696, Kent7301, 
joker88john, CucyNoiD, Nandana, Namenlos314, jijiki, Gaboe420, Giuliamocci, 
Cpaulf30, Lahi, Gq86, Af420, Bsandipan, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, 
_jensen, rosalieper, Neuronton, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T346456: Improve concurrency limits configuration of the wdqs updater

2023-09-26 Thread gerritbot 
gerritbot added a comment.


  Change 961020 had a related patch set uploaded (by DCausse; author: DCausse):
  
  [operations/alerts@master] search: simplify flink parallelism configuration
  
  https://gerrit.wikimedia.org/r/961020

TASK DETAIL
  https://phabricator.wikimedia.org/T346456

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse, gerritbot
Cc: Aklapper, bking, Clement_Goubert, dcausse, Danny_Benjafield_WMDE, 
Isabelladantes1983, Themindcoder, Kappakayala, Adamm71, Jersione, Hellket777, 
LisafBia6531, Astuthiodit_1, AWesterinen, 786, Arnoldokoth, Biggs657, 
karapayneWMDE, Invadibot, maantietaja, Juan90264, wkandek, JMeybohm, 
Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, Hook696, Kent7301, 
joker88john, CucyNoiD, Nandana, Namenlos314, jijiki, Gaboe420, Giuliamocci, 
Cpaulf30, Lahi, Gq86, Af420, Bsandipan, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, 
_jensen, rosalieper, Neuronton, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T346456: Improve concurrency limits configuration of the wdqs updater

2023-09-25 Thread gerritbot 
gerritbot added a project: Patch-For-Review.

TASK DETAIL
  https://phabricator.wikimedia.org/T346456

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse, gerritbot
Cc: Aklapper, bking, Clement_Goubert, dcausse, Danny_Benjafield_WMDE, 
Isabelladantes1983, Themindcoder, Kappakayala, Adamm71, Jersione, Hellket777, 
LisafBia6531, Astuthiodit_1, AWesterinen, 786, Arnoldokoth, Biggs657, 
karapayneWMDE, Invadibot, maantietaja, Juan90264, wkandek, JMeybohm, 
Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, Hook696, Kent7301, 
joker88john, CucyNoiD, Nandana, Namenlos314, jijiki, Gaboe420, Giuliamocci, 
Cpaulf30, Lahi, Gq86, Af420, Bsandipan, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, 
_jensen, rosalieper, Neuronton, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T346456: Improve concurrency limits configuration of the wdqs updater

2023-09-25 Thread gerritbot 
gerritbot added a comment.


  Change 960554 had a related patch set uploaded (by DCausse; author: DCausse):
  
  [wikidata/query/rdf@master] Add mediawiki_max_concurrent_requests
  
  https://gerrit.wikimedia.org/r/960554

TASK DETAIL
  https://phabricator.wikimedia.org/T346456

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse, gerritbot
Cc: Aklapper, bking, Clement_Goubert, dcausse, Danny_Benjafield_WMDE, 
Kappakayala, Astuthiodit_1, AWesterinen, Arnoldokoth, karapayneWMDE, Invadibot, 
maantietaja, wkandek, JMeybohm, ItamarWMDE, Akuckartz, Nandana, Namenlos314, 
jijiki, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, 
merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T346456: Improve concurrency limits configuration of the wdqs updater

2023-09-25 Thread Maintenance_bot 
Maintenance_bot removed a project: Patch-For-Review.

TASK DETAIL
  https://phabricator.wikimedia.org/T346456

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse, Maintenance_bot
Cc: Aklapper, bking, Clement_Goubert, dcausse, Danny_Benjafield_WMDE, 
Kappakayala, Astuthiodit_1, AWesterinen, Arnoldokoth, karapayneWMDE, Invadibot, 
maantietaja, wkandek, JMeybohm, ItamarWMDE, Akuckartz, Nandana, Namenlos314, 
jijiki, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, 
merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331, 
Isabelladantes1983, Themindcoder, Adamm71, Jersione, Hellket777, LisafBia6531, 
786, Biggs657, Juan90264, Alter-paule, Beast1978, Un1tY, Hook696, Kent7301, 
joker88john, CucyNoiD, Gaboe420, Giuliamocci, Cpaulf30, Af420, Bsandipan, 
Lewizho99, Maathavan, Neuronton
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T346456: Improve concurrency limits configuration of the wdqs updater

2023-09-25 Thread gerritbot 
gerritbot added a comment.


  Change 960097 **abandoned** by DCausse:
  
  [wikidata/query/rdf@master] [WIP] Rework how concurrency limits are configured
  
  Reason:
  
  will restore if actually needed
  
  https://gerrit.wikimedia.org/r/960097

TASK DETAIL
  https://phabricator.wikimedia.org/T346456

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse, gerritbot
Cc: Aklapper, bking, Clement_Goubert, dcausse, Danny_Benjafield_WMDE, 
Isabelladantes1983, Themindcoder, Kappakayala, Adamm71, Jersione, Hellket777, 
LisafBia6531, Astuthiodit_1, AWesterinen, 786, Arnoldokoth, Biggs657, 
karapayneWMDE, Invadibot, maantietaja, Juan90264, wkandek, JMeybohm, 
Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, Hook696, Kent7301, 
joker88john, CucyNoiD, Nandana, Namenlos314, jijiki, Gaboe420, Giuliamocci, 
Cpaulf30, Lahi, Gq86, Af420, Bsandipan, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, 
_jensen, rosalieper, Neuronton, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T346456: Improve concurrency limits configuration of the wdqs updater

2023-09-22 Thread gerritbot 
gerritbot added a project: Patch-For-Review.

TASK DETAIL
  https://phabricator.wikimedia.org/T346456

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse, gerritbot
Cc: Aklapper, bking, Clement_Goubert, dcausse, Danny_Benjafield_WMDE, 
Isabelladantes1983, Themindcoder, Kappakayala, Adamm71, Jersione, Hellket777, 
LisafBia6531, Astuthiodit_1, AWesterinen, 786, Arnoldokoth, Biggs657, 
karapayneWMDE, Invadibot, maantietaja, Juan90264, wkandek, JMeybohm, 
Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, Hook696, Kent7301, 
joker88john, CucyNoiD, Nandana, Namenlos314, jijiki, Gaboe420, Giuliamocci, 
Cpaulf30, Lahi, Gq86, Af420, Bsandipan, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, 
_jensen, rosalieper, Neuronton, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T346456: Improve concurrency limits configuration of the wdqs updater

2023-09-22 Thread gerritbot 
gerritbot added a comment.


  Change 960097 had a related patch set uploaded (by DCausse; author: DCausse):
  
  [wikidata/query/rdf@master] Rework how concurrency limits are configured
  
  https://gerrit.wikimedia.org/r/960097

TASK DETAIL
  https://phabricator.wikimedia.org/T346456

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse, gerritbot
Cc: Aklapper, bking, Clement_Goubert, dcausse, Danny_Benjafield_WMDE, 
Kappakayala, Astuthiodit_1, AWesterinen, Arnoldokoth, karapayneWMDE, Invadibot, 
maantietaja, wkandek, JMeybohm, ItamarWMDE, Akuckartz, Nandana, Namenlos314, 
jijiki, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, 
merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T346456: Improve concurrency limits configuration of the wdqs updater

2023-09-20 Thread Gehel 
Gehel removed a parent task: T342149: Test common operations in the flink 
operator/k8s/Flink ZK environment.

TASK DETAIL
  https://phabricator.wikimedia.org/T346456

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse, Gehel
Cc: Aklapper, bking, Clement_Goubert, dcausse, Danny_Benjafield_WMDE, 
Kappakayala, Astuthiodit_1, AWesterinen, Arnoldokoth, karapayneWMDE, Invadibot, 
maantietaja, wkandek, JMeybohm, ItamarWMDE, Akuckartz, Nandana, Namenlos314, 
jijiki, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, 
merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T346456: Improve concurrency limits configuration of the wdqs updater

2023-09-20 Thread dcausse 
dcausse claimed this task.
dcausse moved this task from Ready for Dev -- SWE to In Progress on the 
Discovery-Search (Current work) board.

TASK DETAIL
  https://phabricator.wikimedia.org/T346456

WORKBOARD
  https://phabricator.wikimedia.org/project/board/1227/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse
Cc: Aklapper, bking, Clement_Goubert, dcausse, Danny_Benjafield_WMDE, 
Kappakayala, Astuthiodit_1, AWesterinen, Arnoldokoth, karapayneWMDE, Invadibot, 
maantietaja, wkandek, JMeybohm, ItamarWMDE, Akuckartz, Nandana, Namenlos314, 
jijiki, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, 
merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T346456: Improve concurrency limits configuration of the wdqs updater

2023-09-18 Thread EBernhardson 
EBernhardson set the point value for this task to "3".

TASK DETAIL
  https://phabricator.wikimedia.org/T346456

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: EBernhardson
Cc: Aklapper, bking, Clement_Goubert, dcausse, Danny_Benjafield_WMDE, 
Kappakayala, Astuthiodit_1, AWesterinen, Arnoldokoth, karapayneWMDE, Invadibot, 
maantietaja, wkandek, JMeybohm, ItamarWMDE, Akuckartz, Nandana, Namenlos314, 
jijiki, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, 
merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T346456: Improve concurrency limits configuration of the wdqs updater

2023-09-18 Thread TJones 
TJones moved this task from needs triage to Current work on the 
Discovery-Search board.
TJones edited projects, added Discovery-Search (Current work); removed 
Discovery-Search.

TASK DETAIL
  https://phabricator.wikimedia.org/T346456

WORKBOARD
  https://phabricator.wikimedia.org/project/board/1849/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: TJones
Cc: Aklapper, bking, Clement_Goubert, dcausse, Danny_Benjafield_WMDE, 
Kappakayala, Astuthiodit_1, AWesterinen, Arnoldokoth, karapayneWMDE, Invadibot, 
maantietaja, wkandek, JMeybohm, ItamarWMDE, Akuckartz, Nandana, Namenlos314, 
jijiki, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, 
merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T346456: Improve concurrency limits configuration of the wdqs updater

2023-09-18 Thread EBernhardson 
EBernhardson added a project: Discovery-Search.

TASK DETAIL
  https://phabricator.wikimedia.org/T346456

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: EBernhardson
Cc: Aklapper, bking, Clement_Goubert, dcausse, Danny_Benjafield_WMDE, 
Kappakayala, Astuthiodit_1, AWesterinen, Arnoldokoth, karapayneWMDE, Invadibot, 
maantietaja, wkandek, JMeybohm, ItamarWMDE, Akuckartz, Nandana, Namenlos314, 
jijiki, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, 
merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T346456: Improve concurrency limits configuration of the wdqs updater

2023-09-18 Thread Maintenance_bot 
Maintenance_bot added a project: Wikidata.
Restricted Application added a project: wdwb-tech.

TASK DETAIL
  https://phabricator.wikimedia.org/T346456

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Maintenance_bot
Cc: Aklapper, bking, Clement_Goubert, dcausse, Danny_Benjafield_WMDE, 
Kappakayala, Astuthiodit_1, AWesterinen, Arnoldokoth, karapayneWMDE, Invadibot, 
maantietaja, wkandek, JMeybohm, ItamarWMDE, Akuckartz, Nandana, Namenlos314, 
jijiki, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, 
merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T346456: Improve concurrency limits configuration of the wdqs updater

2023-09-15 Thread bking 
bking added a parent task: T342149: Test common operations in the flink 
operator/k8s/Flink ZK environment.

TASK DETAIL
  https://phabricator.wikimedia.org/T346456

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: bking
Cc: Aklapper, bking, Clement_Goubert, dcausse, Kappakayala, AWesterinen, 
Arnoldokoth, wkandek, JMeybohm, Namenlos314, jijiki, Gq86, 
Lucas_Werkmeister_WMDE, EBjune, merbst, Jonas, Xmlizer, jkroll, Wikidata-bugs, 
Jdouglas, aude, Tobias1984, Manybubbles
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T346456: Improve concurrency limits configuration of the wdqs updater

2023-09-15 Thread dcausse 
dcausse updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T346456

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse
Cc: Aklapper, bking, Clement_Goubert, dcausse, Kappakayala, AWesterinen, 
Arnoldokoth, wkandek, JMeybohm, Namenlos314, jijiki, Gq86, 
Lucas_Werkmeister_WMDE, EBjune, merbst, Jonas, Xmlizer, jkroll, Wikidata-bugs, 
Jdouglas, aude, Tobias1984, Manybubbles
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T346456: Improve concurrency limits configuration of the wdqs updater

2023-09-15 Thread dcausse 
dcausse created this task.
dcausse added projects: Wikidata-Query-Service, serviceops.
Restricted Application added a subscriber: Aklapper.

TASK DESCRIPTION
  The WDQS updater have several config options to reduce the concurrency at 
which it calls the MW api.
  
  The config option `wikibase_repo_thread_pool_size` controls the size of the 
thread pool running HTTP requests.
  
  During a test of this application with zookeeper and the flink-k8s-operator 
we had to backfill around 2weeks of updates and this cause a massive load on 
the mw-api-int cluster.
  
  We lowered this value from 30 to 5 expecting to see a 1/6 fold reduction but 
this reduction was no near this, we barely saw the impact suggesting that the 
current limits are already too high and the system is limited by the endpoint 
capacity not by itself.
  
  Looking a the code this limits is imposed on the HTTP thread pool that is 
attached to a job task, given that we run at a parallelism of 12 this means 
that the actual number of concurrent requests is `parallelism * 
wikibase_repo_thread_pool_size`.
  
  So we went from `30*12=360` to `5*12=60`.
  
  We should definitely change how this is configured to take the flink 
parallelism into account.
  
  AC:
  
  - the updater should have a single option to control the MW requests 
concurrency
  - we should probably not run the AsyncOp over all the 12 tasks

TASK DETAIL
  https://phabricator.wikimedia.org/T346456

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse
Cc: Aklapper, bking, Clement_Goubert, dcausse, Kappakayala, AWesterinen, 
Arnoldokoth, wkandek, JMeybohm, Namenlos314, jijiki, Gq86, 
Lucas_Werkmeister_WMDE, EBjune, merbst, Jonas, Xmlizer, jkroll, Wikidata-bugs, 
Jdouglas, aude, Tobias1984, Manybubbles
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org