[Wikidata-bugs] [Maniphest] [Commented On] T245144: Increase Retry-After header for Wikidata

2020-03-10 Thread Dvorapa
Dvorapa added a comment. > start and stop brutally and make the lag oscillating Yes, but in my opinion this behavior is not much polite and ethical to servers too. And to me it seems it is also dishonest to other bots in an indirect way: Bots rush-saving edits in a rate like 1 per second

[Wikidata-bugs] [Maniphest] [Commented On] T245144: Increase Retry-After header for Wikidata

2020-03-10 Thread Bugreporter
Bugreporter added a comment. Even if bots are using pt:0, they will still follow maxlag (unless also set maxlag=0). This may cause some problem (start and stop brutally and make the lag oscillating), though will not break the server. Even if you use the default put throttle (10, or even long

[Wikidata-bugs] [Maniphest] [Commented On] T245144: Increase Retry-After header for Wikidata

2020-03-10 Thread Dvorapa
Dvorapa added a comment. In T245144#5955788 , @Bugreporter wrote: > Note as I said in T243701#5884926 , some bots runs with put_throttle=1 or 0. **They should not do it continuousl

[Wikidata-bugs] [Maniphest] [Commented On] T245144: Increase Retry-After header for Wikidata

2020-03-10 Thread Bugreporter
Bugreporter added a comment. Note as I said in T243701#5884926 , some bots runs with put_throttle=1 or 0. TASK DETAIL https://phabricator.wikimedia.org/T245144 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpref

[Wikidata-bugs] [Maniphest] [Commented On] T245144: Increase Retry-After header for Wikidata

2020-03-10 Thread Xqt
Xqt added a comment. In T245144#5886173 , @Urbanecm wrote: > On the other hand, when I imagine a Retry-After change, the bots (complying with https://www.mediawiki.org/wiki/Manual:Maxlag_parameter, includes PWB) sleep for longer time, g

[Wikidata-bugs] [Maniphest] [Commented On] T245144: Increase Retry-After header for Wikidata

2020-02-26 Thread Ladsgroup
Ladsgroup added a comment. In T245144#5885952 , @Multichill wrote: > This is one of those bugs where you should just lookup the relevant chapter in a book like http://barbie.uta.edu/~jli/Resources/MapReduce&Hadoop/Distributed%20Systems%

[Wikidata-bugs] [Maniphest] [Commented On] T245144: Increase Retry-After header for Wikidata

2020-02-15 Thread Dvorapa
Dvorapa added a comment. In T245144#5884781 , @Ladsgroup wrote: > We need something to slow down the bots before they reach to the threshold of maxlag and would have to back off. Totally agree! TASK DETAIL https://phabricator.wik

[Wikidata-bugs] [Maniphest] [Commented On] T245144: Increase Retry-After header for Wikidata

2020-02-14 Thread Urbanecm
Urbanecm added a comment. In T245144#5884781 , @Ladsgroup wrote: > I have been thinking about this. Originally I thought it would help but the more I think I feel it would be very similar to the increasing factor. The oscillation will b