[Wikidata-bugs] [Maniphest] [Commented On] T174422: Make dbBatchSize in WikiPageUpdater configurable

2017-09-20 Thread gerritbot
gerritbot added a comment. Change 378228 merged by jenkins-bot: [mediawiki/extensions/Wikibase@master] Clean up unused code, comments and docs in WikiPageUpdaterTest https://gerrit.wikimedia.org/r/378228TASK DETAILhttps://phabricator.wikimedia.org/T174422EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T174422: Make dbBatchSize in WikiPageUpdater configurable

2017-09-20 Thread gerritbot
gerritbot added a comment. Change 377046 merged by jenkins-bot: [mediawiki/extensions/Wikibase@master] Allow batch sizes for different jobs to be defined separately. https://gerrit.wikimedia.org/r/377046TASK DETAILhttps://phabricator.wikimedia.org/T174422EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T174422: Make dbBatchSize in WikiPageUpdater configurable

2017-09-15 Thread gerritbot
gerritbot added a comment. Change 378228 had a related patch set uploaded (by Thiemo Mättig (WMDE); owner: Thiemo Mättig (WMDE)): [mediawiki/extensions/Wikibase@master] Clean up unused code, comments and docs in WikiPageUpdaterTest https://gerrit.wikimedia.org/r/378228TASK

[Wikidata-bugs] [Maniphest] [Commented On] T174422: Make dbBatchSize in WikiPageUpdater configurable

2017-09-12 Thread daniel
daniel added a comment. Afaics, this task as described in the summary is complete, so this ticket can be closed. Or shall we keep it open to discuss more fine grained configuration, as per my proposal above?TASK DETAILhttps://phabricator.wikimedia.org/T174422EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T174422: Make dbBatchSize in WikiPageUpdater configurable

2017-09-12 Thread daniel
daniel added a comment. As per https://gerrit.wikimedia.org/r/#/c/377458/, WikiPageUpdaterDbBatchSize is now set to 20. That's probably still to high for RefreshLinksJob, and way low for UpdateHtmlCacheJob and InjectRCRecordsJob.TASK DETAILhttps://phabricator.wikimedia.org/T174422EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T174422: Make dbBatchSize in WikiPageUpdater configurable

2017-09-12 Thread gerritbot
gerritbot added a comment. Change 377046 had a related patch set uploaded (by Daniel Kinzler; owner: Daniel Kinzler): [mediawiki/extensions/Wikibase@master] Allow batch sizes for different jobs to be defined separately. https://gerrit.wikimedia.org/r/377046TASK

[Wikidata-bugs] [Maniphest] [Commented On] T174422: Make dbBatchSize in WikiPageUpdater configurable

2017-09-12 Thread daniel
daniel added a comment. The batch size is already configurable, that was deployed a few weeks go. The relevant setting is WikiPageUpdaterDbBatchSize. This seems to be insufficient though, since WikiPageUpdater triggers three kinds of jobs with very different batch size. For this reason, I made

[Wikidata-bugs] [Maniphest] [Commented On] T174422: Make dbBatchSize in WikiPageUpdater configurable

2017-08-30 Thread aaron
aaron added a comment. In T174422#3566350, @Krinkle wrote: @Ladsgroup @aaron Would $wgUpdateRowsPerQuery be appropiate here, too? Or is it important for this particular query to use a different batch size? Most of the pure waiting in the job will be for replication (the throttling just makes

[Wikidata-bugs] [Maniphest] [Commented On] T174422: Make dbBatchSize in WikiPageUpdater configurable

2017-08-30 Thread Krinkle
Krinkle added a comment. @Ladsgroup @aaron Would $wgUpdateRowsPerQuery be appropiate here, too? Or is it important for this particular query to use a different batch size?TASK DETAILhttps://phabricator.wikimedia.org/T174422EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T174422: Make dbBatchSize in WikiPageUpdater configurable

2017-08-29 Thread gerritbot
gerritbot added a comment. Change 374505 merged by jenkins-bot: [mediawiki/extensions/Wikibase@master] Make dbBatchSize in WikiPageUpdater configurable https://gerrit.wikimedia.org/r/374505TASK DETAILhttps://phabricator.wikimedia.org/T174422EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T174422: Make dbBatchSize in WikiPageUpdater configurable

2017-08-29 Thread gerritbot
gerritbot added a comment. Change 374505 had a related patch set uploaded (by AnotherLadsgroup; owner: Amir Sarabadani): [mediawiki/extensions/Wikibase@master] Make dbBatchSize in WikiPageUpdater configurable https://gerrit.wikimedia.org/r/374505TASK