ArielGlenn has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/399589 )
Change subject: enable pagelogs to be dumped by several processes in parallel
......................................................................
enable pagelogs to be dumped by several processes in parallel
Bug: T181935
Change-Id: Ib89de0b72aaa0fe73534bb318b54efcd50414192
---
M modules/snapshot/manifests/dumps/configs.pp
1 file changed, 6 insertions(+), 2 deletions(-)
Approvals:
ArielGlenn: Looks good to me, approved
jenkins-bot: Verified
diff --git a/modules/snapshot/manifests/dumps/configs.pp
b/modules/snapshot/manifests/dumps/configs.pp
index 9140a54..bd510ec 100644
--- a/modules/snapshot/manifests/dumps/configs.pp
+++ b/modules/snapshot/manifests/dumps/configs.pp
@@ -28,6 +28,7 @@
keep => '8',
chunksEnabled => '1',
chunksForAbstract => '4',
+ chunksForPagelogs => '4',
checkpointTime => '720',
recombineHistory => '0',
revsPerJob => '1500000',
@@ -89,10 +90,11 @@
en => {
dblist => "${dblistsdir}/enwiki.dblist",
skipdblist => "${dblistsdir}/skipnone.dblist",
- jobsperbatch => 'xmlstubsdump=9,abstractsdump=9',
+ jobsperbatch =>
'xmlstubsdump=9,abstractsdump=9,xmlpagelogsdump=9',
keep => '7',
chunksEnabled => '1',
chunksForAbstract => '27',
+ chunksForPagelogs => '27',
recombineHistory => '0',
checkpointTime => '720',
revsPerJob => '1500000',
@@ -109,10 +111,11 @@
wd => {
dblist => "${dblistsdir}/wikidatawiki.dblist",
skipdblist => "${dblistsdir}/skipnone.dblist",
- jobsperbatch => 'xmlstubsdump=9,abstractsdump=9',
+ jobsperbatch =>
'xmlstubsdump=9,abstractsdump=9,xmlpagelogsdump=9',
keep => '7',
chunksEnabled => '1',
chunksForAbstract => '27',
+ chunksForPagelogs => '27',
recombineHistory => '0',
checkpointTime => '720',
revsPerJob => '1500000',
@@ -138,6 +141,7 @@
}
# for xml/sql dumps running on dumpsdata host
+ # as well as misc dumps via various cron jobs
snapshot::dumps::wikiconf { 'wikidump.conf.dumps':
configtype => 'allwikis',
config => $config,
--
To view, visit https://gerrit.wikimedia.org/r/399589
To unsubscribe, visit https://gerrit.wikimedia.org/r/settings
Gerrit-MessageType: merged
Gerrit-Change-Id: Ib89de0b72aaa0fe73534bb318b54efcd50414192
Gerrit-PatchSet: 2
Gerrit-Project: operations/puppet
Gerrit-Branch: production
Gerrit-Owner: ArielGlenn <[email protected]>
Gerrit-Reviewer: ArielGlenn <[email protected]>
Gerrit-Reviewer: jenkins-bot <>
_______________________________________________
MediaWiki-commits mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
