ArielGlenn added a comment.
Doing some initial testing on beta. as the dumpsgen user from snapshot01.
For one output file with one shard:
php /srv/mediawiki/multiversion/MWScript.php
extensions/Wikibase/repo/maintenance/dumpRdf.php --wiki commonswiki --shard 1
--sharding-factor 2 --batch-size 70000 --format ttl --flavor full-dump
--entity-type mediainfo --no-cache --dbgroupdefault dump --part-id '1-2' 1
70000 2>> /var/lib/dumpsgen/mediainfo-dumps-log-ttl.txt | gzip >
/mnt/dumpsdata/xmldatadumps/temp/mediainfo-dumps-test-ttl.gz
php /srv/mediawiki/multiversion/MWScript.php
extensions/Wikibase/repo/maintenance/dumpRdf.php --wiki commonswiki --shard 1
--sharding-factor 2 --batch-size 70000 --format nt --flavor full-dump
--entity-type mediainfo --no-cache --dbgroupdefault dump --part-id '1-2' 1
70000 2>> /var/lib/dumpsgen/mediainfo-dumps-log-nt.txt | gzip >
/mnt/dumpsdata/xmldatadumps/temp/mediainfo-dumps-test-nt.gz
TASK DETAIL
https://phabricator.wikimedia.org/T239905
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: ArielGlenn
Cc: Smalyshev, hoo, ArielGlenn, WMDE-leszek, Aklapper, Lydia_Pintscher,
Ramsey-WMF, Addshore, Tpt, Lucas_Werkmeister_WMDE, Jdforrester-WMF, Multichill,
Gehel, Cparle, darthmon_wmde, Nandana, JKSTNK, Lahi, PDrouin-WMF, Gq86,
E1presidente, Anooprao, SandraF_WMF, GoranSMilovanovic, Lunewa, QZanden,
EBjune, Tramullas, Acer, merbst, LawExplorer, Salgo60, Silverfish, Poyekhali,
_jensen, rosalieper, Taiwania_Justo, Scott_WUaS, Jonas, Xmlizer, Susannaanas,
Ixocactus, Wong128hk, gnosygnu, Jane023, jkroll, Wikidata-bugs, Jdouglas, Base,
matthiasmullie, aude, Tobias1984, El_Grafo, Dinoguy1000, Manybubbles,
Ricordisamoa, Wesalius, Fabrice_Florin, Raymond, Steinsplitter, Mbch331, Keegan
_______________________________________________
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
