[Pywikipedia-bugs] [Maniphest] [Commented On] T123885: Create a Python Pywikibot script to download Wikimedia database dump
gerritbot added a comment. Change 399179 merged by jenkins-bot: [pywikibot/core@master] Create a maintenance script to download Wikimedia database dump https://gerrit.wikimedia.org/r/399179TASK DETAILhttps://phabricator.wikimedia.org/T123885EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, eflyjason, binbot, zhuyifei1999, Framawiki, pywikibot-bugs-list, jayvdb, Rubin16, Aklapper, Beta16, Cpaulf30, Bright1055, Baloch007, Darkminds3113, Toppole69, Lordiis, Adik2382, Mine0901, Jayprakash12345, Th3d3v1ls, Ramalepe, Liugev6, Magul, Tbscho, MayS, Beeyan, Lewizho99, Mdupont, JJMC89, Maathavan, MtDu, D3r1ck01, Avicennasis, Dalba, Masti, Alchimista, Rxy___ pywikibot-bugs mailing list pywikibot-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs
[Pywikipedia-bugs] [Maniphest] [Commented On] T123885: Create a Python Pywikibot script to download Wikimedia database dump
gerritbot added a comment. Change 399179 had a related patch set uploaded (by Eflyjason; owner: Eflyjason): [pywikibot/core@master] Create a Python Pywikibot script to download Wikimedia database dump https://gerrit.wikimedia.org/r/399179TASK DETAILhttps://phabricator.wikimedia.org/T123885EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, eflyjason, binbot, zhuyifei1999, Framawiki, pywikibot-bugs-list, jayvdb, Rubin16, Aklapper, Beta16, Bright1055, Toppole69, Mine0901, Jayprakash12345, Magul, Tbscho, MayS, Beeyan, Mdupont, JJMC89, MtDu, D3r1ck01, Avicennasis, Dalba, Masti, Alchimista, Rxy___ pywikibot-bugs mailing list pywikibot-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs
[Pywikipedia-bugs] [Maniphest] [Commented On] T123885: Create a Python Pywikibot script to download Wikimedia database dump
zhuyifei1999 added a comment. This should also, if found to be on toolforge, use dumps from the already-mounted dumps directory rather than downloading another copy from dumps.wm.o.TASK DETAILhttps://phabricator.wikimedia.org/T123885EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: zhuyifei1999Cc: eflyjason, binbot, zhuyifei1999, Framawiki, pywikibot-bugs-list, jayvdb, Rubin16, Aklapper, Beta16, Bright1055, Toppole69, Mine0901, Jayprakash12345, Magul, Tbscho, MayS, Beeyan, Mdupont, JJMC89, MtDu, D3r1ck01, Avicennasis, Dalba, Masti, Alchimista, Rxy___ pywikibot-bugs mailing list pywikibot-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs
[Pywikipedia-bugs] [Maniphest] [Commented On] T123885: Create a Python Pywikibot script to download Wikimedia database dump
eflyjason added a comment. Is this script something like https://github.com/WikiTeam/wikiteam/blob/master/wikipediadownloader.py? Also, does "choose what file they want by providing the filename" mean that user will have to provide argument like "frwiki-latest-abstract.xml"? And does user have to provide a "predicable directory" in argument? I wrote a related script. Unfortunately it is hardcoded for Hungarian Wikipedia and therefore it has a lot of Hungarian text (as I didn't think at that time, that it would be useful for others). https://hu.wikipedia.org/wiki/Szerkeszt%C5%91:BinBot/frissdump.py This script does not download the dump, but refreshes a template with the date. Users interested in dump watch this template. So the first part of the task is solved: to watch the new version. It needs cron timing. Somebody may find it useful. So the script will download a new (updated) file from http://dumps.wikimedia.org/ once a while and replace the old downloaded one, right? Sorry for so many questions . I'm new to this.TASK DETAILhttps://phabricator.wikimedia.org/T123885EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: eflyjasonCc: eflyjason, binbot, zhuyifei1999, Framawiki, pywikibot-bugs-list, jayvdb, Rubin16, Aklapper, Beta16, Bright1055, Toppole69, Mine0901, Jayprakash12345, Magul, Tbscho, MayS, Beeyan, Mdupont, JJMC89, MtDu, D3r1ck01, Avicennasis, Dalba, Masti, Alchimista, Rxy___ pywikibot-bugs mailing list pywikibot-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs
[Pywikipedia-bugs] [Maniphest] [Commented On] T123885: Create a Python Pywikibot script to download Wikimedia database dump
Framawiki added a comment. Thanks, it can be useful to parse the site.TASK DETAILhttps://phabricator.wikimedia.org/T123885EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: FramawikiCc: binbot, zhuyifei1999, Framawiki, pywikibot-bugs-list, jayvdb, Rubin16, Aklapper, Beta16, Bright1055, Toppole69, Mine0901, Jayprakash12345, Magul, Tbscho, MayS, Beeyan, Mdupont, JJMC89, MtDu, D3r1ck01, Avicennasis, Dalba, Masti, Alchimista, Rxy___ pywikibot-bugs mailing list pywikibot-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs
[Pywikipedia-bugs] [Maniphest] [Commented On] T123885: Create a Python Pywikibot script to download Wikimedia database dump
binbot added a comment. I wote a related script. Unfortunately it is hardcoded for Hungarian Wikipedia and therefore it has a lot of Hungarian text (as I didn't think at that time, that it would be useful for others). https://hu.wikipedia.org/wiki/Szerkeszt%C5%91:BinBot/frissdump.py This script does not download the dump, but refreshes a template with the date. Users interested in dump watch this template. So the first part of the task is solved: to watch the new version. It needs cron timing. Somebody may find it useful.TASK DETAILhttps://phabricator.wikimedia.org/T123885EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: binbotCc: binbot, zhuyifei1999, Framawiki, pywikibot-bugs-list, jayvdb, Rubin16, Aklapper, Beta16, Bright1055, Toppole69, Mine0901, Jayprakash12345, Magul, Tbscho, MayS, Beeyan, Mdupont, JJMC89, MtDu, D3r1ck01, Avicennasis, Dalba, Masti, Alchimista, Rxy___ pywikibot-bugs mailing list pywikibot-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs
