| rafidaslam created this task. rafidaslam added projects: Pywikibot-core, Pywikibot-Other-scripts. Herald added subscribers: pywikibot-bugs-list, Aklapper. |
TASK DESCRIPTION
In https://github.com/wikimedia/pywikibot/blob/master/scripts/maintenance/download_dump.py#L72
def get_dump_name(self, db_name, typ):
"""Check if dump file exists locally in a Toolforge server."""
db_path = '/public/dumps/public/{0}/'.format(db_name)
if os.path.isdir(db_path):
dates = map(int, os.listdir(db_path))
dates = sorted(dates, reverse=True)
for date in dates:
dump_filepath = ('/public/dumps/public/{0}/{1}/{2}-{3}-{4}'
.format(db_name, date, db_name, date, typ))
if os.path.isfile(dump_filepath):
return dump_filepath
return NoneThere's a call to map function which converts list of directories (which are string) into integer list, but that code will raise an exception if there's a 'non-number' string in the directory name, for example latest.
In toolforge there's one directory which named latest:
rafid@tools-bastion-03:~$ find /public/dumps/public/ -name 'latest' /public/dumps/public/de_labswikimedia/latest rafid@tools-bastion-03:~$ ls -l /public/dumps/public/de_labswikimedia/latest total 128 ---------- 1 root root 0 Aug 22 2014 de_labswikimedia-latest-abstract.xml -rw-r--r-- 1 root root 652 Mar 3 2013 de_labswikimedia-latest-abstract.xml-rss.xml ---------- 1 root root 0 Aug 22 2014 de_labswikimedia-latest-all-titles-in-ns0.gz -rw-r--r-- 1 root root 676 Mar 3 2013 de_labswikimedia-latest-all-titles-in-ns0.gz-rss.xml ---------- 1 root root 0 Aug 22 2014 de_labswikimedia-latest-categorylinks.sql.gz -rw-r--r-- 1 root root 676 Mar 3 2013 de_labswikimedia-latest-categorylinks.sql.gz-rss.xml ---------- 1 root root 0 Aug 22 2014 de_labswikimedia-latest-category.sql.gz -rw-r--r-- 1 root root 661 Mar 3 2013 de_labswikimedia-latest-category.sql.gz-rss.xml ---------- 1 root root 0 Aug 22 2014 de_labswikimedia-latest-externallinks.sql.gz -rw-r--r-- 1 root root 676 Mar 3 2013 de_labswikimedia-latest-externallinks.sql.gz-rss.xml ---------- 1 root root 0 Aug 22 2014 de_labswikimedia-latest-flaggedpages.sql.gz -rw-r--r-- 1 root root 673 Mar 3 2013 de_labswikimedia-latest-flaggedpages.sql.gz-rss.xml ---------- 1 root root 0 Aug 22 2014 de_labswikimedia-latest-flaggedrevs.sql.gz -rw-r--r-- 1 root root 670 Mar 3 2013 de_labswikimedia-latest-flaggedrevs.sql.gz-rss.xml ---------- 1 root root 0 Aug 22 2014 de_labswikimedia-latest-imagelinks.sql.gz -rw-r--r-- 1 root root 667 Mar 3 2013 de_labswikimedia-latest-imagelinks.sql.gz-rss.xml ---------- 1 root root 0 Aug 22 2014 de_labswikimedia-latest-image.sql.gz -rw-r--r-- 1 root root 652 Mar 3 2013 de_labswikimedia-latest-image.sql.gz-rss.xml ---------- 1 root root 0 Aug 22 2014 de_labswikimedia-latest-interwiki.sql.gz -rw-r--r-- 1 root root 664 Mar 3 2013 de_labswikimedia-latest-interwiki.sql.gz-rss.xml ---------- 1 root root 0 Aug 22 2014 de_labswikimedia-latest-iwlinks.sql.gz -rw-r--r-- 1 root root 658 Mar 3 2013 de_labswikimedia-latest-iwlinks.sql.gz-rss.xml ---------- 1 root root 0 Aug 22 2014 de_labswikimedia-latest-langlinks.sql.gz -rw-r--r-- 1 root root 664 Mar 3 2013 de_labswikimedia-latest-langlinks.sql.gz-rss.xml ---------- 1 root root 0 Aug 22 2014 de_labswikimedia-latest-md5sums.txt ---------- 1 root root 0 Aug 22 2014 de_labswikimedia-latest-oldimage.sql.gz -rw-r--r-- 1 root root 661 Mar 3 2013 de_labswikimedia-latest-oldimage.sql.gz-rss.xml ---------- 1 root root 0 Aug 22 2014 de_labswikimedia-latest-pagelinks.sql.gz -rw-r--r-- 1 root root 664 Mar 3 2013 de_labswikimedia-latest-pagelinks.sql.gz-rss.xml ---------- 1 root root 0 Aug 22 2014 de_labswikimedia-latest-page_props.sql.gz -rw-r--r-- 1 root root 667 Mar 3 2013 de_labswikimedia-latest-page_props.sql.gz-rss.xml ---------- 1 root root 0 Aug 22 2014 de_labswikimedia-latest-page_restrictions.sql.gz -rw-r--r-- 1 root root 688 Mar 3 2013 de_labswikimedia-latest-page_restrictions.sql.gz-rss.xml ---------- 1 root root 0 Aug 22 2014 de_labswikimedia-latest-pages-articles-multistream-index.txt.bz2 -rw-r--r-- 1 root root 736 Mar 3 2013 de_labswikimedia-latest-pages-articles-multistream-index.txt.bz2-rss.xml ---------- 1 root root 0 Aug 22 2014 de_labswikimedia-latest-pages-articles-multistream.xml.bz2 -rw-r--r-- 1 root root 718 Mar 3 2013 de_labswikimedia-latest-pages-articles-multistream.xml.bz2-rss.xml ---------- 1 root root 0 Aug 22 2014 de_labswikimedia-latest-pages-articles.xml.bz2 -rw-r--r-- 1 root root 682 Mar 3 2013 de_labswikimedia-latest-pages-articles.xml.bz2-rss.xml ---------- 1 root root 0 Aug 22 2014 de_labswikimedia-latest-pages-logging.xml.gz -rw-r--r-- 1 root root 676 Mar 3 2013 de_labswikimedia-latest-pages-logging.xml.gz-rss.xml ---------- 1 root root 0 Aug 22 2014 de_labswikimedia-latest-pages-meta-current.xml.bz2 -rw-r--r-- 1 root root 694 Mar 3 2013 de_labswikimedia-latest-pages-meta-current.xml.bz2-rss.xml ---------- 1 root root 0 Aug 22 2014 de_labswikimedia-latest-pages-meta-history.xml.7z -rw-r--r-- 1 root root 691 Mar 3 2013 de_labswikimedia-latest-pages-meta-history.xml.7z-rss.xml ---------- 1 root root 0 Aug 22 2014 de_labswikimedia-latest-pages-meta-history.xml.bz2 -rw-r--r-- 1 root root 694 Mar 3 2013 de_labswikimedia-latest-pages-meta-history.xml.bz2-rss.xml ---------- 1 root root 0 Aug 22 2014 de_labswikimedia-latest-page.sql.gz -rw-r--r-- 1 root root 649 Mar 3 2013 de_labswikimedia-latest-page.sql.gz-rss.xml ---------- 1 root root 0 Aug 22 2014 de_labswikimedia-latest-protected_titles.sql.gz -rw-r--r-- 1 root root 685 Mar 3 2013 de_labswikimedia-latest-protected_titles.sql.gz-rss.xml ---------- 1 root root 0 Aug 22 2014 de_labswikimedia-latest-redirect.sql.gz -rw-r--r-- 1 root root 661 Mar 3 2013 de_labswikimedia-latest-redirect.sql.gz-rss.xml ---------- 1 root root 0 Aug 22 2014 de_labswikimedia-latest-site_stats.sql.gz -rw-r--r-- 1 root root 667 Mar 3 2013 de_labswikimedia-latest-site_stats.sql.gz-rss.xml ---------- 1 root root 0 Aug 22 2014 de_labswikimedia-latest-stub-articles.xml.gz -rw-r--r-- 1 root root 676 Mar 3 2013 de_labswikimedia-latest-stub-articles.xml.gz-rss.xml ---------- 1 root root 0 Aug 22 2014 de_labswikimedia-latest-stub-meta-current.xml.gz -rw-r--r-- 1 root root 688 Mar 3 2013 de_labswikimedia-latest-stub-meta-current.xml.gz-rss.xml ---------- 1 root root 0 Aug 22 2014 de_labswikimedia-latest-stub-meta-history.xml.gz -rw-r--r-- 1 root root 688 Mar 3 2013 de_labswikimedia-latest-stub-meta-history.xml.gz-rss.xml ---------- 1 root root 0 Aug 22 2014 de_labswikimedia-latest-templatelinks.sql.gz -rw-r--r-- 1 root root 676 Mar 3 2013 de_labswikimedia-latest-templatelinks.sql.gz-rss.xml ---------- 1 root root 0 Aug 22 2014 de_labswikimedia-latest-user_groups.sql.gz -rw-r--r-- 1 root root 670 Mar 3 2013 de_labswikimedia-latest-user_groups.sql.gz-rss.xml
TASK DETAIL
EMAIL PREFERENCES
To: rafidaslam
Cc: Aklapper, pywikibot-bugs-list, jayvdb, Framawiki, Xqt, zhuyifei1999, rafidaslam, Magul, Tbscho, MayS, Mdupont, JJMC89, Avicennasis, Dalba, Masti, Alchimista, Rxy
Cc: Aklapper, pywikibot-bugs-list, jayvdb, Framawiki, Xqt, zhuyifei1999, rafidaslam, Magul, Tbscho, MayS, Mdupont, JJMC89, Avicennasis, Dalba, Masti, Alchimista, Rxy
_______________________________________________ pywikibot-bugs mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs
