valhallasw added a comment.
I think the main issue is a combination of delete-then-clone plus slow NFS. It's not entirely clear to me whether the script fails halfway or whether it's just very slow. I think we should do the following: 1. clone, git gc, tar in /tmp rather than on NFS, 2. once done, move those files to NFS, but not in their new location yet 3. rename the old files to .old, rename the new files to the correct name (not entirely atomic, but what can one do) 4. remove the old files TASK DETAIL https://phabricator.wikimedia.org/T125505 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: scfc, valhallasw Cc: jayvdb, Urbanecm, russblau, bd808, Alchimista, Jogo.obb, zhuyifei1999, scfc, Ato_01, pywikibot-bugs-list, Ladsgroup, valhallasw, Aklapper, Incola, StudiesWorld, Mdupont, Luke081515, yuvipanda, Gryllida, coren, chasemp _______________________________________________ pywikibot-bugs mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs
