https://bugzilla.wikimedia.org/show_bug.cgi?id=34695
--- Comment #10 from Ben Hartshorne <[email protected]> 2012-05-10 22:33:40 UTC --- Update: The script to delete truncated images has run completely a few times and eliminated most of the truncated images. There were some left and with more digging I found that they were objects in swift that do not exist in the container listings. (as though you can read a file in a directory but when you list the contents of the directory you don't see the file.) I've started a process that is crawling every object in swift and testing to verify that it is present in the container listing, deleting those that aren't. So far it has found several (in the tens of objects per commons shard) objects that aren't listed in the containers - about 0.04%. Based on the progress of the script so far I expect it should take about 12 days to complete the sweep. Results so far show that the most recent file that exists but is not listed in a container is 2012-03-20, so it seems that whatever triggered the bug that allowed them to exist is no longer happening. Note that most of the objects missing from the container listings are not actually truncated images, but it is best to purge them anyways, since they will still cause trouble if the original image is updated. In other words, there are two problems: truncated images and objects missing from the container listing. When both problems affect a single file, the symptom is at truncated file that can't be purged. -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug. _______________________________________________ Wikibugs-l mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
