[Bug 69311] Swift outage caused a bunch of moved files to be inconsistent and missing

2014-10-30 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=69311 --- Comment #21 from Tisza Gergő gti...@wikimedia.org --- On a closer look, almost all of these seem to be about old versions of files. The files for which the current version is missing (filtered via grep -Pv '/\d{14}!' | cut -d/ -f7-) is

[Bug 69311] Swift outage caused a bunch of moved files to be inconsistent and missing

2014-10-29 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=69311 --- Comment #20 from Tisza Gergő gti...@wikimedia.org --- Created attachment 16952 -- https://bugzilla.wikimedia.org/attachment.cgi?id=16952action=edit List of files/thumbnails which are referenced in the database but cannot be found Aaron

[Bug 69311] Swift outage caused a bunch of moved files to be inconsistent and missing

2014-10-27 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=69311 --- Comment #19 from Andre Klapper aklap...@wikimedia.org --- (In reply to Andre Klapper from comment #18) (In reply to Aaron Schulz from comment #16) I'm running a check to find all missing files regardless of time. Aaron / Tisza: So is

[Bug 69311] Swift outage caused a bunch of moved files to be inconsistent and missing

2014-09-22 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=69311 --- Comment #18 from Andre Klapper aklap...@wikimedia.org --- (In reply to Aaron Schulz from comment #16) I'm running a check to find all missing files regardless of time. So is there more cleanup work needed here? Or what is the status? --

[Bug 69311] Swift outage caused a bunch of moved files to be inconsistent and missing

2014-09-02 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=69311 --- Comment #14 from Aaron Schulz aschulz4...@gmail.com --- I ran: mwscript findMissingFiles.php commonswiki --mtimeafter 2014080600 --mtimebefore 2014082100 /home/aaron/broken_files-commons.list Which gives:

[Bug 69311] Swift outage caused a bunch of moved files to be inconsistent and missing

2014-09-02 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=69311 --- Comment #15 from Tisza Gergő gti...@wikimedia.org --- This has no overlap with the files from comment 0. I think the problem is that the move entry in log table has the old page id but the script is joining on the current one. -- You are

[Bug 69311] Swift outage caused a bunch of moved files to be inconsistent and missing

2014-09-02 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=69311 --- Comment #16 from Aaron Schulz aschulz4...@gmail.com --- (In reply to Tisza Gergő from comment #15) This has no overlap with the files from comment 0. I think the problem is that the move entry in log table has the old page id but the

[Bug 69311] Swift outage caused a bunch of moved files to be inconsistent and missing

2014-09-02 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=69311 --- Comment #17 from Aaron Schulz aschulz4...@gmail.com --- Ahh, that would be bug 57084. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list

[Bug 69311] Swift outage caused a bunch of moved files to be inconsistent and missing

2014-08-29 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=69311 --- Comment #12 from Bawolff (Brian Wolff) bawolff...@gmail.com --- *** Bug 70079 has been marked as a duplicate of this bug. *** -- You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.

[Bug 69311] Swift outage caused a bunch of moved files to be inconsistent and missing

2014-08-29 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=69311 Tisza Gergő gti...@wikimedia.org changed: What|Removed |Added Assignee|wikibugs-l@lists.wikimedia. |gti...@wikimedia.org

[Bug 69311] Swift outage caused a bunch of moved files to be inconsistent and missing

2014-08-29 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=69311 --- Comment #13 from Aaron Schulz aschulz4...@gmail.com --- (In reply to Greg Grossmeier from comment #10) (In reply to Filippo Giunchedi from comment #9) Greg: at wikimania I asked Aaron the context for this and a preliminary script to

[Bug 69311] Swift outage caused a bunch of moved files to be inconsistent and missing

2014-08-28 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=69311 --- Comment #11 from Tisza Gergő gti...@wikimedia.org --- Tracked in Mingle as https://wikimedia.mingle.thoughtworks.com/projects/multimedia/cards/827 -- You are receiving this mail because: You are the assignee for the bug. You are on the CC

[Bug 69311] Swift outage caused a bunch of moved files to be inconsistent and missing

2014-08-25 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=69311 --- Comment #8 from Greg Grossmeier g...@wikimedia.org --- Filippo: Anything you can do to help here? -- You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.

[Bug 69311] Swift outage caused a bunch of moved files to be inconsistent and missing

2014-08-25 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=69311 --- Comment #9 from Filippo Giunchedi fili...@wikimedia.org --- Greg: at wikimania I asked Aaron the context for this and a preliminary script to find missing images has been committed in https://gerrit.wikimedia.org/r/#/c/152066/ however AFAIK

[Bug 69311] Swift outage caused a bunch of moved files to be inconsistent and missing

2014-08-25 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=69311 --- Comment #10 from Greg Grossmeier g...@wikimedia.org --- (In reply to Filippo Giunchedi from comment #9) Greg: at wikimania I asked Aaron the context for this and a preliminary script to find missing images has been committed in

[Bug 69311] Swift outage caused a bunch of moved files to be inconsistent and missing

2014-08-24 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=69311 --- Comment #7 from 555 lugu...@gmail.com --- Be aware that this additional issue occured only 20 August 2014‎, days later the first report (8 August). I'm re-uploading the two djvu files listed above, since there is no hope if this isn't only

[Bug 69311] Swift outage caused a bunch of moved files to be inconsistent and missing

2014-08-20 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=69311 Tisza Gergő gti...@wikimedia.org changed: What|Removed |Added CC||lugu...@gmail.com

[Bug 69311] Swift outage caused a bunch of moved files to be inconsistent and missing

2014-08-20 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=69311 Tisza Gergő gti...@wikimedia.org changed: What|Removed |Added Blocks||35925 --- Comment

[Bug 69311] Swift outage caused a bunch of moved files to be inconsistent and missing

2014-08-10 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=69311 Andre Klapper aklap...@wikimedia.org changed: What|Removed |Added Priority|Unprioritized |High

[Bug 69311] Swift outage caused a bunch of moved files to be inconsistent and missing

2014-08-10 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=69311 --- Comment #4 from Andre Klapper aklap...@wikimedia.org --- Bug 69377 is likely one outcome of this? -- You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.

[Bug 69311] Swift outage caused a bunch of moved files to be inconsistent and missing

2014-08-09 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=69311 --- Comment #2 from Steinsplitter steinsplit...@wikipedia.de --- Maybe helpful for techs: Loosing of files is a long term problem because swift is causing a lot of problems on commons. (I can't find the bugreport, maybe you bawolff?) -- You

[Bug 69311] Swift outage caused a bunch of moved files to be inconsistent and missing

2014-08-09 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=69311 Pratyya Ghosh pratyyagh...@yahoo.com changed: What|Removed |Added CC|

[Bug 69311] Swift outage caused a bunch of moved files to be inconsistent and missing

2014-08-08 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=69311 --- Comment #1 from Bawolff (Brian Wolff) bawolff...@gmail.com --- See also Bug 69312 for the underlying issue instead of the clean up bug. -- You are receiving this mail because: You are the assignee for the bug. You are on the CC list for