[ceph-users] Corruption by missing blocks

2013-04-23 Thread Bryan Stillwell
I've run into an issue where after copying a file to my cephfs cluster the md5sums no longer match. I believe I've tracked it down to some parts of the file which are missing: $ obj_name=$(cephfs title1.mkv show_location -l 0 | grep object_name | sed -e s/.*:\W*\([0-9a-f]*\)\.[0-9a-f]*/\1/) $

Re: [ceph-users] Corruption by missing blocks

2013-04-23 Thread Gregory Farnum
On Tue, Apr 23, 2013 at 11:38 AM, Bryan Stillwell bstillw...@photobucket.com wrote: I've run into an issue where after copying a file to my cephfs cluster the md5sums no longer match. I believe I've tracked it down to some parts of the file which are missing: $ obj_name=$(cephfs title1.mkv

Re: [ceph-users] Corruption by missing blocks

2013-04-23 Thread Bryan Stillwell
I've tried a few different ones: 1. cp to cephfs mounted filesystem on Ubuntu 12.10 (quantal) 2. rsync over ssh to cephfs mounted filesystem on Ubuntu 12.04.2 (precise) 3. scp to cephfs mounted filesystem on Ubuntu 12.04.2 (precise) It's fairly reproducible, so I can collect logs for you. Which

Re: [ceph-users] Corruption by missing blocks

2013-04-23 Thread Gregory Farnum
Sorry, I meant kernel client or ceph-fuse? Client logs would be enough to start with, I suppose — debug client = 20 and debug ms = 1 if using ceph-fuse; if using the kernel client things get tricker; I'd have to look at what logging is available without the debugfs stuff being enabled. :/ -Greg

Re: [ceph-users] Corruption by missing blocks

2013-04-23 Thread Bryan Stillwell
On Tue, Apr 23, 2013 at 5:24 PM, Sage Weil s...@inktank.com wrote: On Tue, 23 Apr 2013, Bryan Stillwell wrote: I'm testing this now, but while going through the logs I saw something that might have something to do with this: Apr 23 16:35:28 a1 kernel: [692455.496594] libceph: corrupt inc

Re: [ceph-users] Corruption by missing blocks

2013-04-23 Thread Sage Weil
On Tue, 23 Apr 2013, Bryan Stillwell wrote: On Tue, Apr 23, 2013 at 5:24 PM, Sage Weil s...@inktank.com wrote: On Tue, 23 Apr 2013, Bryan Stillwell wrote: I'm testing this now, but while going through the logs I saw something that might have something to do with this: Apr 23

Re: [ceph-users] Corruption by missing blocks

2013-04-23 Thread Bryan Stillwell
On Tue, Apr 23, 2013 at 5:45 PM, Sage Weil s...@inktank.com wrote: On Tue, 23 Apr 2013, Bryan Stillwell wrote: On Tue, Apr 23, 2013 at 5:24 PM, Sage Weil s...@inktank.com wrote: On Tue, 23 Apr 2013, Bryan Stillwell wrote: I'm testing this now, but while going through the logs I saw

Re: [ceph-users] Corruption by missing blocks

2013-04-23 Thread Bryan Stillwell
On Tue, Apr 23, 2013 at 5:54 PM, Gregory Farnum g...@inktank.com wrote: On Tue, Apr 23, 2013 at 4:45 PM, Sage Weil s...@inktank.com wrote: On Tue, 23 Apr 2013, Bryan Stillwell wrote: On Tue, Apr 23, 2013 at 5:24 PM, Sage Weil s...@inktank.com wrote: On Tue, 23 Apr 2013, Bryan Stillwell