Re: [ceph-users] CephFS file contains garbage zero padding after an unclean cluster shutdown

2018-11-25 Thread Hector Martin
On 26/11/2018 11.05, Yan, Zheng wrote: > On Mon, Nov 26, 2018 at 4:30 AM Hector Martin wrote: >> >> On 26/11/2018 00.19, Paul Emmerich wrote: >>> No, wait. Which system did kernel panic? Your CephFS client running rsync? >>> In this case this would be expected behavior because rsync doesn't >>> sy

Re: [ceph-users] CephFS file contains garbage zero padding after an unclean cluster shutdown

2018-11-25 Thread Yan, Zheng
On Mon, Nov 26, 2018 at 4:30 AM Hector Martin wrote: > > On 26/11/2018 00.19, Paul Emmerich wrote: > > No, wait. Which system did kernel panic? Your CephFS client running rsync? > > In this case this would be expected behavior because rsync doesn't > > sync on every block and you lost your file sy

Re: [ceph-users] CephFS file contains garbage zero padding after an unclean cluster shutdown

2018-11-25 Thread Hector Martin
On 26/11/2018 00.19, Paul Emmerich wrote: > No, wait. Which system did kernel panic? Your CephFS client running rsync? > In this case this would be expected behavior because rsync doesn't > sync on every block and you lost your file system cache. It was all on the same system. So is it expected be

Re: [ceph-users] CephFS file contains garbage zero padding after an unclean cluster shutdown

2018-11-25 Thread Paul Emmerich
No, wait. Which system did kernel panic? Your CephFS client running rsync? In this case this would be expected behavior because rsync doesn't sync on every block and you lost your file system cache. -- Paul Emmerich Looking for help with your Ceph cluster? Contact us at https://croit.io croit G

Re: [ceph-users] CephFS file contains garbage zero padding after an unclean cluster shutdown

2018-11-25 Thread Paul Emmerich
Maybe rsync called fallocate() on the file? Paul -- Paul Emmerich Looking for help with your Ceph cluster? Contact us at https://croit.io croit GmbH Freseniusstr. 31h 81247 München www.croit.io Tel: +49 89 1896585 90 Am Fr., 23. Nov. 2018 um 16:55 Uhr schrieb Hector Martin : > > Background: I

[ceph-users] CephFS file contains garbage zero padding after an unclean cluster shutdown

2018-11-23 Thread Hector Martin
Background: I'm running single-node Ceph with CephFS as an experimental replacement for "traditional" filesystems. In this case I have 11 OSDs, 1 mon, and 1 MDS. I just had an unclean shutdown (kernel panic) while a large (>1TB) file was being copied to CephFS (via rsync). Upon bringing the system