Re: Ceph-deploy (git from today) fails to create osd on host that does not have a mon

On 05/09/13 17:56, Mark Kirkwood wrote: [ceph_deploy.osd][DEBUG ] Preparing cluster ceph disks ceph2:/dev/vdb:/dev/vdc [ceph_deploy.osd][INFO ] Distro info: Ubuntu 12.04 precise [ceph_deploy.osd][DEBUG ] Deploying osd to ceph2 [ceph2][INFO ] write cluster configuration to

Re: Add Metavariable $imagename

On 09/04/2013 09:22 AM, Sage Weil wrote: Hi Mike, On Wed, 4 Sep 2013, Mike Dawson wrote: Thanks for the feature request Mark! To illustrate where my understanding ends, here is a patch to stub in this functionality: From 137ebc2d5326ca710a5e99e2899fd851b02c10f7 Mon Sep 17 00:00:00 2001

Re: [PATCHv4 0/5] ceph: persistent caching with fscache

I've pushed the non-Ceph bits of the bad-page fix to here: http://git.kernel.org/cgit/linux/kernel/git/dhowells/linux-fs.git/log/?h=fscache and added a CIFS fix. David -- To unsubscribe from this list: send the line unsubscribe ceph-devel in the body of a message to

Re: Ceph-deploy (git from today) fails to create osd on host that does not have a mon

On Thu, Sep 5, 2013 at 2:27 AM, Mark Kirkwood mark.kirkw...@catalyst.net.nz wrote: On 05/09/13 17:56, Mark Kirkwood wrote: [ceph_deploy.osd][DEBUG ] Preparing cluster ceph disks ceph2:/dev/vdb:/dev/vdc [ceph_deploy.osd][INFO ] Distro info: Ubuntu 12.04 precise [ceph_deploy.osd][DEBUG ]

Re: Add Metavariable $imagename

On Wed, 4 Sep 2013, Josh Durgin wrote: On 09/04/2013 09:22 AM, Sage Weil wrote: Hi Mike, On Wed, 4 Sep 2013, Mike Dawson wrote: Thanks for the feature request Mark! To illustrate where my understanding ends, here is a patch to stub in this functionality: From

Re: Add Metavariable $imagename

On 09/05/2013 07:59 AM, Sage Weil wrote: On Wed, 4 Sep 2013, Josh Durgin wrote: On 09/04/2013 09:22 AM, Sage Weil wrote: Hi Mike, On Wed, 4 Sep 2013, Mike Dawson wrote: Thanks for the feature request Mark! To illustrate where my understanding ends, here is a patch to stub in this

[PATCH 2/8] CacheFiles: Implement interface to check cache consistency

Implement the FS-Cache interface to check the consistency of a cache object in CacheFiles. Original-author: Hongyi Jia jiayis...@gmail.com Signed-off-by: David Howells dhowe...@redhat.com cc: Hongyi Jia jiayis...@gmail.com cc: Milosz Tanski mil...@adfin.com --- fs/cachefiles/interface.c | 26

[PATCH 1/8] FS-Cache: Add interface to check consistency of a cached object

Extend the fscache netfs API so that the netfs can ask as to whether a cache object is up to date with respect to its corresponding netfs object: int fscache_check_consistency(struct fscache_cookie *cookie) This will call back to the netfs to check whether the auxiliary data associated

[PATCH 0/8] ceph: fscache support upstream changes

Hey gang I think this should be final revision of these changes. The changes are: * David rewrote the cookie validity check (that originally was written by Hongyi Jia). You might have seen some emails flying about doing it the right way. * I added crash fix when for Ceph filesystems

[PATCH 3/8] fscache: Netfs function for cleanup post readpages

Currently the fscache code expect the netfs to call fscache_readpages_or_alloc inside the aops readpages callback. It marks all the pages in the list provided by readahead with PG_private_2. In the cases that the netfs fails to read all the pages (which is legal) it ends up returning to the

[PATCH 5/8] ceph: clean PgPrivate2 on returning from readpages

In some cases the ceph readapages code code bails without filling all the pages already marked by fscache. When we return back to readahead code this causes a BUG. Signed-off-by: Milosz Tanski mil...@adfin.com --- fs/ceph/addr.c |2 ++ fs/ceph/cache.h |7 +++ 2 files changed, 9

[PATCH 6/8] ceph: ceph_readpage_to_fscache didn't check if marked

Previously ceph_readpage_to_fscache did not call if page was marked as cached before calling fscache_write_page resulting in a BUG inside of fscache. FS-Cache: Assertion failed [ cut here ] kernel BUG at fs/fscache/page.c:874! invalid opcode: [#1] SMP Call Trace:

[PATCH 8/8] ceph: Do not do invalidate if the filesystem is mounted nofsc

Previously we would always try to enqueue work even if the filesystem is not mounted with fscache enabled (or the file has no cookie). In the case of the filesystem mouned nofsc (but with fscache compiled in) this would lead to a crash. Signed-off-by: Milosz Tanski mil...@adfin.com ---

[PATCH 4/8] ceph: use fscache as a local presisent cache

Adding support for fscache to the Ceph filesystem. This would bring it to on par with some of the other network filesystems in Linux (like NFS, AFS, etc...) In order to mount the filesystem with fscache the 'fsc' mount option must be passed. Signed-off-by: Milosz Tanski mil...@adfin.com

Re: [PATCH 0/8] ceph: fscache support upstream changes

On Thu, 5 Sep 2013, Milosz Tanski wrote: Hey gang I think this should be final revision of these changes. The changes are: * David rewrote the cookie validity check (that originally was written by Hongyi Jia). You might have seen some emails flying about doing it the right way. *

OSD crash during repair

G'day, I'm getting an OSD crash on 0.56.7-1~bpo70+1 whilst trying to repair an OSD: http://tracker.ceph.com/issues/6233 ceph version 0.56.7 (14f23ab86b0058a8651895b3dc972a29459f3a33) 1: /usr/bin/ceph-osd() [0x8530a2] 2: (()+0xf030) [0x7f541ca39030] 3: (gsignal()+0x35) [0x7f541b132475]

Re: Re: [PATCH 2/2] ceph: Implement writev/pwritev for sync operation.

Hi, Thank you for the patch. On 09/03/2013 04:52 PM, majianpeng wrote: For writev/pwritev sync-operatoin, ceph only do the first iov. It don't think other iovs.Now implement this. I divided the write-sync-operation into two functions.One for direct-write,other for none-direct-sync-write.This

Re: [PATCH 2/2] ceph: Implement writev/pwritev for sync operation.

On 09/06/2013 08:46 AM, majianpeng wrote: Hi, Thank you for the patch. On 09/03/2013 04:52 PM, majianpeng wrote: For writev/pwritev sync-operatoin, ceph only do the first iov. It don't think other iovs.Now implement this. I divided the write-sync-operation into two functions.One for

Re: OSD crash during repair

Hi Chris, What is the inconsistency that scrub reports in the log? My guess is that the simplest way to resolve this is to remove whichever copy you decide is invalid, but it depends on what the inconstency it is trying/failing to repair is. Thanks! sage On Fri, 6 Sep 2013, Chris Dunlop

Re: OSD crash during repair

Hi Sage, Does this answer your question? 2013-09-06 09:30:19.813811 7f0ae8cbc700 0 log [INF] : applying configuration change: internal_safe_to_start_threads = 'true' 2013-09-06 09:33:28.303658 7f0ae94bd700 0 log [ERR] : 2.12 osd.7: soid 56987a12/rb.0.17d9b.2ae8944a.1e11/head//2 extra

Re: OSD crash during repair

On Fri, 6 Sep 2013, Chris Dunlop wrote: Hi Sage, Does this answer your question? 2013-09-06 09:30:19.813811 7f0ae8cbc700 0 log [INF] : applying configuration change: internal_safe_to_start_threads = 'true' 2013-09-06 09:33:28.303658 7f0ae94bd700 0 log [ERR] : 2.12 osd.7: soid

Re: OSD crash during repair

On Thu, Sep 05, 2013 at 07:55:52PM -0700, Sage Weil wrote: On Fri, 6 Sep 2013, Chris Dunlop wrote: Hi Sage, Does this answer your question? 2013-09-06 09:30:19.813811 7f0ae8cbc700 0 log [INF] : applying configuration change: internal_safe_to_start_threads = 'true' 2013-09-06

Re: [PATCH 0/8] ceph: fscache support upstream changes

David, After running this for a day on some loaded machines I ran into what looks like an old issue with the new code. I remember you saw an issue that manifested it self in a similar way a while back. [13837253.462779] FS-Cache: Assertion failed [13837253.462782] 3 == 5 is false

Re: OSD crash during repair

On Fri, Sep 06, 2013 at 01:12:21PM +1000, Chris Dunlop wrote: On Thu, Sep 05, 2013 at 07:55:52PM -0700, Sage Weil wrote: On Fri, 6 Sep 2013, Chris Dunlop wrote: Hi Sage, Does this answer your question? 2013-09-06 09:30:19.813811 7f0ae8cbc700 0 log [INF] : applying configuration change: