Re: [ceph-users] rbd cache command thru admin socket

[Jason Dillaman]

Yes, the socket will be created and will remain as long as librbd is
running -- in the case of QEMU, it should be available for as long as
the VM is running.

On Fri, Jul 1, 2016 at 2:42 PM, Deneau, Tom <tom.den...@amd.com> wrote:
> Thanks, Jason--
>
> Turns out AppArmor was indeed enabled (I was not aware of that).
> Disabled it and now I see the socket but it seems to only be there
> temporarily while some client app is running.
>
> The original reason I wanted to use this socket was that I am also
> using an rbd images thru kvm and I wanted to be able to flush and
> invalidate the rbd cache as an experiment.
>
> I would have thought the socket would get created and stay there as
> long as kvm is active (since kvm is using librbd).  But even when I
> access the rbd disk from the VM, I don't see any socket created at all.
>
> -- Tom
>
>
>> -Original Message-
>> From: Jason Dillaman [mailto:jdill...@redhat.com]
>> Sent: Thursday, June 30, 2016 6:15 PM
>> To: Deneau, Tom <tom.den...@amd.com>
>> Cc: ceph-users <ceph-us...@ceph.com>
>> Subject: Re: [ceph-users] rbd cache command thru admin socket
>>
>> Can you check the permissions on "/var/run/ceph/" and ensure that the user
>> your client runs under has permissions to access the directory?
>> If the permissions are OK, do you have SElinux or AppArmor enabled and
>> enforcing?
>>
>> On Thu, Jun 30, 2016 at 5:37 PM, Deneau, Tom <tom.den...@amd.com> wrote:
>> > I was following the instructions in
>> >
>> > https://www.sebastien-han.fr/blog/2015/09/02/ceph-validate-that-the-rb
>> > d-cache-is-active/
>> >
>> > because I wanted to look at some of the rbd cache state and possibly
>> > flush and invalidate it
>> >
>> > My ceph.conf has
>> > [client]
>> > rbd default features = 1
>> > rbd default format = 2
>> > admin socket = /var/run/ceph/$cluster-$type.$id.$pid.$cctid.asok
>> > log file = /var/log/ceph/
>> >
>> > I have a client only node (no osds) and on that node I ran fio with the
>> librbd engine, which worked fine.  But I did not see anything in
>> /var/run/ceph on that client node.  Is there something else I have to do?
>> >
>> > -- Tom Deneau, AMD
>> >
>> >
>> > ___
>> > ceph-users mailing list
>> > ceph-users@lists.ceph.com
>> > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>
>>
>>
>> --
>> Jason



-- 
Jason
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] rbd cache command thru admin socket

[Deneau, Tom]

Thanks, Jason--

Turns out AppArmor was indeed enabled (I was not aware of that).
Disabled it and now I see the socket but it seems to only be there
temporarily while some client app is running.

The original reason I wanted to use this socket was that I am also
using an rbd images thru kvm and I wanted to be able to flush and 
invalidate the rbd cache as an experiment.

I would have thought the socket would get created and stay there as
long as kvm is active (since kvm is using librbd).  But even when I 
access the rbd disk from the VM, I don't see any socket created at all.

-- Tom


> -Original Message-
> From: Jason Dillaman [mailto:jdill...@redhat.com]
> Sent: Thursday, June 30, 2016 6:15 PM
> To: Deneau, Tom <tom.den...@amd.com>
> Cc: ceph-users <ceph-us...@ceph.com>
> Subject: Re: [ceph-users] rbd cache command thru admin socket
> 
> Can you check the permissions on "/var/run/ceph/" and ensure that the user
> your client runs under has permissions to access the directory?
> If the permissions are OK, do you have SElinux or AppArmor enabled and
> enforcing?
> 
> On Thu, Jun 30, 2016 at 5:37 PM, Deneau, Tom <tom.den...@amd.com> wrote:
> > I was following the instructions in
> >
> > https://www.sebastien-han.fr/blog/2015/09/02/ceph-validate-that-the-rb
> > d-cache-is-active/
> >
> > because I wanted to look at some of the rbd cache state and possibly
> > flush and invalidate it
> >
> > My ceph.conf has
> > [client]
> > rbd default features = 1
> > rbd default format = 2
> > admin socket = /var/run/ceph/$cluster-$type.$id.$pid.$cctid.asok
> > log file = /var/log/ceph/
> >
> > I have a client only node (no osds) and on that node I ran fio with the
> librbd engine, which worked fine.  But I did not see anything in
> /var/run/ceph on that client node.  Is there something else I have to do?
> >
> > -- Tom Deneau, AMD
> >
> >
> > ___
> > ceph-users mailing list
> > ceph-users@lists.ceph.com
> > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
> 
> 
> 
> --
> Jason
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] rbd cache command thru admin socket

[Jason Dillaman]

Can you check the permissions on "/var/run/ceph/" and ensure that the
user your client runs under has permissions to access the directory?
If the permissions are OK, do you have SElinux or AppArmor enabled and
enforcing?

On Thu, Jun 30, 2016 at 5:37 PM, Deneau, Tom  wrote:
> I was following the instructions in
>  
> https://www.sebastien-han.fr/blog/2015/09/02/ceph-validate-that-the-rbd-cache-is-active/
>
> because I wanted to look at some of the rbd cache state and possibly flush 
> and invalidate it
>
> My ceph.conf has
> [client]
> rbd default features = 1
> rbd default format = 2
> admin socket = /var/run/ceph/$cluster-$type.$id.$pid.$cctid.asok
> log file = /var/log/ceph/
>
> I have a client only node (no osds) and on that node I ran fio with the 
> librbd engine, which worked fine.  But I did not see anything in 
> /var/run/ceph on that client node.  Is there something else I have to do?
>
> -- Tom Deneau, AMD
>
>
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com



-- 
Jason
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[ceph-users] rbd cache command thru admin socket

[Deneau, Tom]

I was following the instructions in
 
https://www.sebastien-han.fr/blog/2015/09/02/ceph-validate-that-the-rbd-cache-is-active/

because I wanted to look at some of the rbd cache state and possibly flush and 
invalidate it

My ceph.conf has
[client]
rbd default features = 1
rbd default format = 2
admin socket = /var/run/ceph/$cluster-$type.$id.$pid.$cctid.asok
log file = /var/log/ceph/

I have a client only node (no osds) and on that node I ran fio with the librbd 
engine, which worked fine.  But I did not see anything in /var/run/ceph on that 
client node.  Is there something else I have to do?

-- Tom Deneau, AMD


___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com