Re: [ceph-users] Modification Time of RBD Images

[Jason Dillaman]

No support for that yet -- it's being tracked by a backlog ticket [1].

[1] https://trello.com/c/npmsOgM5

On Wed, Sep 6, 2017 at 12:27 PM, Christoph Adomeit
 wrote:
> Now that we are 2 years and some ceph releases farther and have bluestor:
>
> Are there meanwhile any better ways to find out the mtime of an rbd image ?
>
> Thanks
>   Christoph
>
> On Thu, Nov 26, 2015 at 06:50:46PM +0100, Jan Schermer wrote:
>> Find in which block the filesystem on your RBD image stores journal, find 
>> the object hosting this block in rados and use its mtime :-)
>>
>> Jan
>>
>>
>> > On 26 Nov 2015, at 18:49, Gregory Farnum  wrote:
>> >
>> > I don't think anything tracks this explicitly for RBD, but each RADOS 
>> > object does maintain an mtime you can check via the rados tool. You could 
>> > write a script to iterate through all the objects in the image and find 
>> > the most recent mtime (although a custom librados binary will be faster if 
>> > you want to do this frequently).
>> > -Greg
>> >
>> > On Thursday, November 26, 2015, Christoph Adomeit 
>> > > 
>> > wrote:
>> > Hi there,
>> >
>> > I am using Ceph-Hammer and I am wondering about the following:
>> >
>> > What is the recommended way to find out when an rbd-Image was last 
>> > modified ?
>> >
>> > Thanks
>> >   Christoph
>> >
>> > --
>> > Christoph Adomeit
>> > GATWORKS GmbH
>> > Reststrauch 191
>> > 41199 Moenchengladbach
>> > Sitz: Moenchengladbach
>> > Amtsgericht Moenchengladbach, HRB 6303
>> > Geschaeftsfuehrer:
>> > Christoph Adomeit, Hans Wilhelm Terstappen
>> >
>> > christoph.adom...@gatworks.de  Internetloesungen vom 
>> > Feinsten
>> > Fon. +49 2166 9149-32  Fax. +49 2166 9149-10
>> > ___
>> > ceph-users mailing list
>> > ceph-users@lists.ceph.com 
>> > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com 
>> > 
>> > ___
>> > ceph-users mailing list
>> > ceph-users@lists.ceph.com
>> > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>
>
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com



-- 
Jason
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Modification Time of RBD Images

[Christoph Adomeit]

Now that we are 2 years and some ceph releases farther and have bluestor:

Are there meanwhile any better ways to find out the mtime of an rbd image ?

Thanks
  Christoph

On Thu, Nov 26, 2015 at 06:50:46PM +0100, Jan Schermer wrote:
> Find in which block the filesystem on your RBD image stores journal, find the 
> object hosting this block in rados and use its mtime :-)
> 
> Jan
> 
> 
> > On 26 Nov 2015, at 18:49, Gregory Farnum  wrote:
> > 
> > I don't think anything tracks this explicitly for RBD, but each RADOS 
> > object does maintain an mtime you can check via the rados tool. You could 
> > write a script to iterate through all the objects in the image and find the 
> > most recent mtime (although a custom librados binary will be faster if you 
> > want to do this frequently).
> > -Greg
> > 
> > On Thursday, November 26, 2015, Christoph Adomeit 
> > > 
> > wrote:
> > Hi there,
> > 
> > I am using Ceph-Hammer and I am wondering about the following:
> > 
> > What is the recommended way to find out when an rbd-Image was last modified 
> > ?
> > 
> > Thanks
> >   Christoph
> > 
> > --
> > Christoph Adomeit
> > GATWORKS GmbH
> > Reststrauch 191
> > 41199 Moenchengladbach
> > Sitz: Moenchengladbach
> > Amtsgericht Moenchengladbach, HRB 6303
> > Geschaeftsfuehrer:
> > Christoph Adomeit, Hans Wilhelm Terstappen
> > 
> > christoph.adom...@gatworks.de  Internetloesungen vom 
> > Feinsten
> > Fon. +49 2166 9149-32  Fax. +49 2166 9149-10
> > ___
> > ceph-users mailing list
> > ceph-users@lists.ceph.com 
> > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com 
> > 
> > ___
> > ceph-users mailing list
> > ceph-users@lists.ceph.com
> > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
> 

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Modification Time of RBD Images

[Dongsheng Yang]

Jason, sorry for the typo of your email address in my last mail...

On 29/03/2017, 00:36, Jason Dillaman wrote:

While certainly that could be a feature that could be added to "rbd
info", it will take a while for this feature to reach full use since
it would rely on new versions of librbd / krbd.

Additionally, access and modified timestamps would require sending out
an update notification so that other clients notice the change. You
would also want to highly throttle any updates to the modification
timestamp -- rendering it a rough approximation of the true last
modification time. Finally, a client might not have access to update
an image when it opens it read-only --- rendering the last access
time, again, as a rough approximation.

IMHO, I think there are a lot of other, higher-priority backlog items
for RBD (and supporting services) [1] -- but I've added it to the
bottom of backlog.

[1] https://trello.com/b/ugTc2QFH/ceph-backlog


Yes, agree, let's focus on the other higher-priority backlog items now.

Thanx


On Fri, Mar 24, 2017 at 3:27 AM, Dongsheng Yang
 wrote:

Hi jason,

 do you think this is a good feature for rbd?
maybe we can implement a "rbd stat" command
to show atime, mtime and ctime of an image.

Yang


On 03/23/2017 08:36 PM, Christoph Adomeit wrote:

Hi,

no i did not enable the journalling feature since we do not use mirroring.


On Thu, Mar 23, 2017 at 08:10:05PM +0800, Dongsheng Yang wrote:

Did you enable the journaling feature?

On 03/23/2017 07:44 PM, Christoph Adomeit wrote:

Hi Yang,

I mean "any write" to this image.

I am sure we have a lot of not-used-anymore rbd images in our pool and I
am trying to identify them.

The mtime would be a good hint to show which images might be unused.

Christoph

On Thu, Mar 23, 2017 at 07:32:49PM +0800, Dongsheng Yang wrote:

Hi Christoph,

On 03/23/2017 07:16 PM, Christoph Adomeit wrote:

Hello List,

i am wondering if there is meanwhile an easy method in ceph to find
more information about rbd-images.

For example I am interested in the modification time of an rbd image.

Do you mean some metadata changing? such as resize?

Or any write to this image?

Thanx
Yang

I found some posts from 2015 that say we have to go over all the
objects of an rbd image and find the newest mtime put this is not a
preferred solution for me. It takes to much time and too many system
resources.

Any Ideas ?

Thanks
Christoph


___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com









___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Modification Time of RBD Images

[Jason Dillaman]

While certainly that could be a feature that could be added to "rbd
info", it will take a while for this feature to reach full use since
it would rely on new versions of librbd / krbd.

Additionally, access and modified timestamps would require sending out
an update notification so that other clients notice the change. You
would also want to highly throttle any updates to the modification
timestamp -- rendering it a rough approximation of the true last
modification time. Finally, a client might not have access to update
an image when it opens it read-only --- rendering the last access
time, again, as a rough approximation.

IMHO, I think there are a lot of other, higher-priority backlog items
for RBD (and supporting services) [1] -- but I've added it to the
bottom of backlog.

[1] https://trello.com/b/ugTc2QFH/ceph-backlog

On Fri, Mar 24, 2017 at 3:27 AM, Dongsheng Yang
 wrote:
> Hi jason,
>
> do you think this is a good feature for rbd?
> maybe we can implement a "rbd stat" command
> to show atime, mtime and ctime of an image.
>
> Yang
>
>
> On 03/23/2017 08:36 PM, Christoph Adomeit wrote:
>>
>> Hi,
>>
>> no i did not enable the journalling feature since we do not use mirroring.
>>
>>
>> On Thu, Mar 23, 2017 at 08:10:05PM +0800, Dongsheng Yang wrote:
>>>
>>> Did you enable the journaling feature?
>>>
>>> On 03/23/2017 07:44 PM, Christoph Adomeit wrote:

 Hi Yang,

 I mean "any write" to this image.

 I am sure we have a lot of not-used-anymore rbd images in our pool and I
 am trying to identify them.

 The mtime would be a good hint to show which images might be unused.

 Christoph

 On Thu, Mar 23, 2017 at 07:32:49PM +0800, Dongsheng Yang wrote:
>
> Hi Christoph,
>
> On 03/23/2017 07:16 PM, Christoph Adomeit wrote:
>>
>> Hello List,
>>
>> i am wondering if there is meanwhile an easy method in ceph to find
>> more information about rbd-images.
>>
>> For example I am interested in the modification time of an rbd image.
>
> Do you mean some metadata changing? such as resize?
>
> Or any write to this image?
>
> Thanx
> Yang
>>
>> I found some posts from 2015 that say we have to go over all the
>> objects of an rbd image and find the newest mtime put this is not a
>> preferred solution for me. It takes to much time and too many system
>> resources.
>>
>> Any Ideas ?
>>
>> Thanks
>>Christoph
>>
>>
>> ___
>> ceph-users mailing list
>> ceph-users@lists.ceph.com
>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>
>
>



-- 
Jason
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Modification Time of RBD Images

[Kjetil Jørgensen]

Hi,

YMMV, riddled with assumptions (image is image-format=2, has one ext4
filesystem, no partition table, ext4 superblock starts at 0x400 and
probably a whole boatload of other stuff, I don't know when ext4
updates s_wtime
of it's superblock, nor if it's actually the superblock last write or last
write to filesystem, etc.).

rados -p rbd get $(rbd info $SOME_IMAGE_NAME | awk '/block_name_prefix/ {
print $2 }'). - | dd if=/dev/stdin of=/dev/stdout skip=1072
bs=1 count=4 status=none | perl -lane 'print scalar localtime unpack "I*",
 $_;'

Cheers,
KJ

On Fri, Mar 24, 2017 at 12:27 AM, Dongsheng Yang <
dongsheng.y...@easystack.cn> wrote:

> Hi jason,
>
> do you think this is a good feature for rbd?
> maybe we can implement a "rbd stat" command
> to show atime, mtime and ctime of an image.
>
> Yang
>
>
> On 03/23/2017 08:36 PM, Christoph Adomeit wrote:
>
>> Hi,
>>
>> no i did not enable the journalling feature since we do not use mirroring.
>>
>>
>> On Thu, Mar 23, 2017 at 08:10:05PM +0800, Dongsheng Yang wrote:
>>
>>> Did you enable the journaling feature?
>>>
>>> On 03/23/2017 07:44 PM, Christoph Adomeit wrote:
>>>
 Hi Yang,

 I mean "any write" to this image.

 I am sure we have a lot of not-used-anymore rbd images in our pool and
 I am trying to identify them.

 The mtime would be a good hint to show which images might be unused.

 Christoph

 On Thu, Mar 23, 2017 at 07:32:49PM +0800, Dongsheng Yang wrote:

> Hi Christoph,
>
> On 03/23/2017 07:16 PM, Christoph Adomeit wrote:
>
>> Hello List,
>>
>> i am wondering if there is meanwhile an easy method in ceph to find
>> more information about rbd-images.
>>
>> For example I am interested in the modification time of an rbd image.
>>
> Do you mean some metadata changing? such as resize?
>
> Or any write to this image?
>
> Thanx
> Yang
>
>> I found some posts from 2015 that say we have to go over all the
>> objects of an rbd image and find the newest mtime put this is not a
>> preferred solution for me. It takes to much time and too many system
>> resources.
>>
>> Any Ideas ?
>>
>> Thanks
>>Christoph
>>
>>
>> ___
>> ceph-users mailing list
>> ceph-users@lists.ceph.com
>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>
>>
>
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>



-- 
Kjetil Joergensen 
SRE, Medallia Inc
Phone: +1 (650) 739-6580
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Modification Time of RBD Images

[Dongsheng Yang]

Hi jason,

do you think this is a good feature for rbd?
maybe we can implement a "rbd stat" command
to show atime, mtime and ctime of an image.

Yang

On 03/23/2017 08:36 PM, Christoph Adomeit wrote:

Hi,

no i did not enable the journalling feature since we do not use mirroring.


On Thu, Mar 23, 2017 at 08:10:05PM +0800, Dongsheng Yang wrote:

Did you enable the journaling feature?

On 03/23/2017 07:44 PM, Christoph Adomeit wrote:

Hi Yang,

I mean "any write" to this image.

I am sure we have a lot of not-used-anymore rbd images in our pool and I am 
trying to identify them.

The mtime would be a good hint to show which images might be unused.

Christoph

On Thu, Mar 23, 2017 at 07:32:49PM +0800, Dongsheng Yang wrote:

Hi Christoph,

On 03/23/2017 07:16 PM, Christoph Adomeit wrote:

Hello List,

i am wondering if there is meanwhile an easy method in ceph to find more 
information about rbd-images.

For example I am interested in the modification time of an rbd image.

Do you mean some metadata changing? such as resize?

Or any write to this image?

Thanx
Yang

I found some posts from 2015 that say we have to go over all the objects of an 
rbd image and find the newest mtime put this is not a preferred solution for 
me. It takes to much time and too many system resources.

Any Ideas ?

Thanks
   Christoph


___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com




___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Modification Time of RBD Images

[Christoph Adomeit]

Hi,

no i did not enable the journalling feature since we do not use mirroring.


On Thu, Mar 23, 2017 at 08:10:05PM +0800, Dongsheng Yang wrote:
> Did you enable the journaling feature?
> 
> On 03/23/2017 07:44 PM, Christoph Adomeit wrote:
> >Hi Yang,
> >
> >I mean "any write" to this image.
> >
> >I am sure we have a lot of not-used-anymore rbd images in our pool and I am 
> >trying to identify them.
> >
> >The mtime would be a good hint to show which images might be unused.
> >
> >Christoph
> >
> >On Thu, Mar 23, 2017 at 07:32:49PM +0800, Dongsheng Yang wrote:
> >>Hi Christoph,
> >>
> >>On 03/23/2017 07:16 PM, Christoph Adomeit wrote:
> >>>Hello List,
> >>>
> >>>i am wondering if there is meanwhile an easy method in ceph to find more 
> >>>information about rbd-images.
> >>>
> >>>For example I am interested in the modification time of an rbd image.
> >>Do you mean some metadata changing? such as resize?
> >>
> >>Or any write to this image?
> >>
> >>Thanx
> >>Yang
> >>>I found some posts from 2015 that say we have to go over all the objects 
> >>>of an rbd image and find the newest mtime put this is not a preferred 
> >>>solution for me. It takes to much time and too many system resources.
> >>>
> >>>Any Ideas ?
> >>>
> >>>Thanks
> >>>   Christoph
> >>>
> >>>
> >>>___
> >>>ceph-users mailing list
> >>>ceph-users@lists.ceph.com
> >>>http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
> >>>
> 

-- 
Es gibt keine  Cloud, es gibt nur die Computer anderer Leute
Christoph Adomeit
GATWORKS GmbH
Reststrauch 191
41199 Moenchengladbach
Sitz: Moenchengladbach
Amtsgericht Moenchengladbach, HRB 6303
Geschaeftsfuehrer:
Christoph Adomeit, Hans Wilhelm Terstappen

christoph.adom...@gatworks.de Internetloesungen vom Feinsten
Fon. +49 2166 9149-32  Fax. +49 2166 9149-10
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Modification Time of RBD Images

[Dongsheng Yang]

Did you enable the journaling feature?

On 03/23/2017 07:44 PM, Christoph Adomeit wrote:

Hi Yang,

I mean "any write" to this image.

I am sure we have a lot of not-used-anymore rbd images in our pool and I am 
trying to identify them.

The mtime would be a good hint to show which images might be unused.

Christoph

On Thu, Mar 23, 2017 at 07:32:49PM +0800, Dongsheng Yang wrote:

Hi Christoph,

On 03/23/2017 07:16 PM, Christoph Adomeit wrote:

Hello List,

i am wondering if there is meanwhile an easy method in ceph to find more 
information about rbd-images.

For example I am interested in the modification time of an rbd image.

Do you mean some metadata changing? such as resize?

Or any write to this image?

Thanx
Yang

I found some posts from 2015 that say we have to go over all the objects of an 
rbd image and find the newest mtime put this is not a preferred solution for 
me. It takes to much time and too many system resources.

Any Ideas ?

Thanks
   Christoph


___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com




___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Modification Time of RBD Images

[Christoph Adomeit]

Hi Yang,

I mean "any write" to this image.

I am sure we have a lot of not-used-anymore rbd images in our pool and I am 
trying to identify them.

The mtime would be a good hint to show which images might be unused.

Christoph

On Thu, Mar 23, 2017 at 07:32:49PM +0800, Dongsheng Yang wrote:
> Hi Christoph,
> 
> On 03/23/2017 07:16 PM, Christoph Adomeit wrote:
> >Hello List,
> >
> >i am wondering if there is meanwhile an easy method in ceph to find more 
> >information about rbd-images.
> >
> >For example I am interested in the modification time of an rbd image.
> 
> Do you mean some metadata changing? such as resize?
> 
> Or any write to this image?
> 
> Thanx
> Yang
> >
> >I found some posts from 2015 that say we have to go over all the objects of 
> >an rbd image and find the newest mtime put this is not a preferred solution 
> >for me. It takes to much time and too many system resources.
> >
> >Any Ideas ?
> >
> >Thanks
> >   Christoph
> >
> >
> >___
> >ceph-users mailing list
> >ceph-users@lists.ceph.com
> >http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
> >
> 

-- 
Es gibt keine  Cloud, es gibt nur die Computer anderer Leute
Christoph Adomeit
GATWORKS GmbH
Reststrauch 191
41199 Moenchengladbach
Sitz: Moenchengladbach
Amtsgericht Moenchengladbach, HRB 6303
Geschaeftsfuehrer:
Christoph Adomeit, Hans Wilhelm Terstappen

christoph.adom...@gatworks.de Internetloesungen vom Feinsten
Fon. +49 2166 9149-32  Fax. +49 2166 9149-10
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Modification Time of RBD Images

[Dongsheng Yang]

On 03/23/2017 07:32 PM, Dongsheng Yang wrote:

Hi Christoph,

On 03/23/2017 07:16 PM, Christoph Adomeit wrote:

Hello List,

i am wondering if there is meanwhile an easy method in ceph to find 
more information about rbd-images.


For example I am interested in the modification time of an rbd image.


Do you mean some metadata changing? such as resize?


If you mean metadata changing, I think this command would be enough:
$ rados -p rbd stat rbd_header.11e3238e1f29
rbd/rbd_header.11e3238e1f29 mtime 2017-03-23 19:31:52.00, size 0


Or any write to this image?


But if you want this one, I am afraid it's not so handy currently. maybe
 going through the all data blocks of this image and sorting the mtime
of them would be workable.


Thanx
Yang


I found some posts from 2015 that say we have to go over all the 
objects of an rbd image and find the newest mtime put this is not a 
preferred solution for me. It takes to much time and too many system 
resources.


Any Ideas ?

Thanks
   Christoph


___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com




___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com




___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Modification Time of RBD Images

[Dongsheng Yang]

Hi Christoph,

On 03/23/2017 07:16 PM, Christoph Adomeit wrote:

Hello List,

i am wondering if there is meanwhile an easy method in ceph to find more 
information about rbd-images.

For example I am interested in the modification time of an rbd image.


Do you mean some metadata changing? such as resize?

Or any write to this image?

Thanx
Yang


I found some posts from 2015 that say we have to go over all the objects of an 
rbd image and find the newest mtime put this is not a preferred solution for 
me. It takes to much time and too many system resources.

Any Ideas ?

Thanks
   Christoph


___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com




___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Modification Time of RBD Images

[Jan Schermer]

Find in which block the filesystem on your RBD image stores journal, find the 
object hosting this block in rados and use its mtime :-)

Jan


> On 26 Nov 2015, at 18:49, Gregory Farnum  wrote:
> 
> I don't think anything tracks this explicitly for RBD, but each RADOS object 
> does maintain an mtime you can check via the rados tool. You could write a 
> script to iterate through all the objects in the image and find the most 
> recent mtime (although a custom librados binary will be faster if you want to 
> do this frequently).
> -Greg
> 
> On Thursday, November 26, 2015, Christoph Adomeit 
> > wrote:
> Hi there,
> 
> I am using Ceph-Hammer and I am wondering about the following:
> 
> What is the recommended way to find out when an rbd-Image was last modified ?
> 
> Thanks
>   Christoph
> 
> --
> Christoph Adomeit
> GATWORKS GmbH
> Reststrauch 191
> 41199 Moenchengladbach
> Sitz: Moenchengladbach
> Amtsgericht Moenchengladbach, HRB 6303
> Geschaeftsfuehrer:
> Christoph Adomeit, Hans Wilhelm Terstappen
> 
> christoph.adom...@gatworks.de  Internetloesungen vom 
> Feinsten
> Fon. +49 2166 9149-32  Fax. +49 2166 9149-10
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com 
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com 
> 
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com