Re: [ceph-users] details about cloning objects using librados

2019-08-02 Thread nokia ceph
Thank you Greg, it is now clear for us and the option is only available in C++ , we need to rewrite the client code with c++ . Thanks, Muthu On Fri, Aug 2, 2019 at 1:05 AM Gregory Farnum wrote: > On Wed, Jul 31, 2019 at 10:31 PM nokia ceph > wrote: > > > > Thank you Greg, > > > > Another

Re: [ceph-users] details about cloning objects using librados

2019-08-01 Thread Gregory Farnum
On Wed, Jul 31, 2019 at 10:31 PM nokia ceph wrote: > > Thank you Greg, > > Another question , we need to give new destination object , so that we can > read them separately in parallel with src object . This function resides in > objector.h , seems to be like internal and can it be used in

Re: [ceph-users] details about cloning objects using librados

2019-07-31 Thread nokia ceph
Thank you Greg, Another question , we need to give new destination object , so that we can read them separately in parallel with src object . This function resides in objector.h , seems to be like internal and can it be used in interface level and can we use this in our client ? Currently we

Re: [ceph-users] details about cloning objects using librados

2019-07-31 Thread Gregory Farnum
On Wed, Jul 31, 2019 at 1:32 AM nokia ceph wrote: > Hi Greg, > > We were trying to implement this however having issues in assigning the > destination object name with this api. > There is a rados command "rados -p cp " , is > there any librados api equivalent to this ? > The copyfrom

Re: [ceph-users] details about cloning objects using librados

2019-07-31 Thread nokia ceph
Hi Greg, We were trying to implement this however having issues in assigning the destination object name with this api. There is a rados command "rados -p cp " , is there any librados api equivalent to this ? Thanks, Muthu On Fri, Jul 5, 2019 at 4:00 PM nokia ceph wrote: > Thank you Greg,

Re: [ceph-users] details about cloning objects using librados

2019-07-05 Thread nokia ceph
Thank you Greg, we will try this out . Thanks, Muthu On Wed, Jul 3, 2019 at 11:12 PM Gregory Farnum wrote: > Well, the RADOS interface doesn't have a great deal of documentation > so I don't know if I can point you at much. > > But if you look at Objecter.h, you see that the ObjectOperation

Re: [ceph-users] details about cloning objects using librados

2019-07-03 Thread Gregory Farnum
Well, the RADOS interface doesn't have a great deal of documentation so I don't know if I can point you at much. But if you look at Objecter.h, you see that the ObjectOperation has this function: void copy_from(object_t src, snapid_t snapid, object_locator_t src_oloc, version_t src_version,

Re: [ceph-users] details about cloning objects using librados

2019-07-03 Thread nokia ceph
Hi Greg, Can you please share the api details for COPY_FROM or any reference document? Thanks , Muthu On Wed, Jul 3, 2019 at 4:12 AM Brad Hubbard wrote: > On Wed, Jul 3, 2019 at 4:25 AM Gregory Farnum wrote: > > > > I'm not sure how or why you'd get an object class involved in doing > >

Re: [ceph-users] details about cloning objects using librados

2019-07-02 Thread Brad Hubbard
On Wed, Jul 3, 2019 at 4:25 AM Gregory Farnum wrote: > > I'm not sure how or why you'd get an object class involved in doing > this in the normal course of affairs. > > There's a copy_from op that a client can send and which copies an > object from another OSD into the target object. That's

Re: [ceph-users] details about cloning objects using librados

2019-07-02 Thread Gregory Farnum
I'm not sure how or why you'd get an object class involved in doing this in the normal course of affairs. There's a copy_from op that a client can send and which copies an object from another OSD into the target object. That's probably the primitive you want to build on. Note that the OSD doesn't

Re: [ceph-users] details about cloning objects using librados

2019-07-02 Thread Brad Hubbard
Yes, this should be possible using an object class which is also a RADOS client (via the RADOS API). You'll still have some client traffic as the machine running the object class will still need to connect to the relevant primary osd and send the write (presumably in some situations though this

Re: [ceph-users] details about cloning objects using librados

2019-07-02 Thread nokia ceph
Hi Brett, I think I was wrong here in the requirement description. It is not about data replication , we need same content stored in different object/name. We store video contents inside the ceph cluster. And our new requirement is we need to store same content for different users , hence need

Re: [ceph-users] details about cloning objects using librados

2019-07-01 Thread Brett Chancellor
Ceph already does this by default. For each replicated pool, you can set the 'size' which is the number of copies you want Ceph to maintain. The accepted norm for replicas is 3, but you can set it higher if you want to incur the performance penalty. On Mon, Jul 1, 2019, 6:01 AM nokia ceph wrote:

Re: [ceph-users] details about cloning objects using librados

2019-07-01 Thread nokia ceph
Hi Brad, Thank you for your response , and we will check this video as well. Our requirement is while writing an object into the cluster , if we can provide number of copies to be made , the network consumption between client and cluster will be only for one object write. However , the cluster

Re: [ceph-users] details about cloning objects using librados

2019-06-27 Thread Brad Hubbard
On Thu, Jun 27, 2019 at 8:58 PM nokia ceph wrote: > > Hi Team, > > We have a requirement to create multiple copies of an object and currently we > are handling it in client side to write as separate objects and this causes > huge network traffic between client and cluster. > Is there

[ceph-users] details about cloning objects using librados

2019-06-27 Thread nokia ceph
Hi Team, We have a requirement to create multiple copies of an object and currently we are handling it in client side to write as separate objects and this causes huge network traffic between client and cluster. Is there possibility of cloning an object to multiple copies using librados api?