Thanks Neil..Yes, that will be a great add to Ceph’s feature list..
For now, probably I should use the tool that Ben pointed out.

Regards
Somnath

From: Neil Levine [mailto:[email protected]]
Sent: Wednesday, July 08, 2015 9:04 PM
To: Somnath Roy
Cc: [email protected]; Yehuda Sadeh
Subject: Re: [ceph-users] Transfering files from NFS to ceph + RGW

There is an initial prototype of the NFS layer to RGW using Ganesha. Yehuda can 
probably give an update on its status. The use case for it is exactly as you 
describe: to allow you to migrate data of NFS shares to the S3-object store. 
It's not going to be high performance or be feature rich but hopefully will do 
enough to allow data migration.

On Wed, Jul 8, 2015 at 7:01 PM, Somnath Roy 
<[email protected]<mailto:[email protected]>> wrote:
Hi,
We are planning to build a Ceph cluster with RGW/S3 as the interface for user 
access. We have PB level of data in NFS share which needs to be moved to the 
Ceph cluster and that’s why I need your valuable input on how to efficiently do 
that. I am sure this is a common problem that RGW users in Ceph community have 
faced and resolved ☺ .
I can think of the following approach.

Since the data needs to be accessed later with RGW/S3 , we have to write an 
application that can PUT the existing files as objects  over RGW+S3 interface 
to the cluster.

Is there any alternative approach ?
There are existing RADOS tools that can take files as input and store it in a 
cluster , but, unfortunately RGW probably will not be able to understand those.
IMO, there should be a channel where we can use these rados utility to store 
the objects in .rgw.data pool and RGW should be able to read the objects. This 
will solve lot of data migration problem (?).
Also, probably this blueprint 
(https://wiki.ceph.com/Planning/Blueprints/Infernalis/RGW%3A_NFS) of Yehuda’s 
trying to solve similar problem…

Anyways, Please share your thoughts and let me know if anybody already has a 
workaround for this.

Thanks & Regards
Somnath

________________________________

PLEASE NOTE: The information contained in this electronic mail message is 
intended only for the use of the designated recipient(s) named above. If the 
reader of this message is not the intended recipient, you are hereby notified 
that you have received this message in error and that any review, 
dissemination, distribution, or copying of this message is strictly prohibited. 
If you have received this communication in error, please notify the sender by 
telephone or e-mail (as shown above) immediately and destroy any and all copies 
of this message in your possession (whether hard copies or electronically 
stored copies).

_______________________________________________
ceph-users mailing list
[email protected]<mailto:[email protected]>
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

_______________________________________________
ceph-users mailing list
[email protected]
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Reply via email to