Hi Marc, Whilst I agree CephFS would probably help compared to your present solution, what I'm looking for something that can talk to a the RadosGW restful object storage APIs, so that the backing storage can be durable and low-cost, i.e., on an erasure coded pool. In this case we're looking to backup a Lustre filesystem.
Cheers, On 3 March 2017 at 21:29, Marc Roos <m.r...@f1-outsourcing.eu> wrote: > > Hi Blair, > > We are also thinking of using ceph for 'backup'. At the moment we are > using rsync and hardlinks on a drbd setup. But I think when using cephfs > things could speed up, because file information is gotten from the mds > daemon, so this should save on one rsync file lookup, and we expect that > we can run more tasks in parallel. > > > > > > -----Original Message----- > From: Blair Bethwaite [mailto:blair.bethwa...@gmail.com] > Sent: vrijdag 3 maart 2017 0:55 > To: ceph-users@lists.ceph.com > Subject: [ceph-users] object store backup tool recommendations > > Hi all, > > Does anyone have any recommendations for good tools to perform > file-system/tree backups and restores to/from a RGW object store (Swift > or S3 APIs)? Happy to hear about both FOSS and commercial options > please. > > I'm interested in: > 1) tools known to work or not work at all for a basic file-based data > backup > > Plus these extras: > 2) preserves/restores correct file metadata (e.g. owner, group, acls > etc) > 3) preserves/restores xattrs > 4) backs up empty directories and files > 5) supports some sort of snapshot/versioning/differential functionality, > i.e., will keep a copy or diff or last N versions of a file or whole > backup set, e.g., so that one can restore yesterday's file/s or last > week's but not have to keep two full copies to achieve it > 6) is readily able to restore individual files > 7) can encrypt/decrypt client side > > 8) anything else I should be considering > > -- > > Cheers, > ~Blairo > > > -- Cheers, ~Blairo
_______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com