Hi Scott, I've been looking into scaling BackupPC to some extent.
Object storage is not yet feasible in v4, due to some database-like files being kept in the parts that would go into object storage (cpool). Also, in the current development builds, there are several fairly heavy operations on the cpool that would slow it all down too much. Some may be avoidable in future builds. Running BackupPC as a symmetric/same-config scale-out solution is not possible due to many reasons. Splitting up the work is perfectly doable, though, if you can sacrifice deduplication between the instances. If we are talking PB's of data, node-based storage is likely not feasible. If your files are mostly large, then network based storage is a good option. My experiences with ceph remote block devices in this kind of setting are positive. If the files are mostly small, you may be hit by random access latency with any network-based solution. If your data is a mix of large and small, consider splitting them up if the small can fit on local storage where small random I/O is orders of magnitude faster. In order to scale the filesystem itself, I would opt for a copy-on-write filesystem, since these fit the case of storing static files well. Most also give you data integrity verification out of the box. For example, key benefits of ZFS are: - Data integrity verification - Automatic bit rot fixing if you run ZFS built-in RAID - Snapshot send/receive for remote replication faster than rsync - Transparent compression - Dynamic, on-line resizing So with ZFS, you can handle both compression and data integrity checking outside of BackupPC, speeding things up a lot. I have not tried ZFS on ceph yet, though. Balancing the redundancy optimally is an issue in this scenario, since taking advantage of both ceph and ZFS easily costs 4 times (twice for each, or ~1.3 times for ZFS and three times for ceph) the space of the data to be stored plus plenty of RAM. (Note that googling 'ZFS on ceph' gives a lot of issues about ceph on ZFS OSD's, which is irrelevant here.) Best regards, Johan Ehnberg -- Johan Ehnberg jo...@molnix.com +358503209688 Molnix Oy molnix.com ------------------------------------------------------------------------------ Check out the vibrant tech community on one of the world's most engaging tech sites, SlashDot.org! http://sdm.link/slashdot _______________________________________________ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List: https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki: http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/