Re: Multiple database backup strategy

2016-03-10 Thread Nick Wood
Thanks for the suggestions. @Paul, I did some basic testing with rsync. It seems like the checksuming isn't super efficient if I'm trying to maintain up-to-the-minute backups of large databases (> 1GB) because the whole file has to be read to checksum it. I could just append without checksuming

Re: Multiple database backup strategy

2016-03-10 Thread Jan Lehnardt
> On 09 Mar 2016, at 21:29, Nick Wood wrote: > > Hello, > > I'm looking to back up a CouchDB server with multiple databases. Currently > 1,400, but it fluctuates up and down throughout the day as new databases > are added and old ones deleted. ~10% of the databases are

Re: Multiple database backup strategy

2016-03-09 Thread Paul Okstad
Hey Nick, I run a server with several thousand databases. I found that replicating them continuously to a global DB for backup caused CPU usage to skyrocket. My current solution is to use rsync along with rsync.net to backup my database files via a scheduled cron job. Rsync is really efficient

Multiple database backup strategy

2016-03-09 Thread Nick Wood
Hello, I'm looking to back up a CouchDB server with multiple databases. Currently 1,400, but it fluctuates up and down throughout the day as new databases are added and old ones deleted. ~10% of the databases are written to within any 5 minute period of time. Goals - Maintain a continual