Re: Global backup solution for FBSD Ubuntu
On 7/4/2010 4:43 PM, bsd wrote: Hello, I am trying to build a global backup solution for couple of strategic servers (7) based on two operating systems : - FreeBSD (6 - 7 // soon 7 - 8) - Ubuntu 8.04 LTS These servers are hosting some strategic components mainly related to DNS infrastructure and databases. For the moment I am backing up these server using network based backup solution: - A duplicity based solution which backs up key directories in my infrastructure on a remote FTP server provided by my hosting company. - A dump of some key components which I am doing on regular basis for FreeBSD servers. - Duplicity is also used for the Ubuntu servers. - Databases are replicated live on a remote server using slony for the most strategic ones (Postgres DB) and using mysql dump export for MySQL. • I am not a 100% sure these solutions will allow me to restart rapidly from a crash, specially for Ubuntu servers. • I would like to know which solution(s) you have deployed at what cost for what results ? I am actually considering couple of different solutions - SAIT solution and backula. - Disk based solution (maybe also with backula). … I have couple of servers that will reach their end of life that could be recycled as backup solution at a very convenient price… Thanks for you help. Gregober --- PGP ID -- 0x1BA3C2FD bsd @at@ todoo.biz Followup FYI: http://www.mondorescue.org/ -- Tim Daneliuk tun...@tundraware.com PGP Key: http://www.tundraware.com/PGP/ ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: Global backup solution for FBSD Ubuntu
krad writes: In my experience dedup requires a fairly large amount of juice so if your backups are large I hope you machines are big on ram The way tarsnap does it is not that intensive. I have used in an old 900Mhz machine with less than 640MB of RAM and it worked well. I think the program computes some sort of hash for blocks of data and then the server checks to see if it already has that block. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: Global backup solution for FBSD Ubuntu
On 8 July 2010 05:10, Francisco Reyes li...@stringsutils.com wrote: bsd writes: I am trying to build a global backup solution for couple of strategic servers (7) based on two operating systems : Depending on how much data you are trying to backup and whether an internet backup solution would work, you may want to take a look at tarsnap: http://www.tarsnap.com/ Works on both FreeBSD and Linux. It has deduplication capabilities within a server. You can do several backups as full and the service will only store what has changed. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org In my experience dedup requires a fairly large amount of juice so if your backups are large I hope you machines are big on ram ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: Global backup solution for FBSD Ubuntu
I used to use tapes, I have changed for disks, it is much much faster and easier. And cheaper! In a 3U enclosure you can have 16 disks, for 32TB of storage. A sun x4500 can get 48 drives in 4u. Its intel based so should run freebsd ok if you want to. Not sure what the max drive size is but you should be looking at about ~30-70 TB depending on drive size and array configuration ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: Global backup solution for FBSD Ubuntu
bsd writes: I am trying to build a global backup solution for couple of strategic servers (7) based on two operating systems : Depending on how much data you are trying to backup and whether an internet backup solution would work, you may want to take a look at tarsnap: http://www.tarsnap.com/ Works on both FreeBSD and Linux. It has deduplication capabilities within a server. You can do several backups as full and the service will only store what has changed. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: Global backup solution for FBSD Ubuntu
On 4 July 2010 23:18, Tim Daneliuk tun...@tundraware.com wrote: On 07/04/10 16:43, bsd wrote: Hello, I am trying to build a global backup solution for couple of strategic servers (7) based on two operating systems : - FreeBSD (6 - 7 // soon 7 - 8) - Ubuntu 8.04 LTS These servers are hosting some strategic components mainly related to DNS infrastructure and databases. For the moment I am backing up these server using network based backup solution: - A duplicity based solution which backs up key directories in my infrastructure on a remote FTP server provided by my hosting company. - A dump of some key components which I am doing on regular basis for FreeBSD servers. - Duplicity is also used for the Ubuntu servers. - Databases are replicated live on a remote server using slony for the most strategic ones (Postgres DB) and using mysql dump export for MySQL. • I am not a 100% sure these solutions will allow me to restart rapidly from a crash, specially for Ubuntu servers. • I would like to know which solution(s) you have deployed at what cost for what results ? I am actually considering couple of different solutions - SAIT solution and backula. - Disk based solution (maybe also with backula). … I have couple of servers that will reach their end of life that could be recycled as backup solution at a very convenient price… I wrote a simple shell-based solution for this problem some time ago. It (and FreeBSD instructions) can be found: http://www.tundraware.com/Software/tbku/ I am able to recover a production server (DNS, dhcp, http, sendmail, etc...) in under 30 minutes using this technique. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org we use an rsync based solution at work. All the files are basically rsyncd onto a big opensolaris filer backed with zfs. We then snapshot each hosts file system after the completed backup. It then gives us an incremental forever backup so is generally quite fast to do. Restores are also fairly fast depending on the size of the data set. For a full restore I boot into the new box on a liveusb os, partition/slice, newfs, mount and push the rsync back. All fairly easy and quick. With regard to database backups, we run all our mysql and oracle dbs on zfs. This allows us to put a global write lock on the db and flush everything to disk. We then snapshot the db zfs fs and remove the write lock. Alternatively if its a mysql slave, we just stop the slave, flush and snap. This means we can take hot backups of all our dbs with minimal impact. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: Global backup solution for FBSD Ubuntu
Hi, I am trying to build a global backup solution for couple of strategic servers (7) based on two operating systems : - FreeBSD (6 - 7 // soon 7 - 8) - Ubuntu 8.04 LTS I am running amanda as a centralized backup solution for FreeBSD, Linuxes and Windows. Amanda server is a dedicated machine with 7.5 TB disks (about 2300 USD assembly machine, gives me over 4 weeks or daily incremental backup, but the duration really depends on your usage). The more sensitive services I also backup using the protocol own duplication (master-slave database, DNS replication, etc.) With MySQL server replication, you can have the slave server running your actual database and ready to go in case the primary crashes. If the availability of the service is really critical, you must consider an high-availability solution, not only a backup. With that I have all the needed information to restore a faulty service. - SAIT solution and backula. I used to use tapes, I have changed for disks, it is much much faster and easier. And cheaper! In a 3U enclosure you can have 16 disks, for 32TB of storage. ∙ I am not a 100% sure these solutions will allow me to restart rapidly from a crash, specially for Ubuntu servers. Depends on how you define rapidly... Backup and high availability have different/complementary roles: the first one assures that no data are lost, the second assures that the service will always be available. You know your needs :) Best regards, Olivier ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Global backup solution for FBSD Ubuntu
Hello, I am trying to build a global backup solution for couple of strategic servers (7) based on two operating systems : - FreeBSD (6 - 7 // soon 7 - 8) - Ubuntu 8.04 LTS These servers are hosting some strategic components mainly related to DNS infrastructure and databases. For the moment I am backing up these server using network based backup solution: - A duplicity based solution which backs up key directories in my infrastructure on a remote FTP server provided by my hosting company. - A dump of some key components which I am doing on regular basis for FreeBSD servers. - Duplicity is also used for the Ubuntu servers. - Databases are replicated live on a remote server using slony for the most strategic ones (Postgres DB) and using mysql dump export for MySQL. • I am not a 100% sure these solutions will allow me to restart rapidly from a crash, specially for Ubuntu servers. • I would like to know which solution(s) you have deployed at what cost for what results ? I am actually considering couple of different solutions - SAIT solution and backula. - Disk based solution (maybe also with backula). … I have couple of servers that will reach their end of life that could be recycled as backup solution at a very convenient price… Thanks for you help. Gregober --- PGP ID -- 0x1BA3C2FD bsd @at@ todoo.biz ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: Global backup solution for FBSD Ubuntu
On 07/04/10 16:43, bsd wrote: Hello, I am trying to build a global backup solution for couple of strategic servers (7) based on two operating systems : - FreeBSD (6 - 7 // soon 7 - 8) - Ubuntu 8.04 LTS These servers are hosting some strategic components mainly related to DNS infrastructure and databases. For the moment I am backing up these server using network based backup solution: - A duplicity based solution which backs up key directories in my infrastructure on a remote FTP server provided by my hosting company. - A dump of some key components which I am doing on regular basis for FreeBSD servers. - Duplicity is also used for the Ubuntu servers. - Databases are replicated live on a remote server using slony for the most strategic ones (Postgres DB) and using mysql dump export for MySQL. • I am not a 100% sure these solutions will allow me to restart rapidly from a crash, specially for Ubuntu servers. • I would like to know which solution(s) you have deployed at what cost for what results ? I am actually considering couple of different solutions - SAIT solution and backula. - Disk based solution (maybe also with backula). … I have couple of servers that will reach their end of life that could be recycled as backup solution at a very convenient price… I wrote a simple shell-based solution for this problem some time ago. It (and FreeBSD instructions) can be found: http://www.tundraware.com/Software/tbku/ I am able to recover a production server (DNS, dhcp, http, sendmail, etc...) in under 30 minutes using this technique. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
