Hi We are working with a lot of smaller databases, (The biggest is 600MB) so I am not sure about single large files.
It works by checksumming parts of the file (not sure at what level), so if only one of twenty sections has changed it will only update that section. So if most of your 10GB is static data then it will need very little updating. Peter ----------------------------------------------- Excellence in internet and open source software ----------------------------------------------- Sunmaia Birmingham UK www.sunmaia.net tel. 0121-242-1473 International +44-121-242-1473 ----------------------------------------------- -----Original Message----- From: Steve Vernon [mailto:[EMAIL PROTECTED] Sent: 31 October 2003 14:19 To: Peter Lovatt; Mysql List Subject: Re: Hardware Raid and 2 Gig Limit Hiya! Thanks for the help!!! Do RSync like big files? Or does it prefer smaller files? I see it supports larger than 2 Gig files, but, Ive not seen any speed comparrisons etc. E.g. one big file, or 10 small ones for example. THANKS! Steve ----- Original Message ----- From: "Peter Lovatt" <[EMAIL PROTECTED]> To: "Steve Vernon" <[EMAIL PROTECTED]>; "Mysql List" <[EMAIL PROTECTED]> Cc: <[EMAIL PROTECTED]> Sent: Friday, October 31, 2003 12:17 PM Subject: RE: Hardware Raid and 2 Gig Limit > Hi > > We have a similar challenge. Offsite backups with huge amounts of data, > without spending a fortune. > > We have a local Linux box and the remote server both running rsync. > > http://samba.anu.edu.au/rsync/ > > Rsync is brilliant because it only updates file sectors that have changed. > We would only use it if we can stop MySql but then synchronising takes > minutes (1MB broadband connection), particularly using compression. > > If you cannot add your own server software MySql files also compress very > well (gzip 90%+), but this means some server load. > > HTH > > Peter > > > ----------------------------------------------- > Excellence in internet and open source software > ----------------------------------------------- > Sunmaia > Birmingham > UK > www.sunmaia.net > tel. 0121-242-1473 > International +44-121-242-1473 > ----------------------------------------------- > > > > > > > -----Original Message----- > From: Steve Vernon [mailto:[EMAIL PROTECTED] > Sent: 31 October 2003 12:00 > To: Mysql List > Cc: [EMAIL PROTECTED] > Subject: Re: Hardware Raid and 2 Gig Limit > > > Hiya! > > Thanks for the quick reply!!! > > But dosen't it make more sense to have 20 0.5 Gig files rather than one 10 > Gig file? > > I know you can split files, but basically because we have raid I trust it to > a point. But I would like to make backup's. It costs a lot to have our > server provider to do backup's themselves. We can't afford replication and > backups at the moment. So I plan to stop MySQL. Copy the database files to a > temp directory. THen download them at my leisure. Oh and I suppose I need to > start MySQL then! ;-) The backup will be to Windows 2000, and I want to be > able to use the local copy of the files. > > So if I have smaller files, I can download them, and keep a local copy. > Theres no way I want to start downloading a 10 Gig file from the server. Ok > I can do it, I have a download manager etc, Iv'e downloaded bigger. But I > guess it must be a massive strain on the server sending the data, and we > dont have that fast an internet connection so it's easier. We only have 512 > broadband and it sometimes messes up files larger than 2 Gig. The download > manager realises there is a problem, seems to backtrack or something, so > takes ages. Cable is not available where I live. > > If we go beyond 10 Gigs, it just increases the complexity. > > Do you or anyone know of any serious speed differences between having one > file or 20 smaller files for one table? With one files, isn't there a worry > if it gets corrupted you loose the lot? > > A couple of years ago I looked into big tables for myself and everyone said > you need the raid option in MySQL. Now I'm not sure! > > Thanks, > > Steve > > > > ----- Original Message ----- > From: "David T-G" <[EMAIL PROTECTED]> > To: "mysql users" <[EMAIL PROTECTED]> > Cc: "Steve Vernon" <[EMAIL PROTECTED]> > Sent: Friday, October 31, 2003 10:44 AM > Subject: Re: Hardware Raid and 2 Gig Limit > > > > -----BEGIN PGP SIGNED MESSAGE----- > > Hash: SHA1 > > > > Steve -- > > > > ...and then Steve Vernon said... > > % > > % Hello, > > > > Hi! > > > > > > % > > % Does the 2 Gig file size limit on Linux get broken when I have a > hardware > > % raid controller? > > > > The limit applies only to ext2 filesystems, and not all of them at that; > > ext3 and reiserfs (and others) can happily write much larger files. > > > > > > % > > % My ISP says I don't need the raid option activated on MySQL. > > > > I would generally agree. I can't imagine an ISP not using a journalled > > filesystem such as those above. More to the point, though, the mysql > > raid option has nothing to do with disk RAID; they are completely > > separate. > > > > > > % > > % Thanks, > > % > > % Steve > > > > > > HTH & HAND > > > > :-D > > - -- > > David T-G * There is too much animal courage in > > (play) [EMAIL PROTECTED] * society and not sufficient moral courage. > > (work) [EMAIL PROTECTED] -- Mary Baker Eddy, "Science and > Health" > > http://justpickone.org/davidtg/ Shpx gur Pbzzhavpngvbaf Qrprapl Npg! > > > > -----BEGIN PGP SIGNATURE----- > > Version: GnuPG v1.0.7 (FreeBSD) > > > > iD8DBQE/ojzyGb7uCXufRwARAtEmAJ9i3oIMbLTA4yq8koPcEOUwD7SpRwCfe+bn > > rvzVjuD8tIxO8AVj3jp02CI= > > =QdfG > > -----END PGP SIGNATURE----- > > > > -- > > MySQL General Mailing List > > For list archives: http://lists.mysql.com/mysql > > To unsubscribe: > http://lists.mysql.com/[EMAIL PROTECTED] > > > > > -- > MySQL General Mailing List > For list archives: http://lists.mysql.com/mysql > To unsubscribe: http://lists.mysql.com/[EMAIL PROTECTED] > > > > > -- > MySQL General Mailing List > For list archives: http://lists.mysql.com/mysql > To unsubscribe: http://lists.mysql.com/[EMAIL PROTECTED] > -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe: http://lists.mysql.com/[EMAIL PROTECTED]
