mdadm break / restore soft mirror
Hi, Question for you guys. A brief history: RHEL 4 AS I have a partition with way to many small files on (Usually around a couple of million) that needs to be backed up, standard methods mean that a restore is impossibly slow due to the sheer volume of files. Solution, raw backup /restore of the device. However the partition is permanently being accessed. Proposed solution is to use software raid mirror. Before backup starts, break the soft mirror unmount and backup partition restore soft mirror and let it resync / rebuild itself. Would the above intentional break/fix of the mirror cause any problems? Regards, Brett Brett Maton Linux Consultant RHCE #805007238628267 --- This email, and the contents contained within, are private and confidential between the sender and the individual(s) to whom it is addressed. The contents do not necessarily represent the views of Simplyhealth Group Limited. In the event of misdirection, the recipient is prohibited from using, copying or disseminating it or any information contained in it. If you have received this email in error please notify Simplyhealth immediately by telephone on 0845 075 2020, or by email to [EMAIL PROTECTED] Simplyhealth Group Limited is registered and incorporated in England and Wales as a company limited by guarantee. Its registered office is at Hambleden House, Waterloo Court, Andover, Hampshire, SP10 1LQ, registered no. 5445654. We may record or monitor telephone calls to help improve our service and protect our members. --- - To unsubscribe from this list: send the line unsubscribe linux-raid in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html
Re: mdadm break / restore soft mirror
Brett Maton wrote: Hi, Question for you guys. A brief history: RHEL 4 AS I have a partition with way to many small files on (Usually around a couple of million) that needs to be backed up, standard methods mean that a restore is impossibly slow due to the sheer volume of files. Solution, raw backup /restore of the device. However the partition is permanently being accessed. Proposed solution is to use software raid mirror. Before backup starts, break the soft mirror unmount and backup partition restore soft mirror and let it resync / rebuild itself. Would the above intentional break/fix of the mirror cause any problems? Is there a reason you can't use rsync to just update changes from the previous backup, once you have your initial one? Regards, Richard - To unsubscribe from this list: send the line unsubscribe linux-raid in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html
Re: mdadm break / restore soft mirror
On Wednesday December 12, [EMAIL PROTECTED] wrote: Hi, Question for you guys. A brief history: RHEL 4 AS I have a partition with way to many small files on (Usually around a couple of million) that needs to be backed up, standard methods mean that a restore is impossibly slow due to the sheer volume of files. Solution, raw backup /restore of the device. However the partition is permanently being accessed. Proposed solution is to use software raid mirror. Before backup starts, break the soft mirror unmount and backup partition restore soft mirror and let it resync / rebuild itself. Would the above intentional break/fix of the mirror cause any problems? No, it should work fine. If you can be certain that the device that you break out of the mirror is never altered, then you could add an internal bitmap while the array is split and the rebuild will go much faster. However even mounting a device readonly will sometimes alter the content (e.g. if ext3 needs to replay the journal) so you need to be very careful. NeilBrown - To unsubscribe from this list: send the line unsubscribe linux-raid in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html
Re: mdadm break / restore soft mirror
Proposed solution is to use software raid mirror. Before backup starts, break the soft mirror unmount and backup partition I use this method for backup once a week. One challenge is drives aren't great at steaming data quickly (for the resync) while also doing a lot of random access. Having a little extra redundancy (think 3 or more drives in the RAID-1) can really help. If you can be certain that the device that you break out of the mirror is never altered, then you could add an internal bitmap while the array is split and the rebuild will go much faster. Is this also a viable speedup for the kep rotating backup drives through the array strategy? If so, how much speedup are we talking about? Assume the array changes by 1% before a backup drive gets rotated in again. Jeff - To unsubscribe from this list: send the line unsubscribe linux-raid in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html
RE: mdadm break / restore soft mirror
Proposed solution is to use software raid mirror. Before backup starts, break the soft mirror unmount and backup partition I use this method for backup once a week. One challenge is drives aren't great at steaming data quickly (for the resync) while also doing a lot of random access. Having a little extra redundancy (think 3 or more drives in the RAID-1) can really help. If you can be certain that the device that you break out of the mirror is never altered, then you could add an internal bitmap while the array is split and the rebuild will go much faster. When the device is split from the mirror it will only be read as a raw device by the backup software (NetBackup) and not actually mounted during the process so it really shouldn't be modified in anyway at all. Also during the backup window files will only be being created on remaining device (reports pdf's) so random access shouldn't be a problem either. How do I create the internal bitmap? man mdadm didn't shed any light and my brief excursion into google wasn't much more helpful. The version I have installed is mdadm-1.12.0-5.i386 from RedHat which would appear to be way out of date! Thanks for you help, Brett --- This email, and the contents contained within, are private and confidential between the sender and the individual(s) to whom it is addressed. The contents do not necessarily represent the views of Simplyhealth Group Limited. In the event of misdirection, the recipient is prohibited from using, copying or disseminating it or any information contained in it. If you have received this email in error please notify Simplyhealth immediately by telephone on 0845 075 2020, or by email to [EMAIL PROTECTED] Simplyhealth Group Limited is registered and incorporated in England and Wales as a company limited by guarantee. Its registered office is at Hambleden House, Waterloo Court, Andover, Hampshire, SP10 1LQ, registered no. 5445654. We may record or monitor telephone calls to help improve our service and protect our members. --- - To unsubscribe from this list: send the line unsubscribe linux-raid in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html
