Re: Disk Mirroring in Sarge howto
hi ya On Tue, 14 Jun 2005, Siju George wrote: I want to have the following partitions in both the hard disk / - 500 MB - Primary good swap - 2 GB - Primary bad location ?? if it is partition#2 /usr - 5 GB - Primary ok /home - 500 MB - Logical extreme bad idea if you have users /tmp - 5 GB - Logical extreme bad idea unless oyu have specific applications that will run that requires /tmp to be that big most apps uses less than 100mb of /tmp or /var/tmp or /usr/tmp /var/log - 5 GB -logical wow .. you're collecting tons of log data ?? - how much data do you have now in /var/log /var - rest of the disk - logical extreme bad idea ... unless you have users - if you are intending to make a complete debian mirror in /var/apt and equiv .. than it might be okay, but i'd separate /var for users vs /var for system to keep itself running you cannot ever provide enough disk space for uwers or your own applications .. you will always run out of space .. some apps require /opt in which case / is too small I prefer ext3 or ReiserFS for file systems. or xfs or jfs .. for disks that are say 500GB or more ... i'm not even gonna try using ext3 ... for partitions over 2TB ... its gonna be a fun testing game of which apps crash first because it used the wrong libs How should I go about it??? manually fdisk it ... or write a small script ( 5-10 minutes ) write a 2nd script to copy over the data mount /dev/somthing newdisk cp -dpar /lib /boot /bin /sbin /home /var /newdisk sync chroot /newdisk rerun lilo or grub or dd the mbr reboot c ya alvin -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of unsubscribe. Trouble? Contact [EMAIL PROTECTED]
Re: Disk Mirroring in Sarge howto
Thankyou so much Alvin for the detailed reply :-) Could you please answer some of my doubts based on your feed back? On 6/14/05, Alvin Oga [EMAIL PROTECTED] wrote: hi ya On Tue, 14 Jun 2005, Siju George wrote: I want to have the following partitions in both the hard disk / - 500 MB - Primary good swap - 2 GB - Primary bad location ?? if it is partition#2 Yes its partition 2 . what would be an appropriate location??? I just followed the BSD way where swap (b) comes immediately after / (a). What is appropriate for linux?? /usr - 5 GB - Primary ok actually i won't have much aplications, so I think it must be a bit large but its alright I think especialy if I get ideas later :-) /home - 500 MB - Logical extreme bad idea if you have users I have no users that need a home directory. This will be basically a webserver (apache) and also a backup server. The webserver won't be up most the time so infact this is going to be a dedicated backup server that takes backups from Linux, MS Windows etc. I think of using bacula for taking backup from linux and a smbclient,tar,rsync something for taking backup from MS Windows so I hope 500 MB is o.k??? or is it more??? :-) /tmp - 5 GB - Logical extreme bad idea unless oyu have specific applications that will run that requires /tmp to be that big What would you sugget?? most apps uses less than 100mb of /tmp or /var/tmp or /usr/tmp I see. Thankyou for letting me know. :-) /var/log - 5 GB -logical wow .. you're collecting tons of log data ?? - how much data do you have now in /var/log last time I did't check but what would you suggest?? but I've noticed increase upto 100 MB sometimes in a matter of two days. /var - rest of the disk - logical extreme bad idea ... unless you have users - if you are intending to make a complete debian mirror in /var/apt and equiv .. than it might be okay, but i'd separate /var for users vs /var for system to keep itself running Could you please explain this a little more to me? you cannot ever provide enough disk space for uwers or your own applications .. you will always run out of space .. some apps require /opt in which case / is too small o.k I use on this system Apache PHP4 MySQL Samba Postfix Qpopper Bacula thats it for now. Do you suggets I create a seperate /opt partition??? if so how much size?? I prefer ext3 or ReiserFS for file systems. or xfs or jfs .. for disks that are say 500GB or more ... i'm not even gonna try using ext3 ... for partitions over 2TB ... its gonna be a fun testing game of which apps crash first because it used the wrong libs I 've only used Ext3 till now because I heard data recover is difficult in all others except ext2. and also I understand that ReiserFS is better than XFS if the system goes down suddenly due to power failure. Don't know much about JFS :-( this hard disk is only 40 GB :-) Thankyou so much once again for taking time to explain things to me :-) good luck! kind regards Siju
Re: Disk Mirroring in Sarge howto
Le mardi 14 juin 2005 à 09:27 +0530, Siju George a écrit : On 6/13/05, Aurélien Campéas [EMAIL PROTECTED] wrote: Le lundi 13 juin 2005 à 12:58 +0530, Siju George a écrit : Hi all, I would like to implement Disk mirroring ( Raid1 ) in Debian Sarge. Is it possible to configure it while installation if I have both hard disks attached?? Could someone please tell me what is the easiest way ( steps ) to get this done??? I hope it will be easy because the Installer has an option to configure software RAID but I a not able to get doing it successfully :-( Can you give more details about what's going on ? Without much, nobody will be able to help. Thankyou so much Aurélien for responding! Note that I know next to nothing wrt RAID Debian. But you need to explain your concerns better. I have two hard disks 40 GB each! I want to have RAID 1 including the / partition and boot loader. ie if one hard disk goes down I should be able to boot from the other one. How do I configure it with the installer?? I want to have the following partitions in both the hard disk / - 500 MB - Primary swap - 2 GB - Primary /usr - 5 GB - Primary /home - 500 MB - Logical /tmp - 5 GB - Logical /var/log - 5 GB -logical /var - rest of the disk - logical Do you *really* need to split hairs like that ? Do you know the drawbacks of segmenting your hard drives into so many partitions vs. the supposed benefits ? I prefer ext3 or ReiserFS for file systems. I now prefer reiserfs over ext3. How should I go about it??? is it possible to configure these partitions in the first hard disk and finish the install and then later do the mirroring? I suspect not, but again, I didn't try even once ... or is it possible to do the mirroring also during the install??? See Alvin's answer. Check by yourself : just go ahead and try RAID from the installer ! And then tell us how it went :) ** This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the system manager. This footnote also confirms that this email message has been swept by MIMEsweeper for the presence of computer viruses. www.clearswift.com **
Re: Disk Mirroring in Sarge howto
On 6/14/05, Aurélien Campéas [EMAIL PROTECTED] wrote: Le mardi 14 juin 2005 à 09:27 +0530, Siju George a écrit : On 6/13/05, Aurélien Campéas [EMAIL PROTECTED] wrote: Le lundi 13 juin 2005 à 12:58 +0530, Siju George a écrit : Hi all, I would like to implement Disk mirroring ( Raid1 ) in Debian Sarge. Is it possible to configure it while installation if I have both hard disks attached?? Could someone please tell me what is the easiest way ( steps ) to get this done??? I hope it will be easy because the Installer has an option to configure software RAID but I a not able to get doing it successfully :-( Can you give more details about what's going on ? Without much, nobody will be able to help. Thankyou so much Aurélien for responding! Note that I know next to nothing wrt RAID Debian. But you need to explain your concerns better. I have two hard disks 40 GB each! I want to have RAID 1 including the / partition and boot loader. ie if one hard disk goes down I should be able to boot from the other one. How do I configure it with the installer?? I want to have the following partitions in both the hard disk / - 500 MB - Primary swap - 2 GB - Primary /usr - 5 GB - Primary /home - 500 MB - Logical /tmp - 5 GB - Logical /var/log - 5 GB -logical /var - rest of the disk - logical Do you *really* need to split hairs like that ? Do you know the drawbacks of segmenting your hard drives into so many partitions vs. the supposed benefits ? I prefer ext3 or ReiserFS for file systems. I now prefer reiserfs over ext3. How should I go about it??? is it possible to configure these partitions in the first hard disk and finish the install and then later do the mirroring? I suspect not, but again, I didn't try even once ... or is it possible to do the mirroring also during the install??? See Alvin's answer. Check by yourself : just go ahead and try RAID from the installer ! And then tell us how it went :) Alright friend :-) I just completed it successfully! I first created identical partitions in each hard disk and marked them as RAID Physical volumes. The I created the RAID devices and then specified mount points and ReiserFS :-) It worked al right and easy but when I installed the boot loader I think it got installed only on the hd0 and not on hd1!!! how do I verify this??? and how can testif the RAID is woring fine??? Thankyou so much Kind Regards Siju
Re: Disk Mirroring in Sarge howto
Le mardi 14 juin 2005 à 16:09 +0530, Siju George a écrit : I first created identical partitions in each hard disk and marked them as RAID Physical volumes. The I created the RAID devices and then specified mount points and ReiserFS :-) It worked al right and easy but when I installed the boot loader I think it got installed only on the hd0 and not on hd1!!! how do I verify this??? and how can testif the RAID is woring fine??? I hope someone familiar with RAID reads this ... (now at least you have given enough context to help your helpers help you) What is the output of, say, dmesg (after a reboot), mount, and fdisk on all your drives ? (could be a starting point to see what's happening) (plize don't send me directly your answers, I'm on the list and need not receive twice the same messages) Aurélien. ** This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the system manager. This footnote also confirms that this email message has been swept by MIMEsweeper for the presence of computer viruses. www.clearswift.com **
Re: Disk Mirroring in Sarge howto
On (14/06/05 16:09), Siju George wrote: Alright friend :-) I just completed it successfully! I first created identical partitions in each hard disk and marked them as RAID Physical volumes. The I created the RAID devices and then specified mount points and ReiserFS :-) It worked al right and easy but when I installed the boot loader I think it got installed only on the hd0 and not on hd1!!! how do I verify this??? and how can testif the RAID is woring fine??? cat /proc/mdstat Regards Clive -- www.clivemenzies.co.uk ... ...strategies for business -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of unsubscribe. Trouble? Contact [EMAIL PROTECTED]
Re: Disk Mirroring in Sarge howto
Le mardi 14 juin 2005 à 03:57 -0700, Alvin Oga a écrit : On Tue, 14 Jun 2005, Siju George wrote: Yes its partition 2 . what would be an appropriate location??? I just followed the BSD way where swap (b) comes immediately after / (a). What is appropriate for linux?? swap can be anywhere on the disks swap is supposedly never used ... but it is, aggressively -ie even when you still have boatloads of free ram why would you put swap in between ( / ) files you need hundreds of times per hour and /var files and /usr files ... the head has to skip over swap space -- too much moving of the heads ... - ask 100 people the same questions .. you will get 100 different replies for where to put swap and why ... ( experimental data vs i heard in the grapevine ) put your swap at the beginning of the disk a) no interleaving with proper data b) this is usually the fastest zone of disks, good for swap so I hope 500 MB is o.k??? or is it more??? :-) zero or all of the disk for user the system should be able to clean itself - log rotates in pariticular last time I did't check but what would you suggest?? but I've noticed increase upto 100 MB sometimes in a matter of two days. 100MB/day -- and you want 5GB --- that last you about days assuming there is no log rotation and compression /var/log is temporary data /var/cache or /var/apt is temporary or not .. depending on what you do with the files Could you please explain this a little more to me? nah ... Creating a lot of multiple partition, uh, so as to do like the BSD guys is a perfect way to burn yourself. Unless you know exctly your needs in advance, you probably need only three partitions : swap, system (everything but /home or /var or ... whatever moves a lot), moving data (/home , etc. ...) Do you suggets I create a seperate /opt partition??? if so how much size?? i always use /opt ... and its all the disks space that the system doesnt use nobody has to use opt /usr/local is perfectly fine I 've only used Ext3 till now because I heard data recover is difficult in all others except ext2. you should NEVER have to recover data in the first place .. - something else is wrong if you do - if you like fiddling with inodes and meta-data, that'd be fun that's good advice ... and also I understand that ReiserFS is better than XFS if the system goes down suddenly due to power failure. Don't know much about JFS :-( better is all relative to what and where's the imperical data or source code is what is say power failure problems is pretty much the same problems for all fs - its a matter of how fast can you write your metadata without corrupting the rest of the fs that was good prior to the power failing and you have say 2ms to fix it all up and clean up and exit before the disk write head goes bonkers - writing during a power failure is crazy, even if its to flush the cache Don't forget that common hard drives will lose their cache in case of power failure ; sync is not, in this case, what it says no journalled FS can help - an UPS can. c ya alvin ** This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the system manager. This footnote also confirms that this email message has been swept by MIMEsweeper for the presence of computer viruses. www.clearswift.com **
Re: Disk Mirroring in Sarge howto
On 6/14/05, Clive Menzies [EMAIL PROTECTED] wrote: cat /proc/mdstat Thanks a lot Clive :-) #cat /proc/mdstat Personalities : [raid1] md2 : active raid1 hdd3[1] 4883648 blocks [2/1] [_U] md3 : active raid1 hda5[0] hdd5[1] 489856 blocks [2/2] [UU] md4 : active raid1 hda6[0] hdd6[1] 1951744 blocks [2/2] [UU] md5 : active raid1 hda7[0] hdd7[1] 2931712 blocks [2/2] [UU] md6 : active raid1 hda8[0] hdd8[1] 2931712 blocks [2/2] [UU] md7 : active raid1 hda9[0] hdd9[1] 23486912 blocks [2/2] [UU] md1 : active raid1 hda2[0] hdd2[1] 1951808 blocks [2/2] [UU] md0 : active raid1 hda1[0] hdd1[1] 489856 blocks [2/2] [UU] unused devices: none So Can I be sure that GRUB was installed on bot hda abd hdd??? If I remove one disk will the other still work??? Thankyou so much once again kind regards Siju
Re: Disk Mirroring in Sarge howto
On 6/14/05, Rhomboid [EMAIL PROTECTED] wrote: I just tried to install Sarge yesterday with RAID (md) from the initial setup on a machine. I tried RAID-0 and RAID-1 and both times the installation failed on grub-install. It just hung. The third time I let it sit for about 5 hours and when I got home it was still hung. LILO failed as well and couldn't find hda (no such device). AMD Athlon 1.2GHz (tbird) 512MB PC2100 Nvidia GF3 64MB Asus A7M266 2x WD JB 40GB (hda/hdb, tried RAID on these, using md) 1x IBM 16GB (hdc, used for swap and /var) Adaptec aic7xxx (onboard SCSI) Plextor SCSI Ultraplex CD Seagate SCSI Scorpion DAT 20GB Intel EEPro 100 Tried setting both WD drives bootable at one point, always selected MBR for bootloader installation. I know it may have been better to put one half of the RAID on the other controller but this was just an experiment to see if it would even work on initial install. System installed just fine later without RAID. Hi Rhomboid, I fllowed these steps to get it right If you want to install Sarge with RAID-1, create identical partitions on both disks and tell Sarge you want to use them as Physical Volume for RAID. Then go into the Sarge Configure software RAID menu and create MD devices (RAID volumes) -- you will be prompted for the partitions to use for each RAID volume. Once the RAID volumes are created you can continue specifying mount point, FS type, etc for each volume exactly as you would for a normal disk partition. I am not sure if GRUB is on both the DISKs DID you mark the volumes active of bot the disks while creating RAID volumes?? the RAID works fine -- # cat /proc/mdstat Personalities : [raid1] md2 : active raid1 hdd3[1] 4883648 blocks [2/1] [_U] md3 : active raid1 hda5[0] hdd5[1] 489856 blocks [2/2] [UU] md4 : active raid1 hda6[0] hdd6[1] 1951744 blocks [2/2] [UU] md5 : active raid1 hda7[0] hdd7[1] 2931712 blocks [2/2] [UU] md6 : active raid1 hda8[0] hdd8[1] 2931712 blocks [2/2] [UU] md7 : active raid1 hda9[0] hdd9[1] 23486912 blocks [2/2] [UU] md1 : active raid1 hda2[0] hdd2[1] 1951808 blocks [2/2] [UU] md0 : active raid1 hda1[0] hdd1[1] 489856 blocks [2/2] [UU] unused devices: none --- thankyou so much kind regards Siju
Re: Disk Mirroring in Sarge howto
On (14/06/05 16:52), Siju George wrote: On 6/14/05, Clive Menzies [EMAIL PROTECTED] wrote: cat /proc/mdstat Thanks a lot Clive :-) #cat /proc/mdstat Personalities : [raid1] md2 : active raid1 hdd3[1] 4883648 blocks [2/1] [_U] md3 : active raid1 hda5[0] hdd5[1] 489856 blocks [2/2] [UU] md4 : active raid1 hda6[0] hdd6[1] 1951744 blocks [2/2] [UU] md5 : active raid1 hda7[0] hdd7[1] 2931712 blocks [2/2] [UU] md6 : active raid1 hda8[0] hdd8[1] 2931712 blocks [2/2] [UU] md7 : active raid1 hda9[0] hdd9[1] 23486912 blocks [2/2] [UU] md1 : active raid1 hda2[0] hdd2[1] 1951808 blocks [2/2] [UU] md0 : active raid1 hda1[0] hdd1[1] 489856 blocks [2/2] [UU] unused devices: none So Can I be sure that GRUB was installed on bot hda abd hdd??? If I remove one disk will the other still work??? Hi Siju which is your /boot partition... md2 (hdd3)? In which case you need to do something like: mdadm --add hda3 (to md2 I forget the syntax but it should be in those reference links I posted or man mdadm. However, I think I also read in one of those that it is better to install the /boot partition directly to the additional drive before adding it to the raid array. Have a look through the references but I think Roberto suggested this to you or someone else doing raid currently. There was a post from Alvin in the last 6months which gave a pretty thorough run down on how to test your raid setup; it involved yanking one disk and pulling the power supply ;) worth searching the archive for try in google: site:lists.debian.org debian-user alvin raid 2005 test brings up 33 entries;) Regards Clive -- www.clivemenzies.co.uk ... ...strategies for business -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of unsubscribe. Trouble? Contact [EMAIL PROTECTED]
Re: Disk Mirroring in Sarge howto
On Tue, 14 Jun 2005, Siju George wrote: Yes its partition 2 . what would be an appropriate location??? I just followed the BSD way where swap (b) comes immediately after / (a). What is appropriate for linux?? swap can be anywhere on the disks swap is supposedly never used ... why would you put swap in between ( / ) files you need hundreds of times per hour and /var files and /usr files ... the head has to skip over swap space -- too much moving of the heads ... - ask 100 people the same questions .. you will get 100 different replies for where to put swap and why ... ( experimental data vs i heard in the grapevine ) so I hope 500 MB is o.k??? or is it more??? :-) zero or all of the disk for user the system should be able to clean itself - log rotates in pariticular last time I did't check but what would you suggest?? but I've noticed increase upto 100 MB sometimes in a matter of two days. 100MB/day -- and you want 5GB --- that last you about days assuming there is no log rotation and compression /var/log is temporary data /var/cache or /var/apt is temporary or not .. depending on what you do with the files Could you please explain this a little more to me? nah ... Do you suggets I create a seperate /opt partition??? if so how much size?? i always use /opt ... and its all the disks space that the system doesnt use I 've only used Ext3 till now because I heard data recover is difficult in all others except ext2. you should NEVER have to recover data in the first place .. - something else is wrong if you do - if you like fiddling with inodes and meta-data, that'd be fun and also I understand that ReiserFS is better than XFS if the system goes down suddenly due to power failure. Don't know much about JFS :-( better is all relative to what and where's the imperical data or source code is what is say power failure problems is pretty much the same problems for all fs - its a matter of how fast can you write your metadata without corrupting the rest of the fs that was good prior to the power failing and you have say 2ms to fix it all up and clean up and exit before the disk write head goes bonkers - writing during a power failure is crazy, even if its to flush the cache c ya alvin -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of unsubscribe. Trouble? Contact [EMAIL PROTECTED]
Re: Disk Mirroring in Sarge howto - bad
On Tue, 14 Jun 2005, Siju George wrote: # cat /proc/mdstat Personalities : [raid1] md2 : active raid1 hdd3[1] 4883648 blocks [2/1] [_U] you have a bad raid system ... you lose one partition and your entire raid disks can be toast - if /dev/md2 is /boot ... - why do you need /boot ... /boot is NOT needed in most all applications unless you have whacky things like msdos(windows) at partition1 - or that you have old bios(hw) that cannot talk in lba16, lba24, lba32, lba48, ... if it is /boot.. you did NOT configure grub/lilo/syslinux properly and your current config files are wrong it will NOT boot properly whan the other disk dies - why do you need so many raid devices /?? c ya alvin -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of unsubscribe. Trouble? Contact [EMAIL PROTECTED]
Re: Disk Mirroring in Sarge howto
Exactly what I did. I had only one partition on each of the 40GB drives, marked for physical RAID volumes, set them to active/boot, selected them for use as RAID when prompted, used resulting RAID disk as ext3 root / mount point. GRUB just hangs when grub-install is running (selected install on MBR). Siju George wrote: On 6/14/05, Rhomboid [EMAIL PROTECTED] wrote: I just tried to install Sarge yesterday with RAID (md) from the initial setup on a machine. I tried RAID-0 and RAID-1 and both times the installation failed on grub-install. It just hung. The third time I let it sit for about 5 hours and when I got home it was still hung. LILO failed as well and couldn't find hda (no such device). AMD Athlon 1.2GHz (tbird) 512MB PC2100 Nvidia GF3 64MB Asus A7M266 2x WD JB 40GB (hda/hdb, tried RAID on these, using md) 1x IBM 16GB (hdc, used for swap and /var) Adaptec aic7xxx (onboard SCSI) Plextor SCSI Ultraplex CD Seagate SCSI Scorpion DAT 20GB Intel EEPro 100 Tried setting both WD drives bootable at one point, always selected MBR for bootloader installation. I know it may have been better to put one half of the RAID on the other controller but this was just an experiment to see if it would even work on initial install. System installed just fine later without RAID. Hi Rhomboid, I fllowed these steps to get it right If you want to install Sarge with RAID-1, create identical partitions on both disks and tell Sarge you want to use them as Physical Volume for RAID. Then go into the Sarge Configure software RAID menu and create MD devices (RAID volumes) -- you will be prompted for the partitions to use for each RAID volume. Once the RAID volumes are created you can continue specifying mount point, FS type, etc for each volume exactly as you would for a normal disk partition. I am not sure if GRUB is on both the DISKs DID you mark the volumes active of bot the disks while creating RAID volumes?? the RAID works fine -- # cat /proc/mdstat Personalities : [raid1] md2 : active raid1 hdd3[1] 4883648 blocks [2/1] [_U] md3 : active raid1 hda5[0] hdd5[1] 489856 blocks [2/2] [UU] md4 : active raid1 hda6[0] hdd6[1] 1951744 blocks [2/2] [UU] md5 : active raid1 hda7[0] hdd7[1] 2931712 blocks [2/2] [UU] md6 : active raid1 hda8[0] hdd8[1] 2931712 blocks [2/2] [UU] md7 : active raid1 hda9[0] hdd9[1] 23486912 blocks [2/2] [UU] md1 : active raid1 hda2[0] hdd2[1] 1951808 blocks [2/2] [UU] md0 : active raid1 hda1[0] hdd1[1] 489856 blocks [2/2] [UU] unused devices: none --- thankyou so much kind regards Siju -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of unsubscribe. Trouble? Contact [EMAIL PROTECTED]
Re: Disk Mirroring in Sarge howto
One thing I forgot in system details: This is with the 2.6 kernel. Haven't tried install with 2.4. Rhomboid wrote: Exactly what I did. I had only one partition on each of the 40GB drives, marked for physical RAID volumes, set them to active/boot, selected them for use as RAID when prompted, used resulting RAID disk as ext3 root / mount point. GRUB just hangs when grub-install is running (selected install on MBR). Siju George wrote: On 6/14/05, Rhomboid [EMAIL PROTECTED] wrote: I just tried to install Sarge yesterday with RAID (md) from the initial setup on a machine. I tried RAID-0 and RAID-1 and both times the installation failed on grub-install. It just hung. The third time I let it sit for about 5 hours and when I got home it was still hung. LILO failed as well and couldn't find hda (no such device). AMD Athlon 1.2GHz (tbird) 512MB PC2100 Nvidia GF3 64MB Asus A7M266 2x WD JB 40GB (hda/hdb, tried RAID on these, using md) 1x IBM 16GB (hdc, used for swap and /var) Adaptec aic7xxx (onboard SCSI) Plextor SCSI Ultraplex CD Seagate SCSI Scorpion DAT 20GB Intel EEPro 100 Tried setting both WD drives bootable at one point, always selected MBR for bootloader installation. I know it may have been better to put one half of the RAID on the other controller but this was just an experiment to see if it would even work on initial install. System installed just fine later without RAID. Hi Rhomboid, I fllowed these steps to get it right If you want to install Sarge with RAID-1, create identical partitions on both disks and tell Sarge you want to use them as Physical Volume for RAID. Then go into the Sarge Configure software RAID menu and create MD devices (RAID volumes) -- you will be prompted for the partitions to use for each RAID volume. Once the RAID volumes are created you can continue specifying mount point, FS type, etc for each volume exactly as you would for a normal disk partition. I am not sure if GRUB is on both the DISKs DID you mark the volumes active of bot the disks while creating RAID volumes?? the RAID works fine -- # cat /proc/mdstat Personalities : [raid1] md2 : active raid1 hdd3[1] 4883648 blocks [2/1] [_U] md3 : active raid1 hda5[0] hdd5[1] 489856 blocks [2/2] [UU] md4 : active raid1 hda6[0] hdd6[1] 1951744 blocks [2/2] [UU] md5 : active raid1 hda7[0] hdd7[1] 2931712 blocks [2/2] [UU] md6 : active raid1 hda8[0] hdd8[1] 2931712 blocks [2/2] [UU] md7 : active raid1 hda9[0] hdd9[1] 23486912 blocks [2/2] [UU] md1 : active raid1 hda2[0] hdd2[1] 1951808 blocks [2/2] [UU] md0 : active raid1 hda1[0] hdd1[1] 489856 blocks [2/2] [UU] unused devices: none --- thankyou so much kind regards Siju -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of unsubscribe. Trouble? Contact [EMAIL PROTECTED]
Re: Disk Mirroring in Sarge howto
On 6/15/05, Rhomboid [EMAIL PROTECTED] wrote: One thing I forgot in system details: This is with the 2.6 kernel. Haven't tried install with 2.4. also did it with the 2.6 kernel but GRUB didi not install in the second hard disk! The first one works fine :-( --Siju
Re: Disk Mirroring in Sarge howto
Le lundi 13 juin 2005 à 12:58 +0530, Siju George a écrit : Hi all, I would like to implement Disk mirroring ( Raid1 ) in Debian Sarge. Is it possible to configure it while installation if I have both hard disks attached?? Could someone please tell me what is the easiest way ( steps ) to get this done??? I hope it will be easy because the Installer has an option to configure software RAID but I a not able to get doing it successfully :-( Can you give more details about what's going on ? Without much, nobody will be able to help. ** This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the system manager. This footnote also confirms that this email message has been swept by MIMEsweeper for the presence of computer viruses. www.clearswift.com **
Re: Disk Mirroring in Sarge howto
On Mon, Jun 13, 2005 at 12:58:21PM +0530, Siju George wrote: Hi all, I would like to implement Disk mirroring ( Raid1 ) in Debian Sarge. Is it possible to configure it while installation if I have both hard disks attached?? Could someone please tell me what is the easiest way ( steps ) to get this done??? I hope it will be easy because the Installer has an option to configure software RAID but I a not able to get doing it successfully :-( The installer will walk you through it. I also recommend reading the RAID HOWTO at http://tldp.org/ (specifically, the newer one). -Roberto -- Roberto C. Sanchez http://familiasanchez.net/~sanchezr pgpQxYDMpj2Ad.pgp Description: PGP signature
Re: Disk Mirroring in Sarge howto
I just tried to install Sarge yesterday with RAID (md) from the initial setup on a machine. I tried RAID-0 and RAID-1 and both times the installation failed on grub-install. It just hung. The third time I let it sit for about 5 hours and when I got home it was still hung. LILO failed as well and couldn't find hda (no such device). AMD Athlon 1.2GHz (tbird) 512MB PC2100 Nvidia GF3 64MB Asus A7M266 2x WD JB 40GB (hda/hdb, tried RAID on these, using md) 1x IBM 16GB (hdc, used for swap and /var) Adaptec aic7xxx (onboard SCSI) Plextor SCSI Ultraplex CD Seagate SCSI Scorpion DAT 20GB Intel EEPro 100 Tried setting both WD drives bootable at one point, always selected MBR for bootloader installation. I know it may have been better to put one half of the RAID on the other controller but this was just an experiment to see if it would even work on initial install. System installed just fine later without RAID. Siju George wrote: Hi all, I would like to implement Disk mirroring ( Raid1 ) in Debian Sarge. Is it possible to configure it while installation if I have both hard disks attached?? Could someone please tell me what is the easiest way ( steps ) to get this done??? I hope it will be easy because the Installer has an option to configure software RAID but I a not able to get doing it successfully :-( thankyou so much kind regards Siju -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of unsubscribe. Trouble? Contact [EMAIL PROTECTED]
Re: Disk Mirroring in Sarge howto
On 6/13/05, Aurélien Campéas [EMAIL PROTECTED] wrote: Le lundi 13 juin 2005 à 12:58 +0530, Siju George a écrit : Hi all, I would like to implement Disk mirroring ( Raid1 ) in Debian Sarge. Is it possible to configure it while installation if I have both hard disks attached?? Could someone please tell me what is the easiest way ( steps ) to get this done??? I hope it will be easy because the Installer has an option to configure software RAID but I a not able to get doing it successfully :-( Can you give more details about what's going on ? Without much, nobody will be able to help. Thankyou so much Aurélien for responding! I have two hard disks 40 GB each! I want to have RAID 1 including the / partition and boot loader. ie if one hard disk goes down I should be able to boot from the other one. How do I configure it with the installer?? I want to have the following partitions in both the hard disk / - 500 MB - Primary swap - 2 GB - Primary /usr - 5 GB - Primary /home - 500 MB - Logical /tmp - 5 GB - Logical /var/log - 5 GB -logical /var - rest of the disk - logical I prefer ext3 or ReiserFS for file systems. How should I go about it??? is it possible to configure these partitions in the first hard disk and finish the install and then later do the mirroring? or is it possible to do the mirroring also during the install??? Thankyou so much for the help :-) kind regards Siju / Actually I have two hard disks
Re: Disk mirroring
Joachim Trinkwitz wrote: Has cpbk any advantages over mirrordir or rsync? It's easier to use. If you know how to use cp, then you'd know how to use cpbk. Oki
Re: Disk mirroring
Has cpbk any advantages over mirrordir or rsync? Greetings, joachim
Re: Disk mirroring
Peter S Galbraith wrote: $ ls -la /dev/fd0 /tmp/dev/fd0 brw-rw1 root floppy 2, 0 May 14 11:30 /dev/fd0 brw-r-1 root floppy 2, 0 May 14 11:30 /tmp/dev/fd0 :-( But upstream is working on it. :-) Okay... Been in contact with upstream and he just fixed it! I tried the fix and it solved the problem for me. Look for an updated release soon! Other than the bug mentioned above, is there any more reason not to use cpbk? Will this command work? cpbk -r -n -e /mnt,/dev / /mnt I think I wouldn't have to backup /dev/* periodically; once would be sufficient. TIA, Oki
Re: Disk mirroring
[EMAIL PROTECTED] wrote: You might look into the kernel software RAID if you're running kernel 2.4.x. It supports RAID-1, which is mirroring. Although mounting a Yes, I'm running on 2.4.x. disk and doing a manual copy would work, in the event your system disk fails you'd be stuck with an unbootable system. With a RAID, you can failover to the second disk and continue running while you work on replacing the failed disk, then resync everything automatically. This sounds good. Then what tools can I use to set it up? (Assuming that kernel support for RAID-1 is done). BTW, the controller is SCSI, not RAID; I don't think that I'd be able to hot-swap the disk. This sounds really interesting; failover just like that...? And then resync...? Wow. But the above fail means the disk is no longer usable right? What about the /dev/sdx thing? If the first one fail, would the second still be /dev/sdb? My concern is what's in /etc/fstab. Besides, that failover sounds like going to work for data disks. I'm talking about system disks here. What I have done is to create a single partition on the second disk (my swap is on a file), copy all the / files into it (using cp -avf), and then create a new entry in the Grub's menu.lst (which resides on the first disk); hoping that there would be no (hardware) disk failure. I think this would cover me on events like filesystem failures. I use ReiserFS, BTW. It's _way_ fast, but even in 2.4.x it's not considered as stable. The machine has been up for about 7 days; the last reboot was due to out of swapspace, I believe. Or some holes on the swap partition (I have put it on a file, recently). Another thing, is there any way to chroot apt-get? I'd like to install new packages, on the second disk, but using /mnt as the root directory. TIA, Oki
Re: Disk mirroring
I wrote: badoual loic wrote: On Mon, May 14, 2001 at 04:22:56PM +0700, Oki DZ wrote: It would be great if the copying is done incrementally (copy the newer files only). cpbk is good for that Looks like an interesting package, but this bug worries me: http://bugs.debian.org/63955 $ sudo cpbk -r -n /dev /tmp/dev $ ls -la /dev/fd0 /tmp/dev/fd0 brw-rw1 root floppy 2, 0 May 14 11:30 /dev/fd0 -rw-rw1 root floppy 0 May 14 11:30 /tmp/dev/fd0 The original is a block device, but the copy is not. This is fixed upstream in version 4.1.0 See http://www.enjoy.ne.jp/~gm/program/cpbk/ There's a deb package there which I recommend since Debian unstable doesn't have this version yet. However, the software is still buggy wrt file permissions: $ sudo cpbk /dev /tmp/dev Searching source files and building lists... Done Searching destination files and building lists... Done Comparing files and generating order lists... Done $ ls -la /dev/fd0 /tmp/dev/fd0 brw-rw1 root floppy 2, 0 May 14 11:30 /dev/fd0 brw-r-1 root floppy 2, 0 May 14 11:30 /tmp/dev/fd0 :-( But upstream is working on it. :-) Peter
Re: Disk mirroring
I wrote: I wrote: badoual loic wrote: On Mon, May 14, 2001 at 04:22:56PM +0700, Oki DZ wrote: It would be great if the copying is done incrementally (copy the newer files only). cpbk is good for that Looks like an interesting package, but this bug worries me: http://bugs.debian.org/63955 $ sudo cpbk -r -n /dev /tmp/dev $ ls -la /dev/fd0 /tmp/dev/fd0 brw-rw1 root floppy 2, 0 May 14 11:30 /dev/fd0 -rw-rw1 root floppy 0 May 14 11:30 /tmp/dev/fd0 The original is a block device, but the copy is not. This is fixed upstream in version 4.1.0 See http://www.enjoy.ne.jp/~gm/program/cpbk/ There's a deb package there which I recommend since Debian unstable doesn't have this version yet. However, the software is still buggy wrt file permissions: $ sudo cpbk /dev /tmp/dev Searching source files and building lists... Done Searching destination files and building lists... Done Comparing files and generating order lists... Done $ ls -la /dev/fd0 /tmp/dev/fd0 brw-rw1 root floppy 2, 0 May 14 11:30 /dev/fd0 brw-r-1 root floppy 2, 0 May 14 11:30 /tmp/dev/fd0 :-( But upstream is working on it. :-) Okay... Been in contact with upstream and he just fixed it! I tried the fix and it solved the problem for me. Look for an updated release soon! Peter
Re: Disk mirroring
On Mon, May 14, 2001 at 01:37:26PM +0700, Oki DZ wrote: I'd like to mirror the harddisk of my running system to another disk. What is the best route to do it? What I have in mind is to mount the second disk under /mnt and then copy all the files into it. Can rsync do it? Of course, I'd like to do it periodically; every night at 11:59, for example. have you considered doing a raid 1 mirror? if not you might want to check out the software-raid-howto. to copy a filesystem to another you can use cpio: this will copy you entire rootpartition to /mnt: find / -xdev | cpio -pm /mnt yours martin -- GnuPG 1024D/3E8DCCC0 30DC 1D28 1D79 32F5 5E67 3ABB 28EE B35A 3E8D CCC0 work: factline Krisper Fabro Harnoncourt OEG (www.factline.com)
Re: Disk mirroring
hi ya best way ??? raid1 mirroring... ( assumes same/identical partition sizes ) - anything you put on disk1 will get mirror'd to disk2 - - if you accidentally erase /foo.txt ... it gets erased on disk2 too ... ( i see no point to that ...but... some folks like it ) manually ( via cron ) backing up disk1 to disk2... is a good thing... depending on what you want on the backup disks... tar is better ??? tar zcvf /mnt/backup_disk/backup.$date.tgz /etc /root /home c ya alvin http://www.Linux-Backup.net # # mount the backup disks # mount /dev/hdb1 /mnt/backup_disk # # incremental vs full backups is left to the user to decide ??? # tar zcvf /mnt/backup_disk/backup.$date.tgz /etc /root /home # # # or my haphazard guessing ( ie. no idea ) # rsync -e scp -av /root /etc /home /mnt/backup_disk/backup # umount /mnt/backup_disk # # end of silly demo code # # # crontab -e # backup nightly at 11;59pm 59 23 * * * /usr/scripts/your_backup.sh On Mon, 14 May 2001, Oki DZ wrote: Hi, I'd like to mirror the harddisk of my running system to another disk. What is the best route to do it? What I have in mind is to mount the second disk under /mnt and then copy all the files into it. Can rsync do it? Of course, I'd like to do it periodically; every night at 11:59, for example. Oki
Re: Disk mirroring
On Mon, May 14, 2001 at 12:05:42AM -0700, Alvin Oga wrote: manually ( via cron ) backing up disk1 to disk2... is a good thing... depending on what you want on the backup disks... tar is better ??? tar zcvf /mnt/backup_disk/backup.$date.tgz /etc /root /home Agree. One neat option of tar to remember is -l. It limits tar within same partition of disk (same filesystem). If you have large mirror in separate partition like me, this is neat. (for me /home/ftp is large debian mirror) -N should be for incremental but never used it. I should do mount/umount like you said so power failure has no effects. Osamu :-) -- ~\^o^/~~~ ~\^.^/~~~ ~\^*^/~~~ ~\^_^/~~~ ~\^+^/~~~ ~\^:^/~~~ ~\^v^/~~~ + Osamu Aoki [EMAIL PROTECTED], GnuPG-key: 1024D/D5DE453D + + My debian quick-reference, http://www.aokiconsulting.com/quick/+
Re: Disk mirroring
Martin Würtele wrote: to copy a filesystem to another you can use cpio: this will copy you entire rootpartition to /mnt: find / -xdev | cpio -pm /mnt It would be great if the copying is done incrementally (copy the newer files only). Oki
Re: Disk mirroring
Alvin Oga wrote: hi ya best way ??? raid1 mirroring... ( assumes same/identical partition sizes ) - anything you put on disk1 will get mirror'd to disk2 - - if you accidentally erase /foo.txt ... it gets erased on disk2 too ... ( i see no point to that ...but... some folks like it ) The second disk is about twice in size; the partitions might be in different sizes. manually ( via cron ) backing up disk1 to disk2... is a good thing... Via cron would be better, I think. depending on what you want on the backup disks... tar is better ??? tar zcvf /mnt/backup_disk/backup.$date.tgz /etc /root /home I want to have the second disk bootable (via a floppy if needed). That's why I asked about rsync. Oki
Re: Disk mirroring
Hi, I'd like to mirror the harddisk of my running system to another disk. What is the best route to do it? What I have in mind is to mount the second disk under /mnt and then copy all the files into it. Can rsync do it? Of course, I'd like to do it periodically; every night at 11:59, for example. You might look into the kernel software RAID if you're running kernel 2.4.x. It supports RAID-1, which is mirroring. Although mounting a disk and doing a manual copy would work, in the event your system disk fails you'd be stuck with an unbootable system. With a RAID, you can failover to the second disk and continue running while you work on replacing the failed disk, then resync everything automatically. -- Evan Day [EMAIL PROTECTED] GPG: 1024D/237C1C84 FP: 1615 E312 A6D1 542B C4A6 38B5 69B1 2844 237C 1C84 My bologna has first name, it's H-O-M-E-R...
Re: Disk mirroring
On Mon, May 14, 2001 at 04:22:56PM +0700, Oki DZ wrote: Martin Würtele wrote: to copy a filesystem to another you can use cpio: this will copy you entire rootpartition to /mnt: find / -xdev | cpio -pm /mnt It would be great if the copying is done incrementally (copy the newer files only). cpbk is good for that -- Badoual Loic [EMAIL PROTECTED] http://www.customlinux.org A web site full of tips, tricks and resources ...
Re: Disk mirroring
badoual loic wrote: On Mon, May 14, 2001 at 04:22:56PM +0700, Oki DZ wrote: Martin Würtele wrote: to copy a filesystem to another you can use cpio: this will copy you entire rootpartition to /mnt: find / -xdev | cpio -pm /mnt It would be great if the copying is done incrementally (copy the newer files only). cpbk is good for that Looks like an interesting package, but this bug worries me: http://bugs.debian.org/63955 $ sudo cpbk -r -n /dev /tmp/dev $ ls -la /dev/fd0 /tmp/dev/fd0 brw-rw1 root floppy 2, 0 May 14 11:30 /dev/fd0 -rw-rw1 root floppy 0 May 14 11:30 /tmp/dev/fd0 The original is a block device, but the copy is not. Peter
Re: Disk mirroring - rsync
raid1 mirroring... ( assumes same/identical partition sizes ) - anything you put on disk1 will get mirror'd to disk2 - - if you accidentally erase /foo.txt ... it gets erased on disk2 too ... ( i see no point to that ...but... some folks like it ) The second disk is about twice in size; the partitions might be in different sizes. -- if you are using dd or raid, the size of the disk does not matter, as long as the partiitions are the same number of cylinders otherwise, if the partitions are different size, you have no option but to use tar/cpio/etc to copy stuff to the otehr disk depending on what you want on the backup disks... tar is better ??? tar zcvf /mnt/backup_disk/backup.$date.tgz /etc /root /home I want to have the second disk bootable (via a floppy if needed). That's why I asked about rsync. i dont think rsync copies the boot sector and other boot info... each time youupdate lilo.conf or add new kernels and modules, you'd have to remember to rerun lilo on the backup disk ( assuming that is to be a hard disk bootable replacement - order of magnitude easier ot do raid1 in this case - if you just want ot backup your main hd to a mirror/backup disks... there is no reason to worry about boot issues as it will not be able to boot ... ( /etc/fstab, /etc/lilo.conf, etc would be wrong, have fun linuxing alvin http://www.Linux-Consulting.com/Raid
Re: Disk mirroring - incremental
Martin Würtele wrote: to copy a filesystem to another you can use cpio: this will copy you entire rootpartition to /mnt: find / -xdev | cpio -pm /mnt It would be great if the copying is done incrementally (copy the newer files only). cpbk is good for that tar has a nice option --newer ( learned that a few weeks ago as posted by jens ) - i still prefer find | egrep -v dont copy this stuff | tar you'd want to do regular full backups along with daily incrementals... and both full nor incremental backups must have been done successfully, else all subsequent backups will NOT be useful, and murphys law dictates that the directories/files the backup failed on is the one you'd be wanting to recover from backups have fun alvin
Re: Disk mirroring - rsync
Alvin Oga wrote: each time youupdate lilo.conf or add new kernels and modules, you'd have to remember to rerun lilo on the backup disk ( assuming that is to be a hard disk bootable replacement - order of magnitude easier ot do raid1 in this case I don't think that I'd copy the kernel and the bootloader config files. I mean, it is sufficient to copy them once and have the disk bootable, and do the rest (data, applications) using rsync. - if you just want ot backup your main hd to a mirror/backup disks... there is no reason to worry about boot issues as it will not be able to boot ... ( /etc/fstab, /etc/lilo.conf, etc would be wrong, Well, I think it depends how bad the first disk failure would be. If it were a total failure, then the SCSI number (the /dev/sdx) would be changed; /etc/fstab, etc. (on the second disk) would be all right. But if it were a data failure, then the setup wouldn't work. I think it would be easy to make the second disk bootable, especially if it's done from a floppy. The difficult thing is how to predict what kind of failure you expect from the first disk; hardware failure?; corrupted filesystem? data loss? Each one of it needs a different setup in order to make the second disk bootable. My other concern is that, if I make the file copying done by cron, how would I know that the copy is not done while the first disk is about to fail? I'd end up with another non-working disk. It seems that copying it during the night is not a good idea. Am I right? Am I wrong? Oki
Re: Disk mirroring - rsync - backup methodology
hi oki yes..yes... your bnackup mechanism and backup implementation will protect you against only certain failures... a single backup methodology will NOT protect you against various failure modes and yes... if you create a bad file or corrupt a file... and you use raid1 to mirror your data... than you have corrupted your data disk AND the backup !!! - - i do NOT like raid1 for data backup for this reaason - raid1 by itself should NEVER(??) be used for data backup - - you lose your data on both drives - backup methodology ... fun stuff have fun alvin http://www.linux-backup.net -- how much fault tolerance do you wanna implement ??? - what do you wanna protect against??? - to protect against power cable problems, and ethernet cable problems... - keep the sticky fingers away from the cables - to protect against fan failures... ( next most commmon failures ) - have more than one fan... - - dual power supply may or may not solve your problems - how often has things failed on you... and what was the reason for the failure... - - its very seldom the disks itslef - - change your partition on the disks... - monitor/admin your server more often... ??? - - to protect against any disk failures ( i always assume throw the diska away kind of failures ) - use raid mirroring or raid5 - to protect against boot failures - make a boot floppy - make a bootable cdrom - make a raid1 or raid5 root/raid system - to protect against network failures... - - have more than one gateway between the server and its backup - have a local disk for backup... although if the power supply goes bonkers...you lose the data drive and its backup disks but you do have time to copy off the data to another backup system - most people's backup requirements are satisfied with the above methodologies ... - to protect against data being written and updated while your backup is still updating/working and your disk dies... - - geez...that kind of (realtime) backup is expensive - make sure that the program writting data is writting to multiple servers to guarantee zero data loss even if a disk/server crashes in the middle of writing now you start needing multiple raid systems to backup other raid systems now we are at... - - the 500Gb Raid5 in 1U - On Tue, 15 May 2001, Oki DZ wrote: Alvin Oga wrote: each time youupdate lilo.conf or add new kernels and modules, you'd have to remember to rerun lilo on the backup disk ( assuming that is to be a hard disk bootable replacement - order of magnitude easier ot do raid1 in this case I don't think that I'd copy the kernel and the bootloader config files. I mean, it is sufficient to copy them once and have the disk bootable, and do the rest (data, applications) using rsync. - if you just want ot backup your main hd to a mirror/backup disks... there is no reason to worry about boot issues as it will not be able to boot ... ( /etc/fstab, /etc/lilo.conf, etc would be wrong, Well, I think it depends how bad the first disk failure would be. If it were a total failure, then the SCSI number (the /dev/sdx) would be changed; /etc/fstab, etc. (on the second disk) would be all right. But if it were a data failure, then the setup wouldn't work. I think it would be easy to make the second disk bootable, especially if it's done from a floppy. The difficult thing is how to predict what kind of failure you expect from the first disk; hardware failure?; corrupted filesystem? data loss? Each one of it needs a different setup in order to make the second disk bootable. My other concern is that, if I make the file copying done by cron, how would I know that the copy is not done while the first disk is about to fail? I'd end up with another non-working disk. It seems that copying it during the night is not a good idea. Am I right? Am I wrong? Oki
