[CentOS] raid 1 question
Hi, I have a server with 2 disks. Installed centos 5.9 with raid1. I created /dev/md0 to hold / and /dev/md1 for swap and nothing else. Grub is installed on /dev/md0. After the successful installation, the server does not boot. I don't see the boot loader . I see a blank cursor blinking. What have I done wrong? Thanks Paras. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] raid 1 question
I don't get a grub so I can't issue c . Paras. On Thu, Mar 7, 2013 at 10:33 AM, Timo Schoeler timo.schoe...@riscworks.net wrote: On 03/07/2013 05:30 PM, thus Paras pradhan spake: Hi, Hi, I have a server with 2 disks. Installed centos 5.9 with raid1. I created /dev/md0 to hold / and /dev/md1 for swap and nothing else. Grub is installed on /dev/md0. After the successful installation, the server does not boot. I don't see the boot loader . I see a blank cursor blinking. What have I done wrong? have you paid attention on 'Section Two' here? http://wiki.centos.org/HowTos/SoftwareRAIDonCentOS5 Thanks Paras. HTH, Timo ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] raid 1 question
One question: During the install, do I install grub on sda or md0? Paras. On Thu, Mar 7, 2013 at 10:43 AM, Paras pradhan pradhanpa...@gmail.com wrote: I don't get a grub so I can't issue c . Paras. On Thu, Mar 7, 2013 at 10:33 AM, Timo Schoeler timo.schoe...@riscworks.net wrote: On 03/07/2013 05:30 PM, thus Paras pradhan spake: Hi, Hi, I have a server with 2 disks. Installed centos 5.9 with raid1. I created /dev/md0 to hold / and /dev/md1 for swap and nothing else. Grub is installed on /dev/md0. After the successful installation, the server does not boot. I don't see the boot loader . I see a blank cursor blinking. What have I done wrong? have you paid attention on 'Section Two' here? http://wiki.centos.org/HowTos/SoftwareRAIDonCentOS5 Thanks Paras. HTH, Timo ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] raid 1 question
I have a centos 5.4 installation. grub on /dev/md0 . no problem at all. my primary disk failed , replaced the disk and no problem at all. what has changed in 5.9 and 6 releases? its not easy anymore. Paras. On Thu, Mar 7, 2013 at 11:17 AM, SilverTip257 silvertip...@gmail.com wrote: On Thu, Mar 7, 2013 at 12:00 PM, Paras pradhan pradhanpa...@gmail.comwrote: One question: During the install, do I install grub on sda or md0? Install grub on sda and sdb. Installing GRUB on the mbr of both disks ensures that your system can still boot if one disk has failed. Although the Linux OS sees those two drives as a software raid1, GRUB looks at a single drive when booting. Paras. On Thu, Mar 7, 2013 at 10:43 AM, Paras pradhan pradhanpa...@gmail.com wrote: I don't get a grub so I can't issue c . Paras. On Thu, Mar 7, 2013 at 10:33 AM, Timo Schoeler timo.schoe...@riscworks.net wrote: On 03/07/2013 05:30 PM, thus Paras pradhan spake: Hi, Hi, I have a server with 2 disks. Installed centos 5.9 with raid1. I created /dev/md0 to hold / and /dev/md1 for swap and nothing else. Grub is installed on /dev/md0. After the successful installation, the server does not boot. I don't see the boot loader . I see a blank cursor blinking. What have I done wrong? have you paid attention on 'Section Two' here? http://wiki.centos.org/HowTos/SoftwareRAIDonCentOS5 Thanks Paras. HTH, Timo ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos -- ---~~.~~--- Mike // SilverTip257 // ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] bond of bonds
What about BASP? Anyone using it ? ftp://ftp.dell.com/app/1q03-Bhu.pdf Paras. On Tue, Nov 15, 2011 at 7:22 AM, Benjamin Donnachie benja...@py-soft.co.uk wrote: On 15 November 2011 13:08, Fred Wittekind r...@twister.dyndns.org wrote: You can bridge two bonds together, and enable STP to prevent a loop. Although, don't get it wrong on a production network, it's not pretty. Use decent switches, interlink them and create one big LACP bond across both. Ben ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
[CentOS] bond of bonds
Hi, I am trying to use Link-aggregation with redundancy between switches that doesnot support SMLT in switches. I have 4 network ports. First two are connected to a switch and LACP/LAG is enabled. Third and Fourth ports connect to another switch with another LAG group. I was thinking create two mode 4 bonds and bond those bonds to mode 1 (Active/Passive) bond. But it seems this is not supported yet in kernel (?). How do you guys handle this kind of situation. (And yes without using SMLT between switches). Thanks Paras. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] data recovery
Lamar, Thanks for the info. Paras. On Tue, Sep 27, 2011 at 10:44 AM, Lamar Owen lo...@pari.edu wrote: On Monday, September 26, 2011 11:18:06 AM Paras pradhan wrote: On Mon, Sep 26, 2011 at 5:53 AM, Lamar Owen lo...@pari.edu wrote: May I ask what sort of SAN? Its a Hitachi OpenV fibre channel SAN (4Gbps HBA). My storage admin checked if this LUN can be accessible by others and he found no other hosts have access to it. Ok. I've seen some odd LUN reshuffling before, ... reshuffling here means automatically changing disk's geometry as I am having an issue? It would be interesting to know if this can happen. No, reshuffling as in a host gained access to LUNs in a 'phantom' manner that it should not have had access to. No longer a problem, and hasn't been for a great while. It was an odd interaction, but I forget the details. If another host were put onto the FC with the exact same WWN onto the fabric it might be possible to see this sort of thing, too, but the WWN's are all supposed to be unique. Here are some new additional info : ... So my question is: if the LUN has been re partitioned for ex: say to install windows , why am i seeing our data in these newly created partitions? Is it possible to see data in a reapportioned drive? Yes, it is. If the recovery tool can look at the raw device it can grab stuff that isn't in any partition, and you can look at that data. Standard forensics. Repartitioning erases nothing except the partition table. Now, in the specific case of GPT, it is further possible to have a GPT and an MBR at the same time, and while the 'shadow' MBR is supposed to match the GPT's partitioning it doesn't have to. If you read through the LVM2 documentation and source code you may be able to find the signature used to mark a partition as being LVM; once you do that you should be able to find the start of the partition, and re-write the partition table(s). I use the plural there since with GPT you can have the GPT and the MBR coexisting; ideally you'd want to wipe the GPT out, but in reality you may not want to. But, being that you really don't want to write anything to this volume, you really should set up an offset, read-only, loop device; that is, find the starting sector of the partition (preferably an image of the LUN, and not the actual LUN; can the Hitachi array do LUN replication (EMC's SANcopy or Snapview or MirrorView being the rough equivalents)?). Then, once you find the starting position of the LVM physical volume: START_OFFSET_BYTE='actual starting sector number * sector size, zero origin' DEVLUN='LUN device, probably /dev/sde in your case' losetup -o $START_OFFSET_BYTE --read-only /dev/loop0 $DEVLUN Then see if you can get LVM to see this physical volume (by default loop devices are included in the scan, but you may want to verify they're not filtered in /etc/lvm/lvm.conf): pvscan vgscan lvscan You may be able to mount (-o ro of course) the LV at that point (I'm going through the LVM business because you mentioned VG names in your post). Hope that helps. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] data recovery
Hi Lamar, On Mon, Sep 26, 2011 at 5:53 AM, Lamar Owen lo...@pari.edu wrote: On Friday, September 23, 2011 04:29:39 PM Paras pradhan wrote: This is a SAN drive mounted. I have checked with my storage administrator if this has been re mapped or any similar events and he verified that nothing has happened...(I trust him) May I ask what sort of SAN? Fibre Channel or iSCSI? Are there any access controls (such as EMC's Access Logix or zoning in the switch) in place to prevent multiple initiators connecting to a particular LUN? Its a Hitachi OpenV fibre channel SAN (4Gbps HBA). My storage admin checked if this LUN can be accessible by others and he found no other hosts have access to it. SAN attachment mildly complicates things; I've seen some odd LUN reshuffling before, but it was an older FLARE than what I'm currently running on our Clariions and it was something that was a corner case but was fixed in a later NDU, and it had to do with Access Logix (I don't remember the Primus number right off, as it has been several years now). reshuffling here means automatically changing disk's geometry as I am having an issue? It would be interesting to know if this can happen. If the SAN OS keeps event logs you could try to correlate with the event; beyond that you may just have to do some testing. As you say, someone somewhere had to do a repartition; the hard part is determining where the error is. Good luck. Here are some new additional info : My colleague mounted this LUN to a different host and we found the same partitions over there too which is normal. I dd a 1st device to a file and opened the image file with bvi and found some hosts name, VG name etc etc. in there. Then he ran a recovery tool (R studio) in all three devices and was able to recover most of this data. So my question is: if the LUN has been re partitioned for ex: say to install windows , why am i seeing our data in these newly created partitions? Is it possible to see data in a reapportioned drive? Thanks Paras. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
[CentOS] data recovery
Hi, Need help on data recovery. Suddenly my disk device's geometry has been changed to something that doesnot make any sense. Its a 1.8TB in size and had only one single partition. Now I can see 3 partitions sde1, sde2 and sde2 of sizes 130M, 140GB and 10GB. Is there any way to recover data from these newly created disk devices? Thanks Paras. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] data recovery
On Fri, Sep 23, 2011 at 12:07 PM, Keith Roberts ke...@karsites.net wrote: On Thu, 22 Sep 2011, Paras pradhan wrote: To: CentOS mailing list centos@centos.org From: Paras pradhan pradhanpa...@gmail.com Subject: [CentOS] data recovery Hi, Need help on data recovery. Suddenly my disk device's geometry has been changed to something that does not make any sense. Its a 1.8TB in size and had only one single partition. Now I can see 3 partitions sde1, sde2 and sde2 of sizes 130M, 140GB and 10GB. Is there any way to recover data from these newly created disk devices? Hi Paras. AFAIK disks don't get partitioned out of the blue. Yes true. We are trying to find the out how it happened when nobody did anything to this server. They need some sort of intervention to make this happen. What have you done just before this happened? Did you try to do an installation of Linux, or something else? No. This is a production server and nobody logs in. Very very restricted. Also, is it possible for a trojan program to do this to your HDD? Are there any know trojan that can change the disk layout? Kind Regards, Keith Roberts Thanks Paras. - Websites: http://www.karsites.net http://www.php-debuggers.net http://www.raised-from-the-dead.org.uk All email addresses are challenge-response protected with TMDA [http://tmda.net] - ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] data recovery
Here is o/p John Number Start End Size File system Name Flags 1 17.4kB 134MB 134MB Microsoft reserved partition msftres 2 135MB 134GB 134GB ntfs Basic data partition 3 134GB 1100GB 965GB Basic data partition Thanks Paras. On Fri, Sep 23, 2011 at 1:06 PM, John R Pierce pie...@hogranch.com wrote: On 09/22/11 3:48 PM, Paras pradhan wrote: Hi, Need help on data recovery. Suddenly my disk device's geometry has been changed to something that doesnot make any sense. Its a 1.8TB in size and had only one single partition. Now I can see 3 partitions sde1, sde2 and sde2 of sizes 130M, 140GB and 10GB. Is there any way to recover data from these newly created disk devices? Can you share the output of ... fdisk -l /dev/sde be interesting to see just what these partitions look like in terms of the disk layout. those sizes sort of correlate with a typical /boot / and swap partition -- john r pierce N 37, W 122 santa cruz ca mid-left coast ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] data recovery
On Fri, Sep 23, 2011 at 1:32 PM, Keith Roberts ke...@karsites.net wrote: On Fri, 23 Sep 2011, Paras pradhan wrote: *snip* No. This is a production server and nobody logs in. Very very restricted. Have you checked all your logs? What ports are open? What CLI tools to format a HDD do you have on the server? Also, is it possible for a trojan program to do this to your HDD? Are there any know trojan that can change the disk layout? I don't know of any. What applications do you have running on that server? You say a production server. What type of server - a web hosting provider? What scripting languages do you have running on the server, if any? If you give me an email directly, I might be able to do a remote login for you, and some forensics, as that is one of my many interests. Thank you for this. Right now we are running a tool on it to recover the data. And yes logs have nothing. Paras. Kind Regards, Keith Roberts - Websites: http://www.karsites.net http://www.php-debuggers.net http://www.raised-from-the-dead.org.uk All email addresses are challenge-response protected with TMDA [http://tmda.net] - ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] data recovery
On Fri, Sep 23, 2011 at 2:43 PM, Lamar Owen lo...@pari.edu wrote: On Friday, September 23, 2011 03:25:10 PM Paras pradhan wrote: Here is o/p John Number Start End Size File system Name Flags 1 17.4kB 134MB 134MB Microsoft reserved partition msftres 2 135MB 134GB 134GB ntfs Basic data partition 3 134GB 1100GB 965GB Basic data partition Uh, that's GPT. What version of fdisk did you use to generate that output? Thanks for your detailed suggestion. Yes thats a GPT .. the o/p is from parted. Paras. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] data recovery
This is a SAN drive mounted. I have checked with my storage administrator if this has been re mapped or any similar events and he verified that nothing has happened...(I trust him) Here is one thing I have found. I dd the 1st 134MB partition to an image. and opened it with the hex editor. After that I can verify that this is the same device and was able to read the hostname, VGname etc etc. And AFAIK it is impossible to reshape or change the disk's geomerty to its original shape of anything without use intervention. This is really a mystery. Thanks Paras. On Fri, Sep 23, 2011 at 3:09 PM, Lamar Owen lo...@pari.edu wrote: On Friday, September 23, 2011 03:44:58 PM Paras pradhan wrote: Thanks for your detailed suggestion. Yes thats a GPT .. the o/p is from parted. Is this a removable or some sort, like USB, firewire, eSATA, hot-plug SCSI, Fibre-channel, or SAS? Could it have been taken out to another machine at any time? What kind of interfaces have sda, sdb, sdc, and sdd attached, and what kind of interface is attached to sde? ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] data recovery
On Fri, Sep 23, 2011 at 3:17 PM, John R Pierce pie...@hogranch.com wrote: On 09/23/11 12:33 PM, m.r...@5-cent.us wrote: Paras pradhan wrote: Here is o/p John Number Start End Size File system Name Flags 1 17.4kB 134MB 134MB Microsoft reserved partition msftres 2 135MB 134GB 134GB ntfs Basic data partition 3 134GB 1100GB 965GB Basic data partition snip Looks to me as though someone started to install Windows on top of your box. This isn't partition data magically changed - best guess is someone started, then stopped, realizing it was the wrong box they were working on. ay-yup, thats EXACTLY what it looks like. a NEWER version of Windows at that. You mean the newer windows will create the partition schema as we are seeing it now? And you think its the automatic partitioning by windows if somebody has the access to this? Thanks Paras. Weird how they got disk sde and not sda but I've seen Windows having a completely different idea of which device was '0' than Linux before... -- john r pierce N 37, W 122 santa cruz ca mid-left coast ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] data recovery
opps thats a typo.. the 3rd partition is yes 1.1TB and not 10GB. sorry. Paras. On Fri, Sep 23, 2011 at 3:43 PM, John R Pierce pie...@hogranch.com wrote: On 09/23/11 1:32 PM, Paras pradhan wrote: You mean the newer windows will create the partition schema as we are seeing it now? And you think its the automatic partitioning by windows if somebody has the access to this? i just noticed that 3rd partition is 1.1TB. you had said... Suddenly my disk device's geometry has been changed to something that doesnot make any sense. Its a 1.8TB in size and had only one single partition. Now I can see 3 partitions sde1, sde2 and sde2 of sizes 130M, 140GB and 10GB. even odder. anyways, the reason I suggested a 'newer version' of windows, is I believe starting with Windows Vista and Server 2008, the windows installer creates a small hidden partition for the boot stuff. The fact that the 2nd partition is tagged as NTFS is why we suggested Windows at all. -- john r pierce N 37, W 122 santa cruz ca mid-left coast ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
[CentOS] HBA port
Hi, I have a host which is connected to SAN via single Fibre channel HBA (qlogic). I have several LUNS assigned to this (sdc, sdd). I added another single port HBA to this host. I can now see two world wide names. Now the confusion is which world wide name does sdc and sdd is/was using. scsi_id -g -u -s /block/sdc only gives wwid but I need the wwn for sdc and sdd. Thanks Paras. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] network interface question
On Fri, Oct 15, 2010 at 3:57 AM, Peter Kjellstrom c...@nsc.liu.se wrote: On Thursday 14 October 2010, Paras pradhan wrote: ... I have eight nics and its getting difficult to me which MAC id represents which physical port. Any way to find this? Have a look at the -p option to ethtool It would be useful (to me) if I can use mac address instead of interface name in -p option. Paras. /Peter Thanks! Paras. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] network interface question
On Fri, Oct 15, 2010 at 3:48 AM, Giles Coochey gi...@coochey.net wrote: On 15/10/2010 10:36, John Doe wrote: From: Paras pradhan pradhanpa...@gmail.com I have eight nics and its getting difficult to me which MAC id represents which physical port. Any way to find this? Unless you are 100% sure the nics detection follow a sequential order that matches the nics physical ports order, I think you will have to test them one at a time... JD Not sure whether this is true for all operating systems, but in many systems I have come across the following ordering convention: * Onboard NIC's get listed first, e.g. eth0, eth1. * First PCI bus gets listsed next, starting at slot 1... e.g. eth1, eth2 Didn't happen * If there are multiple interfaces per card then they are ordered in increasing MAC address value. Might be true but never tested. Planning to test this. Paras. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] network interface question
Yes I just tested like this.. What i did was: ifconfig -a gives me logical names such as: __tmp1035166962 , ethX and ethtool -p __tmp1035166962 makes blinking in the network port. My problem is resolved. Thanks a lot guys. Appreciate it. Paras. On Fri, Oct 15, 2010 at 12:12 PM, Bowie Bailey bowie_bai...@buc.com wrote: On 10/15/2010 1:10 PM, Bowie Bailey wrote: On 10/15/2010 12:44 PM, Paras pradhan wrote: On Fri, Oct 15, 2010 at 3:57 AM, Peter Kjellstrom c...@nsc.liu.se wrote: On Thursday 14 October 2010, Paras pradhan wrote: ... I have eight nics and its getting difficult to me which MAC id represents which physical port. Any way to find this? Have a look at the -p option to ethtool It would be useful (to me) if I can use mac address instead of interface name in -p option. Try this script (untested): #!/bin/bash ETH=`ifconfig | grep -i $1 | cut -d ' ' -f 1` echo Blinking $ETH - $1 ethtool -p $ETH 30 Just call it with the mac address as an argument. It will find the interface with ifconfig and then call ethtool to blink the lights for 30 seconds. (Assuming your NIC supports ethtool. The system I tried to test this on was not supported...) oops... Make that ifconfig -a in the script to find inactive interfaces. -- Bowie ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] network interface question
It looks like when there are no ifcfg-* files , then the kernel assigns some default logical names ( don;t know how and why), but if we create ifcfg-ethx files then it overrides it. That should be ok (?) i think. One more question: I have eight nics and its getting difficult to me which MAC id represents which physical port. Any way to find this? Thanks! Paras. On Thu, Oct 14, 2010 at 3:53 AM, John Doe jd...@yahoo.com wrote: From: Paras pradhan pradhanpa...@gmail.com I don't have ifcfg-eth1 in my /etc/sysconfig/network-scripts. Maybe try to have one and put: ONBOOT=no JD ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
[CentOS] network interface question
Hi, I don't have ifcfg-eth1 in my /etc/sysconfig/network-scripts. But when I do ifconfig eth1 I can see output as below. If I do ifconfig eth12 , I don't see anything which i am assume is normal. eth1 Link encap:Ethernet HWaddr 00:24:E8:44:DB:CC BROADCAST MULTICAST MTU:1500 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:0 (0.0 b) TX bytes:0 (0.0 b) Interrupt:17 Memory:e800-e8012800 Don't know why and how this is happening. Thanks! Paras. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] network interface question
I have eight nics as below [pprad...@cvprd1 ~]$ ./lshw -short -class network WARNING: you should run this program as super-user. H/W pathDevice Class Description === /0/100/4/0/0eth4 networkNetXtreme II BCM5708 Gigabit Ethernet /0/100/5/0/0eth1 networkNetXtreme II BCM5708 Gigabit Ethernet /0/100/9/0/0eth6 networkNetXtreme II BCM5708 Gigabit Ethernet /0/100/a/0/0eth7 networkNetXtreme II BCM5708 Gigabit Ethernet /0/100/c/0/2/0 __tmp1035166962 network82575GB Gigabit Network Connection /0/100/c/0/2/0.1eth5 network82575GB Gigabit Network Connection /0/100/c/0/4/0 __tmp619132850 network82575GB Gigabit Network Connection /0/100/c/0/4/0.1__tmp1445504961 network82575GB Gigabit Network Connection On that only eth4, eth6 and eth7 are configured ( or have ifcfg-eth4 , ifcfg-eth6 and ifcfg-eth7) . Wondering why there is eth1 and eth5 and also _tmp* Thanks! Paras. On Wed, Oct 13, 2010 at 5:33 PM, Jacob Bresciani ja...@aers.ca wrote: eth1 exists because the /dev device was found on boot (you have 2 or more network interfaces). eth12 does due to you not have 13+ nic's or did not map a network device to be eth12. On Wed, Oct 13, 2010 at 3:26 PM, Paras pradhan pradhanpa...@gmail.com wrote: Hi, I don't have ifcfg-eth1 in my /etc/sysconfig/network-scripts. But when I do ifconfig eth1 I can see output as below. If I do ifconfig eth12 , I don't see anything which i am assume is normal. eth1 Link encap:Ethernet HWaddr 00:24:E8:44:DB:CC BROADCAST MULTICAST MTU:1500 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:0 (0.0 b) TX bytes:0 (0.0 b) Interrupt:17 Memory:e800-e8012800 Don't know why and how this is happening. Thanks! Paras. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos -- Jacob Bresciani Linux Systems Administrator Advanced Ecommerce Research Systems / Terapeak Cell: 250 418-5412 ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] network interface question
There are eight nics. But i don't get output of all of eth0 to eth7. Paras. On Wed, Oct 13, 2010 at 5:40 PM, John R Pierce pie...@hogranch.com wrote: On 10/13/10 3:26 PM, Paras pradhan wrote: Hi, I don't have ifcfg-eth1 in my /etc/sysconfig/network-scripts. But when I do ifconfig eth1 I can see output as below. If I do ifconfig eth12 , I don't see anything which i am assume is normal. eth1 Link encap:Ethernet HWaddr 00:24:E8:44:DB:CC BROADCAST MULTICAST MTU:1500 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:0 (0.0 b) TX bytes:0 (0.0 b) Interrupt:17 Memory:e800-e8012800 Don't know why and how this is happening. Its unclear what your actual question is, but that behavior indicates that you have in fact an eth1 physical ethernet adapter but you haven't enabled or configured it (note there's no 'UP' or 'RUNNING' shown there). you probably do not have an eth12 interface, hence why that gave no output. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] network interface question
Nothing in the dmesg except this: Broadcom NetXtreme II Gigabit Ethernet Driver bnx2 v2.0.2 (Aug 21, 2009) eth0: Broadcom NetXtreme II BCM5708 1000Base-T (B2) PCI-X 64-bit 133MHz found at mem e600, IRQ 16, node addr 0024e848f03d eth1: Broadcom NetXtreme II BCM5708 1000Base-T (B2) PCI-X 64-bit 133MHz found at mem e800, IRQ 17, node addr 0024e848f03f eth2: Broadcom NetXtreme II BCM5708 1000Base-T (B2) PCI-X 64-bit 133MHz found at mem ea00, IRQ 19, node addr 0026b9662f43 eth3: Broadcom NetXtreme II BCM5708 1000Base-T (B2) PCI-X 64-bit 133MHz found at mem ec00, IRQ 20, node addr 0026b9662f45 Paras. On Wed, Oct 13, 2010 at 5:47 PM, Les Mikesell lesmikes...@gmail.com wrote: On 10/13/2010 5:26 PM, Paras pradhan wrote: Hi, I don't have ifcfg-eth1 in my /etc/sysconfig/network-scripts. But when I do ifconfig eth1 I can see output as below. If I do ifconfig eth12 , I don't see anything which i am assume is normal. eth1 Link encap:Ethernet HWaddr 00:24:E8:44:DB:CC BROADCAST MULTICAST MTU:1500 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:0 (0.0 b) TX bytes:0 (0.0 b) Interrupt:17 Memory:e800-e8012800 Don't know why and how this is happening. The output of 'dmesg' should show some details about the device detected as eth1. -- Les Mikesell lesmikes...@gmail.com ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] multipath troubleshoot
Reboot in to the latest kernel fixed this issue. Paras. On Fri, Sep 17, 2010 at 1:19 PM, Paras pradhan pradhanpa...@gmail.com wrote: Hi, My storage admin just assigned a Lun (fibre) to my server. Then re scanned using echo 1 /sys/class/fc_host/host5/issue_lip echo 1 /sys/class/fc_host/host6/issue_lip I can see the scsi device using dmesg But mpath device are not created for this LUN Pleas see below. The last 4 should be active and I think this is the problem Kernel: 2.6.18-164.11.1.el5xen , EL 5.5 -- [r...@cvprd3 lvm]# multipathd -k multipathd show paths hcil dev dev_t pri dm_st chk_st next_check 5:0:0:0 sdb 8:16 1 [active][ready] XXX... 7/20 5:0:0:1 sdc 8:32 1 [active][ready] XXX... 7/20 5:0:0:16384 sdd 8:48 1 [active][ready] XXX... 7/20 5:0:0:16385 sde 8:64 1 [active][ready] XXX... 7/20 5:0:0:32768 sdf 8:80 1 [active][ready] XXX... 7/20 5:0:0:32769 sdg 8:96 1 [active][ready] XXX... 7/20 5:0:0:49152 sdh 8:112 1 [active][ready] XXX... 7/20 5:0:0:49153 sdi 8:128 1 [active][ready] XXX... 7/20 5:0:0:2 sdj 8:144 1 [active][ready] XXX... 7/20 5:0:0:16386 sdk 8:160 1 [active][ready] XXX... 7/20 5:0:0:32770 sdl 8:176 1 [active][ready] XXX... 7/20 5:0:0:49154 sdm 8:192 1 [active][ready] XXX... 7/20 5:0:0:3 sdn 8:208 1 [active][ready] XXX... 7/20 5:0:0:16387 sdo 8:224 1 [active][ready] XXX... 7/20 5:0:0:32771 sdp 8:240 1 [active][ready] XXX... 7/20 5:0:0:49155 sdq 65:0 1 [active][ready] XXX... 7/20 5:0:0:4 sdr 65:16 1 [active][ready] XXX... 7/20 5:0:0:16388 sds 65:32 1 [active][ready] XXX... 7/20 5:0:0:32772 sdt 65:48 1 [active][ready] XXX... 7/20 5:0:0:49156 sdu 65:64 1 [active][ready] XXX... 7/20 5:0:0:5 sdv 65:80 0 [undef] [faulty] [orphan] 5:0:0:16389 sdw 65:96 0 [undef] [faulty] [orphan] 5:0:0:32773 sdx 65:112 0 [undef] [faulty] [orphan] 5:0:0:49157 sdy 65:128 0 [undef] [faulty] [orphan] multipathd Thanks in Adv Paras. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
[CentOS] multipath troubleshoot
Hi, My storage admin just assigned a Lun (fibre) to my server. Then re scanned using echo 1 /sys/class/fc_host/host5/issue_lip echo 1 /sys/class/fc_host/host6/issue_lip I can see the scsi device using dmesg But mpath device are not created for this LUN Pleas see below. The last 4 should be active and I think this is the problem Kernel: 2.6.18-164.11.1.el5xen , EL 5.5 -- [r...@cvprd3 lvm]# multipathd -k multipathd show paths hcildev dev_t pri dm_st chk_st next_check 5:0:0:0 sdb 8:16 1 [active][ready] XXX... 7/20 5:0:0:1 sdc 8:32 1 [active][ready] XXX... 7/20 5:0:0:16384 sdd 8:48 1 [active][ready] XXX... 7/20 5:0:0:16385 sde 8:64 1 [active][ready] XXX... 7/20 5:0:0:32768 sdf 8:80 1 [active][ready] XXX... 7/20 5:0:0:32769 sdg 8:96 1 [active][ready] XXX... 7/20 5:0:0:49152 sdh 8:112 1 [active][ready] XXX... 7/20 5:0:0:49153 sdi 8:128 1 [active][ready] XXX... 7/20 5:0:0:2 sdj 8:144 1 [active][ready] XXX... 7/20 5:0:0:16386 sdk 8:160 1 [active][ready] XXX... 7/20 5:0:0:32770 sdl 8:176 1 [active][ready] XXX... 7/20 5:0:0:49154 sdm 8:192 1 [active][ready] XXX... 7/20 5:0:0:3 sdn 8:208 1 [active][ready] XXX... 7/20 5:0:0:16387 sdo 8:224 1 [active][ready] XXX... 7/20 5:0:0:32771 sdp 8:240 1 [active][ready] XXX... 7/20 5:0:0:49155 sdq 65:0 1 [active][ready] XXX... 7/20 5:0:0:4 sdr 65:16 1 [active][ready] XXX... 7/20 5:0:0:16388 sds 65:32 1 [active][ready] XXX... 7/20 5:0:0:32772 sdt 65:48 1 [active][ready] XXX... 7/20 5:0:0:49156 sdu 65:64 1 [active][ready] XXX... 7/20 5:0:0:5 sdv 65:80 0 [undef] [faulty] [orphan] 5:0:0:16389 sdw 65:96 0 [undef] [faulty] [orphan] 5:0:0:32773 sdx 65:112 0 [undef] [faulty] [orphan] 5:0:0:49157 sdy 65:128 0 [undef] [faulty] [orphan] multipathd Thanks in Adv Paras. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
[CentOS] Bonding modes
I have a bonded interface running in mode 1 which is active/passive and no issue with this. I need to change it to mode 0 for active/active setup. Does mode 0 is dependent on the switches configuration? My setup is: 2 links from bonded interface is connected to different switches. When I change to mode0 from mode1 , bond0 is not coming up. These are the steps I performed 1) changed to options bond0 mode=0 miimon=100 from options bond0 mode=0 miimon=100 2) modprobe bonding 3) service network restart Thanks ! Paras. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Bonding modes
Nate, Thanks for you input. 802.3ad seems better but I am not in a position to terminate both links in the same switch or same stack. What about mode 6? Thanks Paras. On Wed, Jan 13, 2010 at 4:31 PM, nate cen...@linuxpowered.net wrote: Paras pradhan wrote: I have a bonded interface running in mode 1 which is active/passive and no issue with this. I need to change it to mode 0 for active/active setup. Does mode 0 is dependent on the switches configuration? My setup is: 2 links from bonded interface is connected to different switches. You really should go the 802.3ad route (mode=4) if anything, this does require switch support. You can get unpredictable results with mode=0, and if you want best performance and availability stick to 802.3ad, which does require going to the same switch(or stack of switches). Myself with bonding on linux I use only mode=1. Another user like yourself posted on this topic a few months ago asking the same kind of question, and went down the non-802.3ad route and had major issues. Also note that your single-stream performance will not exceed that of a single link between hosts. So if your doing a file transfer between two hosts for example and you have several 1GbE links between them the throughput of that transfer will not exceed 1Gbps. Load balancing is done on a per MAC/IP/tcp port basis depending on the equipment in use. 10GbE is really cheap these days(cheaper than 1GbE in some cases on a per Gb basis) if you need faster performance, and simple to configure, I wrote a blog on this a couple of months ago: http://www.techopsguys.com/2009/11/17/affordable-10gbe-has-arrived/ nate ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Bonding modes
Thanks nate. Right now I am not concerned with the load balancing. I have few cluster nodes and if I run mode1 , then the failover time may lead to cluster timeout. I have not tested it yet but I will do it. So if the failover time from active to backup is very small and in miliseconds my cluster can afford that and I will stick with mode 0. Is there a way to change this time/durartion ? Thanks Paras. On Wed, Jan 13, 2010 at 5:18 PM, nate cen...@linuxpowered.net wrote: Paras pradhan wrote: Nate, Thanks for you input. 802.3ad seems better but I am not in a position to terminate both links in the same switch or same stack. What about mode 6? I have a NFS cluster running mode 6 with two systems, it works ok, been running for a bit over a year now. Each system has 4 NICs, and 4 IPs(load balancing done mostly via round robin DNS). The systems run CentOS 4.x, they are basically appliances everything comes pre-configured by the vendor. So I can say it can work, and does work when properly configured, though I would not use it myself. The vendor has since moved away from this and is going with 802.3ad for better standards compliance. nate ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Bonding modes
On Wed, Jan 13, 2010 at 5:36 PM, nate cen...@linuxpowered.net wrote: Paras pradhan wrote: Thanks nate. Right now I am not concerned with the load balancing. I have few cluster nodes and if I run mode1 , then the failover time may lead to cluster timeout. I have not tested it yet but I will do it. So if the failover time from active to backup is very small and in miliseconds my cluster can afford that and I will stick with mode 0. Is there a way to change this time/durartion ? You can change the polling interval with the miimon option, but I'm not sure how precise you can get, it does take some time for the system to register a link failure, if that is infact what causes the network to fail. Another failure mode is a layer 2 failure which can detected in some cases using the arp monitor. I think rather than trying to achieve zero loss on the network with regards to failures you should tune the cluster to be more tolerant and not raise a fit if the network is down for This makes sense nate. Thanks! Paras. a second or two. nate ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] multipath
Upgrding the kernel to 2.6.18-164.10.1.el5xen brought back /dev/dm-* and now multipath -ll has the ouput. I am curious about what has caused the lost of /dev/dm* in my previous kernel. Any ideas? Paras. On Mon, Jan 11, 2010 at 8:09 PM, Paras pradhan pradhanpa...@gmail.comwrote: Yes every thing's loaded. Here is the output: [r...@cvprd1 ~]# lsmod | grep dm dm_round_robin 36801 0 rdma_cm68565 1 ib_iser ib_cm 73449 1 rdma_cm iw_cm 43465 1 rdma_cm ib_sa 75209 2 rdma_cm,ib_cm ib_core 105157 6 ib_iser,rdma_cm,ib_cm,iw_cm,ib_sa,ib_mad ib_addr41929 1 rdma_cm dm_multipath 56153 1 dm_round_robin scsi_dh41665 1 dm_multipath dm_raid45 99401 0 dm_message 36289 1 dm_raid45 dm_region_hash 46273 1 dm_raid45 dm_mem_cache 39489 1 dm_raid45 dm_snapshot52105 0 dm_zero35265 0 dm_mirror 54737 0 dm_log 44993 3 dm_raid45,dm_region_hash,dm_mirror dm_mod101521 11 dm_multipath,dm_raid45,dm_snapshot,dm_zero,dm_mirror,dm_log Thanks Paras. On Mon, Jan 11, 2010 at 6:33 PM, nate cen...@linuxpowered.net wrote: Paras pradhan wrote: Hi. Somehow I do not see any out put using multipath -l or multipath -ll . But I can see using dry run ie multipath -d. Also I do not see /dev/dm-* It was there before. How do I re claim it. Are the modules loaded? [r...@dc1-mysql001a:~]# lsmod | grep dm dm_zero35265 0 dm_mirror 60617 0 dm_round_robin 36801 1 dm_multipath 52945 2 dm_round_robin dm_mod 99737 17 dm_zero,dm_mirror,dm_multipath [r...@dc1-mysql001a:~]# multipath -l 350002ac0006a0714dm-1 3PARdata,VV [size=1.0T][features=0][hwhandler=0] \_ round-robin 0 [prio=0][active] \_ 1:0:0:3 sdc 8:32 [active][undef] \_ 1:0:1:3 sde 8:64 [active][undef] \_ 2:0:0:3 sdg 8:96 [active][undef] \_ 2:0:1:3 sdi 8:128 [active][undef] 350002ac000790714dm-0 3PARdata,VV [size=2.0T][features=0][hwhandler=0] \_ round-robin 0 [prio=0][active] \_ 1:0:0:2 sdb 8:16 [active][undef] \_ 1:0:1:2 sdd 8:48 [active][undef] \_ 2:0:0:2 sdf 8:80 [active][undef] \_ 2:0:1:2 sdh 8:112 [active][undef] nate ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] multipath
Can anybody tell me if my multipath o/p is fine?
I have a active/active setup and when I unplug the FC SAN cable on one of
the ports of my HBA my host is being un responsive and need to reboot it.
When I do
multipath -ll
I can see:
[r...@cvprd2 etc]# multipath -ll
mpath2 (360060e8004770d00770d018c) dm-1 HITACHI,OPEN-V*10
[size=335G][features=1 queue_if_no_path][hwhandler=0][rw]
\_ round-robin 0 [prio=8][active]
\_ 6:0:0:1 sdc 8:32 [active][ready]
\_ 6:0:0:16385 sde 8:64 [active][ready]
\_ 6:0:0:32769 sdg 8:96 [active][ready]
\_ 6:0:0:49153 sdi 8:128 [active][ready]
\_ 5:0:0:1 sdk 8:160 [active][ready]
\_ 5:0:0:16385 sdm 8:192 [active][ready]
\_ 5:0:0:32769 sdo 8:224 [active][ready]
\_ 5:0:0:49153 sdq 65:0 [active][ready]
mpath1 (360060e8004770d00770d0154) dm-0 HITACHI,OPEN-V*9
[size=301G][features=1 queue_if_no_path][hwhandler=0][rw]
\_ round-robin 0 [prio=8][active]
\_ 6:0:0:0 sdb 8:16 [active][ready]
\_ 6:0:0:16384 sdd 8:48 [active][ready]
\_ 6:0:0:32768 sdf 8:80 [active][ready]
\_ 6:0:0:49152 sdh 8:112 [active][ready]
\_ 5:0:0:0 sdj 8:144 [active][ready]
\_ 5:0:0:16384 sdl 8:176 [active][ready]
\_ 5:0:0:32768 sdn 8:208 [active][ready]
\_ 5:0:0:49152 sdp 8:240 [active][ready]
[r...@cvprd2 etc]#
--
But when I do multipath -v2 i donot see anything..
[r...@cvprd2 etc]# multipath -v2
[r...@cvprd2 etc]#
--
My multipath.conf is as below:
[r...@cvprd1 etc]# more multipath.conf
# This is a basic configuration file with some examples, for device mapper
# multipath.
# For a complete list of the default configuration values, see
# /usr/share/doc/device-mapper-multipath-0.4.7/multipath.conf.defaults
# For a list of configuration options with descriptions, see
# /usr/share/doc/device-mapper-multipath-0.4.7/multipath.conf.annotated
# Blacklist all devices by default. Remove this to enable multipathing
# on the default devices.
blacklist {
devnode ^sda
}
## Use user friendly names, instead of using WWIDs as names.
defaults {
user_friendly_names yes
polling_interval 5
no_path_retry 3
failover immediate
path_grouping_policy multibus
rr_weight priorities
path_checker readsector0
}
devices {
device {
vendor HITACHI
product OPEN-V
path_grouping_policymultibus
path_checkerreadsector0
getuid_callout /sbin/scsi_id -g -u -p0x80 -s
/block/%n
}
}
[r...@cvprd1 etc]#
Thanks !
Paras
On Tue, Jan 12, 2010 at 10:37 AM, Paras pradhan pradhanpa...@gmail.comwrote:
Upgrding the kernel to 2.6.18-164.10.1.el5xen brought back /dev/dm-* and
now multipath -ll has the ouput.
I am curious about what has caused the lost of /dev/dm* in my previous
kernel.
Any ideas?
Paras.
On Mon, Jan 11, 2010 at 8:09 PM, Paras pradhan pradhanpa...@gmail.comwrote:
Yes every thing's loaded.
Here is the output:
[r...@cvprd1 ~]# lsmod | grep dm
dm_round_robin 36801 0
rdma_cm68565 1 ib_iser
ib_cm 73449 1 rdma_cm
iw_cm 43465 1 rdma_cm
ib_sa 75209 2 rdma_cm,ib_cm
ib_core 105157 6 ib_iser,rdma_cm,ib_cm,iw_cm,ib_sa,ib_mad
ib_addr41929 1 rdma_cm
dm_multipath 56153 1 dm_round_robin
scsi_dh41665 1 dm_multipath
dm_raid45 99401 0
dm_message 36289 1 dm_raid45
dm_region_hash 46273 1 dm_raid45
dm_mem_cache 39489 1 dm_raid45
dm_snapshot52105 0
dm_zero35265 0
dm_mirror 54737 0
dm_log 44993 3 dm_raid45,dm_region_hash,dm_mirror
dm_mod101521 11
dm_multipath,dm_raid45,dm_snapshot,dm_zero,dm_mirror,dm_log
Thanks
Paras.
On Mon, Jan 11, 2010 at 6:33 PM, nate cen...@linuxpowered.net wrote:
Paras pradhan wrote:
Hi.
Somehow I do not see any out put using multipath -l or multipath -ll .
But I
can see using dry run ie multipath -d.
Also I do not see /dev/dm-*
It was there before. How do I re claim it.
Are the modules loaded?
[r...@dc1-mysql001a:~]# lsmod | grep dm
dm_zero35265 0
dm_mirror 60617 0
dm_round_robin 36801 1
dm_multipath 52945 2 dm_round_robin
dm_mod 99737 17 dm_zero,dm_mirror,dm_multipath
[r...@dc1-mysql001a:~]# multipath -l
350002ac0006a0714dm-1 3PARdata,VV
[size=1.0T][features=0][hwhandler=0]
\_ round-robin 0 [prio=0][active]
\_ 1:0:0:3 sdc 8:32 [active][undef]
\_ 1:0:1:3 sde 8:64 [active][undef]
\_ 2:0:0:3 sdg 8:96 [active][undef]
\_ 2:0:1:3 sdi 8:128 [active][undef]
350002ac000790714dm-0 3PARdata,VV
[size=2.0T][features=0][hwhandler=0]
\_ round-robin 0 [prio=0][active]
\_ 1:0:0:2 sdb 8:16 [active][undef]
\_ 1:0:1:2 sdd 8:48 [active][undef]
\_ 2:0:0:2 sdf 8:80 [active][undef]
\_ 2:0:1:2 sdh 8:112 [active][undef
[CentOS] multipath
Hi. Somehow I do not see any out put using multipath -l or multipath -ll . But I can see using dry run ie multipath -d. Also I do not see /dev/dm-* It was there before. How do I re claim it. Thanks! Paras. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] multipath
Yes every thing's loaded. Here is the output: [r...@cvprd1 ~]# lsmod | grep dm dm_round_robin 36801 0 rdma_cm68565 1 ib_iser ib_cm 73449 1 rdma_cm iw_cm 43465 1 rdma_cm ib_sa 75209 2 rdma_cm,ib_cm ib_core 105157 6 ib_iser,rdma_cm,ib_cm,iw_cm,ib_sa,ib_mad ib_addr41929 1 rdma_cm dm_multipath 56153 1 dm_round_robin scsi_dh41665 1 dm_multipath dm_raid45 99401 0 dm_message 36289 1 dm_raid45 dm_region_hash 46273 1 dm_raid45 dm_mem_cache 39489 1 dm_raid45 dm_snapshot52105 0 dm_zero35265 0 dm_mirror 54737 0 dm_log 44993 3 dm_raid45,dm_region_hash,dm_mirror dm_mod101521 11 dm_multipath,dm_raid45,dm_snapshot,dm_zero,dm_mirror,dm_log Thanks Paras. On Mon, Jan 11, 2010 at 6:33 PM, nate cen...@linuxpowered.net wrote: Paras pradhan wrote: Hi. Somehow I do not see any out put using multipath -l or multipath -ll . But I can see using dry run ie multipath -d. Also I do not see /dev/dm-* It was there before. How do I re claim it. Are the modules loaded? [r...@dc1-mysql001a:~]# lsmod | grep dm dm_zero35265 0 dm_mirror 60617 0 dm_round_robin 36801 1 dm_multipath 52945 2 dm_round_robin dm_mod 99737 17 dm_zero,dm_mirror,dm_multipath [r...@dc1-mysql001a:~]# multipath -l 350002ac0006a0714dm-1 3PARdata,VV [size=1.0T][features=0][hwhandler=0] \_ round-robin 0 [prio=0][active] \_ 1:0:0:3 sdc 8:32 [active][undef] \_ 1:0:1:3 sde 8:64 [active][undef] \_ 2:0:0:3 sdg 8:96 [active][undef] \_ 2:0:1:3 sdi 8:128 [active][undef] 350002ac000790714dm-0 3PARdata,VV [size=2.0T][features=0][hwhandler=0] \_ round-robin 0 [prio=0][active] \_ 1:0:0:2 sdb 8:16 [active][undef] \_ 1:0:1:2 sdd 8:48 [active][undef] \_ 2:0:0:2 sdf 8:80 [active][undef] \_ 2:0:1:2 sdh 8:112 [active][undef] nate ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] SAN help
Since I see the following entry
at /usr/share/doc/device-mapper-multipath-0.4.7/multipath.conf.defaults
I am assuming I do not need to add it to multipath.conf but I do not know
exaclty. Also my storage is Hitachi openv and the default one has Product
name as DF.* as you can see below.
So I am confused in here.
device {
# vendor HITACHI
# product DF.*
# getuid_callout /sbin/scsi_id -g -u -s /block/%n
# prio_callout /sbin/mpath_prio_hds_modular %d
# features 0
# hardware_handler 0
# path_grouping_policy group_by_prio
# failback immediate
# rr_weight uniform
# rr_min_io 1000
# path_checker readsector0
# }
Thanks
Paras.
On Fri, Jan 8, 2010 at 9:39 AM, Ray Van Dolson ra...@bludgeon.org wrote:
On Fri, Jan 08, 2010 at 09:37:25AM -0600, Paras pradhan wrote:
Per,
Yes I have a device mapper out of my detected LUNS. My storage is Hitachi
OpenV . My multipath.conf files looks like below. Do I need to add
anything
to it since failover is not working. When I unplugg the cable in the 1st
port of my HBA... my server reboots and I don't know what is causing this
reboot. And after reboot when I plug the cable back, no recovery is done
and
to make it work I have to reboot the server once again with cable
plugged.
--
blacklist {
devnode ^sda
}
defaults {
user_friendly_names yes
failback immediate
}
Seems like you need a devices {} section to define how multipathd
interacts with your storage, identifies problems and chooses a path to
use...
Ray
___
CentOS mailing list
CentOS@centos.org
http://lists.centos.org/mailman/listinfo/centos
___
CentOS mailing list
CentOS@centos.org
http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] SAN help
Thanks for the Link Ray.
One thing I am confused is... failover manual means whenever there is a
link failure this will case the host to be rebooted?
Paras.
On Fri, Jan 8, 2010 at 9:53 AM, Ray Van Dolson ra...@bludgeon.org wrote:
On Fri, Jan 08, 2010 at 09:45:14AM -0600, Paras pradhan wrote:
Since I see the following entry
at /usr/share/doc/device-mapper-multipath-0.4.7/multipath.conf.defaults
I am assuming I do not need to add it to multipath.conf but I do not know
exaclty. Also my storage is Hitachi openv and the default one has Product
name as DF.* as you can see below.
So I am confused in here.
device {
# vendor HITACHI
# product DF.*
# getuid_callout /sbin/scsi_id -g -u -s /block/%n
# prio_callout /sbin/mpath_prio_hds_modular %d
# features 0
# hardware_handler 0
# path_grouping_policy group_by_prio
# failback immediate
# rr_weight uniform
# rr_min_io 1000
# path_checker readsector0
# }
I'm not familiar with this SAN, so can't suggest to you a better
device configuration snippet.
Google may help you out: search for your device type and
multipath.conf. Alternately, if your vendor supports RHEL5 (I'm sure
they do), you could contact them and ask them to provide you with a
known good configuration.
Actually, a quick search yields this:
http://www.calivia.com/book/export/html/74
Which seems to have what you need (verify of course).
Ray
___
CentOS mailing list
CentOS@centos.org
http://lists.centos.org/mailman/listinfo/centos
___
CentOS mailing list
CentOS@centos.org
http://lists.centos.org/mailman/listinfo/centos
[CentOS] SAN help
My CentOS 5.4 box has a single HBA card with 2 ports connected to my Storage. 2 Luns are assigned to my HBA card. Under /dev instead of seeing 4 devices I can see 12 devices from sdb to sdm. I am using qlogic driver that is bulitin to the OS. Has any one seen this kind of situation? Paras ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] SAN help
Yes here is th o/p of fdisk -l. Two Luns are assigned. one of 323 G and another of 359 G as seen blow. sda is my local disk. So do you think incorrect zoning can lead to this? Thanks Paras. - [r...@prd1 ~]# fdisk -l Disk /dev/sda: 146.1 GB, 146163105792 bytes 255 heads, 63 sectors/track, 17769 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System /dev/sda1 * 1 33 265041 83 Linux /dev/sda2 34421033551752+ 82 Linux swap / Solaris /dev/sda34211682120972857+ 83 Linux /dev/sda46822 17769879398105 Extended /dev/sda56822 1776987939778+ 83 Linux Disk /dev/sdb: 323.4 GB, 323459481600 bytes 255 heads, 63 sectors/track, 39325 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System /dev/sdb1 1 2 16033+ 83 Linux /dev/sdb2 3 39325 315861997+ 83 Linux Disk /dev/sdc: 359.3 GB, 359399424000 bytes 255 heads, 63 sectors/track, 43694 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System /dev/sdc1 1 43694 350972023+ 83 Linux Disk /dev/sdd: 323.4 GB, 323459481600 bytes 255 heads, 63 sectors/track, 39325 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System /dev/sdd1 1 2 16033+ 83 Linux /dev/sdd2 3 39325 315861997+ 83 Linux Disk /dev/sde: 323.4 GB, 323459481600 bytes 255 heads, 63 sectors/track, 39325 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System /dev/sde1 1 2 16033+ 83 Linux /dev/sde2 3 39325 315861997+ 83 Linux Disk /dev/sdf: 359.3 GB, 359399424000 bytes 255 heads, 63 sectors/track, 43694 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System /dev/sdf1 1 43694 350972023+ 83 Linux Disk /dev/sdg: 323.4 GB, 323459481600 bytes 255 heads, 63 sectors/track, 39325 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System /dev/sdg1 1 2 16033+ 83 Linux /dev/sdg2 3 39325 315861997+ 83 Linux Disk /dev/sdh: 323.4 GB, 323459481600 bytes 255 heads, 63 sectors/track, 39325 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System /dev/sdh1 1 2 16033+ 83 Linux /dev/sdh2 3 39325 315861997+ 83 Linux Disk /dev/sdi: 359.3 GB, 359399424000 bytes 255 heads, 63 sectors/track, 43694 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System /dev/sdi1 1 43694 350972023+ 83 Linux Disk /dev/sdj: 323.4 GB, 323459481600 bytes 255 heads, 63 sectors/track, 39325 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System /dev/sdj1 1 2 16033+ 83 Linux /dev/sdj2 3 39325 315861997+ 83 Linux Disk /dev/sdk: 323.4 GB, 323459481600 bytes 255 heads, 63 sectors/track, 39325 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System /dev/sdk1 1 2 16033+ 83 Linux /dev/sdk2 3 39325 315861997+ 83 Linux Disk /dev/sdl: 359.3 GB, 359399424000 bytes 255 heads, 63 sectors/track, 43694 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System /dev/sdl1 1 43694 350972023+ 83 Linux Disk /dev/sdm: 323.4 GB, 323459481600 bytes 255 heads, 63 sectors/track, 39325 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System /dev/sdm1 1 2 16033+ 83 Linux /dev/sdm2 3 39325 315861997+ 83 Linux On Thu, Jan 7, 2010 at 11:26 PM, Eero Volotinen eero.voloti...@iki.fiwrote: On 1/8/10 7:21 AM, Paras pradhan wrote: On Thu, Jan 7, 2010 at 11:08 PM, Eero Volotinen eero.voloti...@iki.fi mailto:eero.voloti...@iki.fi wrote: On 1/8/10 6:38 AM, Paras pradhan wrote: My CentOS 5.4 box has a single HBA card with 2 ports connected to my Storage. 2 Luns are assigned to my HBA card. Under /dev instead of seeing 4 devices I can see 12 devices from sdb to sdm. I am using
Re: [CentOS] SAN help
I did create the device mapper for multipathing but while testing failover is not working. So my concern is with the hba driver since I am seeing more than expected. Thanks Paras On Thursday, January 7, 2010, Rajagopal Swaminathan raju.rajs...@gmail.com wrote: Greetings, On Fri, Jan 8, 2010 at 11:01 AM, Paras pradhan pradhanpa...@gmail.com wrote: Hi Rajagopal, Do you mean to say this is typical and is resolved after we use device mapper multipathing? IIRC, in about 2008.11 I was tasked build a cluster with SAN. The san administrator created 3 LUNs and first time around, it showed 12 LUNs. I think it was RHEL4. Afer installation of the multipathing software from server vendor site, we got the 3 LUNs properly. But at that time I did sweat a little. Of course assuming you have two qlogic, 2 san switches etc etc. In short, most likely yes. BTW I am not a storage administrator Regards, Rajagopal ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
[CentOS] Access host from host
HI, I don't know if this is the right place to ask but here is what I am looking for. I have a centos 5.3 server in DMZ . All of the access to and fro is blocked. I have someother servers in my network which they can access to my server at DMZ. Now to connect to the server directly at DMZ (ssh, rdp. ftp), is it possible to allow access via the accessible another servers? Thanks Paras. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
[CentOS-virt] Ubuntu guest
Can I install a ubuntu guest in a para virt mode from an ISO file in CentOS Dom0 without using debootstarp? I have an appliance based on ubuntu which I need to install as a para virt guest. Thanks ! Paras. ___ CentOS-virt mailing list CentOS-virt@centos.org http://lists.centos.org/mailman/listinfo/centos-virt
Re: [CentOS-virt] Ubuntu guest
On Tue, Aug 4, 2009 at 5:51 PM, Victor Padrovpa...@gmail.com wrote: On Tue, Aug 4, 2009 at 5:45 PM, Paras pradhanpradhanpa...@gmail.com wrote: We don't use KVM here. It should be Xen. Paras. On Tue, Aug 4, 2009 at 5:43 PM, Victor Padrovpa...@gmail.com wrote: On Tue, Aug 4, 2009 at 4:57 PM, Paras pradhanpradhanpa...@gmail.com wrote: Can I install a ubuntu guest in a para virt mode from an ISO file in CentOS Dom0 without using debootstarp? I have an appliance based on ubuntu which I need to install as a para virt guest. Thanks ! Paras. ___ CentOS-virt mailing list CentOS-virt@centos.org http://lists.centos.org/mailman/listinfo/centos-virt Why don't you use KVM instead? you will not have that much trouble. -- Linux User #452368 Ubuntu User #28025 Doing a thing well is often a waste of time. //HP Mini 2GB 60GB - Ubuntu Netbook Remix JJ //Core 2 Duo 2.40Ghz 8GB 500GB - Win Vista / 7 /Ubuntu JJ //Core 2 Duo 2.40Ghz 8GB 320GB - MacOS X //Athlon 64 2.7Ghz 8GB 400GB - CentOS 5.3 //Core 2 Duo 1.86Ghz 8GB 1TB - Proxmox 1.3 //Celeron 1.8Ghz 2GB 160GB - pfSense //NSLU2 266Mhz 32MB 1TB - Debian Lenny ___ CentOS-virt mailing list CentOS-virt@centos.org http://lists.centos.org/mailman/listinfo/centos-virt ___ CentOS-virt mailing list CentOS-virt@centos.org http://lists.centos.org/mailman/listinfo/centos-virt Well, you should search about it in google. http://ubuntuforums.org/showthread.php?t=630886 -- Linux User #452368 Ubuntu User #28025 Doing a thing well is often a waste of time. //HP Mini 2GB 60GB - Ubuntu Netbook Remix JJ //Core 2 Duo 2.40Ghz 8GB 500GB - Win Vista / 7 /Ubuntu JJ //Core 2 Duo 2.40Ghz 8GB 320GB - MacOS X //Athlon 64 2.7Ghz 8GB 400GB - CentOS 5.3 //Core 2 Duo 1.86Ghz 8GB 1TB - Proxmox 1.3 //Celeron 1.8Ghz 2GB 160GB - pfSense //NSLU2 266Mhz 32MB 1TB - Debian Lenny ___ CentOS-virt mailing list CentOS-virt@centos.org http://lists.centos.org/mailman/listinfo/centos-virt I got that result before posting to this form. I need to install from an ISO not using debootstrap. Paras. ___ CentOS-virt mailing list CentOS-virt@centos.org http://lists.centos.org/mailman/listinfo/centos-virt
[CentOS-virt] Cluster failover
hi, I have 3 nodes of CentOS 5.3 running xen virtual machines as virtual machine service. This cluster is working fine. One thing I would like to know that how to make failover only to third node. What I mean to say is: I have 3 virtual machine running on node 1 and 2 virtual machines running on node 2. Now if node 1 fails I want my the node1 virtual machines to be stared only on node 3 but not on node2. Similary if node2 breaks, I want virtual machines to be started on node3 but never on node 1. Thanks ! Paras. ___ CentOS-virt mailing list CentOS-virt@centos.org http://lists.centos.org/mailman/listinfo/centos-virt
[CentOS] lvremove killed
hi, My volume group is vg. Inside that i have around 10 lvm partitions (each of 100GB). When I try to remove partitions using lvremove /dev/vg/lvm1 It acts like the machine freezes and after a long time the lvremove process gets killed saying Killed Whats wrong here. I don't see anything interesting in /var/log/message Thanks Paras. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS-virt] relocation, migration
On Fri, Aug 29, 2008 at 11:20 PM, Christopher G. Stach II [EMAIL PROTECTED]wrote: On Fri, Aug 29, 2008 at 4:21 PM, Paras pradhan [EMAIL PROTECTED] wrote: Hi, I am running a cluster having 2 nodes using red hat cluster suite. node 1 has a para virtualized guest(centOS) running under Xen. My question is when node1 is rebooted, guest is automatically relocated to node 2 . Instead of relocation, is migration possible in this case which can result in Zero down time? If you're using the xendomains init script, you can set XENDOMAINS_MIGRATE in /etc/sysconfig/xendomains. -- Christopher G. Stach II ___ CentOS-virt mailing list CentOS-virt@centos.org http://lists.centos.org/mailman/listinfo/centos-virt Added as: XENDOMAINS_MIGRATE = ipaddress --live where ipaddress is the address of the another node in the cluster. Still relocation is going on instead of migration. Thanks Paras. ___ CentOS-virt mailing list CentOS-virt@centos.org http://lists.centos.org/mailman/listinfo/centos-virt
[CentOS-virt] relocation, migration
Hi, I am running a cluster having 2 nodes using red hat cluster suite. node 1 has a para virtualized guest(centOS) running under Xen. My question is when node1 is rebooted, guest is automatically relocated to node 2 . Instead of relocation, is migration possible in this case which can result in Zero down time? Thanks in adv Paras. ___ CentOS-virt mailing list CentOS-virt@centos.org http://lists.centos.org/mailman/listinfo/centos-virt
Re: [CentOS] HP ILO Fence Configuration
On Tue, Aug 5, 2008 at 11:47 AM, John R Pierce [EMAIL PROTECTED] wrote: Balaji wrote: Dear All, Currently i am using HP x6600 Server and I have installed RHEL4 Update 4 AS Linux and RHEL4 Update 4 Support Cluster Suite in my server if you're using RHEL AS and RH Cluster Suite, you are presumably paying for Red Hat Support and should be calling them for configuration advise and assistance. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos What about configuring a cluster without fencing? is it possible? I am about to create a cluster but with out fencing device. Thanks Paras. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
