Re: [CentOS] LSI Logic MegaRAID 8480 Storage controller
+ /home/drew/bin/MegaCli -AdpPRSetDelay 168 -a0 ^MInvalid input at or near token -AdpPRSetDelay Doesn't like the syntax Looks like the manual is outdated, you should have ran a -h :) Turns out this is the correct syntax: MegaCli -AdpPR -Dsbl|EnblAuto|EnblMan|Start|Stop|Info|{SetDelay Val} -aN|-a0,1,2|-aALL MegaCli -AdpPR -SetDelay X -a0 where X is between 0 and 65535... jlc ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] LSI Logic MegaRAID 8480 Storage controller
On Wed, Mar 11, 2009 at 8:26 AM, Joseph L. Casale jcas...@activenetwerx.com wrote: + /home/drew/bin/MegaCli -AdpPRSetDelay 168 -a0 ^MInvalid input at or near token -AdpPRSetDelay Doesn't like the syntax Looks like the manual is outdated, you should have ran a -h :) Hmm. I've seen a bunch of bad syntax in the manual. Can't trust the manual. Haven't looked at the -h Will probably have better luck there. Turns out this is the correct syntax: MegaCli -AdpPR -Dsbl|EnblAuto|EnblMan|Start|Stop|Info|{SetDelay Val} -aN|-a0,1,2|-aALL MegaCli -AdpPR -SetDelay X -a0 where X is between 0 and 65535... jlc ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos -- Drew Einhorn ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
[CentOS] LSI Logic MegaRAID 8480 Storage controller policies?
Life is much better now that I'm using -h instead of the manual. I have a new question about policies Direct and DisDskCache makes sense Cached and EnDiskCache makes sense not so sure about Directand EnDskCache Cached and DisDsk Cache Do they make sense? -- Drew Einhorn ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] LSI Logic MegaRAID 8480 Storage controller policies?
Life is much better now that I'm using -h instead of the manual. I have a new question about policies Direct and DisDskCache makes sense Cached and EnDiskCache makes sense not so sure about Directand EnDskCache Cached and DisDsk Cache Do they make sense? I believe Cached|Direct refers to adapter based caching of the logical (virtual) disk whereas EnDskCache|DisDskCache refers to physical disk cache. The adapter can hold data in the event of a powerloss with a BBU but I can't see how the disc could. jlc ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] LSI Logic MegaRAID 8480 Storage controller policies?
On Wed, Mar 11, 2009 at 12:55 PM, Joseph L. Casale jcas...@activenetwerx.com wrote: Life is much better now that I'm using -h instead of the manual. I have a new question about policies Direct and DisDskCache makes sense Cached and EnDiskCache makes sense not so sure about Direct and EnDskCache Cached and DisDsk Cache Do they make sense? I believe Cached|Direct refers to adapter based caching of the logical (virtual) disk whereas EnDskCache|DisDskCache refers to physical disk cache. The adapter can hold data in the event of a powerloss with a BBU but I can't see how the disc could. Hmm. The drive cabinets could have their own UPS. Doesn't have to be very big to keep the power up for long enough for the drive disk caches to get emptied. And I've seen data centers with amaizing multiple layers of redundant power. I'm thinking production database Secondary servers should be configured for reliability, and production Primary servers should be configure for speed. The secondary will be extremely paranoid. WT Direct DisDskCache. Not sure understand the performance benefit/risk trade offs well enough to choose intelligently for the primary. Especially when the application may be making lots of assumptions about what is happening on the lower levels. And may have much more memory available to do its own caching and optimization. Does the controller really know enough about what's going on in the drive to make effective use of the drives cache to speed things up? My guess is that I'll start with WB Cached DisDskCache on the primary, and may be surprised where we end up. And it seems to me that ADRA is almost always the better choice. But I could easily be missing something important. -- Drew Einhorn ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] LSI Logic MegaRAID 8480 Storage controller
On Mon, Mar 9, 2009 at 11:14 AM, Joseph L. Casale jcas...@activenetwerx.com wrote: There is a MegaCLI command line interface that runs under the operating system. Normally I prefer command line tools. But this software is big, and complex. All I have been able to find is a reference manual, that has lots of typos and is not very well organized for me to learn what I need to know. I have not been able to find a tutorial for this software. It will take more time than I have at the moment to figure out this tool. Huh? It's one tiny binary, and the syntax is trivial? You are looking at something else... Its own help is decent and it installs via rpm on RHEL. What you need is the mr_sas_sw_ug.pdf from lsi's site. The manual IS sloppy. missing - characters in the syntax Tryijng to figure out -Val syntax megacli AdpPRSetDelay -Val -aN|-a0,1,2|-aALL + /home/drew/bin/MegaCli -AdpPRSetDelay 0 -a0 Invalid input at or near token -AdpPRSetDelay Tried sticking a - in front of the zero. Doesn't make much sense, tried it anyway, didn't help. This cheat sheet for another vintage of the controller rebadged by Dell, seems to be exactly what I need. http://tools.rapidsoft.de/perc/perc-cheat-sheet.html Looks like I can get most of what I need, without any stinking -Val That will do for now. -- Drew Einhorn ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] LSI Logic MegaRAID 8480 Storage controller
The manual IS sloppy. missing - characters in the syntax Tryijng to figure out -Val syntax megacli AdpPRSetDelay -Val -aN|-a0,1,2|-aALL + /home/drew/bin/MegaCli -AdpPRSetDelay 0 -a0 Invalid input at or near token -AdpPRSetDelay Tried sticking a - in front of the zero. Doesn't make much sense, tried it anyway, didn't help. Seriously, I get that you are frustrated, been there myself. I don't have any of our LSI's actually running at the moment, but it makes sense to me if the Patrol Read is disabled, you get an error configuring it. Just a guess... What does a -AdpPR -Info -a0 yield? jlc ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] LSI Logic MegaRAID 8480 Storage controller
On Tue, Mar 10, 2009 at 1:52 PM, Joseph L. Casale jcas...@activenetwerx.com wrote: The manual IS sloppy. missing - characters in the syntax Tryijng to figure out -Val syntax megacli AdpPRSetDelay -Val -aN|-a0,1,2|-aALL + /home/drew/bin/MegaCli -AdpPRSetDelay 0 -a0 Invalid input at or near token -AdpPRSetDelay Tried sticking a - in front of the zero. Doesn't make much sense, tried it anyway, didn't help. Seriously, I get that you are frustrated, been there myself. I don't have any of our LSI's actually running at the moment, but it makes sense to me if the Patrol Read is disabled, you get an error configuring it. Just a guess... What does a -AdpPR -Info -a0 yield? + /home/drew/bin/MegaCli -AdpPR -Info -a0 ^M Adapter 0: Patrol Read Information: Patrol Read Mode: Auto Patrol Read Execution Delay: 168 hours Number of iterations completed: 43 Current State: Stopped It's already 168 hours, lets try a command setting it to 168 hours + /home/drew/bin/MegaCli -AdpPRSetDelay 168 -a0 ^MInvalid input at or near token -AdpPRSetDelay Doesn't like the syntax + /home/drew/bin/MegaCli -AdpPRSetDelay 0 -a0 ^MInvalid input at or near token -AdpPRSetDelay Lets try setting it to 0, Doesn't like that either. -- Drew Einhorn ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] LSI Logic MegaRAID 8480 Storage controller
On Tue, Mar 10, 2009 at 4:18 PM, Joseph L. Casale jcas...@activenetwerx.com wrote: I wish I had one of my cards running, but just looking at the syntax, from my experience running this app, I would say you need to do: # MegaCli -AdpPRSetDelay -Val33 -a0 if you wanted 33 hours :) What are you trying to change it to anyway? Is the value sane? + /home/drew/bin/MegaCli -AdpPRSetDelay -Val168 -a0 ^MInvalid input at or near token -AdpPRSetDelay Hmm. It didn't like that either! I'm just trying to figure out the command syntax. And writing some utility scripts. -AdpPRSetDelay -Val is just the first command in the manual that sets a value, and there is neither a specification of the syntax for -Val, nor an example command using -Val Will probably leave the -AdpPRSetDelay at 168 But I still need the syntax for setting -Val in other commands. I bet you didn't learn the syntax from the manual. I'll bet you inherited some scripts from someone else, and learned by tweaking working scripts. -- Drew Einhorn ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] LSI Logic MegaRAID 8480 Storage controller
I bet you didn't learn the syntax from the manual. I'll bet you inherited some scripts from someone else, and learned by tweaking working scripts. Uhm, I learned from the manual. I am tempted to fire one up and just figure it out... ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] LSI Logic MegaRAID 8480 Storage controller
On Tue, Mar 10, 2009 at 6:18 PM, Joseph L. Casale jcas...@activenetwerx.com wrote: I bet you didn't learn the syntax from the manual. I'll bet you inherited some scripts from someone else, and learned by tweaking working scripts. Uhm, I learned from the manual. I am tempted to fire one up and just figure it out... Next I'm trying to setup a raid-10 logical volume. Got the two mirrors built. Now I need to stripe them Here's an excerpt from -LDPDInfo I just added a little white space it makes the output much more readable. And I deleted the stuff about other Logical Drives + /home/drew/bin/MegaCli -LDPDInfo -a0 Adapter #0 Number of Virtual Disks: 5 . . . Virtual Disk: 3 (Target Id: 2) Name: RAID Level: Primary-1, Secondary-0, RAID Level Qualifier-0 Size:285148MB State: Optimal Stripe Size: 128kB Number Of Drives:2 Span Depth:1 Default Cache Policy: WriteBack, ReadAheadNone, Direct, No Write Cache if Bad BBU Current Cache Policy: WriteThrough, ReadAheadNone, Direct, No Write Cache if Bad BBU Access Policy: Read/Write Disk Cache Policy: Disk's Default Encryption Type: None Number of Spans: 1 Span: 0 - Number of PDs: 2 PD: 0 Information Enclosure Device ID: 11 Slot Number: 3 Device Id: 5 Sequence Number: 12 Media Error Count: 0 Other Error Count: 0 Predictive Failure Count: 0 Last Predictive Failure Event Seq Number: 0 PD Type: SAS Raw Size: 286102MB [0x22ecb25c Sectors] Non Coerced Size: 285590MB [0x22dcb25c Sectors] Coerced Size: 285148MB [0x22cee000 Sectors] Firmware state: Online SAS Address(0): 0x5000c500072b15a1 SAS Address(1): 0x0 Connected Port Number: 4(path0) Inquiry Data: IBM-ESXSST3300655SS BA263LM2M7RN1026BA26 FDE Capable: Not Capable FDE Enable: Disable Secured: Unsecured Locked: Unlocked Foreign State: None Media Type: Hard Disk Device PD: 1 Information Enclosure Device ID: 11 Slot Number: 4 Device Id: 6 Sequence Number: 12 Media Error Count: 0 Other Error Count: 0 Predictive Failure Count: 0 Last Predictive Failure Event Seq Number: 0 PD Type: SAS Raw Size: 286102MB [0x22ecb25c Sectors] Non Coerced Size: 285590MB [0x22dcb25c Sectors] Coerced Size: 285148MB [0x22cee000 Sectors] Firmware state: Online SAS Address(0): 0x5000c500072b14c1 SAS Address(1): 0x0 Connected Port Number: 4(path0) Inquiry Data: IBM-ESXSST3300655SS BA263LM2QDNP1026BA26 FDE Capable: Not Capable FDE Enable: Disable Secured: Unsecured Locked: Unlocked Foreign State: None Media Type: Hard Disk Device Virtual Disk: 4 (Target Id: 4) Name: RAID Level: Primary-1, Secondary-0, RAID Level Qualifier-0 Size:285148MB State: Optimal Stripe Size: 128kB Number Of Drives:2 Span Depth:1 Default Cache Policy: WriteBack, ReadAheadNone, Direct, No Write Cache if Bad BBU Current Cache Policy: WriteThrough, ReadAheadNone, Direct, No Write Cache if Bad BBU Access Policy: Read/Write Disk Cache Policy: Disk's Default Encryption Type: None Number of Spans: 1 Span: 0 - Number of PDs: 2 PD: 0 Information Enclosure Device ID: 11 Slot Number: 5 Device Id: 7 Sequence Number: 10 Media Error Count: 0 Other Error Count: 0 Predictive Failure Count: 0 Last Predictive Failure Event Seq Number: 0 PD Type: SAS Raw Size: 286102MB [0x22ecb25c Sectors] Non Coerced Size: 285590MB [0x22dcb25c Sectors] Coerced Size: 285148MB [0x22cee000 Sectors] Firmware state: Online SAS Address(0): 0x5000c500072b2081 SAS Address(1): 0x0 Connected Port Number: 4(path0) Inquiry Data: IBM-ESXSST3300655SS BA263LM2TCW71026BA26 FDE Capable: Not Capable FDE Enable: Disable Secured: Unsecured Locked: Unlocked Foreign State: None Media Type: Hard Disk Device PD: 1 Information Enclosure Device ID: 11 Slot Number: 6 Device Id: 8 Sequence Number: 10 Media Error Count: 0 Other Error Count: 0 Predictive Failure Count: 0 Last Predictive Failure Event Seq Number: 0 PD Type: SAS Raw Size: 286102MB [0x22ecb25c Sectors] Non Coerced Size: 285590MB [0x22dcb25c Sectors] Coerced Size: 285148MB [0x22cee000 Sectors] Firmware state: Online SAS Address(0): 0x5000c500072b1ed5 SAS Address(1): 0x0 Connected Port Number: 4(path0) Inquiry Data: IBM-ESXSST3300655SS BA263LM2RPS41026BA26 FDE Capable: Not Capable FDE Enable: Disable
Re: [CentOS] LSI Logic MegaRAID 8480 Storage controller
Drives are not consistent with Disk Group. Doesn't look like it liked the way I specified the mirrors! I really can't remember, but for some reason I think in the GUI you span then mirror, but in the cli you do it one pass. Dump the two ld's and try that command over. I really can't remember, it's been several months since I set an array up and the only machines running LSI's at the moment are esxi boxes so I can't execute the cli anymore. jlc ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] LSI Logic MegaRAID 8480 Storage controller
Joseph L. Casale wrote: Drives are not consistent with Disk Group. Doesn't look like it liked the way I specified the mirrors! I really can't remember, but for some reason I think in the GUI you span then mirror, but in the cli you do it one pass. Dump the two ld's and try that command over. indeed, most of the hardware raid controllers I've used of late, you just pick 4 or more drives and build a 'raid-1' and it automatically does the mirror/stripe thing for you. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
[CentOS] LSI Logic MegaRAID 8480 Storage controller
I have LSI Logic MegaRAID 8480 Storage controller I am having trouble reconfigure one of the hardware raid devices It is configured with 4 hardware raid logical volumes on /dev/sda /dev/sdb /dev/sdc /dev/sdd. I am in the middle of rebuilding the system, and at this point I am only using one of the volumes, /dev/sda /dev/sda, /dev/sdb, and /dev/sdd are all 2 drive raid1 mirrors I will be using the hardware raid logical volumes /dev/sdb and /dev/sdd with their current configurations I doubt that the hardware raid device on /dev/hda is causing any problems /dev/sda has two partitiions /dev/sda1 is a 100 MB ext3 partition mounted on /boot /dev/sda2 is a 20 GB lvm logical volume in a 67 GB volume group with an ext3 partition mounted on / the rest of the volume group is empty. I don't like the /dev/sdc is configued. It's configured as a 4 drive raid6. It will be used for database journal, nearly all sequential writes. I would rather use raid10 There are 3 ways to configure the hardware raid. The is something called WebBIOS which is sort of like a web browser that you access from the BIOS. This is ruled out since we will need to maintain the raid configuration with shutting down the operating system, or applications. There is a MegaCLI command line interface that runs under the operating system. Normally I prefer command line tools. But this software is big, and complex. All I have been able to find is a reference manual, that has lots of typos and is not very well organized for me to learn what I need to know. I have not been able to find a tutorial for this software. It will take more time than I have at the moment to figure out this tool. Finally there is the MegaRAID Storage Manager a GUI tool that runs under the OS. I'm running v2.77-00 So the first thing I need to do is delete the unwanted raid6 logical volume. When I try to delete it, it refuses and says: This is an OS drive. The virtual drive cannot be deleted. Any ideas on how to get past this problem with the MegaRAID Storage Manager, or pointers the better documentation, and maybe even a tutorial for the MegaCLI interface. -- Drew Einhorn ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] LSI Logic MegaRAID 8480 Storage controller
From: drew einhorn drew.einh...@gmail.com When I try to delete it, it refuses and says: This is an OS drive. The virtual drive cannot be deleted. Any ideas on how to get past this problem with the MegaRAID Storage Manager, or pointers the better documentation, and maybe even a tutorial for the MegaCLI interface. Hum, is it unmounted? If it was, maybe try to remove any partitions on it... JD ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] LSI Logic MegaRAID 8480 Storage controller
There is a MegaCLI command line interface that runs under the operating system. Normally I prefer command line tools. But this software is big, and complex. All I have been able to find is a reference manual, that has lots of typos and is not very well organized for me to learn what I need to know. I have not been able to find a tutorial for this software. It will take more time than I have at the moment to figure out this tool. Huh? It's one tiny binary, and the syntax is trivial? You are looking at something else... Its own help is decent and it installs via rpm on RHEL. Finally there is the MegaRAID Storage Manager a GUI tool that runs under the OS. I'm running v2.77-00 Now that's a big steaming pile of dung :) I can't make any sense of that darn at the best of times :) What you need is the mr_sas_sw_ug.pdf from lsi's site. Display the VD's/LD's: Table 3.35 Display Virtual Disk Information Convention CmdTool -LDInfo -Lx|-L0,1,2|-Lall -aN|-a0,1,2|-aALL Description Displays information about the virtual disk(s) on the selected adapter(s). This information includes the name, RAID level, RAID level qualifier, size in megabytes, state, stripe size, number of drives, span depth, cache policy, access policy, and ongoing activity progress, if any, including initialization, background initialization, consistency check, and reconstruction. Pick the one you want, then delete: Table 3.33 Delete Specified Virtual Disks Convention CmdTool -CfgLDDel -Lx|-L0,1,2|-Lall -aN|-a0,1,2|-aALL Description Deletes the specified virtual disk(s) on the selected adapter(s). You can delete one virtual disk, multiple virtual disks, or all the selected virtual disks on selected adapter(s). HTH, jlc ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] LSI Logic MegaRAID 8480 Storage controller
On Mon, Mar 9, 2009 at 10:38 AM, John Doe jd...@yahoo.com wrote: From: drew einhorn drew.einh...@gmail.com When I try to delete it, it refuses and says: This is an OS drive. The virtual drive cannot be deleted. Any ideas on how to get past this problem with the MegaRAID Storage Manager, or pointers the better documentation, and maybe even a tutorial for the MegaCLI interface. Hum, is it unmounted? No, the only mounted stuff is on /dev/sda If it was, maybe try to remove any partitions on it... That's it! It won't delete a raid logical volume if it sees a partition on it, even if it is not mounted. Once I cleared the partition table. The it let me delete the, logical volume. Thanks, -- Drew Einhorn ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos