Chris,
Thank you for your openness on this list. It's great to feel listened to.
Can we tell if that TSR was with the Samsung 850 (no temp sensor) or with
the Samsung 860? The latter does in fact have a temp sensor:
# megaclisas-status
[....]
-- Disk information --
-- ID | Type | Drive Model | Size
| Status | Speed | Temp | Slot ID | LSI ID
c0u0p0 | SSD | S3YUNB0KC09340D Samsung SSD 860 EVO 2TB RVT03B6Q | 1.818 TB |
Online, Spun Up | 6.0Gb/s | 21C | [32:0] | 0
c0u1p0 | HDD | R6GP40KY WDC WD80EFZX-68UW8N0 83.H0A83 | 7.276 TB |
Online, Spun Up | 6.0Gb/s | 29C | [32:4] | 4
c0u2p0 | SSD | S3YUNB0KC09173D Samsung SSD 860 EVO 2TB RVT03B6Q | 1.818 TB |
Online, Spun Up | 6.0Gb/s | 21C | [32:1] | 1
^^^^=====
Is it possible that your output is from an old TSR of mine? I wonder if
the H730P properly detects the temperature on the 860 even though the
megaraid_sas driver does detect it properly.
Regards,
Vincent
On Thu, 16 Jan 2020, chris.sum...@dell.com wrote:
Dell Customer Communication - Confidential
Unfortunately, I agree with your assessment. I pulled the following content
from the provided TSR the last time I was engaged on your issue. I had to go
back and look again.
The disks are driving an open loop response (not LFM) that cannot be adjusted.
This is a baseline fan speed response for a no-drive-temp config per design.
Agree there's nothing else we can do here to mask this behavior.
From the TSR:
--------------------------------------------------------------------------------
OPEN LOOP CONTROL
--------------------------------------------------------------------------------
ALG_TYPE ID# NAME FZ1 FZ2 | PSU1 PSU2
OL_TYPE1 2 Baseline_Amb_Any 16.90 0.00 | 0.00 0.00
OL_TYPE1 10 HDD_No_Sensor_OL_3_5 41.75 0.00 | 0.00 0.00
<< thermal table fan response due to no HDD temp
OL_TYPE1 16 SSD_No_Sensor_OL_2_5 0.00 0.00 | 0.00 0.00
OL_TYPE1 27 FAC_Restriction_Single Fan 0.00 0.00 | 0.00 0.00
OL_TYPE1 28 FAC_Restriction_NonRDNPSU 0.00 0.00 | 0.00 0.00
OL_OTHER 5 OPEN_LOOP_BASELINE 62.80 0.00 | 0.00 0.00
Regards,
Chris Sumers
Dell EMC | PG- International Product Support (IPS) Engineering
Office + 1 512 728 4685
chris.sum...@dell.com
Dell Technologies 200 Dell Way, RR5-3 IPS Lab, Round Rock, TX 78682
Please consider the environment before printing this email.
Confidentiality Notice | This e-mail message, including any attachments, is for
the sole use of the intended recipient(s) and may contain confidential or
proprietary information. Any unauthorized review, use, disclosure or
distribution is prohibited. If you are not the intended recipient, immediately
contact the sender by reply e-mail and destroy all copies of the original
message.
-----Original Message-----
From: vinc...@cojot.name <vinc...@cojot.name>
Sent: Thursday, January 16, 2020 4:31 PM
To: Sumers, Chris
Cc: linux-poweredge-Lists
Subject: RE: [Linux-PowerEdge] iDRAC9 : Unable to set manual fan response after
iDrac v3.34.34.34
[EXTERNAL EMAIL]
Here's what happens on an H730P (which has 3rd party SSDs behind it which
causes high-rpm) on which I want to disable LFMMode:
/admin1-> racadm set system.PCIeSlotLFM.2.LFMMode 1
ERROR: PCI3022: Unable to adjust the Airflow Linear Flow per Minute (LFM)
settings of the PCIe slot
because the LFM settings can be adjusted only for installed cards that
are identified as third party cards.
I'm still on 3.30.30.30
,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,
Vincent S. Cojot, Computer Engineering. STEP project. _.,-*~'`^`'~*-,._.,-*~
Ecole Polytechnique de Montreal, Comite Micro-Informatique. _.,-*~'`^`'~*-,.
Linux Xview/OpenLook resources page _.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'
http://step.polymtl.ca/~coyote _.,-*~'`^`'~*-,._ coy...@nospam4cojot.name
They cannot scare me with their empty spaces Between stars - on stars where no
human race is I have it in me so much nearer home
To scare myself with my own desert places. - Robert Frost
On Thu, 16 Jan 2020, chris.sum...@dell.com wrote:
Dell Customer Communication - Confidential
Vincent,
You are correct. The ipmi raw command that allows a user to bypass the Dell EMC
multi-vector cooling algorithm was exposed in iDRAC9 releases prior to iDRAC9
3.43.34.34 release. This command was not intended for public consumption on
iDRAC9 and 14G PowerEdge servers. When it was detected that this command was
exposed on Arev iDRAC firmware, measures were taken to revoke that raw ipmi
command starting in iDRAC9 3.34.34.34.
If you are experiencing high PWM of the internal fan of your T440 due to
presence of third-party cards, there are measures that you can take. The Dell
EMC fan algorithm can be disabled on a slot when the PCIe slot is occupied by a
third party card. You can leverage the built-in racadm utility through an SSH
session to the iDRAC to make these changes.
To confirm that the iDRAC detects the add-in card as a third-party card, leverage the
system.PCIeSlotLFM.x.3rdPartyCard attribute. You will need to modify "x" with
the numerical value of your PCIe slot.
racadm>>racadm get system.PCIeSlotLFM.3.3rdPartyCard
[Key=system.Embedded.1#PCIeSlotLFM.3]
3rdPartyCard=Yes
racadm>>
If the value for this slot = yes, then you can disable the Dell EMC cooling
algorithm for that slot. You will need to modify the
sytem.PCIeSlotLFM.x.LFMMode value (x = slot numerical value).
racadm>>racadm set system.PCIeSlotLFM.3.LFMMode 1
[Key=system.Embedded.1#PCIeSlotLFM.3]
Object value modified successfully
racadm>>racadm get system.PCIeSlotLFM.3.LFMMode
[Key=system.Embedded.1#PCIeSlotLFM.3]
LFMMode=Disabled
racadm>>
Additional details on the Dell EMC multi-vector cooling with Dell EMC
PowerEdge servers can be found in this whitepaper:
https://downloads.dell.com/manuals/common/poweredge_pcie_cooling.pdf
Additional details on racadm attribute registry can be found in the current
Attribute Registry Guide:
https://topics-cdn.dell.com/pdf/idrac9-lifecycle-controller-v4x-series
_reference-guide_en-us.pdf
Additional iDRAC9 whitepapers can be found here:
https://www.dell.com/support/article/us/en/19/sln311300/support-for-in
tegrated-dell-remote-access-controller-9-idrac9?lang=en
Regards,
Chris Sumers
Dell EMC | PG- International Product Support (IPS) Engineering Office
+ 1 512 728 4685 chris.sum...@dell.com Dell Technologies 200 Dell Way,
RR5-3 IPS Lab, Round Rock, TX 78682
Please consider the environment before printing this email.
Confidentiality Notice | This e-mail message, including any attachments, is for
the sole use of the intended recipient(s) and may contain confidential or
proprietary information. Any unauthorized review, use, disclosure or
distribution is prohibited. If you are not the intended recipient, immediately
contact the sender by reply e-mail and destroy all copies of the original
message.
-----Original Message-----
From: linux-poweredge-bounces-Lists
<linux-poweredge-boun...@lists.us.dell.com> On Behalf Of
vinc...@cojot.name
Sent: Monday, January 13, 2020 10:06 PM
To: linux-poweredge-Lists
Subject: [Linux-PowerEdge] iDRAC9 : Unable to set manual fan response
after iDrac v3.34.34.34
Hi everyone,
Just FYI, on 14th Gen PowerEdge, with iDrac v3.34.34.34 and above,
Dell Engineering knowingly removed the possibilty to control fan speed
beyond what the iDRAC considers 'the right thing to do' for your
machine (as of
3.34.34.34 and above, you no longer have a say in the matter).
Please allow me to explain by giving an example:
I own a nice T440 with dual 4110 Xeon silver and with mostly low-power
components:
- 384Gb RAM in 32Gb LRDIMM sticks.
- PERC H730P with 2 * 2Tb Samsung 860, 1* 8Tb WD Red
- NVidia 1660 GTX Ti
- a quad-1G NIC
- a NVMe drive on a Supermicro PCI-E adapter.
- The box is running RHEL7 with a moderately conservative power profile.
This box is somewhat low-power (110-154W under light load and 250W under heavy).
I usually force the system fan to 1080rpm:
# /usr/bin/ipmitool raw 0x30 0x30 0x01 0x00 # /usr/bin/ipmitool raw
0x30 0x30 0x02 0xff 0x0b
..unless the cpu temperatures go above 65C at which case the systems goes back
to 'auto' on its own (thanks to a daemon):
# /usr/bin/ipmitool raw 0x30 0x30 0x01 0x01
This works well and the cpus are usually between 32C and 35C on light
load. I've never had any problem on either of my T440, T430 or T630
doing this. The script is here: [1]
..but because I'm using 3rd party components, the iDRAC -thinks- it -must- set
the fan to the highest rpms possible to cool my system. When left to 'auto',
the fan goes to 3700-4300rpm and I feel like I'm standing on the bridge of an
aircraft carrier.
Dell support has been unable to help with my '3rd party components' to take the
fans down (we've tried every BIOS setting).
With 3.34.34.34 and above, the 'manual' fan speed is ignored and
reports
this:
# /usr/bin/ipmitool -I open raw 0x30 0x30 0x01 0x00 Unable to send RAW
command (channel=0x0 netfn=0x30 lun=0x0 cmd=0x30 rsp=0xd4):
Insufficient privilege level
# /usr/bin/ipmitool -I open raw 0x30 0x30 0x02 0xff 0x0b Unable to
send RAW command (channel=0x0 netfn=0x30 lun=0x0 cmd=0x30 rsp=0xd4):
Insufficient privilege level
When contacted, an escalation manager at Dell suggested that I stopped
using 3rd party components and that I should buy Workstations instead.
He also confirmed that the removal of the 'ipmitool' 'feature' in
iDRAC
3.34.34.34 was intentionnal because they 'had had many escalations because of
this'.
Other users on the Dell Community forums have reported similar issues
with
T340 and T640 systems.
Consequently, I will probably be staying on 3.30.30.30 (the last
working
version) for as long as I can.
Here is more information:
[1], script (adjust for your machines):
https://raw.githubusercontent.com/ElCoyote27/krynn-tools/master/dellfa
nctl
[2]: discussions:
https://www.dell.com/community/Systems-Management-General/iDRAC9-Unabl
e-to-set-manual-fan-response-after-iDrac-v3-34-34-34/m-p/7339941
https://www.reddit.com/r/homelab/comments/d0422n/to_anyone_considering
_or_using_dell_14th_gen_for
I used to be a big fan of Dell systems but this T440 will probably be my last.
I hope this helps others.
Regards,
Vincent (Working but not speaking for RedHat/IBM)
_______________________________________________
Linux-PowerEdge mailing list
Linux-PowerEdge@dell.com
https://lists.us.dell.com/mailman/listinfo/linux-poweredge
_______________________________________________
Linux-PowerEdge mailing list
Linux-PowerEdge@dell.com
https://lists.us.dell.com/mailman/listinfo/linux-poweredge
