Public bug reported:
SRIOV: Virtual Function detachment is failing for HPE Data Processing
Unit Infiniband NDR200/Ethernet 200Gb 2-port QSFP112 FHHL B3220 Adapter
using FW 32.43.1014 , Driver 24.10-1.1.4 on Ubuntu 22.04 on a HPE Cray
XD685 system.
1. Install the FW using “rpm -ivh < .rpm>”.
2. Go to “cd /usr/lib/x86_64-linux-gnu/ firmware-<>/
3. Run “./hpsetup” to flash the firmware.
4. Check the Status of the DPU using the below command:
a. mlxconfig -d <pci id> q INTERNAL_CPU_OFFLOAD_ENGINE
b. If the Next Boot shows ENABLED (0) it means that the DPU is in enabled
state. If the Next Boot
shows DISABLED (1) it means that the DPU is in disabled state.
5.Once FW is updated, reboot the server.
1. Verify both the FW and driver are updated using the ethtool command
2. ethtool -i <Interface name>
1. Rundmesg | grep iommu and{}make sure that iommu is in passthrough state.
2. Create at least 1 VFs for each port using below command:
3. echo 1 > /sys/bus/pci/devices/<PCI ID>/sriov_numvfs
4. Verify the VF creation using below command
5. lspci | grep Ethernet
6. Detach the VF using below command.
7. Virsh nodedev-detach pci_0000_38_00_3 (0000_21_01_0 is the virtual
function pci id)
Note: Once the above command is given, we are getting error messages
below
Error: Invalid value for attribute ‘speed’ in element ‘link’ : ‘(null)’
Hardware Configuration:
Server Model: ProLiant Compute XD685
Processor: AMD EPYC 9655 96-Core Processor, 96/96 cores; 192 threads,
64Bit Capable
Memory: 24*96GB RDIMM DDR5 6400MHZ
System ROM: A59 v1.20 (02/14/2025)
iLO 6: 1.67 Feb 14 , 2025.
System Programmable Logic Device(CPLD): 0x03
Boot Controller:
HPE SR932i – p Gen11 storage controller (FW: 03.01.33.044)
Raid 0: 7.68TB 64G NVMe SSD (FW: HPK3)
NVMe Drives:
1 x VV003200LYJKH 3.2TB HPK1
2 x VV007680LYCAV 7.68TB HPK2
5 x VV003840LYCAU 3.84TB HPK2
UBM Backplane: 12 E3S 32G x4NVMe UBM5 EC BP (FW: 1.16)
Intelligent Platform Abstraction Data: 1.12.0 Build 5
MCP: MCP 2024.11.00
Backplane- 2 x 12 E3S 32G x4NVMe UBM5 EC BP (FW- 1.06)
NICs:
HPE Data Processing Unit Infiniband NDR200/Ethernet 200Gb 2-port QSFP112
FHHL B3220 Adapter with FW 32.43.1014 , Driver 24.10-1.1.4
HPE InfiniBand NDR/Ethernet 400Gb 1-port OSFP PCIe5 x16 MCX75310AAS-NEAT
Adapter with FW- 28.43.1014, Driver -24.10-1.1.4
HPE InfiniBand NDR200/Ethernet 200GbE 2-port QSFP112 PCIe5 x16
MCX755106AC-HEAT Adapter with FW- 28.43.1014 , Driver -24.10-1.1.4
OS: Ubuntu 22.04
** Affects: ubuntu
Importance: Undecided
Status: New
--
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/2102035
Title:
SRIOV: Virtual Function detachment is failing for HPE DPU Infiniband
NDR200/Eternet 200Gb adapteron Ubuntu 22.04 on XD685
To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+bug/2102035/+subscriptions
--
ubuntu-bugs mailing list
[email protected]
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
