Still experiencing this issue on VFs. Here is some more information on how I am generating the VFs:
Configuration of the VF on the HOST is as follows: ### LINUX HOST # creation echo 1 > /sys/class/net/enp15s0f0np0/device/sriov_numvfs # MAC manipulation ip link set dev enp15s0f0np0 vf 0 mac 52:54:00:12:34:56 # Validation ip link show dev enp15s0f0np0 7: enp15s0f0np0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 link/ether 0c:42:a1:ec:c3:6a brd ff:ff:ff:ff:ff:ff vf 0 link/ether 52:54:00:12:34:56 brd ff:ff:ff:ff:ff:ff, spoof checking off, link-state auto, trust off, query_rss off altname enx0c42a1ecc36a MAC address validation inside OpenBSD Guest: mcx0: flags=8847<UP,BROADCAST, DEBUG, RUNNING, SIMPLEX, MULTICAST> mtu 1500 lladdr 52:54:00:12:34:56 <---- matches index 1 priority 8 Ilprio 3 groups: egress media: Ethernet autoselect (10GbaseSR) status: active inet 10.0.0.140 netmask Oxffffff00 broadcast 10.0.0.255 When I assign the IP via /etc/hostname.mcx0, the IP gets assigned, I can ping it internally, but cannot ping out to my machines. I can also provide any pcidump info if needed. Essentially it appears that the driver recognizes the VF, but for some reason I cannot do anything with it. I did read SOME posts on proxmox forums which report the same issue, but no resolution. I’ll refrain from posting those for now since they are from a third party and are quite dated. > On Mar 10, 2025, at 7:51 PM, Max Power <[email protected]> wrote: > > Apologies for the duplicate message. > > I have in fact solved the Physical passthrough issue. The issue was reserving > enough space for BAR memory. I have fixed this with the following: > > -device > pcie-root-port,id=root-port2,bus=pcie.0,chassis=2,slot=2,io-reserve=8K,mem-reserve=64M,pref64-reserve=1024G > > Virtual functions are still an issue. The hardware is detected but no > response. I then boot with a Linux LiveCD and it’s pretty much configure iP > and go. > > Here is dmesg output: > > OpenBSD 7.6 (GENERIC.MP) #338: Mon Sep 30 08:55:35 MDT 2024 > [email protected]:/usr/src/sys/arch/amd64/compile/GENERIC.MP > real mem = 4258525184 (4061MB) > avail mem = 4106248192 (3916MB) > random: good seed from bootblocks > mpath0 at root > scsibus0 at mpath0: 256 targets > mainbus0 at root > bios0 at mainbus0: SMBIOS rev. 2.8 @ 0x7f987000 (10 entries) > bios0: > bios0: QEMU Standard PC (Q35 + ICH9, 2009) > efi0 at bios0: UEFI 2.7 > efi0: EDK II rev 0x10000 > acpi0 at bios0: ACPI 3.0 > acpi0: sleep states S3 S4 S5 > acpi0: tables DSDT FACP APIC HPET MCFG WAET BGRT > acpi0: wakeup devices > acpitimer0 at acpi0: 3579545 Hz, 24 bits > acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat > cpu0 at mainbus0: apid 0 (boot processor) > cpu0: AMD Ryzen 9 5950X 16-Core Processor, 4100.32 MHz, 19-21-02 > cpu0: cpuid 1 > edx=178bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,HTT> > > ecx=f7f83203<SSE3,PCLMUL,SSSE3,FMA3,CX16,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,HV> > cpu0: cpuid 6 eax=4<ARAT> > cpu0: cpuid 7.0 > ebx=219c07ab<FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,RDSEED,ADX,SMAP,CLFLUSHOPT,CLWB,SHA> > ecx=40060c<UMIP,PKU> edx=a8000010<STIBP,SSBD> > cpu0: cpuid d.1 eax=f<XSAVEOPT,XSAVEC,XGETBV1,XSAVES> > cpu0: cpuid 80000001 edx=2fd3fbff<NXE,MMXX,FFXSR,PAGE1GB,RDTSCP,LONG> > ecx=8003f3<LAHF,CMPLEG,AMCR8,ABM,SSE4A,MASSE,3DNOWP,OSVW,CPCTR> > cpu0: cpuid 80000008 ebx=1302d205<IBPB,IBRS,STIBP,STIBP_ALL,SSBD,VIRTSSBD> > cpu0: 64KB 64b/line 2-way D-cache, 64KB 64b/line 2-way I-cache > cpu0: 512KB 64b/line 16-way L2 cache > cpu0: smt 0, core 0, package 0 > mtrr: Pentium Pro MTRR support, 8 var ranges, 88 fixed ranges > cpu0: apic clock running at 1000MHz > cpu1 at mainbus0: apid 1 (application processor) > cpu1: AMD Ryzen 9 5950X 16-Core Processor, 4100.25 MHz, 19-21-02 > cpu1: smt 0, core 1, package 0 > cpu2 at mainbus0: apid 2 (application processor) > cpu2: AMD Ryzen 9 5950X 16-Core Processor, 4100.46 MHz, 19-21-02 > cpu2: smt 0, core 2, package 0 > cpu3 at mainbus0: apid 3 (application processor) > cpu3: AMD Ryzen 9 5950X 16-Core Processor, 4100.39 MHz, 19-21-02 > cpu3: smt 0, core 3, package 0 > ioapic0 at mainbus0: apid 0 pa 0xfec00000, version 11, 24 pins > acpihpet0 at acpi0: 100000000 Hz > acpimcfg0 at acpi0 > acpimcfg0: addr 0xe0000000, bus 0-255 > acpiprt0 at acpi0: bus 0 (PCI0) > "ACPI0006" at acpi0 not configured > acpipci0 at acpi0 PCI0: 0x00000010 0x00000011 0x00000000 > "PNP0A06" at acpi0 not configured > "PNP0A06" at acpi0 not configured > "PNP0A06" at acpi0 not configured > "QEMU0002" at acpi0 not configured > com0 at acpi0 COM1 addr 0x3f8/0x8 irq 4: ns16550a, 16 byte fifo > com0: console > acpicmos0 at acpi0 > "ACPI0010" at acpi0 not configured > acpicpu0 at acpi0: C1(@1 halt!) > acpicpu1 at acpi0: C1(@1 halt!) > acpicpu2 at acpi0: C1(@1 halt!) > acpicpu3 at acpi0: C1(@1 halt!) > pvbus0 at mainbus0: KVM > pvclock0 at pvbus0 > pci0 at mainbus0 bus 0 > 0:2:0: bridge mem address conflict 0x390000000000/0x800000000 > 0:3:0: bridge mem address conflict 0x380000000000/0x10000000000 > 0:4:0: mem address conflict 0x390800000000/0x4000 > pchb0 at pci0 dev 0 function 0 "Intel 82G33 Host" rev 0x00 > "Bochs VGA" rev 0x02 at pci0 dev 1 function 0 not configured > ppb0 at pci0 dev 2 function 0 "Red Hat PCIE" rev 0x00: apic 0 int 22 > pci1 at ppb0 bus 1 > ppb1 at pci0 dev 3 function 0 "Red Hat PCIE" rev 0x00: apic 0 int 23 > pci2 at ppb1 bus 2 > 2:0:0: mem address conflict 0x380000000000/0x100000 > mcx0 at pci2 dev 0 function 0 "Mellanox ConnectX-4 Lx VF" rev 0x00: FW > 14.32.2004, msix, address 52:54:00:12:34:56 > virtio0 at pci0 dev 4 function 0 "Qumranet Virtio Storage" rev 0x00 > vioblk0 at virtio0 > scsibus1 at vioblk0: 1 targets > sd0 at scsibus1 targ 0 lun 0: <VirtIO, Block Device, > > sd0: 20480MB, 512 bytes/sector, 41943040 sectors > virtio0: msix per-VQ > pcib0 at pci0 dev 31 function 0 "Intel 82801IB LPC" rev 0x02 > ahci0 at pci0 dev 31 function 2 "Intel 82801I AHCI" rev 0x02: msi, AHCI 1.0 > ahci0: port 0: 1.5Gb/s > ahci0: port 2: 1.5Gb/s > scsibus2 at ahci0: 32 targets > cd0 at scsibus2 targ 0 lun 0: <QEMU, QEMU DVD-ROM, 2.5+> removable > cd1 at scsibus2 targ 2 lun 0: <QEMU, QEMU DVD-ROM, 2.5+> removable > ichiic0 at pci0 dev 31 function 3 "Intel 82801I SMBus" rev 0x02: SMBus > disabled > isa0 at pcib0 > isadma0 at isa0 > pckbc0 at isa0 port 0x60/5 irq 1 irq 12 > pckbd0 at pckbc0 (kbd slot) > wskbd0 at pckbd0 mux 1 > pms0 at pckbc0 (aux slot) > wsmouse0 at pms0 mux 0 > pcppi0 at isa0 port 0x61 > spkr0 at pcppi0 > lpt0 at isa0 port 0x378/4 irq 7 > efifb0 at mainbus0: 1920x1080, 32bpp > wsdisplay0 at efifb0 mux 1 > wskbd0: connecting to wsdisplay0 > wsdisplay0: screen 0-5 added (std, vt100 emulation) > vscsi0 at root > scsibus3 at vscsi0: 256 targets > softraid0 at root > scsibus4 at softraid0: 256 targets > root on sd0a (82bd38cf199211f3.a) swap on sd0b dump on sd0b > Automatic boot in progress: starting file system checks. > /dev/sd0a (82bd38cf199211f3.a): file system is clean; not checking > /dev/sd0l (82bd38cf199211f3.l): file system is clean; not checking > /dev/sd0d (82bd38cf199211f3.d): file system is clean; not checking > /dev/sd0f (82bd38cf199211f3.f): file system is clean; not checking > /dev/sd0g (82bd38cf199211f3.g): file system is clean; not checking > /dev/sd0h (82bd38cf199211f3.h): file system is clean; not checking > /dev/sd0k (82bd38cf199211f3.k): file system is clean; not checking > /dev/sd0j (82bd38cf199211f3.j): file system is clean; not checking > /dev/sd0e (82bd38cf199211f3.e): file system is clean; not checking > pf enabled > starting network > reordering: ld.so libc libcrypto sshd sshd-session ssh-agent. > starting early daemons: syslogd pflogd ntpd. > starting RPC daemons:. > savecore: no core dump > checking quotas: done. > clearing /tmp > kern.securelevel: 0 -> 1 > creating runtime link editor directory cache. > preserving editor files. > starting network daemons: sshd smtpd sndiod. > starting local daemons: cron. > Mon Mar 10 19:43:22 EDT 2025 > > > mcx0: flags=8843<UP,BROADCAST, RUNNING, SIMPLEX, MULTICAST> mtu 1500 > lladdr 52:54:00:12: 34:56 > index 1 priority @ llprio 3 > groups: egress > media: Ethernet autoselect (10GbaseSR) > status: active > inet 10.0.0.140 netmask Oxffffff00 broadcast 10.0.0.255 > >
