Re: AMD EPYC

[William Ahern]

On Wed, Sep 28, 2022 at 11:05:35AM +0300, Kapetanakis Giannis wrote:
> Hi,
> 
> Looking for upgrading our firewall/router and thinking about switching
> from Xeon to EPYC (73F3 - 16C @ 3.5 GHz).
> 
> Anyone running on EPYC? Any problems?
> 
> Alternative would be something like dual Intel Xeon Gold 5315Y - 8C @ 3.20

Note that hyperthreading (SMT) is disabled by default on OpenBSD. The EPYC
Embedded 3201 (8-core) and 3101 (4-core) don't have SMT, so you won't pay a
premium if you choose to not use SMT. The base clocks are lower on
those models, but so are their TDP ratings.

If you're not running any application proxies, the 3101 is probably more
than enough. The base clock is higher than the 3201 so might even perform
better as PF isn't (yet?) multithreaded.

I can't confirm from experience, yet, as I put together a 3201 a few years
ago to upgrade my main OpenBSD server (Xeon E3-1220 v3) but haven't yet
gotten around to swapping it out. For firewalls I still use PC Engines APUs.
The APUs are indisputably under powered (they can't crack 100Mb/s for
IPSec), but plenty of us still get by with them. Any EPYC- or Xeon-class
chip would blow them away and be more than enough for a router, firewall,
and VPN gateway, at least up to 1Gb/s and likely much higher.

Re: AMD EPYC

[Kapetanakis Giannis]

Thanks both Paul and Hrvoje for the quick replies :)

Good news then, lets hope for a better performance.

G

Re: AMD EPYC

[Hrvoje Popovski]

On 28.9.2022. 10:05, Kapetanakis Giannis wrote:
> Hi,
> 
> Looking for upgrading our firewall/router and thinking about switching from 
> Xeon to EPYC (73F3 - 16C @ 3.5 GHz).
> 
> Anyone running on EPYC? Any problems?
> 
> Alternative would be something like dual Intel Xeon Gold 5315Y - 8C @ 3.20
> 
> thanks,
> 
> Giannis
> 

Hi,

I'm running openbsd on

Supermicro AS-1114S-WTRT with
AMD EPYC 7413 24-Core Processor, 2650.00 MHz, 19-01-01


Dell PowerEdge R6515 with
AMD EPYC 7313P 16-Core Processor, 2994.38 MHz, 19-01-01
this one will be my new firewall


from time to time on:
Dell PowerEdge R7515 with
AMD EPYC 7702P 64-Core Processor, 1996.28 MHz, 17-31-00


I have Lenovo Thinkpad E14 gen2 with
AMD Ryzen 5 4500U with Radeon Graphics, 2370.55 MHz, 17-60-01


And all those boxes are working as you would expected.


Here's hw.sensors for 7313P when idle
alt-fw1# sysctl hw.sensors | grep freq
hw.sensors.cpu0.frequency0=18.00 Hz
hw.sensors.cpu1.frequency0=18.00 Hz
hw.sensors.cpu2.frequency0=185000.00 Hz
hw.sensors.cpu3.frequency0=18.00 Hz
hw.sensors.cpu4.frequency0=18.00 Hz
hw.sensors.cpu5.frequency0=18.00 Hz
hw.sensors.cpu6.frequency0=18.00 Hz
hw.sensors.cpu7.frequency0=18.00 Hz
hw.sensors.cpu8.frequency0=18.00 Hz
hw.sensors.cpu9.frequency0=175000.00 Hz
hw.sensors.cpu10.frequency0=18.00 Hz
hw.sensors.cpu11.frequency0=18.00 Hz
hw.sensors.cpu12.frequency0=18.00 Hz
hw.sensors.cpu13.frequency0=18.00 Hz
hw.sensors.cpu14.frequency0=18.00 Hz
hw.sensors.cpu15.frequency0=18.00 Hz


when doing stress -c 16
alt-fw1# sysctl hw.sensors | grep freq
hw.sensors.cpu0.frequency0=37.00 Hz
hw.sensors.cpu1.frequency0=37.00 Hz
hw.sensors.cpu2.frequency0=37.00 Hz
hw.sensors.cpu3.frequency0=37.00 Hz
hw.sensors.cpu4.frequency0=37.00 Hz
hw.sensors.cpu5.frequency0=37.00 Hz
hw.sensors.cpu6.frequency0=37.00 Hz
hw.sensors.cpu7.frequency0=37.00 Hz
hw.sensors.cpu8.frequency0=37.00 Hz
hw.sensors.cpu9.frequency0=37.00 Hz
hw.sensors.cpu10.frequency0=37.00 Hz
hw.sensors.cpu11.frequency0=37.00 Hz
hw.sensors.cpu12.frequency0=37.00 Hz
hw.sensors.cpu13.frequency0=37.00 Hz
hw.sensors.cpu14.frequency0=37.00 Hz
hw.sensors.cpu15.frequency0=37.00 Hz


Regarding networking, few days ago I've rediscover that if you have cpu
with 16 or more core's and 4 nic's that support 16 queues (mcx or ix) if
you enable all of them box freeze and you need to lower to 12 cores.
I'm playing with this problem right now and will send it to tech@ or bugs@

Re: AMD EPYC

[Paul de Weerd]

Hi Kapetanakis,

On Wed, Sep 28, 2022 at 11:05:35AM +0300, Kapetanakis Giannis wrote:
| Hi,
| 
| Looking for upgrading our firewall/router and thinking about switching from 
Xeon to EPYC (73F3 - 16C @ 3.5 GHz).
| 
| Anyone running on EPYC? Any problems?

I'm running on an AMD EPYC without any issues.  Couple of vmm(4) VMs,
various internet services (mail, dns, web, etc).  Rock solid with
OpenBSD.

[weerd@despair] $ sysctl hw.model
hw.model=AMD EPYC 3201 8-Core Processor

Cheers,

Paul 'WEiRD' de Weerd

--- dmesg 
OpenBSD 7.1 (GENERIC.MP) #465: Mon Apr 11 18:03:57 MDT 2022
dera...@amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP
real mem = 68567597056 (65391MB)
avail mem = 66472255488 (63392MB)
random: good seed from bootblocks
mpath0 at root
scsibus0 at mpath0: 256 targets
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 2.8 @ 0xdab19000 (51 entries)
bios0: vendor American Megatrends Inc. version "1.0c" date 06/30/2020
bios0: Supermicro Super Server
acpi0 at bios0: ACPI 6.1
acpi0: sleep states S0 S5
acpi0: tables DSDT FACP APIC FPDT FIDT SSDT SPMI SSDT MCFG SSDT CRAT CDIT BERT 
EINJ HEST HPET SSDT UEFI IVRS SSDT WSMT
acpi0: wakeup devices S0D0(S3) S0D1(S3) S0D2(S3) S0D3(S3) S1D0(S3) S1D1(S3) 
S1D2(S3) S1D3(S3)
acpitimer0 at acpi0: 3579545 Hz, 32 bits
acpimadt0 at acpi0 addr 0xfee0: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: AMD EPYC 3201 8-Core Processor, 1500.27 MHz, 17-01-02
cpu0: 
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,HTT,SSE3,PCLMUL,MWAIT,SSSE3,FMA3,CX16,SSE4.1,SSE4.2,MOVBE,POPCNT,AES,XSAVE,AVX,F16C,RDRAND,NXE,MMXX,FFXSR,PAGE1GB,RDTSCP,LONG,LAHF,CMPLEG,SVM,EAPICSP,AMCR8,ABM,SSE4A,MASSE,3DNOWP,OSVW,SKINIT,TCE,TOPEXT,CPCTR,DBKP,PCTRL3,MWAITX,ITSC,FSGSBASE,BMI1,AVX2,SMEP,BMI2,RDSEED,ADX,SMAP,CLFLUSHOPT,SHA,IBPB,XSAVEOPT,XSAVEC,XGETBV1,XSAVES
cpu0: 64KB 64b/line 4-way I-cache, 32KB 64b/line 8-way D-cache, 512KB 64b/line 
8-way L2 cache
cpu0: ITLB 64 4KB entries fully associative, 64 4MB entries fully associative
cpu0: DTLB 64 4KB entries fully associative, 64 4MB entries fully associative
cpu0: smt 0, core 0, package 0
mtrr: Pentium Pro MTRR support, 8 var ranges, 88 fixed ranges
cpu0: apic clock running at 99MHz
cpu0: mwait min=64, max=64, C-substates=1.1, IBE
cpu1 at mainbus0: apid 1 (application processor)
cpu1: AMD EPYC 3201 8-Core Processor, 1500.00 MHz, 17-01-02
cpu1: 
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,HTT,SSE3,PCLMUL,MWAIT,SSSE3,FMA3,CX16,SSE4.1,SSE4.2,MOVBE,POPCNT,AES,XSAVE,AVX,F16C,RDRAND,NXE,MMXX,FFXSR,PAGE1GB,RDTSCP,LONG,LAHF,CMPLEG,SVM,EAPICSP,AMCR8,ABM,SSE4A,MASSE,3DNOWP,OSVW,SKINIT,TCE,TOPEXT,CPCTR,DBKP,PCTRL3,MWAITX,ITSC,FSGSBASE,BMI1,AVX2,SMEP,BMI2,RDSEED,ADX,SMAP,CLFLUSHOPT,SHA,IBPB,XSAVEOPT,XSAVEC,XGETBV1,XSAVES
cpu1: 64KB 64b/line 4-way I-cache, 32KB 64b/line 8-way D-cache, 512KB 64b/line 
8-way L2 cache
cpu1: ITLB 64 4KB entries fully associative, 64 4MB entries fully associative
cpu1: DTLB 64 4KB entries fully associative, 64 4MB entries fully associative
cpu1: smt 0, core 1, package 0
cpu2 at mainbus0: apid 2 (application processor)
cpu2: AMD EPYC 3201 8-Core Processor, 1500.00 MHz, 17-01-02
cpu2: 
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,HTT,SSE3,PCLMUL,MWAIT,SSSE3,FMA3,CX16,SSE4.1,SSE4.2,MOVBE,POPCNT,AES,XSAVE,AVX,F16C,RDRAND,NXE,MMXX,FFXSR,PAGE1GB,RDTSCP,LONG,LAHF,CMPLEG,SVM,EAPICSP,AMCR8,ABM,SSE4A,MASSE,3DNOWP,OSVW,SKINIT,TCE,TOPEXT,CPCTR,DBKP,PCTRL3,MWAITX,ITSC,FSGSBASE,BMI1,AVX2,SMEP,BMI2,RDSEED,ADX,SMAP,CLFLUSHOPT,SHA,IBPB,XSAVEOPT,XSAVEC,XGETBV1,XSAVES
cpu2: 64KB 64b/line 4-way I-cache, 32KB 64b/line 8-way D-cache, 512KB 64b/line 
8-way L2 cache
cpu2: ITLB 64 4KB entries fully associative, 64 4MB entries fully associative
cpu2: DTLB 64 4KB entries fully associative, 64 4MB entries fully associative
cpu2: smt 0, core 2, package 0
cpu3 at mainbus0: apid 3 (application processor)
cpu3: AMD EPYC 3201 8-Core Processor, 1500.00 MHz, 17-01-02
cpu3: 
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,HTT,SSE3,PCLMUL,MWAIT,SSSE3,FMA3,CX16,SSE4.1,SSE4.2,MOVBE,POPCNT,AES,XSAVE,AVX,F16C,RDRAND,NXE,MMXX,FFXSR,PAGE1GB,RDTSCP,LONG,LAHF,CMPLEG,SVM,EAPICSP,AMCR8,ABM,SSE4A,MASSE,3DNOWP,OSVW,SKINIT,TCE,TOPEXT,CPCTR,DBKP,PCTRL3,MWAITX,ITSC,FSGSBASE,BMI1,AVX2,SMEP,BMI2,RDSEED,ADX,SMAP,CLFLUSHOPT,SHA,IBPB,XSAVEOPT,XSAVEC,XGETBV1,XSAVES
cpu3: 64KB 64b/line 4-way I-cache, 32KB 64b/line 8-way D-cache, 512KB 64b/line 
8-way L2 cache
cpu3: ITLB 64 4KB entries fully associative, 64 4MB entries fully associative
cpu3: DTLB 64 4KB entries fully associative, 64 4MB entries fully associative
cpu3: smt 0, core 3, package 0
cpu4 at mainbus0: apid 8 (application processor)
cpu4: AMD EPYC 3201 8-Core Processor, 1500.00 MHz, 17-01-02
cpu4: