Re: [gentoo-user] emerge times blown out

2023-02-21 Thread Adam Carter
>
> Could it be that some kind of Spectre mitigation is active? I just read
> about
> some massive performance problems in Kernel 5.19+ on Skylake CPUs. Stable
> gentoo kernel was upgraded to 6.1 recently, which could also be affected
> by
> this problem.
> See https://lkml.iu.edu/hypermail/linux/kernel/2209.1/02248.html
>
> Try turning the mitigations off or revert to a 5.15.x kernel.
>

I have one skylake and its now running 6.2 with retbleed=stuff. The others
are AMD.

I will try 5.15.x. I have .configs from that time so it will rule kernel
stuff in/out.


Re: [gentoo-user] emerge times blown out

2023-02-20 Thread Alexander Puchmayr
Am Samstag, 18. Februar 2023, 01:49:11 CET schrieb Adam Carter:
> I have three systems (all ~arch) and the emerge times have blown out on all
> of them across all packages. Worst example appears to be;
> 
> Fri Dec 23 13:11:44 2022 >>> net-libs/webkit-gtk-2.38.3-r410
>merge time: 37 minutes and 8 seconds.
> 
>  Fri Dec 23 13:43:08 2022 >>> net-libs/webkit-gtk-2.38.3
>merge time: 31 minutes and 24 seconds.
> 
>  Sat Feb  4 21:16:40 2023 >>> net-libs/webkit-gtk-2.38.4-r410
>merge time: 6 hours, 53 minutes and 28 seconds.
> 
>  Sun Feb  5 04:17:12 2023 >>> net-libs/webkit-gtk-2.38.4
>merge time: 7 hours and 32 seconds.
> 
> Is anyone else seeing this?

Could it be that some kind of Spectre mitigation is active? I just read about 
some massive performance problems in Kernel 5.19+ on Skylake CPUs. Stable 
gentoo kernel was upgraded to 6.1 recently, which could also be affected by 
this problem.
See https://lkml.iu.edu/hypermail/linux/kernel/2209.1/02248.html

Try turning the mitigations off or revert to a 5.15.x kernel.

Alex






Re: [gentoo-user] emerge times blown out

2023-02-18 Thread Stefan Schmiedl
Samstag, 18. Februar 2023 01:49:
 
> I have three systems (all ~arch) and the emerge times have blown out on all 
> of them across all packages. Worst example appears to be;

>     Fri Dec 23 13:11:44 2022 >>> net-libs/webkit-gtk-2.38.3-r410
>        merge time: 37 minutes and 8 seconds.

>      Fri Dec 23 13:43:08 2022 >>> net-libs/webkit-gtk-2.38.3
>        merge time: 31 minutes and 24 seconds.

>      Sat Feb  4 21:16:40 2023 >>> net-libs/webkit-gtk-2.38.4-r410
>        merge time: 6 hours, 53 minutes and 28 seconds.

>      Sun Feb  5 04:17:12 2023 >>> net-libs/webkit-gtk-2.38.4
>        merge time: 7 hours and 32 seconds.

> Is anyone else seeing this?

When I had something like this about two years ago, the culprit was me
setting the cpufreq thingie in the kernel config to powersave or whatever
it's called ... running emerge with 800 MHz instead of 3.2 GHz produced
effects similar to yours.

s. 
 




Re: [gentoo-user] emerge times blown out

2023-02-18 Thread Alan J. Wylie
Adam Carter  writes:

> My reason for asking is that i'm seeing this across multiple systems, 2
> AMD, 1 Intel, who's configuration hasn't really changed and while there is
> some variance there has been a step change late December / early January.
> Another example
>
> Sat Nov 26 14:34:50 2022 >>> sys-apps/systemd-252.2
>merge time: 2 minutes and 19 seconds.
>
>  Sat Dec 10 20:59:29 2022 >>> sys-apps/systemd-252.3
>merge time: 1 minute and 54 seconds.
>
>  Wed Dec 14 13:56:52 2022 >>> sys-apps/systemd-252.3
>merge time: 2 minutes and 56 seconds.
>
>  Wed Dec 21 20:08:36 2022 >>> sys-apps/systemd-252.4
>merge time: 3 minutes and 7 seconds.
>
>  Tue Jan  3 22:29:43 2023 >>> sys-apps/systemd-252.4
>merge time: 12 minutes and 42 seconds.
>
>  Thu Jan 12 14:56:32 2023 >>> sys-apps/systemd-252.4-r1
>merge time: 22 minutes and 12 seconds.
>
>  Sat Jan 21 12:00:06 2023 >>> sys-apps/systemd-252.4-r1
>merge time: 12 minutes and 3 seconds.
>
>  Mon Jan 30 15:41:44 2023 >>> sys-apps/systemd-252.5
>merge time: 21 minutes and 45 seconds.
>
>  Fri Feb 17 21:18:21 2023 >>> sys-apps/systemd-252.6
>merge time: 22 minutes and 18 seconds.

All my three systems are fine

AMD FX(tm)-8350 Eight-Core Processor, 16GiB

 Sun Oct  2 13:07:33 2022 >>> sys-apps/systemd-251.4
merge time: 3 minutes and 35 seconds.

 Fri Nov 25 08:06:10 2022 >>> sys-apps/systemd-251.7
merge time: 3 minutes and 24 seconds.

 Sat Dec 10 10:11:16 2022 >>> sys-apps/systemd-251.8
merge time: 3 minutes and 19 seconds.

 Tue Jan  3 08:43:49 2023 >>> sys-apps/systemd-252.4
merge time: 3 minutes and 22 seconds.

 Sat Jan 28 06:28:16 2023 >>> sys-apps/systemd-252.4-r1
merge time: 5 minutes and 24 seconds.

AMD FX(tm)-4300 Quad-Core Processor, 16GiB

 Sun Oct  2 13:42:48 2022 >>> sys-apps/systemd-251.4
merge time: 5 minutes and 32 seconds.

 Fri Nov 25 08:11:27 2022 >>> sys-apps/systemd-251.7
merge time: 5 minutes and 40 seconds.

 Sat Dec 10 12:31:38 2022 >>> sys-apps/systemd-251.8
merge time: 5 minutes and 36 seconds.

 Tue Jan  3 08:47:13 2023 >>> sys-apps/systemd-252.4
merge time: 5 minutes and 36 seconds.

 Sat Jan 28 06:28:27 2023 >>> sys-apps/systemd-252.4-r1
merge time: 6 minutes and 17 seconds.

Intel(R) Atom(TM) CPU N2800   @ 1.86GHz, 4GiB, not systemd

 Wed Sep 28 08:32:50 2022 >>> net-dns/bind-9.16.33
merge time: 15 minutes and 28 seconds.

 Fri Jan 20 07:50:41 2023 >>> net-dns/bind-9.16.36
merge time: 16 minutes and 23 seconds.

 Thu Feb 16 07:33:46 2023 >>> net-dns/bind-9.16.37
merge time: 17 minutes and 9 seconds.

-- 
Alan J. Wylie  https://www.wylie.me.uk/

Dance like no-one's watching. / Encrypt like everyone is.
Security is inversely proportional to convenience



Re: [gentoo-user] emerge times blown out

2023-02-17 Thread Dale
Adam Carter wrote:
>
> Does that info help? 
>
>
> My reason for asking is that i'm seeing this across multiple systems,
> 2 AMD, 1 Intel, who's configuration hasn't really changed and while
> there is some variance there has been a step change late December /
> early January. Another example
>
>     Sat Nov 26 14:34:50 2022 >>> sys-apps/systemd-252.2
>        merge time: 2 minutes and 19 seconds.
>
>      Sat Dec 10 20:59:29 2022 >>> sys-apps/systemd-252.3
>        merge time: 1 minute and 54 seconds.
>
>      Wed Dec 14 13:56:52 2022 >>> sys-apps/systemd-252.3
>        merge time: 2 minutes and 56 seconds.
>
>      Wed Dec 21 20:08:36 2022 >>> sys-apps/systemd-252.4
>        merge time: 3 minutes and 7 seconds.
>
>      Tue Jan  3 22:29:43 2023 >>> sys-apps/systemd-252.4
>        merge time: 12 minutes and 42 seconds.
>
>      Thu Jan 12 14:56:32 2023 >>> sys-apps/systemd-252.4-r1
>        merge time: 22 minutes and 12 seconds.
>
>      Sat Jan 21 12:00:06 2023 >>> sys-apps/systemd-252.4-r1
>        merge time: 12 minutes and 3 seconds.
>
>      Mon Jan 30 15:41:44 2023 >>> sys-apps/systemd-252.5
>        merge time: 21 minutes and 45 seconds.
>
>      Fri Feb 17 21:18:21 2023 >>> sys-apps/systemd-252.6
>        merge time: 22 minutes and 18 seconds.


The ones I listed before also jumped in compile times.  As I said tho, I
don't know if other things compiling affected that time.  Still, it does
seem to have increased but I remember when I was on my old single core
rig with just a few GBs of memory.  As time goes by, software gets
bigger therefore takes longer to compile.  Yours from the 4th to the 6th
in the list sure does increase.  That's 8 to 10 times longer roughly. 
That's a large difference.  A true test, emerge something interesting
all by itself.  See what it comes closest to, the old times or the newer
and longer times. 

I suspect this is changes in features of software and could even be
related to gcc or some other tool compiling uses.  It is a interesting
jump.  I don't think you are alone in this.  Maybe someone else will
post their info.  For those interested, genlop -t  is how
to get this info. 

BTW, I don't use systemd so I can't list mine.  ;-)

Dale

:-)  :-)


Re: [gentoo-user] emerge times blown out

2023-02-17 Thread Adam Carter
>
> Does that info help?
>
>
My reason for asking is that i'm seeing this across multiple systems, 2
AMD, 1 Intel, who's configuration hasn't really changed and while there is
some variance there has been a step change late December / early January.
Another example

Sat Nov 26 14:34:50 2022 >>> sys-apps/systemd-252.2
   merge time: 2 minutes and 19 seconds.

 Sat Dec 10 20:59:29 2022 >>> sys-apps/systemd-252.3
   merge time: 1 minute and 54 seconds.

 Wed Dec 14 13:56:52 2022 >>> sys-apps/systemd-252.3
   merge time: 2 minutes and 56 seconds.

 Wed Dec 21 20:08:36 2022 >>> sys-apps/systemd-252.4
   merge time: 3 minutes and 7 seconds.

 Tue Jan  3 22:29:43 2023 >>> sys-apps/systemd-252.4
   merge time: 12 minutes and 42 seconds.

 Thu Jan 12 14:56:32 2023 >>> sys-apps/systemd-252.4-r1
   merge time: 22 minutes and 12 seconds.

 Sat Jan 21 12:00:06 2023 >>> sys-apps/systemd-252.4-r1
   merge time: 12 minutes and 3 seconds.

 Mon Jan 30 15:41:44 2023 >>> sys-apps/systemd-252.5
   merge time: 21 minutes and 45 seconds.

 Fri Feb 17 21:18:21 2023 >>> sys-apps/systemd-252.6
   merge time: 22 minutes and 18 seconds.


Re: [gentoo-user] emerge times blown out

2023-02-17 Thread Dale
Adam Carter wrote:
> I have three systems (all ~arch) and the emerge times have blown out
> on all of them across all packages. Worst example appears to be;
>
>     Fri Dec 23 13:11:44 2022 >>> net-libs/webkit-gtk-2.38.3-r410
>        merge time: 37 minutes and 8 seconds.
>
>      Fri Dec 23 13:43:08 2022 >>> net-libs/webkit-gtk-2.38.3
>        merge time: 31 minutes and 24 seconds.
>
>      Sat Feb  4 21:16:40 2023 >>> net-libs/webkit-gtk-2.38.4-r410
>        merge time: 6 hours, 53 minutes and 28 seconds.
>
>      Sun Feb  5 04:17:12 2023 >>> net-libs/webkit-gtk-2.38.4
>        merge time: 7 hours and 32 seconds.
>
> Is anyone else seeing this?


A lot of this will obviously depend on CPU speed, number of
cores/threads, amount of memory and also, is it compiling on its own or
are other packages also being compiled and taking up CPU time or other
things using CPU time as well.  Here, AMD CPU at 4GHz with 8 cores. 
32GBs of memory and most packages built on tmpfs, except large
packages.  This is a recent few examples. 


 Sat Aug  6 06:34:31 2022 >>> net-libs/webkit-gtk-2.36.5-r1
   merge time: 1 hour, 39 minutes and 13 seconds.

 Sun Aug 21 16:04:23 2022 >>> net-libs/webkit-gtk-2.36.6
   merge time: 3 hours, 41 minutes and 44 seconds.

 Sat Sep  3 22:29:36 2022 >>> net-libs/webkit-gtk-2.36.7
   merge time: 2 hours, 41 minutes and 7 seconds.



I left out binary emerges and such.  Oldest at top, newest at bottom.  I
suspect for the middle and most likely the bottom one, there was another
package compiling as well.  It's possible the top one was either on its
own part or all of the time. 

It's really hard to compare these things.  Even if our rigs are close in
speed/power/whatever, there can still be a lot of things that affect the
compile time.  I run KDE, watch TV from computer, have torrent software
that runs basically 24/7 plus other stuff running.  If you for example
use Fluxbox and have little else running, even with the same CPU and
memory, compile times will vary. 

Does that info help? 

Dale

:-)  :-) 



[gentoo-user] emerge times blown out

2023-02-17 Thread Adam Carter
I have three systems (all ~arch) and the emerge times have blown out on all
of them across all packages. Worst example appears to be;

Fri Dec 23 13:11:44 2022 >>> net-libs/webkit-gtk-2.38.3-r410
   merge time: 37 minutes and 8 seconds.

 Fri Dec 23 13:43:08 2022 >>> net-libs/webkit-gtk-2.38.3
   merge time: 31 minutes and 24 seconds.

 Sat Feb  4 21:16:40 2023 >>> net-libs/webkit-gtk-2.38.4-r410
   merge time: 6 hours, 53 minutes and 28 seconds.

 Sun Feb  5 04:17:12 2023 >>> net-libs/webkit-gtk-2.38.4
   merge time: 7 hours and 32 seconds.

Is anyone else seeing this?