Re: Buildworld and buildkernel with very slow compilation, recently
On 21 Jun 2020, at 14:36, Chris Nehren wrote: > > On Sunday, June 21, 2020 8:11:15 AM EDT Michael Grimm wrote: >> Hi, >> >> I am following FreeBSD 12.1-STABLE. >> >> Clang has been upgraded to version 10.0.0 on May, 1st, and ever since that >> time, I do observe a dramatic increase in compilation times of building >> world, kernel and ports. I didn't benchmark the exact times, but >> compilation times are at least increased by a factor of 1.5. Nothing has >> changed of the last month besides upgrading 12.1-Stable every other week. >> >> Has anyone else been bitten by this? > > I don't have measurements to corroborate this, but here's a mailing list > thread where folks are talking about it (split across two URLs, the OP posted > in April and then there was a followup in May): > > http://lists.llvm.org/pipermail/llvm-dev/2020-April/140938.html > https://lists.llvm.org/pipermail/llvm-dev/2020-May/141482.html > > So there definitely seems to be *something* going on, and you are indeed not > crazy. :) Indeed, there is some upstream discussion going on about this issue. There are some scenarios where people see non-negligible performance loss, but apparently not everybody suffers from it. If you build the whole ports collection, it is rather likely you may bump into it. I have personally not seen much performance difference in building world, kernel etc. One of the upstream problems is that there is not really any authoritative performance regression log being built up, so it is hard to see where such regressions were introduced. Somebody then has to spend a lot of time tracking down each and every regression, and then attempt to untangle it from the dozens of commits made around the same time. :) In any case, there is at least some attention on it now, so hopefully this will improve again. I don't think such fixes will be trivial though, so it is not likely they will land in 10.0.1. -Dimitry signature.asc Description: Message signed with OpenPGP
Re: Buildworld and buildkernel with very slow compilation, recently
On Sun, Jun 21, 2020 at 02:48:51PM +0200, Ronald Klop wrote: > Building ports/pkgs is also significantly slower on 13 (new clang) than on > 12.1. > http://thunderx1.nyi.freebsd.org/ > 13 = 140 hours12.1 = 103 hoursFor roughly the same amount of ports. If you use stock HEAD GENERIC kernel config and stock-built libc, it is expected. Both kernel and jemalloc has extensive debugging turned on, on HEAD. > > Regards, Ronald > > Van: Michael Grimm > Datum: 21 juni 2020 14:12 > Aan: FreeBSD-STABLE Mailing List > Onderwerp: Buildworld and buildkernel with very slow compilation, recently > > > > > > > Hi, > > > > I am following FreeBSD 12.1-STABLE. > > > > Clang has been upgraded to version 10.0.0 on May, 1st, and ever since that > > time, I do observe a dramatic increase in compilation times of building > > world, kernel and ports. I didn't benchmark the exact times, but > > compilation times are at least increased by a factor of 1.5. Nothing has > > changed of the last month besides upgrading 12.1-Stable every other week. > > > > Has anyone else been bitten by this? > > > > Regards, > > Michael > > ___ > > freebsd-stable@freebsd.org mailing list > > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > > To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org" > > > > > > > > > ___ > freebsd-stable@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org" ___ freebsd-stable@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"
Re: Buildworld and buildkernel with very slow compilation, recently
From: Ronald Klop Subject: Re: Buildworld and buildkernel with very slow compilation, recently Date: Sun, 21 Jun 2020 14:48:51 +0200 (CEST) > Building ports/pkgs is also significantly slower on 13 (new clang) > than on 12.1. > http://thunderx1.nyi.freebsd.org/ > 13 = 140 hours12.1 = 103 hoursFor roughly the same amount of ports. >From /usr/src/UPDATING of head: NOTE TO PEOPLE WHO THINK THAT FreeBSD 13.x IS SLOW: FreeBSD 13.x has many debugging features turned on, in both the kernel and userland. These features attempt to detect incorrect use of system primitives, and encourage loud failure through extra sanity checking and fail stop semantics. They also substantially impact system performance. If you want to do performance measurement, benchmarking, and optimization, you'll want to turn them off. This includes various WITNESS- related kernel options, INVARIANTS, malloc debugging flags in userland, and various verbose features in the kernel. Many developers choose to disable these features on build machines to maximize performance. (To completely disable malloc debugging, define MALLOC_PRODUCTION in /etc/make.conf, or to merely disable the most expensive debugging functionality run "ln -s 'abort:false,junk:false' /etc/malloc.conf".) --- Yasuhiro KIMURA ___ freebsd-stable@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"
Re: Buildworld and buildkernel with very slow compilation, recently
Building ports/pkgs is also significantly slower on 13 (new clang) than on 12.1. http://thunderx1.nyi.freebsd.org/ 13 = 140 hours12.1 = 103 hoursFor roughly the same amount of ports. Regards, Ronald Van: Michael Grimm Datum: 21 juni 2020 14:12 Aan: FreeBSD-STABLE Mailing List Onderwerp: Buildworld and buildkernel with very slow compilation, recently Hi, I am following FreeBSD 12.1-STABLE. Clang has been upgraded to version 10.0.0 on May, 1st, and ever since that time, I do observe a dramatic increase in compilation times of building world, kernel and ports. I didn't benchmark the exact times, but compilation times are at least increased by a factor of 1.5. Nothing has changed of the last month besides upgrading 12.1-Stable every other week. Has anyone else been bitten by this? Regards, Michael ___ freebsd-stable@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org" ___ freebsd-stable@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"
Re: Buildworld and buildkernel with very slow compilation, recently
On Sunday, June 21, 2020 8:11:15 AM EDT Michael Grimm wrote: > Hi, > > I am following FreeBSD 12.1-STABLE. > > Clang has been upgraded to version 10.0.0 on May, 1st, and ever since that > time, I do observe a dramatic increase in compilation times of building > world, kernel and ports. I didn't benchmark the exact times, but > compilation times are at least increased by a factor of 1.5. Nothing has > changed of the last month besides upgrading 12.1-Stable every other week. > > Has anyone else been bitten by this? I don't have measurements to corroborate this, but here's a mailing list thread where folks are talking about it (split across two URLs, the OP posted in April and then there was a followup in May): http://lists.llvm.org/pipermail/llvm-dev/2020-April/140938.html https://lists.llvm.org/pipermail/llvm-dev/2020-May/141482.html So there definitely seems to be *something* going on, and you are indeed not crazy. :) ___ freebsd-stable@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"
Re: Buildworld and buildkernel with very slow compilation, recently
Michael Grimm wrote: Hi, I am following FreeBSD 12.1-STABLE. Clang has been upgraded to version 10.0.0 on May, 1st, and ever since that time, I do observe a dramatic increase in compilation times of building world, kernel and ports. I didn't benchmark the exact times, but compilation times are at least increased by a factor of 1.5. Nothing has changed of the last month besides upgrading 12.1-Stable every other week. Not seeing this after clang update to 10 on both stable/12 and head. I'd check if you are excessively swapping now as (not sure about that, just guessing) newer clang/llvm could consume more memory during compilation, and possibly reducing the make jobs number. ___ freebsd-stable@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"
Buildworld and buildkernel with very slow compilation, recently
Hi, I am following FreeBSD 12.1-STABLE. Clang has been upgraded to version 10.0.0 on May, 1st, and ever since that time, I do observe a dramatic increase in compilation times of building world, kernel and ports. I didn't benchmark the exact times, but compilation times are at least increased by a factor of 1.5. Nothing has changed of the last month besides upgrading 12.1-Stable every other week. Has anyone else been bitten by this? Regards, Michael ___ freebsd-stable@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"
