Re: SOLVED: Re: [gentoo-user] Getting WiFi to work
On Sunday, 21 April 2024 23:30:54 BST Wol wrote: > On 19/04/2024 17:02, Peter Humphrey wrote: > > > > Just reporting back. > > > > I built a new system - using NetworkManager (after all I've said about > > it!) - now that it's so much quicker using binpkgs. > > > > It all went fairly smoothly, taking one step at a time through changing > > several USE flags, installing various tools, and finally, adding the new > > wlan0 interface to shorewall. > > > > The machine can now boot with either wired or wireless network, or both. > > > > Thank you, all who helped. > > Any chance you can document those steps? Yes, I ought to do that. I just need to remember... ;-) > I'm struggling to get wireless working on my laptop - the statement in the > handbook Wireless networking on Linux is usually pretty straightforward. > There are three ways of configuring wifi: graphical clients, text-mode > interfaces, and command-line interfaces. > > just seems to be complete rubbish :-( It does seem that way, indeed. It was certainly no use to me. > As far as I can tell, my kernel is bringing up the hardware fine - dmesg > tells me my wireless interface has come up fine with iwlwifi, and has > been renamed from wlan0 to wlo1. Network manager detects the ethernet > connection but can't even see the wireless connection. > > Ummm ... of course, sod has just struck, I've rebooted, started Network > Manager (which I thought I'd uninstalled) and wonder of wonders I have > internet! > > But some documentation would certainly be appreciated. I'll see what I can do in the next day or two. -- Regards, Peter.
SOLVED: Re: [gentoo-user] Getting WiFi to work
On Tuesday, 9 April 2024 14:23:31 BST I wrote: > I want to move my Intel i5 NUC box to a place where Ethernet is not > available, nor like to become so. That means I have to get WiFi working, > but I've had no success so far. The wiki pages are many, confusing and > contradictory, so I'd like the panel's advice on the way to proceed. Just reporting back. I built a new system - using NetworkManager (after all I've said about it!) - now that it's so much quicker using binpkgs. It all went fairly smoothly, taking one step at a time through changing several USE flags, installing various tools, and finally, adding the new wlan0 interface to shorewall. The machine can now boot with either wired or wireless network, or both. Thank you, all who helped. -- Regards, Peter.
Re: [gentoo-user] Using the new binpkgs
On Tuesday, 16 April 2024 16:29:09 BST Eli Schwartz wrote: [Big snip] Never mind. I've solved the problem by removing sci-misc/boinc and its 40-odd dependencies. The machine was only barely capable of running it anyway. -- Regards, Peter.
Re: [gentoo-user] Using the new binpkgs
(Rearranged in chronological order...) On Tuesday, 16 April 2024 15:08:33 BST Waldo Lemmer wrote: > On Tue, Apr 16, 2024, 15:43 Peter Humphrey wrote: > > On Monday, 15 April 2024 12:19:02 BST Peter Humphrey wrote: --->8 > > I'm still mystified by these Gentoo binary packages. I assume that they're > > generated using the default USE flags in the profile version (whence the > > need to specify it in gentoobinhost.conf). > > > > So why is portage not fetching webkit-gtk from the repo? I've just had to > > compile it from source, even though nothing in /etc/portage/ refers to it > > (except for wxGTK depending on it). Therefore I assume i meet the > > conditions > > for using the binpkg, but apparently not. > > > > Clues, anyone? > > If you add --ask --verbose, Portage should tell you why it's falling back > to the source package. This is what I get after this morning's update: Dependency resolution took 16.03 s (backtrack: 0/20). [ebuild N ] gui-libs/gtk-4.12.5:4::gentoo USE="X cups gstreamer introspection wayland (-aqua) -broadway -cloudproviders -colord -examples (- ffmpeg) -sysprof -test (-vulkan)" CPU_FLAGS_X86="f16c" 16,909 KiB [binary NS] net-libs/libsoup-3.4.4-2:3.0::gentoo [2.74.3:2.4::gentoo] USE="brotli* introspection ssl vala -gssapi -gtk-doc -samba -sysprof -test" ABI_X86="(64) -32 (-x32)" 390 KiB [ebuild NS] net-libs/webkit-gtk-2.42.5-r600:6/0::gentoo [2.42.5:4/37::gentoo] USE="X gstreamer introspection jpeg2k jumbo-build lcms pdf (seccomp) spell wayland (-aqua) -avif -examples -gamepad -jpegxl -keyring -systemd" 0 KiB Total: 3 packages (1 new, 2 in new slots, 1 binary), Size of downloads: 17,299 KiB !!! The following binary packages have been ignored due to non matching USE: =gui-libs/gtk-4.12.5 colord -cpu_flags_x86_f16c sysprof =gui-libs/gtk-4.12.5 -cpu_flags_x86_f16c -gstreamer Notice that there's no mention of non-matching USE in webkit-gtk. And, re gtk-4.12.5, why do the USE flags not match the default in the profile? And what on earth is 'cpu_flags_x86_f16c'? And why does gtk get two different lines for the same package? What's more, neither gtk nor libsoup was mentioned this morning, and I haven't sync'd in the interim. You see why I'm mystified - unless I've messed up my scripts, of course. > Does your emerge command include --getbinpkg, or -g? Of course; I /am/ doing my best to follow the instructions verbatim. -- Regards, Peter.
Re: [gentoo-user] Using the new binpkgs
On Monday, 15 April 2024 12:19:02 BST Peter Humphrey wrote: Hello list, [Big snip] I'm still mystified by these Gentoo binary packages. I assume that they're generated using the default USE flags in the profile version (whence the need to specify it in gentoobinhost.conf). So why is portage not fetching webkit-gtk from the repo? I've just had to compile it from source, even though nothing in /etc/portage/ refers to it (except for wxGTK depending on it). Therefore I assume i meet the conditions for using the binpkg, but apparently not. Clues, anyone? -- Regards, Peter.
Re: [gentoo-user] Using the new binpkgs
On Monday, 15 April 2024 13:24:59 BST Waldo Lemmer wrote: > I'd like to understand your confusion. Where did you get 27 from? >From ref 1, viz: "The architecture and profile targets within the sync-uri value do matter and should align to the respective computer architecture (amd64 in this case) and system profile selected in the Choosing the right profile section." I think it should refer to a family of profiles, or perhaps a series. Something to refer specifically to, in this case, 23.0. It might have saved me some sawdust under the finger-nails. :) -- Regards, Peter.
Re: [gentoo-user] Using the new binpkgs
On Monday, 15 April 2024 12:19:02 BST Peter Humphrey wrote: > Hello list, > > I've decided to follow the instructions in [1] on one of my machines, which > runs too hot for my comfort on long emerges, but I need some advice, please: > where the wiki gives this [2], I'm setting 'amd64' as the and '27' > as the . > > Then, when I try to emerge a package, I get this: > > !!! Error fetching binhost package info from > 'https://distfiles.gentoo.org/releases/amd64/binpackages/27/x86-64' !!! > HTTP Error 404: Not Found > > Then I tried setting 'default/linux/amd64/23.0/desktop/plasma' as the > , but I still got the 404 error. > > What am I doing wrong? Sorry about the noise. The answer is simple: go to the ...binpackages page and look! The 27 should be 23.0. -- Regards, Peter.
[gentoo-user] Using the new binpkgs
Hello list, I've decided to follow the instructions in [1] on one of my machines, which runs too hot for my comfort on long emerges, but I need some advice, please: where the wiki gives this [2], I'm setting 'amd64' as the and '27' as the . Then, when I try to emerge a package, I get this: !!! Error fetching binhost package info from 'https://distfiles.gentoo.org/releases/amd64/binpackages/27/x86-64' !!! HTTP Error 404: Not Found Then I tried setting 'default/linux/amd64/23.0/desktop/plasma' as the , but I still got the 404 error. What am I doing wrong? 1. https://wiki.gentoo.org/wiki/Handbook:AMD64/Installation/Base#Optional:_Adding_a_binary_package_host 2. sync-uri = https://distfiles.gentoo.org/releases//binpackages//x86-64/ -- Regards, Peter.
Re: [gentoo-user] Getting WiFi to work
On Friday, 12 April 2024 16:39:12 BST Michael wrote: > On Friday, 12 April 2024 16:05:46 BST Peter Humphrey wrote: > > On Friday, 12 April 2024 14:35:02 BST Michael wrote: > > > There are GUI front-ends for the above to suit various desktop and user > > > preferences, some more polished than others. > > > > Hm. I haven't found one for iwd yet... > > There is net-wireless/iwgtk in portage. Other GUI applications exist > (idwgui, dmenu-iwd-gui), plus the general GUI front ends of networkmanager > and connman. Of course, I found iwgtk a minute after sending that last. Network Manager is what I'm trying to avoid, mostly because it makes a mess of my existing wired LAN with its static addresses. I may have to revisit that whole setup. -- Regards, Peter.
Re: [gentoo-user] Getting WiFi to work
On Friday, 12 April 2024 14:35:02 BST Michael wrote: > For clarity: > > The iwlwifi is a kernel driver for Intel wireless chips. > > The net-wireless/iw software can be used to manage the wireless association > with an AP if the latter has been configured to offer connections with the > deprecated and insecure WEP, or no encryption. > > The net-wireless/wpa_supplicant software can be used to manage the > negotiation for a wireless connection with an AP when this has encryption > enabled (WPA, WPA-2, WPA-3). Yes, I was aware of those. > The net-wireless/iwd is a more modern software developed by Intel to replace > wpa_supplicant. In addition it will also create wireless interfaces as it > needs to and manage these, as opposed to leaving this function to udev. > Essentially iwd takes over the management of wireless interfaces and their > encrypted communication with an AP in a standalone fashion. I haven't > tried this yet to find out how it behaves, but it is rumoured to be more > polished than wpa_supplicant and can work without netifrc scripts or > dhcpcd. That's a better explanation than I've seen before - thanks! > There are GUI front-ends for the above to suit various desktop and user > preferences, some more polished than others. Hm. I haven't found one for iwd yet... -- Regards, Peter. signature.asc Description: This is a digitally signed message part.
Re: [gentoo-user] Getting WiFi to work
On Tuesday, 9 April 2024 15:56:28 BST Wojciech Kuzyszyn wrote: > On Tue, 09 Apr 2024 14:23:31 +0100 > > Peter Humphrey wrote: > > Hello list, > > > > I want to move my Intel i5 NUC box to a place where Ethernet is not > > available, nor like to become so. That means I have to get WiFi > > working, but I've had no success so far. The wiki pages are many, > > confusing and contradictory, so I'd like the panel's advice on the > > way to proceed. > > > > The first thing I tried was the traditional wpa_supplicant, which > > seemed to go well - except that I couldn't get the link out of the > > DOWN state. > > > > Then I tried NetworkManager, and failed with that too. > > > > This is the hardware: > > # lspci -v -s 00:14.3 > > 00:14.3 Network controller: Intel Corporation Raptor Lake PCH CNVi > > WiFi (rev 01) > > --->8 > > > > Kernel driver in use: iwlwifi > > Kernel modules: iwlwifi > > > > And this is dmesg: > > > > $ dmesg | grep -i wifi > > [1.622343] Intel(R) Wireless WiFi driver for Linux > > [1.622432] iwlwifi :00:14.3: enabling device ( -> 0002) > > [1.625069] iwlwifi :00:14.3: Detected crf-id 0x400410, cnv-id > > 0x80400 wfpm id 0x8020 > > [1.625121] iwlwifi :00:14.3: PCI dev 51f1/0094, rev=0x370, > > rfid=0x2010d000 > > [1.625313] Loading firmware: iwlwifi-so-a0-gf-a0-86.ucode > > [1.626644] iwlwifi :00:14.3: TLV_FW_FSEQ_VERSION: FSEQ > > Version: 0.0.2.41 > > [1.626902] iwlwifi :00:14.3: loaded firmware version > > 86.fb5c9aeb.0 so- a0-gf-a0-86.ucode op_mode iwlmvm > > [1.643426] iwlwifi :00:14.3: Detected Intel(R) Wi-Fi 6E AX211 > > 160MHz, REV=0x370 > > [1.651382] iwlwifi :00:14.3: WRT: Invalid buffer destination > > [1.809375] iwlwifi :00:14.3: WFPM_UMAC_PD_NOTIFICATION: 0x20 > > [1.809385] iwlwifi :00:14.3: WFPM_LMAC2_PD_NOTIFICATION: 0x1f > > [1.809394] iwlwifi :00:14.3: WFPM_AUTH_KEY_0: 0x90 > > [1.809401] iwlwifi :00:14.3: CNVI_SCU_SEQ_DATA_DW9: 0x0 > > [1.809403] Loading firmware: iwlwifi-so-a0-gf-a0.pnvm > > [1.810724] iwlwifi :00:14.3: loaded PNVM version e28bb9d7 > > [1.810817] iwlwifi :00:14.3: RFIm is deactivated, reason = 4 > > [1.825831] iwlwifi :00:14.3: Detected RF GF, rfid=0x2010d000 > > [1.897387] iwlwifi :00:14.3: base HW address: > > f4:6d:3f:2a:33:3e > > > > Would net-wireless/iwd get me a bit further? > > > > Meanwhile, I'll keep on exploring with the results of > > sys-apps/hw-probe. > > Hello! > > I have never managed to get WiFi working with iwlwifi, but iwd works > great for me. Give it a try! According to https://wiki.gentoo.org/wiki/Handbook:AMD64/Networking/Wireless, "the net-wireless/iw software...cannot connect to WPA-only Access Points." I think my Fritz!Box 7530 router has that limitation, but It's hard to know. -- Regards, Peter. signature.asc Description: This is a digitally signed message part.
Re: [gentoo-user] Getting WiFi to work
On Thursday, 11 April 2024 16:18:51 BST Michael wrote: > On Thursday, 11 April 2024 16:15:52 BST Peter Humphrey wrote: > > On Thursday, 11 April 2024 16:08:35 BST Michael wrote: > > > On Thursday, 11 April 2024 13:49:18 BST Peter Humphrey wrote: > > --->8 > > > > > > I decided to establish a firm, clean system to fall back to after > > > > messing > > > > about with the various wifi packages, so I built a fresh system > > > > building > > > > on the merged-usr stage-3. I was surprised to find that kde-plasma/ > > > > powerdevil now insists on installing Network Manager unless I set > > > > USE=- > > > > wireless against it. > > > > > > > > Why has this happened? Can't the poor power devil cope with any other > > > > way > > > > of running WiFi? > > > > > > The USE="wireless" flag on powerdevil is needed to save energy when the > > > bluetooth/wireless chip is idle. This function could be useful with > > > laptops running on battery. > > > > > > If you set USE="-networkmanager" in make.conf and USE="-wireless" for > > > the > > > powerdevil package you won't be bothered by this again. > > > > I already had USE="-networkmanager" in make.conf. > > > > This is not a laptop and it has no battery. Nowhere on the system is there > > any hint to the contrary, so I still think this has not been thought > > through. The logic should have included alternatives to Network Manager. > > Yes, I agree wholeheartedly. However, these decisions are taken upstream, > where there is a tendency of convergence to monoculture. Sorry, but I disagree with that last. The ebuild could have contained suitable logic, and it still could. -- Regards, Peter.
Re: [gentoo-user] Getting WiFi to work
On Tuesday, 9 April 2024 15:56:28 BST Wojciech Kuzyszyn wrote: > I have never managed to get WiFi working with iwlwifi, but iwd works > great for me. Give it a try! I will - thanks! -- Regards, Peter.
Re: [gentoo-user] Getting WiFi to work
On Thursday, 11 April 2024 16:08:35 BST Michael wrote: > On Thursday, 11 April 2024 13:49:18 BST Peter Humphrey wrote: --->8 > > I decided to establish a firm, clean system to fall back to after messing > > about with the various wifi packages, so I built a fresh system building > > on the merged-usr stage-3. I was surprised to find that kde-plasma/ > > powerdevil now insists on installing Network Manager unless I set USE=- > > wireless against it. > > > > Why has this happened? Can't the poor power devil cope with any other way > > of running WiFi? > > The USE="wireless" flag on powerdevil is needed to save energy when the > bluetooth/wireless chip is idle. This function could be useful with laptops > running on battery. > > If you set USE="-networkmanager" in make.conf and USE="-wireless" for the > powerdevil package you won't be bothered by this again. I already had USE="-networkmanager" in make.conf. This is not a laptop and it has no battery. Nowhere on the system is there any hint to the contrary, so I still think this has not been thought through. The logic should have included alternatives to Network Manager. -- Regards, Peter.
Re: [gentoo-user] Getting WiFi to work
On Tuesday, 9 April 2024 14:44:05 BST Paul Sopka wrote: > On 09.04.24 15:23, Peter Humphrey wrote: > > Hello list, > > > > I want to move my Intel i5 NUC box to a place where Ethernet is not > > available, nor like to become so. That means I have to get WiFi working, > > but I've had no success so far. The wiki pages are many, confusing and > > contradictory, so I'd like the panel's advice on the way to proceed. > > > > The first thing I tried was the traditional wpa_supplicant, which seemed > > to go well - except that I couldn't get the link out of the DOWN state. > > > > Then I tried NetworkManager, and failed with that too. > > > > This is the hardware: > > # lspci -v -s 00:14.3 > > 00:14.3 Network controller: Intel Corporation Raptor Lake PCH CNVi WiFi > > (rev 01) > > --->8 > > > > Kernel driver in use: iwlwifi > > Kernel modules: iwlwifi > > > > And this is dmesg: > > > > $ dmesg | grep -i wifi > > [1.622343] Intel(R) Wireless WiFi driver for Linux > > [1.622432] iwlwifi :00:14.3: enabling device ( -> 0002) > > [1.625069] iwlwifi :00:14.3: Detected crf-id 0x400410, cnv-id > > 0x80400 wfpm id 0x8020 > > [1.625121] iwlwifi :00:14.3: PCI dev 51f1/0094, rev=0x370, > > rfid=0x2010d000 > > [1.625313] Loading firmware: iwlwifi-so-a0-gf-a0-86.ucode > > [1.626644] iwlwifi :00:14.3: TLV_FW_FSEQ_VERSION: FSEQ Version: > > 0.0.2.41 > > [1.626902] iwlwifi :00:14.3: loaded firmware version 86.fb5c9aeb.0 > > so- a0-gf-a0-86.ucode op_mode iwlmvm > > [1.643426] iwlwifi :00:14.3: Detected Intel(R) Wi-Fi 6E AX211 > > 160MHz, REV=0x370 > > [1.651382] iwlwifi :00:14.3: WRT: Invalid buffer destination > > [1.809375] iwlwifi :00:14.3: WFPM_UMAC_PD_NOTIFICATION: 0x20 > > [1.809385] iwlwifi :00:14.3: WFPM_LMAC2_PD_NOTIFICATION: 0x1f > > [1.809394] iwlwifi :00:14.3: WFPM_AUTH_KEY_0: 0x90 > > [1.809401] iwlwifi :00:14.3: CNVI_SCU_SEQ_DATA_DW9: 0x0 > > [1.809403] Loading firmware: iwlwifi-so-a0-gf-a0.pnvm > > [1.810724] iwlwifi :00:14.3: loaded PNVM version e28bb9d7 > > [1.810817] iwlwifi :00:14.3: RFIm is deactivated, reason = 4 > > [1.825831] iwlwifi :00:14.3: Detected RF GF, rfid=0x2010d000 > > [1.897387] iwlwifi :00:14.3: base HW address: f4:6d:3f:2a:33:3e > > > > Would net-wireless/iwd get me a bit further? > > > > Meanwhile, I'll keep on exploring with the results of sys-apps/hw-probe. > > Hey Peter > > This might be the wrong firmware being loaded. > > Are you building your the iwlwifi driver not as a module but directly > into the kernel? > > Are you including your firmware into the kernel? > > If you do the above, try loading the driver as a module. Also enable > both DVM and MVM Firmware support. > > Then emerge sys-kernel/linux-firmware without USE=savedconfig. > > Finally reboot and check wther it works. If it works, check which > firmware is loaded in your dmesg. I decided to establish a firm, clean system to fall back to after messing about with the various wifi packages, so I built a fresh system building on the merged-usr stage-3. I was surprised to find that kde-plasma/powerdevil now insists on installing Network Manager unless I set USE=-wireless against it. Why has this happened? Can't the poor power devil cope with any other way of running WiFi? -- Regards, Peter.
[gentoo-user] Getting WiFi to work
Hello list, I want to move my Intel i5 NUC box to a place where Ethernet is not available, nor like to become so. That means I have to get WiFi working, but I've had no success so far. The wiki pages are many, confusing and contradictory, so I'd like the panel's advice on the way to proceed. The first thing I tried was the traditional wpa_supplicant, which seemed to go well - except that I couldn't get the link out of the DOWN state. Then I tried NetworkManager, and failed with that too. This is the hardware: # lspci -v -s 00:14.3 00:14.3 Network controller: Intel Corporation Raptor Lake PCH CNVi WiFi (rev 01) --->8 Kernel driver in use: iwlwifi Kernel modules: iwlwifi And this is dmesg: $ dmesg | grep -i wifi [1.622343] Intel(R) Wireless WiFi driver for Linux [1.622432] iwlwifi :00:14.3: enabling device ( -> 0002) [1.625069] iwlwifi :00:14.3: Detected crf-id 0x400410, cnv-id 0x80400 wfpm id 0x8020 [1.625121] iwlwifi :00:14.3: PCI dev 51f1/0094, rev=0x370, rfid=0x2010d000 [1.625313] Loading firmware: iwlwifi-so-a0-gf-a0-86.ucode [1.626644] iwlwifi :00:14.3: TLV_FW_FSEQ_VERSION: FSEQ Version: 0.0.2.41 [1.626902] iwlwifi :00:14.3: loaded firmware version 86.fb5c9aeb.0 so- a0-gf-a0-86.ucode op_mode iwlmvm [1.643426] iwlwifi :00:14.3: Detected Intel(R) Wi-Fi 6E AX211 160MHz, REV=0x370 [1.651382] iwlwifi :00:14.3: WRT: Invalid buffer destination [1.809375] iwlwifi :00:14.3: WFPM_UMAC_PD_NOTIFICATION: 0x20 [1.809385] iwlwifi :00:14.3: WFPM_LMAC2_PD_NOTIFICATION: 0x1f [1.809394] iwlwifi :00:14.3: WFPM_AUTH_KEY_0: 0x90 [1.809401] iwlwifi :00:14.3: CNVI_SCU_SEQ_DATA_DW9: 0x0 [1.809403] Loading firmware: iwlwifi-so-a0-gf-a0.pnvm [1.810724] iwlwifi :00:14.3: loaded PNVM version e28bb9d7 [1.810817] iwlwifi :00:14.3: RFIm is deactivated, reason = 4 [1.825831] iwlwifi :00:14.3: Detected RF GF, rfid=0x2010d000 [1.897387] iwlwifi :00:14.3: base HW address: f4:6d:3f:2a:33:3e Would net-wireless/iwd get me a bit further? Meanwhile, I'll keep on exploring with the results of sys-apps/hw-probe. -- Regards, Peter.
Re: [gentoo-user] Successfully upgraded to new profile 23.0
On Monday, 8 April 2024 22:14:30 BST Eli Schwartz wrote: > If you're okay doing a fresh install from a stage3 tar, which is faster > at least to install the base system because it is all precompiled and > you are not building the packages yourself, then I would assume you're > also okay doing the update using the gentoo.org official binhost. > > They're both just the binaries that Gentoo's release automation builds > for you. Extracting a bunch of gpkgs is much faster than compiling them, > and not too much slower than extracting a single stage3 tarball. > > It also has the advantage that for amd64, more than just the stage3 > package set can be sped up like this -- and you don't have to rebuild > the installation, recreate @world, backup and restore user data, etc. > > Just enable the binhost and then do the same -e @world you were doing > without the binhost. :) There is one caveat, though: all the binary packages have been compiled with default USE flags. If you've changed any on your system, you'll still have to install those packages the standard way. I have 24 such USE settings on this machine. -- Regards, Peter.
Re: [gentoo-user] Program shutting down - where is its status held?
On Friday, 5 April 2024 16:21:15 BST Michael Orlitzky wrote:
> But barring that, you could add pre- and post-stop hooks that will let you
> know that the daemon is stopping.
>
> For example, in /etc/conf.d/boinc, you could put
>
> stop_pre(){
> touch /run/stopping-boinc
> }
> stop_post(){
> rm -f /run/stopping-boinc
> }
>
> or something like that. (I haven't tested, but the idea is sound.)
> Then, if that file exists, boinc is stopping.
Nice, neat solution. Works a charm, too.
Thanks again, Michael.
--
Regards,
Peter.
Re: [gentoo-user] Program shutting down - where is its status held?
On Friday, 5 April 2024 16:21:15 BST Michael Orlitzky wrote:
> Personally, I would try to figure out why boinc doesn't want to stop
> when you tell it to stop.
Actually, it does; all its daughter process do stop straight away. It's just
that it doesn't report completion when it should.
> But barring that, you could add pre- and post-stop hooks that will let you
> know that the daemon is stopping.
>
> For example, in /etc/conf.d/boinc, you could put
>
> stop_pre(){
> touch /run/stopping-boinc
> }
> stop_post(){
> rm -f /run/stopping-boinc
> }
>
> or something like that. (I haven't tested, but the idea is sound.)
> Then, if that file exists, boinc is stopping.
Outstanding! I'll try that. Thank you Michael.
As to the primary problem, I think the BOINC team aren't entirely in tune with
the Linux way of doing things - though I could be wrong, of course. They're
university boffins, after all... :)
--
Regards,
Peter.
Re: [gentoo-user] Program shutting down - where is its status held?
On Thursday, 4 April 2024 10:12:23 BST I wrote: > Some of my machines run BOINC, which I want to stop while doing my sync & > update. For some reason, '/etc/init.d/boinc stop' often takes exactly 60s to > complete instead of its normal 6-10s. > > I'd like my update script to detect this condition, but I can't see how. > I've tried grepping /bin/ps output, and I've tried checking for existence > of a BOINC pid file, but those both tell me that BOINC is "running" while > it's in the process of shutting down. > > Is there somewhere in /proc where this shutting-down status is held? Let me ask a different way: does start-stop-daemon keep the current, transient status of the daemon it's operating on anywhere other than in its own variables, and thus accessible for inspection? I have tried reading the code, but I'm not familiar with the Linux way of organising programs, and it's far too long since I did anything even remotely similar. -- Regards, Peter.
[gentoo-user] Program shutting down - where is its status held?
Hello list, Some of my machines run BOINC, which I want to stop while doing my sync & update. For some reason, '/etc/init.d/boinc stop' often takes exactly 60s to complete instead of its normal 6-10s. I'd like my update script to detect this condition, but I can't see how. I've tried grepping /bin/ps output, and I've tried checking for existence of a BOINC pid file, but those both tell me that BOINC is "running" while it's in the process of shutting down. Is there somewhere in /proc where this shutting-down status is held? -- Regards, Peter.
Re: [gentoo-user] New profiles 23.0
On Tuesday, 26 March 2024 15:21:32 GMT Walter Dnes wrote: > I'm AMD64 stable OpenRC. I got tired of dicking around resizing > partitions years ago, so I have all data and binaries in one honking > big partition. Also separate partitions for UEFI and swap. I assume > my system is already "merged-usr". Current profile... Perhaps, perhaps not. I fell for that one too. 'merged-usr' refers to moving /bin, /sbin and maybe others under /usr and replacing their top-level directories with symlinks to their new positions. Once merged, never to be unmerged again, without lots of preparation and hoop- jumping. -- Regards, Peter.
Re: [gentoo-user] Stage-3 and profile 23.x
On Monday, 25 March 2024 23:14:50 GMT Michael wrote: > On Monday, 25 March 2024 21:48:24 GMT Peter Humphrey wrote: > > On Monday, 25 March 2024 16:52:19 GMT Michael wrote: > > > The default OpenRC installation now assumes a merged-usr fs structure - > > > therefore make sure you select the appropriate profile in a new > > > installation. > > > > I was wondering about that. Now that we have 23.0 in place, are we meant > > to > > change to merged-usr? Should I run the eponymous script? > > You can, if you want to. I've installed sys-apps/merge-usr and ran it on my > OpenRC system, after I completed the migration to profile 23.0. It didn't > take any time at all: > > https://wiki.gentoo.org/wiki/Merge-usr I'd want a good reason to do so, as I can't imagine it being reversed easily - I'd need to keep a backup of /bin, /usr and so on which I could restore if necessary, then run emerge -e @world and save those directories again. Not worth the candle. There being no foreseeable prospect of the systemd bandwagon picking me up on its way by, I think I'll stick to what I know*. * For some vague approximation to 'know'. :) -- Regards, Peter.
Re: [gentoo-user] Stage-3 and profile 23.x
On Monday, 25 March 2024 16:52:19 GMT Michael wrote: > The default OpenRC installation now assumes a merged-usr fs structure - > therefore make sure you select the appropriate profile in a new installation. I was wondering about that. Now that we have 23.0 in place, are we meant to change to merged-usr? Should I run the eponymous script? -- Regards, Peter.
[gentoo-user] Stage-3 and profile 23.x
Hello list, It would be good if a stage-3 tarball were available with profile 23.x built in. Sooner or later someone will want to build a new system with such a profile. Is this in the offing? -- Regards, Peter.
Re: [gentoo-user] New profile, gcc-13.2.1_p20240210 fails to build. ATTN: Peter Humphrey.
On Monday, 25 March 2024 07:04:57 GMT Dale wrote: > Overall, the devs did a really good job with the instructions. Just > have to update first as it says. It works better. ;-) I just wonder > who went through the torture of figuring out what went in what order. O_O Indeed, they've done a thorough job - and not, I assume, just the one whose name appears on the news item. -- Regards, Peter.
Re: [gentoo-user] New profile, gcc-13.2.1_p20240210 fails to build. ATTN: Peter Humphrey.
On Saturday, 23 March 2024 20:45:03 GMT Dale wrote: --->8 > I saw where Peter mentioned in another thread gcc failing with no error > message for him. This could be related. Nope. I was all fingers and thumbs at the time, now all straightened out. -- Regards, Peter.
Re: [gentoo-user] New profiles 23.0
On Saturday, 23 March 2024 17:42:29 GMT Michael wrote: > I suggest it would be best to take heed of the devs hard work and read the > instructions they have provided instead of winging it: > > https://wiki.gentoo.org/wiki/Project:Toolchain/23.0_update_instructions Of course I was doing that, but from the news item. My problem was that I wasn't reading straight. (I think I had a form of covid last month, and it's left a few loose ends - mostly in my brain!) -- Regards, Peter.
Re: [gentoo-user] New profiles 23.0
On Saturday, 23 March 2024 15:08:56 GMT Peter Humphrey wrote: > On Saturday, 23 March 2024 14:59:15 GMT Peter Humphrey wrote: > > Hello list, > > > > Has anyone tried the profile upgrade that was notified today? I tried it > > just now on a small rescue system and it failed on installing the first > > binary package, complaining that my disk layout was split-usr. > > > > My /var is on a separate partition, for easy of file recovery, but /usr is > > not. Is this the cause of the problem? > > Please ignore that. Three seconds later I realised what I should have done: > run emerge-usr first. No, that's wrong too. I need to do a bit of head-scratching. -- Regards, Peter.
Re: [gentoo-user] New profiles 23.0
On Saturday, 23 March 2024 14:59:15 GMT Peter Humphrey wrote: > Hello list, > > Has anyone tried the profile upgrade that was notified today? I tried it > just now on a small rescue system and it failed on installing the first > binary package, complaining that my disk layout was split-usr. > > My /var is on a separate partition, for easy of file recovery, but /usr is > not. Is this the cause of the problem? Please ignore that. Three seconds later I realised what I should have done: run emerge-usr first. -- Regards, Peter.
[gentoo-user] New profiles 23.0
Hello list, Has anyone tried the profile upgrade that was notified today? I tried it just now on a small rescue system and it failed on installing the first binary package, complaining that my disk layout was split-usr. My /var is on a separate partition, for easy of file recovery, but /usr is not. Is this the cause of the problem? -- Regards, Peter.
Re: [gentoo-user] Soft scrolling on framebuffer consoles - with GPM handling - version of the patch for kernel 6.6 [was 6.3] onwards.
On Wednesday, 24 January 2024 12:20:29 GMT Alan Mackenzie wrote:
> Hello, Gentoo.
>
> On Wed, Jan 24, 2024 at 10:00:37 +, Alan Mackenzie wrote:
>
> [ ]
>
> Please note the corrected subject line. This version of the soft
> scrolling patch is for kernel 6.6.13, or thereabouts.
It works well here, Alan, up to kernel version 6.7.9, but one of the 15 or so
new kernel parameters (since 6.7.8) seems to cause it to fail.
I've attached the reject file, /usr/src/linux-6.8.0-gentoo/drivers/tty/vt/
vt.c.rej.
--
Regards,
Peter.
--- drivers/tty/vt/vt.c
+++ drivers/tty/vt/vt.c
@@ -348,107 +377,111 @@ void schedule_console_callback(void)
* Code to manage unicode-based screen buffers
*/
-/*
- * Our screen buffer is preceded by an array of line pointers so that
- * scrolling only implies some pointer shuffling.
- */
+#define vc_uniscr_buf_end(vc) (vc->vc_uniscr_buf + vc->vc_uniscr_char_size)
-static u32 **vc_uniscr_alloc(unsigned int cols, unsigned int rows)
+static int vc_uniscr_alloc(struct vc_data *vc, unsigned int cols, unsigned int rows)
{
- u32 **uni_lines;
- void *p;
- unsigned int memsize, i, col_size = cols * sizeof(**uni_lines);
-
- /* allocate everything in one go */
- memsize = col_size * rows;
- memsize += rows * sizeof(*uni_lines);
- uni_lines = vzalloc(memsize);
- if (!uni_lines)
- return NULL;
-
- /* initial line pointers */
- p = uni_lines + rows;
- for (i = 0; i < rows; i++) {
- uni_lines[i] = p;
- p += col_size;
- }
+ uint32_t *p;
+ unsigned int new_size; /* In 32-bit characters */
- return uni_lines;
-}
+#ifdef CONFIG_FRAMEBUFFER_CONSOLE_SOFT_SCROLLBACK_GPM
+ unsigned int num_scrollback_rows;
-static void vc_uniscr_free(u32 **uni_lines)
-{
- vfree(uni_lines);
+ num_scrollback_rows = (console_soft_scrollback_size / 2) / cols;
+ new_size = cols * (num_scrollback_rows + rows + 1);
+#else
+ new_size = cols * (rows + 1); /* 1 row for the circular buffer admin */
+#endif
+ p = (uint32_t *)vzalloc (sizeof (uint32_t) * new_size);
+ if (!p)
+ return -ENOMEM;
+ vc->vc_uniscr_buf = p;
+ vc->vc_uniscr_curr = p;
+ vc->vc_uniscr_char_size = new_size;
+ memset32(p, ' ', new_size); /* Probably redundant. */
+ return 0;
}
-static void vc_uniscr_set(struct vc_data *vc, u32 **new_uni_lines)
+static void vc_uniscr_free(struct vc_data *vc)
{
- vc_uniscr_free(vc->vc_uni_lines);
- vc->vc_uni_lines = new_uni_lines;
+ kvfree(vc->vc_uniscr_buf);
+ vc->vc_uniscr_buf = NULL;
}
static void vc_uniscr_putc(struct vc_data *vc, u32 uc)
{
- if (vc->vc_uni_lines)
- vc->vc_uni_lines[vc->state.y][vc->state.x] = uc;
+ uint32_t *pos;
+
+ if (vc->vc_uniscr_buf) {
+ pos = vc->vc_uniscr_curr;
+ UNISCR_PLUS(pos, vc->state.y * vc->vc_cols + vc->state.x);
+#ifdef CONFIG_FRAMEBUFFER_CONSOLE_SOFT_SCROLLBACK_GPM
+ UNISCR_MINUS(pos, vc->vc_cols * (vc->vc_softback_lines + vc->vc_top));
+#endif
+ *pos = uc;
+ }
}
static void vc_uniscr_insert(struct vc_data *vc, unsigned int nr)
{
- if (vc->vc_uni_lines) {
- u32 *ln = vc->vc_uni_lines[vc->state.y];
- unsigned int x = vc->state.x, cols = vc->vc_cols;
+ unsigned int x = vc->state.x, y = vc->state.y, cols = vc->vc_cols;
+ uint32_t *ln = vc->vc_uniscr_curr;
- memmove([x + nr], [x], (cols - x - nr) * sizeof(*ln));
+ if (vc->vc_uniscr_buf) {
+ UNISCR_PLUS(ln, y * cols);
+#ifdef CONFIG_FRAMEBUFFER_CONSOLE_SOFT_SCROLLBACK_GPM
+ UNISCR_MINUS(ln, vc->vc_cols * (vc->vc_softback_lines + vc->vc_top));
+#endif
+ memmove([x + nr], [x], (cols - x - nr) * sizeof(uint32_t));
memset32([x], ' ', nr);
}
}
static void vc_uniscr_delete(struct vc_data *vc, unsigned int nr)
{
- if (vc->vc_uni_lines) {
- u32 *ln = vc->vc_uni_lines[vc->state.y];
- unsigned int x = vc->state.x, cols = vc->vc_cols;
+ unsigned int x = vc->state.x, y = vc->state.y, cols = vc->vc_cols;
+ uint32_t *ln = vc->vc_uniscr_curr;
- memcpy([x], [x + nr], (cols - x - nr) * sizeof(*ln));
+ if (vc->vc_uniscr_buf) {
+ UNISCR_PLUS(ln, y * cols);
+#ifdef CONFIG_FRAMEBUFFER_CONSOLE_SOFT_SCROLLBACK_GPM
+ UNISCR_MINUS(ln, vc->vc_cols * (vc->vc_softback_lines + vc->vc_top));
+#endif
+ memcpy([x], [x + nr], (cols - x - nr) * sizeof(uint32_t));
memset32([cols - nr], ' ', nr);
}
}
+/* FIXME!!! We need to check that NR never goes beyond the current line end. !!! */
static void vc_uniscr_clear_line(struct vc_data *vc, unsigned int x,
unsigned int nr)
{
- if (vc->vc_uni_lines)
- memset32(>vc_uni_lines[vc->state.y][x], ' ', nr);
+ if (vc->vc_uniscr_buf) {
+ uint32_t *ln = vc->vc_uniscr_curr;
+
+ UNISCR_PLUS(ln, vc->state.y * vc->vc_cols);
+#ifdef CONFIG_FRAMEBUFFER_CONSOLE_SOFT_SCROLLBACK_GPM
+ UNISCR_MINUS(ln, vc->vc_cols * (vc->vc_softback_lines + vc->vc_top));
+#endif
+ memset32([x], ' ', nr);
+ }
}
static void vc_uniscr_clear_lines(struct vc_data *vc, unsigned int y,
unsigned int nr)
{
- if (vc->vc_uni_lines)
- while (nr--)
- memset32(vc->vc_uni_lines[y++], ' ', vc->vc_cols);
-}
-
-/* juggling array rotation algorithm (complexity O(N), size complexity O(1))
Re: [gentoo-user] Emerge trouble with firefox and thunderbird ...
On Sunday, 10 March 2024 07:17:27 GMT Walter Dnes wrote: > So there are at least 2 people who've found out that Firefox can and > *MUST* be built with USE="-clang". Ah. I'll change my USE flag straight away. Thanks Walter. -- Regards, Peter.
Re: [gentoo-user] Emerge trouble with firefox and thunderbird ...
On Saturday, 9 March 2024 19:37:40 GMT Walter Dnes wrote: > On Sat, Mar 09, 2024 at 02:45:02PM +, Peter Humphr > The real question is what else, besides clang and its libraries, are you > building that requires clang? Firefox. -- Regards, Peter.
Re: [gentoo-user] Emerge trouble with firefox and thunderbird ...
On Saturday, 9 March 2024 12:49:33 GMT Walter Dnes wrote: > I have "-clang" in USE in make.conf and no problems resulting from it. > clang seems to be another "solution in search of a problem" along the > lines of rust and cups and systemd and hatbuzz, etc, which keep trying > to worm their way into everybody's linux system. When I tried USE=-clang emerge -uaDvN @world, I got this: [...] >>> Running pre-merge checks for sys-libs/compiler-rt-18.1.0 * Building using a compiler other than clang may result in broken atomics * library. Enable USE=clang unless you have a very good reason not to. Does the compiler-rt ebuild override USE in make.conf? -- Regards, Peter.
Re: [gentoo-user] Re: How to set up drive with many Linux distros?
On Tuesday, 27 February 2024 00:12:07 GMT Mark Knecht wrote: > I have no experience beyond three operating systems on a single machine > but if you grabbed just 2 or 3 USB flash drives then I would think you > could test it pretty easily. I believe the UEFI boot procedures are > storing a unique ID for the disk or the partition you are requesting. If you > have a unique ID that's different for each flash drive it would (hopefully) > find the one you're looking for which should be relatively simple. > > I would suggest you use the boot ordering feature and make the > system hard drive last in the list. If no USB devices are plugged in > it would default to your system drive. If a flash drive is plugged in > it should find its ID and boot that first. > > I do not know if, for instance, you had 20 different drives listed in > your BIOS whether it would be a lot slower to boot but you could > test that yourself. My experience is that the BIOS will discard any boot devices that are not present at the time of booting. I don't know whether that's typical or just what I've found. -- Regards, Peter.
Re: [gentoo-user] gui-libs/egl-wayland and x11-drivers/nvidia-drivers dependency conflict.
On Saturday, 17 February 2024 17:03:09 GMT Dale wrote: > Howdy, > > I posted about this once before but also included pipewire and others. > We addressed the other problems but this wasn't really fixed it would > seem. I found the old thread. This is what I get today. > > > WARNING: One or more updates/rebuilds have been skipped due to a > dependency conflict: > > gui-libs/egl-wayland:0 > > (gui-libs/egl-wayland-1.1.13:0/0::gentoo, ebuild scheduled for merge) > USE="" ABI_X86="(64)" conflicts with > ~gui-libs/egl-wayland-1.1.7 required by > (x11-drivers/nvidia-drivers-470.223.02:0/470::gentoo, installed) USE="X > modules strip tools wayland -dist-kernel -modules-compress -modules-sign > -persistenced -static-libs" ABI_X86="(64) -32" > ^ ^ > I do this in a Konsole and I tried changing the fonts. The little > things still point to places there is nothing or other wrong places. The ^ points to the ~ character above it, and the ^ points to 1.1.7, the version of egl-wayland, so the version you want to merge won't satisfy nvidia-drivers. Does that help? -- Regards, Peter.
Re: [gentoo-user] Help with local mail, please
On Friday, 16 February 2024 12:30:48 GMT J. Roeleveld wrote: > On Friday, February 16, 2024 6:19:25 AM CET Peter Humphrey wrote: > > On Wednesday, 14 February 2024 11:35:18 GMT J. Roeleveld wrote: > > > I've been using postfix for longer than I can remember. > > > The config entries I changed from default are: > > > > > > --- main.cf --- > > > myhostname = > > > mydomain = > > > myorigin = > > > mynetworks = > > 192.168.1.0/24> > > > > That's helpful - thanks Joost. > > You're welcome. Was this enough to get it working? I forgot to add that my system was already almost identical to yours, so I don't know whether to say yes or no. :) > > > smtpd_relay_restrictions = permit_mynetworks, permit_sasl_authenticated, reject_unauth_destination > > > > No relaying here; all outgoing mail goes to my ISP. > > If your mailserver (postfix) is sending emails to your ISP, that is (from > the viewpoint of postfix) relaying by definition. Er... outgoing mail doens't go through postfix at all; it goes direct from my KMail client to my ISP. > > > Also, are all emails sent to "mydomain" or do you have additional > > > domains configured? > > > If the latter, did you set "virtual_alias_domains = hash:/etc/postfix/ > > > virtual_domains" > > > Include all virtual domains the file and converted the file to a .db ? > > > > Just the one "mydomain" ...so no need to set any virtual domains. > If you have only 1 domain, keep that "virtual_alias_domains" empty. No such setting in my main.cf so I assume it's empty. Anyway, I looked at some of those mails that postfix was trying to forward, and they were old and unimportant, so I purged them. Let's see what other problems I've made for myself... :) -- Regards, Peter.
Re: [gentoo-user] Help with local mail, please
On Wednesday, 14 February 2024 11:35:18 GMT J. Roeleveld wrote: > I've been using postfix for longer than I can remember. > The config entries I changed from default are: > > --- main.cf --- > myhostname = > mydomain = > myorigin = > mynetworks = 192.168.1.0/24> That's helpful - thanks Joost. > smtpd_relay_restrictions = permit_mynetworks, permit_sasl_authenticated, > reject_unauth_destination No relaying here; all outgoing mail goes to my ISP. > Also, are all emails sent to "mydomain" or do you have additional domains > configured? > If the latter, did you set "virtual_alias_domains = hash:/etc/postfix/ > virtual_domains" > Include all virtual domains the file and converted the file to a .db ? Just the one "mydomain" -- Regards, Peter.
Re: [gentoo-user] Help with local mail, please
On Tuesday, 13 February 2024 17:20:40 GMT Arve Barsnes wrote: > I'm not sure I quite understood where you're having problems, but I > have a machine that accepts mail from the LAN through postfix, so I'll > show some of my setup. Replace any <> with your hostnames. > On the LAN machine I don't have postfix, I only send mail directly to > the machine with 'sendmail', but I found that I have in > /etc/mail/mailertable: > 192.168. smtp: > esmtp: > And in /etc/mail/local-host-names I have set - > maybe that does something, but I send mail directly with sendmail > either way. I think those entries must be for sendmail. > On the postfix machine I have in /etc/postfix/aliases: > root: arve > This should make all mail to root be delivered to me. Yes, I have root: prh, but postfix still tries to forward mail for root@ to instead of hanging on to it. > It also contains a bunch of aliases that I'm not sure if is necessary: > arve@ arve > arve@.lan arve > arve@.localdomain arve > arve@.lan arve I hadn't thought of doing that. When I tried it, postfix complained "Names must be local" and wouldn't accept my root@ entries. > In /etc/postfix/main.cf there is this, and I assume at least some of > this makes this all work: > myhostname = .lan > inet_interfaces = $myhostname, localhost > mydestination = $myhostname, localhost.$mydomain, localhost, Isn't the same as $myhostname? > mynetworks = 192.168.0.0/24, 127.0.0.0/8 I'll try setting mynetworks and see what happens. Thanks, Arve. -- Regards, Peter.
[gentoo-user] Help with local mail, please
Hello list, For years, I've been using postfix to accept mail from LAN hosts, and from the Internet via my ISP. This has never worked as I want it - it's just so complex to set up and understand. Well, it is for a bear of little brain like me. Can someone tell me how to make postfix accept all mail addressed to any host or user on the LAN - and not forward any mail to anywhere at all? It's running on a single-homed host on the LAN, and all other hosts are also single homed. Any of four hosts can originate mail, and I have fetchmail running on the same host to collect POP3 mail from my ISP. Dovecot serves IMAP4 to KMail clients on the LAN. At present, postfix is insisting on forwarding mail addressed to root on a LAN machine, but it's supposed to be acting on behalf of that machine. Two other hosts' mails never show up anywhere. Or perhaps there's a more suitable MTA out there? -- Regards, Peter.
Re: [gentoo-user] Re: Suggestions for backup scheme?
On Friday, 9 February 2024 15:48:45 GMT Wols Lists wrote: > ... And I'm not worried about a double failure - yes it could happen, > but ... > > Given that my brother's ex-employer was quite happily running a raid-6 > with maybe petabytes of data, over a double disk failure (until an > employee went into the data centre and said "what are those red > lights"), I don't think my 20TB of raid-5 is much :-) [OT - anecdote] I used to work in power generation and transmission (CEGB, for those with long memories), in which every system was required to be fault tolerant - one fault at a time. As Wol says, that's fine until your one fault has appeared and not been noticed. Then another fault appears - and the reactor shuts down! Carpeting comes next... Oh, frabjous day! [/OT] -- Regards, Peter.
Re: [gentoo-user] AMD microcode error?
On Sunday, 28 January 2024 17:39:56 GMT Michael wrote: > I'm not sure a microcode update has been released yet by AMD as a blob, > outside what they make available to MoBo OEMs within 'BIOS firmware' > updates. To find what's in the box use: > > dmesg | grep -i 'family:' > > Then check what CPU family and model microcodes the linux-firmware contains: > > https://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git/ > tree/amd-ucode/README No luck with those. > If you can't find your family and model in the above, then you could check > what firmware updates are available by the MoBo's OEM. These would include > microcode made directly available by AMD to the OEM. That's ASRock X570 Taichi. Their pages suggest that they only acknowledge Windows 10 & 11. I'll keep my eyes open for another glitch. Maybe the microcode isn't to blame at all, in which case I'd better not sleep on the job. Thanks for the pointers. -- Regards, Peter.
Re: [gentoo-user] AMD microcode error?
On Sunday, 28 January 2024 16:39:56 GMT I wrote: > Hits on the web suggest downgrading linux-firmware, which I've now done and > will await results. The latest upgrade was to version 20240115-r1, four days > ago. s/Hits/Hints/ -- Regards, Peter.
[gentoo-user] AMD microcode error?
Hello list, For the first time ever, I received an mce error today: [11473.528812] mce: [Hardware Error]: CPU 1: Machine Check: 0 Bank 14: 9090909090909090 [11473.529657] mce: [Hardware Error]: TSC 0 [11473.530146] mce: [Hardware Error]: PROCESSOR 2:a20f10 TIME 1706457141 SOCKET 0 APIC 2 microcode a201009 This is an AMD Ryzen M9 5900X. Hits on the web suggest downgrading linux-firmware, which I've now done and will await results. The latest upgrade was to version 20240115-r1, four days ago. Has anyone else experienced this? -- Regards, Peter.
Re: [gentoo-user] Gentoo-kernel 6.6 -- how to install?
On Saturday, 27 January 2024 16:10:40 GMT Alexander Puchmayr wrote: > Since now kernel 6.6 is stable, installation procedure seems to have > changed. > > I used to install it by > > emerge --config gentoo-kernel I don't know what that does. I run make oldconfig; make; make modules-install; make insstall. That's been my routine for years. > grub-mkconfig -o /boot/grub/grub.cfg I can't help with grub - sorry. > But grub does not find the kernel, since it is not installed in /boot's root > but in some uuid named sub directory. Sounds like you have sys-kernel/installkernel-systemd installed, instead of sys-kernel/installkernel. > Eselect news says for grub users, nothing changes, but actually it does not > work. I tried quite hard to follow the systemd way of installing kernels when installkernel was split recently, but I gave up in the end and reverted to my own way. For one thing, at boot time, the list of bootable kernels was far too verbose to be useful. For another, the method involved too much error-prone typing; not at all the unixy way. -- Regards, Peter.
Re: [gentoo-user] Soft scrolling on framebuffer consoles - with GPM handling - version of the patch for kernel 6.3 onwards.
On Wednesday, 24 January 2024 10:00:37 GMT Alan Mackenzie wrote: > I've adapted this patch for kernel 6.6.13. All of the parent post still > applies, with the exception of the version numbers. > > The main patch for the new kernel is 6.6.13-GPM.20240123.diff. > > Additionally I've attached a smaller patch which fixes what to me was a > little glitch in the gpm utility. This was that on a triple click to > select a whole line (or sequence of lines), the (last) line got a > linefeed appended to it. The effect was that if you wanted to hoik a > line out of some screen output and execute that from the bash command > line, you couldn't edit it first. So with this patch, you no longer get > that annoying linefeed, and the highlighting is adjusted accordingly. > This patch is (as far as I'm aware, without testing) independent of the > main GPM patch. Ever the star, Alan! -- Regards, Peter.
Re: [gentoo-user] Using binary packages
On Tuesday, 23 January 2024 16:12:05 GMT I wrote: --->8 > At the moment, the only way I can see to change portage's behaviour like > that is to keep editing FEATURES in make.conf. It's obvious, really: just pass FEATURES="-getbinpkg -binpkg-request-signature" to the emerge command. Or perhaps just the -getbinpkg will do; I haven't tried it. -- Regards, Peter.
[gentoo-user] Using binary packages
Hello list, The new ability to pull packages from Gentoo servers is useful [1]. It does require something close to neutral USE flags, though, as well as -march and - mtune. My little Celeron box only took 19 minutes (!) to fetch and install gcc, not the 23 hours it took before. I'd like to be able to tell portage to ignore the Gentoo packages in certain instances - something like half those 19 minutes were spent in checking the local indexes against the server's. And if I know I have a good local package, I don't want to have to go and make coffee or something while it goes through that checking process before ignoring the upstream packages. At the moment, the only way I can see to change portage's behaviour like that is to keep editing FEATURES in make.conf. -- Regards, Peter.
Re: [gentoo-user] Re: Dual Booting - selection from command line
On Wednesday, 17 January 2024 18:54:46 GMT the...@sys-concept.com wrote: > I'm not sure why "/EFI/REFIND/REFIND_X64.EFI" are all caps letters, in /boot > dir it is: "/EFI/refind/refind_x64.efi" Because it's a FAT partition? -- Regards, Peter.
Re: [gentoo-user] Dolphin and side pain not updating when mounting drives
On Tuesday, 9 January 2024 22:13:59 GMT Mark Knecht wrote: > On Tue, Jan 9, 2024 at 2:58 PM Dale wrote: > > > > One reason I was asking, if no one else was seeing this, I was going to > > reset my KDE config and get a fresh start. I haven't done that in a long > time > > > It's worth a try but it didn't help the one problem I've had with KDE for > maybe the last year or so. In my case I use the Virtual Desktops with 6 > desktops. I used to be able to leave apps open on different desktops - > terminals, browsers, etc., and when I shut down and restart the next day > they would still be on the virtual desktop that I left them on. Now they > all show up on Desk 1 and resetting my config didn't fix that. See https://bugs.kde.org/show_bug.cgi?id=471977 -- Regards, Peter.
Re: [gentoo-user] Genlop wonky again
On Sunday, 7 January 2024 08:34:15 GMT Wols Lists wrote: > Weird! I took a module on statistics in my Open University (Chemistry) > degree 40-odd years ago. Probably the same one? I've still got the > modules as a reference work, though I probably couldn't lay my hands on > them easily now ... Could have been the same. It was M100, the first version of their maths foundation course, in 1976. -- Regards, Peter.
Re: [gentoo-user] Emerge load again
On Sunday, 7 January 2024 00:54:12 GMT Adam Carter wrote: > > > So if it's consistently gcc that collapses to two threads, then > > > something (maybe explicit settings, maybe dependencies, maybe yadda > > > yadda) is telling make that only two jobs can run at the same time else > > > they'll trip over each other. > > > > > > Could be a dev has hard-coded the "two jobs" rule to make those random > > > crashes go away :-) Or maybe they found the problem, and that's why only > > > two jobs can run in parallel. > > > > Not so. As I said last time: 'if I set -distcc and -j12 -l12, I get 12 > > threads > > in parallel'. > > Have you checked you're not limiting jobs in /etc/distcc/hosts? ie no '/2' > after the IP address? $ cat /etc/distcc/hosts localhost/12 -- Regards, Peter.
Re: [gentoo-user] Genlop wonky again
On Saturday, 6 January 2024 19:28:05 GMT Wols Lists wrote: > Statistics is one of those areas where, if you don't know what you're > doing and you use the wrong maths, then you are going to get stupid results. > > "Statistics tell you how to get from A to B. What they don't tell you is > that you're all at C". I took a module on statistics in my Open University maths degree 40-odd years ago. I was bemused. They seemed to say that the subject was founded on two basic principles; then they proceeded to define each of them in terms of the other. I'm still waiting for the entire edifice to come crashing down around our ears. :) -- Regards, Peter.
Re: [gentoo-user] Emerge load again
On Saturday, 6 January 2024 19:31:59 GMT Wols Lists wrote: > On 06/01/2024 17:52, Peter Humphrey wrote: > >> In other cases, there may be a hundred separate tasks, make fires off a > >> hundred tasks shared amongst all the resource it can find, and sits back > >> and waits. > > > > And that's how the very first installation goes, with single-host distcc. > > Then, when it gets to gcc, it collapses to 2 threads and everything > > gained so far is lost many-fold. (I set USE=-fortran to avoid pointless > > recompilation, since nothing needs it here.) > > So if it's consistently gcc that collapses to two threads, then > something (maybe explicit settings, maybe dependencies, maybe yadda > yadda) is telling make that only two jobs can run at the same time else > they'll trip over each other. > > Could be a dev has hard-coded the "two jobs" rule to make those random > crashes go away :-) Or maybe they found the problem, and that's why only > two jobs can run in parallel. Not so. As I said last time: 'if I set -distcc and -j12 -l12, I get 12 threads in parallel'. -- Regards, Peter.
Re: [gentoo-user] Genlop wonky again
On Saturday, 6 January 2024 16:26:49 GMT Daniel Pielmeier wrote: > Am 5. Januar 2024 23:51:39 UTC schrieb Peter Humphrey : > >Hello list, > > > >I've just had some strange output from genlop on my 16-thread i5 box, thus: > > > ># genlop -t libreoffice | /bin/grep minute > > > > merge time: 37 minutes and 38 seconds. > > merge time: 52 minutes and 59 seconds. > > merge time: 46 minutes and 17 seconds. > > > ># genlop -c > > > > Currently merging 11 out of 11 > > > > * app-office/libreoffice-7.5.9.2 > > > > current merge time: 4 minutes and 3 seconds. > > ETA: 1 hour, 4 minutes and 24 seconds. > > > >### Then, once the update finished: > > > ># genlop -t libreoffice | /bin/grep minute > > > > merge time: 37 minutes and 38 seconds. > > merge time: 52 minutes and 59 seconds. > > merge time: 46 minutes and 17 seconds. > > merge time: 38 minutes and 40 seconds. > > > >I know genlop is, shall we say, not perfect, but how can it be so grossly > >wrong as that? > > > >I have this in make.conf, and it hasn't changed since I built the machine: > > > >grep '\-j' /etc/portage/make.conf > >EMERGE_DEFAULT_OPTS="--jobs --load-average=12 > >MAKEOPTS="-j12 -l12" > > There are not by chance binary merges which took less than a minute? That > might explain the differences. That would skew the prediction downwards, not up. > What is the output wihout the grep or filtering by merge time instead. The same. -- Regards, Peter.
Re: [gentoo-user] Genlop wonky again
On Saturday, 6 January 2024 16:21:30 GMT Wols Lists wrote: > ... it's nothing to do with more power or whatever, it's down to simple > statistics. If genloop guesses the statistical spread wrongly, it's > going to mess up its estimates. Aren't you exaggerating genlop's complexity? I wasn't aware of any use of statistics in it, other than a simple arithmetic mean to estimate the time remaining. It certainly seems to do that, anyway. > If you have a double-peak distribution, with a large short-lived peak, > and a small long-lived peak, you can get some weird results, especially > if you have assumed a bell curve (almost always wrong) or an exponential > decay (which is generally, NOT ALWAYS, a good choice). I doubt it does any of that. -- Regards, Peter.
Re: [gentoo-user] Emerge load again
On Saturday, 6 January 2024 15:28:53 GMT Wols Lists wrote: > As far as I'm aware, there's no mystery. On a single machine you get the > exact same thing ... it's all down to parallelism. > > Make asks itself "how many separate tasks can I do at the same time, > which won't interfere with each other". In gcc's case, the answer > appears to be two. It doesn't matter how much resource is available, > make can only make use of two cores. Yet, if I set -distcc and -j12 -l12, I get 12 threads in parallel. That's the mystery. > In other cases, there may be a hundred separate tasks, make fires off a > hundred tasks shared amongst all the resource it can find, and sits back > and waits. And that's how the very first installation goes, with single-host distcc. Then, when it gets to gcc, it collapses to 2 threads and everything gained so far is lost many-fold. (I set USE=-fortran to avoid pointless recompilation, since nothing needs it here.) > Think of a hundred compile jobs all running at the same time, but then > the linker is invoked, and you can only have the one linker running, > after all the compile jobs have finished. I hadn't thought of that - another thing to consider. > And this is a HARD problem, I haven't seen it recently, but there used > to be plenty of threads about hard-to-debug compile failures that went > away with -j1. The obvious cause was two compile jobs being set off in > parallel, when in reality one depended on the other, and things messed up. I haven't either - seen it recently. -- Regards, Peter.
Re: [gentoo-user] Emerge load again
On Saturday, 6 January 2024 11:44:20 GMT Michael wrote: > On Wednesday, 29 November 2023 12:06:15 GMT Peter Humphreey wrote: > > On Wednesday, 29 November 2023 10:26:36 GMT Michael wrote: > > > Here's my hypothesis explaining your own observation with libreoffice. > > > As > > > a package or more finished emerging, libreoffice's turn comes up. Soon > > > libreoffice starts to execute make jobs, but any of the following may > > > apply: > > > > > > 1. There are only 4 out of 30 jobs available, because other packages are > > > already using 26, throughout your window of observation. > > > > Nope. Nothing else in progress. > > > > > 2. Libreoffice sequencing of make jobs is mostly linear with succeeding > > > make jobs waiting on output from their predecessors. > > > > That's possible, but it doesn't seem likely with such a huge code base. > > And > > why four processes, specifically and consistently? > > > > > 3. Libreoffice source code is not optimised for high parallelism - I > > > recall > > > when it was hardcoded at -j1 just a few years ago. Before this > > > restriction > > > was added, any bug reporters were advised to try again after limiting > > > make > > > to -j1. > > > > Yes, that was common to many packages for a long time because of > > incomplete > > optimisation. > > > > > Next time I'm building libreoffice on a beefier system I'll keep an eye > > > out > > > for the number of jobs to see what it gets up to. > > > > That would help, yes. > > OK, I eventually got around to it. I am observing right now LO is building > with as many as 24 jobs: > > top - 11:14:59 up 2:19, 2 users, load average: 24.46, 23.15, 9.51 > Tasks: 474 total, 25 running, 449 sleeping, 0 stopped, 0 zombie > %Cpu(s): 0.2 us, 5.6 sy, 94.0 ni, 0.2 id, 0.0 wa, 0.0 hi, 0.0 si, 0.0 > st > MiB Mem : 64217.1 total, 50028.6 free, 6233.7 used, 7954.9 buff/cache > MiB Swap: 0.0 total, 0.0 free, 0.0 used. 54333.4 avail Mem > > I don't use distcc. The make -j25 -l24.8 I have specified is respected. Interesting. Thanks. > > The contribution of distcc isn't clear to me yet, as I said before. > > Sometimes it's the bee's knees; other times it might just as well not be > > there. I don't like mysteries... :) I've decided to ditch distcc altogether. During the very first build, what it grants with one hand it takes away double with the other - lots of tiny jobs all started together, but then gcc is sompiled with just two threads. That just-two happens on at least two different machines (not just separate; different). The position is no better in regular maintenance: no matter how many /make/ tasks are needed, I get just two threads compiling at a time. (I'm referring to the single-host arrangement I mentioned at the start.) I'm baffled, and I don't like it; I much prefer understanding to mystery. -- Regards, Peter.
[gentoo-user] Genlop wonky again
Hello list, I've just had some strange output from genlop on my 16-thread i5 box, thus: # genlop -t libreoffice | /bin/grep minute merge time: 37 minutes and 38 seconds. merge time: 52 minutes and 59 seconds. merge time: 46 minutes and 17 seconds. # genlop -c Currently merging 11 out of 11 * app-office/libreoffice-7.5.9.2 current merge time: 4 minutes and 3 seconds. ETA: 1 hour, 4 minutes and 24 seconds. ### Then, once the update finished: # genlop -t libreoffice | /bin/grep minute merge time: 37 minutes and 38 seconds. merge time: 52 minutes and 59 seconds. merge time: 46 minutes and 17 seconds. merge time: 38 minutes and 40 seconds. I know genlop is, shall we say, not perfect, but how can it be so grossly wrong as that? I have this in make.conf, and it hasn't changed since I built the machine: grep '\-j' /etc/portage/make.conf EMERGE_DEFAULT_OPTS="--jobs --load-average=12 MAKEOPTS="-j12 -l12" -- Regards, Peter.
Re: [gentoo-user] LiveGUI USB Image
On Thursday, 4 January 2024 02:48:13 GMT Adam Carter wrote: > > > dd if=/path/to/iso-image of=/dev/sd? bs=4M status=progress > > > > > > Replace the obvious bits. > > > > I've tried a few values of block size over the years, but so far I haven't > > noticed any difference. I haven't run any proper tests though. > > I think it's just that the default blocksize is (or was) very small (512 > bytes?) so setting it to anything non-small helps a lot. > > eg one example (from > https://superuser.com/questions/234199/good-block-size-for-disk-cloning-with > -diskdump-dd#234204) seems to show that most gains are in by around 16k. > There's probably a lot of testing noise in these results. > > $ ./dd_obs_test.sh > block size : transfer rate >512 : 11.3 MB/s > 1024 : 22.1 MB/s > 2048 : 42.3 MB/s > 4096 : 75.2 MB/s > 8192 : 90.7 MB/s > 16384 : 101 MB/s > 32768 : 104 MB/s > 65536 : 108 MB/s > 131072 : 113 MB/s > 262144 : 112 MB/s > 524288 : 133 MB/s >1048576 : 125 MB/s >2097152 : 113 MB/s >4194304 : 106 MB/s >8388608 : 107 MB/s > 16777216 : 110 MB/s > 33554432 : 119 MB/s > 67108864 : 134 MB/s Interesting. I think I'll stick to my usual 64MB block size. -- Regards, Peter.
Re: [gentoo-user] emerge -c being strange
On Saturday, 30 December 2023 21:10:10 GMT Jack wrote: > I have both wine-vanilla 8.0.2 (stable) and 8.1.2 (testing) installed. > "emerge -c wine-vanilla" would remove both of them. "emerge -c > wine-vanilla:8.21" refuses, claiming > > app-emulation/wine-vanilla-8.21 pulled in by: > virtual/wine-0-r10 requires > app-emulation/wine-vanilla[abi_x86_32,abi_x86_64] > > Although it is perfectly happy with "emerge -c wine-vanilla:8.0.2". > > Is this a bug, or is it considered reasonable for portage to have a > virtual absolutely insist on keeping the newest installed version if > several slots are available? No, it's how it's supposed to work. Portage removed one version of wine because the virtual was still satisfied. It wouldn't remove the last remaining version: you need to uninstall the virtual first. -- Regards, Peter.
Re: [gentoo-user] LiveGUI USB Image
On Saturday, 30 December 2023 21:41:40 GMT Dale wrote: > hitachi303 wrote: > > long time since I needed something to boot the pc. I see there is a > > LiveGUI USB Image to download but the handbook does not mention it. > > How to get a bootable USB stick? > > You can get it here: > > https://www.gentoo.org/downloads/ > > I suspect most just use dd to put the iso on the stick. I've alwas done that too, until I bought this new NUC i5, which wouldn't boot from any of my USB sticks. I had to use an app to make the transfer to USB. I forget what it was now. Nel B. can explain about ISO images and booting. --->8 > If you plan to use dd, this is the command I have in my notes. > > dd if=/path/to/iso-image of=/dev/sd? bs=4M status=progress > > Replace the obvious bits. I've tried a few values of block size over the years, but so far I haven't noticed any difference. I haven't run any proper tests though. -- Regards, Peter.
Re: [gentoo-user] Boot and EFI partitions
On Thursday, 7 December 2023 11:51:10 GMT I wrote: > On Wednesday, 6 December 2023 17:34:08 GMT Marco Rebhan wrote: > > No, you do not need an XBOOTLDR partition with systemd-boot and in fact I > > have never used one, and I'm not sure why the guide advertises it so > > prominently. > > I haven't either, as I said, but this is a new venture so I went to the > official guides, wanting to Do The Right Thing. That's where the > contradiction exists. At the time I started this thread I hadn't reached the fstab creation, so I did that and now I do get a kernel in /boot, but it's just called 'linux' (I think - I dismounted and unplugged the USB disk I was transferring the output below to this machine and the NUC promptly shut itself down. It's quite a business getting it up again.) Anyway, 'make install' gives the folowing output: INSTALL /boot <--- New machine ID '49eccff7c02e4fa38053e7140fd90a5a' generated. Found cgroup2 on /sys/fs/cgroup/, full unified hierarchy Found container virtualization none. Using XBOOTLDR partition at /boot as $BOOT_ROOT. Using entry token: gentoo kernel version (6.1.57-gentoo) set via command line. kernel image file (/usr/src/linux-6.1.57-gentoo/arch/x86/boot/bzImage) set via command line. /boot/gentoo exists, using layout=bls. Using ENTRY_DIR=/boot/gentoo/6.1.57-gentoo mkdir -p /boot/gentoo/6.1.57-gentoo Using plugins: /usr/lib/kernel/install.d/00-00machineid-directory.install /usr/lib/kernel/install.d/50-depmod.install /usr/lib/kernel/install.d/90-loaderentry.install /usr/lib/kernel/install.d/90-uki-copy.install Plugin environment: LC_COLLATE=C.UTF-8 KERNEL_INSTALL_VERBOSE=1 KERNEL_INSTALL_IMAGE_TYPE=pe KERNEL_INSTALL_MACHINE_ID=49eccff7c02e4fa38053e7140fd90a5a KERNEL_INSTALL_ENTRY_TOKEN=gentoo KERNEL_INSTALL_BOOT_ROOT=/boot KERNEL_INSTALL_LAYOUT=bls KERNEL_INSTALL_INITRD_GENERATOR= KERNEL_INSTALL_UKI_GENERATOR= KERNEL_INSTALL_STAGING_AREA=/tmp/kernel-install.staging.30L75M Plugin arguments: add 6.1.57-gentoo /boot/gentoo/6.1.57-gentoo /usr/src/ linux-6.1.57-gentoo/arch/x86/boot/bzImage Successfully forked off '(sd-executor)' as PID 71429. Successfully forked off '(direxec)' as PID 71430. /usr/lib/kernel/install.d/00-00machineid-directory.install succeeded. Successfully forked off '(direxec)' as PID 71431. +depmod -a 6.1.57-gentoo<--- /usr/lib/kernel/install.d/50-depmod.install succeeded. Successfully forked off '(direxec)' as PID 71432. Creating /boot/loader/entries/gentoo-6.1.57-gentoo.conf <--- /usr/lib/kernel/install.d/90-loaderentry.install succeeded. Successfully forked off '(direxec)' as PID 71441. /usr/lib/kernel/install.d/90-uki-copy.install succeeded. (sd-executor) succeeded. Only three of those lines are in the standard white (on black background); I've marked them with pointers. The others are in grey. That's new to me. In fact, all that output from 'make install' is new. I now need to get the kernel name to include the version and the local version; then I'll be able to show a menu of options at boot time, as on my other machines. -- Regards, Peter.
Re: [gentoo-user] Boot and EFI partitions
On Wednesday, 6 December 2023 17:34:08 GMT Marco Rebhan wrote: > On Wednesday, 6 December 2023 17:49:43 CET Victor Ivanov wrote: > > So, without knowing much about systemd-boot from the guide linked it > > seems to me that its implementation doesn't differ too much from this > > reasonably well established model, except for a few additional > > constraints which, based on my understanding, are: > > 1. You _must_ have an XBOOTLDR partition (functionally equivalent to > > "boot" above) _in addition to_ the ESP and cannot simply use "/boot" > > under your rootfs partition > > 2. XBOOTLDR partition _must_ be of GPT type 0xEA00 > > 3. XBOOTLDR partition _must_ have GUID set to > > "bc13c2ff-59e6-4262-a352-b275fd6f7172" > > 4. XBOOTLDR partition _must_ be formatted with a filesystem supported > > by your EFI BIOS with FAT32 being universally supported, though your > > particular EFI BIOS _might_ support others > > > > I say "must" as it appears to be from the guide like this is the > > requirement for systemd-boot, the actual Boot Loader Specification > > page appears to suggest that an XBOOTLDR partition is optional. So > > there may be a viable configuration without it. > > No, you do not need an XBOOTLDR partition with systemd-boot and in fact I > have never used one, and I'm not sure why the guide advertises it so > prominently. I haven't either, as I said, but this is a new venture so I went to the official guides, wanting to Do The Right Thing. That's where the contradiction exists. -- Regards, Peter.
Re: [gentoo-user] New installation - not booting
On Wednesday, 6 December 2023 18:47:43 GMT Wols Lists wrote: > On 06/12/2023 14:56, Peter Humphreey wrote: > > The idea is that you may want to install another system later, which may > > want to install its own code in /efi. By all means shrink it if you think > > that's unlikely and you need the space. Gparted on SysRescCD is ideal for > > this. > I had the opposite problem - Windows created a tiny EFI partition and I > couldn't install linux ... ...and you couldn't enlarge the partition because Windows then wouldn't boot! -- Regards, Peter.
Re: [gentoo-user] Emerge -K ignoring new packages
On Tuesday, 21 November 2023 08:24:31 GMT Neil Bothwick wrote: > On Tue, 21 Nov 2023 03:24:20 +0000, Peter Humphrey wrote: > > > Default location for binary packages is /var/cache/binpkgs/ > > > > Oh? When did that change? > > It may not have on your system. To check the location, run > > portageq pkgdir I know where it is because I set it to the recommended place when portage was moved out of /usr. I just wondered when, and why, it had been changed. It will stay where it is, here, if only because 'binpkgs' is harder to type than 'packages'. -- Regards, Peter.
Re: [gentoo-user] Emerge -K ignoring new packages
On Monday, 20 November 2023 17:12:04 GMT Vitaliy Perekhovy wrote: > On Mon, Nov 20, 2023 at 05:07:45PM +0000, Peter Humphrey wrote: > > Hello list, > > > > Now that I have my NFS set up (with help - thanks) the next problem is > > that, having new packages built by my workstation over NFS, emerge on the > > tiny box is ignoring all those new packages. And yes, I have checked that > > they do exist, and in the right place: /var/cache/packages/ . > > > > The man page says that any new package will cause a remerge, so what has > > tripped me up this time? > > Default location for binary packages is /var/cache/binpkgs/ Oh? When did that change? -- Regards, Peter.
[gentoo-user] Emerge -K ignoring new packages
Hello list, Now that I have my NFS set up (with help - thanks) the next problem is that, having new packages built by my workstation over NFS, emerge on the tiny box is ignoring all those new packages. And yes, I have checked that they do exist, and in the right place: /var/cache/packages/ . The man page says that any new package will cause a remerge, so what has tripped me up this time? -- Regards, Peter.
Re: [gentoo-user] Re: Debugging NFS mounts
On Sunday, 19 November 2023 15:59:37 GMT Remy Blank wrote: > Peter Humphrey wrote on 19.11.2023 16:12: > > Yes, indeed. In fact I don't know why this has only just bitten me; I've > > been doing the same thing for years without problem. > > > > That search turns up so many answers that I don't know where to start, > > even > > prefixing the phrase with "gentoo". Most of them seem to date from 10 > > years ago or more. > > You need to configure two files. Add a *.conf file below /etc/sysctl.d with > the following content: > > # Set fixed ports for lockd. > fs.nfs.nlm_tcpport = 4014 > fs.nfs.nlm_udpport = 4014 > > Then set some options in /etc/conf.d/nfs. Here's my config, the -p options > configure the ports of various NFS services. > > # /etc/conf.d/nfs > > # If you wish to set the port numbers for lockd, > # please see /etc/sysctl.conf > > # Optional services to include in default `/etc/init.d/nfs start` > # For NFSv4 users, you'll want to add "rpc.idmapd" here. > NFS_NEEDED_SERVICES="rpc.idmapd" > > # Options to pass to rpc.nfsd > OPTS_RPC_NFSD="8 -s -V 3 -N 4" > > # Options to pass to rpc.mountd > # ex. OPTS_RPC_MOUNTD="-p 32767" > OPTS_RPC_MOUNTD="-p 4010 --manage-gids" > > # Options to pass to rpc.statd > # ex. OPTS_RPC_STATD="-p 32765 -o 32766" > OPTS_RPC_STATD="-p 4011 -o 4012" > > # Options to pass to rpc.idmapd > OPTS_RPC_IDMAPD="" > > # Options to pass to rpc.gssd > OPTS_RPC_GSSD="" > > # Options to pass to rpc.svcgssd > OPTS_RPC_SVCGSSD="" > > # Options to pass to rpc.rquotad (requires sys-fs/quota) > OPTS_RPC_RQUOTAD="-p 4013" > > # Timeout (in seconds) for exportfs > EXPORTFS_TIMEOUT=30 > > # Options to set in the nfsd filesystem (/proc/fs/nfsd/). > # Format is =. Multiple options are allowed. > #OPTS_NFSD="nfsv4leasetime=30 max_block_size=4096" > > > Then you need to allow ports 111 (TCP + UDP), 2049 (TCP) and 4010:4014 (TCP > + UDP) through your firewall. I'm not entirely sure about TCP vs. UDP, you > might be able to remove some of them (it has been a while that I configured > this). You can pick different port number than 4010:4014 if you like. That's a great help. Thank you Remy. -- Regards, Peter.
Re: [gentoo-user] Debugging NFS mounts
On Sunday, 19 November 2023 00:30:24 GMT William Kenworthy wrote: > On 18/11/23 15:29, Peter Humphrey wrote: > > On Friday, 17 November 2023 16:44:29 GMT I wrote: > >> I'll try that - thanks. > > > > Damn fool - it was a firewall problem on the server. For some reason, the > > NFS destination port has changed. > > > > Sorry for the noise. > > Actually, NFS may have some ports dynamicly allocated so they change on > reboot. Google "pin NFS ports" for how to fix them for firewalls. Yes, indeed. In fact I don't know why this has only just bitten me; I've been doing the same thing for years without problem. That search turns up so many answers that I don't know where to start, even prefixing the phrase with "gentoo". Most of them seem to date from 10 years ago or more. -- Regards, Peter.
Re: [gentoo-user] Debugging NFS mounts
On Friday, 17 November 2023 16:44:29 GMT I wrote: > I'll try that - thanks. Damn fool - it was a firewall problem on the server. For some reason, the NFS destination port has changed. Sorry for the noise. -- Regards, Peter.
Re: [gentoo-user] Debugging NFS mounts
On Thursday, 16 November 2023 20:38:45 GMT Marco Rebhan wrote: > On Wednesday, 15 November 2023 17:29:19 CET Peter Humphrey wrote: > > Hello list, > > > > My little server needs help with compiling, so I NFS-export /var (which > > has > > its own partition) to a chroot on my workstation. I mount all the > > partitions on both server and workstation. Then when I chroot, env-update > > hangs for ever. Well, over an hour anyway. > > > > Is it possible to export /var in this way? I can't see anything else > > wrong. > > I don't see why it shouldn't work, but there's a couple commands I use to > debug NFS. They're not *great*, but they work. > > I haven't used Gentoo in a while so I forget exactly what env-update does, > but I assume mounting the network share works successfully and this is just > a command that accesses /var. > > You can use these commands to make the kernel driver output debugging > information to dmesg. > > On the client: > > # rpcdebug -m nfs -s all > > On the server: > > # rpcdebug -m nfsd -s all > > On both sides, if the others don't give useful info, this is for the lower > > level protocol: > > # rpcdebug -m rpc -s all > > Then, try running the command again. It will spew a lot of info but > hopefully you can figure out from it what's going on. I'll try that - thanks. -- Regards, Peter.
Re: [gentoo-user] Debugging NFS mounts
On Wednesday, 15 November 2023 17:04:27 GMT Alan McKinnon wrote: > On Wed, Nov 15, 2023 at 6:29 PM Peter Humphrey > > wrote: > > Hello list, > > > > My little server needs help with compiling, so I NFS-export /var (which > > has > > its own partition) to a chroot on my workstation. I mount all the > > partitions > > on both server and workstation. Then when I chroot, env-update hangs for > > ever. > > Well, over an hour anyway. > > > > Is it possible to export /var in this way? I can't see anything else > > wrong. > > Did you run mount inside the chroot or outside of it? Outside. That's how it's worked everywhere else. -- Regards, Peter.
[gentoo-user] Debugging NFS mounts
Hello list, My little server needs help with compiling, so I NFS-export /var (which has its own partition) to a chroot on my workstation. I mount all the partitions on both server and workstation. Then when I chroot, env-update hangs for ever. Well, over an hour anyway. Is it possible to export /var in this way? I can't see anything else wrong. -- Regards, Peter.
[gentoo-user] What's happening to dev-cpp/abseil-cpp?
Hello list,
This package[1] has see-sawed up and down several times recently, causing
recompilation of libreoffice each time. What's going on?
$ genlop libreoffice
* acct-group/libreoffice
Sat Sep 2 00:35:00 2023 >>> app-office/libreoffice-7.5.5.2
Sat Sep 2 12:45:06 2023 >>> app-office/libreoffice-7.5.5.2
Sun Sep 3 17:22:11 2023 >>> app-office/libreoffice-7.5.5.2
Mon Oct 9 17:30:59 2023 >>> app-office/libreoffice-7.5.5.2
Mon Oct 16 13:18:07 2023 >>> app-office/libreoffice-7.5.5.2
Wed Oct 18 13:35:13 2023 >>> app-office/libreoffice-7.5.5.2
Thu Oct 19 13:21:58 2023 >>> app-office/libreoffice-7.5.5.2
1. dev-cpp/abseil-cpp (20230125.2(0/20230125){xpak:2}): Abseil Common
Libraries (C++), LTS Branch
--
Regards,
Peter.
Re: [gentoo-user] Re: OFF TOPIC Need Ubuntu network help: boot loader info
On Thursday, 19 October 2023 12:59:06 BST Neil Bothwick wrote: > Incidentally, systemd-boot can also generate and update boot menu entries > automatically with "bootctl install" and "bootctl update" although I have > never tried either. Yes, that's what I use. Once your kernel is complete, with ramdisk etc., make a copy of /boot somewhere, then "bootctl install", copy the loader.conf from your copy, then "bootctl update". Older versions of bootctl used to create a /boot// directory, where nn was a 32-digit hex number, in which we were supposed to put our boot entries: far too complex for Gentoo, so I just deleted that directory. -- Regards, Peter.
Re: [gentoo-user] Re: OFF TOPIC Need Ubuntu network help
On Thursday, 19 October 2023 00:06:43 BST Neil Bothwick wrote: > If you like simple, here is a config file I use with systemd-boot > > version 6.1.57-gentoo > linux /vmlinuz-6.1.57-gentoo > options root=/dev/sda3 panic=10 net.ifnames=0 i915.enable_ips=0 > > That's it! There is a separate file for each menu entry, but they are > this simple. There's also a global loader.conf, that runs to a massive 2 > lines here! Just to expand this in case it helps someone, and because the wiki article on systemd-boot is not very helpful: I like to keep one recent kernel along with the current one, as fallback. I also have a small rescue partition on the same disk, and that also has two kernels. The main system has a choice of three boot options: standard, no X and no network, and the rescue system the same but without the no-X. That gives the following structure on this machine: # ls -1 /boot/v* /boot/vmlinuz-6.1.46-gentoo /boot/vmlinuz-6.1.46-gentoo-rescue /boot/vmlinuz-6.1.57-gentoo /boot/vmlinuz-6.1.57-gentoo-rescue # tree -L 3 /boot/loader /boot/loader ├── entries │ ├── 06-gentoo-rescue-6.1.46.conf │ ├── 07-gentoo-rescue-6.1.46.nonet.conf │ ├── 08-gentoo-rescue-6.1.46.conf │ ├── 09-gentoo-rescue-6.1.46.nonet.conf │ ├── 30-gentoo-6.1.57.conf │ ├── 32-gentoo-6.1.57.nox.conf │ ├── 34-gentoo-6.1.57.nonet.conf │ ├── 40-gentoo-6.1.46.conf │ ├── 42-gentoo-6.1.46.nox.conf │ └── 44-gentoo-6.1.46.nonet.conf ├── loader.conf └── random-seed The random seed was put there by systemd-boot. I think I have most eventualities covered. (Hah!) -- Regards, Peter.
[OT] Re: [gentoo-user] OFF TOPIC Need Ubuntu network help
On Tuesday, 17 October 2023 17:41:23 BST Dale wrote: > Maybe some color coding would help??? Not only that, but judicious use of colour would help a great deal. Having everything in monochrome is no help at all. Neither is showing a numbered list of contents but no sign of the numbers in the text, so that the ranking of headings and subheadings is lost. I've tried to raise a bugzilla entry on this but was rebuffed. -- Regards, Peter.
Re: [gentoo-user] google SMTP with postfix - Password not accepted
On Sunday, 15 October 2023 03:43:00 BST William Kenworthy wrote: > On 14/10/23 21:28, Peter Humphrey wrote: > > On Saturday, 14 October 2023 12:26:29 BST I wrote: > >> Perhaps I should switch to getmail... > > > > On the other hand, I'd prefer to stick with fetchmail for my Zen POP3 > > account, since it's working well. Then I could use getmail to fetch my > > gmail mail. Would that be safe? > > > > If it works I could move Zen mail to getmail later, at my leisure. > > (That's the only sort of time I have these days... :( ) > > getmail works fine with gmail - just follow their instructions to configure. I'm sure it does - just not for me. I've followed Google's instructions to the letter, but still no joy. -- Regards, Peter.
Re: [gentoo-user] google SMTP with postfix - Password not accepted
On Sunday, 15 October 2023 10:45:45 BST Michael wrote: > The workarounds I have devised are: > > 1. Close Kmail, restart it and keep an eye on the progress bar to confirm it > has finished synchronizing all folders with remote IMAP servers, before I > click on anything else. > > 2. If the above does not succeed I close Kmail and run 'akonadictl stop', > before I restart it. > > 3. If the problem is not resolved, I repeat step 2 above and proceed to run: Yes, I did allow plenty of time for synchronising - hours, in fact. > akonadictl start > akonadictl fsck (wait for it to finish) > akonadi vacuum (wait for it to finish) I didn't think of that. > then relaunch Kmail. > > 4. A last resort is to launch akonadiconsole, go to the Browser tab and > delete any messages there. > > I anyone knows of a better solution, other than trying alternative mail > clients, please post back. -- Regards, Peter.
Re: [gentoo-user] google SMTP with postfix - Password not accepted
On Saturday, 14 October 2023 12:26:29 BST I wrote: > Perhaps I should switch to getmail... On the other hand, I'd prefer to stick with fetchmail for my Zen POP3 account, since it's working well. Then I could use getmail to fetch my gmail mail. Would that be safe? If it works I could move Zen mail to getmail later, at my leisure. (That's the only sort of time I have these days... :( ) -- Regards, Peter.
Re: [gentoo-user] google SMTP with postfix - Password not accepted
On Saturday, 14 October 2023 08:04:27 BST Neil Bothwick wrote: > I use this getmail config for GMail. It uses procmail to deliver to > Docecot, but it should work as a starting point for you. ---<8 Thanks for the help, Neil. Until now I've been using fetchmail, but I can't find any help in using it, and this entry in /etc/fetchmailrc fails with a permission error: poll pop.gmail.com proto pop3, user ".gmail.com", with password "", is "prh" here, ssl, dropdelivered, fetchall, no keep; I also tried setting up a gmail IMAP source in KMail, and that worked so I assume the permissions are right at their end. (I removed the account when KMail kept resurrecting scores of mails I'd already deleted, even though access on my mobile showed an absence of mails.) Perhaps I should switch to getmail... -- Regards, Peter.
Re: [gentoo-user] google SMTP with postfix - Password not accepted
On Tuesday, 20 June 2023 09:55:10 BST William Kenworthy wrote: > getmail can facilitate getting googlemail into postfix. In my case, it > fetches an mail then invokes sendemail to forward into postfix. The > docs for the google side of the equation are quite good. Coming to this after a while, can you point me to the one that helps, please? I've had a look round but I haven't found anything helpful. Thanks. -- Regards, Peter.
Re: [gentoo-user] Soft scrolling on framebuffer consoles - with GPM handling - version of the patch for kernel 6.3 onwards.
On Wednesday, 4 October 2023 14:16:44 BST Alan Mackenzie wrote: > Hello, Gentoo. > > On Fri, Feb 03, 2023 at 18:56:27 +, Alan Mackenzie wrote: > > The topic of this post is my kernel patch which enables soft scrolling > on Linux tty's with and , and also enables > the GPM mouse utility on those scrolled regions. > > Currently, the patch I posted some months ago works on all 6.1.x > kernels, and very likely works on 6.2.x, too. In kernel 6.3.1, some > significant refactoring was done by the kernel people, necessitating a > new version of the patch, called 6.3.11-GPM.20231004.diff. I've tested > this on 6.3.11 and 6.5.5. > > Just a quick reminder of how to use these files for anybody else who > might be interested: > (i) cd /usr/src/linux-6.3.11-gentoo, or similar. (Or ...-6.1.x-gentoo). > (ii) patch -p1 < 6.3.11-GPM.20231004.diff (or the other one). > (iii) Configure the kernel as normal. Additionally, under Device > drivers/Graphic Support/Console display driver support, enable > CONFIG_FRAMEBUFFER_CONSOLE_SOFT_SCROLLBACK, set the buffer size to taste > (it's default is 128 kB) and accept the default enablement of > CONFIG_FRAMEBUFFER_CONSOLE_SOFT_SCROLLBACK_GPM. > (iv) Build the kernel and install it into your boot manager. > (v) Reboot and enjoy! You can now use GPM in scrolled consoles. > > Just a warning: if you copy your kernel .config from a 6.1.x kernel, and > use make oldconfig to generate a new kernel for 6.3.x etc., you will > have to enable CONFIG_HID_SUPPORT, otherwise your USB keyboard and mouse > will be dead on bootup. ;-( > > The usual disclaimers apply, here. If this patch breaks anything for > you, you get to join the pieces back together again. But if this does > happen, please let me know, so that I can try to fix the bug. My only > promise is that there's nothing malicious in the patch. > > As well as 6.3.11-GPM.20231004.diff, I'm reposting > 6.1.8-GPM.20230203.diff for anybody new here who wants to try it on the > current Gentoo 6.1.x kernel. Many thanks again Alan. What a stalwart you are! -- Regards, Peter.
Re: [gentoo-user] Unwanted fonts
On Monday, 2 October 2023 15:35:18 BST Michael wrote: > Noto and Hack media-fonts are listed as reverse dependencies for kde-plasma/ > plasma-integration. With no USE flag to exclude them being available at > present, the package.provided solution can be used. Reverse? Plasma-integration depends on those fonts, not the other way round. -- Regards, Peter.
Re: [gentoo-user] Unwanted fonts
On Monday, 2 October 2023 15:33:13 BST Cara Salter wrote: > Could you add ">media-fonts/noto-20220912" to package.mask? That (by my > understanding) would keep new versions from being installed. Yes, I've done that, and now it should blow up in my face when I try to upgrade noto to the next version. Better than quietly ignoring me, as it were... -- Regards, Peter.
Re: [gentoo-user] Unwanted fonts
On Monday, 2 October 2023 12:38:02 BST Arve Barsnes wrote: > If they're actually not in use, try package.provided. > > # echo "media-fonts/noto" >> /etc/portage/profile/package.provided > # emerge -C media-fonts/noto Ah! Good idea, though I had to give a version as well: # cat /etc/portage/profile/package.provided media-fonts/noto-20220912 That means I'll be tripped up at the next noto update. Thanks for the idea though. -- Regards, Peter.
[gentoo-user] Unwanted fonts
Hello list, Has anyone found a way to exclude media-fonts/noto from a Plasma system? They're a 1GB download and I have no intention of ever using them - DejaVu suits me perfectly. -- Regards, Peter.
Re: [gentoo-user] Switching from desktop to desktop without function keys.
On Sunday, 1 October 2023 01:17:12 BST Dale wrote: > I found it. Kwin was the key I was missing. Yes, I had to search for it too. > I did check the wrap around, it was already set to wrap. Still, now I know > it will since I checked it. > > This is going to help a lot when the plasma thing decides to take a > short nap. I suspect that if I reset to a blank KDE config and started > over, it would work like it should. It's been a few years since I did > that and I really need to give it a fresh start. To be honest, it might > fix a few quirks I'm seeing at times. Well, what with switching between stable and testing systems from time to time, I do it fairly often - create a new user account, that is. The process has become much easier since I started using my LAN server as an IMAP host, the way it's meant to be. It saves a lot of work in recovering my email history. > Thanks much. Pleasure. It's a nice change not being the one asking for help. :) -- Regards, Peter.
Re: [gentoo-user] Switching from desktop to desktop without function keys.
On Saturday, 30 September 2023 20:59:04 BST Dale wrote: > Is there a way with the keyboard to switch to a desktop above 10? Even > if it just switches up one at a time, that would work. Say switch to 10 > and then keep hitting a set of keys to go to 11, then 12, then 13 etc > etc. Eventually, I get to the one I want. You can set up a key combination to switch one desktop to the right and another to switch one to the left. It's under Shortcuts, where you select KWin, then scroll the right-hand panel down to Walk through Desktop List, where I've put what used to be the default value: CTRL-ALT-right. Then down one to the next entry and enter CTRL-ALT-left. The defaults are left blank nowadays. Then, under Virtual Desktops set Navigation Wraps Around. HTH. :) -- Regards, Peter.
Re: [gentoo-user] PCIe x1 or PCIe x4 SATA controller card
On Tuesday, 19 September 2023 14:40:24 BST Peter Humphrey wrote: > My machine was built by Armari, and it has 64GB. Even that isn't enough to > accommodate more than one huge package emerge at a time - which is why I'd > like to see the new feature I've been bleating about. I might ask them if I > can double it. It turns out that I can double it to 128 GB, but at a cost of course. I'm now musing over whether I can justify it. I'll also have to consider whether portage can make effective use of it. I also discovered that Armari are a big player. They've supplied well over 100 huge systems to CERN for the LHC. I wish I had CERN's money! :) -- Regards, Peter.
Re: [gentoo-user] PCIe x1 or PCIe x4 SATA controller card
On Sunday, 26 March 2023 20:08:29 BST Dale wrote: > I looked at a few lists of CPU processors. This is a bit pricey but I may > try to buy a AMD Ryzen 9 5900X 12-Core @ 3.7 GHz. It has 4 more cores but > clock speed is a little slower. Even just comparing number of cores and the > fairly close clock speed, that alone should make it a bit faster. Add in > that they make them run code more efficiently now, should be a good bit > better. That's the CPU I have. It's double-threaded, and it just flies. :) > I usually try to aim for 4 or 5 times more processing power. I suspect > this may help with encryption as well since newer CPUs have extra code > just for that on there now. Most of the mobos also handle a lot more > memory as well. I have 32GBs now. Most support 64GB and I think I saw > a 128GB version somewhere. My machine was built by Armari, and it has 64GB. Even that isn't enough to accommodate more than one huge package emerge at a time - which is why I'd like to see the new feature I've been bleating about. I might ask them if I can double it. -- Regards, Peter.
Re: [gentoo-user] Controlling emerges
On Monday, 18 September 2023 17:13:04 BST Alan McKinnon wrote: > I did read all those but no matter how you move things around you still > have only X resources available all the time. > Whether you just let emerge do it's thing or try get it to do big packages > on their own, everything is still going to use the same number of cpu > cycles overall and you will save nothing. That isn't the point. The point is that it takes twice as long, and it wastes the machine's resources while I twiddle my thumbs waiting for it. > If webkit-gtk is the only big package, have you considered: > > emerge -1v webkit-gtk && emerge -avuND @world? Of course. > What you have is not a portage problem. It is a orthodox parallelism > problem, and I think you are thinking your constraint is unique in the work > - it isn't. No, I think my problem has not been tackled by the portage developers. > With parallelism, trying to fiddle single nodes to improve things overall > never really works out. See above. -- Regards, Peter.
Re: [gentoo-user] Controlling emerges
(I assume this was addressed to me, though it was a reply to someone else.) On Tuesday, 19 September 2023 10:14:42 BST William Kenworthy wrote: > That is where you set per package compiler parameters by overriding > make.conf settings. And which make.conf setting might achieve what I want? Careful reading of the make.conf man page hasn't revealed anything relevant. -- Regards, Peter.
Re: [gentoo-user] Controlling emerges
On Monday, 18 September 2023 23:44:50 BST William Kenworthy wrote: > per package env variables? > > https://wiki.gentoo.org/wiki//etc/portage/package.env Apropos of what? -- Regards, Peter.
Re: [gentoo-user] Controlling emerges
On Monday, 18 September 2023 14:48:46 BST Alan McKinnon wrote: > On Mon, Sep 18, 2023 at 3:44 PM Peter Humphrey > > wrote: > > It may be less complex than you think, Jack. I envisage a package being > > marked > > as solitary, and when portage reaches that package, it waits until all > > current > > jobs have finished, then it starts the solitary package with the > > environment > > specified for it, and it doesn't start the next one until that one has > > finished. > > The dependency calculation shouldn't need to be changed. > > > > It seems simple the way I see it. > > How does that improve emerge performance overall? By allocating all the system resources to huge packages while not flooding the system with lesser ones. For example, I can set -j20 for webkit-gtk today without overflowing the 64GB RAM, and still have 4 CPU threads available to other tasks. The change I've proposed should make the whole operation more efficient overall and take less time. As things stand today, I have to make do with -j12 or so, wasting time and resources. I have load-average set at 32, so if I were to set -j20 generally I'd run out of RAM in no time. I've had many instances of packages failing to compile in a large update, but going just fine on their own; and I've had mysterious operational errors resulting, I suspect, from otherwise undetected miscompilation. Previous threads have more detail of what I've tried already. -- Regards, Peter.
Re: [gentoo-user] Controlling emerges
On Monday, 18 September 2023 13:59:03 BST Jack wrote: > On 9/18/23 08:00, Peter Humphrey wrote: > > Hello list, > > > > We've had a few discussions here on how to balance the parameters to > > emerge > > to make the most of the resources available. Here's another idea: > > > > One the one hand, big jobs should be able to use the maximum CPU > > performance and RAM capacity, but on the other we don't want to flood the > > system. > > > > Therefore, I think it would be useful to be able to specify in env and > > package.env that a job should be run on its own - if any other emerge jobs > > are scheduled, wait until they're finished. Combine that with a specific > > MAKEOPTS, and we'd have a more flexible deployment of resouces. > > > > Is this feasible? What have I not thought of? > > I've had exactly the same thought for some time now. My guess is that > it is theoretically possible to add some USE flag or ENV var for portage > to recognize, but I don't know the portage internals well enough to > guess how much effort it would be. Given that portage orders ebuilds in > a single emerge session based on some dependency graph, that seems like > a good place to put the necessary hooks. > > As a starting point, one option might be to create a special/magic > ebuild and make it a dependency of those jobs that need to be run alone, > and have something about it that won't run if anything else is still > running. But, I don't know if those pre-checks (such as checking for > enough RAM and/or disk space) can be run at build time and not just at > portage startup time. The other possible problem with that approach > would be to be sure that ebuild gets run separately for each other > ebuild that depends on it - not all of them depending on it being run > once.Also, those blocking ebuilds have work so that if several of them > are queued (and running their "wait for everything else to finish" > scripts - exactly one of them needs to start. I don't know if those > pre-check scripts count as running before or within the ebuild itself. It may be less complex than you think, Jack. I envisage a package being marked as solitary, and when portage reaches that package, it waits until all current jobs have finished, then it starts the solitary package with the environment specified for it, and it doesn't start the next one until that one has finished. The dependency calculation shouldn't need to be changed. It seems simple the way I see it. -- Regards, Peter.
[gentoo-user] Controlling emerges
Hello list, We've had a few discussions here on how to balance the parameters to emerge to make the most of the resources available. Here's another idea: One the one hand, big jobs should be able to use the maximum CPU performance and RAM capacity, but on the other we don't want to flood the system. Therefore, I think it would be useful to be able to specify in env and package.env that a job should be run on its own - if any other emerge jobs are scheduled, wait until they're finished. Combine that with a specific MAKEOPTS, and we'd have a more flexible deployment of resouces. Is this feasible? What have I not thought of? -- Regards, Peter.
Re: [gentoo-user] long compiles
On Wednesday, 13 September 2023 16:14:09 BST Michael wrote: > I recall this being discussed in a previous thread, but if your CPU has 24 > threads and you've set: > > EMERGE_DEFAULT_OPTS="--jobs=4 --load-average=32 > MAKEOPTS="-j14" > > You will be asking emerge to run up to 4 x 14 = 56 threads, which could > potentially eat up to 2G of RAM each, i.e. 112G of RAM. This will exhaust > your 64G of RAM, not taking into account whatever else the OS will be trying > to run at the time. Yes, I understand that, but I've spent a lot of time watching, and instrumenting, and in practice the load doesn't exceed about 33. > The --load-average=32 is normally expected to be a floating point number That stipulation has only appeared recently. I have tried adding a '.0' to the number, and it's made no noticeaible difference. Besides, I could attempt pedantry and declare that the set of all integers is a proper subset of all real numbers. ;-) > Of course, not all emerges use make and you may never or rarely emerge 4 x > monster packages in parallel to need 2G of RAM for each thread at the same > time. I have actually had three or four big packages running together, but my observation is that they don't pump the load up too far. > If only we had at our disposal some AI algorithm to calculate dynamically > each time we run emerge the optimal combo of parallel emerge jobs and > number of make tasks, so as to achieve the highest total time saving Vs > energy spent! Or just the highest total time saving. ;-) Yes, that's what we need, all right. > I haven't performed any meaningful comparisons to determine where the > greatest gains are to be achieved. Parallel emerges of many small > packages, or a large number of make jobs for big packages. The combination > would change each time according to the individual packages waiting for an > update. In my use case, instinctively feels more beneficial reducing the > time I have to wait for huge packages like qtwebengine to finish, than > accelerating the updates of half a dozen smaller packages. That is the difficulty. I do often rebuild a new system, not trusting the existing one any longer, and a lot of time is spent fiddling with four tiny packages at a time in the early and middle stages, then benefitting from the limit of 4 once the desktop packages begin. > Therefore, as a rule I leave EMERGE_DEFAULT_OPTS unset. I set MAKEOPTS jobs > to the number of CPU threads +1 and the load average at 95%, so I can > continue using the PC without any noticeable latency. On PCs where RAM is > constrained I reduce the MAKEOPTS in /etc/portage/ package.env for any large > packages which are bound to start swapping and thrashing the disk. Interesting. Do you mean 95% of the jobs figure? I'll do some more experimenting. Meanwhile, perhaps I'll run new builds in two stages: the first without any desktop packages - I do have sets defined to enable that - and the second with them. I can't do that with emerge -e though. -- Regards, Peter.
