Re: [gentoo-user] emerge - Tips and Tricks
Arve Barsnes wrote: > On Tue, 3 Sept 2024 at 11:05, Arve Barsnes wrote: >> On Tue, 3 Sept 2024 at 09:49, Dale wrote: >>> If you find a place that explains all those and what they do, please >>> share a link. I'd like to know too. I didn't find anything on the >>> wiki. >> They're in the man pages. >> man 4 make.conf >> https://devmanual.gentoo.org/eclass-reference/make.conf/index.html > That should be: > man ***5*** make.conf > > Well, I searched first on the wiki then did a DDG search, the duck search thing. None of them found that. o_O Thanks for the link. Now we both have some reading to do. At first glance, I don't see anything I think I should change. Dale :-) :-)
Re: [gentoo-user] emerge - Tips and Tricks
On Tue, 3 Sept 2024 at 11:05, Arve Barsnes wrote: > > On Tue, 3 Sept 2024 at 09:49, Dale wrote: > > If you find a place that explains all those and what they do, please > > share a link. I'd like to know too. I didn't find anything on the > > wiki. > > They're in the man pages. > man 4 make.conf > https://devmanual.gentoo.org/eclass-reference/make.conf/index.html That should be: man ***5*** make.conf
Re: [gentoo-user] emerge - Tips and Tricks
On Tue, 3 Sept 2024 at 09:49, Dale wrote: > If you find a place that explains all those and what they do, please > share a link. I'd like to know too. I didn't find anything on the > wiki. They're in the man pages. man 4 make.conf https://devmanual.gentoo.org/eclass-reference/make.conf/index.html Cheers, Arve
Re: [gentoo-user] emerge - Tips and Tricks
ralfconn wrote: > Il 02/09/24 01:56, Dale ha scritto: >> FEATURES="-usersync userpriv usersandbox buildpkg sandbox parallel-fetch >> parallel-install" >> >> >> The ones I care about. The buildpkg tells it to save binary copies. >> This is a must if done in a chroot and you want to install elsewhere as >> binaries but comes in handy if you accidentally remove something and >> need it back fast or you need to restore something you removed and broke >> portage. The fetch option just tells it to fork the download part and >> keep downloading until it has everything it needs to update. The >> install option I think tells it to do more than one install at a time >> instead of one at a time. I've never had a problem with this. If >> something is going to clash, emerge sets a lock file and waits until the >> other package is installed. I think the others were the default when I >> installed. Check the man page maybe >> > > > Thanks for bringing this up, it got me wondering what my FEATURES > were. Mine contains only -userfetch (I don't know why I set that, I > will have to test) but many other options are set by default: > > $ portageq envvar FEATURES | xargs -n 1 > assume-digests > binpkg-docompress > binpkg-dostrip > binpkg-logs > binpkg-multi-instance > buildpkg-live > config-protect-if-modified > distlocks > ebuild-locks > fixlafiles > ipc-sandbox > merge-sync > merge-wait > multilib-strict > network-sandbox > news > parallel-fetch > pid-sandbox > pkgdir-index-trusted > preserve-libs > protect-owned > qa-unresolved-soname-deps > sandbox > sfperms > strict > unknown-features-warn > unmerge-logs > unmerge-orphans > userpriv > usersandbox > usersync > xattr > > raf > > If you find a place that explains all those and what they do, please share a link. I'd like to know too. I didn't find anything on the wiki. I added to the defaults on this new rig but didn't change what was already there. Adding something may help me as well. We both need to know what each one does as it could have unintended effects. This is my list using the same command you used. It seems some are set in other places. root@Gentoo-1 / # portageq envvar FEATURES | xargs -n 1 assume-digests binpkg-docompress binpkg-dostrip binpkg-logs binpkg-multi-instance buildpkg buildpkg-live config-protect-if-modified distlocks ebuild-locks fixlafiles ipc-sandbox merge-sync merge-wait multilib-strict network-sandbox news parallel-fetch parallel-install pid-sandbox pkgdir-index-trusted preserve-libs protect-owned qa-unresolved-soname-deps sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox xattr root@Gentoo-1 / # Thanks. Dale :-) :-)
[gentoo-user] emerge keeps installing then uninstalling qtbase, qttools, ...
For the past 4 days or so, every time I do a sync and then 'emerge -auvND world', portage installs the following: qttools qtbase qttranslations xcb-util-cursor Afterwards, when I do 'emerge --depclean', it uninstalls them. Any ideas why? It's getting a little annoying. -- Grant
Re: [gentoo-user] emerge - Tips and Tricks
Il 02/09/24 01:56, Dale ha scritto: FEATURES="-usersync userpriv usersandbox buildpkg sandbox parallel-fetch parallel-install" The ones I care about. The buildpkg tells it to save binary copies. This is a must if done in a chroot and you want to install elsewhere as binaries but comes in handy if you accidentally remove something and need it back fast or you need to restore something you removed and broke portage. The fetch option just tells it to fork the download part and keep downloading until it has everything it needs to update. The install option I think tells it to do more than one install at a time instead of one at a time. I've never had a problem with this. If something is going to clash, emerge sets a lock file and waits until the other package is installed. I think the others were the default when I installed. Check the man page maybe Thanks for bringing this up, it got me wondering what my FEATURES were. Mine contains only -userfetch (I don't know why I set that, I will have to test) but many other options are set by default: $ portageq envvar FEATURES | xargs -n 1 assume-digests binpkg-docompress binpkg-dostrip binpkg-logs binpkg-multi-instance buildpkg-live config-protect-if-modified distlocks ebuild-locks fixlafiles ipc-sandbox merge-sync merge-wait multilib-strict network-sandbox news parallel-fetch pid-sandbox pkgdir-index-trusted preserve-libs protect-owned qa-unresolved-soname-deps sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userpriv usersandbox usersync xattr raf
Re: [gentoo-user] emerge - Tips and Tricks
Il 02/09/24 00:44, Joe ha scritto: Normally i run emerge -uavDU --with-bdeps=y @world when i don't want a reinstall of everything after a emerge --sync I run emerge -uavDN --with-bdeps=y @world when i want to reinstall or like the manual says if there is a use flag that has been changed by me or the dev. My make.conf: EMERGE_DEFAULT_OPTS="--quiet-build --keep-going --jobs 24 --load-average 24.0" MAKEOPTS="-j24 -l24.0" I don't know if I got the load-average and company right, anyway the system is always responsive (Ryzen 9 with 64Gb) even when using all 24 CPU threads. The ebuilds have gotten a long way towards stability even in ~amd64, I rarely have build problems (except when cross-compiling for ARM, but that's a different story). My command line is 'emerge -auDvN @world'. Let the system decide if there are USE flag changes that require a rebuild, computers should do the boring stuff for us 🙂 raf
Re: [gentoo-user] emerge - Tips and Tricks
On Monday, 2 September 2024 07:59:20 BST Wols Lists wrote: > On 02/09/2024 06:11, Dale wrote: > > If you have a laptop where heat is a issue, you may want to do things > > different but if you can, that will give you the most stable system for > > updates. > > Another tip - if you run into any problems, try to emerge @system, not > @world. > > If you know you've successfully emerged @system and you get loads of > stuff blocking with an @world, I tend to just unmerge all the blockers > until @world fires successfully. You need to be a bit careful, you could > still unmerge something important, but it's unlikely. Although these > problems also tend to be fixed by backtrack=100. > > Cheers, > Wol You can remove blockers manually and I admit to do it occasionally, but it can sometimes break your system if you don't pay particular attention and you inadvertently remove some critical toolchain software - e.g. python, glibc, gcc, et al. It is safer to run: emerge --depclean -v -p and check what dependencies of are complaining about your attempt to remove it. Should you come across python or something portage depends on, it's best to back off and ask before you decide how to proceed. Soft blockers (b) are dealt with automatically by emerge, it is hard blockers (B) you'd have to pay attention to. My typical update runs like this: eix-sync emerge -uaNDv @world dispatch-conf emerge --depclean -a -v eclean-dist If the emerge output asks me to, I also run: revdep-rebuild and when perl itself goes through a major update, I run: perl-cleaner --reallyall Enjoy your gentoo! signature.asc Description: This is a digitally signed message part.
Re: [gentoo-user] emerge - Tips and Tricks
Wols Lists wrote: > On 02/09/2024 00:56, Dale wrote: >> Obviously, a news item can change that process. If there is a news item >> with a different process, follow that for sure. Following the news item >> to the letter is the best way. The devs work out all the kinks and bugs >> before they post the news item. > > Find the other commands (like perl-cleaner) that you really ought to > run but are not part of emerge - CPAN predates even linux I believe, > so they expect us to adjust to them ... > > I followed the Python update to the letter, and it just refused to run > ... until I ran perl-cleaner. > > perl-cleaner is basically "emerge for perl" - it goes through and > sorts out all your CPAN dependencies. > > Cheers, > Wol This is true. I always forget to run perl update and python tools as well. I rarely have issues but it is likely a good idea to run it when one of those are updated, just to be safe. Joe, add that to your list. ;-) Dale :-) :-)
Re: [gentoo-user] emerge - Tips and Tricks
On 02/09/2024 06:11, Dale wrote: If you have a laptop where heat is a issue, you may want to do things different but if you can, that will give you the most stable system for updates. Another tip - if you run into any problems, try to emerge @system, not @world. If you know you've successfully emerged @system and you get loads of stuff blocking with an @world, I tend to just unmerge all the blockers until @world fires successfully. You need to be a bit careful, you could still unmerge something important, but it's unlikely. Although these problems also tend to be fixed by backtrack=100. Cheers, Wol
Re: [gentoo-user] emerge - Tips and Tricks
On 02/09/2024 00:56, Dale wrote: Obviously, a news item can change that process. If there is a news item with a different process, follow that for sure. Following the news item to the letter is the best way. The devs work out all the kinks and bugs before they post the news item. Find the other commands (like perl-cleaner) that you really ought to run but are not part of emerge - CPAN predates even linux I believe, so they expect us to adjust to them ... I followed the Python update to the letter, and it just refused to run ... until I ran perl-cleaner. perl-cleaner is basically "emerge for perl" - it goes through and sorts out all your CPAN dependencies. Cheers, Wol
Re: [gentoo-user] emerge - Tips and Tricks
Matt Connell wrote: > On Sun, 2024-09-01 at 18:56 -0500, Dale wrote: >> FEATURES="-usersync userpriv usersandbox buildpkg sandbox >> parallel-fetch parallel-install" > No candy? You struck me as a candy guy. > > > I'll admit, I haven't touched that setting in ages. Likely a decade or more. I'm not sure what options are even available now that wasn't before. This thing has candy? I like candy. The area below my ribs likes candy too. Candy tends to stick around. LOL Dale :-) :-)
Re: [gentoo-user] emerge - Tips and Tricks
Joe wrote: > > > On 9/1/24 16:56, Dale wrote: >> Joe wrote: >>> Hello, >>> >>> >>> I'm looking for some tips and tricks regarding emerge. I know there is >>> a cheat sheet on what stuff you can do. But i would like emerge >>> exclusively . >>> >>> Normally i run emerge -uavDU --with-bdeps=y @world when i don't want a >>> reinstall of everything after a emerge --sync >>> >>> I run emerge -uavDN --with-bdeps=y @world when i want to reinstall or >>> like the manual says if there is a use flag that has been changed by >>> me or the dev. >>> >>> >>> Am i doing it right or what should i do that can help me and newer >>> people >>> >>> >>> Thanks >>> >>> >>> Joe >> >> I been using Gentoo since 2003. The emerge program has come a LONG way >> since then. Over the years tho, I've refined my update process until I >> got to a point where it won't get any better. You will still run into >> the occasional update that requires the use of a hammer but for the most >> part, this does well. First thing. I have a set of options in >> make.conf to cover most options. That line looks like this. >> >> >> EMERGE_DEFAULT_OPTS="--with-bdeps y --backtrack=500 --keep-going -v >> --quiet-build=y -1 --unordered-display --jobs=16 --load-average 8" >> >> >> A couple of those are either personal preference or machine dependent. >> The bdeps option will cause extra rebuilds on occasion but it is rare >> that I get a seg fault or programs that just crash because the versions >> don't work well together. Before that option was available, I used to >> do a emerge -e world to fix problems with programs not starting or >> crashing with a seg fault. The bdeps options seems to have improved >> that a LOT. The backtrack option just makes sure you only have to run >> emerge -a once. It takes a while sometimes but it digs deep, >> real deep. If a update can be done, it will find a way. Honestly, 100 >> is likely more than enough in most all cases. The keep-going option is >> good for when a packages fails, especially early on, and it stops the >> update. On most occasions, emerge can regroup and continue on skipping >> only one or a very few packages. It saves time in the long run if you >> start a update and don't monitor it. The -1 option is the same as >> oneshot. This prevents you from accidentally cluttering up the world >> file. Something gives you problems and you are emerging by hand, if you >> forget to add the -1 as you work to fix it, it adds all those to the >> world file, including version if you specify one. I'm not sure on the >> display option. I added it for some reason, ages ago. The job and load >> is different for each machine. The line above is for a 16 core, 32 >> thread CPU with 64GBs of ram. My old 8 core with 32GBs of ram was set >> to jobs 8 and load 3 I think. Memory is one limiting factor there. >> LOo, that qt package and a couple others can fail from lack of memory if >> set higher. >> >> Second thing. My usual update process. I sync first. I run emerge >> -auDN world and check what it plans to do. I mostly check USE flags. >> Sometimes a USE flag will change and I have to adjust them a bit. >> Sometimes on a per package basis, sometimes global. Once I'm happy with >> what it wants to do, I hit the 'y' key and turn her lose. >> >> On both my old rig and new rig, I have a second install that is in a >> chroot. When I have packages that take a long time to build, I do my >> updates in the chroot first and then copy over the binaries. Then I >> just need to do a emerge -aukDN world to make the update faster since it >> is already compiled. This can be handy when you have some of the qt >> packages and the software has different versions and it causes >> problems. Some updates midway can make it so certain programs won't >> launch at all. I've had that happen with Kwrite several times, Dolphin >> a few times. Once the update is done and you logou and back in, >> everything works again. You just may run into problems during the >> update when some packages are old still and some are new. This method >> lessens the time of that problem. >> >> Once the update is done, I then run emerge -a --depclean and see if >> anything needs to be removed or if I need to add something I want to >> keep to the world file. Oh, if you want to emerge something and add it >> to the world file so it gets updated and saved, emerge --select y plus >> your other options will override the oneshot option. If you run a GUI, >> you need to logout and back in. I sometimes switch to the boot runlevel >> and check for services that need to be restarted as well. One could >> reboot and achieve the same goal. This is Linux tho. ;-) >> >> Obviously, a news item can change that process. If there is a news item >> with a different process, follow that for sure. Following the news item >> to the letter is the best way. The devs work out all the kinks and bugs >> before they post the news item. >> >> Oh, this is ano
Re: [gentoo-user] emerge - Tips and Tricks
On Sun, 2024-09-01 at 18:56 -0500, Dale wrote: > FEATURES="-usersync userpriv usersandbox buildpkg sandbox > parallel-fetch parallel-install" No candy? You struck me as a candy guy.
Re: [gentoo-user] emerge - Tips and Tricks
On 9/1/24 16:56, Dale wrote: Joe wrote: Hello, I'm looking for some tips and tricks regarding emerge. I know there is a cheat sheet on what stuff you can do. But i would like emerge exclusively . Normally i run emerge -uavDU --with-bdeps=y @world when i don't want a reinstall of everything after a emerge --sync I run emerge -uavDN --with-bdeps=y @world when i want to reinstall or like the manual says if there is a use flag that has been changed by me or the dev. Am i doing it right or what should i do that can help me and newer people Thanks Joe I been using Gentoo since 2003. The emerge program has come a LONG way since then. Over the years tho, I've refined my update process until I got to a point where it won't get any better. You will still run into the occasional update that requires the use of a hammer but for the most part, this does well. First thing. I have a set of options in make.conf to cover most options. That line looks like this. EMERGE_DEFAULT_OPTS="--with-bdeps y --backtrack=500 --keep-going -v --quiet-build=y -1 --unordered-display --jobs=16 --load-average 8" A couple of those are either personal preference or machine dependent. The bdeps option will cause extra rebuilds on occasion but it is rare that I get a seg fault or programs that just crash because the versions don't work well together. Before that option was available, I used to do a emerge -e world to fix problems with programs not starting or crashing with a seg fault. The bdeps options seems to have improved that a LOT. The backtrack option just makes sure you only have to run emerge -a once. It takes a while sometimes but it digs deep, real deep. If a update can be done, it will find a way. Honestly, 100 is likely more than enough in most all cases. The keep-going option is good for when a packages fails, especially early on, and it stops the update. On most occasions, emerge can regroup and continue on skipping only one or a very few packages. It saves time in the long run if you start a update and don't monitor it. The -1 option is the same as oneshot. This prevents you from accidentally cluttering up the world file. Something gives you problems and you are emerging by hand, if you forget to add the -1 as you work to fix it, it adds all those to the world file, including version if you specify one. I'm not sure on the display option. I added it for some reason, ages ago. The job and load is different for each machine. The line above is for a 16 core, 32 thread CPU with 64GBs of ram. My old 8 core with 32GBs of ram was set to jobs 8 and load 3 I think. Memory is one limiting factor there. LOo, that qt package and a couple others can fail from lack of memory if set higher. Second thing. My usual update process. I sync first. I run emerge -auDN world and check what it plans to do. I mostly check USE flags. Sometimes a USE flag will change and I have to adjust them a bit. Sometimes on a per package basis, sometimes global. Once I'm happy with what it wants to do, I hit the 'y' key and turn her lose. On both my old rig and new rig, I have a second install that is in a chroot. When I have packages that take a long time to build, I do my updates in the chroot first and then copy over the binaries. Then I just need to do a emerge -aukDN world to make the update faster since it is already compiled. This can be handy when you have some of the qt packages and the software has different versions and it causes problems. Some updates midway can make it so certain programs won't launch at all. I've had that happen with Kwrite several times, Dolphin a few times. Once the update is done and you logou and back in, everything works again. You just may run into problems during the update when some packages are old still and some are new. This method lessens the time of that problem. Once the update is done, I then run emerge -a --depclean and see if anything needs to be removed or if I need to add something I want to keep to the world file. Oh, if you want to emerge something and add it to the world file so it gets updated and saved, emerge --select y plus your other options will override the oneshot option. If you run a GUI, you need to logout and back in. I sometimes switch to the boot runlevel and check for services that need to be restarted as well. One could reboot and achieve the same goal. This is Linux tho. ;-) Obviously, a news item can change that process. If there is a news item with a different process, follow that for sure. Following the news item to the letter is the best way. The devs work out all the kinks and bugs before they post the news item. Oh, this is another good line to have in make.conf. FEATURES="-usersync userpriv usersandbox buildpkg sandbox parallel-fetch parallel-install" The ones I care about. The buildpkg tells it to save binary copies. This is a must if done in a chroot and you want to install elsewhere as binaries but comes in handy
Re: [gentoo-user] emerge - Tips and Tricks
Joe wrote: > Hello, > > > I'm looking for some tips and tricks regarding emerge. I know there is > a cheat sheet on what stuff you can do. But i would like emerge > exclusively . > > Normally i run emerge -uavDU --with-bdeps=y @world when i don't want a > reinstall of everything after a emerge --sync > > I run emerge -uavDN --with-bdeps=y @world when i want to reinstall or > like the manual says if there is a use flag that has been changed by > me or the dev. > > > Am i doing it right or what should i do that can help me and newer people > > > Thanks > > > Joe I been using Gentoo since 2003. The emerge program has come a LONG way since then. Over the years tho, I've refined my update process until I got to a point where it won't get any better. You will still run into the occasional update that requires the use of a hammer but for the most part, this does well. First thing. I have a set of options in make.conf to cover most options. That line looks like this. EMERGE_DEFAULT_OPTS="--with-bdeps y --backtrack=500 --keep-going -v --quiet-build=y -1 --unordered-display --jobs=16 --load-average 8" A couple of those are either personal preference or machine dependent. The bdeps option will cause extra rebuilds on occasion but it is rare that I get a seg fault or programs that just crash because the versions don't work well together. Before that option was available, I used to do a emerge -e world to fix problems with programs not starting or crashing with a seg fault. The bdeps options seems to have improved that a LOT. The backtrack option just makes sure you only have to run emerge -a once. It takes a while sometimes but it digs deep, real deep. If a update can be done, it will find a way. Honestly, 100 is likely more than enough in most all cases. The keep-going option is good for when a packages fails, especially early on, and it stops the update. On most occasions, emerge can regroup and continue on skipping only one or a very few packages. It saves time in the long run if you start a update and don't monitor it. The -1 option is the same as oneshot. This prevents you from accidentally cluttering up the world file. Something gives you problems and you are emerging by hand, if you forget to add the -1 as you work to fix it, it adds all those to the world file, including version if you specify one. I'm not sure on the display option. I added it for some reason, ages ago. The job and load is different for each machine. The line above is for a 16 core, 32 thread CPU with 64GBs of ram. My old 8 core with 32GBs of ram was set to jobs 8 and load 3 I think. Memory is one limiting factor there. LOo, that qt package and a couple others can fail from lack of memory if set higher. Second thing. My usual update process. I sync first. I run emerge -auDN world and check what it plans to do. I mostly check USE flags. Sometimes a USE flag will change and I have to adjust them a bit. Sometimes on a per package basis, sometimes global. Once I'm happy with what it wants to do, I hit the 'y' key and turn her lose. On both my old rig and new rig, I have a second install that is in a chroot. When I have packages that take a long time to build, I do my updates in the chroot first and then copy over the binaries. Then I just need to do a emerge -aukDN world to make the update faster since it is already compiled. This can be handy when you have some of the qt packages and the software has different versions and it causes problems. Some updates midway can make it so certain programs won't launch at all. I've had that happen with Kwrite several times, Dolphin a few times. Once the update is done and you logou and back in, everything works again. You just may run into problems during the update when some packages are old still and some are new. This method lessens the time of that problem. Once the update is done, I then run emerge -a --depclean and see if anything needs to be removed or if I need to add something I want to keep to the world file. Oh, if you want to emerge something and add it to the world file so it gets updated and saved, emerge --select y plus your other options will override the oneshot option. If you run a GUI, you need to logout and back in. I sometimes switch to the boot runlevel and check for services that need to be restarted as well. One could reboot and achieve the same goal. This is Linux tho. ;-) Obviously, a news item can change that process. If there is a news item with a different process, follow that for sure. Following the news item to the letter is the best way. The devs work out all the kinks and bugs before they post the news item. Oh, this is another good line to have in make.conf. FEATURES="-usersync userpriv usersandbox buildpkg sandbox parallel-fetch parallel-install" The ones I care about. The buildpkg tells it to save binary copies. This is a must if done in a chroot and you want to install elsewhere as binaries but comes
[gentoo-user] emerge - Tips and Tricks
Hello, I'm looking for some tips and tricks regarding emerge. I know there is a cheat sheet on what stuff you can do. But i would like emerge exclusively . Normally i run emerge -uavDU --with-bdeps=y @world when i don't want a reinstall of everything after a emerge --sync I run emerge -uavDN --with-bdeps=y @world when i want to reinstall or like the manual says if there is a use flag that has been changed by me or the dev. Am i doing it right or what should i do that can help me and newer people Thanks Joe
Re: [gentoo-user] emerge notice
On 07/07/2024 00:31, Thelma wrote:
I have in my make.conf:
PORTAGE_ELOG_CLASSES="warn error log"
PORTAGE_ELOG_SYSTEM="mail"
PORTAGE_ELOG_MAILURI="i...@domain.com /usr/sbin/sendmail"
PORTAGE_ELOG_MAILFROM="portage"
PORTAGE_ELOG_MAILSUBJECT="package \${PACKAGE} merged on \${HOST} with
notice"
It used to work, but ever since Rogers took over Shaw network, they
started making changes to their mail server and most email sent from
command line to myself via my provider doesn't work.
Is there an alternative, example send these notifications to a file or
print them at the end of emerge.
Bear in mind I've tried to do stuff like this, and failed miserably, but
I run a local mailserver type setup.
And reading between the lines, if you could get this to work, you could
probably get the command line to work too ...
But get something like exim or postfix or whatever set up locally,
configure it to send deliver local mail locally, and forward the rest to
Rogers.
Or if you actually want to use Rogers as your cloud email provider, get
it to send everything.
As a last resort, create an independent local system, so any mail sent
using standard *nix utilities stays on the local system (you'll probably
have to configure both the client and server to use a non-standard port
like 26) and now all your emerge and system monitoring stuff stays local
and under your control.
I feel your pain, my wife's laptop has suddenly stopped communicating
with gmail using thunderbird. But I can access those same accounts, with
the identical config, no problem. What the is going on?
Cheers,
Wol
Re: [gentoo-user] emerge notice
On 7/6/24 17:46, Jude DaShiell wrote: you could first pipe portage output to tee perhaps portage.log for a file to hold output then use grep on portage.log to find notifications in context sofollowing lines of notifications would be preserved. I've not used grep with lines of context before yet so don't know how that feature would work. -- Jude "There are four boxes to be used in defense of liberty: soap, ballot, jury, and ammo. Please use in that order." Ed Howdershelt 1940. What the command would look like. Maybe it would be a solution for single emerge but I'm not sure how it would work with "emerge -uDNavq world" when a system emerges over 300 packages.
Re: [gentoo-user] emerge notice
you could first pipe portage output to tee perhaps portage.log for a file
to hold output then use grep on portage.log to find notifications in
context sofollowing lines of notifications would be preserved. I've not
used grep with lines of context before yet so don't know how that feature
would work.
--
Jude
"There are four boxes to be used in defense of liberty:
soap, ballot, jury, and ammo.
Please use in that order."
Ed Howdershelt 1940.
On Sat, 6 Jul 2024, Thelma wrote:
> I have in my make.conf:
>
> PORTAGE_ELOG_CLASSES="warn error log"
> PORTAGE_ELOG_SYSTEM="mail"
> PORTAGE_ELOG_MAILURI="i...@domain.com /usr/sbin/sendmail"
> PORTAGE_ELOG_MAILFROM="portage"
> PORTAGE_ELOG_MAILSUBJECT="package \${PACKAGE} merged on \${HOST} with notice"
>
> It used to work, but ever since Rogers took over Shaw network, they started
> making changes to their mail server and most email sent from command line to
> myself via my provider doesn't work.
>
> Is there an alternative, example send these notifications to a file or print
> them at the end of emerge.
>
>
[gentoo-user] emerge notice
I have in my make.conf:
PORTAGE_ELOG_CLASSES="warn error log"
PORTAGE_ELOG_SYSTEM="mail"
PORTAGE_ELOG_MAILURI="i...@domain.com /usr/sbin/sendmail"
PORTAGE_ELOG_MAILFROM="portage"
PORTAGE_ELOG_MAILSUBJECT="package \${PACKAGE} merged on \${HOST} with notice"
It used to work, but ever since Rogers took over Shaw network, they started
making changes to their mail server and most email sent from command line to
myself via my provider doesn't work.
Is there an alternative, example send these notifications to a file or print
them at the end of emerge.
--
Thelma
[gentoo-user] emerge pattern....
I'm trying to do the steps for the forced profile update even though things had been working perfectly Emerge has been doing really crazy things recently. It will start emerging a thousand packages but not install a single one of them. Then it crashes with a bunch of python garbage having made absolutely no progress whatsoever. Is there any way I can FORCE emerge to attempt the install IMMEDIATELY after the build stage completes UNCONDITIONALLY? damnit, I was trying to shift my bedtime back to 3 am... now 4:42 am Ran it again just to capture the error barf so therefore it seems to be working, at least it is installing stuff after compiling like 950 packages in a single stretch Why Just why. I mean there cannot be any advantage to having a compile dozens of things in a batch and then install everything one at a time, in a batch... I mean usually everything should just compile and install concurrently across 64 cores with only a handful of concurrency locks needed to maintain a minimal amount of sanity. I mean that actually used to work... I've been using multi-core systems since before I started using gentoo, and never had an issue attributable to multiprocessing... If I did, I just hit it with an emerge --resume and never complained about it -- You can't out-crazy a Democrat. #EggCrisis #BlackWinter White is the new Kulak. Powers are not rights.
Re: [gentoo-user] emerge-webrsync error
Anyone know anything about top secret mind control devices? The devices are suspected to be in haymarket melbourne australia and can control peoples brains with audio and visual data? if anyone knows anyone from darpa or other agency maybe let them now Sent: Thursday, May 23, 2024 at 3:18 AM From: "Jude DaShiell" To: gentoo-user@lists.gentoo.org Subject: Re: [gentoo-user] emerge-webrsync error Thanks, if I get to that point I'll remember that number! -- Jude "There are four boxes to be used in defense of liberty: soap, ballot, jury, and ammo. Please use in that order." Ed Howdershelt 1940. On Wed, 22 May 2024, Michael wrote: > Or, more appropriately if you do not use a desktop then please select profile > No. 21: > > [21] default/linux/amd64/23.0 (stable) > > > On Wednesday, 22 May 2024 16:05:09 BST Michael wrote: > > Ah! OK, this probably explains it. > > > > The latest and now default Gentoo profile is no longer 17.1, but 23.0, > > which uses a merged /usr directory structure. > > > > Consequently, select profile 23: > > > > [23] default/linux/amd64/23.0/desktop (stable) > > > > On Wednesday, 22 May 2024 15:53:11 BST Jude DaShiell wrote: > > > I used bash but don't know that there's a problem with bash. > > > I burnt the whole system to the ground and still have the verified and > > > validated stage3 file available on my system. > > > Once stage3 is installed was the tee utility included on stage3? If so I > > > can capture what's going on. When I ran emerge-webrsync again I was told > > > bzip2 couldn't be found so if that was installed by stage3 there may be > > > other problems. > > > I'm going with efi since that's the computer default and openrc since > > > that's gentoo's original default in my choices for the system. On the > > > profile I'm going for the default 1 which is I think a command line > > > interface since that's where I live most of the time. > >
Re: [gentoo-user] emerge-webrsync error
Thanks, if I get to that point I'll remember that number! -- Jude "There are four boxes to be used in defense of liberty: soap, ballot, jury, and ammo. Please use in that order." Ed Howdershelt 1940. On Wed, 22 May 2024, Michael wrote: > Or, more appropriately if you do not use a desktop then please select profile > No. 21: > > [21] default/linux/amd64/23.0 (stable) > > > On Wednesday, 22 May 2024 16:05:09 BST Michael wrote: > > Ah! OK, this probably explains it. > > > > The latest and now default Gentoo profile is no longer 17.1, but 23.0, > > which uses a merged /usr directory structure. > > > > Consequently, select profile 23: > > > > [23] default/linux/amd64/23.0/desktop (stable) > > > > On Wednesday, 22 May 2024 15:53:11 BST Jude DaShiell wrote: > > > I used bash but don't know that there's a problem with bash. > > > I burnt the whole system to the ground and still have the verified and > > > validated stage3 file available on my system. > > > Once stage3 is installed was the tee utility included on stage3? If so I > > > can capture what's going on. When I ran emerge-webrsync again I was told > > > bzip2 couldn't be found so if that was installed by stage3 there may be > > > other problems. > > > I'm going with efi since that's the computer default and openrc since > > > that's gentoo's original default in my choices for the system. On the > > > profile I'm going for the default 1 which is I think a command line > > > interface since that's where I live most of the time. > >
Re: [gentoo-user] emerge-webrsync error
Or, more appropriately if you do not use a desktop then please select profile No. 21: [21] default/linux/amd64/23.0 (stable) On Wednesday, 22 May 2024 16:05:09 BST Michael wrote: > Ah! OK, this probably explains it. > > The latest and now default Gentoo profile is no longer 17.1, but 23.0, > which uses a merged /usr directory structure. > > Consequently, select profile 23: > > [23] default/linux/amd64/23.0/desktop (stable) > > On Wednesday, 22 May 2024 15:53:11 BST Jude DaShiell wrote: > > I used bash but don't know that there's a problem with bash. > > I burnt the whole system to the ground and still have the verified and > > validated stage3 file available on my system. > > Once stage3 is installed was the tee utility included on stage3? If so I > > can capture what's going on. When I ran emerge-webrsync again I was told > > bzip2 couldn't be found so if that was installed by stage3 there may be > > other problems. > > I'm going with efi since that's the computer default and openrc since > > that's gentoo's original default in my choices for the system. On the > > profile I'm going for the default 1 which is I think a command line > > interface since that's where I live most of the time. signature.asc Description: This is a digitally signed message part.
Re: [gentoo-user] emerge-webrsync error
Ah! OK, this probably explains it. The latest and now default Gentoo profile is no longer 17.1, but 23.0, which uses a merged /usr directory structure. Consequently, select profile 23: [23] default/linux/amd64/23.0/desktop (stable) On Wednesday, 22 May 2024 15:53:11 BST Jude DaShiell wrote: > I used bash but don't know that there's a problem with bash. > I burnt the whole system to the ground and still have the verified and > validated stage3 file available on my system. > Once stage3 is installed was the tee utility included on stage3? If so I > can capture what's going on. When I ran emerge-webrsync again I was told > bzip2 couldn't be found so if that was installed by stage3 there may be > other problems. > I'm going with efi since that's the computer default and openrc since > that's gentoo's original default in my choices for the system. On the > profile I'm going for the default 1 which is I think a command line > interface since that's where I live most of the time. signature.asc Description: This is a digitally signed message part.
Re: [gentoo-user] emerge-webrsync error
I used bash but don't know that there's a problem with bash. I burnt the whole system to the ground and still have the verified and validated stage3 file available on my system. Once stage3 is installed was the tee utility included on stage3? If so I can capture what's going on. When I ran emerge-webrsync again I was told bzip2 couldn't be found so if that was installed by stage3 there may be other problems. I'm going with efi since that's the computer default and openrc since that's gentoo's original default in my choices for the system. On the profile I'm going for the default 1 which is I think a command line interface since that's where I live most of the time. -- Jude "There are four boxes to be used in defense of liberty: soap, ballot, jury, and ammo. Please use in that order." Ed Howdershelt 1940. On Wed, 22 May 2024, Michael wrote: > You can check while within your chroot, if /dev/fd is a symlink to the > directory /proc/self/fd. > > If the above is correct, then there may be a problem with your shell. Check > what you get when you run: > > # echo $SHELL > > or, > > # ps -p $$ > > Bash should work fine, but from the little I understand about zsh it uses > slightly different process substitution than bash. If your shell is not bash > try changing to it, to see if it makes a difference: > > chsh -s /bin/bash > > I don't know if this is the cause of your problem, but it's worth a try. > > > On Wednesday, 22 May 2024 14:45:40 BST Michael Orlitzky wrote: > > On Wed, 2024-05-22 at 09:40 -0400, Jude DaShiell wrote: > > > Yes, this is during installation. > > > I did type: > > > mount --rbind /dev /mnt/gentoo/dev > > > I was outside of chroot at the time but that's all I did with dev before > > > running emerge-webrsync. > > > > Ok, that was my one guess. I'm out of ideas, sorry. > >
Re: [gentoo-user] emerge-webrsync error
You can check while within your chroot, if /dev/fd is a symlink to the directory /proc/self/fd. If the above is correct, then there may be a problem with your shell. Check what you get when you run: # echo $SHELL or, # ps -p $$ Bash should work fine, but from the little I understand about zsh it uses slightly different process substitution than bash. If your shell is not bash try changing to it, to see if it makes a difference: chsh -s /bin/bash I don't know if this is the cause of your problem, but it's worth a try. On Wednesday, 22 May 2024 14:45:40 BST Michael Orlitzky wrote: > On Wed, 2024-05-22 at 09:40 -0400, Jude DaShiell wrote: > > Yes, this is during installation. > > I did type: > > mount --rbind /dev /mnt/gentoo/dev > > I was outside of chroot at the time but that's all I did with dev before > > running emerge-webrsync. > > Ok, that was my one guess. I'm out of ideas, sorry. signature.asc Description: This is a digitally signed message part.
Re: [gentoo-user] emerge-webrsync error
On Wed, 2024-05-22 at 09:40 -0400, Jude DaShiell wrote: > Yes, this is during installation. > I did type: > mount --rbind /dev /mnt/gentoo/dev > I was outside of chroot at the time but that's all I did with dev before > running emerge-webrsync. > Ok, that was my one guess. I'm out of ideas, sorry.
Re: [gentoo-user] emerge-webrsync error
Yes, this is during installation. I did type: mount --rbind /dev /mnt/gentoo/dev I was outside of chroot at the time but that's all I did with dev before running emerge-webrsync. -- Jude "There are four boxes to be used in defense of liberty: soap, ballot, jury, and ammo. Please use in that order." Ed Howdershelt 1940. On Wed, 22 May 2024, Michael Orlitzky wrote: > Is this during install? Maybe forgot to bind-mount /dev from the real > system into your chroot? > >
Re: [gentoo-user] emerge-webrsync error
Is this during install? Maybe forgot to bind-mount /dev from the real system into your chroot?
[gentoo-user] emerge-webrsync error
This one is the last two lines of output. Failed to validate a sane '/dev'. bash process substitution doesn't work; this may be an indication of a broken '/dev/fd'. What did I do wrong? -- Jude "There are four boxes to be used in defense of liberty: soap, ballot, jury, and ammo. Please use in that order." Ed Howdershelt 1940.
Re: [gentoo-user] Emerge trouble with firefox and thunderbird ...
Il 10/03/24 23:44, Walter Dnes ha scritto:
On Sun, Mar 10, 2024 at 08:43:46PM +0100, ralfconn wrote
Given the warning message reported by Peter ("Enable USE=clang unless
you have a very good reason not to.")
That message comes from sys-libs/compiler-rt which is a dedicated
runtime lib for clang. It makes sense to use clang if you're building
the clang toolchain... just like using gcc if you're building the gcc
toolchain.
Correct, my mistake. My point was that it's worth filing a bug since
it's possible that GCC support will be dropped upstream. But, the only
'news' I found on this regard [1] is quite old and it looks like GCC is
still being supported.
raf
[1]
https://blog.mozilla.org/nfroyd/2018/05/29/when-implementation-monoculture-right-thing/
Re: [gentoo-user] Emerge trouble with firefox and thunderbird ...
On Sun, Mar 10, 2024 at 08:43:46PM +0100, ralfconn wrote
> Given the warning message reported by Peter ("Enable USE=clang unless
> you have a very good reason not to.")
That message comes from sys-libs/compiler-rt which is a dedicated
runtime lib for clang. It makes sense to use clang if you're building
the clang toolchain... just like using gcc if you're building the gcc
toolchain.
--
Roses are red
Roses are blue
Depending on their velocity
Relative to you
Re: [gentoo-user] Emerge trouble with firefox and thunderbird ...
Il 10/03/24 15:08, Peter Humphrey ha scritto:
On Sunday, 10 March 2024 07:17:27 GMT Walter Dnes wrote:
So there are at least 2 people who've found out that Firefox can and
*MUST* be built with USE="-clang".
Ah. I'll change my USE flag straight away.
Thanks Walter.
This got me wondering, here I don't have clang in my make.config. The
main packages using it are:
[I] www-client/firefox
Installed versions: 123.0.1(rapid)(21:16:32 03/06/24)(X clang ...
[I] mail-client/thunderbird
Installed versions: 115.8.1(21:14:19 03/07/24)(X clang ...
[I] app-office/libreoffice
Installed versions: 7.6.5.2^t(21:42:53 03/06/24)(... -clang ...
libreoffice sees it unset because it is not present in the global uses.
firefox and thunderbird instead set it in the ebuild:
$ grep clang /var/db/repos/gentoo/www-client/firefox/firefox-123.0.ebuild
IUSE="+clang cpu_flags_arm_neon dbus debug eme-free hardened hwaccel"
$ grep clang
/var/db/repos/gentoo/mail-client/thunderbird/thunderbird-115.8.1.ebuild
IUSE="+clang cpu_flags_arm_neon dbus debug eme-free hardened hwaccel"
Both packages have no issues here with +clang. Given the warning message
reported by Peter ("Enable USE=clang unless you have a very good reason
not to.") and the fact that gentoo developers decided to switch it on
specifically for these packages it would probably be a better idea to
file a bugzilla rather than forcing the use of GCC, which might fix the
issue now but lead to problems later. As usual, YMMV.
raf
Re: [gentoo-user] Emerge trouble with firefox and thunderbird ...
On Sunday, 10 March 2024 07:17:27 GMT Walter Dnes wrote: > So there are at least 2 people who've found out that Firefox can and > *MUST* be built with USE="-clang". Ah. I'll change my USE flag straight away. Thanks Walter. -- Regards, Peter.
Re: [gentoo-user] Emerge trouble with firefox and thunderbird ...
On Sat, Mar 09, 2024 at 09:16:37PM +, Peter Humphrey wrote > On Saturday, 9 March 2024 19:37:40 GMT Walter Dnes wrote: > > > On Sat, Mar 09, 2024 at 02:45:02PM +, Peter Humphr > > The real question is what else, besides clang and its libraries, > are you building that requires clang? > > Firefox. Upstream in this same thread... On Sat, Mar 09, 2024 at 08:04:06AM +, Wols Lists wrote > On 03/03/2024 23:13, Carsten Hauck wrote: > > > > Some time ago on one of my machines Thunderbird and Firefox stopped to > > compile with USE="clang". As they can be build with gcc I never digged > > too deep into that problem but maybe it's worth a shot. > > For anyone else who hits this sort of problem, I did an > > USE=-clang emerge --update @world > > (firefox and thunderbird were the only programs I thought this would > touch), and it worked. > > There were a couple of other programs that I guess got pulled in by the > changed use, but they've upgraded which is the main thing. > > Thank you very much So there are at least 2 people who've found out that Firefox can and *MUST* be built with USE="-clang". -- Roses are red Roses are blue Depending on their velocity Relative to you
Re: [gentoo-user] Emerge trouble with firefox and thunderbird ...
On Saturday, 9 March 2024 19:37:40 GMT Walter Dnes wrote: > On Sat, Mar 09, 2024 at 02:45:02PM +, Peter Humphr > The real question is what else, besides clang and its libraries, are you > building that requires clang? Firefox. -- Regards, Peter.
Re: [gentoo-user] Emerge trouble with firefox and thunderbird ...
On Sat, Mar 09, 2024 at 02:45:02PM +, Peter Humphrey wrote > >>> Running pre-merge checks for sys-libs/compiler-rt-18.1.0 > * Building using a compiler other than clang may result in broken atomics > * library. Enable USE=clang unless you have a very good reason not to. According to https://packages.gentoo.org/packages/sys-libs/compiler-rt "sys-libs/compiler-rt" is a "Compiler runtime library for clang (built-in part)" so like... dohhh. Use clang to support clang. The real question is what else, besides clang and its libraries, are you building that requires clang? > Does the compiler-rt ebuild override USE in make.conf? You can build it with USE="-clang", but that defeats the entire purpose of building compiler-rt. -- Roses are red Roses are blue Depending on their velocity Relative to you
Re: [gentoo-user] Emerge trouble with firefox and thunderbird ...
On Saturday, 9 March 2024 12:49:33 GMT Walter Dnes wrote: > I have "-clang" in USE in make.conf and no problems resulting from it. > clang seems to be another "solution in search of a problem" along the > lines of rust and cups and systemd and hatbuzz, etc, which keep trying > to worm their way into everybody's linux system. When I tried USE=-clang emerge -uaDvN @world, I got this: [...] >>> Running pre-merge checks for sys-libs/compiler-rt-18.1.0 * Building using a compiler other than clang may result in broken atomics * library. Enable USE=clang unless you have a very good reason not to. Does the compiler-rt ebuild override USE in make.conf? -- Regards, Peter.
Re: [gentoo-user] Emerge trouble with firefox and thunderbird ...
On Sat, Mar 09, 2024 at 08:04:06AM +, Wols Lists wrote > For anyone else who hits this sort of problem, I did an > > USE=-clang emerge --update @world > > (firefox and thunderbird were the only programs I thought this would > touch), and it worked. I have "-clang" in USE in make.conf and no problems resulting from it. clang seems to be another "solution in search of a problem" along the lines of rust and cups and systemd and hatbuzz, etc, which keep trying to worm their way into everybody's linux system. -- Roses are red Roses are blue Depending on their velocity Relative to you
Re: [gentoo-user] Emerge trouble with firefox and thunderbird ...
On 03/03/2024 23:13, Carsten Hauck wrote: So I don't know what's going on, but basically Mozilla won't emerge, and I don't know why ... Cheers, Wol Did the other 19 package emerge OK? Are the mozilla progs crashing when running, or when emerging? If emerging, the log is just console output, as indecipherable as we know it sometimes can be. If they crash when running, try running from command line. Some time ago on one of my machines Thunderbird and Firefox stopped to compile with USE="clang". As they can be build with gcc I never digged too deep into that problem but maybe it's worth a shot. For anyone else who hits this sort of problem, I did an USE=-clang emerge --update @world (firefox and thunderbird were the only programs I thought this would touch), and it worked. There were a couple of other programs that I guess got pulled in by the changed use, but they've upgraded which is the main thing. Thank you very much Cheers, Wol
Re: [gentoo-user] Emerge trouble with firefox and thunderbird ...
On 04/03/2024 16:20, ralfconn wrote: Il 03/03/24 10:47, Wols Lists ha scritto: I'm getting this output from emerge --update --newuse --deep --with-bdeps=y @world Calculating dependencies... done! * Dependencies could not be completely resolved due to * the following required packages not being installed: * * >=dev-libs/icu-73.1:0/73.1= pulled in by: * www-client/firefox-115.6.0 * * Have you forgotten to do a complete update prior to depclean? The * most comprehensive command for this purpose is as follows: * * emerge --update --newuse --deep --with-bdeps=y @world * * Note that the --with-bdeps=y option is not required in many * situations. Refer to the emerge manual page (run `man emerge`) * for more information about --with-bdeps. * * Also, note that it may be necessary to manually uninstall * packages that no longer exist in the repository, since it may not * be possible to satisfy their dependencies. thewolery /usr/local/bin # icu is at 74.2 firefox failed to update ... * www-client/firefox Latest version available: 115.8.0 Latest version installed: 115.6.0 Size of files: 496,244 KiB Homepage: https://www.mozilla.com/firefox Description: Firefox Web Browser License: MPL-2.0 GPL-2 LGPL-2.1 as did thunderbird ... * mail-client/thunderbird Latest version available: 115.8.0 Latest version installed: 115.6.0 Size of files: 528,920 KiB Homepage: https://www.thunderbird.net/ Description: Thunderbird Mail Client License: MPL-2.0 GPL-2 LGPL-2.1 Andy ideas? Or is the mozilla emerge stuff slightly broken on my system? I've been having trouble with those two for the last few weeks ... Cheers, Wol Here I see: [I] www-client/firefox Available versions: (esr) 115.7.0 115.8.0 (rapid) (~)122.0.1 (~)123.0 You have 115.6.0 installed which apparently is out of tree. That may be confusing emerge. You could try to un-merge firefox, depclean and re-emerge it. Hmm ... that sounds like it's been removed from the tree, then, and emerge can't cope with stuff disappearing. Surely that's a bug? Anyways, I'll try and see what happens. I was thinking something of the sort, removing firefox that is, seeing how it goes. I'll probably try the gcc thing first, though ... if that works, then it's a simpler "let it sort itself out" approach. Cheers, Wol
Re: [gentoo-user] Emerge trouble with firefox and thunderbird ...
Il 03/03/24 10:47, Wols Lists ha scritto: I'm getting this output from emerge --update --newuse --deep --with-bdeps=y @world Calculating dependencies... done! * Dependencies could not be completely resolved due to * the following required packages not being installed: * * >=dev-libs/icu-73.1:0/73.1= pulled in by: * www-client/firefox-115.6.0 * * Have you forgotten to do a complete update prior to depclean? The * most comprehensive command for this purpose is as follows: * * emerge --update --newuse --deep --with-bdeps=y @world * * Note that the --with-bdeps=y option is not required in many * situations. Refer to the emerge manual page (run `man emerge`) * for more information about --with-bdeps. * * Also, note that it may be necessary to manually uninstall * packages that no longer exist in the repository, since it may not * be possible to satisfy their dependencies. thewolery /usr/local/bin # icu is at 74.2 firefox failed to update ... * www-client/firefox Latest version available: 115.8.0 Latest version installed: 115.6.0 Size of files: 496,244 KiB Homepage: https://www.mozilla.com/firefox Description: Firefox Web Browser License: MPL-2.0 GPL-2 LGPL-2.1 as did thunderbird ... * mail-client/thunderbird Latest version available: 115.8.0 Latest version installed: 115.6.0 Size of files: 528,920 KiB Homepage: https://www.thunderbird.net/ Description: Thunderbird Mail Client License: MPL-2.0 GPL-2 LGPL-2.1 Andy ideas? Or is the mozilla emerge stuff slightly broken on my system? I've been having trouble with those two for the last few weeks ... Cheers, Wol Here I see: [I] www-client/firefox Available versions: (esr) 115.7.0 115.8.0 (rapid) (~)122.0.1 (~)123.0 You have 115.6.0 installed which apparently is out of tree. That may be confusing emerge. You could try to un-merge firefox, depclean and re-emerge it. raf
Re: [gentoo-user] Emerge trouble with firefox and thunderbird ...
On 03/03/24 at 04:18, Jack wrote: On 2024.03.03 15:23, Wol wrote: On 03/03/2024 19:40, Jack wrote: On 2024.03.03 13:54, Wols Lists wrote: On 03/03/2024 09:47, Wols Lists wrote: I'm getting this output from emerge --update --newuse --deep --with-bdeps=y @world whoops I mean "emerge --depclean" I'm trying to get a clean system, and don't know what exactly is wrong, or what to try ... Cheers, Wol As the error says, you generally need to do a full update before you can depclean. What error(s) do you get when trying to update firefox or thunderbird? What happens if you try to update @world? Both firefox and thunderbird seemed to die for no obvious reason. Where do I find the logs? But because depclean complained, I did blah-blah-with-bdeps, which emerged (or tried to) 21 packages, but firefox/thunderbird still bombed, and then --depclean still complained. So I don't know what's going on, but basically Mozilla won't emerge, and I don't know why ... Cheers, Wol Did the other 19 package emerge OK? Are the mozilla progs crashing when running, or when emerging? If emerging, the log is just console output, as indecipherable as we know it sometimes can be. If they crash when running, try running from command line. Some time ago on one of my machines Thunderbird and Firefox stopped to compile with USE="clang". As they can be build with gcc I never digged too deep into that problem but maybe it's worth a shot. Greetings, Carsten
Re: [gentoo-user] Emerge trouble with firefox and thunderbird ...
On 2024.03.03 15:23, Wol wrote: On 03/03/2024 19:40, Jack wrote: On 2024.03.03 13:54, Wols Lists wrote: On 03/03/2024 09:47, Wols Lists wrote: I'm getting this output from emerge --update --newuse --deep --with-bdeps=y @world whoops I mean "emerge --depclean" I'm trying to get a clean system, and don't know what exactly is wrong, or what to try ... Cheers, Wol As the error says, you generally need to do a full update before you can depclean. What error(s) do you get when trying to update firefox or thunderbird? What happens if you try to update @world? Both firefox and thunderbird seemed to die for no obvious reason. Where do I find the logs? But because depclean complained, I did blah-blah-with-bdeps, which emerged (or tried to) 21 packages, but firefox/thunderbird still bombed, and then --depclean still complained. So I don't know what's going on, but basically Mozilla won't emerge, and I don't know why ... Cheers, Wol Did the other 19 package emerge OK? Are the mozilla progs crashing when running, or when emerging? If emerging, the log is just console output, as indecipherable as we know it sometimes can be. If they crash when running, try running from command line.
Re: [gentoo-user] Emerge trouble with firefox and thunderbird ...
On 03/03/2024 19:40, Jack wrote: On 2024.03.03 13:54, Wols Lists wrote: On 03/03/2024 09:47, Wols Lists wrote: I'm getting this output from emerge --update --newuse --deep --with-bdeps=y @world whoops I mean "emerge --depclean" I'm trying to get a clean system, and don't know what exactly is wrong, or what to try ... Cheers, Wol As the error says, you generally need to do a full update before you can depclean. What error(s) do you get when trying to update firefox or thunderbird? What happens if you try to update @world? Both firefox and thunderbird seemed to die for no obvious reason. Where do I find the logs? But because depclean complained, I did blah-blah-with-bdeps, which emerged (or tried to) 21 packages, but firefox/thunderbird still bombed, and then --depclean still complained. So I don't know what's going on, but basically Mozilla won't emerge, and I don't know why ... Cheers, Wol
Re: [gentoo-user] Emerge trouble with firefox and thunderbird ...
On 2024.03.03 13:54, Wols Lists wrote: On 03/03/2024 09:47, Wols Lists wrote: I'm getting this output from emerge --update --newuse --deep --with-bdeps=y @world whoops I mean "emerge --depclean" I'm trying to get a clean system, and don't know what exactly is wrong, or what to try ... Cheers, Wol As the error says, you generally need to do a full update before you can depclean. What error(s) do you get when trying to update firefox or thunderbird? What happens if you try to update @world?
Re: [gentoo-user] Emerge trouble with firefox and thunderbird ...
On 03/03/2024 09:47, Wols Lists wrote: I'm getting this output from emerge --update --newuse --deep --with-bdeps=y @world whoops I mean "emerge --depclean" I'm trying to get a clean system, and don't know what exactly is wrong, or what to try ... Cheers, Wol
[gentoo-user] Emerge trouble with firefox and thunderbird ...
I'm getting this output from emerge --update --newuse --deep --with-bdeps=y @world Calculating dependencies... done! * Dependencies could not be completely resolved due to * the following required packages not being installed: * * >=dev-libs/icu-73.1:0/73.1= pulled in by: * www-client/firefox-115.6.0 * * Have you forgotten to do a complete update prior to depclean? The * most comprehensive command for this purpose is as follows: * * emerge --update --newuse --deep --with-bdeps=y @world * * Note that the --with-bdeps=y option is not required in many * situations. Refer to the emerge manual page (run `man emerge`) * for more information about --with-bdeps. * * Also, note that it may be necessary to manually uninstall * packages that no longer exist in the repository, since it may not * be possible to satisfy their dependencies. thewolery /usr/local/bin # icu is at 74.2 firefox failed to update ... * www-client/firefox Latest version available: 115.8.0 Latest version installed: 115.6.0 Size of files: 496,244 KiB Homepage: https://www.mozilla.com/firefox Description: Firefox Web Browser License: MPL-2.0 GPL-2 LGPL-2.1 as did thunderbird ... * mail-client/thunderbird Latest version available: 115.8.0 Latest version installed: 115.6.0 Size of files: 528,920 KiB Homepage: https://www.thunderbird.net/ Description: Thunderbird Mail Client License: MPL-2.0 GPL-2 LGPL-2.1 Andy ideas? Or is the mozilla emerge stuff slightly broken on my system? I've been having trouble with those two for the last few weeks ... Cheers, Wol
Re: [gentoo-user] Emerge load again
On Sunday, 7 January 2024 00:54:12 GMT Adam Carter wrote: > > > So if it's consistently gcc that collapses to two threads, then > > > something (maybe explicit settings, maybe dependencies, maybe yadda > > > yadda) is telling make that only two jobs can run at the same time else > > > they'll trip over each other. > > > > > > Could be a dev has hard-coded the "two jobs" rule to make those random > > > crashes go away :-) Or maybe they found the problem, and that's why only > > > two jobs can run in parallel. > > > > Not so. As I said last time: 'if I set -distcc and -j12 -l12, I get 12 > > threads > > in parallel'. > > Have you checked you're not limiting jobs in /etc/distcc/hosts? ie no '/2' > after the IP address? $ cat /etc/distcc/hosts localhost/12 -- Regards, Peter.
Re: [gentoo-user] Emerge load again
> > > So if it's consistently gcc that collapses to two threads, then > > something (maybe explicit settings, maybe dependencies, maybe yadda > > yadda) is telling make that only two jobs can run at the same time else > > they'll trip over each other. > > > > Could be a dev has hard-coded the "two jobs" rule to make those random > > crashes go away :-) Or maybe they found the problem, and that's why only > > two jobs can run in parallel. > > Not so. As I said last time: 'if I set -distcc and -j12 -l12, I get 12 > threads > in parallel'. > Have you checked you're not limiting jobs in /etc/distcc/hosts? ie no '/2' after the IP address?
Re: [gentoo-user] Emerge load again
On Saturday, 6 January 2024 19:31:59 GMT Wols Lists wrote: > On 06/01/2024 17:52, Peter Humphrey wrote: > >> In other cases, there may be a hundred separate tasks, make fires off a > >> hundred tasks shared amongst all the resource it can find, and sits back > >> and waits. > > > > And that's how the very first installation goes, with single-host distcc. > > Then, when it gets to gcc, it collapses to 2 threads and everything > > gained so far is lost many-fold. (I set USE=-fortran to avoid pointless > > recompilation, since nothing needs it here.) > > So if it's consistently gcc that collapses to two threads, then > something (maybe explicit settings, maybe dependencies, maybe yadda > yadda) is telling make that only two jobs can run at the same time else > they'll trip over each other. > > Could be a dev has hard-coded the "two jobs" rule to make those random > crashes go away :-) Or maybe they found the problem, and that's why only > two jobs can run in parallel. Not so. As I said last time: 'if I set -distcc and -j12 -l12, I get 12 threads in parallel'. -- Regards, Peter.
Re: [gentoo-user] Emerge load again
On 06/01/2024 17:52, Peter Humphrey wrote: In other cases, there may be a hundred separate tasks, make fires off a hundred tasks shared amongst all the resource it can find, and sits back and waits. And that's how the very first installation goes, with single-host distcc. Then, when it gets to gcc, it collapses to 2 threads and everything gained so far is lost many-fold. (I set USE=-fortran to avoid pointless recompilation, since nothing needs it here.) So if it's consistently gcc that collapses to two threads, then something (maybe explicit settings, maybe dependencies, maybe yadda yadda) is telling make that only two jobs can run at the same time else they'll trip over each other. Could be a dev has hard-coded the "two jobs" rule to make those random crashes go away :-) Or maybe they found the problem, and that's why only two jobs can run in parallel. Cheers, Wol
Re: [gentoo-user] Emerge load again
On Saturday, 6 January 2024 15:28:53 GMT Wols Lists wrote: > As far as I'm aware, there's no mystery. On a single machine you get the > exact same thing ... it's all down to parallelism. > > Make asks itself "how many separate tasks can I do at the same time, > which won't interfere with each other". In gcc's case, the answer > appears to be two. It doesn't matter how much resource is available, > make can only make use of two cores. Yet, if I set -distcc and -j12 -l12, I get 12 threads in parallel. That's the mystery. > In other cases, there may be a hundred separate tasks, make fires off a > hundred tasks shared amongst all the resource it can find, and sits back > and waits. And that's how the very first installation goes, with single-host distcc. Then, when it gets to gcc, it collapses to 2 threads and everything gained so far is lost many-fold. (I set USE=-fortran to avoid pointless recompilation, since nothing needs it here.) > Think of a hundred compile jobs all running at the same time, but then > the linker is invoked, and you can only have the one linker running, > after all the compile jobs have finished. I hadn't thought of that - another thing to consider. > And this is a HARD problem, I haven't seen it recently, but there used > to be plenty of threads about hard-to-debug compile failures that went > away with -j1. The obvious cause was two compile jobs being set off in > parallel, when in reality one depended on the other, and things messed up. I haven't either - seen it recently. -- Regards, Peter.
Re: [gentoo-user] Emerge load again
On 29/11/2023 12:06, Peter Humphreey wrote: The contribution of distcc isn't clear to me yet, as I said before. Sometimes it's the bee's knees; other times it might just as well not be there. I don't like mysteries... 🙂 As far as I'm aware, there's no mystery. On a single machine you get the exact same thing ... it's all down to parallelism. Make asks itself "how many separate tasks can I do at the same time, which won't interfere with each other". In gcc's case, the answer appears to be two. It doesn't matter how much resource is available, make can only make use of two cores. In other cases, there may be a hundred separate tasks, make fires off a hundred tasks shared amongst all the resource it can find, and sits back and waits. Think of a hundred compile jobs all running at the same time, but then the linker is invoked, and you can only have the one linker running, after all the compile jobs have finished. And this is a HARD problem, I haven't seen it recently, but there used to be plenty of threads about hard-to-debug compile failures that went away with -j1. The obvious cause was two compile jobs being set off in parallel, when in reality one depended on the other, and things messed up. Cheers, Wol
Re: [gentoo-user] Emerge load again
On Saturday, 6 January 2024 11:44:20 GMT Michael wrote: > On Wednesday, 29 November 2023 12:06:15 GMT Peter Humphreey wrote: > > On Wednesday, 29 November 2023 10:26:36 GMT Michael wrote: > > > Here's my hypothesis explaining your own observation with libreoffice. > > > As > > > a package or more finished emerging, libreoffice's turn comes up. Soon > > > libreoffice starts to execute make jobs, but any of the following may > > > apply: > > > > > > 1. There are only 4 out of 30 jobs available, because other packages are > > > already using 26, throughout your window of observation. > > > > Nope. Nothing else in progress. > > > > > 2. Libreoffice sequencing of make jobs is mostly linear with succeeding > > > make jobs waiting on output from their predecessors. > > > > That's possible, but it doesn't seem likely with such a huge code base. > > And > > why four processes, specifically and consistently? > > > > > 3. Libreoffice source code is not optimised for high parallelism - I > > > recall > > > when it was hardcoded at -j1 just a few years ago. Before this > > > restriction > > > was added, any bug reporters were advised to try again after limiting > > > make > > > to -j1. > > > > Yes, that was common to many packages for a long time because of > > incomplete > > optimisation. > > > > > Next time I'm building libreoffice on a beefier system I'll keep an eye > > > out > > > for the number of jobs to see what it gets up to. > > > > That would help, yes. > > OK, I eventually got around to it. I am observing right now LO is building > with as many as 24 jobs: > > top - 11:14:59 up 2:19, 2 users, load average: 24.46, 23.15, 9.51 > Tasks: 474 total, 25 running, 449 sleeping, 0 stopped, 0 zombie > %Cpu(s): 0.2 us, 5.6 sy, 94.0 ni, 0.2 id, 0.0 wa, 0.0 hi, 0.0 si, 0.0 > st > MiB Mem : 64217.1 total, 50028.6 free, 6233.7 used, 7954.9 buff/cache > MiB Swap: 0.0 total, 0.0 free, 0.0 used. 54333.4 avail Mem > > I don't use distcc. The make -j25 -l24.8 I have specified is respected. Interesting. Thanks. > > The contribution of distcc isn't clear to me yet, as I said before. > > Sometimes it's the bee's knees; other times it might just as well not be > > there. I don't like mysteries... :) I've decided to ditch distcc altogether. During the very first build, what it grants with one hand it takes away double with the other - lots of tiny jobs all started together, but then gcc is sompiled with just two threads. That just-two happens on at least two different machines (not just separate; different). The position is no better in regular maintenance: no matter how many /make/ tasks are needed, I get just two threads compiling at a time. (I'm referring to the single-host arrangement I mentioned at the start.) I'm baffled, and I don't like it; I much prefer understanding to mystery. -- Regards, Peter.
Re: [gentoo-user] Emerge load again
On Wednesday, 29 November 2023 12:06:15 GMT Peter Humphreey wrote: > On Wednesday, 29 November 2023 10:26:36 GMT Michael wrote: > > Here's my hypothesis explaining your own observation with libreoffice. As > > a package or more finished emerging, libreoffice's turn comes up. Soon > > libreoffice starts to execute make jobs, but any of the following may > > apply: > > > > 1. There are only 4 out of 30 jobs available, because other packages are > > already using 26, throughout your window of observation. > > Nope. Nothing else in progress. > > > 2. Libreoffice sequencing of make jobs is mostly linear with succeeding > > make jobs waiting on output from their predecessors. > > That's possible, but it doesn't seem likely with such a huge code base. And > why four processes, specifically and consistently? > > > 3. Libreoffice source code is not optimised for high parallelism - I > > recall > > when it was hardcoded at -j1 just a few years ago. Before this > > restriction > > was added, any bug reporters were advised to try again after limiting make > > to -j1. > > Yes, that was common to many packages for a long time because of incomplete > optimisation. > > > Next time I'm building libreoffice on a beefier system I'll keep an eye > > out > > for the number of jobs to see what it gets up to. > > That would help, yes. OK, I eventually got around to it. I am observing right now LO is building with as many as 24 jobs: top - 11:14:59 up 2:19, 2 users, load average: 24.46, 23.15, 9.51 Tasks: 474 total, 25 running, 449 sleeping, 0 stopped, 0 zombie %Cpu(s): 0.2 us, 5.6 sy, 94.0 ni, 0.2 id, 0.0 wa, 0.0 hi, 0.0 si, 0.0 st MiB Mem : 64217.1 total, 50028.6 free, 6233.7 used, 7954.9 buff/cache MiB Swap: 0.0 total, 0.0 free, 0.0 used. 54333.4 avail Mem I don't use distcc. The make -j25 -l24.8 I have specified is respected. > The contribution of distcc isn't clear to me yet, as I said before. > Sometimes it's the bee's knees; other times it might just as well not be > there. I don't like mysteries... :) signature.asc Description: This is a digitally signed message part.
Re: [gentoo-user] emerge -c being strange
On 2023.12.30 18:21, Peter Humphrey wrote: On Saturday, 30 December 2023 21:10:10 GMT Jack wrote: > I have both wine-vanilla 8.0.2 (stable) and 8.1.2 (testing) installed. > "emerge -c wine-vanilla" would remove both of them. "emerge -c > wine-vanilla:8.21" refuses, claiming > > app-emulation/wine-vanilla-8.21 pulled in by: > virtual/wine-0-r10 requires > app-emulation/wine-vanilla[abi_x86_32,abi_x86_64] > > Although it is perfectly happy with "emerge -c wine-vanilla:8.0.2". > > Is this a bug, or is it considered reasonable for portage to have a > virtual absolutely insist on keeping the newest installed version if > several slots are available? No, it's how it's supposed to work. Portage removed one version of wine because the virtual was still satisfied. It wouldn't remove the last remaining version: you need to uninstall the virtual first. Sorry, but I did NOT actually remove 8.0.2, I was only checking what it WOULD remove. With both installed, portage is OK to remove both or the older one, but not the newer one.
Re: [gentoo-user] emerge -c being strange
On Saturday, 30 December 2023 21:10:10 GMT Jack wrote: > I have both wine-vanilla 8.0.2 (stable) and 8.1.2 (testing) installed. > "emerge -c wine-vanilla" would remove both of them. "emerge -c > wine-vanilla:8.21" refuses, claiming > > app-emulation/wine-vanilla-8.21 pulled in by: > virtual/wine-0-r10 requires > app-emulation/wine-vanilla[abi_x86_32,abi_x86_64] > > Although it is perfectly happy with "emerge -c wine-vanilla:8.0.2". > > Is this a bug, or is it considered reasonable for portage to have a > virtual absolutely insist on keeping the newest installed version if > several slots are available? No, it's how it's supposed to work. Portage removed one version of wine because the virtual was still satisfied. It wouldn't remove the last remaining version: you need to uninstall the virtual first. -- Regards, Peter.
[gentoo-user] emerge -c being strange
I have both wine-vanilla 8.0.2 (stable) and 8.1.2 (testing) installed. "emerge -c wine-vanilla" would remove both of them. "emerge -c wine-vanilla:8.21" refuses, claiming app-emulation/wine-vanilla-8.21 pulled in by: virtual/wine-0-r10 requires app-emulation/wine-vanilla[abi_x86_32,abi_x86_64] Although it is perfectly happy with "emerge -c wine-vanilla:8.0.2". Is this a bug, or is it considered reasonable for portage to have a virtual absolutely insist on keeping the newest installed version if several slots are available? Jack
Re: [gentoo-user] emerge consistently 'hangs' on kernel/gentoo-sources
Michael responded to me off list, and wrote: On Sun, Dec 17, 2023 at 10:08:49AM -0500, Michael wrote in <675d0538-292f-40de-95c0-446641611...@gmail.com>: I assume you have a script in /etc/portage/env/sys-kernel to build the kernel during normal emerge, this is getting stuck because genkernel is calling another emerge instance and the hook is holding a lock. genkernel needs to be called with --no-module-rebuild in that case, then you need to manually call emerge @module-rebuild I tried "genkernel --no-module-rebuild --kernel-config=/etc/kernels/kernel-config-6.1.19-gentoo-x86_64 all" and this did result in a succesful compilation. Doing an emerge afterwards finished emerging the last four remaining packages. Will see if this fixes it going forward as well! Thank you all for the suggestions!
Re: [gentoo-user] emerge consistently 'hangs' on kernel/gentoo-sources
Il 17/12/23 15:17, Remco Rijnders ha scritto: Hi all, I've tried googling and didn't get very far so am afraid this might not be a common thing... Since a number of months, emerge hangs when doing a upgrade as soon as it gets to the package gentoo-sources: Installing (23 of 27) sys-kernel/gentoo-sources-6.1.67::gentoo * If you are upgrading from a previous kernel, you may be interested * in the following document: * - General upgrade guide: https://wiki.gentoo.org/wiki/Kernel/Upgrade * For more info on this patchset, and how to report problems, see: * https://dev.gentoo.org/~mpagano/genpatches WARNING: Will unset existing variable 'TMPDIR' to avoid clashing with genkernel config ... WARNING: Will unset existing variable 'CHOST' to avoid clashing with genkernel config ... * Gentoo Linux Genkernel; Version 4.3.6 * Using genkernel configuration from '/etc/genkernel.conf' ... * Running with options: --kernel-config=/etc/kernels/kernel-config-6.1.19-gentoo-x86_64 all * Working with Linux kernel 6.1.67-gentoo for x86_64 * Using kernel config file '/etc/kernels/kernel-config-6.1.19-gentoo-x86_64' ... * * Note: The version above is subject to change (depends on config and status of kernel sources). * kernel: >> Initializing ... * >> Running 'make mrproper' ... * >> Running 'make oldconfig' ... * >> Kernel version has changed (probably due to config change) since genkernel start: * We are now building Linux kernel 6.1.67-gentoo-x86_64 for x86_64 ... * >> Compiling 6.1.67-gentoo-x86_64 bzImage ... * >> Compiling 6.1.67-gentoo-x86_64 modules ... * >> Installing 6.1.67-gentoo-x86_64 modules (and stripping) ... * >> Generating module dependency data ... * >> Compiling out-of-tree module(s) ... It is consistent every time and at the same point. It has been stuck there for 24 hours now. Pressing Ctrl-C takes me back to the command line with no error indication. Computer load is low, and this is the process tree for emerge: root 19590 0.0 0.0 7916 4264 pts/5 S 09:15 0:00 | \_ bash root 19936 0.6 1.9 322620 314152 pts/5 SN+ 09:16 1:17 | \_ /usr/bin/python3.11 /usr/lib/python-exec/python3.11/emerge --ask --update --newuse --de ep @world root 8996 0.1 1.8 324220 308860 pts/5 SN+ 09:40 0:20 | \_ /usr/bin/python3.11 /usr/lib/python-exec/python3.11/emerge --ask --update --newuse --deep @world root 9142 0.0 0.0 10892 7148 pts/5 SN+ 09:40 0:00 | \_ bash /usr/lib/portage/python3.11/ebuild.sh postinst root 9153 0.0 0.0 10892 5992 pts/5 SN+ 09:40 0:00 | \_ bash /usr/lib/portage/python3.11/ebuild.sh postinst root 9196 0.0 0.0 12724 9024 pts/5 SN+ 09:40 0:00 | \_ /bin/bash /usr/bin/genkernel --kernel-config=/etc/kernels/kernel-config -6.1.19-gentoo-x86_64 all root 31236 0.0 0.4 71804 67416 pts/5 SN+ 10:03 0:00 | \_ /usr/bin/python3.11 /usr/lib/python-exec/python3.11/emerge --ignore -default-opts --buildpkg=n --usepkg=n --quiet-build=y @module-rebuild Anyone has any ideas what might be wrong? I don't use genkernel so just a guess. It looks like the kernel got build and installed but genkernel is stuck 'building out of tree module'. Maybe it is trying to fetch some code and not managing to? Try checking /var/log/emerge-fetch.log raf
[gentoo-user] emerge consistently 'hangs' on kernel/gentoo-sources
Hi all, I've tried googling and didn't get very far so am afraid this might not be a common thing... Since a number of months, emerge hangs when doing a upgrade as soon as it gets to the package gentoo-sources: Installing (23 of 27) sys-kernel/gentoo-sources-6.1.67::gentoo * If you are upgrading from a previous kernel, you may be interested * in the following document: * - General upgrade guide: https://wiki.gentoo.org/wiki/Kernel/Upgrade * For more info on this patchset, and how to report problems, see: * https://dev.gentoo.org/~mpagano/genpatches WARNING: Will unset existing variable 'TMPDIR' to avoid clashing with genkernel config ... WARNING: Will unset existing variable 'CHOST' to avoid clashing with genkernel config ... * Gentoo Linux Genkernel; Version 4.3.6 * Using genkernel configuration from '/etc/genkernel.conf' ... * Running with options: --kernel-config=/etc/kernels/kernel-config-6.1.19-gentoo-x86_64 all * Working with Linux kernel 6.1.67-gentoo for x86_64 * Using kernel config file '/etc/kernels/kernel-config-6.1.19-gentoo-x86_64' ... * * Note: The version above is subject to change (depends on config and status of kernel sources). * kernel: >> Initializing ... * >> Running 'make mrproper' ... * >> Running 'make oldconfig' ... * >> Kernel version has changed (probably due to config change) since genkernel start: *We are now building Linux kernel 6.1.67-gentoo-x86_64 for x86_64 ... * >> Compiling 6.1.67-gentoo-x86_64 bzImage ... * >> Compiling 6.1.67-gentoo-x86_64 modules ... * >> Installing 6.1.67-gentoo-x86_64 modules (and stripping) ... * >> Generating module dependency data ... * >> Compiling out-of-tree module(s) ... It is consistent every time and at the same point. It has been stuck there for 24 hours now. Pressing Ctrl-C takes me back to the command line with no error indication. Computer load is low, and this is the process tree for emerge: root 19590 0.0 0.0 7916 4264 pts/5S09:15 0:00 | \_ bash root 19936 0.6 1.9 322620 314152 pts/5 SN+ 09:16 1:17 | \_ /usr/bin/python3.11 /usr/lib/python-exec/python3.11/emerge --ask --update --newuse --de ep @world root 8996 0.1 1.8 324220 308860 pts/5 SN+ 09:40 0:20 | \_ /usr/bin/python3.11 /usr/lib/python-exec/python3.11/emerge --ask --update --newuse --deep @world root 9142 0.0 0.0 10892 7148 pts/5SN+ 09:40 0:00 | \_ bash /usr/lib/portage/python3.11/ebuild.sh postinst root 9153 0.0 0.0 10892 5992 pts/5SN+ 09:40 0:00 | \_ bash /usr/lib/portage/python3.11/ebuild.sh postinst root 9196 0.0 0.0 12724 9024 pts/5SN+ 09:40 0:00 | \_ /bin/bash /usr/bin/genkernel --kernel-config=/etc/kernels/kernel-config -6.1.19-gentoo-x86_64 all root 31236 0.0 0.4 71804 67416 pts/5SN+ 10:03 0:00 | \_ /usr/bin/python3.11 /usr/lib/python-exec/python3.11/emerge --ignore -default-opts --buildpkg=n --usepkg=n --quiet-build=y @module-rebuild Anyone has any ideas what might be wrong?
Re: [gentoo-user] Emerge load again
On Wednesday, 29 November 2023 14:12:39 GMT John Blinka wrote: > On Mon, Nov 27, 2023 at 10:39 AM Peter Humphreey > wrote:l > > > What am I missing? > > I have much less powerful hardware than you but libreoffice (as a > stand-alone build) generates many more threads than 4 on my “cluster”. I’m > also using distcc. > > On the main box, I set > MAKEOPTS=“-j17 -l6” > On the other two less powerful ones -l is 5 and 3, but -j is the same. > > On the main box, /etc/distcc/hosts contains > localhost/11 sophie/5,lzo tobey/3,lzo —localslots=11 —localslots_cpp=11 > > On sophie and tobey (my less powerful boxes) the hosts file contains > something similar but specific to those boxes. The localslots and > localslots_cpp numbers are 3 on tobey and 5 on sophie, and the order in > which the machines are mentioned changes (local machine first, then remote > machines in order of power). > > This configuration is the result of a lot of experimentation rather than > just a theoretical calculation. The various guides that discuss how to tune > these numbers for best performance were modestly helpful in explaining what > the tuning parameters mean, but experimenting and watching the resulting > performance was the best teacher. > > Hope this helps. > > John Blinka I don't use distcc, so I can't add anything useful to its application on Peter's requirements, but a quick test by Peter would be to start a single emerge of libreoffice on its own and observe if it is still limited to 4 threads with and without distcc. signature.asc Description: This is a digitally signed message part.
Re: [gentoo-user] Emerge load again
On Mon, Nov 27, 2023 at 10:39 AM Peter Humphreey wrote:l > > What am I missing? I have much less powerful hardware than you but libreoffice (as a stand-alone build) generates many more threads than 4 on my “cluster”. I’m also using distcc. On the main box, I set MAKEOPTS=“-j17 -l6” On the other two less powerful ones -l is 5 and 3, but -j is the same. On the main box, /etc/distcc/hosts contains localhost/11 sophie/5,lzo tobey/3,lzo —localslots=11 —localslots_cpp=11 On sophie and tobey (my less powerful boxes) the hosts file contains something similar but specific to those boxes. The localslots and localslots_cpp numbers are 3 on tobey and 5 on sophie, and the order in which the machines are mentioned changes (local machine first, then remote machines in order of power). This configuration is the result of a lot of experimentation rather than just a theoretical calculation. The various guides that discuss how to tune these numbers for best performance were modestly helpful in explaining what the tuning parameters mean, but experimenting and watching the resulting performance was the best teacher. Hope this helps. John Blinka
Re: [gentoo-user] Emerge load again
On Wednesday, 29 November 2023 10:26:36 GMT Michael wrote: > Here's my hypothesis explaining your own observation with libreoffice. As a > package or more finished emerging, libreoffice's turn comes up. Soon > libreoffice starts to execute make jobs, but any of the following may > apply: > > 1. There are only 4 out of 30 jobs available, because other packages are > already using 26, throughout your window of observation. Nope. Nothing else in progress. > 2. Libreoffice sequencing of make jobs is mostly linear with succeeding make > jobs waiting on output from their predecessors. That's possible, but it doesn't seem likely with such a huge code base. And why four processes, specifically and consistently? > 3. Libreoffice source code is not optimised for high parallelism - I recall > when it was hardcoded at -j1 just a few years ago. Before this restriction > was added, any bug reporters were advised to try again after limiting make > to -j1. Yes, that was common to many packages for a long time because of incomplete optimisation. > Next time I'm building libreoffice on a beefier system I'll keep an eye out > for the number of jobs to see what it gets up to. That would help, yes. The contribution of distcc isn't clear to me yet, as I said before. Sometimes it's the bee's knees; other times it might just as well not be there. I don't like mysteries... :) -- Regards, Peter.
Re: [gentoo-user] Emerge load again
On Monday, 27 November 2023 15:39:33 GMT Peter Humphreey wrote: > Hello list, > > I still can't see how portage limits the load. Today I'm emerging > libreoffice, and it's spending almost the whole time working with 4 CPU > threads. But: > > $ grep -e '\-j' -e distcc /etc/portage/make.conf > EMERGE_DEFAULT_OPTS="--jobs=18 --load-average=30 --backtrack=200 -- > autounmask=n --keep-going --nospinner" > FEATURES="distcc userfetch buildpkg network-sandbox parallel-install sandbox > userpriv usersandbox" > MAKEOPTS="-j18" > > I found a suggestion to use distcc in the installation handbook, which I > hadn't seen there before, so I went searching for it and found how to do it. > It usually works well, in this case starting 18 packages before starting LO > itself. grep -rw doesn't find '4' anywere relevant under /etc/portage/ . > Other times it just doesn't help at all. > > What am I missing? In absence of other contributions I'll offer a theoretical explanation, based on random observations on my systems. You have specified as many as 18 packages to be emerged in parallel x up to 18 make jobs each. The result of [18 x 18 = 324] is to be limited by a total load average of 30. If there were more than 18 packages listed to be emerged and there were no dependencies between them to restrict how many could start emerging in parallel, you would observe =<18 packages being emerged in parallel. This alone will not breach the load limit of 30. Let's assume all 18 packages had a large codebase to need at least 18 make jobs each. Sooner or later you'd have 18 parallel emerges all trying to run 18 make jobs. Were this to occur the load limit restriction would kick in and you would see only up to 30 jobs listed in top, with individual package processes alternating in the top list of make threads. Here's my hypothesis explaining your own observation with libreoffice. As a package or more finished emerging, libreoffice's turn comes up. Soon libreoffice starts to execute make jobs, but any of the following may apply: 1. There are only 4 out of 30 jobs available, because other packages are already using 26, throughout your window of observation. 2. Libreoffice sequencing of make jobs is mostly linear with succeeding make jobs waiting on output from their predecessors. 3. Libreoffice source code is not optimised for high parallelism - I recall when it was hardcoded at -j1 just a few years ago. Before this restriction was added, any bug reporters were advised to try again after limiting make to -j1. Next time I'm building libreoffice on a beefier system I'll keep an eye out for the number of jobs to see what it gets up to. signature.asc Description: This is a digitally signed message part.
[gentoo-user] Emerge load again
Hello list, I still can't see how portage limits the load. Today I'm emerging libreoffice, and it's spending almost the whole time working with 4 CPU threads. But: $ grep -e '\-j' -e distcc /etc/portage/make.conf EMERGE_DEFAULT_OPTS="--jobs=18 --load-average=30 --backtrack=200 -- autounmask=n --keep-going --nospinner" FEATURES="distcc userfetch buildpkg network-sandbox parallel-install sandbox userpriv usersandbox" MAKEOPTS="-j18" I found a suggestion to use distcc in the installation handbook, which I hadn't seen there before, so I went searching for it and found how to do it. It usually works well, in this case starting 18 packages before starting LO itself. grep -rw doesn't find '4' anywere relevant under /etc/portage/ . Other times it just doesn't help at all. What am I missing? -- Regards, Peter.
Re: [gentoo-user] Emerge -K ignoring new packages
On Tuesday, 21 November 2023 08:24:31 GMT Neil Bothwick wrote: > On Tue, 21 Nov 2023 03:24:20 +, Peter Humphrey wrote: > > > Default location for binary packages is /var/cache/binpkgs/ > > > > Oh? When did that change? > > It may not have on your system. To check the location, run > > portageq pkgdir I know where it is because I set it to the recommended place when portage was moved out of /usr. I just wondered when, and why, it had been changed. It will stay where it is, here, if only because 'binpkgs' is harder to type than 'packages'. -- Regards, Peter.
Re: [gentoo-user] Emerge -K ignoring new packages
On Tue, 21 Nov 2023 03:24:20 +, Peter Humphrey wrote: > > Default location for binary packages is /var/cache/binpkgs/ > > Oh? When did that change? It may not have on your system. To check the location, run portageq pkgdir -- Neil Bothwick pgpvxJd2Rwpxc.pgp Description: OpenPGP digital signature
Re: [gentoo-user] Emerge -K ignoring new packages
On Monday, 20 November 2023 17:12:04 GMT Vitaliy Perekhovy wrote: > On Mon, Nov 20, 2023 at 05:07:45PM +, Peter Humphrey wrote: > > Hello list, > > > > Now that I have my NFS set up (with help - thanks) the next problem is > > that, having new packages built by my workstation over NFS, emerge on the > > tiny box is ignoring all those new packages. And yes, I have checked that > > they do exist, and in the right place: /var/cache/packages/ . > > > > The man page says that any new package will cause a remerge, so what has > > tripped me up this time? > > Default location for binary packages is /var/cache/binpkgs/ Oh? When did that change? -- Regards, Peter.
RE: [gentoo-user] Emerge -K ignoring new packages
> -Original Message- > From: Wols Lists > Sent: Monday, November 20, 2023 9:46 AM > To: gentoo-user@lists.gentoo.org > Subject: Re: [gentoo-user] Emerge -K ignoring new packages > > On 20/11/2023 17:12, Vitaliy Perekhovy wrote: > > On Mon, Nov 20, 2023 at 05:07:45PM +, Peter Humphrey wrote: > >> Hello list, > >> > >> Now that I have my NFS set up (with help - thanks) the next problem > >> is that, having new packages built by my workstation over NFS, emerge > >> on the tiny box is ignoring all those new packages. And yes, I have > >> checked that they do exist, and in the right place: /var/cache/packages/ . > >> > >> The man page says that any new package will cause a remerge, so what > >> has tripped me up this time? > >> > >> -- > >> Regards, > >> Peter. > > > > Default location for binary packages is /var/cache/binpkgs/ > > > Can't remember what I did, but the first thing to check is you're using the > same make flags (unless of course, you're sharing /etc/portage). > > Then I seem to remember using -bK or something like that. So the command I'm > giving emerge is "use a binary if you can find it, otherwise build it". > > Because I might emerge packages on either machine, that worked great for me. > And I actually usually emerged stuff on the slower machine, because it was > more reliable ... :-) > > Cheers, > Wol > -K is "binpkg or nothing" and will abort if the entire list of packages aren't available in binpkg form. -k will use binpackages if available and build otherwise. Beware of creating binpackages for anything in the virtual/* category. No good can come of it. LMP
Re: [gentoo-user] Emerge -K ignoring new packages
On 20/11/2023 17:12, Vitaliy Perekhovy wrote: On Mon, Nov 20, 2023 at 05:07:45PM +, Peter Humphrey wrote: Hello list, Now that I have my NFS set up (with help - thanks) the next problem is that, having new packages built by my workstation over NFS, emerge on the tiny box is ignoring all those new packages. And yes, I have checked that they do exist, and in the right place: /var/cache/packages/ . The man page says that any new package will cause a remerge, so what has tripped me up this time? -- Regards, Peter. Default location for binary packages is /var/cache/binpkgs/ Can't remember what I did, but the first thing to check is you're using the same make flags (unless of course, you're sharing /etc/portage). Then I seem to remember using -bK or something like that. So the command I'm giving emerge is "use a binary if you can find it, otherwise build it". Because I might emerge packages on either machine, that worked great for me. And I actually usually emerged stuff on the slower machine, because it was more reliable ... :-) Cheers, Wol
Re: [gentoo-user] Emerge -K ignoring new packages
On Mon, Nov 20, 2023 at 05:07:45PM +, Peter Humphrey wrote: > Hello list, > > Now that I have my NFS set up (with help - thanks) the next problem is that, > having new packages built by my workstation over NFS, emerge on the tiny box > is ignoring all those new packages. And yes, I have checked that they do > exist, and in the right place: /var/cache/packages/ . > > The man page says that any new package will cause a remerge, so what has > tripped me up this time? > > -- > Regards, > Peter. > > > > Default location for binary packages is /var/cache/binpkgs/ -- Regards, Vitaliy Perekhovy signature.asc Description: PGP signature
[gentoo-user] Emerge -K ignoring new packages
Hello list, Now that I have my NFS set up (with help - thanks) the next problem is that, having new packages built by my workstation over NFS, emerge on the tiny box is ignoring all those new packages. And yes, I have checked that they do exist, and in the right place: /var/cache/packages/ . The man page says that any new package will cause a remerge, so what has tripped me up this time? -- Regards, Peter.
Re: [gentoo-user] emerge conflict. Need help. ffmpeg, kpipewire, handbrake, ffmpegthumbnailer and others.
On Sun, 4 Jun 2023 22:21:54 +0200, Arve Barsnes wrote: > > Doing my updates, most things updated but some still have conflicts. > > Emerge is trying to tell me but I use Konsole and I think it messes up > > the ^ bit and points to the wrong thing. I'm thinking this is a > > USE flag problem but I can't tell for sure. Anyone else recognize > > this and make sense of it? I recently switched to the pipewire thing > > and that could be part of it, maybe. It's among those mentioned at > > least. > > > > Ideas? Thoughts?? > > It seems opencascade and handbrake are the culprits for you, blocking > the ffmpeg upgrade, in your output they require a newer handbrake version that uses ffmpeg 5, but it is not in > ::gentoo, so maybe check for a newer version in an overlay or on > b.g.o. According to b.g.o the version of HandBrake works with the new ffmpeg. I just package.masked ffmpeg-5.1.3 for now. > Maybe the same is true for opencascade. libopenshot is also affected here. -- Neil Bothwick Quick!! Act as if nothing has happened! pgpY75FtiO_Y2.pgp Description: OpenPGP digital signature
Re: [gentoo-user] emerge conflict. Need help. ffmpeg, kpipewire, handbrake, ffmpegthumbnailer and others.
Jack wrote: > On 2023.06.04 17:22, Dale wrote: >> Jack wrote: >> > On 2023.06.04 15:56, Dale wrote: >> > >> >> Doing my updates, most things updated but some still have conflicts. >> >> Emerge is trying to tell me but I use Konsole and I think it messes >> >> up the ^ bit and points to the wrong thing. >> > I suspect the ^ assumes a fixed width font. >> > >> > >> >> >> I suspect it is that or expecting a console or something. There may be >> a setting to make it work in Konsole but I have no idea what it would be >> or where to look even. It's always been that way. Either way, it >> rarely points to the right spot which makes it useless when trying to >> decode what emerge is saying. > It doesn't matter where you are looking at that output, it just counts > characters to put the ^^^ under what it is supposed to point to. That > only LOOKS right if you use a monospace or fixed width font. Works > the same in a terminal or text editor or email reader. > > In Konsole, it's under Settings/Edit Profiles/pick and edit the > profile, click Appearance on the left, and pick an appropriate font > near the bottom. >> >> Maybe one day. Maybe. >> >> Dale >> >> :-) :-) >> >> >> > > > I made a change. See if it helps next time. It was set to the default which is easy for me to read but never heard of the font. Thanks. Dale :-) :-)
Re: [gentoo-user] emerge conflict. Need help. ffmpeg, kpipewire, handbrake, ffmpegthumbnailer and others.
On 2023.06.04 17:22, Dale wrote: Jack wrote: > On 2023.06.04 15:56, Dale wrote: > >> Doing my updates, most things updated but some still have conflicts. >> Emerge is trying to tell me but I use Konsole and I think it messes >> up the ^ bit and points to the wrong thing. > I suspect the ^ assumes a fixed width font. > > I suspect it is that or expecting a console or something. There may be a setting to make it work in Konsole but I have no idea what it would be or where to look even. It's always been that way. Either way, it rarely points to the right spot which makes it useless when trying to decode what emerge is saying. It doesn't matter where you are looking at that output, it just counts characters to put the ^^^ under what it is supposed to point to. That only LOOKS right if you use a monospace or fixed width font. Works the same in a terminal or text editor or email reader. In Konsole, it's under Settings/Edit Profiles/pick and edit the profile, click Appearance on the left, and pick an appropriate font near the bottom. Maybe one day. Maybe. Dale :-) :-)
Re: [gentoo-user] emerge conflict. Need help. ffmpeg, kpipewire, handbrake, ffmpegthumbnailer and others.
Jack wrote: > On 2023.06.04 15:56, Dale wrote: > >> Doing my updates, most things updated but some still have conflicts. >> Emerge is trying to tell me but I use Konsole and I think it messes >> up the ^ bit and points to the wrong thing. > I suspect the ^ assumes a fixed width font. > > I suspect it is that or expecting a console or something. There may be a setting to make it work in Konsole but I have no idea what it would be or where to look even. It's always been that way. Either way, it rarely points to the right spot which makes it useless when trying to decode what emerge is saying. Maybe one day. Maybe. Dale :-) :-)
Re: [gentoo-user] emerge conflict. Need help. ffmpeg, kpipewire, handbrake, ffmpegthumbnailer and others.
Arve Barsnes wrote: > On Sun, 4 Jun 2023 at 21:56, Dale wrote: >> Howdy, >> >> Doing my updates, most things updated but some still have conflicts. >> Emerge is trying to tell me but I use Konsole and I think it messes up >> the ^ bit and points to the wrong thing. I'm thinking this is a USE >> flag problem but I can't tell for sure. Anyone else recognize this and >> make sense of it? I recently switched to the pipewire thing and that >> could be part of it, maybe. It's among those mentioned at least. >> >> Ideas? Thoughts?? > It seems opencascade and handbrake are the culprits for you, blocking > the ffmpeg upgrade, in your output they require a newer handbrake version that uses ffmpeg 5, but it is not in > ::gentoo, so maybe check for a newer version in an overlay or on > b.g.o. Maybe the same is true for opencascade. > > I was thinking that was what it was saying at first but nothing newer was in the tree that was masked/keyworded so I thought I was just not reading it right. Then I couldn't figure out what USE flag it was complaining about either. It seems my first thought was right but odd there is a dependency on something not in the tree. I may just mask the newer ffmpeg until the tree catches up. I won't update until next weekend anyway, or the next if I'm busy. I'll see what I can figure out the torrent problem. May be a similar problem. Thanks much for shedding some light on this. I was scratching my head pretty good. lol Dale :-) :-)
Re: [gentoo-user] emerge conflict. Need help. ffmpeg, kpipewire, handbrake, ffmpegthumbnailer and others.
On 2023.06.04 15:56, Dale wrote: Doing my updates, most things updated but some still have conflicts. Emerge is trying to tell me but I use Konsole and I think it messes up the ^ bit and points to the wrong thing. I suspect the ^ assumes a fixed width font.
Re: [gentoo-user] emerge conflict. Need help. ffmpeg, kpipewire, handbrake, ffmpegthumbnailer and others.
On Sun, 4 Jun 2023 at 21:56, Dale wrote: > > Howdy, > > Doing my updates, most things updated but some still have conflicts. > Emerge is trying to tell me but I use Konsole and I think it messes up > the ^ bit and points to the wrong thing. I'm thinking this is a USE > flag problem but I can't tell for sure. Anyone else recognize this and > make sense of it? I recently switched to the pipewire thing and that > could be part of it, maybe. It's among those mentioned at least. > > Ideas? Thoughts?? It seems opencascade and handbrake are the culprits for you, blocking the ffmpeg upgrade, in your output they require
[gentoo-user] emerge conflict. Need help. ffmpeg, kpipewire, handbrake, ffmpegthumbnailer and others.
Howdy, Doing my updates, most things updated but some still have conflicts. Emerge is trying to tell me but I use Konsole and I think it messes up the ^ bit and points to the wrong thing. I'm thinking this is a USE flag problem but I can't tell for sure. Anyone else recognize this and make sense of it? I recently switched to the pipewire thing and that could be part of it, maybe. It's among those mentioned at least. (chroot) root@fireball / # emerge -auDN media-video/ffmpeg kde-apps/ffmpegthumbs media-video/handbrake sci-libs/opencascade media-libs/opencv kde-apps/k3b kde-plasma/kpipewire kde-frameworks/kfilemetadata media-video/mplayer libtorrent-rasterbar net-p2p/qbittorrent gui-libs/egl-wayland These are the packages that would be merged, in order: Calculating dependencies... done! Dependency resolution took 40.62 s. Total: 0 packages, Size of downloads: 0 KiB WARNING: One or more updates/rebuilds have been skipped due to a dependency conflict: net-libs/libtorrent-rasterbar:0 (net-libs/libtorrent-rasterbar-2.0.8:0/2.0::gentoo, ebuild scheduled for merge) USE="dht gnutls ssl -debug -python -test" ABI_X86="(64)" PYTHON_SINGLE_TARGET="python3_11 -python3_10" conflicts with =media-video/ffmpeg-3.1.3:0/56.58.58=[postproc] required by (media-video/vlc-3.0.18-r3:0/5-9::gentoo, installed) USE="X a52 alsa bidi bluray cddb dbus dvbpsi dvd encode ffmpeg flac fontconfig gcrypt gui jpeg libnotify libsamplerate mad mp3 mpeg ncurses ogg png pulseaudio ssl svg truetype udev wayland x264 x265 xml zeroconf -aom -archive -aribsub -chromaprint -chromecast -dav1d -dc1394 -debug (-directx) -dts -faad -fdk -fluidsynth -gme -gstreamer -ieee1394 -jack -kate -keyring -libass -libcaca -libtar -libtiger -linsys -lirc -live -lua -macosx-notifications -matroska -modplug -mtp -musepack -nfs -omxil -optimisememory -opus -projectm -rdp -run-as-root -samba -sdl-image -sftp -shout -sid -skins -soxr -speex -srt -taglib -test -theora -tremor -twolame -upnp -v4l -vaapi -vdpau -vnc -vpx -zvbi" ABI_X86="(64)" CPU_FLAGS_X86="mmx sse" LUA_SINGLE_TARGET="lua5-1" media-video/ffmpeg:0/56.58.58=[encode,threads] required by (media-video/mpv-0.35.1-r1:0/2::gentoo, installed) USE="X alsa bluray cdda cli drm dvd egl iconv javascript jpeg lcms libmpv libplacebo lua opengl pipewire pulseaudio sdl uchardet vulkan wayland xv zlib (-aqua) -archive (-coreaudio) -debug -dvb -gamepad -jack -libcaca (-mmal) -nvenc -openal (-raspberry-pi) -rubberband (-selinux) -sixel -sndio -test -tools -vaapi -vdpau -zimg" ABI_X86="(64)" LUA_SINGLE_TARGET="luajit -lua5-1" PYTHON_SINGLE_TARGET="python3_11 -python3_10 (-python3_12)" media-video/ffmpeg:0/56.58.58= required by (media-video/gpac-2.2.0:0/11::gentoo, installed) USE="X a52 aac alsa ffmpeg jpeg jpeg2k mad opengl png pulseaudio sdl ssl truetype vorbis xml xvid -debug -dvb -jack -oss -static-libs -theora" ABI_X86="(64)" CPU_FLAGS_X86="sse2" >=media-video/ffmpeg-2:0/56.58.58=[encode] required by (app-text/unpaper-7.0.0:0/0::gentoo, installed) USE="userland_GNU -test" ABI_X86="(64)" media-video/ffmpeg:0/56.58.58= required by (kde-frameworks/kfilemetadata-5.106.0:5/5.106::gentoo, installed) USE="epub exif ffmpeg pdf taglib userland_GNU -debug -doc -mobi -test" ABI_X86="(64)" >=media-video/ffmpeg-4.0:0/56.58.58= required by (media-video/mplayer-1.5_p20230215:0/0::gentoo, installed) USE="X a52 alsa bidi bluray cddb cdio cdparanoia dvd dvdnav enca encode faac iconv ipv6 jpeg libass mad mng mp3 network opengl osdmenu png pulseaudio rar sdl shm truetype unicode vorbis x264 xscreensaver xv xvid -aalib (-aqua) -bl -bs2b -cpudetection -debug -dga -doc -dts -dv -dvb -faad -fbcon -ftp -ggi -gsm -jack -joystick -ladspa -libcaca -libmpeg2 -lirc -live -lzo -md5sum -nas -openal -oss -pnm -pvr -radio -rtc -rtmp -samba (-selinux) -speex -tga -theora -toolame -tremor -twolame -v4l -vcd -vdpau (-vidix) -xinerama -yuv4mpeg -zoran" ABI_X86="(64)" CPU_FLAGS_X86="avx fma3 fma4 mmx mmxext sse sse2 sse3 sse4_1 sse4_2 ssse3 xop -3dnow -3dnowext -avx2" VIDEO_CARDS="-mga" =media-video/ffmpeg-2.7:0/56.58.58= required by (media-video/ffmpegthumbnailer-2.2.2-r1:0/0::gentoo, installed) USE="gtk jpeg png userland_GNU -gnome -test" ABI_X86="(64)" gui-libs/egl-wayland:0 (gui-libs/egl-wayland-1.1.12:0/0::gentoo, ebuild scheduled for merge) USE="" ABI_X86="(64)" conflicts with ~gui-libs/egl-wayland-1.1.7 required by (x11-drivers/nvidia-drivers-470.182.03:0/470::gentoo, installed) USE="X driver tools wayland -dist-kernel -persistenced -static-libs" ABI_X86="(64) -32" ^ ^ !!! The following installed packages are masked: - sys-kernel/gentoo-sources-6.1.23::gentoo (masked by: packag
Re: [gentoo-user] emerge --sync fails with a python error
On 15.05.23 16:41, Matt Connell wrote: On Mon, 2023-05-15 at 16:24 +0200, Dan Johansson wrote: RuntimeError: OpenPGP signature not found on Manifest It sounds like your sync is hitting a mirror that is currently broken. Are you using a defined mirror list or letting it auto-select? As far as I can tell, portage is using "auto-select". in /etc/portage/make.conf I do not have GENTOO_MIRRORS set. -- Dan Johansson *** This message is printed on 100% recycled electrons! ***
Re: [gentoo-user] emerge --sync fails with a python error
On Mon, 2023-05-15 at 16:24 +0200, Dan Johansson wrote: > RuntimeError: OpenPGP signature not found on Manifest It sounds like your sync is hitting a mirror that is currently broken. Are you using a defined mirror list or letting it auto-select?
[gentoo-user] emerge --sync fails with a python error
Since at least my "emerge --sync" fails with the following message:
--8<--
Total bytes received: 55.60M
sent 456.87K bytes received 55.60M bytes 4.48M bytes/sec
total size is 188.36M speedup is 3.36
Traceback (most recent call last):
File
"/usr/lib/python3.11/site-packages/portage/util/_async/AsyncFunction.py", line
45, in _run
result = self.target(*(self.args or []), **(self.kwargs or {}))
^^
File "/usr/lib/python3.11/site-packages/portage/sync/controller.py", line
165, in sync
taskmaster.run_tasks(tasks, func, status, options=task_opts)
File "/usr/lib/python3.11/site-packages/portage/sync/controller.py", line 65,
in run_tasks
result = getattr(inst, func)(**kwargs)
^
File "/usr/lib/python3.11/site-packages/portage/sync/syncbase.py", line 364,
in sync
return self.update()
^
File "/usr/lib/python3.11/site-packages/portage/sync/modules/rsync/rsync.py",
line 428, in update
raise RuntimeError(
RuntimeError: OpenPGP signature not found on Manifest
Action: sync for repo: gentoo, returned code = 1
--8<--
I have tried re-emerging portage and even unmasked portage-3.0.47, I also tried disabling
the "rsync-verify" verify USE-flag.
Any suggestions what is wrong and how to solve it?
--
Dan Johansson,
***
This message is printed on 100% recycled electrons!
***
Re: [gentoo-user] emerge -U or emerge -N
On Tue, 11 Apr 2023 10:18:13 -0500, Dale wrote: > >> When I say deeper, I mean it will find more packages that may not be > >> found otherwise. > > And -e finds even more - but more is not always better. -U was > > introduced because -N was causing too many packages to be rebuilt > > unnecessarily. > Before those options came along, I would run emerge -e world to fix > problems. Sometimes revdep-rebuild would catch things but sometimes it > wouldn't. Thing is, since I started using the current options, I have > few problems with package upgrades. Sure, they have a known bug on > occasion but recompiling won't help that. I'm just talking about > problems with one package not matching up with some other package and > recompile fixes it. > > To me, the fact it works so much better tells me I'm doing something > right. Other people may get different results but as long as what I'm > doing works, I don't plan to change anything. -N works, it just creates extra work. If you are happy with that, there's no need to change. -- Neil Bothwick There are two hard things in computer science: cache invalidation, naming things and off-by-one errors. pgp3tqCYjPe6V.pgp Description: OpenPGP digital signature
Re: [gentoo-user] emerge -U or emerge -N
Neil Bothwick wrote: > On Tue, 11 Apr 2023 06:30:47 -0500, Dale wrote: > >>> -U: if a package doesn't need to be updated on your system today, >>> it'll be left until it does. >>> >>> -N: if any USE flag at all has changed in a package, it'll be >>> recompiled, whether it needs to be on your system or not. >>> >> >> When I say deeper, I mean it will find more packages that may not be >> found otherwise. > And -e finds even more - but more is not always better. -U was introduced > because -N was causing too many packages to be rebuilt unnecessarily. > > Before those options came along, I would run emerge -e world to fix problems. Sometimes revdep-rebuild would catch things but sometimes it wouldn't. Thing is, since I started using the current options, I have few problems with package upgrades. Sure, they have a known bug on occasion but recompiling won't help that. I'm just talking about problems with one package not matching up with some other package and recompile fixes it. To me, the fact it works so much better tells me I'm doing something right. Other people may get different results but as long as what I'm doing works, I don't plan to change anything. Dale :-) :-)
Re: [gentoo-user] emerge -U or emerge -N
On Tue, 11 Apr 2023 06:30:47 -0500, Dale wrote: > > -U: if a package doesn't need to be updated on your system today, > > it'll be left until it does. > > > > -N: if any USE flag at all has changed in a package, it'll be > > recompiled, whether it needs to be on your system or not. > > > > > When I say deeper, I mean it will find more packages that may not be > found otherwise. And -e finds even more - but more is not always better. -U was introduced because -N was causing too many packages to be rebuilt unnecessarily. -- Neil Bothwick "Logic will get you from A to B. Imagination will take you everywhere." (Albert Einstein) pgpqMA91uTQ4P.pgp Description: OpenPGP digital signature
Re: [gentoo-user] emerge -U or emerge -N
Neil, On Tuesday, 2023-04-11 08:19:10 +0100, you wrote: > ... > So now we kn ow, ChatGPT is case-insensitive, it gave you answers for -u > and -n. You aren't really flabbergasted, are you? After all Microsoft is known for having a particularly soft spot for case-insensitiveness :-) Sincerely, Rainer
Re: [gentoo-user] emerge -U or emerge -N
Peter Humphrey wrote: > On Tuesday, 11 April 2023 11:33:38 BST Dale wrote: > >> The info from the man page is correct. > Of course it is. There'd be uproar if it weren't. > >> They do two different things. The -N will mean more recompiles of packages >> but it also means that when a USE flag change is made, it also changes any >> packages that relates to that. In other words, it goes deeper. > I don't know why you think it goes deeper, Dale. It's a question of candidate > selection, not depth of analysis. > > -U: if a package doesn't need to be updated on your system today, it'll be > left until it does. > > -N: if any USE flag at all has changed in a package, it'll be recompiled, > whether it needs to be on your system or not. > When I say deeper, I mean it will find more packages that may not be found otherwise. The deeper the hole I dig, the more dirt I have. That sort of thing. Maybe it should be phrased another way??? Dale :-) :-)
Re: [gentoo-user] emerge -U or emerge -N
On Tuesday, 11 April 2023 11:33:38 BST Dale wrote: > The info from the man page is correct. Of course it is. There'd be uproar if it weren't. > They do two different things. The -N will mean more recompiles of packages > but it also means that when a USE flag change is made, it also changes any > packages that relates to that. In other words, it goes deeper. I don't know why you think it goes deeper, Dale. It's a question of candidate selection, not depth of analysis. -U: if a package doesn't need to be updated on your system today, it'll be left until it does. -N: if any USE flag at all has changed in a package, it'll be recompiled, whether it needs to be on your system or not. -- Regards, Peter.
Re: [gentoo-user] emerge -U or emerge -N
jul...@jroy.ca wrote: > On Mon, 2023-04-10 at 22:10 -0600, the...@sys-concept.com wrote: >> On 4/10/23 18:53, Dale wrote: >> >> >> I've asked ChatGPT for explanation and here is what I got: >> >> Here are the differences between emerge -U and emerge -N: >> >> emerge -U: This option upgrades the specified package(s) to the >> latest available version. It will first download the new version, >> then build and install it. If a dependency of the package being >> upgraded also needs to be upgraded, it will also be upgraded. >> >> emerge -N: This option installs the specified package(s) without >> upgrading any dependencies. It will only download and install the >> package(s) if they are not already installed. If any dependencies of >> the package(s) are not already installed, the command will fail. >> >> In other words, emerge -U upgrades packages and their dependencies, >> while emerge -N only installs packages without upgrading any >> dependencies. >> > This is a good example of why ChatGPT cannot be trusted. > When ChatGPT doesn't know the answer to something, rather than saying > it doesn't know the answer, it just makes it up. > > The difference between -U and -N as explained by ChatGPT is wrong; in > fact, it has nothing to do with dependencies. > > To have a truthful answer, let's not ask ChatGPT and instead look at > `man 5 emerge`: > > --newuse, -N > Tells emerge to include installed packages where USE > flags have changed since compilation. This option also > implies the --selective option. USE flag changes > include: > > A USE flag was added to a package. A USE flag was > removed from a package. A USE flag was > turned on for > a package. A USE flag was turned off for a package. > > --changed-use, -U > Tells emerge to include installed packages where USE > flags have changed since installation. This option > also implies the --selective option. Unlike --newuse, > the --changed-use option does not trigger > reinstallation when flags that the user has not > enabled are added orremoved. > > In a nutshell, `--newuse` or `-N` rebuilds packages when USE flags have > changed, regardless of whether the changed USE flags affect the outcome > Where as `--changed-use` or `-U` rebuilds packages when the USE flags > have changed, AND the changed USE flags affect the outcome. > > For example, suppose you are on an openRC system, and a package > introduces a new `systemd` USE flag; > With `-N`: this package will be rebuilt with `-systemd` > With `-U`: this package will not be rebuilt > The info from the man page is correct. They do two different things. The -N will mean more recompiles of packages but it also means that when a USE flag change is made, it also changes any packages that relates to that. In other words, it goes deeper. What all this comes down to, how stable and how consistent do you want your system to be? On some systems, it may get away with doing it the quick and fast way. In some cases it may not. It seemed to me that for my system, going a bit deeper worked better for me. I'd rather rebuild more packages and have a more stable system than take a quicker way and have problems every once in a while. If one wants to try the shorter way, see if it works for them, then that can be done. If it works, great. If not, switching to a method that takes longer and sorts through more packages may be needed. It's all up to the person sitting in the chair. Dale :-) :-)
Re: [gentoo-user] emerge -U or emerge -N
On Mon, 10 Apr 2023 22:10:32 -0600, the...@sys-concept.com wrote: > !'ve asked ChatGPT for explanation and here is what I got: > > Here are the differences between emerge -U and emerge -N: > > emerge -U: This option upgrades the specified package(s) to the latest > available version. It will first download the new version, then build > and install it. If a dependency of the package being upgraded also > needs to be upgraded, it will also be upgraded. > > emerge -N: This option installs the specified package(s) without > upgrading any dependencies. It will only download and install the > package(s) if they are not already installed. If any dependencies of > the package(s) are not already installed, the command will fail. So now we kn ow, ChatGPT is case-insensitive, it gave you answers for -u and -n. It's probably easier to read the man page than ask a bot to make a guess :( -- Neil Bothwick Hyperbole is absolutely the worst mistake you can possibly make pgppjQANgv7wq.pgp Description: OpenPGP digital signature
Re: [gentoo-user] emerge -U or emerge -N
On Mon, 2023-04-10 at 22:10 -0600, the...@sys-concept.com wrote: > On 4/10/23 18:53, Dale wrote: > > > I've asked ChatGPT for explanation and here is what I got: > > Here are the differences between emerge -U and emerge -N: > > emerge -U: This option upgrades the specified package(s) to the > latest available version. It will first download the new version, > then build and install it. If a dependency of the package being > upgraded also needs to be upgraded, it will also be upgraded. > > emerge -N: This option installs the specified package(s) without > upgrading any dependencies. It will only download and install the > package(s) if they are not already installed. If any dependencies of > the package(s) are not already installed, the command will fail. > > In other words, emerge -U upgrades packages and their dependencies, > while emerge -N only installs packages without upgrading any > dependencies. > This is a good example of why ChatGPT cannot be trusted. When ChatGPT doesn't know the answer to something, rather than saying it doesn't know the answer, it just makes it up. The difference between -U and -N as explained by ChatGPT is wrong; in fact, it has nothing to do with dependencies. To have a truthful answer, let's not ask ChatGPT and instead look at `man 5 emerge`: --newuse, -N Tells emerge to include installed packages where USE flags have changed since compilation. This option also implies the --selective option. USE flag changes include: A USE flag was added to a package. A USE flag was removed from a package. A USE flag was turned on for a package. A USE flag was turned off for a package. --changed-use, -U Tells emerge to include installed packages where USE flags have changed since installation. This option also implies the --selective option. Unlike --newuse, the --changed-use option does not trigger reinstallation when flags that the user has not enabled are added orremoved. In a nutshell, `--newuse` or `-N` rebuilds packages when USE flags have changed, regardless of whether the changed USE flags affect the outcome Where as `--changed-use` or `-U` rebuilds packages when the USE flags have changed, AND the changed USE flags affect the outcome. For example, suppose you are on an openRC system, and a package introduces a new `systemd` USE flag; With `-N`: this package will be rebuilt with `-systemd` With `-U`: this package will not be rebuilt -- Julien signature.asc Description: This is a digitally signed message part
Re: [gentoo-user] emerge -U or emerge -N
On 4/10/23 18:53, Dale wrote: the...@sys-concept.com wrote: Is it better to us emerge -U or emerge -N I've always done -N but it didn't go very smoothly it seems to me -U might be better option but it takes longer. Right now I'm doing -U and it is compiling 549-packages. . I always do both except I use the lower case 'u'. I started using Gentoo back in 2003. Over the years, I added/changed options to emerge until I got a good sane system that works as expected and is stable. My command is emerge -auDN world and it has worked for years. One difference, I update once a week and on occasion two weeks if I have something going on and need to wait. I'd think tho, if one goes a long time between updates, my way would result in a longer compile time but also a system that is more stable or clean. Everyone has their own way. If what a person does is working, by all means do it that way. I picked my way because of problems I ran into. The solutions to those problems resulted in the command I use. If one waits a long time between updates, more packages will have updated and result in more updates regardless of the options. In that case, any USE changes would apply to those packages anyway. If one updates often, as I do, then the way I do it may have benefits and result in a more stable system, even tho it requires more packages to compile. Hope that helps. Dale :-) :-) I've asked ChatGPT for explanation and here is what I got: Here are the differences between emerge -U and emerge -N: emerge -U: This option upgrades the specified package(s) to the latest available version. It will first download the new version, then build and install it. If a dependency of the package being upgraded also needs to be upgraded, it will also be upgraded. emerge -N: This option installs the specified package(s) without upgrading any dependencies. It will only download and install the package(s) if they are not already installed. If any dependencies of the package(s) are not already installed, the command will fail. In other words, emerge -U upgrades packages and their dependencies, while emerge -N only installs packages without upgrading any dependencies.
Re: [gentoo-user] emerge -U or emerge -N
the...@sys-concept.com wrote: > Is it better to us emerge -U or emerge -N > > I've always done -N but it didn't go very smoothly it seems to me -U > might be better option but it takes longer. > Right now I'm doing -U and it is compiling 549-packages. > > . > I always do both except I use the lower case 'u'. I started using Gentoo back in 2003. Over the years, I added/changed options to emerge until I got a good sane system that works as expected and is stable. My command is emerge -auDN world and it has worked for years. One difference, I update once a week and on occasion two weeks if I have something going on and need to wait. I'd think tho, if one goes a long time between updates, my way would result in a longer compile time but also a system that is more stable or clean. Everyone has their own way. If what a person does is working, by all means do it that way. I picked my way because of problems I ran into. The solutions to those problems resulted in the command I use. If one waits a long time between updates, more packages will have updated and result in more updates regardless of the options. In that case, any USE changes would apply to those packages anyway. If one updates often, as I do, then the way I do it may have benefits and result in a more stable system, even tho it requires more packages to compile. Hope that helps. Dale :-) :-)
Re: [gentoo-user] emerge -U or emerge -N
On 4/10/23 11:11, hitachi303 wrote: Am 10.04.23 um 18:44 schrieb the...@sys-concept.com: Is it better to us emerge -U or emerge -N I've always done -N but it didn't go very smoothly it seems to me -U might be better option but it takes longer. Right now I'm doing -U and it is compiling 549-packages. Just out of curiosity: Is that your update process for world or in which context do you use it? If this is your update process, with which other options do you combine it? 549-packages is quit a lot. emerege -uDUavq @world Haven't done done any updates since Dec. I think that is why. -U came up with 549-packages -N came up with 592-packages
Re: [gentoo-user] emerge -U or emerge -N
Am 10.04.23 um 18:44 schrieb the...@sys-concept.com: Is it better to us emerge -U or emerge -N I've always done -N but it didn't go very smoothly it seems to me -U might be better option but it takes longer. Right now I'm doing -U and it is compiling 549-packages. Just out of curiosity: Is that your update process for world or in which context do you use it? If this is your update process, with which other options do you combine it? 549-packages is quit a lot.
