Re: [gentoo-user] Highlight certain packages being upgraded
Neil Bothwick wrote: > On Sat, 8 Jul 2023 15:44:47 -0500, Dale wrote: > >>> I have reused the configuration file >>> "/etc/portage/package.env/no_tmpfs.conf"[1], which already contains a >>> list of packages, which need hours to compile. >>> >>> -Ramon >>> >>> [1] >>> https://wiki.gentoo.org/wiki/Portage_TMPDIR_on_tmpfs#Per-package_choices_at_compile_time >>> >> >> I need more than just packages that take a while to compile. I need a >> list of packages that require large amounts of memory, needs restarting >> after upgrade is done and other things. I already use notmpfs on a few >> packages. That works fine. Things is, I need to know about other >> packages for other reasons as well. Upgrading nvidia is one. It uses >> little memory to upgrade but it does require the modules to be >> reloaded. > You can do a lot with package.env, including sending notifications > to remind you to do this. I also run app-admin/needrestart after each > emerge to list any services that need restarting. > > I just wanted to be able to see them better in the output of emerge. Anything else just creates more work and consumes more time than it saves. Once I scan the list, I can hit yes and let it start. If I see Firefox, LOo or others, I close Firefox profiles, sometimes Seamonkey, to free up memory. If I see packages that are services, I know I need to restart them, even if checkrestart doesn't show it. If I see mplayer, I know that if Smplayer moves to a new video in the playlist, it will likely fail to start. Some I just know I can take a nice lng nap. What I do just depends on the package. I just need it to be easier to see in the list. Nothing fancy, just easier to see. I use checkrestart still. I tried needrestart but it does more than I need. I found checkrestart in a overlay and I just stuck with it. Heck, I still use the rc command, even tho it gripes each time I use it. lol Dale :-) :-)
Re: [gentoo-user] Highlight certain packages being upgraded
On Sat, 8 Jul 2023 15:44:47 -0500, Dale wrote: > > I have reused the configuration file > > "/etc/portage/package.env/no_tmpfs.conf"[1], which already contains a > > list of packages, which need hours to compile. > > > > -Ramon > > > > [1] > > https://wiki.gentoo.org/wiki/Portage_TMPDIR_on_tmpfs#Per-package_choices_at_compile_time > > > > > I need more than just packages that take a while to compile. I need a > list of packages that require large amounts of memory, needs restarting > after upgrade is done and other things. I already use notmpfs on a few > packages. That works fine. Things is, I need to know about other > packages for other reasons as well. Upgrading nvidia is one. It uses > little memory to upgrade but it does require the modules to be > reloaded. You can do a lot with package.env, including sending notifications to remind you to do this. I also run app-admin/needrestart after each emerge to list any services that need restarting. -- Neil Bothwick He who asks a question is a fool for a minute, He who doesn't ask is a fool for a lifetime. pgpsm3szqSMFe.pgp Description: OpenPGP digital signature
Re: [gentoo-user] Highlight certain packages being upgraded
Ramon Fischer wrote: > Hello Dale, > > I solved it like this: > > https://www.mail-archive.com/gentoo-user@lists.gentoo.org/msg186292.html > > I have reused the configuration file > "/etc/portage/package.env/no_tmpfs.conf"[1], which already contains a > list of packages, which need hours to compile. > > -Ramon > > [1] > https://wiki.gentoo.org/wiki/Portage_TMPDIR_on_tmpfs#Per-package_choices_at_compile_time > I need more than just packages that take a while to compile. I need a list of packages that require large amounts of memory, needs restarting after upgrade is done and other things. I already use notmpfs on a few packages. That works fine. Things is, I need to know about other packages for other reasons as well. Upgrading nvidia is one. It uses little memory to upgrade but it does require the modules to be reloaded. Maybe one of these days. Dale :-) :-)
Re: [gentoo-user] Highlight certain packages being upgraded
Jack wrote: > What about piping the output of emerge through 'tee' into a file. You > can then grep that file for the package names you are interested in, > and they will clearly be highlighted. True, you will need to look at > the portage output directly to decide whether or not to proceed, and > then separately at the grep of the same text to see if you need to > take other actions. > I think on most occasions it would be faster to just read every package name being listed instead of doing other repetitive things. I was trying to make them more obvious, stand out more or something that would catch my eye as I scan the list for USE changes. The USE changes stand out pretty good as they are. I've read where one can change the default colors as some background colors make the default colors hard to see. I use a black background so the default works fine for me, yellow stands out pretty good for USE changes. Since it highlights USE changes already, I thought there might be a way to change colors of certain package names as well, just maybe. I was doubtful but in the past, someone posts something that emerge does that is either new or I never heard of before. I was shooting in the dark but thought I'd ask. Turns out, I needed it this time. I totally missed the nvidia upgrade and it is usually shown as a world file entry which stands out a little more, not much but a little. I see another batch of KDE packages was just released. I may upgrade again later tonight or tomorrow. If I had known those were coming, I'd have waited until tomorrow to upgrade. :/ Even a blind squirrel finds a acorn every once in a while. LOL Dale :-) :-)
Re: [gentoo-user] Highlight certain packages being upgraded
What about piping the output of emerge through 'tee' into a file. You can then grep that file for the package names you are interested in, and they will clearly be highlighted. True, you will need to look at the portage output directly to decide whether or not to proceed, and then separately at the grep of the same text to see if you need to take other actions. On 7/8/23 16:20, Dale wrote: Neil Bothwick wrote: On Sat, 8 Jul 2023 14:14:46 -0500, Dale wrote: Thing is, some of the packages are dependencies of other packages. Excluding them will likely trigger other problems, such as packages not being able to upgrade due to others being excluded. Plus, I'd have to run it twice and do two separate upgrades. Usually, I start the upgrade in a chroot, take a nap and it is done when I wake up. I'd have to interrupt my nap for the second set if it is split up. Having it highlight the packages so I can see them easier was a thought, just not a good one. :/ But what would you do with the information? If you're just going to see that there are slow packages there and then carry, what's the point. I suppose you know you can have a longer nap :) You could try piping emerge's output through sed to add colour codes around the packages you want to highlight. How exactly you do this is left as an exercise for the reader :P When I see certain packages, I know to close some of my Firefox profiles if they require a lot of memory. For some, I know I need to restart that program/service. For some, such as my video drivers, I know to reload the modules after I logout. What I do with the info depends on which package it is. I just make a mental note that certain things needs to be done and I know to do them either before I start the upgrade or after it is done. Just as a example, my overnight upgrade included nvidia drivers. I didn't see it so when I logged out, no X. I usually see it but missed it this time. Having a way to easily set the colors would be easier but having to repeat things, create files to scan, use tools I'm not familiar with and such, that isn't easy. I wanted to be able to see it in the initial list, make a note of what packages I need to do things for and then hit yes to continue. Basically, I was hoping emerge had a way to do this that isn't known to me. After all, the thing all but washes dishes already. ROFL Maybe one day others will like this idea and one of them is willing to add some code to emerge to do it. Until then, I guess I'll just miss one on occasion and have to scratch my head a couple times. Thanks to all. Interesting ideas but generally over my head. :/ Dale :-) :-)
Re: [gentoo-user] Highlight certain packages being upgraded
Hello Dale, I solved it like this: https://www.mail-archive.com/gentoo-user@lists.gentoo.org/msg186292.html I have reused the configuration file "/etc/portage/package.env/no_tmpfs.conf"[1], which already contains a list of packages, which need hours to compile. -Ramon [1] https://wiki.gentoo.org/wiki/Portage_TMPDIR_on_tmpfs#Per-package_choices_at_compile_time On 08/07/2023 10:33, Dale wrote: Howdy, I was wondering. Is there a way to highlight certain packages that are about to be upgraded? Example, I like to know when some larger packages like Firefox, LOo, that excessively long qt package and a couple others are going to be upgraded. Some that are listed in the world file show up in a darker green and are easier to see however, some are not. They are dependencies of another package but I'd like to have them stick out in the list of packages to be upgraded. I don't recall ever seeing anyone mention this as a feature of emerge or heard of a way to configure such a thing either. That said, it could be possible and just not well known. I'd like to be able to have those packages show up as red or something like that. If it is possible. Thoughts? Ever heard of such a thing? Dale :-) :-) -- GPG public key: 5983 98DA 5F4D A464 38FD CF87 155B E264 13E6 99BF OpenPGP_0x155BE26413E699BF.asc Description: OpenPGP public key OpenPGP_signature Description: OpenPGP digital signature
Re: [gentoo-user] Highlight certain packages being upgraded
Neil Bothwick wrote: > On Sat, 8 Jul 2023 14:14:46 -0500, Dale wrote: > >> Thing is, some of the packages are dependencies of other packages. >> Excluding them will likely trigger other problems, such as packages not >> being able to upgrade due to others being excluded. Plus, I'd have to >> run it twice and do two separate upgrades. Usually, I start the upgrade >> in a chroot, take a nap and it is done when I wake up. I'd have to >> interrupt my nap for the second set if it is split up. >> >> Having it highlight the packages so I can see them easier was a thought, >> just not a good one. :/ > But what would you do with the information? If you're just going to see > that there are slow packages there and then carry, what's the point. I > suppose you know you can have a longer nap :) > > You could try piping emerge's output through sed to add colour codes > around the packages you want to highlight. How exactly you do this is > left as an exercise for the reader :P > > When I see certain packages, I know to close some of my Firefox profiles if they require a lot of memory. For some, I know I need to restart that program/service. For some, such as my video drivers, I know to reload the modules after I logout. What I do with the info depends on which package it is. I just make a mental note that certain things needs to be done and I know to do them either before I start the upgrade or after it is done. Just as a example, my overnight upgrade included nvidia drivers. I didn't see it so when I logged out, no X. I usually see it but missed it this time. Having a way to easily set the colors would be easier but having to repeat things, create files to scan, use tools I'm not familiar with and such, that isn't easy. I wanted to be able to see it in the initial list, make a note of what packages I need to do things for and then hit yes to continue. Basically, I was hoping emerge had a way to do this that isn't known to me. After all, the thing all but washes dishes already. ROFL Maybe one day others will like this idea and one of them is willing to add some code to emerge to do it. Until then, I guess I'll just miss one on occasion and have to scratch my head a couple times. Thanks to all. Interesting ideas but generally over my head. :/ Dale :-) :-)
Re: [gentoo-user] Highlight certain packages being upgraded
On Sat, 8 Jul 2023 14:14:46 -0500, Dale wrote: > Thing is, some of the packages are dependencies of other packages. > Excluding them will likely trigger other problems, such as packages not > being able to upgrade due to others being excluded. Plus, I'd have to > run it twice and do two separate upgrades. Usually, I start the upgrade > in a chroot, take a nap and it is done when I wake up. I'd have to > interrupt my nap for the second set if it is split up. > > Having it highlight the packages so I can see them easier was a thought, > just not a good one. :/ But what would you do with the information? If you're just going to see that there are slow packages there and then carry, what's the point. I suppose you know you can have a longer nap :) You could try piping emerge's output through sed to add colour codes around the packages you want to highlight. How exactly you do this is left as an exercise for the reader :P -- Neil Bothwick Q. How many mathematicians does it take to change a light bulb? A. Only one - who gives it to six Californians, thereby reducing the problem to an earlier joke. pgpexWWBa11g_.pgp Description: OpenPGP digital signature
Re: [gentoo-user] Highlight certain packages being upgraded
Jack wrote: > On 2023.07.08 13:02, Dale wrote: >> Neil Bothwick wrote: >> > On Sat, 8 Jul 2023 03:33:30 -0500, Dale wrote: >> > >> >> I was wondering. Is there a way to highlight certain packages >> that are >> >> about to be upgraded? Example, I like to know when some larger >> packages >> >> like Firefox, LOo, that excessively long qt package and a couple >> others >> >> are going to be upgraded. Some that are listed in the world file >> show >> >> up in a darker green and are easier to see however, some are not. >> They >> >> are dependencies of another package but I'd like to have them >> stick out >> >> in the list of packages to be upgraded. I don't recall ever seeing >> >> anyone mention this as a feature of emerge or heard of a way to >> >> configure such a thing either. That said, it could be possible >> and just >> >> not well known. >> > If your objective is to update your system without the long build >> times, >> > put the atoms of the relevant packages in a file and run >> > >> > emerge --your-options --exclude "$(cat big-packages.txt)" @world >> > >> > >> >> >> I'm just wanting certain packages to stand out more in the list emerge >> spits out. Some require a lot of memory, some have long build times, >> some both of those and some require me to restart programs or do other >> things. I already check the changes in USE flags but they stick out >> good since they are usually yellow or some other color. I was curious >> if I could set colors for certain packages without reinventing the >> wheel. While I don't recall hearing or seeing anything about it, I >> thought it might be possible I just hadn't heard about a feature that >> does this. >> >> Doesn't sound like there is a easy way to do this so I guess just >> looking at each package name is the way to go for now. > Using Neil's approach, you do the emerge with the excludes, so you > know there are no problem packages included. Then you run it again, > without the excludes, and all/most of what shows up will be those > big/long packages. No need to hunt through the first list, and the > second list will be much shorted and easier to review. Yes, it would > be nice if portage gave you a way to visually flag certain packages, > but it's not currently an option. > > Thing is, some of the packages are dependencies of other packages. Excluding them will likely trigger other problems, such as packages not being able to upgrade due to others being excluded. Plus, I'd have to run it twice and do two separate upgrades. Usually, I start the upgrade in a chroot, take a nap and it is done when I wake up. I'd have to interrupt my nap for the second set if it is split up. Having it highlight the packages so I can see them easier was a thought, just not a good one. :/ Oh well, we tried. lol Dale :-) :-)
Re: [gentoo-user] Highlight certain packages being upgraded
On 2023.07.08 13:02, Dale wrote: Neil Bothwick wrote: > On Sat, 8 Jul 2023 03:33:30 -0500, Dale wrote: > >> I was wondering. Is there a way to highlight certain packages that are >> about to be upgraded? Example, I like to know when some larger packages >> like Firefox, LOo, that excessively long qt package and a couple others >> are going to be upgraded. Some that are listed in the world file show >> up in a darker green and are easier to see however, some are not. They >> are dependencies of another package but I'd like to have them stick out >> in the list of packages to be upgraded. I don't recall ever seeing >> anyone mention this as a feature of emerge or heard of a way to >> configure such a thing either. That said, it could be possible and just >> not well known. > If your objective is to update your system without the long build times, > put the atoms of the relevant packages in a file and run > > emerge --your-options --exclude "$(cat big-packages.txt)" @world > > I'm just wanting certain packages to stand out more in the list emerge spits out. Some require a lot of memory, some have long build times, some both of those and some require me to restart programs or do other things. I already check the changes in USE flags but they stick out good since they are usually yellow or some other color. I was curious if I could set colors for certain packages without reinventing the wheel. While I don't recall hearing or seeing anything about it, I thought it might be possible I just hadn't heard about a feature that does this. Doesn't sound like there is a easy way to do this so I guess just looking at each package name is the way to go for now. Using Neil's approach, you do the emerge with the excludes, so you know there are no problem packages included. Then you run it again, without the excludes, and all/most of what shows up will be those big/long packages. No need to hunt through the first list, and the second list will be much shorted and easier to review. Yes, it would be nice if portage gave you a way to visually flag certain packages, but it's not currently an option.
Re: [gentoo-user] Highlight certain packages being upgraded
Neil Bothwick wrote: > On Sat, 8 Jul 2023 03:33:30 -0500, Dale wrote: > >> I was wondering. Is there a way to highlight certain packages that are >> about to be upgraded? Example, I like to know when some larger packages >> like Firefox, LOo, that excessively long qt package and a couple others >> are going to be upgraded. Some that are listed in the world file show >> up in a darker green and are easier to see however, some are not. They >> are dependencies of another package but I'd like to have them stick out >> in the list of packages to be upgraded. I don't recall ever seeing >> anyone mention this as a feature of emerge or heard of a way to >> configure such a thing either. That said, it could be possible and just >> not well known. > If your objective is to update your system without the long build times, > put the atoms of the relevant packages in a file and run > > emerge --your-options --exclude "$(cat big-packages.txt)" @world > > I'm just wanting certain packages to stand out more in the list emerge spits out. Some require a lot of memory, some have long build times, some both of those and some require me to restart programs or do other things. I already check the changes in USE flags but they stick out good since they are usually yellow or some other color. I was curious if I could set colors for certain packages without reinventing the wheel. While I don't recall hearing or seeing anything about it, I thought it might be possible I just hadn't heard about a feature that does this. Doesn't sound like there is a easy way to do this so I guess just looking at each package name is the way to go for now. Dale :-) :-)
Re: [gentoo-user] Instrumenting emerges
On Saturday, 8 July 2023 16:19:49 BST Neil Bothwick wrote: > On Sat, 08 Jul 2023 15:20:19 +0100, Peter Humphrey wrote: > > Has anyone here developed a utility to record the one-minute load > > average once per minute and log the results? The first bit is easy: > > just cat /proc/loadavg, but the logging has me stumped for the moment. > > You could use dev-db/influxdb to record the information and > www-apps/grafana-bin to make pretty pictures with it. I've used this > combination in the past, although long enough ago[1] for the details t > have become fuzzy. > > [1] A week seems long enough these days :( :) -- Regards, Peter.
Re: [gentoo-user] Instrumenting emerges
>Hello list, > >Has anyone here developed a utility to record the one-minute load average once >per minute and log the results? The first bit is easy: just cat /proc/loadavg, >but the logging has me stumped for the moment. while [ true ] ; do cat /proc/loadavg |logger; sleep 60; done But you will want to read man logger to see where/how to direct the logging to somewhere more convenient than default. DaveF > >I see there's a QT-Charts module, but my impression is that it's a >programmer's tool. > >Ideas? > >-- >Regards, >Peter. > > > >
Re: [gentoo-user] Instrumenting emerges
On Sat, 08 Jul 2023 15:20:19 +0100, Peter Humphrey wrote: > Has anyone here developed a utility to record the one-minute load > average once per minute and log the results? The first bit is easy: > just cat /proc/loadavg, but the logging has me stumped for the moment. You could use dev-db/influxdb to record the information and www-apps/grafana-bin to make pretty pictures with it. I've used this combination in the past, although long enough ago[1] for the details t have become fuzzy. [1] A week seems long enough these days :( -- Neil Bothwick Of all the people I've met you're certainly one of them pgp1gp63jKlAu.pgp Description: OpenPGP digital signature
Re: [gentoo-user] Highlight certain packages being upgraded
On Sat, 8 Jul 2023 03:33:30 -0500, Dale wrote: > I was wondering. Is there a way to highlight certain packages that are > about to be upgraded? Example, I like to know when some larger packages > like Firefox, LOo, that excessively long qt package and a couple others > are going to be upgraded. Some that are listed in the world file show > up in a darker green and are easier to see however, some are not. They > are dependencies of another package but I'd like to have them stick out > in the list of packages to be upgraded. I don't recall ever seeing > anyone mention this as a feature of emerge or heard of a way to > configure such a thing either. That said, it could be possible and just > not well known. If your objective is to update your system without the long build times, put the atoms of the relevant packages in a file and run emerge --your-options --exclude "$(cat big-packages.txt)" @world -- Neil Bothwick "There are two ways to live: you can live as if nothing is a miracle; you can live as if everything is a miracle." (Albert Einstein) pgpUITQBNiNxN.pgp Description: OpenPGP digital signature
Re: [gentoo-user] Instrumenting emerges
Read from /proc/loadavg every minute and write in a file? sâm., 8 iul. 2023, 17:20 Peter Humphrey a scris: > Hello list, > > Has anyone here developed a utility to record the one-minute load average > once > per minute and log the results? The first bit is easy: just cat > /proc/loadavg, > but the logging has me stumped for the moment. > > I see there's a QT-Charts module, but my impression is that it's a > programmer's tool. > > Ideas? > > -- > Regards, > Peter. > > > > >
[gentoo-user] Instrumenting emerges
Hello list, Has anyone here developed a utility to record the one-minute load average once per minute and log the results? The first bit is easy: just cat /proc/loadavg, but the logging has me stumped for the moment. I see there's a QT-Charts module, but my impression is that it's a programmer's tool. Ideas? -- Regards, Peter.
Re: [gentoo-user] Highlight certain packages being upgraded
Dale, On Saturday, 2023-07-08 03:33:30 -0500, you wrote: > ... > I was wondering. Is there a way to highlight certain packages that are > about to be upgraded? Example, I like to know when some larger packages > like Firefox, LOo, that excessively long qt package and a couple others > are going to be upgraded. I simply don't know whether or not build-time related highlighting is possible in native Portage. I retrieve that information by some script- ing, which involves sending the output of "emerge --ask" to a log file, and as soon as "emerge" asks whether to continue, running a script in another terminal window which analyses this log file using "qlop" and "gawk". But to really ban several buld-time hogs from my rig, I added "-clang" and "-llvm" to my global USE flags, added "dev-lang/rust" to directory "package.mask/", causing "dev-lang/rust-bin" to be used when necessary, and besides happily replaced "www-client/firefox" with its binary vari- ant. I also tried this with "app-office/libreoffice", but sadly its bi- nary variant does not support exporting to PDF, so I humbly returned to "app-office/libreoffice" which here needs some three hours to build. If you don't need this feature, I would recommend using its binary version, too. Luckily, I don't have many "Qt" packages as dependencies, the lon- gest build time of these is about 23 minutes here. Sincerely, Rainer
Re: [gentoo-user] Highlight certain packages being upgraded
On Sat, Jul 8, 2023 at 4:33 AM Dale wrote: > Howdy, > > I was wondering. Is there a way to highlight certain packages that are > about to be upgraded? Example, I like to know when some larger packages > like Firefox, LOo, that excessively long qt package and a couple others > are going to be upgraded. Some that are listed in the world file show > up in a darker green and are easier to see however, some are not. They > are dependencies of another package but I'd like to have them stick out > in the list of packages to be upgraded. I don't recall ever seeing > anyone mention this as a feature of emerge or heard of a way to > configure such a thing either. That said, it could be possible and just > not well known. > > I'd like to be able to have those packages show up as red or something > like that. If it is possible. > > Thoughts? Ever heard of such a thing? > > Dale > > :-) :-) How about first making a list of all files needing to be rebuilt with something like emerge -pDuNv @world > builds Then make a file “long” containing names of demanding builds like firefox and qtwebengine, one to a line. Finally, execute grep -f long builds which will print the names of those long builds if they’re due for rebuilding or upgrading. HTH John Blinka >
Re: [gentoo-user] Encrypted swap with keyfile
On Sat, Jul 8, 2023 at 4:29 AM efeizbudak wrote: > > I use genkernel to make my initramfs and I am passing the crypt_swap, > crypt_swap_keydev and crypt_swap_key options but I'm guessing that since > /dev/sda2 comes before /dev/sda3, the initramfs tries to decrypt that one > first. How can I go around this? Is my only option to try and reorder these > partitions? > So, I've never really used genkernel, but this seems like the sort of thing that wouldn't be hard to do with dracut. If it doesn't already have native support for putting keyfiles in the initramfs, it would be pretty easy to create a module that does. Just loading the keyfile into the initramfs is trivial using install_items in the config file. You'd still need to change the logic to load it, or maybe do it via kernel command line. Perhaps genkernel has some way to add a file to the initramfs as well. -- Rich
[gentoo-user] Highlight certain packages being upgraded
Howdy, I was wondering. Is there a way to highlight certain packages that are about to be upgraded? Example, I like to know when some larger packages like Firefox, LOo, that excessively long qt package and a couple others are going to be upgraded. Some that are listed in the world file show up in a darker green and are easier to see however, some are not. They are dependencies of another package but I'd like to have them stick out in the list of packages to be upgraded. I don't recall ever seeing anyone mention this as a feature of emerge or heard of a way to configure such a thing either. That said, it could be possible and just not well known. I'd like to be able to have those packages show up as red or something like that. If it is possible. Thoughts? Ever heard of such a thing? Dale :-) :-)
[gentoo-user] Encrypted swap with keyfile
Hi everyone, So I've been trying to get my encrypted swap working but didn't have a lot of success so far. I have /dev/sda2 as the swap partition and /dev/sda3 as the root partition. I did encrypt the swap partition with a keyfile and the unlock works fine but the problem is that my initramfs asks to decrypt the swap partition before the root partition and since the keyfile is stored in the root partition it still asks me for a password. I use genkernel to make my initramfs and I am passing the crypt_swap, crypt_swap_keydev and crypt_swap_key options but I'm guessing that since /dev/sda2 comes before /dev/sda3, the initramfs tries to decrypt that one first. How can I go around this? Is my only option to try and reorder these partitions? Thank you!
