Re: [gentoo-user] What is the best way to clean up the world file?
Jack wrote: > On 6/6/19 1:37 PM, Grant Taylor wrote: >> On 6/6/19 10:50 AM, Jack wrote: >> >>> I'm not going to even try regenworld, as I'm in the midst of >>> converting to the 17.1 profile, and have quite a number of packages >>> that don't yet seem to cope with that change well. >> >> Fair. >> >> I'm not thinking about the 17.0 to 17.1 migration yet. > It still seems not quite ready for prime time. >> I'm wondering what, if anything I need to do to clean up gcc: >> >> % gcc-config -l >> [1] x86_64-pc-linux-gnu-6.4.0 * >> [2] x86_64-pc-linux-gnu-8.2.0 >> [3] x86_64-pc-linux-gnu-8.3.0 >> >> I seem to remember going from older /to/ 6.4 being a bit touchy. > I currently have only 8.3.0 installed, and I don't remember having any > problems with the upgrade from whatever previous version I was using. > I assume (can't remember) that I did rebuild a number of other > packages before/when I removed the older version(s), but my current > rig is far too slow to even consider an "emerge world" (would take at > least a week) so I'm pretty selective about rebuilding stuff. > > I don't recall having any problems with the GCC upgrade either. I'd check the news items to be sure if anything special needs to be done but I don't recall anything. Dale :-) :-)
Re: [gentoo-user] What is the best way to clean up the world file?
On June 6, 2019 5:43:07 PM UTC, Jack wrote: >On 6/6/19 1:37 PM, Grant Taylor wrote: >> On 6/6/19 10:50 AM, Jack wrote: >> >>> I'm not going to even try regenworld, as I'm in the midst of >>> converting to the 17.1 profile, and have quite a number of packages >>> that don't yet seem to cope with that change well. >> >> Fair. >> >> I'm not thinking about the 17.0 to 17.1 migration yet. >It still seems not quite ready for prime time. >> I'm wondering what, if anything I need to do to clean up gcc: >> >> % gcc-config -l >> [1] x86_64-pc-linux-gnu-6.4.0 * >> [2] x86_64-pc-linux-gnu-8.2.0 >> [3] x86_64-pc-linux-gnu-8.3.0 >> >> I seem to remember going from older /to/ 6.4 being a bit touchy. >I currently have only 8.3.0 installed, and I don't remember having any >problems with the upgrade from whatever previous version I was using. >I >assume (can't remember) that I did rebuild a number of other packages >before/when I removed the older version(s), but my current rig is far >too slow to even consider an "emerge world" (would take at least a >week) >so I'm pretty selective about rebuilding stuff. Check the Gentoo GCC upgrade guide. It lists versions from which the default method won't work correctly. -- Joost -- Sent from my Android device with K-9 Mail. Please excuse my brevity.
Re: [gentoo-user] What is the best way to clean up the world file?
On 6/6/19 1:37 PM, Grant Taylor wrote: On 6/6/19 10:50 AM, Jack wrote: I'm not going to even try regenworld, as I'm in the midst of converting to the 17.1 profile, and have quite a number of packages that don't yet seem to cope with that change well. Fair. I'm not thinking about the 17.0 to 17.1 migration yet. It still seems not quite ready for prime time. I'm wondering what, if anything I need to do to clean up gcc: % gcc-config -l [1] x86_64-pc-linux-gnu-6.4.0 * [2] x86_64-pc-linux-gnu-8.2.0 [3] x86_64-pc-linux-gnu-8.3.0 I seem to remember going from older /to/ 6.4 being a bit touchy. I currently have only 8.3.0 installed, and I don't remember having any problems with the upgrade from whatever previous version I was using. I assume (can't remember) that I did rebuild a number of other packages before/when I removed the older version(s), but my current rig is far too slow to even consider an "emerge world" (would take at least a week) so I'm pretty selective about rebuilding stuff.
Re: [gentoo-user] What is the best way to clean up the world file?
On 6/6/19 10:50 AM, Jack wrote: I've been going through this lately also (mainly due to forgetting -1 on updates) and put together a script, which I can post later if anyone wants. However, the bottom line for me is to do "emerge -pc package" for each package in world to see what (if anything) else pulled it in. If it was pulled in by something else, I remove it from the world file, unless I explicitly want it installed. The script just does most of that, producing a file that makes it easier for me to see what -pc would remove and what is actually installed. Interesting concept and methodology. I'll have to pontificate that. Currently my world file is 292 lines, with 1863 packages installed (from "eix-installed -a".) ACK I'm not going to even try regenworld, as I'm in the midst of converting to the 17.1 profile, and have quite a number of packages that don't yet seem to cope with that change well. Fair. I'm not thinking about the 17.0 to 17.1 migration yet. I'm wondering what, if anything I need to do to clean up gcc: % gcc-config -l [1] x86_64-pc-linux-gnu-6.4.0 * [2] x86_64-pc-linux-gnu-8.2.0 [3] x86_64-pc-linux-gnu-8.3.0 I seem to remember going from older /to/ 6.4 being a bit touchy. -- Grant. . . . unix || die
Re: [gentoo-user] What is the best way to clean up the world file?
On 2019.06.06 11:59, Grant Taylor wrote: On 6/6/19 9:57 AM, Grant Taylor wrote: It seems as if the regenworld script adds things that it finds from /var/log/emerge.log that aren't themselves dependencies of something else. Thus it the world file is cleaner than if all installed packages were in the world file. To put some numbers to it, regenworld crates a new world file that is ~250 lines on a machine that has > 950 packages installed (as reported by emerge -DuNeq @world). So it's better. But I think I still need to clean the world file. I've been going through this lately also (mainly due to forgetting -1 on updates) and put together a script, which I can post later if anyone wants. However, the bottom line for me is to do "emerge -pc package" for each package in world to see what (if anything) else pulled it in. If it was pulled in by something else, I remove it from the world file, unless I explicitly want it installed.The script just does most of that, producing a file that makes it easier for me to see what -pc would remove and what is actually installed. Currently my world file is 292 lines, with 1863 packages installed (from "eix-installed -a".) I'm not going to even try regenworld, as I'm in the midst of converting to the 17.1 profile, and have quite a number of packages that don't yet seem to cope with that change well. Jack
Re: [gentoo-user] What is the best way to clean up the world file?
On 6/6/19 9:57 AM, Grant Taylor wrote: It seems as if the regenworld script adds things that it finds from /var/log/emerge.log that aren't themselves dependencies of something else. Thus it the world file is cleaner than if all installed packages were in the world file. To put some numbers to it, regenworld crates a new world file that is ~250 lines on a machine that has > 950 packages installed (as reported by emerge -DuNeq @world). So it's better. But I think I still need to clean the world file. -- Grant. . . . unix || die
Re: [gentoo-user] What is the best way to clean up the world file?
On 6/5/19 10:56 PM, Dale wrote: It's a plain text file and I've edited it in the past with no problems. ACK I /thought/ that was the case. But I wanted to double check that there wasn't something else filed away that needed to match before I edited the file. I've done that cleanup before and it can take some time to accomplish depending on how bad it is. I went through this when I first started using Gentoo and didn't know any better. I'd do small chunks and keep a versioned back up file just in case. *nod* I've also used the script once. It does fairly well. It may miss a couple here and there and may have a few false positives as well. It seems as if the regenworld script adds things that it finds from /var/log/emerge.log that aren't themselves dependencies of something else. Thus it the world file is cleaner than if all installed packages were in the world file. However, there are still some things that aren't dependencies of other things that are listed that are no longer needed. The world file is 279 lines long. I'm just going to go through the file by hand and identify every package listed and make a judgment call if I know if it needs to be on the system or not. If it does, then I'll leave it. If it doesn't then I'll remove it from the world file and let emerge decide if it needs to stay or not. There's a massive --depclean in this systems future. Still it can do some heavy lifting for you. I'd copy the world file to a safe place and try the script. I'd try it once with the old world file in place and once without a world file at all. Then see which one works best. If that fails, do it manually. ACK Good luck. I hope one or the other works. Thank you. -- Grant. . . . unix || die -- Grant. . . . unix || die
Re: [gentoo-user] What is the best way to clean up the world file?
On 6/6/19 1:36 AM, Mick wrote: On Thursday, 6 June 2019 05:56:53 BST Dale wrote: Grant Taylor wrote: On 6/5/19 9:18 PM, Dale wrote: I would start by removing anything that has libs in it. Generally, those should be pulled in as deps. After that, I'd go through the list and remove anything that you don't directly use. ACK Can I just edit /var/lib/portage/world? Or do I need to do something else? Yes, manually edit this file, but FIRST MAKE A BACK UP. :-) If you don't feel comfortable doing that `emerge --deselect` will remove things from the world file without altering it's state on the machine (i.e. you will have to --depclean to remove packages.) Dan
Re: [gentoo-user] What is the best way to clean up the world file?
Mick wrote: > On Thursday, 6 June 2019 09:56:24 BST Neil Bothwick wrote: >> On Thu, 06 Jun 2019 09:36:03 +0100, Mick wrote: >>> I think, but may be wrong, regenworld will pick up anything and >>> everything in emerge.log and add it to your world file. Definitely >>> create a back up of / var/lib/portage/world if you do not have one >>> already, because you can diff it later on to see how much weight it has >>> put on. >> I think it only adds packages that are not a dependency of something >> else, which may result in a world file that is too lean and >> over-enthusiastic depcleaning later on. >> >> Another method, a time consuming one, is to remove the world file and run >> emerge -p --depclean. Then emerge -n anything in the output that you use >> directly. Rinse and repeat. Eventually the depclean output will only >> contain unneeded packages, at which point you can run it in anger. > I haven't used it for a long time, so its behaviour may have > changed/improved. > The last time I used it I got a *very* long list of "package XXX was added to > your world file" kind of message and stopped using it ever since. I may have > run it the wrong way - not sure - but thought of warning Grant just in case. > With a back up in hand, which I foolishly did not have handy as I was rushing > at the time, it is easy to revert any unwelcome changes. > > As Dale mentioned my original problem (a fat/polluted world file) would have > been easily resolved if I used 'emerge -1' each time I manually tried to sort > out some portage output. I think I've learned this lesson well. ;-) > And if you are a old fart who has bad memory like me, put it in the make.conf as a default. That way it takes no effort to keep a clean world file but does take effort to add something to the world file. I have to rebuild a individual package a lot more than I need to install a new package. I learned long ago, don't trust my memory to do things by default. Heck, I have to think about it to remember to add the -N to regular updates still. I been doing that for years. If it wouldn't screw up other things, I'd set it as a default but that causes another set of issues. Go ahead, tell me to do updates in script. ROFL Dale :-) :-)
Re: [gentoo-user] What is the best way to clean up the world file?
On Thursday, 6 June 2019 09:56:24 BST Neil Bothwick wrote: > On Thu, 06 Jun 2019 09:36:03 +0100, Mick wrote: > > I think, but may be wrong, regenworld will pick up anything and > > everything in emerge.log and add it to your world file. Definitely > > create a back up of / var/lib/portage/world if you do not have one > > already, because you can diff it later on to see how much weight it has > > put on. > > I think it only adds packages that are not a dependency of something > else, which may result in a world file that is too lean and > over-enthusiastic depcleaning later on. > > Another method, a time consuming one, is to remove the world file and run > emerge -p --depclean. Then emerge -n anything in the output that you use > directly. Rinse and repeat. Eventually the depclean output will only > contain unneeded packages, at which point you can run it in anger. I haven't used it for a long time, so its behaviour may have changed/improved. The last time I used it I got a *very* long list of "package XXX was added to your world file" kind of message and stopped using it ever since. I may have run it the wrong way - not sure - but thought of warning Grant just in case. With a back up in hand, which I foolishly did not have handy as I was rushing at the time, it is easy to revert any unwelcome changes. As Dale mentioned my original problem (a fat/polluted world file) would have been easily resolved if I used 'emerge -1' each time I manually tried to sort out some portage output. I think I've learned this lesson well. ;-) -- Regards, Mick signature.asc Description: This is a digitally signed message part.
Re: [gentoo-user] What is the best way to clean up the world file?
On Thu, 06 Jun 2019 09:36:03 +0100, Mick wrote: > I think, but may be wrong, regenworld will pick up anything and > everything in emerge.log and add it to your world file. Definitely > create a back up of / var/lib/portage/world if you do not have one > already, because you can diff it later on to see how much weight it has > put on. I think it only adds packages that are not a dependency of something else, which may result in a world file that is too lean and over-enthusiastic depcleaning later on. Another method, a time consuming one, is to remove the world file and run emerge -p --depclean. Then emerge -n anything in the output that you use directly. Rinse and repeat. Eventually the depclean output will only contain unneeded packages, at which point you can run it in anger. -- Neil Bothwick People who eat natural foods die from natural causes. pgpyT9uhIkjXb.pgp Description: OpenPGP digital signature
Re: [gentoo-user] What is the best way to clean up the world file?
Mick wrote: > On Thursday, 6 June 2019 05:56:53 BST Dale wrote: >> Grant Taylor wrote: >>> On 6/5/19 9:18 PM, Dale wrote: I would start by removing anything that has libs in it. Generally, those should be pulled in as deps. After that, I'd go through the list and remove anything that you don't directly use. >>> ACK >>> >>> Can I just edit /var/lib/portage/world? Or do I need to do something >>> else? > Yes, manually edit this file, but FIRST MAKE A BACK UP. :-) > > >> It's a plain text file and I've edited it in the past with no problems. >> I've done that cleanup before and it can take some time to accomplish >> depending on how bad it is. I went through this when I first started >> using Gentoo and didn't know any better. I'd do small chunks and keep a >> versioned back up file just in case. >> >> I've also used the script once. It does fairly well. It may miss a >> couple here and there and may have a few false positives as well. Still >> it can do some heavy lifting for you. I'd copy the world file to a safe >> place and try the script. I'd try it once with the old world file in >> place and once without a world file at all. Then see which one works >> best. If that fails, do it manually. >> >> Good luck. I hope one or the other works. >> >> Dale >> >> :-) :-) > I think, but may be wrong, regenworld will pick up anything and everything in > emerge.log and add it to your world file. Definitely create a back up of / > var/lib/portage/world if you do not have one already, because you can diff it > later on to see how much weight it has put on. > >From the help info, I think that is what it is saying. However, when I used it last time, many years ago, it would somehow figure out what is dependencies. From what I recall, it didn't do a bad job. As you say tho, backup the file before doing anything. At least then there is something to refer back to. Of course, it may be a option to just start from a empty world file and add back what is really needed and just keep running --depclean to see what needs to be added back to the world file. This is like updating a old un-maintained system. In some cases it is best to reinstall but in some it may not take much effort to do the updates just in smaller steps. Thing is, one doesn't know until one starts the process. It all depends on so many variables. Plus, we ain't the ones doing it either. lol Dale :-) :-)
Re: [gentoo-user] What is the best way to clean up the world file?
On Thursday, 6 June 2019 05:56:53 BST Dale wrote: > Grant Taylor wrote: > > On 6/5/19 9:18 PM, Dale wrote: > >> I would start by removing anything that has libs in it. Generally, > >> those should be pulled in as deps. After that, I'd go through the > >> list and remove anything that you don't directly use. > > > > ACK > > > > Can I just edit /var/lib/portage/world? Or do I need to do something > > else? Yes, manually edit this file, but FIRST MAKE A BACK UP. :-) > It's a plain text file and I've edited it in the past with no problems. > I've done that cleanup before and it can take some time to accomplish > depending on how bad it is. I went through this when I first started > using Gentoo and didn't know any better. I'd do small chunks and keep a > versioned back up file just in case. > > I've also used the script once. It does fairly well. It may miss a > couple here and there and may have a few false positives as well. Still > it can do some heavy lifting for you. I'd copy the world file to a safe > place and try the script. I'd try it once with the old world file in > place and once without a world file at all. Then see which one works > best. If that fails, do it manually. > > Good luck. I hope one or the other works. > > Dale > > :-) :-) I think, but may be wrong, regenworld will pick up anything and everything in emerge.log and add it to your world file. Definitely create a back up of / var/lib/portage/world if you do not have one already, because you can diff it later on to see how much weight it has put on. -- Regards, Mick signature.asc Description: This is a digitally signed message part.
Re: [gentoo-user] What is the best way to clean up the world file?
Grant Taylor wrote: > On 6/5/19 9:18 PM, Dale wrote: >> I would start by removing anything that has libs in it. Generally, >> those should be pulled in as deps. After that, I'd go through the >> list and remove anything that you don't directly use. > > ACK > > Can I just edit /var/lib/portage/world? Or do I need to do something > else? It's a plain text file and I've edited it in the past with no problems. I've done that cleanup before and it can take some time to accomplish depending on how bad it is. I went through this when I first started using Gentoo and didn't know any better. I'd do small chunks and keep a versioned back up file just in case. I've also used the script once. It does fairly well. It may miss a couple here and there and may have a few false positives as well. Still it can do some heavy lifting for you. I'd copy the world file to a safe place and try the script. I'd try it once with the old world file in place and once without a world file at all. Then see which one works best. If that fails, do it manually. Good luck. I hope one or the other works. Dale :-) :-)
Re: [gentoo-user] What is the best way to clean up the world file?
On 6/5/19 9:18 PM, Dale wrote: I would start by removing anything that has libs in it. Generally, those should be pulled in as deps. After that, I'd go through the list and remove anything that you don't directly use. ACK Can I just edit /var/lib/portage/world? Or do I need to do something else? Ah, it just hit me. root@fireball / # regenworld -h This script regenerates the portage world file by checking the portage logfile for all actions that you've done in the past. It ignores any arguments except --help. It is recommended that you make a backup of your existing world file (/var/lib/portage/world) before using this tool. root@fireball / # I'll check that out. I might add, I put the option -1 in my make.conf for emerge defaults so that anytime I emerge something, it doesn't get added to the world file. If I want to add something to the world file, I use --select y to override the -1 in make.conf. It's so easy to forget to add -1 and make a mess of the world file, I decided to set it so I don't have to remember. You may want to consider this. I'll consider that.
Re: [gentoo-user] What is the best way to clean up the world file?
Grant Taylor wrote: > What is the best way to clean up the world file? > > I have inherited a system where someone did individual emerges to > update packages when there was a single package that had a problem. > So, now all the packages that emerge wanted to update have been added > to the world file. > > I'd like to clean up world file so that it's back to just the original > packages and allow emerge to manage the dependencies. More > specifically, I'd like the standard emerge --depclean to remove > no-longer-needed dependencies after removing the things that depended > on them. > > I can derive a list of the extra dependencies from the > /var/log/emerge.log file by looking for clusters of individual > installs really close to each other. > > I would start by removing anything that has libs in it. Generally, those should be pulled in as deps. After that, I'd go through the list and remove anything that you don't directly use. Example, leave Firefox since it is a web browser you use directly, Libreoffice is another example. Other examples may be Smplayer, VLC, digiKam and other similar programs. There used to be a script that does this fairly well but not sure if it still works or even exists. As you remove items, run emerge -a --depclean to see what would be removed. Look for anything you want to keep and add those as needed. It can take time to complete this sort of task if your world file is a real mess. Ah, it just hit me. root@fireball / # regenworld -h This script regenerates the portage world file by checking the portage logfile for all actions that you've done in the past. It ignores any arguments except --help. It is recommended that you make a backup of your existing world file (/var/lib/portage/world) before using this tool. root@fireball / # I might add, I put the option -1 in my make.conf for emerge defaults so that anytime I emerge something, it doesn't get added to the world file. If I want to add something to the world file, I use --select y to override the -1 in make.conf. It's so easy to forget to add -1 and make a mess of the world file, I decided to set it so I don't have to remember. You may want to consider this. Dale :-) :-)