Re: [gentoo-user] Controlling emerges
Tsukasa Mcp_Reznor wrote:
> So I feel I should add my own 2 cents to the pileor possibly 25 cents due
> to inflation.
>
>
> PORTAGE_IONICE_COMMAND="ionice -c 3 -p \${PID}"
> PORTAGE_SCHEDULING_POLICY="idle"
>
> Those 2 together in make.conf have had a noticeable effect on multitasking
> for me. I still wouldn't recommend allocating all of your cores to emerge,
> but emerging with idle priority keeps your tasks a little higher up in the
> mix.
>
>
> From: Laurence Perkins
> Sent: Thursday, September 21, 2023 3:26 PM
> To: gentoo-user@lists.gentoo.org
> Subject: RE: [gentoo-user] Controlling emerges
>
I had the first one, little different for my rig, but I added the second
one just now. I'll be testing this tomorrow or Sunday, depending on
packages, maybe both. lol
Sometimes I wish they would announce when they add features. Rich, you
frequent this list. If you hear of something new, could you post it?
This may not be NEW but it is new to me. No idea when it got added.
Dale
:-) :-)
Re: [gentoo-user] What is a dependency of ruby
On 2023.09.21 13:09, Alan McKinnon wrote: On Thu, Sep 21, 2023 at 6:35 PM Jack wrote: > On 9/21/23 12:30, Alan McKinnon wrote: > > > > On Thu, Sep 21, 2023 at 5:03 PM Neil Bothwick wrote: > >> On Thu, 21 Sep 2023 13:45:19 +0200, Alan McKinnon wrote: >> >> > Not 100% back in the gentoo groove yet, forget some basic tools. >> > Something pulled in ruby, I know not what. >> > What commands show me what installed packages have ruby as a dependency? >> >> emerge -cav ruby > > but that is the wrong way wrong. > Why do you think so? Trying to remove ruby will tell you why portage refuses to do so, and that reason is any installed packages that depend on it. This differs from using equery, which will tell you every package that depends on ruby, whether or not it is installed. Using -d instead of -a saves you from typing "N" just in case it IS willing to unmerge it. > Because I wanted to know, recursively, what packages depended on ruby, i.e. I have ruby (which I despise) so why? The answer is kdenlive which I can see in equery d, and cannot see in emerge -c What options did you give to equery? I had thought that "equery d" listed only direct dependencies, and that it listed packages whether installed or not. Actually reading the fine equery man page, under the section on "depends (d)" are the options -a, --all packages - Include dependencies that are not installed. This can take a while. -D, --indirect - Search for both direct and indirect dependencies so I was wrong on both counts. I can imagine using -D might give a large list, but probably not so bad, as long as you don;t us both -a and -D. Is this where you found kdenlive? This matters because emerge -avc only gives immediate dependencies, I wanted to see the full dep tree -- Alan McKinnon alan dot mckinnon at gmail dot com
[gentoo-user] Re: How to move ext4 partition
On 2023-09-21, Jack wrote: > >> [...] Of course I've discovered for the Nth time in the past 10-15 >> years, that for the root= command line argument, the kernel doesn't >> grok LABEL or UUID values -- it only understands device names and >> PARTUUID. > > while my Gentoo grub.cfg has root=PARTUUID=, my Artix Linux install > (using openrc) has root=UUID=. I wasn't aware they had mucked with > grub (2.12-rc1) nor do I know if it's a recent change in grub. AFAIK, it's not grub (grub does know how to handle LABEL and UUID when setting grub's root). For the kernel, it's something in the initrd's 'init' executable that parses the root=UUID= or root=LABEL=, searches the available filesystems to find a match, then mounts the matching filesystem and does a chroot to it (or someting like that). If you don't have an initrd, then the kernel itself has to handle the root= and that code only knows about device names and partition UUIDs. It doesn't know anything about filesystems (which doesn't make much sense, since the next step is to mount the specified partition, and it obviously knows about filesystems at that point). At least that's what I've read...
Re: [gentoo-user] Re: How to move ext4 partition
On 9/21/23 16:23, Grant Edwards wrote: On 2023-09-21, Victor Ivanov wrote: On Wed, 20 Sept 2023 at 23:58, Grant Edwards wrote: Just make sure you update /etc/fstab and bootloader config file with the new filesystem UUID or partition indices. I always forget one or the other until after I try to boot the first time. That's why I keep systemrescuecd and Gentoo minimal install USB drives on hand. Me too, even just recently when I migrated my OS to another build I decided to do a few partition touch ups and fell once more into this trap. I updated fstab but not the bootloader. Luckily, Gentoo minimal install image is so tiny a bootable medium can literally be created in minutes. The tar backup restore worked just fine (and didn't take long, even though both drives were connected via USB). I've since fixed a second machine by adding a bios-boot partition. I should have started using them when I switched from MBR to GPT, but I think I got bios-boot partitions confused with UEFI boot partitions. :/ I'm also working on switching to using either labels or uuids in fstab and grub configs so that changes in partition numbers don't cause problems. Of course I've discovered for the Nth time in the past 10-15 years, that for the root= command line argument, the kernel doesn't grok LABEL or UUID values -- it only understands device names and PARTUUID. while my Gentoo grub.cfg has root=PARTUUID=, my Artix Linux install (using openrc) has root=UUID=. I wasn't aware they had mucked with grub (2.12-rc1) nor do I know if it's a recent change in grub.
Re: [gentoo-user] What is a dependency of ruby
On Thu, 21 Sep 2023 11:21:34 -0400, Matt Connell wrote: > > emerge -cav ruby > > emerge --depclean --pretend ruby > > No need to ask when you don't actually mean to depclean it... nor could > you if something depended on it. Muscle memory added the --ask, but you do need verbose for this to give the information you need. emerge -cpv ruby -- Neil Bothwick A real programmer never documents his code. It was hard to make, it should be hard to read pgpbG5qkjbrtO.pgp Description: OpenPGP digital signature
Re: [gentoo-user] Controlling emerges
So I feel I should add my own 2 cents to the pileor possibly 25 cents due
to inflation.
PORTAGE_IONICE_COMMAND="ionice -c 3 -p \${PID}"
PORTAGE_SCHEDULING_POLICY="idle"
Those 2 together in make.conf have had a noticeable effect on multitasking for
me. I still wouldn't recommend allocating all of your cores to emerge, but
emerging with idle priority keeps your tasks a little higher up in the mix.
From: Laurence Perkins
Sent: Thursday, September 21, 2023 3:26 PM
To: gentoo-user@lists.gentoo.org
Subject: RE: [gentoo-user] Controlling emerges
> -Original Message-
> From: Wol
> Sent: Wednesday, September 20, 2023 3:07 PM
> To: gentoo-user@lists.gentoo.org
> Subject: Re: [gentoo-user] Controlling emerges
>
> > What you have is not a portage problem. It is a orthodox parallelism
> > problem, and I think you are thinking your constraint is unique in the
> > work - it isn't.
> > With parallelism, trying to fiddle single nodes to improve things
> > overall never really works out.
> >
> A big problem you are missing is that portage does not have control of the
> system. It can control its usage of the system, but if I want emerge to use
> as much SPARE resource IN THE BACKGROUND as it can without impacting on
> on-line responsiveness, that is HARD.
>
> I would like to be able to tell portage "these programs are resource hogs,
> don't parallelise them". If portage has loads of little jobs, it can fire
> them off one after the other as resource becomes available. If it fires a hog
> (or worse, two) off at the same time, the system can rapidly collapse under
> load.
>
> Even better, if portage knew roughly how much resource each job required, it
> could (within constraints) start with the jobs that required least resource
> and run loads of them, and by firing jobs off in order of increasing
> demandingness, the number of jobs running in parallel would naturally tail
> off.
>
> At the end of the day, if the computer takes an extra 20% time, I'm not
> bothered. If I'm sat at the computer 20% time extra because the system isn't
> responding because emerge has bogged it down, then I do care. And when I'm
> building things like webkit-gtk, llvm, LO, FF and TB, they do hammer my
> system. If they're running in parallel, my system would be near unusable.
>
> Cheers,
> Wol
Maybe take a look at "cpulimit" out of the repos. I used to use it on one of
my low-power systems to control how much load the various compilers were
allowed to put on the system so that it could keep doing other tasks.
I think there are some other, similar tools as well.
LMP
[gentoo-user] Re: How to move ext4 partition
On 2023-09-21, Victor Ivanov wrote: > On Wed, 20 Sept 2023 at 23:58, Grant Edwards > wrote: > >>> Just make sure you update /etc/fstab and bootloader config file >>> with the new filesystem UUID or partition indices. >> >> I always forget one or the other until after I try to boot the >> first time. That's why I keep systemrescuecd and Gentoo minimal >> install USB drives on hand. > > Me too, even just recently when I migrated my OS to another build I > decided to do a few partition touch ups and fell once more into this > trap. I updated fstab but not the bootloader. Luckily, Gentoo > minimal install image is so tiny a bootable medium can literally be > created in minutes. The tar backup restore worked just fine (and didn't take long, even though both drives were connected via USB). I've since fixed a second machine by adding a bios-boot partition. I should have started using them when I switched from MBR to GPT, but I think I got bios-boot partitions confused with UEFI boot partitions. :/ I'm also working on switching to using either labels or uuids in fstab and grub configs so that changes in partition numbers don't cause problems. Of course I've discovered for the Nth time in the past 10-15 years, that for the root= command line argument, the kernel doesn't grok LABEL or UUID values -- it only understands device names and PARTUUID. -- Grant
RE: [gentoo-user] Controlling emerges
> -Original Message- > From: Wol > Sent: Wednesday, September 20, 2023 3:07 PM > To: gentoo-user@lists.gentoo.org > Subject: Re: [gentoo-user] Controlling emerges > > > What you have is not a portage problem. It is a orthodox parallelism > > problem, and I think you are thinking your constraint is unique in the > > work - it isn't. > > With parallelism, trying to fiddle single nodes to improve things > > overall never really works out. > > > A big problem you are missing is that portage does not have control of the > system. It can control its usage of the system, but if I want emerge to use > as much SPARE resource IN THE BACKGROUND as it can without impacting on > on-line responsiveness, that is HARD. > > I would like to be able to tell portage "these programs are resource hogs, > don't parallelise them". If portage has loads of little jobs, it can fire > them off one after the other as resource becomes available. If it fires a hog > (or worse, two) off at the same time, the system can rapidly collapse under > load. > > Even better, if portage knew roughly how much resource each job required, it > could (within constraints) start with the jobs that required least resource > and run loads of them, and by firing jobs off in order of increasing > demandingness, the number of jobs running in parallel would naturally tail > off. > > At the end of the day, if the computer takes an extra 20% time, I'm not > bothered. If I'm sat at the computer 20% time extra because the system isn't > responding because emerge has bogged it down, then I do care. And when I'm > building things like webkit-gtk, llvm, LO, FF and TB, they do hammer my > system. If they're running in parallel, my system would be near unusable. > > Cheers, > Wol Maybe take a look at "cpulimit" out of the repos. I used to use it on one of my low-power systems to control how much load the various compilers were allowed to put on the system so that it could keep doing other tasks. I think there are some other, similar tools as well. LMP
Re: [gentoo-user] What is a dependency of ruby
On Thu, Sep 21, 2023 at 6:35 PM Jack wrote: > On 9/21/23 12:30, Alan McKinnon wrote: > > > > On Thu, Sep 21, 2023 at 5:03 PM Neil Bothwick wrote: > >> On Thu, 21 Sep 2023 13:45:19 +0200, Alan McKinnon wrote: >> >> > Not 100% back in the gentoo groove yet, forget some basic tools. >> > >> > Something pulled in ruby, I know not what. >> > >> > What commands show me what installed packages have ruby as a dependency? >> >> emerge -cav ruby >> >> >> >> Thanks Neil, > > but that is the wrong way wrong. > > Why do you think so? Trying to remove ruby will tell you why portage > refuses to do so, and that reason is any installed packages that depend on > it. This differs from using equery, which will tell you every package that > depends on ruby, whether or not it is installed. Using -d instead of -a > saves you from typing "N" just in case it IS willing to unmerge it. > Because I wanted to know, recursively, what packages depended on ruby, i.e. I have ruby (which I despise) so why? The answer is kdenlive which I can see in equery d, and cannot see in emerge -c This matters because emerge -avc only gives immediate dependencies, I wanted to see the full dep tree -- Alan McKinnon alan dot mckinnon at gmail dot com
Re: [gentoo-user] What is a dependency of ruby
On 9/21/23 12:30, Alan McKinnon wrote: On Thu, Sep 21, 2023 at 5:03 PM Neil Bothwick wrote: On Thu, 21 Sep 2023 13:45:19 +0200, Alan McKinnon wrote: > Not 100% back in the gentoo groove yet, forget some basic tools. > > Something pulled in ruby, I know not what. > > What commands show me what installed packages have ruby as a dependency? emerge -cav ruby Thanks Neil, but that is the wrong way wrong. Why do you think so? Trying to remove ruby will tell you why portage refuses to do so, and that reason is any installed packages that depend on it. This differs from using equery, which will tell you every package that depends on ruby, whether or not it is installed. Using -d instead of -a saves you from typing "N" just in case it IS willing to unmerge it.
Re: [gentoo-user] What is a dependency of ruby
On Thu, Sep 21, 2023 at 5:03 PM Neil Bothwick wrote: > On Thu, 21 Sep 2023 13:45:19 +0200, Alan McKinnon wrote: > > > Not 100% back in the gentoo groove yet, forget some basic tools. > > > > Something pulled in ruby, I know not what. > > > > What commands show me what installed packages have ruby as a dependency? > > emerge -cav ruby > > > > Thanks Neil, but that is the wrong way wrong. -- Alan McKinnon alan dot mckinnon at gmail dot com
Re: [gentoo-user] What is a dependency of ruby
On Thu, 2023-09-21 at 16:03 +0100, Neil Bothwick wrote: > > What commands show me what installed packages have ruby as a dependency? > > emerge -cav ruby emerge --depclean --pretend ruby No need to ask when you don't actually mean to depclean it... nor could you if something depended on it.
Re: [gentoo-user] What is a dependency of ruby
On Thursday, 21 September 2023 13:34:20 BST Alan McKinnon wrote: > On Thu, Sep 21, 2023 at 2:01 PM Arve Barsnes wrote: > > On Thu, 21 Sept 2023 at 13:45, Alan McKinnon > > > > wrote: > > > Hey Gentooers, > > > > > > Not 100% back in the gentoo groove yet, forget some basic tools. > > > > > > Something pulled in ruby, I know not what. > > > > > > What commands show me what installed packages have ruby as a dependency? > > > > I tend to use > > # equery d dev-lang/ruby > > > > equery from app-portage/gentoolkit > > > > Regards, > > Arve > > Yes, that's the one! thanks! Let's not forget qdepends too: $ qdepends usage: qdepends [opts] : show dependency info options: -[drpbIQitUF:SRvqChV] -d, --depend * Show DEPEND info -r, --rdepend * Show RDEPEND infols: /usr/bin/qdepends -p, --pdepend * Show PDEPEND info -b, --bdepend * Show BDEPEND info -I, --idepend * Show IDEPEND info -Q, --query* Query reverse deps -i, --installed* Search installed packages using VDB -t, --tree * Search available ebuilds in the tree -U, --use * Apply profile USE-flags to conditional deps -F, --format * Print matched atom using given format string -S, --pretty * Pretty format specified depend strings -R, --resolve * Resolve found dependencies to package versions --root* Set the ROOT env var -v, --verbose * Report full package versions, emit more elaborate output -q, --quiet* Tighter output; suppress warnings -C, --nocolor * Don't output color --color* Force color in output -h, --help * Print this help and exit -V, --version * Print version and exit $ qfile /usr/bin/qdepends app-portage/portage-utils: /usr/bin/qdepends signature.asc Description: This is a digitally signed message part.
Re: [gentoo-user] What is a dependency of ruby
On Thu, 21 Sep 2023 13:45:19 +0200, Alan McKinnon wrote: > Not 100% back in the gentoo groove yet, forget some basic tools. > > Something pulled in ruby, I know not what. > > What commands show me what installed packages have ruby as a dependency? emerge -cav ruby -- Neil Bothwick If at first you don't succeed, skydiving is not for you. pgp9mQbDdZpE3.pgp Description: OpenPGP digital signature
Re: [gentoo-user] What is a dependency of ruby
On Thu, Sep 21, 2023 at 2:01 PM Arve Barsnes wrote: > On Thu, 21 Sept 2023 at 13:45, Alan McKinnon > wrote: > > > > Hey Gentooers, > > > > Not 100% back in the gentoo groove yet, forget some basic tools. > > > > Something pulled in ruby, I know not what. > > > > What commands show me what installed packages have ruby as a dependency? > > I tend to use > # equery d dev-lang/ruby > > equery from app-portage/gentoolkit > > Regards, > Arve > > Yes, that's the one! thanks! -- Alan McKinnon alan dot mckinnon at gmail dot com
Re: [gentoo-user] What is a dependency of ruby
On Thu, 21 Sept 2023 at 13:45, Alan McKinnon wrote: > > Hey Gentooers, > > Not 100% back in the gentoo groove yet, forget some basic tools. > > Something pulled in ruby, I know not what. > > What commands show me what installed packages have ruby as a dependency? I tend to use # equery d dev-lang/ruby equery from app-portage/gentoolkit Regards, Arve
[gentoo-user] What is a dependency of ruby
Hey Gentooers, Not 100% back in the gentoo groove yet, forget some basic tools. Something pulled in ruby, I know not what. What commands show me what installed packages have ruby as a dependency? -- Alan McKinnon alan dot mckinnon at gmail dot com
Re: [gentoo-user] Re: How to move ext4 partition
On Wed, 20 Sept 2023 at 23:58, Grant Edwards wrote: > Yep, that's pretty much what I decided on based on the tar command > shown at > >https://wiki.gentoo.org/wiki/Handbook:AMD64/Installation/Stage > > Interestingly, the Arch Linux Wiki recommends using bsdtar because > "GNU tar with --xattrs will not preserve extended attributes". I remember coming across this too as I've previously had issues preserving some extended attributes, notably on files under my home directory. However, I found that using "--xattrs-include='*.*'" in addition to "--xattrs" works pretty well and does record attributes that would otherwise be excluded with just "--xattrs". I cannot comment, however, if it truly includes "everything" in every possible scenario. > > Both the drive being "fixed" and the backup drive are in a USB3 > attached dual slot drive dock, so I'm thinking compression might be > worthwhile. > Then LZO or zstd might indeed be a better approach as suggested by Frank. > > Just make sure you update /etc/fstab and bootloader config file with > > the new filesystem UUID or partition indices. > > I always forget one or the other until after I try to boot the first > time. That's why I keep systemrescuecd and Gentoo minimal install > USB drives on hand. Me too, even just recently when I migrated my OS to another build I decided to do a few partition touch ups and fell once more into this trap. I updated fstab but not the bootloader. Luckily, Gentoo minimal install image is so tiny a bootable medium can literally be created in minutes. Good luck! Regards, V
Re: [gentoo-user] Re: How to move ext4 partition
On Thu, 21 Sept 2023 at 02:01, Frank Steinmetzger wrote: > > $ tar -cpf /path/to/backup.tar --xattrs --xattrs-include='*.*' -C / . > > Does that stop at file system boundaries (because you tar up '/')? I think > it must be, otherwise you wouldn’t use it that way. No, it doesn't. It will archive everything recursively including mounted directories, so fair point for raising this. It's something that I do not normally consider, as I tend not to do full root backup on the running system itself. But how cool is using bind mount for this situation as you suggest? Simple and effective, I like it. Actually, the presence of -C in the above example is purely out of habit. I use it when pointing to a full path, e.g. "/path/to/dir" so it doesn't end up creating the "path/to/dir" path prefix inside the archive and only archives the contents of the path. It's effectively changing to that directory and archiving everything there, but saves you from doing the "cd". Naturally, for "/" this is superfluous and "-C / ." can be replaced with just "/". > > Provided backup space isn't an issue, I wouldn't bother with > > compression. It could be a lot quicker too depending on the size of > > your root partition. > > Or not, depending on the speed of the backup device. ;-) > LZO compression (or zstd with a low setting) has negligible CPU cost, but > can lower the file size quite nicely, specially with large binaries or debug > files. > That's true :) I had somehow forgotten of tar's support for LZO and zstd as my default finger memory approach is to use -J for xz. Good memory nudge here! Regards, V
