Re: [gentoo-user] Successfully upgraded to new profile 23.0
I use a buildhost for each of the 4 architectures I manage - binary emtytree installs are not to bad. However the initial build for low power arm systems is measured in multiple days (for just the initial toolchain, not hours :(. Only minor problems so far though which is good. At least it can build while online, unlike fresh installs which mean lots of downtime and more work for me in configuring. BillK On 9/4/24 05:14, Eli Schwartz wrote: On 4/8/24 10:03 AM, Dr Rainer Woitok wrote: Greetings, the upgrade on my old laptop with two 2.7GHz Dual-Core Skylake proces- sors took slightly more than 2 hours for the manual upgrading of "bin- utils", "gcc" and "glibc", and slightly more than 21.5 hours for the fi- nal upgrade of "@world", which had to process a total of 1061 packages. I'm wondering whether a fresh install from a stage 3 "tar" ball would have been faster? If you're okay doing a fresh install from a stage3 tar, which is faster at least to install the base system because it is all precompiled and you are not building the packages yourself, then I would assume you're also okay doing the update using the gentoo.org official binhost. They're both just the binaries that Gentoo's release automation builds for you. Extracting a bunch of gpkgs is much faster than compiling them, and not too much slower than extracting a single stage3 tarball. It also has the advantage that for amd64, more than just the stage3 package set can be sped up like this -- and you don't have to rebuild the installation, recreate @world, backup and restore user data, etc. Just enable the binhost and then do the same -e @world you were doing without the binhost. :) My first Gentoo installation on this laptop back in mid 2019 used pro- file 17.1 (which is still marked "experimental", by the way). Now, less than five years later this profile set is deprecated. Is five years a common intervall between enforced Gentoo profile upgrades? Well, 13.0 -> 17.0 -> 17.1 -> 23.0 so I suppose you could say they are fairly long intervals, yeah. As far as it being marked experimental: it was dropped from stable during the 23.0 announcement, but is being marked as stable again: https://github.com/gentoo/gentoo/pull/35871 Rationale: """ Making 17.1 exp immediately gives the impression that it's formally deprecated, which it isn't yet. """
Re: [gentoo-user] New profiles 23.0
I have a question about binaries and the new profile: I have a number of almost identical architectures that I build binaries for and share across the similar sytems e.g. arm, aarch64, amd64 etc. Is deleting the bin host storage (rm -rf ) enough on the buildhost so I can share/use the binaries for the "emerge -e" on the other hosts? Or does it have to be a native emerge? BillK
Re: [gentoo-user] Problem with "GRUB upgrades" news item
Is your efi fat32 formatted? (required) This usually means its another partition mounted to /boot/EFI BillK On 6/3/24 14:02, Dale wrote: Walter Dnes wrote: I've got a UEFI system. According to the news item... Re-runing grub-install both with and without the --removable option should ensure a working GRUB installation. I tried that... [i3][root][~] grub-install Installing for x86_64-efi platform. grub-install: error: cannot find EFI directory. [i3][root][~] grub-install --removable Installing for x86_64-efi platform. grub-install: error: cannot find EFI directory. Oops! My EFI directory... [i3][root][~] ll /boot/EFI/ total 2 drwxr-xr-x 3 root root 512 Jun 11 2021 . drwxr-xr-x 4 root root 1024 Dec 31 1969 .. drwxr-xr-x 2 root root 512 Jun 11 2021 gentoo Any ideas? I don't use EFI but I read on this the other day when I was working my way through this news item. Here is a link. https://wiki.gentoo.org/wiki/GRUB#Installing_GRUB_for_EFI If you followed the docs for installing grub with EFI, you need to point it to the location of the efi directory. The command might look like this. | grub-install --efi-directory=/efi Hope that helps. Dale :-) :-) |
Re: [gentoo-user] Don't be like stupid me!
On 10/2/24 23:56, Alan Mackenzie wrote: Hello, gentoo. I was wanting to do a pretty full build of my Emacs working repository. This involved first purging al *.elc files. The way to do this is $ find . -name '*.elc' | xargs rm . But for some reason, I typed $ find . '*.elc' | xargs rm . I even carefully checked it before pressing RET. However, press it I did, instantly deleting all files in my working directory. OUTCH! So, I fell back on my backup from last Sunday. After about 1½ hours trial and error, I had my source files as of last Sunday back again, though git could have been more helpful than it actually is. Thankfully, I had Emacs open, with all the files modified since Sunday in buffers. So, I laboriously worked through Emacs's buffer list, saving those ones I'd since changed. I lost all my timestamps on the files, and lost all my Emacs backup files (things ending in ~ which Emacs constantly makes). But my software builds and runs. It could have been a lot worse. Boys and girls, don't use $ find | xargs rm unless you really know what you're doing. And even then, it's probably better not to. ;-( It occurred to me fairly quickly after that press of RET that I could have done well with a COW snapshot facility, something which has been discussed at length on another recent thread. I even have LVM on my machine for its RAID capabilities. But I've never bothered before. I mean "I'm too careful", amn't I? ;-( At least I do a weekly backup, though. So, in the end I managed to recover fairly well, thankfully. No, you don't need a snapshot system - you need a proper backup system that stores the proper metadata. When I was experimenting with snapshots (btrfs and moosefs) at different times I lost everything a few times with filesystem corruption which meant I lost the snapshots too. Snapshots are NOT safe backups - treat them as a convenient copy ... BillK
Re: [gentoo-user] Suggestions for backup scheme?
On 8/2/24 06:36, Frank Steinmetzger wrote: Am Tue, Jan 30, 2024 at 06:15:09PM - schrieb Grant Edwards: I need to set up some sort of automated backup on a couple Gentoo machines (typical desktop software development and home use). One of them used rsnapshot in the past but the crontab entries that drove that have vanished :/ (presumably during a reinstall or upgrade -- IIRC, it took a fair bit of trial and error to get the crontab entries figured out). I believe rsnapshot ran nightly and kept daily snapshots for a week, weekly snapshots for a month, and monthly snapshots for a couple years. Are there other backup solutions that people would like to suggest I look at to replace rsnapshot? I was happy enough with rsnapshot (when it was running), but perhaps there's something else I should consider? In my early backup times I, too, used rsnapshot to back up my ~ and rsync for my big media files. But that only included my PC. My laptop was wholly un-backed-up. I only syncronised much of my home and my audio collection between the two with unison. At some point my external 3 TB drive became free and then I started using borg to finally do proper backups. Borg is very similar to restic, I actually used the two in parallel for a while to compare them, but stayed with borg. One pain point was that I couln’t switch off restic’s own password protection. Since all my backup disks are LUKSed anyway, I don’t need that. Since borg works block-based, it does deduplication without extra cost and it is suitable for big image files which don’t change much. I do full filesystem backups of /, ~ and my media partition of my main PC and my laptop. I have one repository for each of those three filesystems, and each repo receives the data from both machines, so they are deduped. Since both machines run Arch, their roots are binary identical. The same goes for my unison-synced homes. Borg has retention logic built-in. You can say I want to keep the latest archive of each of the last 6 days/weeks/months/years, and it even goes down to seconds. And of course you can combine those rules. The only thing is they don’t overlap, meaning if you want to keep the last 14 days and the last four weeks, those weekly retentions start after the last daily snapshots. In summary, advantages: + fast dedup, built-in compression (different algos and levels configurable) + big data files allow for quick mirroring of repositories. I simply rsync my primary backup disk to two other external HDDs. + Incremental backups are quite fast because borg uses a cache to detect changed files quickly. Disadvantages: - you need borg to mount the backups it - it is not as fast as native disk access, especially during restore and when getting a total file listing due to lots of random I/O on the HDD. As example, I currently have 63 snapshots in my data partition repository: # borg list data/ tp_2021-06-07 Mon, 2021-06-07 16:27:44 [5f9ebd9f24353c340691b2a71f5228985a41699d2e23473ae4e9e795669c8440] kern_2021-06-07 Mon, 2021-06-07 23:58:56 [19c76211a9c35432e6a66ac1892ee19a08368af28d2d621f509af3d45f203d43] [... 55 more lines ...] kern_2024-01-14 Sun, 2024-01-14 20:53:23 [499ce7629e64cffb7ec6ec9ffbf0c595e4ede3d93f131a9a4b424b165647f645] tp_2024-01-14 Sun, 2024-01-14 20:57:42 [ea2baef3e4bb49c5aec7cf8536f7b00b55fb27ecae3a80ef9f5a5686a1da30d5] kern_2024-01-21 Sun, 2024-01-21 23:42:46 [71aa2ce6cf4021712f949af068498bfda7797b5d1c5ddc0f0ce8862b89e48961] tp_2024-01-21 Sun, 2024-01-21 23:48:24 [45e35ed9206078667fa62d0e4a1ac213e77f52415f196101d14ee21e79fc393d] kern_2024-02-04 Sun, 2024-02-04 23:16:43 [e1b015117143fad6b89cea66329faa888cffc990644e157b1d25846220c62448] tp_2024-02-04 Sun, 2024-02-04 23:23:15 [e9b167ceec1ab9a80cbdb1acf4ff31cd3935fc23e81674cad1b8694d98547aeb] The last “tp” (Thinkpad) snapshot contains 1 TB, “kern” (my PC) 809 GB. And here you see how much space this actually takes on disk: # borg info data/ [ ... ] Original size Compressed sizeDeduplicated size All archives: 56.16 TB 54.69 TB 1.35 TB Obviously, compression doesn’t do much for media files. But it is very effective in the repository for the root partitions: # borg info arch-root/ [ ... ] Original size Compressed sizeDeduplicated size All archives: 1.38 TB 577.58 GB 79.41 GB I would also like to add my +1 to borgbackup ... I long ago lost the ability to use snapshots and full size backups due to the sheer amount of data involved. Currently I use borg to backup multiple hosts to individual backups on a dedicated machine (low power arm based, 6TB drive). I also backup from the top level of the directory all those repos are stored in to another arm system (2TB drive) again using borg. As each 1st level backup only adds/changes a few chunks for each iteration, the second level only
Re: [gentoo-user] How to make binary Asterisk package
man quickpkg On 4/2/24 15:47, Thelma wrote: How to make net-misc/asterisk-16.30.1 into binary package so I can install in on future gentoo boxes. I think asterisk ver. 16 (still in portage) is the last one still compatible with sip/iax code all future versions starting with ver.18 are converting sip => pjsip that is not compatible with older sip hardware. So if I install Gentoo on a new box and asterisk-16 is no longer in portage I would like to install asterisk from my local binary.
Re: [gentoo-user] Asterisk - need some help [SOLVED]
I believe asterisk is evolving way from a "carrier" mindset more into an IT one. Losing support for ancient hardware is part of that. I no longer use IAX (used it to trunk multiple instances across vpn's - worked well.) Currently I only have a couple of now quite old Cisco phones and Jami softphones on android using SIP to a single asterisk. I incrementally upgrade asterisk mostly by a clean install carrying over config files into an LXC instance (using a golden master setup) which has been trouble free until pjsip - and thats more my fault in missing that SIP was deprecated and having to unexpectedly fault find it. The conversion script worked fine for internal extensions, but the uplink trunk required a few hours extra work until I stumbled over the correct syntax - too many options confusing things. My recommendation would be to spin up a VM and install a test instance and start afresh - older asterisk versions are usually a security risk as time goes on. BillK On 4/2/24 06:00, Thelma wrote: I think I was able solve my problem, it was as simple as disabling "jitterbuffer" in iax.conf I can hear phone voicemail request from the remote asterisk, will know 100% on Monday. Regarding Asterisk I'm on 16.30.1 ; tried emerging ver.18 but my AudioCodes box wouldn't even register to it. Conversion scrip (sip->pjsip) will not do any good if the hardware (AudioCodes boxes, Sipura and other units) are not compatible with pjsip. Is IAX is gone as well in newer versions? I have an impression this is the end of old Asterisk that Digium started; very, very sad :-/ It had good community support. Newer versions 18+ are not compatible with older hardware and learning curve/conversion is not worth it. Sangoma - community support is almost not existent, few folks just bark at you if one mention still running ver. 16 I'll hang on to 16.30.1 as long as I can. On 2/2/24 20:55, William Kenworthy wrote: In v18 sip is still present but deprecated - after this its removed. There is a conversion script (sip->pjsip) for migration. It required a few sacrificial chickens and much swearing until I got the upstream trunk to register (iinet in AU). Its all working good now, the pjsip config is more programmer friendly but also allows much more complex (read hard to follow/fault find) configuration. Note that the CLI commands are not equivalent to sip (including help, its now pjsip) with a different format. After install, but before re-configuration everything sip related disappears on restart. BillK On 3/2/24 09:42, John Covici wrote: On Fri, 02 Feb 2024 19:29:24 -0500, Thelma wrote: When did they implement switch-over from sip to pjsip? I'm using AudioCode boxes. I emerged and tried to load asterisk ver.18 but the audiocode would not register. I suppose ver.16 is the end of the line for me. On 2/2/24 16:39, William Kenworthy wrote: Yes, was caught out recently by the replacement of sip with pjsip - currently on v21.0.2 and working (sip only, simple home setup) Also had some weird problems with two versions installed (so asterisk started on old working version even though new one was installed - once I ran depclean it failed due to the sip/pjsip issue. BillK On 2/2/24 23:26, Thelma wrote: Anybody on the list using Asterisk? I need some help. Have save version of asterisk is working correctly on one computer but the other. I would use at least asterisk 18 in all cases and if you can later versions. pjsip has been the preferred version for a while, sip is still OK, however.
Re: [gentoo-user] Asterisk - need some help
In v18 sip is still present but deprecated - after this its removed. There is a conversion script (sip->pjsip) for migration. It required a few sacrificial chickens and much swearing until I got the upstream trunk to register (iinet in AU). Its all working good now, the pjsip config is more programmer friendly but also allows much more complex (read hard to follow/fault find) configuration. Note that the CLI commands are not equivalent to sip (including help, its now pjsip) with a different format. After install, but before re-configuration everything sip related disappears on restart. BillK On 3/2/24 09:42, John Covici wrote: On Fri, 02 Feb 2024 19:29:24 -0500, Thelma wrote: When did they implement switch-over from sip to pjsip? I'm using AudioCode boxes. I emerged and tried to load asterisk ver.18 but the audiocode would not register. I suppose ver.16 is the end of the line for me. On 2/2/24 16:39, William Kenworthy wrote: Yes, was caught out recently by the replacement of sip with pjsip - currently on v21.0.2 and working (sip only, simple home setup) Also had some weird problems with two versions installed (so asterisk started on old working version even though new one was installed - once I ran depclean it failed due to the sip/pjsip issue. BillK On 2/2/24 23:26, Thelma wrote: Anybody on the list using Asterisk? I need some help. Have save version of asterisk is working correctly on one computer but the other. I would use at least asterisk 18 in all cases and if you can later versions. pjsip has been the preferred version for a while, sip is still OK, however.
Re: [gentoo-user] Asterisk - need some help
Yes, was caught out recently by the replacement of sip with pjsip - currently on v21.0.2 and working (sip only, simple home setup) Also had some weird problems with two versions installed (so asterisk started on old working version even though new one was installed - once I ran depclean it failed due to the sip/pjsip issue. BillK On 2/2/24 23:26, Thelma wrote: Anybody on the list using Asterisk? I need some help. Have save version of asterisk is working correctly on one computer but the other.
[gentoo-user] split-usr
Some years back I did the usr-merge and my laptop has continued on more or less ok. Now, I suddenly have a number of packages failing to build with internal collisions as they try and install (for example) a binary into /bin and /usr/bin and collide. "emerge --info" is showing the split-usr flag enabled on my profile (5): [5] default/linux/amd64/17.1/desktop (stable) [6] default/linux/amd64/17.1/desktop/gnome (stable) [7] default/linux/amd64/17.1/desktop/gnome/systemd (stable) [8] default/linux/amd64/17.1/desktop/gnome/systemd/merged-usr (stable) [9] default/linux/amd64/17.1/desktop/plasma (stable) [10] default/linux/amd64/17.1/desktop/plasma/systemd (stable) [11] default/linux/amd64/17.1/desktop/plasma/systemd/merged-usr (stable) [12] default/linux/amd64/17.1/desktop/systemd (stable) [13] default/linux/amd64/17.1/desktop/systemd/merged-usr (stable) So which profile should I use for an XFCE4 desktop. This laptop is openrc and predates the devils spawn (systemd) and I dont use gnome or plasma? BillK
[gentoo-user] OT: tablet mode
Hi, I have a MS Surface4Pro being used as a gentoo laptop. At various times Ive tried setting up a soft keyboard so I can use it as a tablet - with mostly not really usable results, and Ive just realised my previous choices no longer work due to python moving on. So what soft keyboard, greeter and window manager combination do people use for tablet mode? BillK
Re: [gentoo-user] App windows not staying put!
On 25/11/23 16:35, Michael wrote: On Saturday, 25 November 2023 05:45:04 GMT William Kenworthy wrote: Hi, I have an odd problem with a server that's been repurposed as a desktop: 2 monitors, main is DP, secondary is HDMI, intel on board video with sddm and xfce4. The problem is the icons and app windows on the second monitor get pushed onto the main monitor when the monitors deep sleep or resume from hibernate. I am guessing that the second monitor is not up in time as the Xorg display re-configures itself? I have set a profile via the xfce display settings app which hasn't helped, though it is working if I manually select it (its too late to stop the apps/icons from moving though) BillK I was experiencing similar problems on a system using HDMI + DVI until I moved on to Wayland. If not when waking up then almost always when I updated xorg and friends. I'm mentioning this in case Wayland works for you and you don't have any other reason stopping you using it. Thanks, I'll look into it. BillK
[gentoo-user] App windows not staying put!
Hi, I have an odd problem with a server that's been repurposed as a desktop: 2 monitors, main is DP, secondary is HDMI, intel on board video with sddm and xfce4. The problem is the icons and app windows on the second monitor get pushed onto the main monitor when the monitors deep sleep or resume from hibernate. I am guessing that the second monitor is not up in time as the Xorg display re-configures itself? I have set a profile via the xfce display settings app which hasn't helped, though it is working if I manually select it (its too late to stop the apps/icons from moving though) BillK
Re: [gentoo-user] Debugging NFS mounts
On 18/11/23 15:29, Peter Humphrey wrote: On Friday, 17 November 2023 16:44:29 GMT I wrote: I'll try that - thanks. Damn fool - it was a firewall problem on the server. For some reason, the NFS destination port has changed. Sorry for the noise. Actually, NFS may have some ports dynamicly allocated so they change on reboot. Google "pin NFS ports" for how to fix them for firewalls. BillK
Re: [gentoo-user] Computer case for new build
On 11/11/23 05:15, Dale wrote: the...@sys-concept.com wrote: Thelma On 9/17/23 23:17, Dale wrote: Howdy, This is a work in progress and may take some time, financially if nothing else. With hindsight, I wish I had done this before the price of everything went up but some things are getting more reasonable. My first task, a case. At this point, I may build a new system in the new case, or, I might build the new system in my current case. It depends on which case I buy. A cube shape wouldn't work for my main system. It would take up to much space, it would however make a great NAS box. My current case is a Cooler Master HAF-932 with those huge 200mm fans. It has a top fan and that thing removes a lot of warm air. A top fan really improves heat removal. After all, heat naturally rises. So any case that has a top fan gets extra points with me. I've found a few cases that peak my interest depending on which way I go with this. One I found that has a lot of hard drive space and would make a descent NAS box, the Fractal Design Node 804. It's a cube shaped thing but can hold a LOT of spinning rust. 10 drives plus I think space for a SSD for the OS as well. 10, 16 or 18TB drives, is a lot of space, even if in a RAID setup. I might add, the price ain't bad either, cheaper than some full tower type cases. It also has space for 10 fans. That includes several top ones. The downside, only micro ATX and mini ITX mobo. This is a serious down vote here. I was hoping to turn my current rig into a NAS. The mobo and such parts. This won't be a option with this case. Otherwise, it gives ideas on what I'm looking for. And not. ;-) [snip] I am most likely too late but as for case I have two of these: https://www.newegg.ca/white-ssupd-meshlicious-mini-itx/p/2AM-030R-5 They are mesh type cases, run very cool no heat at all; planning on getting two more. Thelma The case I got holds I think 18 3.5" hard drives. Eventually, I'll run out there if I keep downloading stuff. I got plenty of entertainment tho. lol The case you linked to wouldn't even be a start. It does look nice tho. I bet that mesh does allow a lot of air to flow even without fans. Dale :-) :-) If your handy with some tools, you could do one of these ... "https://www.backblaze.com/blog/open-source-data-storage-server/; BillK
[gentoo-user] updating glsa's
Hi, I am using git for portage updates and exporting it over nfs for other systems - I like to hold portage at a point so all systems are updated to the same level before updating it. However, I would also like to be able to use glsa-check on any newly issued glsa's. Is it possible to sync just the glsa database only, instead of updating the whole of portage? It used to be possible to do this with rsync but I need some hints to do it with git. BillK
Re: [gentoo-user] rsync options after backup restore. Transfer speed again.
On 22/10/23 11:23, Dale wrote: Frank Steinmetzger wrote: Am Fri, Oct 20, 2023 at 09:20:45PM -0500 schrieb Dale: Howdy, As most know, I had to restore from backups recently. I also reworked my NAS box. I'm doing my first backup given that I have more files that need to be added to the backups. When I started the rsync, it's starting from the first file and updating each file as it goes as if all of them changed. Given that likely 95% of the files hasn't changed, I figure this is being done because of a time stamp or something. Is there a way to tell rsync to ignore the time stamp or something or if the files are the same size, just update the time stamp? Is there a way to just update the time stamps on the NAS box? Is there a option I haven't thought of to work around this? This is the old command I was using to create the backups. time rsync -uivr --progress --delete /home/dale/Desktop/Crypt/TV_Series /mnt/TV_Backup/ This didn’t preserve timestamps. Hence there is one type of information lost from which rsync knows whether two files may be identical. So now your restore has more recent timestamps the the backup. If you use -u, Rsync should skip all files. My perfectionist self doesn’t like discarding timestamp information, because then my system can’t tell me how old some file is, and how old (or young) I was when I created it and so on. I once didn’t pay enough attention when restoring a backup back when I was still on Windows, which is why I don’t have many files left that are dated before April 2007, even though they are from 2000 ± x. BTW: -i and -v are redundant. -v will only print the file path, whereas -i does the same and adds the reasons colum at the beginning. I tried these to try to get around it. time rsync -ar --progress --delete /home/dale/Desktop/Crypt/TV_Series /mnt/TV_Backup/ -a and -r are also redundant, as -a includes -r. I looked at the man page and the options there. I don't see anything that I think will help. Is there a way around this? My muscle memory uses `rsync -ai` for almost everything. And when I do full root file systems or stuff where I know I will need them, I use -axAHX instead. Since this preserves all the usual data, I’ve never really had rsync wanting to do everything all over. Well, I can't turn back the clocks so it is what it is now. These files tho, I really don't worry to much about the timestamps. If I were backing up my OS tho, that could become a problem. So my command should be more like: rsync -ai --progress --delete /path/to/source/ path/to/target If I want to preserve all the Linux file data, then I should use this: rsync -axAHX --progress --delete /path/to/source/ path/to/target Dale :-) :-) P. S. Working on new kernel for fireball. Added some options for encryption stuff. I really need to update to a newer kernel. I got a newer one that boots but no GUI. That's not very helpful. Hi Dale, I might have missed it in the thread but are you aware that rsync is focussed on remote filefile transfer and if its a local transfer it does a full copy (no delta) of the file without optimisations as its usually faster than all the extra operations a local delta requires. You are using NFS mounts so rsync is looking at it as a local copy - it does not know it is a remote system. My recent use of moosefs (another network file system) had similar problems using rsync - it also turns out some of the data rsync uses for detecting changes may not be stable across a network mount - moosefs certainly has problems with this, NFS likely to have it too. The workaround is to check file-size, mtimes and ctimes to figure out which is able to be used. see: http://unix.stackexchange.com/questions/450537/ddg#450666 google rsync over nfs BillK
Re: [gentoo-user] google SMTP with postfix - Password not accepted
On 14/10/23 21:28, Peter Humphrey wrote: On Saturday, 14 October 2023 12:26:29 BST I wrote: Perhaps I should switch to getmail... On the other hand, I'd prefer to stick with fetchmail for my Zen POP3 account, since it's working well. Then I could use getmail to fetch my gmail mail. Would that be safe? If it works I could move Zen mail to getmail later, at my leisure. (That's the only sort of time I have these days... :( ) getmail works fine with gmail - just follow their instructions to configure. getmail itself is a bit flakey - using it with hydroxide as a proton bridge it keeps going to sleep(need to restart getmail every hour), and on 3 accounts with my ISP I get random crashes with no indication why. But with gmail and ventraip.mail its quite stable. On the plus side imap getmail IDLE works ... I had problems with fetchmail so moved to getmail. BillK
Re: [gentoo-user] Controlling emerges
MAKEOPTS - for example I have a laptop that locks up (heat) on long compiles so reduce the number of jobs (rust and webgtk). The discussion asks about how to control emerge - appropriate per package -j and -l for the heavy packages should go a long way to doing what you want. On 19 September 2023 5:48:39 pm AWST, Peter Humphrey wrote: >(I assume this was addressed to me, though it was a reply to someone else.) > >On Tuesday, 19 September 2023 10:14:42 BST William Kenworthy wrote: >> That is where you set per package compiler parameters by overriding >> make.conf settings. > >And which make.conf setting might achieve what I want? Careful reading of the >make.conf man page hasn't revealed anything relevant. > >-- >Regards, >Peter. > > > > > >
Re: [gentoo-user] Controlling emerges
That is where you set per package compiler parameters by overriding make.conf settings. BillK On 19/9/23 17:09, Peter Humphrey wrote: On Monday, 18 September 2023 23:44:50 BST William Kenworthy wrote: per package env variables? https://wiki.gentoo.org/wiki//etc/portage/package.env Apropos of what?
Re: [gentoo-user] Controlling emerges
per package env variables? https://wiki.gentoo.org/wiki//etc/portage/package.env BillK
Re: [gentoo-user] TrueNAS not helping me now.
Oh, forgot to mention the "this could be you" photo in that link :) BillK On 7/9/23 11:24, William Kenworthy wrote: On 7/9/23 11:09, Dale wrote: Frank Steinmetzger wrote: Am Wed, Sep 06, 2023 at 02:45:11PM -0500 schrieb Dale: Oh, creating a vdev was the trick. Once that is done, expand the pool. It's one of those, once it is done, it seems easy. ROFL Note that people used to shoot themselves in the foot when lazily (or by accident) adding a single disk to an existing pool. If that pool was composed of RAID vdevs, then now they had a non-redundant single disk in that pool and it was not possible to remove a vdev from a pool! That single-disk vdev could only be converted to a mirror to at least get redundancy back. The only proper solution was to destroy the pool and start from scratch. By now there is a partial remedy, in that it is possible to remove mirror vdevs from a pool. But no RAIDs: https://forum.level1techs.com/t/solved-how-to-remove-vdev-from-zpool/192044/5 https://arstechnica.com/civis/threads/performance-when-removing-zfs-vdevs-with-zpool-remove.1481148/post-40491873 And you get some left-over metadata about the removed vdev. That's good to see. I'll bookmark those links for the future. At least this is doable. If I do mess up, I could just start over. It only takes about 10 days to copy over again. o_O I guess vdev is like LVMs pv, physical volume I think it is. Haven’t we had this topic before? At least twice? Including the comparison between the three layers of LVM with their equivalent in ZFS land. ;-) ZFS is more meant for static setups, not constantly changing disk loadouts of varying disk sizes. We may have but being more familiar with LVM, I try to sort of make it make sense to me. Honestly, ZFS doesn't really make sense, yet. My understanding, it has two layers instead of three. I think. If there was a NAS thing like TrueNAS that used LVM instead, I'd be all over it. I likely would have never used TrueNAS at all. If I found one, I'd switch faster than a lightning strike. Even if it is done in GUI I'd switch. Command line would be fine by me. Honestly, once set up and a network is working, all I need is for it to boot, let me enter the encryption password and me able to mount the thing from my main rig. Of course, shutdown when done as well. Then it may be best for me to consider other options. I'm always adding, swapping out or otherwise moving things around. That is one thing I like about LVM. The only thing I try to avoid, shrinking a file system. I use ext4 so it is doable as long as there is enough space but still, I try to avoid it. I may have done that once, maybe. At least I got it done now. Updating my backups went faster than expected. Already done and drives are back in the safe. Since I have three drives in the little cage and little room for air flow, I added a fan to the drive cage. They got up to the 40's C pretty quick. Can't have them getting hot. Thanks to all. Dale :-) :-) Hi Dale, if you are feeling bored, google "gentoo NAS" and start reading. Example: https://wiki.installgentoo.com/wiki/Home_server Home brew is the only way to go! BillK
Re: [gentoo-user] TrueNAS not helping me now.
On 7/9/23 11:09, Dale wrote: Frank Steinmetzger wrote: Am Wed, Sep 06, 2023 at 02:45:11PM -0500 schrieb Dale: Oh, creating a vdev was the trick. Once that is done, expand the pool. It's one of those, once it is done, it seems easy. ROFL Note that people used to shoot themselves in the foot when lazily (or by accident) adding a single disk to an existing pool. If that pool was composed of RAID vdevs, then now they had a non-redundant single disk in that pool and it was not possible to remove a vdev from a pool! That single-disk vdev could only be converted to a mirror to at least get redundancy back. The only proper solution was to destroy the pool and start from scratch. By now there is a partial remedy, in that it is possible to remove mirror vdevs from a pool. But no RAIDs: https://forum.level1techs.com/t/solved-how-to-remove-vdev-from-zpool/192044/5 https://arstechnica.com/civis/threads/performance-when-removing-zfs-vdevs-with-zpool-remove.1481148/post-40491873 And you get some left-over metadata about the removed vdev. That's good to see. I'll bookmark those links for the future. At least this is doable. If I do mess up, I could just start over. It only takes about 10 days to copy over again. o_O I guess vdev is like LVMs pv, physical volume I think it is. Haven’t we had this topic before? At least twice? Including the comparison between the three layers of LVM with their equivalent in ZFS land. ;-) ZFS is more meant for static setups, not constantly changing disk loadouts of varying disk sizes. We may have but being more familiar with LVM, I try to sort of make it make sense to me. Honestly, ZFS doesn't really make sense, yet. My understanding, it has two layers instead of three. I think. If there was a NAS thing like TrueNAS that used LVM instead, I'd be all over it. I likely would have never used TrueNAS at all. If I found one, I'd switch faster than a lightning strike. Even if it is done in GUI I'd switch. Command line would be fine by me. Honestly, once set up and a network is working, all I need is for it to boot, let me enter the encryption password and me able to mount the thing from my main rig. Of course, shutdown when done as well. Then it may be best for me to consider other options. I'm always adding, swapping out or otherwise moving things around. That is one thing I like about LVM. The only thing I try to avoid, shrinking a file system. I use ext4 so it is doable as long as there is enough space but still, I try to avoid it. I may have done that once, maybe. At least I got it done now. Updating my backups went faster than expected. Already done and drives are back in the safe. Since I have three drives in the little cage and little room for air flow, I added a fan to the drive cage. They got up to the 40's C pretty quick. Can't have them getting hot. Thanks to all. Dale :-) :-) Hi Dale, if you are feeling bored, google "gentoo NAS" and start reading. Example: https://wiki.installgentoo.com/wiki/Home_server Home brew is the only way to go! BillK
Re: [gentoo-user] Is distfile partial mirror with failover possible?
On 5/9/23 22:58, Walter Dnes wrote: On Tue, Sep 05, 2023 at 08:04:19AM +0100, Neil Bothwick wrote On Mon, 4 Sep 2023 22:54:38 -0400, Walter Dnes wrote: It looks like remote-mounting /var/cache/distfiles might be the quick-n-dirty solution like Alan suggested. And I never have a need to have emerge run simultaneously on more than one machine. It seems the simplest suitable solution for your needs. And while we're at it, howsabout "emerge --sync" on one host, and then remote-mounting /var/db/repos/gentoo ? Similarly - I was mounting a single location on moosefs (network filesystem) for ~15 hosts. One host updates using --sync. One buildhost for each architecture building packages. Distfiles are handled the same way. Then "emerge -k" on the remainder checking for packages that needed an actual build. If none, parallel merge (via ansible) or else single builds. Resulting packages are also stored remotely per arch (various amd64, arm32, arm64 etc.) Working well for a few years, but I am in the process of converting to nfs with a similar structure as I have decommissioned the moosefs system and many machines that are no longer needed. A single machine will handle built packages, distfiles and repos which are mounted on the other systems via nfs. I will look into apt-cacher-ng as I was a fan of http-replicator until it was deprecated. BillK
Re: [gentoo-user] Re: attic
On 4/9/23 16:04, Nuno Silva wrote: On 2023-09-04, William Kenworthy wrote: On 3/9/23 18:29, Rich Freeman wrote: On Sun, Sep 3, 2023 at 4:44 AM Michael wrote: On Sunday, 3 September 2023 07:49:36 BST William Kenworthy wrote: Hi , I used to be able to get old ebuilds from "the attic" but I cant find it on google - is it still around? Perhaps have a look here at the archives? https://gitweb.gentoo.org/ The archives will only contain data migrated from CVS - so only things from more than a few years ago. You want to look into the main repo for anything recently deleted. [...] This can be done via the website, though the search capability is a little limited. I ended up having to search from a local clone because your package name contains an error and the web search found nothing. To find your file, go to: https://gitweb.gentoo.org/repo/gentoo.git/ Go to the search box in the top right and search for: dev-python/reedsolomon (note that the package category is different from what was in your email) Find the commit one commit before the one that removed your package. (ie one that contains your package in its most recent version) If you find the one that deleted your file, then just look at the parent in the commit header and click on that to go back one version where it is still present. Click the tree hash to browse the historical version of the repository that existed before your file was deleted. For example, you can find v1.6.1 of that package at: https://gitweb.gentoo.org/repo/gentoo.git/tree/dev-python/reedsolomon/reedsolomon-1.6.1.ebuild?id=149a131188ebce76a87fd8363fb212f5f1620a02 [...] The web git interface is capable of displaying past commits. It just can't search for wildcards/etc. Thanks Rich, unfortunately the web interface isn't helpful - I cant just navigate the tree to find commits - "https://gitweb.gentoo.org/repo/gentoo.git/tree/dev-python/reedsolomon/; gives path not found - it looks like you have to know the commit first by downloading the git tree to search it - not friendly at all! With /log/ instead of /tree/ in the URL it at least shows the list of commits. From a quick check, this seems to include the commit removing the directory when it's removed instead of renamed, so hopefully it helps too with retrieving older ebuilds? (But note that Rich was suggesting using the *search* feature of the gitweb interface, which, in this case, also finds the same topmost commit if I search for "reedsolomon".) tkx, missed that! BillK
Re: [gentoo-user] attic
On 3/9/23 18:29, Rich Freeman wrote: On Sun, Sep 3, 2023 at 4:44 AM Michael wrote: On Sunday, 3 September 2023 07:49:36 BST William Kenworthy wrote: Hi , I used to be able to get old ebuilds from "the attic" but I cant find it on google - is it still around? Perhaps have a look here at the archives? https://gitweb.gentoo.org/ The archives will only contain data migrated from CVS - so only things from more than a few years ago. You want to look into the main repo for anything recently deleted. * gentoo has moved dev-embedded/reedsolomon to dev-embedded/reedsolo (then removing the old ebuilds) breaking my homeassistant install easiest fix is a local copy until HA catches up. Both CVS and git maintain a record of anything that has been deleted, but they do it differently. The attic directory in CVS contains anything deleted from CVS. In git you need to search the commit history for these files. This can be done via the website, though the search capability is a little limited. I ended up having to search from a local clone because your package name contains an error and the web search found nothing. To find your file, go to: https://gitweb.gentoo.org/repo/gentoo.git/ Go to the search box in the top right and search for: dev-python/reedsolomon (note that the package category is different from what was in your email) Find the commit one commit before the one that removed your package. (ie one that contains your package in its most recent version) If you find the one that deleted your file, then just look at the parent in the commit header and click on that to go back one version where it is still present. Click the tree hash to browse the historical version of the repository that existed before your file was deleted. For example, you can find v1.6.1 of that package at: https://gitweb.gentoo.org/repo/gentoo.git/tree/dev-python/reedsolomon/reedsolomon-1.6.1.ebuild?id=149a131188ebce76a87fd8363fb212f5f1620a02 If the search function is too limiting on the website, here is how to do it from a local checkout. This is what I ended up doing since you had the wrong package name. Note that the first step here requires a few minutes and a few GB of space. My search example is also a bit broader than it would have to be, but you got the package category wrong and searching for "dev-embedded/reedsolomon" turned up nothing. git clone https://anongit.gentoo.org/git/repo/gentoo.git cd gentoo git log --all --full-history --raw --no-merges -- "**/reedsolomon/*" Then browse through the history for the file you're interested in. Suppose you want reedsolomon-1.6.1.ebuild. Easiest way to do that is to find a commit just before it was deleted, so just search the log for that filename. Ignore the first commit where it comes up, which is where the file was deleted (if you examine that commit the file will be missing, since it was deleted). Go to the next one. So reedsolomon-1.6.1.ebuild was deleted in commit beedaf82bd7abd72a654e26627774aef38590149. The next commit in the log search is 149a131188ebce76a87fd8363fb212f5f1620a02, git checkout 149a131188ebce76a87fd8363fb212f5f1620a02 cd dev-python/reedsolomon cat reedsolomon-1.6.1.ebuild You can also see this on the web interface at: https://gitweb.gentoo.org/repo/gentoo.git/tree/dev-python/reedsolomon/reedsolomon-1.6.1.ebuild?id=149a131188ebce76a87fd8363fb212f5f1620a02 The web git interface is capable of displaying past commits. It just can't search for wildcards/etc. Thanks Rich, unfortunately the web interface isn't helpful - I cant just navigate the tree to find commits - "https://gitweb.gentoo.org/repo/gentoo.git/tree/dev-python/reedsolomon/; gives path not found - it looks like you have to know the commit first by downloading the git tree to search it - not friendly at all! the wrong package category was due to trying to wrangle a few ebuilds with the same problem which I confused in the email. I have now found the last of them in an overlay with the distfiles (a similar problem)! This was all self caused - I had years of portage backups (started last time I had a major problem with finding ancient ebuilds) I lost when simplifying/re configuring my systems :( BillK
[gentoo-user] attic
Hi , I used to be able to get old ebuilds from "the attic" but I cant find it on google - is it still around? * gentoo has moved dev-embedded/reedsolomon to dev-embedded/reedsolo (then removing the old ebuilds) breaking my homeassistant install easiest fix is a local copy until HA catches up. BillK
Re: [gentoo-user] he's baaaaaaack :-D
Welcome Back to the force :) BillK William Kenworthy On 1/9/23 02:15, Alan McKinnon wrote: Hello Gentoo'ers After some years away, I'm back to Gentoo. Arch was nice and I got fuzzies but something was always missing. Was on Mint for a while but eventually got fed up with how it does Bluetooth. So Gentoo is now on the new laptop from work. Going through the list archives, I see a whole bunch of familiar names like Dale, Helmut, Peter, Rich, Grant, Walter, William and more. For those who never knew me, My name is Alan, first used Gentoo 18/19 years ago, work at a large mobile operator where I'm a sysadmin and general know-it-all-busy-body working with ICT stuff, so happy to make your acquaintance. -- Alan McKinnon alan dot mckinnon at gmail dot com
Re: [gentoo-user] Need some help with location of git clone when bisecting with 9999-ebuilds
On 11/8/23 09:06, Morgan Wesström wrote: Thank you, Yixun. On 2023-08-11 02:23, Yixun Lan wrote: understanding git bisect should be enough to keep you going.. Yes, I actually just ended up doing what git bisect does but manually for now. 2) Can I tell emerge not to clean the build directory between bisects so it only recompiles the source files that actually changes between commits? it would be great to have this feature, but I don't know.. or I'd not personally bother to go this way My old machine takes 50 minutes to compile wine so it would've been great. Guess it's time for me to upgrade. ;) EGIT_OVERRIDE_COMMIT_WINE_WINE? have you checked the emerge log? it's obvious I noticed that by chance when I was looking in the log to check whether it accepted the commit hash I fed it or not. But I ended up just using the deprecated EGIT_COMMIT for this bisect and running it manually. Since most of the time is spent compiling it wasn't that much work but I'll be sure to try a more automated method next time now that I got the last pieces of the puzzle. :) Just out of curiosity, what decides what the suffix to those EGIT_OVERRIDE_ variables will become? I was unable to find any info of those in the Gentoo Development Guide, although I only looked at the description of the git-r3.eclass and that might have been the wrong place. Regards Morgan Will "ebuild /path/to/whatever.ebuild compile" work for what you are doing ? Also, it works on some simpler builds to cd to the top of the src tree and just issue a make. BillK
Re: [gentoo-user] amavis/postfix and port 10025
Inline: On 3/7/23 12:52, J. Roeleveld wrote: On Sunday, July 2, 2023 4:16:54 AM CEST William Kenworthy wrote: Hi all, I have been using a gentoo mail gateway for many years - its currently running under LXC and is upgraded using a generic LXC "golden master" image with the various email related packages being installed and config files copied across roughly a month or two apart. This is always a trial, particularly with permissions and has become much worse with gentoo's attempt at using the acct packages to manage user and group ID's. I actually find this easier to solve issues. What do you find difficult here? Trying to interpret an error message that says "it cant connect" with no detail as to why when started via the openrc service script - but it works fine when started as the amavis user in debug mode. If I try and run it in debug mode from root it produces lots of perl errors that do not occur with either the openrc service script or amavis user: fetch_modules: error loading optional module Razor2/Client/Agent.pm: Can't locate Getopt/Long.pm: lib/Getopt/Long.pm: Permission denied at /usr/lib64/perl5/vendor_perl/5.36/aarch64-linux-thread-multi/Razor2/Client/Agent.pm line 15. BEGIN failed--compilation aborted at /usr/lib64/perl5/vendor_perl/5.36/aarch64-linux-thread-multi/Razor2/Client/Agent.pm line 15. Compilation failed in require at /usr/sbin/amavisd line 212. fetch_modules: error loading optional module Mail/DKIM.pm: Can't locate Mail/DKIM.pm: lib/Mail/DKIM.pm: Permission denied at /usr/sbin/amavisd line 212. fetch_modules: error loading optional module Mail/DKIM/Verifier.pm: Can't locate Mail/DKIM/Verifier.pm: lib/Mail/DKIM/Verifier.pm: Permission denied at /usr/sbin/amavisd line 212. fetch_modules: error loading optional module Image/Info.pm: Can't locate Image/Info.pm: lib/Image/Info.pm: Permission denied at /usr/sbin/amavisd line 212. fetch_modules: error loading optional module Image/Info/GIF.pm: and many more! The latest problem driving me up the wall is amavis-new wouldn't start after the upgrade. I have postfix sending email to port 1024 where amavis is listening (this time required a new setting in amavisd.conf not previously needed) but postfix now wont accept email back from amavis on port 10025 so mail is mostly queued (some leaks at times - no idea why). I assume you mean port 10024 ? NO, 10025 - postix is configured to send mail to amavis on 10024 for scanning via clamav, and forward back to postix on 10025 where its getting the error - note that this configuration has been working for over 20 years with the same basic configuration until now. I originally set it up under a "mailuser" group ID and I am increasingly finding that on startup I have to check files to make sure their permissions are unchanged. From the reading I have done on this I am suspecting that this latest version of amavis is trying to enforce "something" but not telling me what - at this stage I suspect amavis is the root cause and not postfix. The main error message is: Jul 2 10:00:14 mail amavis[6074]: (06074-02-3) about to connect to smtp:[127.0.0.1]:10025, JZ76UHvsOKBa FWD from -> Jul 2 10:00:14 mail amavis[6074]: (06074-02-3) smtp session: setting up a new session Jul 2 10:00:14 mail amavis[6074]: (06074-02-3) new socket using IO::Socket::IP to [127.0.0.1]:10025, timeout 35 Jul 2 10:00:14 mail amavis[6074]: (06074-02-3) (!)connect to [127.0.0.1]:10025 failed, attempt #1: Unrecognised protocol tcp at /usr/sbin/amavisd line 8392. Jul 2 10:00:14 mail amavis[6074]: (06074-02-3) mail_via_smtp: session failed: All attempts (1) failed connecting to smtp:[127.0.0.1]:10025 This is postfix rejecting the connection. Do you have the following: # grep 10025 * master.cf:127.0.0.1:10025 inet n- n - - smtpd mail ~ # grep -r 10025 /etc/postfix/* /etc/postfix/master.cf:127.0.0.1:10025 inet n - n - - smtpd -v mail ~ # and what has thrown me: I can stop amavisd, then log in as user "amavis" and run "amavisd -c /etc/amavisd.conf debug" then everything works as intended! WHY? Does postfix start before or after amavis? The startup scripts start amavisd first, but there is no difference if I manually start amavis after postfix (unless I run it as the amavis user) I am preparing a new mail gateway LXC image as a clean install to try and straighten out the underlying permissions, but a fix for my current dilemma would be appreciated! If a clean install works, I'd recommend a comparison between the 2 (start with a diff for both "/etc") to check the cause. Thats what I am working up to but I was hoping someone has seen this before to save time - its going to be a couple of days before I can get back to it. Thanks. BillK -- Joost
[gentoo-user] amavis/postfix and port 10025
Hi all, I have been using a gentoo mail gateway for many years - its currently running under LXC and is upgraded using a generic LXC "golden master" image with the various email related packages being installed and config files copied across roughly a month or two apart. This is always a trial, particularly with permissions and has become much worse with gentoo's attempt at using the acct packages to manage user and group ID's. The latest problem driving me up the wall is amavis-new wouldn't start after the upgrade. I have postfix sending email to port 1024 where amavis is listening (this time required a new setting in amavisd.conf not previously needed) but postfix now wont accept email back from amavis on port 10025 so mail is mostly queued (some leaks at times - no idea why). The main error message is: Jul 2 10:00:14 mail amavis[6074]: (06074-02-3) about to connect to smtp:[127.0.0.1]:10025, JZ76UHvsOKBa FWD from -> Jul 2 10:00:14 mail amavis[6074]: (06074-02-3) smtp session: setting up a new session Jul 2 10:00:14 mail amavis[6074]: (06074-02-3) new socket using IO::Socket::IP to [127.0.0.1]:10025, timeout 35 Jul 2 10:00:14 mail amavis[6074]: (06074-02-3) (!)connect to [127.0.0.1]:10025 failed, attempt #1: Unrecognised protocol tcp at /usr/sbin/amavisd line 8392. Jul 2 10:00:14 mail amavis[6074]: (06074-02-3) mail_via_smtp: session failed: All attempts (1) failed connecting to smtp:[127.0.0.1]:10025 and what has thrown me: I can stop amavisd, then log in as user "amavis" and run "amavisd -c /etc/amavisd.conf debug" then everything works as intended! WHY? I am preparing a new mail gateway LXC image as a clean install to try and straighten out the underlying permissions, but a fix for my current dilemma would be appreciated! BillK
Re: [gentoo-user] google SMTP with postfix - Password not accepted
getmail can facilitate getting googlemail into postfix. In my case, it fetches an mail then invokes sendemail to forward into postfix. The docs for the google side of the equation are quite good. BillK On 20/6/23 16:30, Michael wrote: On Tuesday, 20 June 2023 06:29:52 BST the...@sys-concept.com wrote: Trying to send email via Google SMTP and postfix but getting authentication failed. white postfix/smtp[32223]: 62E5618008F: to=, relay=smtp.gmail.com[173.194.203.109]:587, delay=2390, delays=2390/0.01/0.29/0, dsn=4.7.8, status=deferred (SASL authentication failed; server smtp.gmail.com[173.194.203.109] said: 535-5.7.8 Username and Password not accepted. Learn more at?535 5.7.8 https://support.google.com/mail/?p=BadCredentials n3-20020aa78a4300b00663b712bfbdsm4668932pfa.57 - gsmtp) relayhost = [smtp.gmail.com]:587 smtp_sasl_auth_enable = yes smtp_sasl_password_maps = hash:/etc/postfix/sasl_passwd smtp_sasl_security_options = noanonymous smtp_tls_CAfile = /etc/postfix/cacert.pem smtp_use_tls = yes /etc/postfix/sasl_passwd [smtp.gmail.com]:587usern...@gmail.com:PASSWORD postmap /etc/postfix/sasl_passwd /etc/init.d/postfix restart The user and password are correct. I think I know what the problem is - but I do not use postfix and can't confirm it on my side: Since mid 2022 Google requires 2FA to allow login into their server. Until then it used to be the case you could select in their security settings to "Allow Less Secure Apps", generate an application specific password hash using their GUI and use this in your mail client. For a year now you won't be able to do this, unless you first provide a mobile phone number to Google. If you *must* use Google, they you'll have to login into their Google account security panel, set 2FA, attempt to connect with your postfix client, create an application pass code hash for your postfix via their GUI and use that as your password in your postfix settings. If you change your IP address, or your PC/client, or anything else Google are using to fingerprint and profile your device, then you'll have to login again in their GUI to confirm you are who you are and your client is a legitimate device owned by you. They have many relevant help pages to explain all this, so you should search for specific guidance, or find another email provider with less onerous user profiling demands. ;-) HTH
Re: [gentoo-user] Mouse pain
On 16/5/23 23:52, Michael wrote: On Tuesday, 16 May 2023 01:03:31 BST Wol wrote: On 15/05/2023 18:25, Michael wrote: Check the attached screenshots, relevant to this laptop. There's pointer speed and scrolling speed for the USB mouse I have attached. I use libinput for years now and as far as I recall I have not changed the default settings. I think different mouse models would generate different inputs and would offer more settings. Mine is a simple wired optical mouse. I'm not at that system at the moment but ... where on your screenshot is the double click speed? Where is the "configure middle button"? etc etc. You've got the basics, just like me ... Cheers, Wol According to libinput this is what's available for my USB mouse: # libinput list-devices [snip ...] Device: PIXART USB OPTICAL MOUSE Kernel: /dev/input/event6 Group:5 Seat: seat0, default Capabilities: pointer Tap-to-click: n/a Tap-and-drag: n/a Tap drag lock:n/a Left-handed: disabled Nat.scrolling:disabled Middle emulation: disabled Calibration: n/a Scroll methods: button Click methods:none Disable-w-typing: n/a Disable-w-trackpointing: n/a Accel profiles: flat *adaptive custom Rotation: 0.0 It's a very basic three button mouse. In Plasma-Wayland I get more options shown in the SystemSettings GUI, than when in Plasma on Xorg. I don't know if tweaking '/etc/X11/xorg.conf.d/40-libinput.conf' will allow you to configure your mouse as you want to. Settings configured in this file which work in Xorg do not necessarily work with Wayland. Here is mine: Device: Logitech M310 Kernel: /dev/input/event11 Group: 3 Seat: seat0, default Capabilities: pointer Tap-to-click: n/a Tap-and-drag: n/a Tap drag lock: n/a Left-handed: disabled Nat.scrolling: disabled Middle emulation: disabled Calibration: n/a Scroll methods: button Click methods: none Disable-w-typing: n/a Disable-w-trackpointing: n/a Accel profiles: flat *adaptive Rotation: n/a In XFCE4 most of the settings appear part of the desktop/window manager. BillK
Re: [gentoo-user] Mouse pain
Checked your menu? XFCE has a "mouse and touchpad" under settings with a number of useful items including acceleration, double click timings etc. BillK On 15/5/23 04:33, Wols Lists wrote: I've been having grief with my mouse for a while, and all the help I can find is "how to adjust mouse speed", which is not my problem... and seems to be about the only thing that is adjustable ... Basically even something as simple as left click doesn't work properly. I'm guessing it's timing related, but I can't find anywhere to adjust it. The symptoms are single clicks get interpreted as double or treble clicks, and when I try (especially in games) to do a "drag to select", the area the mouse drags over bears precious little resemblance to the are the mouse actually is. Combined with the "double click effect" it makes the mouse - randomly :-( ! - almost unusable. It might well be tied into system lock-ups, as every now and then the system simply stops responding, as in either the mouse and keyboard just no longer work, or the mouse moves freely but the system just ignores it. Basically I just don't know how - or where - to start debugging it (systemd, kde system) Cheers, Wol
Re: [gentoo-user] file system for new machine
On 29/4/23 19:45, Frank Steinmetzger wrote: Am Sat, Apr 29, 2023 at 01:20:52PM +0800 schrieb William Kenworthy: Filesystem choice is very much to do with your particular use case. I am not a fan of ext4 - lost too much data too many times. I ve found btrfs and xfs much tougher, and the online tools much more convenient. I’ve been using ext4 possibly (don’t know for sure) since it was available in standard Gentoo land. I cannot remember ever having suffered data loss. These days I like to experiment with more flash-friendly systems like f2fs, which I use on the MicroSD card of my raspberry and the 400 GB data MicroSD in my Surface Go tablet. I also test-drive it on my mini desktop PC (all Arch linux) because, like all my machines, it has an SSD. That said btrfs has its less than stellar moments. I still have systems that use ext4 and they "seem" reliable for light duty but I make sure I have backups and do not trust them with anything important - been bitten too many times! In what kind of situations did you encounter these problems? It was particularly bad when used with Dirvish for backups (lose ALL your backups at once) :( - not a problem with btrfs. Also a fixed number of nodes on creation (annoying and sometimes disastrous when it runs out - think lots of small files like mail storage), power outages cause what seems like silent corruption that builds up. I will admit ext4 does seem better these days but I am not a fan. I am using btrfs on loopback container file systems (data for mail, web, dav servers etc.) and that's not always successful with crashes - is there a better one for this use case. How do you find f2fs? - I lose (wear out I guess) SD cards on raspberry pi and Odroid systems on a regular basis with any of the mainstream filesystems - using them as a boot drive only extends their life, but that's not always possible. BillK
Re: [gentoo-user] file system for new machine
On 28/4/23 21:21, Michael wrote: On Friday, 28 April 2023 13:54:37 BST Peter Humphrey wrote: On Friday, 28 April 2023 10:08:01 BST Philip Webb wrote: 230428 Peter Humphrey wrote: On Thursday, 27 April 2023 13:23:01 BST Philip Webb wrote: I've built & tested the new machine I was planning in 2022 & am at the point of designing the partitions. For many years, I've used Reiserfs, but it is now obsolescent, so I need to choose an alternative. Reiserfs seemed appropriate for a system with a large number of small files. Ext4 seems to be used by well-known binary distros. What would others recommend ? It depends: is this a UEFI machine? No, it isn't. I await your recommendation with bated breath (smile). In that case I have nothing to add to others' suggestions; sorry. :) It used to be the case btrfs would suffer corruption if you ran out of space. I don't know if this is the same today. Anecdotally, I've run out of space and the fs did not become corrupt on that partition. It corrupted another time though, but thankfully no significant data loss happened after I ran btrfs scrub, followed by btrfs check. Now I'm getting this warning on dmesg, but I have no idea what it means: BTRFS warning (device sdb3): devid 1 physical 0 len 4194304 inside the reserved space and the same on 3 other partitions on the same disk. :-/ NOTE: I don't recall ever having problems with ext4, for many years now. Filesystem choice is very much to do with your particular use case. I am not a fan of ext4 - lost too much data too many times. I ve found btrfs and xfs much tougher, and the online tools much more convenient. That said btrfs has its less than stellar moments. I still have systems that use ext4 and they "seem" reliable for light duty but I make sure I have backups and do not trust them with anything important - been bitten too many times! BillK
Re: [gentoo-user] Finally got a SSD drive to put my OS on
On 16/4/23 15:18, Peter Humphrey wrote: On Sunday, 16 April 2023 02:47:00 BST William Kenworthy wrote: look into mount options for SSD's (discard option) and "fstrim" for maintenance. (read up on trimmimg - doing a manual trim before the drive reaches full allocation (they delete files, but do not erase them because erasing is time consuming so its an OS controlled operation) or auto trimming (which can cause serious pauses at awkward times) can prevent serious performance degradation as it has to erase before writing. I am not sure of the current status but in the early days of SSD's, this was serious concern. In short, see https://wiki.gentoo.org/wiki/SSD . :) Excellent, condenses it nicely. BillK
Re: [gentoo-user] Finally got a SSD drive to put my OS on
On 16/4/23 06:47, Dale wrote: Howdy, I finally broke down and bought a SSD. It's a Samsung V-Nand 870 EVO 500GB. My current OS sits on a 160GB drive so should be plenty. I plan to even add a boot image for the Gentoo LiveGUI thingy, maybe Knoppix or something plus my usual OS. By the way, caught one for sale for $40.00. It has a production date of 5/2021. My question is this. Do I need anything special in the kernel or special fstab options for this thing? I know at one point there was folks having problems with certain settings. I did some googling and it seems to be worked out but I want to be sure I don't blow this thing up or something. Anything else that makes these special? Any tips or tricks? Dale :-) :-) P. S. I'm hoping this will make my system a little more responsive. Maybe. Either way, that 160GB drive is getting a little full. look into mount options for SSD's (discard option) and "fstrim" for maintenance. (read up on trimmimg - doing a manual trim before the drive reaches full allocation (they delete files, but do not erase them because erasing is time consuming so its an OS controlled operation) or auto trimming (which can cause serious pauses at awkward times) can prevent serious performance degradation as it has to erase before writing. I am not sure of the current status but in the early days of SSD's, this was serious concern. BillK BillK
Re: [gentoo-user] Logic?
The rubygem / webkit problem has cropped up recently - do something like this 1. Mask webkit (I needed to do yelp as well on one system) 2. emerge any remaining updates so you can depclean 3. emerge --depclean (this removes old ruby versions and fixes the system 4. unmask webkit etc. 4. finish the updates. BillK On 7/4/23 17:31, John Acree wrote: On 2023-04-06 17:22, Alan Grimes wrote: 1. My system was basically working last time I updated it several months ago. 2. Now both of my main web browsers are severely if not utterly foobar. 3. It required effort to change the system from the first state to the second... -> how much effort did it it take? =\ That said, the situation here was very stratge. I was looking for a chance to insert some down time for the system to swap out the water block on the CPU. I had gone out shopping and when I returned Chromium had suddenly stopped working for reasons I can't fathom. Ok, so I took the machine down and did the maintenance. When I brought it back up, chromium was still foobar and I'm like WTF... Apparently it inserted trillions of crash reports in its log directory and rm -rf'ing the crash reports alone is taking a very long time. (HDD on that volume...) On the build side, my pain list is as follows: tortoise /var/tmp/portage # tree -L 2 . ├── dev-lang │ └── ruby-3.1.4 << surprised as hell... no idea... ├── dev-ruby │ [REDACTED] │ ├── rubygems-3.4.6 << reports can't find variable "RUBY" even though it is definitely set. │ [REDACTED] ├── media-libs │ └── nas-1.9.5 <<< wtf, don't care enough to examine it. └── net-libs ├── signon-ui-0.15_p20171022-r1 └── webkit-gtk-2.40.0-r410 <<< apparently only user of Ruby no idea what it does or why it's on my system. Hi Alan, Hope this helps. The `equery` tool has a "depends" argument which shows packages depending on the atom argument. `equery depends webkit-gtk` will show any current installed packages depending on it. When I have a stale system to update, portage is always the first package I worry about getting updated. Once that is updated start with system packages and then world packages. But even with portage if there are emerge errors I uninstall every package causing an error. In a worst case, I have to go through the handbook and find the instructions for installing as on a fresh install and install it, https://wiki.gentoo.org/wiki/Handbook:AMD64/Installation/Stage. In portage's case, I have had to remove setuptools and certifi to get past a dependency loop which was preventing portage from updating. Removing as many packages as necessary generally helps. The packages can be added back once the base components are updated. Regards, John
Re: [gentoo-user] Mouse and hibernate
On 6/4/23 19:20, Michael wrote: On Thursday, 6 April 2023 11:49:29 BST Frank Steinmetzger wrote: Am Wed, Apr 05, 2023 at 05:35:52PM +0800 schrieb William Kenworthy: I have suspend/hibernate set up on a desktop ... it's been working fine for years. But recently, it's been occaisionally coming out of suspension some time after suspension without any intervention on my part. I am suspecting the mouse - I would prefer not to disable the mouse ... Is there an alternative? BillK Often there are options in the BIOS/UEFI to choose what can cause it to come out of suspension. Unfortunately they are already off (the bios has PS2 settings) - the mouse is part of a keyboard/mouse set using a Logitech unifying USB dongle. I can use a udev rule to turn off waking via the USB port, but I cant separate the mouse from the keyboard - and I need the keyboard enabled to wake the PC up. Usually, Logitech mice have a switch on the bottom to physically turn them on or off. Usually I use that to circumvent wake-on-USB, rather than pulling out the USB wart. Have a look in '/sys/devices/.../power/wakeup files' to see if tweaking sys files can stop your USB mouse waking up the OS: https://www.kernel.org/doc/html/v6.1/driver-api/pm/devices.html#interfaces-for-entering-system-sleep-states the above seems like a dead end - the mouse and keyboard share the usb device through the Logitech Unifying Receiver - they are not broken out at that level so disabling USB disables both ... and I need the keyboard to bring it out of suspend. I think there are actually two problems ... any mouse movement immediately after clicking the button seems to be cached and triggers a resume within a few seconds after suspending and even a slight movement of the mouse at any time triggers a resume. Its an optical mouse, so movements are generated if you pick it up to turn it off so that's out. All I have been able to do is to position it out of the way, carefully click the button and immediately leave it alone ... this mostly works :( This over-sensitive behaviour seems to have started with later 5.15 kernels and has become annoyingly worse with 6.1 - before that it seemed to have a threshold before it would resume, but thats probably just my imagination now its bugging me :) I am starting to wonder if its a "just me" problem. BillK
Re: [gentoo-user] Mouse and hibernate
On 5/4/23 17:24, tastytea wrote: On 2023-04-05 08:54+0800 William KENWORTHY wrote: I have suspend/hibernate set up on a desktop ... it's been working fine for years. But recently, it's been occaisionally coming out of suspension some time after suspension without any intervention on my part. I am suspecting the mouse - I would prefer not to disable the mouse ... Is there an alternative? BillK Often there are options in the BIOS/UEFI to choose what can cause it to come out of suspension. Unfortunately they are already off (the bios has PS2 settings) - the mouse is part of a keyboard/mouse set using a Logitech unifying USB dongle. I can use a udev rule to turn off waking via the USB port, but I cant separate the mouse from the keyboard - and I need the keyboard enabled to wake the PC up. BillK
[gentoo-user] Mouse and hibernate
I have suspend/hibernate set up on a desktop ... it's been working fine for years. But recently, it's been occaisionally coming out of suspension some time after suspension without any intervention on my part. I am suspecting the mouse - I would prefer not to disable the mouse ... Is there an alternative? BillK
Re: [gentoo-user] How to restart/fix frozen XFCE4
On 2/4/23 13:28, the...@sys-concept.com wrote: At time to time my XFCE4 freezes. The screen is responding to the keyboard, mouse pointer is moving on the screen but nothing is responding. I just lookup some solutions and found this one: - press: CTRL+Alt+T (to get to terminal) - pidof xfce4-panel - kill -9 pid xfwm4 --replace & Any other solutions? Thelma Network mount? - my xfce4 freezes sometimes when a backup is being done (via a moosefs fuse mount - happens more often if there is a lot of network activity. I suspect the xfce file manager or similar is looking into the mount even when nothing is actually being accessed via the desktop and has to wait, often for a few minutes. BillK
[gentoo-user] running KSM
I am interested in running KSM (Kernel Samepage Merging) on an lxc server. Some other distros have a tuning daemon to extend/control ksm but I cant find anything gentoo. I have it in the kernel and can run it with fixed defaults but I hope to do better. Does anyone have recommendations on how to do this? (e.g., use Red Hats or Proxmox tuning daemons) BillK
Re: [gentoo-user] Advice appreciated regarding how to handle Perl modules correctly in an ebuild
On 22/3/23 04:27, Morgan Wesström wrote: On 2023-03-21 21:04, Jack wrote: 1) Where's the appropriate place for these files in Gentoo and why? 2) If the appropriate place is either of those folders with a version number, how do I install the files there without hard coding the version number in the ebuild (which would naturally break the next time Perl gets updated)? Regards Morgan Wesström I'd suggest looking at ebuilds created by g-cpan, which produces ebuilds for any module in CPAN. I suspect the eclass(es) involved deal with the perl version issue. I don't think you can savely ignore that, since there are likely to be things in the module which do depend on the version of perl used to create that module. Thank you, Jack. Digging through some ebuilds in the dev-perl category was the first thing I did. It led me to the perl-module eclass but I can only find reference documentation which doesn't tell me how to use it or how its functions hook into the build system. I lack fundamental knowledge of how Perl is organized and I'm an old guy which mean I have to be selective with new knowledge not t be overwhelmed. ;) How DO I know if either module is dependent on a specific Perl version for example? In the old ebuild I found online, the developer just creates a /usr/share/znapzend/perl5 folder and puts all those files there. https://git.gerczei.eu/tgerczei/gentoo-overlay/src/branch/master/app-backup/znapzend/znapzend-0.20.0.ebuild I could easily do that and be done with it but this is also an opportunity to absorb some new knowledge and to know that I made the correct choice and why this choice is the correct one in this situation. Regards Morgan Also, are you aware of perl-cleaner? - it takes care of perl packages after an upgrade. This is a good read: https://wiki.gentoo.org/wiki/Perl BillK
[gentoo-user] Lxc weirdness
Hi, I am having a problem with lxc where tasks run via lxc-attach seems to hang or run so slow it may as well be hung. No log messages, no signs of anything else wrong. It appears independent of kernel versions, and regular updates have occurred to the external environment. The lxc VM's are mostly unchanged and golden master based. Currently, all are gentoo and the lxc host is arm64. Has anyone seen this before and can offer some hints on sheer to look? BillK
Re: [gentoo-user] NAS and replacing with larger drives
On 21/12/22 14:19, Frank Steinmetzger wrote: Am Wed, Dec 21, 2022 at 05:53:03AM + schrieb Wols Lists: On 21/12/2022 02:47, Dale wrote: ... In layman’s term, a stripe of mirrors. Raid-1 is the mirror, Raid-0 a (JBOD) pool. So mirror + pool = mirrorpool, hence the 1+0 → 10. ... I tend to use older drives that have led a hard life - so failure happens and I have to be prepared for it (by having good backups!) I have found mirrors to be problematic - sometimes when one drive fails, it causes a cascade of fails that includes the data on the mirror. With raid-10, its worse (even more fragile). When I eventually moved away from raid for my main data store it was because of a catastrophic failure of a bcache ssd fronting one of the mirrors causing all data to be lost - somewhat self-caused by using bcache to try and get some more speed out of the system, but as a RAID 10 with 4 HDD fronted by 4x SSD it should have survived ... In the end, I realised that raided data gave me a small speedup with little or no benefit as regards reliable data storage. I currently have one linux raid 10 using 4xSSD's that has suffered one SSD abrupt failure and survived - which I regard as "being lucky". SSD's are an issue as they usually fail abruptly without warning whereas spinning rust usually gives some warning. I've never tried RAID-6 as it was still considered buggy/risky at the time. No matter what storage system you use, offline backups are better - raid is NOT a viable backup. Fun, innit? YEP! BillK
Re: Living in NGL: was: [gentoo-user] NAS and replacing with larger drives
On 19/12/22 21:30, Rich Freeman wrote: On Mon, Dec 19, 2022 at 7:51 AM Wols Lists wrote: On 19/12/2022 12:00, Rich Freeman wrote: On Mon, Dec 19, 2022 at 12:11 AM Dale wrote: If I like these Raspberry things, may make a media box out of one. I'd like to have a remote tho. So, I've done that. Honestly, these days a Roku is probably the better option, or something like a Google Chromecast or the 47 other variations on this them. Where do you put that 2TB drive on your Roku or Chromecast? I'm thinking of building a media server, not to drive the TV, but to record and store. I thought that was what a media server was! So, he said "media box," which I assumed meant the client that attaches to the TV. There are some canned solutions for media servers - I think the NVidia Shield can run Plex server for example. However, in general server-side I'd go amd64. My current solution is: 1. Moosefs for storage: amd64 container for the master, and ARM SBCs for the chunkservers which host all the USB3 hard drives. With a modest number of them performance is very good, though certainly not as good as Ceph or local storage. (I do have moosefs in my overlay - might try to get that into the main repo when I get a chance.) 2. Plex server in a container on amd64 (looking to migrate this to k8s over the holiday). 3. Rokus or TV apps for the clients. Very similar to what I have (intel/arm for moosefs) - I am effectively using moosefs as a distributed NAS (fuse mount onto whatever system(s) I am using) with built in data protection and redundancy. LVM and similar pooling is discouraged as it defeats some of the built in data protection. To increase storage, just add a disk, format, add to the config and reload - it automatically redistributes the data. Similarly, you can add/remove storage or whole storage systems while live with no risk to your data (within limits!!!) With LVM, if a drive fails, you are SOL and offline until you can recover and restore the data. On a recent holiday, an SD card failed and a moosefs arm SBC in AU went offline - discovered the next morning when doing status checks from a ship in the Mediterranean(!) - it had already backfilled and protection was back at normal, moosefs was just missing 2Tb of storage space. 5 weeks later when I got home, I replaced the SD card, rebooted and readded the system all with no risk to the data. Dale, I was where you are about 10 or so years ago and was forced to move on when that design hit its limits - forget LVM etc, these days there are lots of better ways to do what you want with less risk to your data. Another factor is power - moosefs is currently 1 intel and 7 arm SBC's that use 90-110w (most of which is due to using ancient WD and Seagate hard drives) - where as my intel desktop is 90w when idle, or over 300 w when compiling etc. so its off unless its being used. Power is important to me as its expensive!! BillK
Re: [gentoo-user] NAS and replacing with larger drives
* didn't send to the list the first time :( On 9/12/22 07:30, Dale wrote: I just wonder, could I use that board and just hook it to my USB port and a external power supply and skip the Raspberry Pi part? I'd bet not tho. ;-) Dale :-) :-) Check this one: https://www.hardkernel.com/shop/odroid-hc4-p-kit/ I have quite few hardkernel devices (inc 5x HC2 using moosefs) and they are quite good. I run gentoo, but the included OS is ok. Only gotchais using an SD card for the OS (less reliable) but getting the optional eMMC sidesteps that one. BillK
Solved: GRe: [gentoo-user] Any one with experience using getmail with postfix?
On 25/11/22 21:01, William Kenworthy wrote:
On 25/11/22 20:37, Wols Lists wrote:
On 25/11/2022 11:56, William Kenworthy wrote:
Hi,
I am looking into replacing fetchmail with getmail on my mail
gateway system
Are you using getmail, or getmail6?
https://pyropus.ca./software/getmail/documentation.html#python3
A quick "emerge --search getmail" shows that gentoo is distributing
getmail6 under getmail's name - they are two completely different
programs. I guess somebody should file a bug to get THAT fixed.
The tldr is that the maintainer of getmail has not migrated to
Python3 - time is hard to find. getmail6 is a fork where somebody has
fed it through 2to3 and not bugfixed it (properly). In other words,
whether you choose getmail or getmail6, you have a problem.
Made worse by the fact that many people - distros included! - don't
realise that getmail and getmail6 are completely different entities.
Cheers,
Wol
I dont think it makes a difference - for my purposes it looks and
works exactly like getmail, but uses python3. I guess what I need is
an MTA that takes input on stdin, and outputs to a host:port
The solution was to use sendEmail (its in portage) as below:
[destination]
type = MDA_external
path = /usr/bin/sendEmail
arguments = ("-f", "%(sender)", "-t", "my_valid_user@mail.server", "-s",
"localhost:10026", "-o", "tls=no", "-o", "message-format=raw")
unixfrom = true
user = my_valid_user
group = my_valid_group
Re: [gentoo-user] Any one with experience using getmail with postfix?
On 25/11/22 20:37, Wols Lists wrote: On 25/11/2022 11:56, William Kenworthy wrote: Hi, I am looking into replacing fetchmail with getmail on my mail gateway system Are you using getmail, or getmail6? https://pyropus.ca./software/getmail/documentation.html#python3 A quick "emerge --search getmail" shows that gentoo is distributing getmail6 under getmail's name - they are two completely different programs. I guess somebody should file a bug to get THAT fixed. The tldr is that the maintainer of getmail has not migrated to Python3 - time is hard to find. getmail6 is a fork where somebody has fed it through 2to3 and not bugfixed it (properly). In other words, whether you choose getmail or getmail6, you have a problem. Made worse by the fact that many people - distros included! - don't realise that getmail and getmail6 are completely different entities. Cheers, Wol I dont think it makes a difference - for my purposes it looks and works exactly like getmail, but uses python3. I guess what I need is an MTA that takes input on stdin, and outputs to a host:port
[gentoo-user] Any one with experience using getmail with postfix?
Hi,
I am looking into replacing fetchmail with getmail on my mail
gateway system (I want to use getmails per instance IDLE parameter).
The docs say that it can work with postfix, however suitable examples
and information is lacking. Currently fetchmail is delivering multiple
accounts via port localhost:10026 to postfix. But I cant figure out how
to get getmail to deliver mail to localhost:10026 like fetchmail can.
This looks like a common use, but I cant see how to do it.
Existing postfix/master.cf: working with fetchmail
127.0.0.1:10026 inet n - n - - smtpd
-o syslog_name=postfix-fetchmail
getmail: this doesnt work
[destination]
type = MDA_external
path = /usr/sbin/sendmail
arguments = ("-i", "-bm", "valid_user@127.0.0.1:10026")
unixfrom = true
Delivery to an mbox directory works fine, and the mail system itself
including postfix has been working for years (with regular updates.).
BillK
Re: [gentoo-user] I915 mobile firmware
Install lshw - might give more info. Boot off of an install, ubuntu, sysrescue or other live USB and investigate dmesg. BillK On 16/11/22 00:59, Peter Humphrey wrote: Hello list, My new laptop shows this from /proc/cpuinfo: --->8 processor : 0 vendor_id : GenuineIntel cpu family : 6 model : 154 model name : 12th Gen Intel(R) Core(TM) i7-12700H stepping: 3 microcode : 0x421 --->8 I've been hunting around to find which modules I need to load from sys-kernel/ linux-firmware, and it isn't at all clear. Some sources say that the processor is a mobile complement to Alder Lake 11th gen, but I also see it as just Tiger Lake. The web seems full of helpful information, but not quite helpful enough for me.:-(
Re: [gentoo-user] Re: realloc() failure in motion
On 21/9/22 00:40, Nuno Silva wrote: On 2022-09-18, William Kenworthy wrote: Hi, I am setting up some cameras (esp32cam) and intended to use motion for them but it crashes on startup with a realloc() error. The system is an up to date arm64 (odroid N2+), mostly stable. Has anyone seen this before? BillK ha /etc/motion # /usr/bin/motion -c /etc/motion/motion.conf -k 9 -d 9 [0:motion] [NTC] [ALL] conf_load: Processing thread 0 - config file /etc/motion/motion.conf [0:motion] [NTC] [ALL] config_camera: Processing camera config file /etc/motion/camera0.conf [0:motion] [NTC] [ALL] read_camera_dir: Processing config file /etc/motion/motion.conf [0:motion] [NTC] [ALL] config_camera: Processing camera config file /etc/motion/motion.conf realloc(): invalid old size Aborted Could you try to get a stack trace from that? I've never used "motion" and I don't know its source code, but [1] makes me wonder if the failure could be happening in [2]. OTOH, from the output, "motion" has entered config_camera() and gone beyond [2] a second time before the realloc() abort - but could these two calls have received the same cnt? From my very little understanding of the code and from your output, it looks like "motion" might be processing motion.conf twice (the "Processing thread 0 [...]" line precedes a call to conf_process(), as does "Processing camera config file"). Is this intended? [1] https://github.com/Motion-Project/motion/blob/HEAD/src/conf.c#L3204 [2] https://github.com/Motion-Project/motion/blob/HEAD/src/conf.c#L3180 (Links are to HEAD, as that's what I started reading.) Yep, that was the problem - it was when looking the output from strace thst it hit me. Its self caused in that I had a camera description file and also set a config variable to read the directory that the files are stored in. From google hits on reallocate failures like this, its likely a lack of protection in the code for reading the config files multiple times at the root of the problem. The documentation could be clearer about this, but thats on me. BillK
[gentoo-user] realloc() failure in motion
Hi, I am setting up some cameras (esp32cam) and intended to use motion for them but it crashes on startup with a realloc() error. The system is an up to date arm64 (odroid N2+), mostly stable. Has anyone seen this before? BillK ha /etc/motion # /usr/bin/motion -c /etc/motion/motion.conf -k 9 -d 9 [0:motion] [NTC] [ALL] conf_load: Processing thread 0 - config file /etc/motion/motion.conf [0:motion] [NTC] [ALL] config_camera: Processing camera config file /etc/motion/camera0.conf [0:motion] [NTC] [ALL] read_camera_dir: Processing config file /etc/motion/motion.conf [0:motion] [NTC] [ALL] config_camera: Processing camera config file /etc/motion/motion.conf realloc(): invalid old size Aborted
Re: [gentoo-user] openvpn experience, anyone?
On 18/9/22 15:26, n952162 wrote: Hello all, I want to ssh over my openvpn connection, and I can't do it, the connection times out. I saw a reference to gentoo in the openvpn scripts in /etc/openvpn and thought maybe somebody here knows something about this. Earlier my institution recommended openconnect, and I was able to use ssh to login in to a host with no problem. Then, for some reason (licensing?), we were switched to openvpn, which works for xfreerdp but not for ssh. I don't have control over the institution's firewall (but I do have for the host itself) Perhaps when installing the new service, they tightened up the firewall rules. But maybe there's a configuration screw I can turn, or ... maybe a USE flag? - - down-root : Enable the down-root plugin - - examples : Install examples, usually source code - - inotify : Enable inotify filesystem monitoring support - - iproute2 : Enabled iproute2 support instead of net-tools + + lz4 : Enable support for lz4 compression (as implemented in app-arch/lz4) + + lzo : Enable support for lzo compression - - mbedtls : Use mbed TLS as the backend crypto library + + openssl : Use OpenSSL as the backend crypto library + + pam : Add support for PAM (Pluggable Authentication Modules) - DANGEROUS to arbitrarily flip - - pkcs11 : Enable PKCS#11 smartcard support + + plugins : Enable the OpenVPN plugin system - - systemd : Enable use of systemd-specific libraries and features like socket activation or session tracking - - test : Enable dependencies and/or preparations necessary to run tests (usually controlled by FEATURES=test but can be toggled independently) TIA ssh and openvpn work well together. However I am doing most of the work using my own configs - gentoo tries to be too clever with its vpn networking and Ive never been able to get it to work reliably/acceptably. On some sites I have to use port 443 (https) to get through, and in extreme cases double wrap in ssl (using a mix of proxytunnel (windows host), stunnel and sslh) to disguise its a vpn but still separate it from regular https traffic on my firewall. You will need to figure out where the ssh is getting blocked/stripped out - is openvpn your endpoint or theirs? BillK
Re: [gentoo-user] Encrypted hard drives on LVM and urgent power shutdowns.
If your using nut, it has to be setup - and should be regularly tested to make sure it works. BillK ' On 12/9/22 09:56, Dale wrote: Howdy, Last night we had some bad weather where I live and we ended up with some power problems. Ironically they went out a few hours after the storm was gone. Anyway. I had all sorts of encrypted drives open. My usual drives inside my puter plus the large 14TB external backup drive that is still copying files over. Glad my UPS held up while I closed all those drives and did a proper shutdown. Doing all that tho, it made me think about if I wasn't here to do all that. Being Linux, I'd suspect that upsmon would tell the puter to do a proper shutdown which includes unmounting the file system, closing the encrypted drives, like I do with cryptsetup close etc and then shutting down. However, one has to ask, is it set up to do so by default? I manage the encrypted drives manually. I don't use the crypt services for that like people do when all of the system drive(s) is encrypted or when just /home is encrypted. My encrypted stuff is mounted within /home or for the external backups, in /mnt. Thing is, some aren't open unless I'm using them or are external. Since I do it manually, is there a tool that sees they need unmounting and closing and does it or do I need to do something to make sure it is done before a shutdown? I suspect this would happen on its own but I'd like to make sure. I'd hate to mess up the file system badly on any of my drives or in a worst case scenario, brick a hard drive with some 1 in a million chance problem. I thought about having a drive connected, open and mounted that I don't really need and just do a shutdown, see what happens. Then again, why not ask and see if anyone else has had this happen and if things turned out OK or if there was problems. I'm lucky, most of the time I'm either home or very close by. Still, it can happen when I'm not here. I already wonder if upsmon will kick in correctly and do a proper shutdown. After all, it has never had to before. I'm running on faith that it will. I hope I'm right. Thoughts? Default will take care of things? I need to take steps to be sure in case I'm not here? Personal experience? A good theory? ;-) Thanks. Dale :-) :-)
Re: [gentoo-user] Getting maximum space out of a hard drive
On 25/8/22 06:45, Frank Steinmetzger wrote: [..] Also, if you're using ext2/3/4, there's the preset, i.e. if you're rather sure about what kind of data is going to be on there, you can tune it so that it reserves more or less place for metadata like inodes, which can be another bit. When I format a partition (and I usually use ext4, with some f2fs mingled in on flash bashed devices), I always set the inode count myself, because the default was always much too high. Like 15 m on a 40 GiB partition or so. My arch root partition has 2 m inodes in total, 34 % of which are in use for a full-fledged KDE setup. That’s sufficient. On Gentoo, I might give it some more for the ever-growing portage directory. But even a few percent on a 10 TB drive amount to many gigabytes. Keep in mind ext4 is created with a fixed number of inodes - you cant change it once its created so you have to deal with reformatting the filesystem and replacing the data. Just another reason to use something more modern - running out of inodes, especially on a large disk is not a minor matter as you have to find somewhere to copy/store the data so you can reformat the disk with more inodes and then put it back. I seem to remember the last time it happened to me (its not an uncommon event) I had to deal with mass corruption too. On the other hand, at one inode per file and Dale primarily storing large media files it may be safe to reduce them. BillK
Re: [gentoo-user] Getting maximum space out of a hard drive
On 21/8/22 13:34, Grant Taylor wrote: On 8/20/22 10:22 PM, William Kenworthy wrote: ... If that is an Odroid XU4, then I strongly suspect that /dev/sda is passing through a USB interface. So ... I'd take those numbers with a grain of salt. -- If the system is working for you, then by all means more power to you. I found that my Odroid XU4 was /almost/ fast enough to be my daily driver. But the fan would kick in for some things and I didn't care for the noise of the stock fan. I've not yet compared contemporary Raspberry Pi 4 or other comparable systems. Samsung Exynos 5422 is developed on the 28 nm technology node and architecture Cortex-A15 / Cortex-A7. Its base clock speed is 1.40 GHz, and maximum clock speed in turbo boost - 2.10 GHz. Samsung Exynos 5422 contains 8 processing cores. Instruction set (ISA) ARMv7-A32 (32 bit) ArchitectureCortex-A15 / Cortex-A7 Yes, its an xu4 and as I mentioned, its a USB drive (seagate 4G backup with an SMR inside) - works ok as a backup drive and the data transfer is fast until you fill the cache - then its throughput is best described as "miserable"! The xu4 lists as 32bit and odroid supplies a 32 bit kernel etc - I just used their config as a base when building gentoo onto it - its my build (for 5 xu4 based HC2 systems) and hosts the backup drive. My attaching the hdparm run was an example of its use, and that happened to be the terminal i was using at the time. BillK
Re: [gentoo-user] Getting maximum space out of a hard drive
What are you measuring the speed with - hdparm or rsync or ? hdparm is best for profiling just the harddisk (tallks to the interface and can bypass the cache depending on settings, rsync/cp/?? usually have the whole OS storage chain including encryption affecting throughput. Encryption itself can be highly variable depending on what you use and usually though not always includes compression before encryption. There are tools you can use to isolate where the slowdown occurs. atop is another one that may help. [test using a USB3 shingled drive on a 32 it arm system] xu4 ~ # hdparm -Tt /dev/sda /dev/sda: Timing cached reads: 1596 MB in 2.00 seconds = 798.93 MB/sec Timing buffered disk reads: 526 MB in 3.01 seconds = 174.99 MB/sec xu4 ~ # BillK On 21/8/22 06:45, Dale wrote: Grant Taylor wrote: Sorry for the duplicate post. I had an email client error that accidentally caused me to hit send on the window I was composing in. I figured it was something like that. ;-) On 8/20/22 1:15 PM, Dale wrote: Howdy, Hi, Related question. Does encryption slow the read/write speeds of a drive down a fair amount? My experience has been the opposite. I know that it's unintuitive that encryption would make things faster. But my understanding is that it alters how data is read from / written to the disk such that it's done in more optimized batches and / or optimized caching. This was so surprising that I decrypted a drive / re-encrypted a drive multiple times to compare things to come to the conclusion that encryption was noticeably better. Plus, encryption has the advantage of destroying the key rendering the drive safe to use independent of the data that was on it. N.B. The actual encryption key is encrypted with the passphrase. The passphrase isn't the encryption key itself. This new 10TB drive is maxing out at about 49.51MB/s or so. I wonder if you are possibly running into performance issues related to shingled drives. Their raw capacity comes at a performance penalty. This drive is not supposed to be SMR. It's a 10TB and according to a site I looked on, none of them are SMR, yet. I found another site that said it was CMR. So, pretty sure it isn't SMR. Nothing is 100% tho. I might add, it's been at about that speed since I started the backup. If you have a better source of info, it's a WD model WD101EDBZ-11B1DA0 drive. I actually copied that from the progress of rsync and a nice sized file. It's been running over 24 hours now so I'd think buffer and cache would be well done with. LOL Ya, you have /probably/ exceeded the write back cache in the system's memory. It did pass both a short and long self test. I used cryptsetup -s 512 to encrypt with, nice password too. My rig has a FX-8350 8 core running at 4GHz CPU and 32GBs of memory. The CPU is fairly busy. A little more than normal anyway. Keep in mind, I have two encrypted drives connected right now. The last time I looked at cryptsetup / LUKS, I found that there was a [kernel] process per encrypted block device. A hack that I did while testing things was to slice up a drive into multiple partitions, encrypt each one, and then re-aggregate the LUKS devices as PVs in LVM. This surprisingly was a worthwhile performance boost. I noticed there is a kcrypt something thread running, a few actually but it's hard to keep up since I see it on gkrellm's top process list. The CPU is running at about 40% or so average but I do have mplayer, a couple Firefox profiles, Seamonkey and other stuff running as well. I still got plenty of CPU pedal left if needed. Having Ktorrent and qbittorrent running together isn't helping. Thinking of switching torrent software. Qbit does seem to use more memory tho. Just curious if that speed is normal or not. I suspect that your drive is FAR more the bottleneck than the encryption itself is. There is a chance that the encryption's access pattern is exascerbating a drive performance issue. Thoughts? Conceptually working in 512 B blocks on a drive that is natively 4 kB sectors. Thus causing the drive to do lots of extra work to account for the other seven 512 B blocks in a 4 kB sector. I think the 512 has something to do with key size or something. Am I wrong on that? If I need to use 256 or something, I can. My understanding was that 512 was stronger than 256 as far as the encryption goes. P. S. The pulled drive I bought had like 60 hours on it. Dang near new. :-) I'm going to try some tests Rich mentioned after it is done doing its backup. I don't want to stop it if I can avoid it. It's about half way through, give or take a little. Dale :-) :-)
Re: [gentoo-user] Backup program that compresses data but only changes new files.
On 15/8/22 06:44, Dale wrote: Howdy, With my new fiber internet, my poor disks are getting a work out, and also filling up. First casualty, my backup disk. I have one directory that is . . . well . . . huge. It's about 7TBs or so. This is where it is right now and it's still trying to pack in files. /dev/mapper/8tb 7.3T 7.1T 201G 98% /mnt/8tb Right now, I'm using rsync which doesn't compress files but does just update things that have changed. I'd like to find some way, software but maybe there is already a tool I'm unaware of, to compress data and work a lot like rsync otherwise. I looked in app-backup and there is a lot of options but not sure which fits best for what I want to do. Again, backup a directory, compress and only update with changed or new files. Generally, it only adds files but sometimes a file gets replaced as well. Same name but different size. I was trying to go through the list in app-backup one by one but to be honest, most links included only go to github or something and usually doesn't tell anything about how it works or anything. Basically, as far as seeing if it does what I want, it's useless. It sort of reminds me of quite a few USE flag descriptions. I plan to buy another hard drive pretty soon. Next month is possible. If there is nothing available that does what I want, is there a way to use rsync and have it set to backup files starting with "a" through "k" to one spot and then backup "l" through "z" to another? I could then split the files into two parts. I use a script to do this now, if one could call my little things scripts, so even a complicated command could work, just may need help figuring out the command. Thoughts? Ideas? Dale :-) :-) The questions you need to ask is how compressible is the data and how much duplication is in there. Rsync's biggest disadvantage is it doesn't keep history, so if you need to restore something from last week you are SOL. Honestly, rsync is not a backup program and should only be used the way you do for data that don't value as an rsync archive is a disaster waiting to happen from a backup point of view. Look into dirvish - uses hard links to keep files current but safe, is easy to restore (looks like a exact copy so you cp the files back if needed. Downside is it hammers the hard disk and has no compression so its only deduplication via history (my backups stabilised about 2x original size for ~2yrs of history - though you can use something like btrfs which has filesystem level compression. My current program is borgbackup which is very sophisticated in how it stores data - its probably your best bet in fact. I am storing literally tens of Tb of raw data on a 4Tb usb3 disk (going back years and yes, I do restore regularly, and not just for disasters but for space efficient long term storage I access only rarely. e.g.: A single host: -- Original size Compressed size Deduplicated size All archives: 3.07 TB 1.96 TB 151.80 GB Unique chunks Total chunks Chunk index: 1026085 22285913 Then there is my offline storage - it backs up ~15 hosts (in repos like the above) + data storage like 22 years of email etc. Each host backs up to its own repo then the offline storage backs that up. The deduplicated size is the actual on disk size ... compression varies as its whatever I used at the time the backup was taken ... currently I have it set to "auto,zstd,11" but it can be mixed in the same repo (a repo is a single backup set - you can nest repos which is what I do - so ~45Tb stored on a 4Tb offline disk). One advantage of a system like this is chunked data rarely changes, so its only the differences that are backed up (read the borgbackup docs - interesting) -- Original size Compressed size Deduplicated size All archives: 28.69 TB 28.69 TB 3.81 TB Unique chunks Total chunks Chunk index:
Re: [gentoo-user] About to have fiber internet and need VPN info
On 6/8/22 20:42, Michael wrote: On Saturday, 6 August 2022 12:08:30 BST Dale wrote: ... The more you try to escape the 14 eyes Big Brother, the closer you may fall into the hands of various authoritarian regimes. LOL! Even VPNs like NordVPN which operates within the jurisdiction of Panama (let's not forget it is Langley's doorstep), it also has offices in the UK, Netherlands and Lithuania. I wonder why . . . Total privacy on the Internet is improbable. If your only concern is to retain your privacy from your ISP with regards to your Internet connections, then most/any VPN service will offer this benefit by obfuscating your IP address. Your browsing patterns, browser User Agent, addons and umpteen other OS and application fingerprints won't be obfuscated beyond the VPN server. Therefore your identity can only be protected so much and no more. Also, leakage is almost inevitable ... DNS, content distribution networks, browser fingerprinting, timezones, paying online with a US credit card, US delivery address and just simple mis-configuration exposing you to risk etc. My impression as a long time openvpn user is that TOR and the TOR browser might be the closest to secure for your purposes? Also, keep in mind that things like online shopping will cost you more overseas because if you are successful in hiding you are in the US you will get the international surcharges, or in some cases ordering IT stuff from the US you have to fill out export clearances (once even for sparkfun hobby stuff!) :) ... then if you pay with a US card and/or have a US delivery address they have got you anyway - in fact being in Oz I gave it up as being no gain, too much pain to use a VPN try and get cheaper US shopping. I found myself having to maintain two totally independent systems with one in a locked down VPN with US settings with all traffic actively blocked from the local network, and use US shipping and packaging firms that offered facilities to buy on my behalf. That is much harder than you think - trusting the end points is only one small part of the problem you are trying to solve and from the Gov monitoring point of view almost certainly a waste of time anyway as they have massive resources. The best you can hope for with openvpn is SSL point to point level security. Just use HTTPS, a good browser and be part of the crowd - if you are trawling suspect/socially compromising websites you do not want anyone to see you going to, no matter what you do there will always be a risk and as a VPN user you are a more likely target for a closer look anyway. I am sure the bigger online VPN providers would be monitored closely - at least TOR is likely to help more than a plain VPN. BillK
Re: [gentoo-user] python mess - random winge!
On 5/7/22 14:24, w...@op.pl wrote: > Dnia 2022-07-05, o godz. 13:04:07 > William Kenworthy napisał(a): > >> I synced portage a couple of days now and now my systems are >> rebuilding python modules for 3.10 without any input from me (prior >> to this 3.10 was on the system but wasn't picked up by applications.) >> This is breaking non portage apps like homeassistant which are still >> not fully 3.10 safe - ok that's sort of expected and in this case >> will be fixed, but I cant find anything definitive on the task of "I >> want to control which python is used" and when to update. >> >> I eventually found that changing the order in python-exec.conf helped >> on the homeassistant system. There is a LOT of out of date >> documentation out there, particularly with eselect being used but is >> actually not used with python anymore (why? - from a user point of >> view having consistent access to configuration is a no brainer!) - so >> how can one get python to behave reliably and override its automatic >> get things wrong installation system? Is manually editing >> python-exec.conf the way (which seems to get overwritten - shouldn't >> that be a protected config file then?) >> >> BillK >> >> >> >> > Hello! > > In "eselect news" info about python update there is a paragraph about > blocking the upgrade. It just means adding: > > */* PYTHON_TARGETS: -* python3_9 > */* PYTHON_SINGLE_TARGET: -* python3_9 > > to /etc/portage/make.conf or /etc/portage/package.use or > /etc/portage/package.use/zz-somename - whichever suites you best. > > You can also change these settings just for some packages, by adding: > > cat/pkg PYTHON_TARGETS: -* python3_9 PYTHON_SINGLE_TARGET: -* python3_9 > > to one of aforementioned files. > > Hope that helps! I did read the news item and set the systems as above with multiple python targets - there is no mention of python-exec and its role in which python version is in use for packages that just call "python". Perhaps I should have been clearer - what I see is with multiple python targets present the python ebuild automatically selects the latest version that is stable via python-exec - ok, some would want that. But what it should do is respect the users choice of running version and not automaticly overide it without asking. It looks like python-exec is the controlling factor so I'll try CONFIG_PROTECTon that file and manually manage it via ansible. BillK
[gentoo-user] python mess - random winge!
I synced portage a couple of days now and now my systems are rebuilding python modules for 3.10 without any input from me (prior to this 3.10 was on the system but wasn't picked up by applications.) This is breaking non portage apps like homeassistant which are still not fully 3.10 safe - ok that's sort of expected and in this case will be fixed, but I cant find anything definitive on the task of "I want to control which python is used" and when to update. I eventually found that changing the order in python-exec.conf helped on the homeassistant system. There is a LOT of out of date documentation out there, particularly with eselect being used but is actually not used with python anymore (why? - from a user point of view having consistent access to configuration is a no brainer!) - so how can one get python to behave reliably and override its automatic get things wrong installation system? Is manually editing python-exec.conf the way (which seems to get overwritten - shouldn't that be a protected config file then?) BillK
Re: [gentoo-user] Re: Boot has no space left.
and don't forget to run "uname -a" to get your currently running kernel version and make sure you don't delete that! "IF" "uname -a" isn't the latest version you have in /boot, some more investigation as to why will be needed. BillK On 1/7/22 04:29, Lee wrote: > The OP should read the section of the Gentoo manual on kernel install > to learn what files are installed where. Yea, but just rm the kernels > and initramfs's from /boot and you're golden. FWIW, I usually only > upgrade my kernel when it's a major revision. > > On Thu, Jun 30, 2022 at 12:39 PM Wols Lists > wrote: > > On 30/06/2022 19:23, Michael wrote: > > On Thursday, 30 June 2022 19:15:33 BST Guillermo wrote: > >> Hello, > >> > >> I still have the same problem, but the command worked fine. > > The command "emerge -a --depclean" will only remove uninstall > the kernel > > packages, but will not remove files from/usr/src/, or old kernel > images and > > files from/boot/. > > As far as I'm aware, depclean only installs files it installed, so it > leaves quite a lot of garbage lying around from kernels, including > the > /usr/src/kernel-xx-xx-xx directory and various files involved in > making > your kernel, that you've modified. > > Cheers, > Wol > > > > -- > Lee >
Re: [gentoo-user] verify-sig
Thanks. BillK On 9/4/22 15:32, Ionen Wolkens wrote: On Sat, Apr 09, 2022 at 02:50:30PM +0800, William Kenworthy wrote: A new use has shown up named "verify-sig". It seems simple enough from its euse description but its causing a large number of packages to be rebuilt unnecessarily (it defaults to off on my sytems). Should I enable it? - I can find much info on it and it looks like it will cause major user hassles considering its effects so far - I am surprised there has been no news item for it which probably means its not considered a useful use flag. Use --changed-use/-U rather than --newuse/-N when using emerge. With --changed-use, if USE is changing from to: enabled -> removed = rebuilds disabled -> removed = ignores (changes nothing, no rebuild needed) missing -> disabled = ignores (likewise, this is the verify-sig) missing -> enabled = rebuilds While --newuse rebuilds in all 4 cases. There's largely no reason to enable verify-sig as you're already verifying through the Manifest. This is primarily intended for developers, albeit for users it can give some assurance that signatures were checked.
[gentoo-user] verify-sig
A new use has shown up named "verify-sig". It seems simple enough from its euse description but its causing a large number of packages to be rebuilt unnecessarily (it defaults to off on my sytems). Should I enable it? - I can find much info on it and it looks like it will cause major user hassles considering its effects so far - I am surprised there has been no news item for it which probably means its not considered a useful use flag. BillK
Re: [gentoo-user] Choose a wireless access point
On 5/4/22 16:05, Michael wrote: On Tuesday, 5 April 2022 08:46:52 BST Neil Bothwick wrote: On Tue, 5 Apr 2022 11:16:10 +0800, William Kenworthy wrote: On 5/4/22 07:09, Michael wrote: On Monday, 4 April 2022 16:12:53 BST Jack wrote: On 4/4/22 01:31, William Kenworthy wrote: Is there a way force openrc and wpa_supplicant to map a particular access point to an interface or fail? I have two AP's (each on a different ssid) to connect to so have two wifi interfaces - unfortunately they are not equal so I want wlan0 to connect to only one particular AP, and wlan1 to the other ... reliably! I can manually force it to connect but invariably at the first glitch they both end up connected to the same AP (usually the strongest which is often not what I want :( BillK I don't know about wpa-supplicant, but I'm using open-rc and KDE, and KDE's systemsettings Network / Connections screen lets you restrict a network connection so a specific device. Not sure if this helps you any, but it would indicate that what you want is possible. Jack Look at the example provided in: /usr/share/doc/netifrc-0.7.3/net.example.bz2 You can set a different ssid for each wireless NIC. The wpa_supplicant can be set with credentials for the two APs only. Unfortunately, this does not work as I want ...wpa_supplicant's behaviour makes sense in that it provides a fallback if the allocated access point cant connect ... it will pick the next available one (seemingly based on signal strength) if it is in its conf file (and does not care that its another ssid) - so it does not fail. As only one of the two networks has internet access the device often ends up not being able to be connected to (its headless so that's a problem!). I have fallen back to openrc for the main connection and will do the other manually - it would be nice to have everything properly controlled but its not working for me. Could you run two instances of wpa_suplicant, each listening on a different interface and using a config with only the AP for that interface? As I recall wpa_cli can be launched by specifying a particular interface. Therefore two instances of wpa_cli launched by a script should be possible. However, isn't the purpose of /etc/conf.d/net to specify how individual interfaces are configured? I still think - but have not tried it - each wireless NIC can be configured via this file to use a particular access point/ channel and not go scanning for others, while the wpa_supplicant can be left to deal with the authentication mechanism after each NIC has found its specified ESSID. The section in the netifrc example file which starts as follows, merits reading: ### # SETTINGS # Hard code an SSID to an interface - leave this unset if you wish the driver # to scan for available Access Points . . . Something like this ought to work: essid_wlan0="foo" essid_wlan1="bar" Didnt work - what did work was setting up the main network using normal openrc and scripting the other interface after making it config_wlan1="null" in conf.d/net. I am putting this part of the problem as solved. Routing is still an issue but once I have a couple of diagnostic packages installed (compiling is slow on a pi!) I will be better able to see whats gone wrong. BillK
Re: [gentoo-user] Choose a wireless access point
On 4/4/22 23:12, Jack wrote: On 4/4/22 01:31, William Kenworthy wrote: Is there a way force openrc and wpa_supplicant to map a particular access point to an interface or fail? I have two AP's (each on a different ssid) to connect to so have two wifi interfaces - unfortunately they are not equal so I want wlan0 to connect to only one particular AP, and wlan1 to the other ... reliably! I can manually force it to connect but invariably at the first glitch they both end up connected to the same AP (usually the strongest which is often not what I want :( BillK I don't know about wpa-supplicant, but I'm using open-rc and KDE, and KDE's systemsettings Network / Connections screen lets you restrict a network connection so a specific device. Not sure if this helps you any, but it would indicate that what you want is possible. Jack Hi Jack, unfortunately its a headless, wifi only system which is why getting openrc to behave is important! BillK
Re: [gentoo-user] Choose a wireless access point
On 5/4/22 07:09, Michael wrote: On Monday, 4 April 2022 16:12:53 BST Jack wrote: On 4/4/22 01:31, William Kenworthy wrote: Is there a way force openrc and wpa_supplicant to map a particular access point to an interface or fail? I have two AP's (each on a different ssid) to connect to so have two wifi interfaces - unfortunately they are not equal so I want wlan0 to connect to only one particular AP, and wlan1 to the other ... reliably! I can manually force it to connect but invariably at the first glitch they both end up connected to the same AP (usually the strongest which is often not what I want :( BillK I don't know about wpa-supplicant, but I'm using open-rc and KDE, and KDE's systemsettings Network / Connections screen lets you restrict a network connection so a specific device. Not sure if this helps you any, but it would indicate that what you want is possible. Jack Look at the example provided in: /usr/share/doc/netifrc-0.7.3/net.example.bz2 You can set a different ssid for each wireless NIC. The wpa_supplicant can be set with credentials for the two APs only. Unfortunately, this does not work as I want ...wpa_supplicant's behaviour makes sense in that it provides a fallback if the allocated access point cant connect ... it will pick the next available one (seemingly based on signal strength) if it is in its conf file (and does not care that its another ssid) - so it does not fail. As only one of the two networks has internet access the device often ends up not being able to be connected to (its headless so that's a problem!). I have fallen back to openrc for the main connection and will do the other manually - it would be nice to have everything properly controlled but its not working for me. BillK
[gentoo-user] Choose a wireless access point
Is there a way force openrc and wpa_supplicant to map a particular access point to an interface or fail? I have two AP's (each on a different ssid) to connect to so have two wifi interfaces - unfortunately they are not equal so I want wlan0 to connect to only one particular AP, and wlan1 to the other ... reliably! I can manually force it to connect but invariably at the first glitch they both end up connected to the same AP (usually the strongest which is often not what I want :( BillK
Re: [gentoo-user] Two wifi client interfaces and routing
Thanks for the detailed reply - my response is inline: On 1/4/22 00:17, Grant Taylor wrote: > On 3/31/22 7:21 AM, William Kenworthy wrote: >> Hi, > > Hi, > >> I am trying to use a raspberry pi ... to create a routed link >> between two access points ... so I can access the monitoring port >> ... from homeassistant. > > I'm distilling this down to a Gentoo system participating in two two > LANs, both of which are connected as DHCP clients. -- Correct me if > I've distilled too much. -- And you want other systems on either LAN > to use this system as a communications path to systems on the opposing > LAN. > Correct, though I only need systems on the home network side (from at least two VLANs) to access through the rpi - this device, as well as some other "untrusted", cloud devices are on their own VLAN) - the inverter is an island and I need to access just that one port. >> Both AP's connect ok from the rpi but the routing is wrong - I can >> ping in both directions from the rpi, but only sometimes from devices >> further hops away - can openrc even do this? > > This seems like a classic routing issue. To me, it's not even an > OpenRC issue in any way other than how to add static routes /after/ > the network is brought up via DHCP. Agree - I would describe it as a two gateway and related routing issues with something resetting/re-configuring of the routing tables into a nonsensical state when I try and manually manipulate them. I did forget to mention I use ospfd (frr) to propagate routes (a complex, multi VLAN network) which works fine - its openrc setting the wrong routes on the rpi which then get propagated - thats not central to this issue though. > >> My experimenting so far is hit and miss. Trying to static route or >> override the default routes doesn't survive a network glitch, and >> half the time doesn't seem to "take" at all. > > Ya. At a higher level, this can be non-obvious how to do this as it's > niche routing configuration. > >> A working example I could adapt would be great! > > I don't have an example off hand. -- Seeing as I use static IPs on > almost all of my machines, I don't even know if OpenRC supports adding > a static route /after/ bringing an interface up with DHCP. It does, but its either set the network configuration manually which kept getting extra routes added - in particular the inverter sends the gateway which dhcpd adds then I have to delete ... and gets undone at the next network glitch (hostile wifi environment plus weak signal). > > I do know that the DHCP protocol supports adding additional options / > definitions / parameters (?term?) to specify -- what I've been > describing as -- static routes. That way DHCP clients will learn > about these additional routes and install them in their local routing > table. Though I don't know if you will have the necessary control over > /both/ DHCP servers that's needed to do this. Unfortunately, the inverter is a black box :( > > Presuming that you don't have control over /both/ DHCP servers (as > control over /both/ will be needed), I'm going to fall back and > suggest what I call the "Customer Interface Router". I cant control the inverter network. > > Specifically, set up port forwarding on the Pi such that when clients > on LAN1 connect to $PORT on the Pi, the traffic is DNATed to the > HomeAssistant on LAN2 /and/ the traffic is SNATed to the LAN2 > interface on the Pi. Thus every system on each LAN thinks that it's > talking to a directly attached system in the same LAN. There is no > need for routing in this case. I have not tried this as I thought it would also run into the two default gateway issue ... I'll try this next! > > I typically only use the C.I.R. when there are reasons that more > proper routing can't be configured. The C.I.R. is an abstraction > layer that allows either side to operate almost completely > independently of each other, save for IP conflicts between each > directly attached LAN. I have now been given api credentials but they don't say if it runs on the inverter or a remote site ... more reading! At this stage all I need is simple monitoring that I can process using software. Thanks, BillK > > >
[gentoo-user] Two wifi client interfaces and routing
Hi, I am trying to use a raspberry pi (3B running gentoo 32bit, openrc) to create a routed link between two access points (the rpi acting as a client to both AP's) so I can access the monitoring port (6607, modbus) from homeassistant. One AP is an Huawei inverter with a built in "island" access point that sets a default route to itself on clients via dhcp. I have a normal gentoo based Access Point for the house that also sets a default route via dhcp. What I need is a single default route to my home network via the rpi from the Huawei inverter. Both AP's connect ok from the rpi but the routing is wrong - I can ping in both directions from the rpi, but only sometimes from devices further hops away - can openrc even do this? My experimenting so far is hit and miss. Trying to static route or override the default routes doesn't survive a network glitch, and half the time doesn't seem to "take" at all. A working example I could adapt would be great! BillK
Re: [gentoo-user] how to restart the network, no net.enp1s0
There was a news item on network naming - it might be that. A couple of people got caught by it. BillK On 21/1/22 20:48, n952162 wrote: The point is, something has changed in openrc, and I was hoping somebody knew about it. It used to be that you could restart the network with: rc-service net.enp1s0 restart which would use the link in /etc/init.d. But that link is now gone, although the network works. Something fundamental has changed, I think, and I thought it would pop out here, but I guess I'm the only one still using openrc. On 1/16/22 19:06, Mark Knecht wrote: On Sun, Jan 16, 2022 at 1:50 AM n952162 wrote: Hello all, my system runs fine, but when I want to restart my network, I find there's no /etc/init.d/net.enp1s0 link or other interesting candidate. Do something change here? What do I need to do to restart my network? Obviously the answers depends completely on how you are managing services and what executables you have on your highly customizable Gentoo machine, but possibly: sudo service network-manager restart sudo systemctl restart NetworkManager.service sudo nmcli networking off && sudo nmcli networking on sudo ifdown -a && sudo ifup -a If you are using systemctl then sudo systemctl status is a good place to start, along with nmcli HTH, Mark
Re: [gentoo-user] Handling a sizable amount of spam and Dovecote question
On 20/1/22 22:06, Marco Rebhan wrote: On Thursday, 20 January 2022 14:22:02 CET Dale wrote: What do others do with spam to minimize it? Hi Dale, I'm not sure if you're talking about self-hosted mail because you mention dovecot, if you do: Google Gentoo mail gateway - there are a couple of good guides. Running a mail system is a major effort for a small number of accounts however it is nowhere near as effective as a user vs one of the larger companies such as Cisco who have access to a huge number of data samples to analyse and work off. The ISP I use (iinet) offers cisco ironport spam filtering free on accounts, either off, blocking or marking. Its very effective whereas my mail filtering gateway using fetchmail, procmail, blacklisting, grey listing, spam-assassin, amavis-new, clamav, razor, dcc etc. does sort of work for me, it just doesn't work as well. BillK
Re: [gentoo-user] Kernel config thingy, "make menuconfig"
On 16/1/22 00:06, Dale wrote: tastytea wrote: On 2022-01-15 22:38+0800 Andrew Lowe wrote: Dear all, I'm in the process of fiddling around with the config of my kernel. This means using the "menu config thingy" that "make menuconfig" builds. It is very frustrating. Does anyone know why stuff is not in alphabetical order? It's a pain in the clacka trying to find some of the entries. For example "Device Drivers -> Android". You would expect it to be near the top of the device drivers, but no, it's near the bottom. No, I'm not expecting anyone to "fix" it, just basically a whinge. Andrew Yeah, someone should clean that thing up… But I guess a lot of people would complain because they are used to the current structure. Did you know you can search with / and then jump to the results with the number keys? Number keys? I got to go test this. That would be one nifty trick. Thanks. Dale :-) :-) Yep, its quite nifty! Also, menuconfig is not the only way - there are a few config programs for the kernel ... if you have X on the machine there is xconfig which can be quite useful. Others Ive heard of a mconfig, gconfig and nconfig and there are probably more. also see "https://en.wikipedia.org/wiki/Menuconfig; BillK
Re: [gentoo-user] TLD for home LAN?
On 15/1/22 18:33, Peter Humphrey wrote: Hello list, Rich F said recently, "I'd avoid using the .local TLD due to RFC 6762." That brings me back to a thorny problem: what should I call my local network? It used to be .prhnet, but then a program I tried a few years ago insisted on a two-component name, so I changed it to .prhnet.local. Now I've read that RFC - well, Appendix G to it - and I'm scratching my head. I suppose it's possible that someone may want to connect an Apple device to my network, so perhaps I should clear the way for that eventuality. So, what TLD should I use? Should I use .home, or just go back to .prhnet? It isn't going to be visible to the Big Bad World, so does it even matter? Ive been using "localdomain" for years without any obvious problems. .local is not just apple but can be used by other things too (e.g., homeassistant uses it for device discovery, creating an extensive ecosystem in the process. No apple devices in sight :) BillK
Re: [gentoo-user] "EZ mode" vs "AP mode"
On 13/1/22 21:29, Neil Bothwick wrote: On Thu, 13 Jan 2022 20:38:48 +0800, William Kenworthy wrote: Z mode is the smart dev acting as an accesspoint for the controlling phone app to connect - so it cant in that mode connect to anything else. To reflash the firmware with something friendlier you can use EZ mode to flash esphome onto tuya devices using tuya-convert via a raspberry pi (needs to be a 32 bit OS ... I am using gentoo but is a lot easier with raspian). Tonight I decided to flash esphome onto some "brilliant smartplugs" but it isnt connecting - its a frustrating process :( but the apps usually work ok ... after multiple goes. The tuya and similar devices used the esp8266 chipset, so you could flash them with tasmota/espurna/esphome. Now they are switching to different chipsets and none of the previous flashing methods will work. I am hoping this is not the case (supposedly these are still flashable) - Ive just discovered my current problem is my tuya-convert install is broken. BillK
Re: [gentoo-user] "EZ mode" vs "AP mode"
On 13/1/22 19:45, k...@aspodata.se wrote: Thelma: What kind of routers work with "EZ mode" Recently I was plying with a wifi light switch and couldn't get "EZ mode" to work with my Asus router. AP mode, worked but for this to work phone's Bluetooth and Personal Hotspot need to be turn ON (during configuration); and the switch manual did not mentioned it. I don't know what you're talking about, but this is what I found doing a simple search. https://support.cesmarthome.com/en/support/solutions/articles/44000568556-connecting-to-the-wi-fi-smart-dimmer-switch-how-to-put-device-in-pairing-mode-ez-and-ap-mode- https://dazzblingproducts.com/troubleshooting/ Regards, /Karl Hammar EZ mode is the smart dev acting as an accesspoint for the controlling phone app to connect - so it cant in that mode connect to anything else. To reflash the firmware with something friendlier you can use EZ mode to flash esphome onto tuya devices using tuya-convert via a raspberry pi (needs to be a 32 bit OS ... I am using gentoo but is a lot easier with raspian). Tonight I decided to flash esphome onto some "brilliant smartplugs" but it isnt connecting - its a frustrating process :( but the apps usually work ok ... after multiple goes. BillK
Re: [gentoo-user] OT: whats a good laptop for gentoo these days?
On 10/1/22 00:26, Jack wrote: On 1/9/22 07:49, William Kenworthy wrote: My MS surface pro4 has died (swelling battery has popped the screen - known problem) so I am looking for a better replacement. I bought it new years ago but it only got good Linux support (touchscreen etc.) in the last couple of years so its been a bit frustrating. So the question is - whats a good replacement? Criteria is good battery life, can dual boot windows (this is my only windows machine these days and there are still some cases - Logitech harmony remote for one) and gentoo with everything working/supported. I do like the tablet with detachable physical keyboard design but I mostly use it with keyboard attached. And non-microsoft hardware is preferred (the sp4 failure is a design issue for which MS suffered a class action lawsuit to get them to honour the warranty - I don't want a repeat) BillK Do you really need/want dual boot, or would Windows in a VM work? No, has to be a hardware install. Trying to do usb flashing using vm's (which I have) has not worked well. (logitech harmony, bluefin, ...) BillK
[gentoo-user] OT: whats a good laptop for gentoo these days?
My MS surface pro4 has died (swelling battery has popped the screen - known problem) so I am looking for a better replacement. I bought it new years ago but it only got good Linux support (touchscreen etc.) in the last couple of years so its been a bit frustrating. So the question is - whats a good replacement? Criteria is good battery life, can dual boot windows (this is my only windows machine these days and there are still some cases - Logitech harmony remote for one) and gentoo with everything working/supported. I do like the tablet with detachable physical keyboard design but I mostly use it with keyboard attached. And non-microsoft hardware is preferred (the sp4 failure is a design issue for which MS suffered a class action lawsuit to get them to honour the warranty - I don't want a repeat) BillK
Re: [gentoo-user] genkernel's new configs not used?
On 2/1/22 13:44, Dale wrote: Dale wrote: Neil Bothwick wrote: On Sat, 1 Jan 2022 15:44:51 +, Wols Lists wrote: Compiling the kernel and modules? Replace 1 with make all modules_install install There's also the matter of the initramfs, one of the main reasons people use genkernel, although I prefer dracut for this. until you trip over genkernel's "features" ... like AUTOMOUNT_BOOT, which doesn't work, by design. Or NO_INSTALL, which does rather more than just not installing ... I'm investigating source_mage, and ought to investigate dracut. Once you have a working kernel, there's very little to do on updates. A script that runs cd /usr/src/linux zcate /proc/config.gz >.config make oldconfig make all modules_install install dracut --kver=$(cat include/config/kernel.release) --xz update the bootloader mostly does it all, with a few frills thrown in to cover things like rebuilding modules. Can you explain this part a bit? How it knows what version for example to build against? Does it follow the link in /usr/src/linux, eselect info or something else? dracut --kver=$(cat include/config/kernel.release) --xz The one thing that stumps me is figuring out how to tell dracut what version I want built. I keep 2, 3 and sometimes 4 kernels of different versions lurking about in /boot. Thanks. Dale :-) :-) I got it figured out. That's a little like cheating. LOL Dale :-) :-) rattus ~ # (cd /usr/src/linux && make kernelversion) 5.10.76-gentoo-r1 rattus ~ #
Re: [gentoo-user] SD memory card not erasing, even with dd.
... This thread has been interesting tho. At least I know that a Sandisk card at least tries to fail in a way that I can get the data off that did get written to the card. Hey, that's a lot better than some I guess. :-D I've had some other brands that when they die, they dead. You get nothing at all. Dale :-) :-) From memory (I found some articles describing what was happening when investigating a while back) - its common with other brands too so might be part of the specification - if it detects a failure, it forces permanent read only mode to enable data recovery. Some cards may be put back into write mode by software but not all and I wouldn't trust it anyway. I have Kingston, Samsung and Sandisk cards - I regard Samsung as very slightly better but not enough to go out of my way and pay more for them. BillK
Re: [gentoo-user] SD memory card not erasing, even with dd.
On 29/12/21 20:26, Michael wrote: On Tuesday, 28 December 2021 20:21:32 GMT Dale wrote: Howdy, As some may recall, I have quite a few deer trail cameras that use SD memory cards. On occasion some of the cards start acting weird. I've got one that is really weird. Usually I just replace them but this one is a bit of a puzzle I'd like to solve. When it stopped working, it had a dozen or so short videos on it that are about 30MBs on average. Some color and large, some black and white night vision and fairly small. When it stopped working, I tried to reformat the thing. The files remained even after that. I then ran dd and zeroed the thing, files still there even tho dd reported no problems. I then used this GUI disk program that tests memory cards and it claims the card is fine. It writes files to it, reads them back. I also used it to reformat the card. The original videos are still there. Today I decided to play with it again. I ran this dd command on the stick. root@fireball / # dd if=/dev/zero of=/dev/sdh bs=4K conv=notrunc oflag=direct status=progress 31907364864 bytes (32 GB, 30 GiB) copied, 3956 s, 8.1 MB/s dd: error writing '/dev/sdh': No space left on device 7791745+0 records in 7791744+0 records out 31914983424 bytes (32 GB, 30 GiB) copied, 3956.94 s, 8.1 MB/s root@fireball / # As you can see, no errors. It wrote zeros until it ran out of space. Guess what, the original videos are still on the card. File listing: root@fireball / # ls -al /run/media/dale/2140-2E00/DCIM/100MEDIA/* -rw-r--r-- 1 dale users0 May 6 2018 /run/media/dale/2140-2E00/DCIM/100MEDIA/.AAA -rw-r--r-- 1 dale users0 May 6 2018 /run/media/dale/2140-2E00/DCIM/100MEDIA/.BBB -rw-r--r-- 1 dale users 14335272 May 2 2018 /run/media/dale/2140-2E00/DCIM/100MEDIA/WGI_0823.AVI -rw-r--r-- 1 dale users 50843576 May 6 2018 /run/media/dale/2140-2E00/DCIM/100MEDIA/WGI_0824.AVI -rw-r--r-- 1 dale users 53137560 May 6 2018 /run/media/dale/2140-2E00/DCIM/100MEDIA/WGI_0825.AVI -rw-r--r-- 1 dale users 18398504 May 6 2018 /run/media/dale/2140-2E00/DCIM/100MEDIA/WGI_0826.AVI -rw-r--r-- 1 dale users 18922808 May 6 2018 /run/media/dale/2140-2E00/DCIM/100MEDIA/WGI_0827.AVI -rw-r--r-- 1 dale users 18332888 May 6 2018 /run/media/dale/2140-2E00/DCIM/100MEDIA/WGI_0828.AVI -rw-r--r-- 1 dale users 18726200 May 6 2018 /run/media/dale/2140-2E00/DCIM/100MEDIA/WGI_0829.AVI -rw-r--r-- 1 dale users 18332920 May 6 2018 /run/media/dale/2140-2E00/DCIM/100MEDIA/WGI_0830.AVI -rw-r--r-- 1 dale users 18005288 May 6 2018 /run/media/dale/2140-2E00/DCIM/100MEDIA/WGI_0831.AVI -rw-r--r-- 1 dale users 17612088 May 6 2018 /run/media/dale/2140-2E00/DCIM/100MEDIA/WGI_0832.AVI -rw-r--r-- 1 dale users 17153336 May 6 2018 /run/media/dale/2140-2E00/DCIM/100MEDIA/WGI_0833.AVI -rw-r--r-- 1 dale users 16694584 May 6 2018 /run/media/dale/2140-2E00/DCIM/100MEDIA/WGI_0834.AVI -rw-r--r-- 1 dale users0 May 6 2018 /run/media/dale/2140-2E00/DCIM/100MEDIA/WGI_0835.AVI root@fireball / # The zero byte files are broken, my first clue way back that the card needed replacing. I see no errors in dmesg or messages. Usually the cards produce errors and it remounts read only. Not in this case tho. Mount info: root@fireball / # mount | grep sdh /dev/sdh1 on /run/media/dale/2140-2E00 type vfat (rw,nosuid,nodev,relatime,uid=1000,gid=100,fmask=0022,dmask=0022,codepage=43 7,iocharset=iso8859-1,shortname=mixed,showexec,utf8,flush,errors=remount-ro, uhelper=udisks2) root@fireball / # In the past, I've at times been able to copy the files off other cards going bad but it stays read only. Reformating fails etc etc. Sometimes, it just plain doesn't work. Almost always tho I get a error of some kind in messages or dmesg if not both. This one tho, it's just plain weird. No errors but nothing removes the files either. Oh, I've checked the lock button. It's not locked. It is shown that way in dmesg as well. [2592841.808336] sd 10:0:0:2: [sdh] Write Protect is off Obviously I'm not going to trust this thing. It will end up in the trash but, does this make sense to anyone else? Of all the ones I've worn out, this is the only one that behaves this way. I'd at least expect the format to fail or it only mount read only. At least some sort of error anyway. Thoughts? Dale :-) :-) I don't think I've come across something like this before. In my case data is lost, occasionally irretrievably. I suppose something has switched blocks on the SD as immutable, probably a controller having a hiccup. You could try blkdiscard to erase blocks directly - but I haven't tried this on an SD. I also haven't tried to know if it will work at all hdparm's secure deletion. However, the best option is to see if the OEM offers a reset app for this particular card and use that. I have a few SD cards as OS disks on raspberry pi, odroids etc. One has your symptoms like yours - read only when it says its in write mode.
Re: [gentoo-user] Long boot time after kernel update
A point to keep in mind - if you can feel the drive moving it may be generating errors! Depending on the drive, the errors may just be handled internally and I can see it slowing things down though probably would be barely noticeable. I have seen it myself with random errors from a WD green drive disappearing when properly immobilised. When investigating I ran across articles discussing the problem, one of which fastened the drives to a granite slab for tests! Also see discussions on NAS seups and vibrations affecting co located drives. BillK ** Interesting read https://www.ept.ca/features/everything-need-know-hard-drive-vibration/ On 27/12/21 22:15, Dale wrote: Wols Lists wrote: On 27/12/2021 13:40, Michael wrote: On Monday, 27 December 2021 11:32:39 GMT Wols Lists wrote: On 27/12/2021 11:07, Jacques Montier wrote: Well, i don't know if my partitions are aligned or mis-aligned... How could i get it ? fdisk would have spewed a bunch of warnings. So you're okay. I'm not sure of the details, but it's the classic "off by one" problem - if there's a mismatch between the kernel block size and the disk block size any writes required doing a read-update-write cycle which of course knackered performance. I had that hit a while back. But seeing as fdisk isn't moaning, that isn't the problem ... Cheers, Wol I also thought of misaligned boundaries when I first saw the error, but the mention of Seagate by the OP pointed me to another edge case which crept up with zstd compression on ZFS. I'm mentioning it here in case it is relevant: https://livelace.ru/posts/2021/Jul/19/unaligned-write-command/ that might be of interest to me ... I'm getting system lockups but it's not an SSD. I've got two IronWolves and a Barracuda. But I notice the OP has a Barra*C*uda. Note the different spelling. That's a shingled drive I believe, which shouldn't make a lot of difference in light usage, but you don't want to hammer it! Cheers, Wol I don't recall seeing this mentioned but this may be part of the issue unless I'm missing something that rules this out. Could it be a drive is a SMR drive? I recently made a new backup after wiping out the drive. I know the backup drive is a SMR drive. At first, it copied at a fairly normal speed but after a short time frame, it started slowing down. At times, it would do only about 50 to 60MBs/sec. It started out at well over 100MBs/sec which is fairly normal for this rig. I would stop the copy process, let it catch up and restart just to give it some time to process. I can't say it was any faster that way tho. The way I noticed my drive was SMR, I could feel the heads going back and forth by putting my hand on the enclosure. It had a bumpy feel to it. You can't really hear it tho. If you can feel those little bumps even when the drive isn't mounted, I'd be thinking it is a SMR drive. There are also sites that you can look this sort of thing up on too. If needed, I can go dig out some links. Just thought it worth a mention. Dale :-) :-)
Re: [gentoo-user] Re: Movie editing softeware
On 22/12/21 04:59, Dale wrote: Grant Edwards wrote: On 2021-12-21, Dale wrote: As someone who has experimented with video editing software, I can understand Wols on this. What some of us needs is something similar to 'video editing for dummys' except we need the software not the book. At one time, I wanted to remove like 20 or 30 seconds on the beginning and about the same on the end of a few videos. Hours later, still couldn't figure it out. Heaven forbid I wanted to remove something in the middle as well or add a second or so of black screen. I've had pretty much the same experience with all of the GUI video editing software I've tried: 0. It takes at a day just to get one to build. 1. The GUI is always completely baffling, and there doesn't seem to be any commonality from one package to the next. 2. There's little or no documentation available other than lists of commands/features with descriptions that assume you already know how the program works. When you need to know how to accomplish a task, there's no help. It is always assumed you already know what command/feature to use. 3. The "project" structure and paradigm always seems to be WAY too complex for what I want to do and does nothing for me other than get in the way. 4. About 30% of the features/commands don't work at all, another 30% don't work they way the documentation says they do, and the rest have been renamed and moved to a different menu/panel/mode since the documentation was written. 5. All of the ones I've ever tried crashed frequently. They crash when adding a source, when adding or changing an edit, transitions, or effect. They crash when exporting/rendering. Melt is the only one I've ever been able to actually accomplish something useful with. The really nice thing is that you can write a bash (or other) program to automate stuff. If all you want to do is concatenate a directory full of video clips with some intro, outro, and transitions, you can write a script that does that and then run it on as many different directories or lists of files as you want. You don't have to set up a new project and start from scratch every time. I never had Kdenlive to crash. I just couldn't figure out how to make it work. As you say, most docs are out of date or for old versions. I've seen that with Kicad too. I kind of dread upgrading to Kicad 6. I actually masked it here until the bugs get worked out and the docs catch up. Maybe one day either the docs will catch up or they will make it easy to figure out. Maybe. ;-) Dale :-) :-) Gotta reply here - kdelive crashes at the drop of a hat with the files I am using - very frustrating. But the interface is such a crap shoot I have given up on it - I'll try the other suggestions over the next few days so I am ready next time.. BillK
Re: [gentoo-user] Movie editing softeware
On 20/12/21 13:40, Andrew Lowe wrote: On 20/12/21 11:17 am, William Kenworthy wrote: Hi, what is a usable piece of software in portage to do a quick edit of a movie? (cut start/end and maybe splice a bit in/out of the middle?) BillK How easy should it be? Won't ffmpeg allow you to do this type of thing but you need to do a bit of work to get what you need - no nice GUI? Andrew I am using ffmeg now to reduce the video size. Its a Christmas message taken on a lumix camera that needs to be sent a few thousand km over what may be a flakey mobile link. I just wanted something I can play a video, click on a point and delete everything before that. Same at the end. Looking at kdelive its a stupidly complex program that has a steep learning curve to do the above. BillK
[gentoo-user] Movie editing softeware
Hi, what is a usable piece of software in portage to do a quick edit of a movie? (cut start/end and maybe splice a bit in/out of the middle?) BillK
[gentoo-user] OT: what keyboard is suitable for a touchscreen?
I have been using the onboard keyboard from an overlay for the touchscreen on my surface laptop, but it currently only supports python 3.8. What else is in portage or overlay that is worth trying? BillK
[gentoo-user] log4j
I was reading up on log4j and its recent problems and discovered
it can "hide" layers deep inside java jar files depending on how
its used.
I can see that dev-embedded/arduino includes log4j directly (and
does it embed log4j in code produced for IoT?):
rattus ~ # locate *.jar|grep 4j
/usr/share/arduino/lib/log4j-api-2.12.0.jar
/usr/share/arduino/lib/log4j-core-2.12.0.jar
/usr/share/arduino/lib/slf4j-api-1.7.22.jar
/usr/share/arduino/lib/slf4j-simple-1.7.22.jar
rattus ~ #
BUT there are a lot of other jar files on my systems which have
log4j embedded in it.
Sylf (not in portage that I can see) seems like it can build an
SBOM for a target (Software Bill of Materials) that could identify
deeply embedded log4j instances - has anyone used this on a gentoo
system (it looks like it needs to specifically target a distro) or
is there something easier/better? "strings|grep log4j" works on
the arduino jar files but that wont work on propriety encrytpted
jar files (such as propriety apps where it may likely be used).
And is doing just jar files enough?
BillK
** try something like 'find /opt /lib64 /usr/share -name *.jar
-print -exec strings {} \; |grep log4j'
Re: [gentoo-user] Local mail delivery agent (MDA) wanted
True - missed that! BillK On 13/12/21 17:36, Peter Humphrey wrote: On Sunday, 12 December 2021 23:36:33 GMT William Kenworthy wrote: I thought the gentoo default mail program is nullmailer? Changed from smtpd(? or something named similar) some time back. Simple, reasonably versatile and has easy configuration. That's a sending program, not receiving.
Re: [gentoo-user] Local mail delivery agent (MDA) wanted
I thought the gentoo default mail program is nullmailer? Changed from smtpd(? or something named similar) some time back. Simple, reasonably versatile and has easy configuration. BillK On 12/12/21 21:25, Frank Steinmetzger wrote: Hey list, I am looking for an as-simple-as-possible setup for local mail delivery. What I mean by that is: the mail shall go into /var/spool/mail locally, which is why I deem it overkill to set up and run a complicated smtpd daemon with its own config file language. At my previous employer we used mda on our Ubuntu-based machines, but this is not available in Gentoo. It did extactly what I am looking for: receive mail (most importantly from cron) via pipe and put it right into the spool file, so I can see a message upon login and read it with mutt. That’s all I need, so I can get summary reports of zfs snapshots, smartd messages and so on. I was looking through wiki articles, but they all employ the usual beasts postfix, courier and so on. Do you have any recommendations? Much obliged.
[gentoo-user] clean up a git sync'd portage
Hi all, are there any settings useful to reduce the size of a git sync'd portage? Its just hit 22Gb and the little arm system I use to maintain it is choking. I am doing a git clean -f and git gc --aggressive in the hope it reduces it some, but from reading I believe the real problem is years of history logs. Is there a way of a) setting depth=1 for portage and b) cleaning out the existing history? -- or something better? BillK
[gentoo-user] OT: BATMAN vs frr/ospf
Hi all, has anyone had experience using the batman-adv protocol and can comment on its use instead of ospf? The recommended "drop in" replacement for quagga/ospf based routing with the frr/ospf package has proven to be a less than stellar replacement in my case (not really frr's fault, but it is not identical to quagga and my requirements are complex) so I am looking to jump ship to batman. I am currently building kernels and vm's to test but I would appreciate comments from someone who has done this already. My networks include ~10-15 vlans that extend across (open)vpn tunnels and multiple wifi SSID's and have a number of potential looping scenarios that ospf manages. I use zeroconf (for homeassistant) and have lxc based instances using veth interfaces for services (asterisk, web, dns, ...). There is a moosefs data store on its own switch and two dedicated vlans. I have in excess of 30 devices on the network and ESP IoT devices are multiplying like rabbits (!) All non-esp or android phone systems use gentoo on arm32/arm64/intel, run shorewall, have multiple vlans via trunking or multiple interfaces in different vlans or in some cases up to 4 interfaces bonded for throughput. I am using d-link managed switches and a homebrew AP using hostapd in the 2.4 and 5g bands. Using quagga/ospf was mostly stable and just worked. While I could try tuning frr to work more reliably (worst problems are not staying converged, convergence time (which sometimes kills vm's via the moosefs data store disappearing off the network for minutes at a time), fighting frr's interference in ip forwarding across multiple interfaces and excessive overhead as it never seems to settle for long). I am thinking the effort might be better spent on batman - I am attracted to the supposedly fast convergence, minimal overhead and the potential of meshes (IoT) using the flat routing overlay it implements. Questions I have are: 1. easily works with shorewall 2. it actually does have fast and glitch free convergence 3. internetworking across a VPN based WAN with batman at either end 4. mesh hot spot control 5. any other gotchas? BillK
Re: [gentoo-user] Kernel upgrade breaks virtualbox
quickpg the existing modules then try the remove/reinstall fix. You can then use "emerge -K =package" or even a manually reinstall (by coping them over the newer ones) to replace the modules if things don't work out. I would think in your case needing to keep kernel specific modules around this would be an attractive task to script keeping matching modules with a kernel and swapping them in and out as necessary. BillK On 28/11/21 08:11, Wols Lists wrote: On 27/11/2021 22:15, Kees wrote: >The docu says "emerge @module-rebuild". >Both of these terminate with "nothing to rebuild". Strange. try: emerge virtualbox-modules That should be rebuild after everuy kernel upgrade and that happens normally with emerge @module-rebuild "nothing to rebuild" It always USED to work ... Cheers, Wol
Re: [gentoo-user] Why has genkernel initramfs changed behaviour!?
On 18/11/21 7:24 am, Jack wrote: > On 2021.11.17 18:15, Wol wrote: >> Just filed bug 824282. >> >> In the past, I've always done "make kernel, make kernel_modules, make >> install, make modules_install, genkernel initramfs ...". >> >> This worked fine, and I then ran grub-mkconfig, sorted out grub.cfg, >> and all was well. >> >> My new setup, I have a /boot WHICH I WANT TO SORT OUT MYSELF! I got >> thoroughly confused because genkernel was finding /boot in fstab, >> mounting it by default, and sticking the initramfs there. So of >> course, grub-mkconfig screwed up because the kernel was in the /boot >> directory, but the initramfs was in the /boot partition! >> >> So I told genkernel not to mount the boot partition ... >> >> WAH WAH WAH FATAL ERROR YOU WON'T LET ME MOUNT BOOT SULK SULK SULK. >> >> If I tell it not to mount boot then that's my lookout, not for >> genconfig to nanny me and sulk! >> >> >> And it gets worse. I've always done "make modules_install, genkernel >> initramfs". Which now seems to be an unsupported option. genkernel is >> now looking in /var/tmp/genkernel/... for the modules - no surprise >> the modules aren't there! The error says "did you forget to compile >> the kernel" - no I didn't - it is compiled, the modules are >> installed, I just didn't use genkernel to do it. >> >> Why oh why does everything change ... for the worse ... now let's see >> if allowing it to mount the boot partition makes it work properly ... >> >> and allowing it to mount boot made everything work perfectly afaict >> ... what a mess ... >> >> Cheers, >> Wol > I have no problem telling genkernel not to mount ./boot, but then I > always have /boot mounted, so I suppose it might not complain only > because it's set up the way it wants it anyway. > > I also use genkernel to compile the kernel and modules, but I do "make > xconfig" to set my own choice of options, and tell genkernel to skip > any of that configuring. I've had no problems with doing it that > way. if you want, I can send you a copy of my genkernel.conf. I > launch it with "genkernel --no-gpg --lvm --firmware --microcode > --kernel-append-localversion=$1 all | tee genkern.log 2>&1" so I can > have multiple versions of the same kernel version (usually because I > want to test some different setting, but don't want the original to be > overwritten in case the new version doesn't work or just doesn't do > what I want. > > Jack > I agree something is amiss in the current genkernel. I have a raspberry pi with a number of OS variants in separate partitions that I maintain via chroot's ... genkernel somehow mounted /boot into the chroot properly clobbering things there by putting a 32bit kernel in /boot for the 64bit OS ... BillK
Re: [gentoo-user] Suggestions for NAS appliance?
On 14/11/21 12:52 am, Rich Freeman wrote: > On Sat, Nov 13, 2021 at 12:35 AM William Kenworthy wrote: >> Look at the odroid HC4 - I am using 5x the older HC2 version for moosefs >> - they are USB3 based but work well in this application. They are arm32 >> but 64bit is not needed. > I like the idea behind the HC series Odroids, but being limited to 1-2 > drives per node seems a bit contraining. With the USB3 approach there > really is no limit to how many drives I can put on a node, as long as > I don't mind the performance drop. I'm more concerned with static > storage capacity in this case. If you're using 1Gbps ethernet then I > guess two drives is already going to saturate the network if they're > able to read sequentially. > The HC2 works fine with a USB3 disk added to an existing sata drive (I was doing that for awhile using SATA->USB3 adaptors) - however it looks like the HC4 has dropped USB3 and only USB2 is available - backward step in my view. BillK
Re: [gentoo-user] Suggestions for NAS appliance?
On 13/11/21 5:56 am, Rich Freeman wrote: > On Wed, Nov 10, 2021 at 11:06 PM Mark Knecht wrote: >> >> Not a recommendation precisely but there's a guy on YouTube named Jeff >> Geerling that's doing a lot of that sort of thing using a Raspberry Pi and >> multiple SATA drives. I've just built my first RP4 box aimed at >> astrophotography and I'm pretty impressed with how well the Pi works. My >> next project will likely be some sort of NAS box using a second Pi4 with an >> M.2 system drive. >> > I run LizardFS and at this point Pi4s are my preferred hardware for > storage nodes. However, I don't deal with much IOPS. I tend to use > USB3 hard drives for convenience/cost. Really though SATA on a Pi4 > wouldn't be super-ideal anyway due to the lack of PCIe (I think it > lacks it at least). You can find ARM SBCs that have PCIe capable of > handling an HBA which are probably better if you want a bunch of SATA > drives, though those have their downsides. If you're serious about > IOPS I'm not sure anything cheap will do the trick. Look at the odroid HC4 - I am using 5x the older HC2 version for moosefs - they are USB3 based but work well in this application. They are arm32 but 64bit is not needed. > I would definitely avoid Pi2/3 for this due to the combo of 100MBps > networking and USB2 and a lot of the IO goes through USB2 in the first > place. It is just not a very good setup for IO at all, and there are > much better alternatives. The Pi4 though is pretty solid as long as > you don't mind USB3 (and it has two hosts so you can basically run 4 > spinning disks all-out without a performance hit until you get to the > network at least). I have a pi3B - bad idea to use this for any DFS - I tried... I am using an Odroid C4 for directly connected USB3 disks - works well. > Gigabit network is its own bottleneck for any kind of storage. I'm > too cheap to try to use anything better, but anybody doing serious DFS > is going to want 10Gbps, or often dual 10Gbps.
Re: [gentoo-user] Ethernet card for puter
In reality, today there seems to be little to choose from between ethernet cards for the average user - wasn't always the case though. I have a number of usb-<->ethernet plugins and pcicards. Some are bonded (mix of usb and pci) and are mostly realtek though there is an intel or two. I am using a usb2->ethernet to the fibre based internet (1Gb AU NBN) without any speed problems. Note there is a linux kernel driver bug in an odd combination of realtek and usb2 for some versions which cuts throughput by ~1/3 unless patched - the dongles themselves are fine. Currently, with the covid supply chain issues its more a problem just getting "something" :) BillK 1000/50 over usb2 realtek ~17.44pm - at other times its usually a little better. moriah ~ # speedtest Retrieving speedtest.net configuration... Testing from iiNet Limited (nnn.nnn.nnn.nnn)... Retrieving speedtest.net server list... Selecting best server based on ping... Hosted by Internode (Perth) [1.07 km]: 2.796 ms Testing download speed Download: 929.99 Mbit/s Testing upload speed.. Upload: 45.82 Mbit/s moriah ~ # On 6/11/21 4:13 pm, Frank Steinmetzger wrote: > Am Fri, Nov 05, 2021 at 08:03:32PM -0500 schrieb Dale: >> Manuel McLure wrote: >>> I highly recommend getting an Intel card. Back in the day the e1000 >>> cards were the ones to get, >>> nowadays https://www.newegg.com/intel-expi9301ctblk/p/N82E16833106033 >>> should be a good option for a single port card. Intel cards have been >>> well supported in Linux for a long time. > I have no idea how you came across that one first. Network cards are a > commodity and start in the single-Euro (so probably also dollar) range these > days. Intel cards start in the 20–30 range: > https://geizhals.eu/?cat=nwpcie=p=14063_Intel%7E14065_LAN-Adapter%7E14066_PCIe-Karte > >> I was looking at the mobo manual and noticed the built in network port >> is a 1Gb chip as well. It is a Realtec and the last time I tried to use >> it, it was a bit flakey. Sometimes it would work but sometimes I'd have >> to restart the network to get it going again. That was about a decade >> ago. > My PC is over 7 years old now and I’ve always been unsing its internal > ethernet port. Most consumer boards use Realtek chips, and so does mine, > because they are a little cheaper than Intel’s counterparts. Enthusiasts and > power users like Intel more because it does more in hardware and offers more > features, whereas the realtek driver puts some load on the CPU, AFAIK. But > in my view, that is counting crumbs, as we say in Germany. I’ve never had > bandwidth problems and always had the full 1 Gb to my NAS. For us normal > home user folk, it won’t make a difference, IMHO. (Except if you are a > purist and care about code quality; I think there were niggles with > Realtek’s code a longer while back.) > >> I wonder, is the drivers better today than they were then? I would have >> used it all this time if it worked well. Anyone have experience with this >> in the last year or so that is showing it working really well and stable? >> Keep in mind, I run 24/7 here. If that works fine, I could just use it. >> lspci shows this for the on board network: >> >> Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit >> Ethernet Controller (rev 06) > That’s the one veryone uses. I actually have two of those installed; one > one-board, the other one as a PCIe card that I got from my old employer. > >> I have 2 PCIex1 and one PCIex 4 slots open. The small ones are close to >> my video card and I'm not sure I can use them. > Sure you can. Are you a hardcore gamer? Does your card consume 100s of W all > the time? Usually the GPU is the top-most card except for cases that hold > the board upside-down (meaning hot air rises away). > >> Can I plug these types of cards into the larger slots? > Yes. Speeds are downward-compatible. One PCIe 2.0 lane is fast enough for 1 > Gb. > >> I think I read once that can be done. It's been ages tho. My old network >> card appears to be in a old PCI plain slot. It's a really old card, works >> faithfully tho. > If you change the filter in the link I gave you at the top, you can also > look for PCI-based cards (unselect PCIe first). It’s possible that PCIe, > though a faster interface, may be more frugal these days. When PCI was > invented, power saving was not an issue. > >> This may require some rearranging. Or using the on board network one. >> I'd really prefer the card tho. They just tend to work better. > Why should they? A hunch? The only real benefit is you can easliy swap them > in case of failure. But as long as you have it and it works – why not give > it a try with what you have before you spend more for something you may not > even need? >
Re: [gentoo-user] Package management, depclean and new installs
On 4/10/21 11:30 am, coa...@tuta.io wrote: > Hi y'all new confused user regarding package management > > How do you guys manage and protect your packages? > Do you just put everything on world and end up with a huge world file? > Do you have basic system files on world and the rest you protect or omit? > Do you create new(personalised) files depending on category and > somehow link them in any of the above 3? > > It's just emerging everything you are not sure you will keep with -1 > seems cumbersome to me especially if at some point I want to transfer > to a new device and want to copy my settings over ,select what to keep > and discard the rest,depcleaning with pretend all the time seems > annoying on the long term as well so there should be lots of different > solutions from different people(at least thats what I think) > > I just think this is one of the things its better I learn now rather > than later and forum or wiki info is too "on-point" on a specific > situation so I thought I'd ask the userbase Apps I am trying out or wont keep for long, install with -1 Apps I want, install without -1 Updates - always use -1 and after a successful update is complete run emerge --depclean -p and make sure whats being removed is really correct then remove the -p. Occasionally go through "/var/lib/portage/world" and turf things you no longer need or don't know the use of, then run emerge --depclean -p and make sure whats being removed is really correct then remove the -p. BillK
