Re: [gentoo-user] Re: btrfs and gcc 4.9
Am 13.11.2014 um 19:12 schrieb Stefan G. Weichinger: emerge -e @system went through fine completely ... but my @world is a different thing. Some gnome-related stuff does not compile yet, additionally complicated by the fact that I run the very unstable packages from the gnome-overlay, bringing gnome 3.14. This runs fine on my main installation (and on a thinkpad as well, btw). But gcc-4.9 might be a bit too early ;-) Up and running with gnome 3.14 as well. Snappy performance so far. Only a few packages left to care about. Nice.
Re: [gentoo-user] difficulties with lvm2+systemd+grub2
Am 12.11.2014 um 10:47 schrieb Michael Mair-Keimberger: Dracut was already mentioned. I'll give it a try later that day. Regarding your rd.lvm.vg= flag. I guess should be put into the grub2 entry, shouldn't it? Yes, in the same line where you add the init= parameter. You might add it to your /etc/default/grub file, into GRUB_CMDLINE_LINUX=
Re: [gentoo-user] difficulties with lvm2+systemd+grub2
Am 12.11.2014 um 11:07 schrieb Sam Jorna: On Wed, Nov 12, 2014 at 10:42:28AM +0100, Michael Mair-Keimberger wrote: On Wed, Nov 12, 2014 at 12:03:04PM +1100, wra...@wraeth.id.au wrote: On Tue, Nov 11, 2014 at 09:56:09PM +0100, Michael Mair-Keimberger wrote: snip systemd. Maybe i could adopt that to my custom one as well. /snip Working examples are always nice :-) Around dracut and grub2 I remember a few bits, maybe they help. In /etc/dracut.conf I have (after discussion here): # dracut modules to omit omit_dracutmodules+=systemd (this one means don't build an instance of systemd *into* the initrd) # dracut modules to add to the default add_dracutmodules+=bash # build initrd only to boot current hardware hostonly=yes hostonly_cmdline=yes I don't use lvm and sw-raid anymore, you might need: add_dracutmodules+=lvm bash mdraid or so.
Re: [gentoo-user] difficulties with lvm2+systemd+grub2
Am 11.11.2014 um 21:56 schrieb Michael Mair-Keimberger: Don't get confused about the lvm flag. This just get passed to my very simple custom initramfs Why not try dracut for creating your initrd? I spent *lots* of time around lvm/mdadm with systemd and grub2 back then ... What does your own initramfs do that dracut won't do? - Aside from that: We don't see your kernel-config. Did you check for the requirements systemd has and recompile your kernel accordingly? Does your new menuentry boot without the init= part? - Just some generic thoughts, nothing specific, sorry. Stefan
Re: [gentoo-user] Re: btrfs and gcc 4.9
Am 08.11.2014 um 23:17 schrieb James: I'm trying to keep it as simple as possible (the old boot root swap type of approach for btrfs is all I'm after for now. (simple). I have several system to experiment on, so once I get it figured out, I'll try a more agressive set up. For now it's everything under /root/ with subvolumes created under /root partition ? /usr/local/ is the only thing I do special. The /home dir is just me. So I'm trying to keep this simple and get it working on 3 old boxes.. General rule(s) for subvolumes as I learned them: * create them if you want to separate things logically * use them if you want to use specific settings/parameters for specific directories/subvols: for example compression, quotas ... * use them if you want to use snapshots. A (btrfs-)snapshot is always based on a subvolume so if you want to create snapshots for particular areas you have to set them up as subvolumes in advance. Splitting it into /boot, /, /home and maybe /distfiles (no compression here ... ?) is a usual approach. Keeping it as simple as possible in the start is a good idea. You can always add subvols later ... and move things over ... As I see the howto and the steps about booting: http://wiki.gentoo.org/wiki/Btrfs_native_system_root#Embedding_an_initram_filesystem I didn't do it that way but used dracut for the initrd ... the ml-archives have some threads around learning this (combined with systemd and LVM stuff back then I spent quite some time ...). Canek's tool kerninst also helps here: https://github.com/canek-pelaez/kerninst
Re: [gentoo-user] gcc 4.7.3 -- 4.8.3
Am 07.11.2014 um 19:19 schrieb Mark Pariente: Going to 4.9 though is another thing. Apparently they broke the ABI for the standard C++ library, so once you start compiling C++ stuff with 4.9 you better go all in (I did @system @world with 4.9 and had very few things that failed to compile[1], it's looking pretty good already). --Mark [1] https://bugs.gentoo.org/show_bug.cgi?id=526140 I give that a try ... as I set up a fresh new btrfs-subvolume to do a fresh new build based on my @world only yesterday I will see if I can do it with gcc 4.9 while I am at it. Let's see if things work out and if it gets any better ;-)
Re: [gentoo-user] btrfs and gcc 4.9
Am 08.11.2014 um 21:27 schrieb James: If you would be so cool as to post your subvolume setup; I'd be very grateful: [..] I guess what really has me confused is to set up a traditional fstab, uuid, efi, with grub2. I'm just dense I guess because the aforementioned doc, I think derived from some of Duncan's postings just does not click for me. I've botched a few runs at btrfs (raid1) one on fresh gentoo installs, just so you know Starting with filesystems like zfs or btrfs means learning new concepts, yes. You talk of subvolumes but show partitioning ... right? OK, what do I have here? A bit easier as I don't run rootfs on a raid on my main box. I use btrfs-pools with redundancy as well but not in this case. The SSD here is partitioned like this: Found valid GPT with protective MBR; using GPT. Disk /dev/sda: 488397168 sectors, 232.9 GiB Logical sector size: 512 bytes Disk identifier (GUID): 32048E18-BD83-4873-96CF-48D04B8739E6 Partition table holds up to 128 entries First usable sector is 34, last usable sector is 488397134 Partitions will be aligned on 2048-sector boundaries Total free space is 2349 sectors (1.1 MiB) Number Start (sector)End (sector) Size Code Name 12048 194559 94.0 MiBEF00 ESI 2 194560 480585727 229.1 GiB 8300 Linux filesystem 3 480585728 488396799 3.7 GiB 8200 (partition 3 is just some slice left over afaik) - /dev/sda2 went into one of the btrfs pools here: # btrfs fi show Label: 'btrfs_evo' uuid: 741835e6-95a3-49f3-ba85-2ffe3ea0730d Total devices 1 FS bytes used 58.28GiB devid1 size 229.07GiB used 63.02GiB path /dev/sda2 - And from here you can start to create and use btrfs-subvolumes. I currently have the following subvolumes in this pool: # btrfs su list / ID 256 gen 56 top level 5 path __active ID 257 gen 2223 top level 256 path __active/root ID 275 gen 2224 top level 256 path __active/root_rasa ID 281 gen 2223 top level 256 path __active/home ID 312 gen 851 top level 256 path __active/oopsfiles And then I use them and mount them via /etc/fstab # grep 741835e6-95a3-49f3-ba85-2ffe3ea0730d /etc/fstab UUID=741835e6-95a3-49f3-ba85-2ffe3ea0730d /mnt/btrfs_pool1btrfs noauto,noatime,compress=lzo,subvolid=5 0 0 UUID=741835e6-95a3-49f3-ba85-2ffe3ea0730d / btrfs defaults,noatime,compress=lzo,subvolid=257 0 0 UUID=741835e6-95a3-49f3-ba85-2ffe3ea0730d /home btrfs defaults,noatime,compress=lzo,subvolid=281 0 0 UUID=741835e6-95a3-49f3-ba85-2ffe3ea0730d /home/sgw/oopsfiles btrfs defaults,noatime,compress=lzo,subvolid=312 0 0 UUID=741835e6-95a3-49f3-ba85-2ffe3ea0730d /mnt/root_rasa btrfs x-systemd.automount,noatime,compress=lzo,subvolid=275 0 0 A special note here for mountpoint /mnt/btrfs_pool1: with subvolid 5 I get access to the root or top of this btrfs pool: in this mountpoint you can access all the subvolumes like in a directory tree. I mount it noauto ... I sometimes use this to modify things or work with snapshots. - If you set up your btrfs pool with raid1 redundancy this doesn't make any difference from there. Create subvolumes and mount them where you need them. - Does this help in any way? Did you create your pool already? There are lots of things to say here, please let us know where we can help, learn and share ;-) Stefan
Re: [gentoo-user] btrfs and gcc 4.9
Am 08.11.2014 um 22:07 schrieb Stefan G. Weichinger: Number Start (sector)End (sector) Size Code Name 12048 194559 94.0 MiBEF00 ESI 2 194560 480585727 229.1 GiB 8300 Linux filesystem 3 480585728 488396799 3.7 GiB 8200 (partition 3 is just some slice left over afaik) correction: it is swap more than enough with 16 GB RAM ... ;-)
Re: [gentoo-user] kernel 3.17.0
What do they do for us lucky chaps? ;-) On October 18, 2014 1:33:18 PM GMT+02:00, Alan McKinnon alan.mckin...@gmail.com wrote: On 18/10/2014 06:17, Philip Webb wrote: I just installed Kernel 3.17.0 (gentoo-sources) noticed there are specific options for Gentoo right at the beginning. Are we really privileged to have our own place in kernel-land or have these been added by the Gentoo devs ? The latter. They've also been there for a rather long time already, perhaps as much as a year :-) -- Alan McKinnon alan.mckin...@gmail.com -- Diese Nachricht wurde von meinem Android-Mobiltelefon mit K-9 Mail gesendet.
Re: [gentoo-user] [OT] Linus Torvalds on systemd
Am 17.09.2014 um 18:06 schrieb Canek Peláez Valdés: This is highly off-topic, and systemd-related, so if you don't want your breakfast with a healthy amount of flames, skip it. iTWire posted an interview with Linus Torvalds[1], where the Big Penguin himself gave a succinct and pretty fair opinion on systemd. The gist of it can be resumed in two lines: I don't personally mind systemd, and in fact my main desktop and laptop both run it. I post it here because several times in the last discussions about systemd, there was people asking what opinion Linus had about systemd. I personally don't think Linus particular opinion matters at all in this particular issue; in general people who likes systemd will continue to like it, and people who despises it will continue to do so, for any good, bad, real or imaginary reason. However, I *really* like several things Linus says in the interview; some juicy bits: • So I think many of the original ideals of UNIX are these days more of a mindset issue than necessarily reflecting reality of the situation. • There's still value in understanding the traditional UNIX do one thing and do it well model where many workflows can be done as a pipeline of simple tools each adding their own value, but let's face it, it's not how complex systems really work, and it's not how major applications have been working or been designed for a long time. It's a useful simplification, and it's still true at *some* level, but I think it's also clear that it doesn't really describe most of reality. • ...systemd is in no way the piece that breaks with old UNIX legacy. • I'm still old-fashioned enough that I like my log-files in text, not binary, so I think sometimes systemd hasn't necessarily had the best of taste, but hey, details..[.] • (About the single-point-of-failure argument) I think people are digging for excuses. I mean, if that is a reason to not use a piece of software, then you shouldn't use the kernel either. • And there's a classic term for it in the BSD camps: bikeshed painting, which is very much about how random people can feel like they have the ability to discuss superficial issues, because everybody feels that they can give an opinion on the color choice. So issues that are superficial get a lot more noise. Then when it comes to actual hard and deep technical decisions, people (sometimes) realise that they just don't know enough, and they won't give that the same kind of mouth-time. It's an interesting read; I highly recommend it. [1] http://www.itwire.com/business-it-news/open-source/65402-torvalds-says-he-has-no-strong-opinions-on-systemd thanks for the pointer ;-) S
Re: [gentoo-user] {OT} Intel NUC install -- no display on OLED TV
Am 05.09.2014 um 22:07 schrieb Daniel Frey: Going off topic a bit, but I recently bought a DN2820FYKH (Celeron model) and it works beautifully with mythtv. Compiling is a litter slower due to the processor, but it works well with its built-in IR. Very happy with it. I have everything working including HDMI audio passthrough. Best ~$250 I spent to date (NUC, RAM, SSD.) ... I am right now ordering the i3-version ... 4 GB RAM will be enough for a start. Bear in mind that HDMI audio passthrough doesn't work when booting in legacy mode, you have to boot with native EFI. Had no issues with grub2. Yes, thanks, I heard about that already. It's for debian, but seems to list some general know-how for NUCs and mythtv: https://docs.google.com/document/d/1alWSZZ8tLYe4I-lmdrsAGT67xV77q4F4jivGeEzIklk/edit# I also found out (the hard way) that kernel =3.14 are required for the Intel video support. Thanks, will consider that. Even 3.14.14 is stable in portage right now, I wouldn't have started any lower. I will install gentoo stable ... btw, how did you start installing? Some rescue-disk on a stick? PXE? (I should fix my PXE-setup ...) Stefan
Re: [gentoo-user] {OT} Intel NUC install -- no display on OLED TV
Am 06.09.2014 um 11:21 schrieb Stefan G. Weichinger: I will install gentoo stable ... btw, how did you start installing? Some rescue-disk on a stick? PXE? (I should fix my PXE-setup ...) Second thought: I could clone of my thinkpad-SSDs and start with that. Should boot ... depends if some special modules are needed. I use EFI on the X220 so that should help me getting up and running.
Re: [gentoo-user] {OT} Intel NUC install -- no display on OLED TV
Am 05.09.2014 um 16:51 schrieb Grant: I have a Gigabyte 2807 (technically not a NUC but basically the same thing) and nothing appears on the screen at all when it is connected to a 55 OLED TV via HDMI. Just a no signal message. I was planning to install Gentoo via a bootable USB stick but I don't even get a POST screen. http://www.newegg.com/Product/Product.aspx?Item=N82E16856164017 Any ideas? I've gotten my Pandaboard to display 640x480 on the TV. Maybe the TV can only display 640x480 and 1920x1080? Maybe I need to buy a computer monitor for installation? I read about outdated BIOS-versions and the need/fix to connect something via DisplayPort and enter BIOS once ... to reset things or something. I don't have such a box ... just echoing something I read (as I play with the thought to buy a Intel NUC-Kit D34010WYK for use as a mythtv-frontend). As your issue isn't gentoo-specific afaik I would recommend browsing Gigabyte support forums or docs ... ? Stefan
Re: [gentoo-user] Gnome, pam_mount, keyrings ...
Am 06.08.2014 um 15:18 schrieb Neil Bothwick: On Wed, 6 Aug 2014 13:30:44 +0100, Mick wrote: In any case 'cryptsetup -y luksAddKey /dev/sdaX' allows you to add a passphrase in another slot - can't recall how many passphrase slots are there without looking into it. 8. You can see which are in use with cryptsetup luksDump. I was successful at adding and using a second or third passphrase. But logging into gdm didn't use the new passphrase and I don't exactly know where to put that information. Gnome keyring? Stefan
Re: [gentoo-user] Gnome, pam_mount, keyrings ...
Am 01.08.2014 um 11:38 schrieb Stefan G. Weichinger: Greetings, could someone pls point me at how to solve this in the right way - I run gnome3, with gnome-keyring, seahorse, systemd-ui brings systemd-gnome-ask-password-agent (do I need that?) and I use pam_mount to unlock and mount my encrypted home-dir (thinkpad). As it happens I use a rather weak password (you know, you set something up for testing and then it gets productive ...) ... which I would like to change. So I have to add/edit the LUKS-keyphrase for the LUKS-device and additionally edit my password via plain passwd, right? And there is the gnome keyring, which I can edit via seahorse, right? What exactly to edit in there? I tried that for several times and never managed to change it all in the proper way so that logging in to gdm unlocks pam_mount as well ... I always ended up with a mismatch ... Could someone point out how to do this? *bump* ;-)
[gentoo-user] Gnome, pam_mount, keyrings ...
Greetings, could someone pls point me at how to solve this in the right way - I run gnome3, with gnome-keyring, seahorse, systemd-ui brings systemd-gnome-ask-password-agent (do I need that?) and I use pam_mount to unlock and mount my encrypted home-dir (thinkpad). As it happens I use a rather weak password (you know, you set something up for testing and then it gets productive ...) ... which I would like to change. So I have to add/edit the LUKS-keyphrase for the LUKS-device and additionally edit my password via plain passwd, right? And there is the gnome keyring, which I can edit via seahorse, right? What exactly to edit in there? I tried that for several times and never managed to change it all in the proper way so that logging in to gdm unlocks pam_mount as well ... I always ended up with a mismatch ... Could someone point out how to do this? Thanks a lot, Stefan!
Re: [gentoo-user] re: which NTPd package to use?
Am 28.07.2014 18:47, schrieb Rich Freeman: Anybody have a decent comparison of timedated vs ntpd or anything else for that matter? Running ntpd isn't hard at all, so I'm not really sure why I'd want to switch. At the very least I'd want to ensure that the replacement covers the basics. I am running networkd and I'm very happy with it. Setting it up for dhcp-only is brain-dead simple, and I have it serving up a bridge for containers/kvm with fairly little trouble as well. AFAI understand it the systemd-timedated.service helps setting clock and time-related settings ... and if you use it to enable NTP syncing, systemd-timesyncd.service will actually take over the part of syncing with ntp servers. I also preferred chrony over ntp for the last year or so. Better with laptops etc. and quicker to correct time when there is large offset. What I haven't yet fully understood: daemons like chrony bring a specific settings file for systemd-environments, in this case: /usr/lib/systemd/ntp-units.d/50-chrony.list (saying chronyd.service) In the same directory I see 90-systemd.list (saying systemd-timesyncd.service). As far as I understand this: if other ntp-software is installed, systemd-timedated.service uses the ntp-unit with higher priority (in my current case chronyd.service) for ntp-syncing. So you may use the systemd-timedated.service to do your settings and in the same setup let it use another ntp-daemon to actually do the syncing behind the curtains. Generalized interface with choice --- nice, isn't it? ;-) but maybe I misunderstand. Stefan
Re: [gentoo-user] re: which NTPd package to use?
Am 28.07.2014 23:20, schrieb Stefan G. Weichinger: I am running networkd and I'm very happy with it. Setting it up for dhcp-only is brain-dead simple, and I have it serving up a bridge for containers/kvm with fairly little trouble as well. shameless pointer to an older blog entry: http://www.oops.co.at/en/publications/systemd-networkd-network-configuration-for-a-kvm-server S
Re: [gentoo-user] re: which NTPd package to use?
Am 28.07.2014 23:20, schrieb Stefan G. Weichinger: As far as I understand this: if other ntp-software is installed, systemd-timedated.service uses the ntp-unit with higher priority (in my current case chronyd.service) for ntp-syncing. So you may use the systemd-timedated.service to do your settings and in the same setup let it use another ntp-daemon to actually do the syncing behind the curtains. My tests show: If I manually disable chronyd.service and then do timedatectl set-ntp yes this enables and starts chronyd.service (in my case the higher priority ntp.unit as mentioned before). I might additionally emerge net-misc/ntp and see what happens - this adds /usr/lib/systemd/ntp-units.d/60-ntpd.list with ntpd.service inside ... so this would trigger ntpd.service if chrony would not be installed? And there is still /etc/systemd/ntp-units.d/ where you can override the given priorities (if more than one ntp-capable package is installed). - I am quite happy with systemd controlling and using chrony here ... just interesting how things are implemented here. enough for today: 0:20am here, ntp-synced. Stefan
Re: [gentoo-user] wayland
Am 25.07.2014 06:32, schrieb Pavel Volkov: On Tuesday, July 22, 2014 1:40:36 AM MSK, James wrote: Bloatware like gnome and KDE will be the last to get QT5, Wayland and a myriad of new, super_fast, secure desktop toys, imho. Well, KDE is already on Qt 5. Strictly speaking, there's no KDE or KDE SC anymore. There are 3 separate projects: - KDE Frameworks 5 (released already) - KDE Plasma 5 (released too) - KDE Applications 5 (this or is not yet released) Qt 4 apps will still be able to work with Frameworks 5 and Plasma 5. As for Wayland, we should not worry about KDE or GNOME not supporting it but rather about nvidia or amd video driver. Nouveau is still slow and I doubt it'll show decent perfomance in near future. thanks all. I still don't understand if Gnome 3.12 should work now with current wayland/weston or not. At least I get this when testing: Jul 27 14:38:28 goto gnome-session[22840]: gnome-session[22840]: WARNING: Unable to find required component 'gnome-shell-wayland' Recompiling gnome-session doesn't help and that file(?) isn't anywhere. I only get a blinking cursor when I log into gdm with gnome on wayland S
Re: [gentoo-user] NFS tutorial for the brain dead sysadmin?
Am 26.07.2014 04:47, schrieb walt: So, why did the broken machine work normally for more than a year without rpcbind until two days ago? (I suppose because nfs-utils was updated to 1.3.0 ?) The real problem here is that I have no idea how NFS works, and each new version is more complicated because the devs are solving problems that I don't understand or even know about. I double your search for understanding ... my various efforts to set up NFSv4 for sharing stuff in my LAN also lead to unstable behavior and frustration. Only last week I re-attacked this topic as I start using puppet here to manage my systems ... and one part of this might be sharing /usr/portage via NFSv4. One client host mounts it without a problem, the thinkpads don't do so ... just another example ;-) Additional in my context: using systemd ... so there are other (different?) dependencies at work and services started. I'd be happy to get that working in a reliable way. I don't remember unstable behavior with NFS (v2 back then?) when we used it at a company I worked for in the 90s. Stefan
Re: [gentoo-user] NFS tutorial for the brain dead sysadmin?
Am 27.07.2014 18:25, schrieb Stefan G. Weichinger: Only last week I re-attacked this topic as I start using puppet here to manage my systems ... and one part of this might be sharing /usr/portage via NFSv4. One client host mounts it without a problem, the thinkpads don't do so ... just another example ;-) As so often ... my fault: thinkpads did have NFSv4 in the kernel, but no nfs-utils installed ... ;-) sorry, S
Re: [gentoo-user] Re: wayland
Am 21.07.2014 15:54, schrieb James: Stefan G. Weichinger lists at xunil.at writes: Anyone playing with wayland already? Not yet. Closely related, is the QT5 approach to start experimenting. Maybe even using it as daily driver ? I did some steps to compile and use it on my systems ... so far I wasn't able to start up gnome 3.12 (~ gnome-shell) with gdm here. Is it possible already? This might help [1] Stefan [1] http://qt-project.org/wiki/QtWayland hmm, thanks ... I am not sure how to apply this ;-) You suggest that by running QtWayland I might be able to run gnome with wayland? S
[gentoo-user] wayland
Anyone playing with wayland already? Maybe even using it as daily driver ? I did some steps to compile and use it on my systems ... so far I wasn't able to start up gnome 3.12 (~ gnome-shell) with gdm here. Is it possible already? Stefan
Re: [gentoo-user] btrfs: subvol without compression
Am 20.06.2014 12:07, schrieb Marc Joliet: From my own google search, at least up to 2011 per-subvolume compression settings were not possible. Then, after subsequently searching on the btrfs wiki for a while, I finally found an answer: no. See this FAQ entry: https://btrfs.wiki.kernel.org/index.php/FAQ#Can_I_mount_subvolumes_with_different_mount_options.3F [...] This seems to be the same for the option nodatacow. I wanted to test this with VM-images in a separate subvolume, and with this script: https://github.com/stsquad/scripts/blob/master/uncow.py It was mentioned here: https://btrfs.wiki.kernel.org/index.php/FAQ#Can_copy-on-write_be_turned_off_for_data_blocks.3F Does somebody already have experience with turning off COW for specific files like VM images? I would like to take 2 demo VMs with me on my thinkpad, and there I don't have that much flexibility to add another hdd w/ ext4 or something. As far as I have seen so far, for demoing the performance isn't too bad anyway. Stefan
Re: [gentoo-user] ssh rekeying slow ?
Am 26.06.2014 06:07, schrieb Dale: I ran into a issue like this once a long time ago. I had something wrong with my hosts file if I recall correctly. It never did make sense as to how it messed things up but after fixing that, it worked fine. So, I'd look at the hosts file and see if anything is amiss there. I'm pretty sure that is the file that was messed up tho. Hope that helps. thanks for the suggestion. I don't see anything strange in the hosts file(s). For now I keep pam_systemd commented out. Maybe I upgrade to systemd 214 on that server ... ssh-ing to my main workstation works fine with that line in /etc/pam.d/system-auth ... so maybe it's related to the release of systemd. Stefan
Re: [gentoo-user] ssh rekeying slow ?
Am 26.06.2014 12:54, schrieb Alan McKinnon: Is your delay about 30 seconds? hmm, I think it was shorter ... but around that, yes. If so, that's almost certain to be related to dns lookups (30 seconds being the magic timeout that almost everything seems to use) Which hosts might it be then? The one on the server I want to reach? reverse-lookup for the contacting clients IP? I already activated: UseDNS no S
[gentoo-user] ssh rekeying slow ?
When I ssh into a server in my basement, this takes way more time than usual. I don't have a clue what might have changed ... aside from usual updating. I rebuilt and restarted openssh down there without a change. This is a bit annoying when logging in and using git to pull/push stuff from/to there. Does anyone have an idea what I could do to fix that? Stefan demo - $ ssh -v root@mythtv OpenSSH_6.6.1, OpenSSL 1.0.1h 5 Jun 2014 debug1: Reading configuration data /home/sgw/.ssh/config debug1: /home/sgw/.ssh/config line 33: Applying options for mythtv debug1: Reading configuration data /etc/ssh/ssh_config debug1: Connecting to mythtv [2001:15c0:65ff:8742:219:99ff:fee8:2343] port 22. debug1: fd 3 clearing O_NONBLOCK debug1: Connection established. debug1: identity file /home/sgw/.ssh/id_rsa type 1 debug1: identity file /home/sgw/.ssh/id_rsa-cert type -1 debug1: identity file /home/sgw/.ssh/id_dsa type -1 debug1: identity file /home/sgw/.ssh/id_dsa-cert type -1 debug1: identity file /home/sgw/.ssh/id_ecdsa type -1 debug1: identity file /home/sgw/.ssh/id_ecdsa-cert type -1 debug1: identity file /home/sgw/.ssh/id_ed25519 type -1 debug1: identity file /home/sgw/.ssh/id_ed25519-cert type -1 debug1: Enabling compatibility mode for protocol 2.0 debug1: Local version string SSH-2.0-OpenSSH_6.6.1p1-hpn14v4 debug1: Remote protocol version 2.0, remote software version OpenSSH_6.6p1-hpn14v4 debug1: match: OpenSSH_6.6p1-hpn14v4 pat OpenSSH_6.5*,OpenSSH_6.6* compat 0x1400 debug1: SSH2_MSG_KEXINIT sent debug1: SSH2_MSG_KEXINIT received debug1: AUTH STATE IS 0 debug1: REQUESTED ENC.NAME is 'aes128-ctr' debug1: kex: server-client aes128-ctr hmac-md5-...@openssh.com none debug1: REQUESTED ENC.NAME is 'aes128-ctr' debug1: kex: client-server aes128-ctr hmac-md5-...@openssh.com none debug1: sending SSH2_MSG_KEX_ECDH_INIT debug1: expecting SSH2_MSG_KEX_ECDH_REPLY debug1: Server host key: ECDSA 07:f3:16:2b:e9:64:87:fa:df:14:70:dc:03:60:5a:3c debug1: Host 'mythtv' is known and matches the ECDSA host key. debug1: Found key in /home/sgw/.ssh/known_hosts:168 debug1: ssh_ecdsa_verify: signature correct debug1: SSH2_MSG_NEWKEYS sent debug1: expecting SSH2_MSG_NEWKEYS debug1: SSH2_MSG_NEWKEYS received debug1: Roaming not allowed by server debug1: SSH2_MSG_SERVICE_REQUEST sent debug1: SSH2_MSG_SERVICE_ACCEPT received debug1: Authentications that can continue: publickey,keyboard-interactive debug1: Next authentication method: publickey debug1: Offering RSA public key: /home/sgw/.ssh/id_rsa debug1: Server accepts key: pkalg ssh-rsa blen 277 debug1: Single to Multithread CTR cipher swap - client request debug1: Authentication succeeded (publickey). Authenticated to mythtv ([2001:15c0:65ff:8742:219:99ff:fee8:2343]:22). debug1: HPN to Non-HPN Connection debug1: Final hpn_buffer_size = 2097152 debug1: HPN Disabled: 0, HPN Buffer Size: 2097152 debug1: channel 0: new [client-session] debug1: Enabled Dynamic Window Scaling debug1: Requesting no-more-sessi...@openssh.com debug1: Entering interactive session. debug1: need rekeying debug1: SSH2_MSG_KEXINIT sent debug1: rekeying in progress debug1: rekeying in progress debug1: rekeying in progress debug1: rekeying in progress debug1: enqueue packet: 80 debug1: rekeying in progress debug1: SSH2_MSG_KEXINIT received debug1: AUTH STATE IS 1 debug1: REQUESTED ENC.NAME is 'aes128-ctr' debug1: kex: server-client aes128-ctr hmac-md5-...@openssh.com none debug1: REQUESTED ENC.NAME is 'aes128-ctr' debug1: kex: client-server aes128-ctr hmac-md5-...@openssh.com none debug1: sending SSH2_MSG_KEX_ECDH_INIT debug1: expecting SSH2_MSG_KEX_ECDH_REPLY debug1: Server host key: ECDSA 07:f3:16:2b:e9:64:87:fa:df:14:70:dc:03:60:5a:3c debug1: Host 'mythtv' is known and matches the ECDSA host key. debug1: Found key in /home/sgw/.ssh/known_hosts:168 debug1: ssh_ecdsa_verify: signature correct debug1: set_newkeys: rekeying debug1: spawned a thread debug1: spawned a thread debug1: dequeue packet: 80 debug1: SSH2_MSG_NEWKEYS sent debug1: expecting SSH2_MSG_NEWKEYS debug1: set_newkeys: rekeying debug1: spawned a thread debug1: spawned a thread debug1: SSH2_MSG_NEWKEYS received debug1: Sending environment. debug1: Sending env LANG = de_DE.UTF-8
Re: [gentoo-user] Re: ssh rekeying slow ?
Am 25.06.2014 20:30, schrieb James: Stefan G. Weichinger lists at xunil.at writes: When I ssh into a server in my basement, this takes way more time than usual. Does anyone have an idea what I could do to fix that? ssh has an ordered array of negotiations between systems that are related to the version numbers of ssh and the other configurations. There is usually a mismatch, when it takes too long to start a session, in my experience. I did not look at the specifics you posted. both servers/machines run net-misc/openssh-6.6.1_p1 ... re-compiled right today.
Re: [gentoo-user] Re: ssh rekeying slow ?
Am 25.06.2014 21:49, schrieb Alan McKinnon: I've also noticed slowdowns recently, I think it's the new ciphers likes ecdsa. Try this: Connect using ssh -vvv and examine the output to find which of the various ciphers and algorithms are used once connection is achieved. On the client, add those configuration options for the server to ssh_config. You should notice a speed up on the next attempt as unused methods will be skipped man 5 ssh_config has all the details ;-) thanks, Alan. Did you already find out what options to set? Aside from that, I wonder why we as users have to do that and why it isn't set up as good as possible by the coders of openssh. I will see if I can figure out what to do ... Stefan
Re: [gentoo-user] Re: ssh rekeying slow ?
Am 25.06.2014 23:10, schrieb Stefan G. Weichinger: I will see if I can figure out what to do ... To me it looks as if my issue is related to this line in the logs: Jun 25 23:30:45 mythtv sshd[5387]: pam_systemd(sshd:session): Failed to create session: Connection timed out hmm ...
Re: [gentoo-user] Re: ssh rekeying slow ?
Am 25.06.2014 23:31, schrieb Alan McKinnon: Because the openssh developers have no idea what you set up and cannot possibly know. The phrase as good as possible has no meaning here as the options out there in the wild as whatever they happen to be. Having users installing their software with the default config isn't that wild or unpredictable for them, I assume. anyway Stefan
Re: [gentoo-user] Re: ssh rekeying slow ?
Am 25.06.2014 23:31, schrieb Stefan G. Weichinger: Am 25.06.2014 23:10, schrieb Stefan G. Weichinger: I will see if I can figure out what to do ... To me it looks as if my issue is related to this line in the logs: Jun 25 23:30:45 mythtv sshd[5387]: pam_systemd(sshd:session): Failed to create session: Connection timed out hmm ... yes. edited /etc/pam.d/system-auth and commented this line (to be disabled): #-sessionoptionalpam_systemd.so Immediate logins now. Other people on the web face(d) that as well, according to google. S
Re: [gentoo-user] Re: ssh rekeying slow ?
Am 25.06.2014 23:45, schrieb cov...@ccs.covici.com: I had a problem like that and solved it by changine UseDNS no because it is trying to look for reverse dns pointers. This is done on the hosts /etc/ssh/sshd_config . Tried/tested a few hours ago. No change. pam_systemd is (or seems to be) the reason, see my other posting. Stefan
Re: [gentoo-user] Re: ssh rekeying slow ?
Am 26.06.2014 00:20, schrieb Stefan G. Weichinger: pam_systemd is (or seems to be) the reason, see my other posting. maybe it would be also solved by upgrading to the (in terms of gentoo) unstable version 214 of systemd: # equery b pam_systemd.so * Searching for pam_systemd.so ... sys-apps/systemd-212-r5 (/lib64/security/pam_systemd.so) I will check tomorrow or so, late here. Stefan
[gentoo-user] yubikey
Anyone using that (with gentoo) ? Experience? I consider getting one to test and use it .. flameeyes didn't get one: https://blog.flameeyes.eu/2012/01/how-not-to-sell-me-something-why-i-won-t-be-maintaining-yubikey-software-directly-in-gentoo maybe since then they changed their policies etc Stefan
Re: [gentoo-user] yubikey
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Am 18.06.2014 14:50, schrieb Neil Bothwick: On Wed, 18 Jun 2014 14:21:27 +0200, Stefan G. Weichinger wrote: Anyone using that (with gentoo) ? I got one a few days ago to check out. It's basically a USB keyboard, so it works with Gentoo exactly the same way it works with anything else. I've only tried the static password part so far, but my hard drive is not encrypted with a ridiculously long key that I would never use if I had to type it manually. cool ... I'd like to use it for * plain login * unlocking ssh-keys * maybe even unlocking my LUKS-partitions ... and the NFC-part for combining it with a password safe on my android phone It's weird. They list prices in dollars, PayPal converts that to Pounds Sterling, then the device is posted for a UK address. The VAT thing is even weirder. I consider I won't get a correct invoice .. in terms of taxes .. S -BEGIN PGP SIGNATURE- Version: GnuPG v2 Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQIcBAEBAgAGBQJToY3LAAoJEClcuD1V0PzmNeMP/iKez25Dt8BiZNyJKW2uyVTh caoW0Co8eo509LkLeuD3/GypWAc2ASkz/Qo6M/Kuoz+tN0jYPIkdoMQCRDcLltOt o8/VXjTjtdMIRVt3LEJ4gtMaoh4CE/dP/aRUMWflDamCy2UgR1tKp2tDe2BpluG9 FHQCkSQeoWpf5UsYddLp9MHCQqyWBN5jpB3s3sgYPdFz9JERt84zdDvMTYgeiHLM bYD+StdIXwnNAP63mWIXueTSF7yl9hTJSc62/R4F+SOEF7Et7RGyj1LmYYy4Pxrz eVIbZ7jS/uBBW+pp8MtbLF6m6J5XiA4VripHNbQa+pkx1zzrRSEe3lhN9zzR3xZq 83hLUMYUw1uCgiHo7AQxFjNWee/xei5QuZMND44bkJNRsMOjnrlmLxNFOyi2E9bq VNehz58caBkyiqwusMUaM6BfVs4dt5XLk5LhaWDqzjN59Q6XoR92Gi1BExLL5IAA /YhVvBXARc5qFYHZn0/fOGr/lskG/8kpwELlXYE8tVcimdLrSmcOzr8Q7zEJCtnn twkX08RM0taadiQ9ZFJ80Lcc8SZgxMVHHJwFyu+8nUoifvFkn1WSt642IZSn5aVN 3oTQhom8vf4fNjI64TaklOQfp+8NZECtIwBVnS6yyjg0yyQTPiKAebvPigaJyai1 8YJdE0f/85vrm0CVBJKc =MDt1 -END PGP SIGNATURE-
Re: [gentoo-user] yubikey
Am 18.06.2014 14:54, schrieb Alon Bar-Lev: Right, I use it, and it working fine. I use single HOTP. The sdk/tools also build friendly, there was no problem to build in order to perform the initial enrolment. good to hear, thanks!
[gentoo-user] btrfs: subvol without compression
... I am quite happy now with the performance of that new server I am preparing. See thread Intel(R) C600 SAS Controller for that story: https://www.mail-archive.com/gentoo-user@lists.gentoo.org/msg146119.html Right now I get quite good results when doing backups of the 2 existing VMs (which have their virtio-disks on LVM-LVs on the host) ... up to 200MB/s ... I can show for reference, if someone is interested. I think that is around the possible maximum. --- The issue I want to share with you is related to a btrfs subvol I have here. Block device sda builds the btrfs-pool containing the root-fs: # btrfs fi show Label: ROOT uuid: 9133c469-df1e-45f5-a09f-d1b9c75c69da Total devices 1 FS bytes used 29.47GiB devid1 size 500.00GiB used 278.04GiB path /dev/sda Btrfs v3.12 These are the subvolumes (I could/should rm some, but it doesn't matter for this issue, afaik): # btrfs su list / ID 257 gen 4282 top level 5 path __active ID 258 gen 4874 top level 5 path __active/root ID 266 gen 4772 top level 258 path images ID 267 gen 838 top level 258 path images/otrs ID 289 gen 4285 top level 258 path images/windows ID 538 gen 4874 top level 5 path __active/virt-backup fstab has: # grep btrfs /etc/fstab LABEL=ROOT / btrfs defaults,noatime,compress=lzo 0 0 LABEL=ROOT /mnt/virt-backupbtrfs compress=no,noatime,subvolid=538 0 0 ... so I want to mount subvolid 538 with disabled compression (to speed up backups as the files written to it are compressed on the fly via pigz already). But after booting I get that dir mounted with compress=lzo (which is default). # mount | grep btrfs /dev/sda on / type btrfs (rw,noatime,compress=lzo,space_cache) /dev/sda on /mnt/virt-backup type btrfs (rw,noatime,compress=lzo,space_cache) remounting works, though: booze ~ # mount -o remount,compress=no /mnt/virt-backup/ booze ~ # mount | grep btrfs /dev/sda on / type btrfs (rw,noatime,space_cache) /dev/sda on /mnt/virt-backup type btrfs (rw,noatime,space_cache) BUT it remounts / without compression as well ... ! Is it a bug? A mistake or misunderstanding? Could someone test this on his gentoo-btrfs-box? -- Additional info: # cat /proc/version Linux version 3.12.21-gentoo-r1 ... sys-fs/btrfs-progs-3.12-r1 # btrfs su get-default / ID 258 gen 4886 top level 5 path __active/root # line in grub.cfg mounts default subvol (because no specific subvol is specified) linux /boot/vmlinuz-3.12.21-gentoo-r1 root=UUID=9133c469-df1e-45f5-a09f-d1b9c75c69da ro Thanks, regards, Stefan
Re: [gentoo-user] btrfs: subvol without compression
Am 17.06.2014 13:04, schrieb Stefan G. Weichinger: BUT it remounts / without compression as well ... ! Is it a bug? A mistake or misunderstanding? maybe also related to this bug I filed a while ago: https://bugs.gentoo.org/show_bug.cgi?id=510148 Stefan
Re: [gentoo-user] What happened to qemu-kvm?
Am 13.06.2014 11:11, schrieb Konstantinos Agouros: Hi, I upgraded to qemu 2.0 however after this qemu-kvm is missing. Did this change somehow and is called differently (to actually use the kvm features)? the ebuild message tells you ... Use /usr/bin/qemu-system-x86_64 instead (for example in your libvirt xmls) There was a thread here a few days ago. Stefan
Re: [gentoo-user] Intel(R) C600 SAS Controller
Am 11.06.2014 22:17, schrieb thegeezer: On 06/11/2014 07:57 PM, Stefan G. Weichinger wrote: looks promising: awesome. i did have a look through the diff, there are lots of scsi drivers selected, storage (block) cgroups but i think the crucial factor was the HZ was set at 100 previously and 1000 now. i guess it has helped kernel-io though maybe a kernel hacker in here might give a more authoritative answer The help suggests to choose 100 for servers ... the 1000 comes from the sysresccd-setup, yes. I wonder if chosing the Processor Family also had an influence. And I even wonder more if I have some bad choices in my desktop's kernel as well ;-) it's a grown setup over years ... For now it looks good ... I will configure the current kernel as a fallback kernel and maybe play with some options. One big fat hw-RAID10 might be better? But losing the wrong 2 drives makes it crash again ... afaik. yeah you could argue with raid6 you can _only_ lose two disks, whereas if you lose the right disks with raid01 you can lose 3 and still rebuild. raid 0+1 (as opposed to raid10, slightly different) gives you great speed and at least one drive you can lose. however, you are not protected by silent bit corruption but then you are using btrfs elsewhere. ... for the OS, yes ... and maybe for the target of virt-backup. myself i would use lvm to partition and then at least you can move things around later; btrfs lets you do the same afaiu _always_ have your hotspare in the system, then it takes less time to come back up to 100% nothing is quite as scary as having a system waiting on the post and a screwdriver before rebuild can even start good suggestion, sure. That would mean rebuilding the arrays to a RAID6 over 4 or 5 disks and keeping one aside. time for a break here. i'd strongly recommend such monitoring software as munin to have running -- this way you can watch trends like io times increasing over time and act on them before things start feeling sluggish I will take a look into it and check how much time I need to learn and set up. well earned break :) ;-) S
Re: [gentoo-user] Intel(R) C600 SAS Controller
hello again ... noone interested? ;-) I understand in a way ... Maybe I have something in the kernel misconfigured ... Right now I get these messages again: [ 1998.118658] hpet1: lost 1 rtc interrupts Should I disable HPET in the BIOS and/or via kernel command line? I never know how to set the timer-related kernel options, especially with KVM hosting. Stefan
Re: [gentoo-user] Intel(R) C600 SAS Controller
Am 11.06.2014 12:14, schrieb thegeezer: Basically 3 RAID-6 hw-raids over 6 SAS hdds. OK so i'm confused again. RAID6 requires minimum of 4 drives. if you have 3 raid6's then you would need 12 drives (coffee hasn't quite activated in me yet so my maths may not be right) or do you have essentially the first part of each of the six drives be virtual disk 1, the second part of each of the six drives virtual disk 2 and the third part be virtual disk 3 -- if this is the case bear in mind that the slowest part of the disk is the end of the disk -- so you are essentially hobbling your virtual disk3 but only a little, instead of being around 150MB/sec it might run at 80. I'd be happy to see 80 ! Ran atop now while dd-ing stuff to an external disk and got ~1MB/s for 2.5GB of data. (this is even too slow for USB ...) I am unsure what to post here from atop ... ? To the initial question: Yes, imagine the six disks split or partitioned at the level of the hardware raid controller (as you described above). you might also like to try a simple test of the following (yes lvs count as block devices) # hdparm -t /dev/sda # hdparm -t /dev/sdb # hdparm -t /dev/sdc # hdparm -t /dev/vg01/winserver_disk0 # hdparm -t /dev/vg01/amhold everything around 380 MB/s ... only ~350 MB/s for /dev/vg01/winserver_disk0 (which still is nice) i notice the core i7 only now. have you disabled turbo boost in the bios ? this is great for a desktop but awful for a server as it disables all those extra cores for a single busy thread I checked BIOS settings yesterday and don't remember a turbo boost option. I will check once more. cgroups are a great way of limiting or guaranteeing performance. by default i believe systemd will aim for user interactivity, but you want to change that to be more balanced. maybe some else can suggest how best to configure systemd cgroups. meanwhile can you # tree /sys/fs/cgroup/ # !tr tree /sys/fs/cgroup/ /sys/fs/cgroup/ ├── cpu - cpu,cpuacct ├── cpuacct - cpu,cpuacct ├── cpu,cpuacct │ ├── cgroup.clone_children │ ├── cgroup.event_control │ ├── cgroup.procs │ ├── cgroup.sane_behavior │ ├── cpuacct.stat │ ├── cpuacct.usage │ ├── cpuacct.usage_percpu │ ├── cpu.shares │ ├── notify_on_release │ ├── release_agent │ └── tasks ├── cpuset │ ├── cgroup.clone_children │ ├── cgroup.event_control │ ├── cgroup.procs │ ├── cgroup.sane_behavior │ ├── cpuset.cpu_exclusive │ ├── cpuset.cpus │ ├── cpuset.mem_exclusive │ ├── cpuset.mem_hardwall │ ├── cpuset.memory_migrate │ ├── cpuset.memory_pressure │ ├── cpuset.memory_pressure_enabled │ ├── cpuset.memory_spread_page │ ├── cpuset.memory_spread_slab │ ├── cpuset.mems │ ├── cpuset.sched_load_balance │ ├── cpuset.sched_relax_domain_level │ ├── machine.slice │ │ ├── cgroup.clone_children │ │ ├── cgroup.event_control │ │ ├── cgroup.procs │ │ ├── cpuset.cpu_exclusive │ │ ├── cpuset.cpus │ │ ├── cpuset.mem_exclusive │ │ ├── cpuset.mem_hardwall │ │ ├── cpuset.memory_migrate │ │ ├── cpuset.memory_pressure │ │ ├── cpuset.memory_spread_page │ │ ├── cpuset.memory_spread_slab │ │ ├── cpuset.mems │ │ ├── cpuset.sched_load_balance │ │ ├── cpuset.sched_relax_domain_level │ │ ├── machine-qemu\x2dotrs.scope │ │ │ ├── cgroup.clone_children │ │ │ ├── cgroup.event_control │ │ │ ├── cgroup.procs │ │ │ ├── cpuset.cpu_exclusive │ │ │ ├── cpuset.cpus │ │ │ ├── cpuset.mem_exclusive │ │ │ ├── cpuset.mem_hardwall │ │ │ ├── cpuset.memory_migrate │ │ │ ├── cpuset.memory_pressure │ │ │ ├── cpuset.memory_spread_page │ │ │ ├── cpuset.memory_spread_slab │ │ │ ├── cpuset.mems │ │ │ ├── cpuset.sched_load_balance │ │ │ ├── cpuset.sched_relax_domain_level │ │ │ ├── emulator │ │ │ │ ├── cgroup.clone_children │ │ │ │ ├── cgroup.event_control │ │ │ │ ├── cgroup.procs │ │ │ │ ├── cpuset.cpu_exclusive │ │ │ │ ├── cpuset.cpus │ │ │ │ ├── cpuset.mem_exclusive │ │ │ │ ├── cpuset.mem_hardwall │ │ │ │ ├── cpuset.memory_migrate │ │ │ │ ├── cpuset.memory_pressure │ │ │ │ ├── cpuset.memory_spread_page │ │ │ │ ├── cpuset.memory_spread_slab │ │ │ │ ├── cpuset.mems │ │ │ │ ├── cpuset.sched_load_balance │ │ │ │ ├── cpuset.sched_relax_domain_level │ │ │ │ ├── notify_on_release │ │ │ │ └── tasks │ │ │ ├── notify_on_release │ │ │ ├── tasks │ │ │ ├── vcpu0 │ │ │ │ ├── cgroup.clone_children │ │ │ │ ├── cgroup.event_control │ │ │ │ ├── cgroup.procs │ │ │ │ ├── cpuset.cpu_exclusive │ │ │ │ ├── cpuset.cpus │ │ │ │ ├── cpuset.mem_exclusive │ │ │ │ ├── cpuset.mem_hardwall │ │ │ │ ├── cpuset.memory_migrate │ │ │ │ ├── cpuset.memory_pressure │ │ │ │ ├── cpuset.memory_spread_page │ │
Re: [gentoo-user] Intel(R) C600 SAS Controller
Am 11.06.2014 12:41, schrieb thegeezer: everything around 380 MB/s ... only ~350 MB/s for /dev/vg01/winserver_disk0 (which still is nice) OK here is the clue. if the LVs are also showing such fast speed, then please can you show your command that you are trying to run that is so slow ? I originally noticed that virt-backup was slow so I looked into it and found some dd-command. My tests right now are like this: booze ~ # dd if=/dev/vg01/winserver_disk0 bs=1M of=/dev/null ^C25+0 Datensätze ein 24+0 Datensätze aus 25165824 Bytes (25 MB) kopiert, 13,8039 s, 1,8 MB/s booze ~ # dd if=/dev/vg01/winserver_disk0 bs=4M of=/dev/null ^C6+0 Datensätze ein 5+0 Datensätze aus 20971520 Bytes (21 MB) kopiert, 12,5837 s, 1,7 MB/s booze ~ # dd if=/dev/vg01/winserver_disk0of=/dev/null ^C55009+0 Datensätze ein 55008+0 Datensätze aus 28164096 Bytes (28 MB) kopiert, 12,611 s, 2,2 MB/s So no copy from-to same disk here ... should be just plain reading, right? virt-backup does some ionice-stuff as well, but as you see, my test-commands don't. # cat /sys/block/sdc/queue/scheduler [noop] deadline cfq - noop scheduler to let the controller do its own scheduling thanks, Stefan
Re: [gentoo-user] Intel(R) C600 SAS Controller
Am 11.06.2014 13:01, schrieb thegeezer: yeah this is very very odd. firstly there should not be such discrepancy between hdparm -t and dd if= secondly you would imagine that the first dd would be cached and so would be faster the second time round please check for the turbo boost disable, i'll have a closer look at the cgroups no turbo boost found. only a powermanagement menu ... I disabled it again. It was disabled per default, other options are efficient and custom ... so I understand it as performant when it is disabled. custom brings several options then, I had tried the performant options already without success. Right now I get around 18-20 MB/s for the /dev/null test.
Re: [gentoo-user] Intel(R) C600 SAS Controller
Am 11.06.2014 13:18, schrieb thegeezer: just out of curiosity, what happens if you do # dd if=/dev/vg01/amhold of=/dev/null bs=1M count=100 # dd if=/dev/sdc of=/dev/null bs=1M count=100 booze ~ # dd if=/dev/vg01/amhold of=/dev/null bs=1M count=100 100+0 Datensätze ein 100+0 Datensätze aus 104857600 Bytes (105 MB) kopiert, 1,71368 s, 61,2 MB/s booze ~ # dd if=/dev/sdc of=/dev/null bs=1M count=100 100+0 Datensätze ein 100+0 Datensätze aus 104857600 Bytes (105 MB) kopiert, 2,40518 s, 43,6 MB/s
Re: [gentoo-user] Intel(R) C600 SAS Controller
Am 11.06.2014 13:52, schrieb thegeezer: ok baffling. sdc i already said would be slower but not this much slower it certainly should not be slower than the lvm that sits on top of it! i can't see anything in the cgroups that stands out, maybe someone else can give a better voice to this. all i can think is there is other IO happening in atop if you can highlight any line that begins LVM CPU or DSK and paste it in to a reply - with no virtualmachines running and no dd or anything. then run a dd as before and highlight the lines in atop while it is running (maybe increase count to 1000 to give yourself a chance) and paste in here too I did a test with a sysresccd from 2013 (that is kernel 3.4.52 ... phew) Just booted, vgchange -ay and then the dd-test from LV to /dev/null - with or without count=500 I get around 340-350 MB/s ! So my kernel-config seems buggy or I should downgrade to something older? Aside from that I checked the firmware of the controller, it has the latest release. Stefan
Re: [gentoo-user] Intel(R) C600 SAS Controller
Am 11.06.2014 15:32, schrieb thegeezer: So my kernel-config seems buggy or I should downgrade to something older? I suspect that in your fully running system somethingelse(tm) is stealing the activity. can you start up with no services enabled and do the test ? hm, yes. although I had deactivated most of it already. Right now I compile a 3.10.x kernel with a config pulled from the sysresccd ... way more stuff compiled in, but maybe a step ...
Re: [gentoo-user] Intel(R) C600 SAS Controller
Am 11.06.2014 15:44, schrieb Stefan G. Weichinger: Am 11.06.2014 15:32, schrieb thegeezer: So my kernel-config seems buggy or I should downgrade to something older? I suspect that in your fully running system somethingelse(tm) is stealing the activity. can you start up with no services enabled and do the test ? hm, yes. although I had deactivated most of it already. Right now I compile a 3.10.x kernel with a config pulled from the sysresccd ... way more stuff compiled in, but maybe a step ... That definitely helped. Faster booting and now the bottleneck is gone somewhere. dd-tests look good now, I already do a first backup via virt-backup (which runs a dd with bs=4M under the hood ... and I pipe that through pigz ...) Now I migrate and slim down this kernel config for the (gentoo-)stable kernel linux-3.12.21-gentoo-r1 ... we'll see! Thanks @thegeezer for the help so far! Stefan
Re: [gentoo-user] Intel(R) C600 SAS Controller
looks promising: virt-backup dumps and packs a 12 GB image-file within ~145 seconds to a non-compressing btrfs subvolume: a) does a LVM-snapshot b) dd with bs=4M and through pigz to the target file The bigger LV with ~250GB is running right now. The system feels snappier than with the old kernel ... I wonder if there is more to tune as right now I am using the rather generic config which is not tuned for the specific CPU, for example (which might even have helped? ;-) ). That was good progress today ... but I might consider re-configuring the RAIDs as mentioned. As I run backups via amanda I have to provide a so called holding disk as intermediate place for dumps on their way to the tape drive. This means copying around stuff within the same hardware raid array. One big fat hw-RAID10 might be better? But losing the wrong 2 drives makes it crash again ... afaik. time for a break here. Greets, Stefan
Re: [gentoo-user] Intel(R) C600 SAS Controller
Am 27.05.2014 15:03, schrieb Stefan G. Weichinger: way too slow ... I think I have some IO-topic going on ... very likely some mismatch of block sizes ... the hw-raid, then LVM, then the snapshot on top of that ... and a filesystem with properties as target ... oh my. Chosing noop as IO-scheduler helps a bit but maybe I have to roll back and rebuild one of the HW-RAID-Arrays with a different blocksize. back from short vacation and re-attacking this one ... I am not sure if I set up the HW-RAIDs correctly and want to move data away from the LVM (yes, again) to try to rebuild the array /dev/sdc I have: # lsblk -o NAME,FSTYPE,UUID,SIZE,TYPE,MOUNTPOINT,LABEL,MODEL,PHY-SEC,MIN-IO NAME FSTYPE UUID SIZE TYPE MOUNTPOINT LABEL MODELPHY-SEC MIN-IO sdabtrfs 9133c469-df1e-45f5-a09f-d1b9c75c69da 500G disk /mnt/defvol ROOT RAID 5/6 SAS 6G 4096 4096 sdbswap102d41a8-848d-4525-b39e-d9b543355b71 8G disk [SWAP] SWAP RAID 5/6 SAS 6G 4096 4096 sdcLVM2_member Z2LEVf-ZJch-cqi3-GVob-Jpd2-eweJ-sDtW7H 1,3T disk RAID 5/6 SAS 6G 4096 4096 ├─vg01-amhold xfs 96b7395b-6e81-4660-9459-6a7ad83d8861 400G lvm /mnt/amhold AMHOLD 4096 4096 └─vg01-winserver_disk0 244,1G lvm 4096 4096 (sorry for the ugly format ... should I post a URL?) Is the value for PHY-SEC my problem? The 4 MB ... ? - So sdc is a PV in VG vg01 ... which contains a KVM-diskimage /dev/vg01/winserver_disk0 I use the noop scheduler btw ... I try a dd (or ddrescue) from that LV to somewhere else and only get around 1-5 MB/s ... this takes way too long. --- example with external disk as target: ddrescue -v --block-size=4M /dev/vg01/winserver_disk0 /mnt/ext/virt-backup/windows-server/windows-server_vda.img tried local root-fs as target, different block sizes etc. --- The system is an updated and stable gentoo amd64 box - # emerge --info Portage 2.2.8-r1 (default/linux/amd64/13.0, gcc-4.7.3, glibc-2.17, 3.12.21-gentoo-r1 x86_64) = System uname: Linux-3.12.21-gentoo-r1-x86_64-Intel-R-_Xeon-R-_CPU_E5-2407_0_@_2.20GHz-with-gentoo-2.2 KiB Mem:16413444 total, 9252100 free KiB Swap:8388604 total, 8388604 free Timestamp of tree: Tue, 10 Jun 2014 07:30:01 + ld GNU ld (GNU Binutils) 2.23.2 app-shells/bash: 4.2_p45 dev-lang/python: 2.7.6, 3.2.5-r2, 3.3.3 dev-util/cmake: 2.8.11.2 dev-util/pkgconfig: 0.28 sys-apps/baselayout: 2.2 sys-apps/openrc: 0.12.4 sys-apps/sandbox: 2.6-r1 sys-devel/autoconf: 2.69 sys-devel/automake: 1.13.4 sys-devel/binutils: 2.23.2 sys-devel/gcc:4.7.3-r1 sys-devel/gcc-config: 1.7.3 sys-devel/libtool:2.4.2 sys-devel/make: 3.82-r4 sys-kernel/linux-headers: 3.13 (virtual/os-headers) sys-libs/glibc: 2.17 Repositories: gentoo hiro-oops-intern ACCEPT_KEYWORDS=amd64 ACCEPT_LICENSE=* -@EULA CBUILD=x86_64-pc-linux-gnu CFLAGS=-march=corei7-avx -O2 -pipe CHOST=x86_64-pc-linux-gnu CONFIG_PROTECT=/etc /usr/share/gnupg/qualified.txt CONFIG_PROTECT_MASK=/etc/ca-certificates.conf /etc/env.d /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo CXXFLAGS=-march=corei7-avx -O2 -pipe DISTDIR=/usr/portage/distfiles FCFLAGS=-O2 -pipe FEATURES=assume-digests binpkg-logs config-protect-if-modified distlocks ebuild-locks fixlafiles merge-sync news notitles parallel-fetch preserve-libs protect-owned sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync FFLAGS=-O2 -pipe GENTOO_MIRRORS=http://distfiles.gentoo.org; LANG=de_DE.UTF-8 LDFLAGS=-Wl,-O1 -Wl,--as-needed MAKEOPTS=-j5 PKGDIR=/var/portage/packages PORTAGE_CONFIGROOT=/ PORTAGE_RSYNC_OPTS=--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages PORTAGE_TMPDIR=/var/tmp PORTDIR=/usr/portage PORTDIR_OVERLAY=/usr/local/portage SYNC=rsync://172.32.99.6/gentoo-portage USE=acl amd64 berkdb bzip2 cli cracklib crypt cxx dri fortran gdbm iconv ipv6 mmx modules multilib ncurses nls nptl openmp pam pcre readline session sse sse2 ssl systemd tcpd udev unicode zlib ABI_X86=64 ALSA_CARDS=ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci APACHE2_MODULES=alias cgi headers filter deflate perl CALLIGRA_FEATURES=kexi words flow plan sheets stage tables krita karbon braindump author CAMERAS=ptp2 COLLECTD_PLUGINS=df interface irq load memory rrdtool swap syslog CURL_SSL=openssl DRACUT_MODULES=biosdevname btrfs caps lvm mdraid ELIBC
Re: [gentoo-user] Intel(R) C600 SAS Controller
additional infos from journalctl. I don't like the fact with 512-byte logical blocks vs. 4096-byte physical blocks ... sounds wrong, hm? - Jun 10 21:54:31 booze kernel: megaraid_sas :02:00.0: Controller type: MR,Memory size is: 512MB Jun 10 21:54:31 booze kernel: scsi7 : LSI SAS based MegaRAID driver Jun 10 21:54:31 booze kernel: scsi 7:0:1:0: Direct-Access ATA ST9500620NS FTA7 PQ: 0 ANSI: 5 Jun 10 21:54:31 booze kernel: scsi 7:0:2:0: Direct-Access ATA ST9500620NS FTA7 PQ: 0 ANSI: 5 Jun 10 21:54:31 booze kernel: scsi 7:0:3:0: Direct-Access ATA ST9500620NS FTA7 PQ: 0 ANSI: 5 Jun 10 21:54:31 booze kernel: scsi 7:0:4:0: Direct-Access ATA ST9500620NS FTA7 PQ: 0 ANSI: 5 Jun 10 21:54:31 booze kernel: scsi 7:0:5:0: Direct-Access ATA ST9500620NS FTA7 PQ: 0 ANSI: 5 Jun 10 21:54:31 booze kernel: scsi 7:0:6:0: Direct-Access ATA ST9500620NS FTA7 PQ: 0 ANSI: 5 Jun 10 21:54:31 booze kernel: scsi 7:2:0:0: Direct-Access LSI RAID 5/6 SAS 6G 2.13 PQ: 0 ANSI: 5 Jun 10 21:54:31 booze kernel: sd 7:2:0:0: [sda] 1048576000 512-byte logical blocks: (536 GB/500 GiB) Jun 10 21:54:31 booze kernel: sd 7:2:0:0: Attached scsi generic sg2 type 0 Jun 10 21:54:31 booze kernel: scsi 7:2:1:0: Direct-Access LSI RAID 5/6 SAS 6G 2.13 PQ: 0 ANSI: 5 Jun 10 21:54:31 booze kernel: sd 7:2:0:0: [sda] 4096-byte physical blocks Jun 10 21:54:31 booze kernel: sd 7:2:1:0: [sdb] 16777216 512-byte logical blocks: (8.58 GB/8.00 GiB) Jun 10 21:54:31 booze kernel: sd 7:2:1:0: [sdb] 4096-byte physical blocks Jun 10 21:54:31 booze kernel: sd 7:2:1:0: Attached scsi generic sg3 type 0 Jun 10 21:54:31 booze kernel: sd 7:2:1:0: [sdb] Write Protect is off Jun 10 21:54:31 booze kernel: sd 7:2:1:0: [sdb] Mode Sense: 1f 00 10 08 Jun 10 21:54:31 booze kernel: sd 7:2:1:0: [sdb] Write cache: disabled, read cache: enabled, supports DPO and FUA Jun 10 21:54:31 booze kernel: scsi 7:2:2:0: Direct-Access LSI RAID 5/6 SAS 6G 2.13 PQ: 0 ANSI: 5 Jun 10 21:54:31 booze kernel: sd 7:2:2:0: [sdc] 2837446656 512-byte logical blocks: (1.45 TB/1.32 TiB) Jun 10 21:54:31 booze kernel: sd 7:2:2:0: [sdc] 4096-byte physical blocks Jun 10 21:54:31 booze kernel: sd 7:2:2:0: [sdc] Write Protect is off Jun 10 21:54:31 booze kernel: sd 7:2:2:0: [sdc] Mode Sense: 1f 00 00 08 Jun 10 21:54:31 booze kernel: sd 7:2:2:0: [sdc] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA Jun 10 21:54:31 booze kernel: sd 7:2:2:0: Attached scsi generic sg4 type 0 Jun 10 21:54:31 booze kernel: sd 7:2:0:0: [sda] Write Protect is off Jun 10 21:54:31 booze kernel: sd 7:2:0:0: [sda] Mode Sense: 1f 00 00 08 Jun 10 21:54:31 booze kernel: sd 7:2:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA Jun 10 21:54:31 booze kernel: sdb: unknown partition table Jun 10 21:54:31 booze kernel: sd 7:2:1:0: [sdb] Attached SCSI disk Jun 10 21:54:31 booze kernel: sdc: unknown partition table Jun 10 21:54:31 booze kernel: sd 7:2:2:0: [sdc] Attached SCSI disk Jun 10 21:54:31 booze kernel: sda: Jun 10 21:54:31 booze kernel: sd 7:2:0:0: [sda] Attached SCSI disk Jun 10 21:54:31 booze systemd[1]: Found device RAID_5_6_SAS_6G ROOT.
Re: [gentoo-user] Intel(R) C600 SAS Controller
Found out something about megacli and checked settings for cache and stuff following http://highperfpostgres.com/guides/lsi-megaraid-setup-for-postgresql/ Did I set a wrong Strip Size for the third array? good night, late here ... Stefan # megacli -LDInfo -Lall -aALL Adapter 0 -- Virtual Drive Information: Virtual Drive: 0 (Target Id: 0) Name:root RAID Level : Primary-6, Secondary-3, RAID Level Qualifier-3 Size: 500.0 GB Sector Size : 512 Is VD emulated : No Parity Size : 250.0 GB State : Optimal Strip Size : 256 KB Number Of Drives: 6 Span Depth : 1 Default Cache Policy: WriteBack, ReadAdaptive, Direct, No Write Cache if Bad BBU Current Cache Policy: WriteBack, ReadAdaptive, Direct, No Write Cache if Bad BBU Default Access Policy: Read/Write Current Access Policy: Read/Write Disk Cache Policy : Disabled Encryption Type : None Bad Blocks Exist: No Is VD Cached: No Virtual Drive: 1 (Target Id: 1) Name:swap RAID Level : Primary-6, Secondary-3, RAID Level Qualifier-3 Size: 8.0 GB Sector Size : 512 Is VD emulated : No Parity Size : 4.0 GB State : Optimal Strip Size : 64 KB Number Of Drives: 6 Span Depth : 1 Default Cache Policy: WriteBack, ReadAheadNone, Cached, No Write Cache if Bad BBU Current Cache Policy: WriteBack, ReadAheadNone, Cached, No Write Cache if Bad BBU Default Access Policy: Read/Write Current Access Policy: Read/Write Disk Cache Policy : Disabled Encryption Type : None Bad Blocks Exist: No Is VD Cached: No Virtual Drive: 2 (Target Id: 2) Name:lvm RAID Level : Primary-6, Secondary-3, RAID Level Qualifier-3 Size: 1.321 TB Sector Size : 512 Is VD emulated : No Parity Size : 676.5 GB State : Optimal Strip Size : 64 KB Number Of Drives: 6 Span Depth : 1 Default Cache Policy: WriteBack, ReadAdaptive, Direct, No Write Cache if Bad BBU Current Cache Policy: WriteBack, ReadAdaptive, Direct, No Write Cache if Bad BBU Default Access Policy: Read/Write Current Access Policy: Read/Write Disk Cache Policy : Disabled Encryption Type : None Bad Blocks Exist: No Is VD Cached: No
Re: [gentoo-user] Organising btrfs subvolumes
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Am 27.05.2014 09:59, schrieb Neil Bothwick: Alternative: mount the subvol via option subvolid etc in fstab if you plan to mount different snapshots, for example. I went with set-default for the root subvolume, if I need the root volume I can mount it with subvolid=0. Yes, just a question of preference. I prefer to specify a subvolid ... this won't lead to side-effects if I ever might set-default to something else. But it's easier to use the defaul subvolid if you refer to that subvol via grub2 or dracut etc ... Something I still learn about ... As far as I understand you are allowed to mount the root volume (or academic: any subvol in a higher level) and use plain mv to rename the subvols as if you renamed sub-dirs. rust me to overlook the easy way of doing things, I was looking for an equivalent to zfs rename and never considered mv. It feels somehow wrong to only mv them, right? ;-) So far, btrfs looks good on my laptop - time to think about putting it on my desktop. Yeah, good luck with that. I am quite happy with btrfs so far ... no problems or disadvantages so far. And the hourly snapshots of / and /home on my desktop are really nice to have ;-) Stefan -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.22 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQIcBAEBAgAGBQJThG+2AAoJEClcuD1V0PzmqXsP/jkK/dYlatk90CbXwc/H71Y3 VPuT8y0P8zrsrMdwziG8BzvL5ivL6xTEMmxXmi5frWHgC9751UmqZVlCI6I2+dYQ ffjZYLqf3Q6FXKIcZ09Sbuxg+FsuEqw2LLrWXmSgWDrf5YQ0GAOjZupL4ii8dtUt heBGUXWHMdR6JQOgqAl5+g+f1HlDEnVDf49L5AbKE5wkeCirNPZzx4I54k8SNykG N7TLUe+AGzCsDAOL8BWpLrAyCyuWkMc01sfZN0sp36wzt4IsMxQYQFxq1ndmtEWf LneGfQzAalXY26YnKvpAczyeTLcwdWw5TK0Yd8ftvnJz8Q++h4KQOAzqyaVBlMKi oYis1WugSeKOG5JebOd5vNYQ/Po4NaGmidLkvTARFf7lSyLdND+dOQRkCBuzN2Q0 i/G+C5OFVSI8Mp+7qmHfWIOaKdi36Zi8luKV937gJD2+y/oS0tJiOWICSo4bqAIh 5/yaSWg3rUfxQ0aYzQG8U055CpcvhfZntqt0HKn4/NOuw42T4/r/nFplIhB1/Qgz qIGmkvCupUNRrpSfY+CjbNKMeO4LDpNpruU2qThwYBPMWQ/m3Iq1zEAkR4vYNetA 3oFdqEZmJsOI/e/uTBfpSTGsk9bP9y9rEIEjzmjTXEN8OjwfpMoB/Dn9C0J9uK25 MdA7u6Xx0JfbJ1qOXNQl =b71z -END PGP SIGNATURE-
Re: [gentoo-user] Organising btrfs subvolumes
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Am 27.05.2014 13:25, schrieb Mick: I recall that zfs needed a lot of RAM = 8M, is it the same with BTRFS? I assume you mean 8GB ? As far as I know and researched: no, btrfs is less memory hungry and was designed to even work fine on small devices like phones or so. It depends if you use features like deduplication which is very ressource-intensive ... Also how big is each snapshot of / and why are these necessary on an hourly basiszfs ? Snapshots don't have any size initially. With filesystems like btrfs and zfs a snapshot is more of a pointer to a specific status of the whole fs-tree in time and in consequence also happens instantly. The size of the snapshot ... oh, Rich already replied as well :-) Stefan -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.22 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQIcBAEBAgAGBQJThHlUAAoJEClcuD1V0PzmApcP/RCBeASWCqKOxDhtyJ7Pj+c3 LgDObKZ23svRCU2qiwF04e1enJTUF+FcaL/KyB4690x1EATo+0ciYOajzgIRng16 24bGB/ZCRhE4uZ99aVLymAslhBXUyILcZ+AqaJCM2XL72Ttp7gqB/PW0bJWOgQ0Y wC4FWtzDJN6vm2VfC3gDMhdUaoysWuCEQqhppJe5RpSbOP3kk9PzXiFLPpJkKs2V xglvGDy5SCu79APTqUrDRZtHCQBpLTkMDBQr9ytdtVLPDDx6WyG0BZ351tp2fzMp CMUy4T1z417l+TgDMZ2iYBh1+Ctnqkr+SfLdlkkF+0AJfpFUpNjztDHyhV8Muzan AQdEDW1ccXc/cSR62gbf8+Y+Aj2QTBPImXtHNHQHPRiszVgJM7E5ufnxrUm+1qT9 aWM+SSLbDjtvmRBSOExNawonprMT44Vhqc4j0UfLhbLsLZfVbUghfczqOr5pDD6l 32dIkXRtT/zkR/tDpWX5n6ZotIlnAuVh7xIe8zID3KTLXdcuM2sP3UDFUGd4FqPU 5ovfAIhi133BHpdz7FHmTbR9if7iGeF+mWFfCt/cWYQY9vw3yLmUaJg3pxP0gKvC C3SXt8V30ubWKglrCXd0a3eqm0fbonFaACdB3eyeQgi5S4FBYHIATW8XDGP+/VSG t81Av1TKapRTzHgQF35U =lMUl -END PGP SIGNATURE-
Re: [gentoo-user] Organising btrfs subvolumes
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Am 27.05.2014 13:49, schrieb Neil Bothwick: I have zfs-snapshot making snapshots at 15 minute, hourly, daily, monthly and weekly intervals - and it cleans up after itself. There isn't anything quite like that for btrfs, so I'm knocking up a python script to take care of it. I want automated snapshots before I risk it on my desktop. Oh, I have something like that. Copied here: http://marc.merlins.org/perso/btrfs/post_2014-03-21_Btrfs-Tips_-How-To-Setup-Netapp-Style-Snapshots.html I wrapped some helper stuff around it to make it work with 2 btrfs-pools and systemd (and a timer there to even avoid running cron). Stefan -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.22 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQIcBAEBAgAGBQJThHx8AAoJEClcuD1V0Pzmnj4QAKcZIghxoDgVVbI7a1rIltxl fAPdRvY5g5We0v/VJ7RL9vJe1tJ9F2UnzDBC/rEPw8XSPR1zJxhrFyCrdmumMYY+ qac4XSRCSS92subHwnYfjWxigqLk7DT86ATTEIo841YmQTdrfRyzmxwVHwvoONOB APasAal8Re7PFd01UAGpCurAzA20lMs1CFlqK/sBcWwM9RGsRzPwUZsfLiKcmdmX Ta4YUO/RtOv/RWntyHYJZ0FgcxmNo+HLCE6821mOxg+CyDp9Vag/6HWlXbZW1MRM /CVHQ8kim+azcEuX0NU7WDIfotPrXtb8PGZt+2QJtJm12CJQficQrUOZpmgoi3yM 7n1ux1VkM7avnXkoJ90/T5eWznq8d/NqTaESUHLnOPueE7JciR5gc3kNEgcriD7Y qHM9ZDG4vzRScUcLowZydsK32FHZdFRHUpNkwE2Admffz7+Sv3TfZqog2rs0WVoM zVBoKr3DY1LQo7NvHQJT2sfMKzBJq0kFoBY7yvwnJkzf2htlnhT2jOFg+XzTC0Hr IEHzEu/yzfmwKp490U3+jAfCxEnaGNIW1YZ+lA+kzS+6+9DWR+XYuaV/EV/wvE9s J2oPqzwzpcaBLxLY+Mq8cz/sXOASf6ICYYy1w+GfH82e/DYzfn/j+FTIxmjK6KVe t6/tx2rwGeNL1AhKaSmY =QHMO -END PGP SIGNATURE-
Re: [gentoo-user] Organising btrfs subvolumes
Am 27.05.2014 14:12, schrieb Rich Freeman: There is snapper, which is even in the tree now. It isn't 100% flexible but supports any number of hourly, daily, monthly, and yearly snapshots, with retention policies for each. no systemd-unitfiles yet, correct? I merged it and took a quick look, as far as I understand it needs a service running ... I will check back later this evening and see how to get that working here. Stefan
Re: [gentoo-user] Intel(R) C600 SAS Controller
Am 26.05.2014 21:57, schrieb Stefan G. Weichinger: Am 26.05.2014 19:47, schrieb Stefan G. Weichinger: But I somehow think the performance is sub-optimal. virt-backup is slow as well (using dd and gzip or pigz in my own patched version). Yes, that LVM stuff again ... I run 6 SAS disks and built hardware raids. Should I look into the cache settings there? way too slow ... I think I have some IO-topic going on ... very likely some mismatch of block sizes ... the hw-raid, then LVM, then the snapshot on top of that ... and a filesystem with properties as target ... oh my. Chosing noop as IO-scheduler helps a bit but maybe I have to roll back and rebuild one of the HW-RAID-Arrays with a different blocksize. Stefan
Re: [gentoo-user] Re: fstab cleanup
Am 26.05.2014 06:47, schrieb Nikos Chantziaras: On 21/05/14 13:32, Stefan G. Weichinger wrote: Do I still need these lines .. especially with a modern systemd/gnome3-environment? tmpfs /dev/shmtmpfs nodev,nosuid,noexec 0 0 /dev/cdrw /media/cdrecorder auto user,exec,noauto,managed 0 0 You can safely delete both. A /dev/shm mount is created automatically, and /media/cdrecorder is not used by anything. Some old cruft left from back then somedays --- removed it already, yes.
Re: [gentoo-user] Intel(R) C600 SAS Controller
Am 24.05.2014 21:24, schrieb Stefan G. Weichinger: Am 23.05.2014 09:52, schrieb Stefan G. Weichinger: Greetings, I have a new Fujitsu TX150 here, with a Intel(R) C600 SAS Controller and an LTO4 drive attached to it. My kernel has support for isci, scsi tape, ahci and all the sas stuff ... but I don't get any st devices. Do I need SCSI_PROC_FS set? I just wonder ... I still don't see that LTO drive. Anyone with access to this: https://access.redhat.com/site/solutions/262773 managed to support the LTO on its controller now. But I somehow think the performance is sub-optimal. Does someone spot any obvious mistakes in my kernel config: http://pastebin.com/VGiJRMac ? When I run a backup via amanda .. the load is unusual high and I really wonder why ... I already rebuilt @system I now rebuild the kernel with -O2 ... it was on -Os ... some old VM-template was used as seed for this installation ... I disabled HPET in BIOS as I always get dropped interrupts (KVM related?) Thanks for any hints! - # emerge --info Portage 2.2.8-r1 (default/linux/amd64/13.0, gcc-4.7.3, glibc-2.17, 3.12.20-gentoo x86_64) = System uname: Linux-3.12.20-gentoo-x86_64-Intel-R-_Xeon-R-_CPU_E5-2407_0_@_2.20GHz-with-gentoo-2.2 KiB Mem:16414588 total, 7848248 free KiB Swap:8388604 total, 8388604 free Timestamp of tree: Mon, 26 May 2014 06:00:01 + ld GNU ld (GNU Binutils) 2.23.2 app-shells/bash: 4.2_p45 dev-lang/python: 2.7.6, 3.2.5-r2, 3.3.3 dev-util/cmake: 2.8.11.2 dev-util/pkgconfig: 0.28 sys-apps/baselayout: 2.2 sys-apps/openrc: 0.12.4 sys-apps/sandbox: 2.6-r1 sys-devel/autoconf: 2.69 sys-devel/automake: 1.13.4 sys-devel/binutils: 2.23.2 sys-devel/gcc:4.7.3-r1 sys-devel/gcc-config: 1.7.3 sys-devel/libtool:2.4.2 sys-devel/make: 3.82-r4 sys-kernel/linux-headers: 3.13 (virtual/os-headers) sys-libs/glibc: 2.17 Repositories: gentoo hiro-oops-intern ACCEPT_KEYWORDS=amd64 ACCEPT_LICENSE=* -@EULA CBUILD=x86_64-pc-linux-gnu CFLAGS=-march=corei7-avx -O2 -pipe CHOST=x86_64-pc-linux-gnu CONFIG_PROTECT=/etc /usr/share/gnupg/qualified.txt CONFIG_PROTECT_MASK=/etc/ca-certificates.conf /etc/env.d /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo CXXFLAGS=-march=corei7-avx -O2 -pipe DISTDIR=/usr/portage/distfiles FCFLAGS=-O2 -pipe FEATURES=assume-digests binpkg-logs config-protect-if-modified distlocks ebuild-locks fixlafiles merge-sync news notitles parallel-fetch preserve-libs protect-owned sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync FFLAGS=-O2 -pipe GENTOO_MIRRORS=http://distfiles.gentoo.org; LANG=de_DE.UTF-8 LDFLAGS=-Wl,-O1 -Wl,--as-needed MAKEOPTS=-j5 PKGDIR=/var/portage/packages PORTAGE_CONFIGROOT=/ PORTAGE_RSYNC_OPTS=--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages PORTAGE_TMPDIR=/var/tmp PORTDIR=/usr/portage PORTDIR_OVERLAY=/usr/local/portage SYNC=rsync://172.32.99.6/gentoo-portage USE=acl amd64 berkdb bzip2 cli cracklib crypt cxx dri fortran gdbm iconv ipv6 mmx modules multilib ncurses nls nptl openmp pam pcre readline session sse sse2 ssl systemd tcpd udev unicode zlib ABI_X86=64 ALSA_CARDS=ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci APACHE2_MODULES=alias cgi headers filter deflate perl CALLIGRA_FEATURES=kexi words flow plan sheets stage tables krita karbon braindump author CAMERAS=ptp2 COLLECTD_PLUGINS=df interface irq load memory rrdtool swap syslog CURL_SSL=openssl DRACUT_MODULES=biosdevname btrfs caps lvm mdraid ELIBC=glibc GPSD_PROTOCOLS=ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf superstar2 timing tsip tripmate tnt ublox ubx INPUT_DEVICES=keyboard mouse evdev KERNEL=linux LCD_DEVICES=bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text LIBREOFFICE_EXTENSIONS=presenter-console presenter-minimizer OFFICE_IMPLEMENTATION=libreoffice PHP_TARGETS=php5-5 PYTHON_SINGLE_TARGET=python2_7 PYTHON_TARGETS=python2_7 python3_3 RUBY_TARGETS=ruby19 ruby20 USERLAND=GNU VIDEO_CARDS=fbdev glint intel mach64 mga nouveau nv r128 radeon savage sis tdfx trident vesa via vmware dummy v4l XTABLES_ADDONS=quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account Unset: CPPFLAGS, CTARGET, EMERGE_DEFAULT_OPTS, INSTALL_MASK, LC_ALL, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS
Re: [gentoo-user] Intel(R) C600 SAS Controller
Am 26.05.2014 19:47, schrieb Stefan G. Weichinger: But I somehow think the performance is sub-optimal. virt-backup is slow as well (using dd and gzip or pigz in my own patched version). Yes, that LVM stuff again ... I run 6 SAS disks and built hardware raids. Should I look into the cache settings there? way too slow ...
Re: [gentoo-user] Intel(R) C600 SAS Controller
Am 23.05.2014 09:52, schrieb Stefan G. Weichinger: Greetings, I have a new Fujitsu TX150 here, with a Intel(R) C600 SAS Controller and an LTO4 drive attached to it. My kernel has support for isci, scsi tape, ahci and all the sas stuff ... but I don't get any st devices. Do I need SCSI_PROC_FS set? I just wonder ... I still don't see that LTO drive. Anyone with access to this: https://access.redhat.com/site/solutions/262773 ? ;-) S
[gentoo-user] Intel(R) C600 SAS Controller
Greetings, I have a new Fujitsu TX150 here, with a Intel(R) C600 SAS Controller and an LTO4 drive attached to it. My kernel has support for isci, scsi tape, ahci and all the sas stuff ... but I don't get any st devices. Do I need SCSI_PROC_FS set? I just wonder ... thanks, Stefan
Re: [gentoo-user] Organising btrfs subvolumes
Am 22.05.2014 18:12, schrieb Neil Bothwick: I'm working on this btrfs malarkey and have a question about best practice. It is recommended to leave the root volume empty and create a subvolume for the root filesystem which is set with btrfs subvolume set-default, which I have done. Alternative: mount the subvol via option subvolid etc in fstab if you plan to mount different snapshots, for example. What is the recommended way to create subvolumes that are mounted further down the filesystem? Let's say I was usr and var on their own subvolumes. Do I create them in the btrfs root, which means they have to be mounted from /etc/fstab - or do I create hem below the subvolume called root? I saw more examples mounting every dir via a separate line in fstab (which also adds the choice to mount them with different options, think compression etc). My understanding is: * create and use subvols for entities you want to be able to snapshot and rollback individually. * create and use subvols for entities you want to apply special options to: compression, (no)COW, quota ... I would mount each subvol via extra line and create them in parallel ... That raises another question. Assuming I've done it wrong (well, my wife always does) is there an equivalent to the zfs rename command to move or rename a subvolume? As far as I understand you are allowed to mount the root volume (or academic: any subvol in a higher level) and use plain mv to rename the subvols as if you renamed sub-dirs. Stefan
[gentoo-user] fstab cleanup
Do I still need these lines .. especially with a modern systemd/gnome3-environment? - # glibc 2.2 and above expects tmpfs to be mounted at /dev/shm for # POSIX shared memory (shm_open, shm_unlink). # (tmpfs is a dynamically expandable/shrinkable ramdisk, and will # use almost no memory if not populated with files) tmpfs /dev/shmtmpfs nodev,nosuid,noexec 0 0 /dev/cdrw /media/cdrecorder auto user,exec,noauto,managed 0 0 ?
Re: [gentoo-user] fstab cleanup
Am 21.05.2014 15:31, schrieb Tom H:
On Wed, May 21, 2014 at 6:32 AM, Stefan G. Weichinger li...@xunil.at wrote:
Do I still need these lines .. especially with a modern
systemd/gnome3-environment?
# glibc 2.2 and above expects tmpfs to be mounted at /dev/shm for
# POSIX shared memory (shm_open, shm_unlink).
# (tmpfs is a dynamically expandable/shrinkable ramdisk, and will
# use almost no memory if not populated with files)
tmpfs /dev/shmtmpfs
nodev,nosuid,noexec 0 0
/dev/cdrw /media/cdrecorder auto
user,exec,noauto,managed 0 0
From src/core/mount-setup.c:
{ tmpfs, /dev/shm, tmpfs,
mode=1777, MS_NOSUID|MS_NODEV|MS_STRICTATIME, NULL,
MNT_FATAL|MNT_IN_CONTAINER },
So the answer is no ?
Re: [gentoo-user] fstab cleanup
Am 21.05.2014 21:44, schrieb Tom H: The answer is no unless you want to apply different perms to /dev/shm. I don't have an idea why I should want to do that so I removed the line for now. Thanks. Stefan
Re: [gentoo-user] btrfs and sparse VM image files
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Am 19.05.2014 13:01, schrieb Neil Bothwick: On Mon, 19 May 2014 12:07:32 +0200, Marc Stürmer wrote: Just take a look at the official Gotchas Page of BTRFS, which can be found here: https://btrfs.wiki.kernel.org/index.php/Gotchas Putting virtual image files on Btrfs is something that the developers still do not recommend at all, and that's with reason! The page you linked to does not actually state that. There are plenty of hints and sideways references but little concrete information about what is safe with the current release - hence my question. I have a nice testbox here now ... a server for a customer which I won't deliver soon so I will have that one here for some weeks. I will play around with qemu/kvm-vms in various configs ... and see what happens. Stefan -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.22 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQIcBAEBAgAGBQJTewhlAAoJEClcuD1V0PzmQFUP/AzzW5ilQpK+RvWsikTWvyX7 LxGQQ9dTnCYNzXzLsf9drPDMAgQiIppJ/T3INRrsqCfCgpiIdOIx5YEMCW4at61m BbeXtUR6RazAcgI+2hOqbnkZFCVyOwG3Od2+C87y1NWc4+EId2ryNpo+eOlqC7Zr xlyqs2gE7HclVC29NQx2ntw19y9JMJD/Ac0I7oL5lKZt45bywBHzlcXplmuSDhba xuJuNT6ei+ip3A2+bYrGvfQ5/Yd0TiGUtbpjkAWPR1WXGdszqhvpG73aGlpj9aff gU6phiZc0vLjtGuM5peDSbNoT5OGpQJdhUTU+DbEpCdq1yh19h03Xa8YUibSFUT/ IZaB4UyjIr8Y/6SKF1krcLIrCi+1vvgRw2D2JscgLw/5uQ5sPX3LUay4gFxtWafq IHLbFvvjtrra847nGnNOKf9iUbbSv96lUXmvqJx+2sxr2ESsHqHpTFwAYWtRKz41 2A2cufUC6Zx7G/mNsE1teajovCP48EewlF3UKFo0Tqc68iuLMdQ4RJ4wVX5J12sk Ma0K/Y28/qezTO9GrJYzo4UoFxzE5md9foV0xqS34PMNtiw8aYNK3pC83AOE9KBu +daOIH6EY7HWx/C8S7jzeQZu8pWKOGf2rIT65Xt1Ij1w7vBXgD/4B5DeUkacAnz4 P/2sbXDzqrZr8PO32AOW =+l8k -END PGP SIGNATURE-
Re: [gentoo-user] btrfs and sparse VM image files
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Am 18.05.2014 14:28, schrieb Neil Bothwick: I'm confused about the desirability of keeping VM image files, usually space qcow files, on a btrfs volume. I have read the advice about using chattr +C on the subvolume, but are there any other gotchas? The btrfs wiki says in one place that using sparse file on btrfs is not a good idea, but is that still the case. There is conflicting information out there, does anyone here have any hard experience? No clue yet, but interested as well. Although I avoid these spaced qcow-files anyway. I would like to run QEMU/KVM-based VMs on btrfs subvolumes ... I love the idea of snapshotting them. Until now I often run them on LVM-LVs (as raw) and use virt-backup (which uses LVM snapshots) to generate backups. That works OK but btrfs-snapshots look and are way more sophisticated, I assume. - - I currently move over data from my zfs-pool to a new btrfs pool and will remove zfs then from that server. Stefan -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.22 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQIcBAEBAgAGBQJTearvAAoJEClcuD1V0Pzm3pcQAIq2yN5/2b8iFeLOBeY8Omwo JykaBvY8oSTa1julDs0JxKeEl7c4BKKB2lqUCpQ1Sl0G4TY4UR3stK/kKbA2X4Y5 9uJsh91U7yz/KsX3r+4d+e8B8iazhT66zY1Xyk94xqMQXjgpOrdDIMbfaK/aWeda 4pz5R47LNLSCEBhNCg0uZV/iv+oXTXGpvtnQ1B/bY15cf122Z59XHDZT9ofEK9EM zS4IucVHQpHS9OXmeusKqYmuos1s/WVYBmxfLJnfiMrd1llbMS9L63K2QV1YWp37 KSimPhyijpTIGPPdUMGjNaVzE2tE3cGOT3j0r33BVap62az1ese4Bi8fEES09bOk MjqGRnki1ZBjOx5cOCDmawvkBgMJzFZvqLofoCi0qGTegk33cXY5PBpPrXVfG2Qn 7WaVifl+oR16mVvpMKYUfoVmRZz93X8ZWQQT0Rfxtw3Sr+k9U6RUYl8lb/KqArAv kSKFH3jqRKpXJ7bfevKdB7YZp4+pKKf4PR3AHHLSkYJbM6H/1His1YNfdAfn074G 3D/HSIJNpojBRybpwM4eeYcB9DxqG712LkjNGHyvnfAuUpsnjUVQrBPLhblajvDy J7K0PdfYPUm37Hl4cVk3ohlM4h7kIxLDxptmV6darB1JAQV+J/G5R6HqRxfdvOHN s75mo/Ph+pKG/H4SM1Uk =wWUR -END PGP SIGNATURE-
Re: [gentoo-user] btrfs only, without dracut
Am 17.05.2014 20:48, schrieb Greg Turner: On Sat, May 17, 2014 at 8:56 AM, Stefan G. Weichinger li...@xunil.atwrote: It seems to not detect or interpret correctly the fact that there are 2 physical devices in there and then the linux ... line for grub.cfg gets messed up, at least for me here. ACK, genkernel initramfs doesn't btrfs scan and TSHTF. genkernel-next works though. I use dracut for generating the initramfs. But if you have it working now without any initramfs then obviously that is full of win (the LA kind, not the Redmond variety)! I wonder if there are any real advantages of booting *with* the initramfs even when you don't need it. When I look at what dracut does in interaction with systemd: https://www.kernel.org/pub/linux/utils/boot/dracut/dracut.html#dracutbootup7 https://www.kernel.org/pub/linux/utils/boot/dracut/dracut.html#_dracut_on_shutdown ... it seems to me that this adds something like an additional layer around certain things and helps to make all that more bulletproof? Or do I misinterpret here? I am a bit mystified -- or perhaps ignorant -- as to how it came to be that btrfs has no option to automatically initiate a scan (like md raid does, when it's built into the kernel as a non-module). Surely people must want that feature. I can see how scanning the wrong partitions could lead to terrible mayhem, though, say, in a disaster recovery scenario where you binary-cloned a failing drive and forgot to take the old one out before booting or whatever but btrfs has the secret sauce to most likely figure stuff like that out auto-magically anyhow, using the genid... so what gives? Anyone know? I don't. Not yet.
Re: [gentoo-user] btrfs only, without dracut
Am 19.05.2014 15:39, schrieb Rich Freeman: On Mon, May 19, 2014 at 3:04 AM, Stefan G. Weichinger li...@xunil.at wrote: ... it seems to me that this adds something like an additional layer around certain things and helps to make all that more bulletproof? Now that I know how to use dracut I'm basically using it everywhere, even for VMs that have a single ext4 partition (where it really is a bit overkill). For the most part it is plug-and-play, and once you start getting multiple disks involved it adds a lot of robustness. Dracut can fsck your disks if you want, it can reliably mount the right root even with fairly confusing layouts, and it actually respects whatever is in /etc/fstab. It can also be told to mount anything you want before pivoting via an additional fstab (with the usual syntax). Yes, it looks like a small system to me that boots and works before the real system boots up. Sure, in theory it is one more thing that can go wrong, but I look at it more like one thing that can help get things to go right when they would otherwise go wrong. I'd encourage anybody who hasn't used it to at least get an understanding of it. It can make your life easier. So my impressions were right, thanks for agreeing and explaining. There was a Lennart article about using the initramfs to do shutdown which was good reading. The concept is that you can cleanly unmount everything this way, and it also handles FUSE much better. Do you have an URL at hand for that? Thanks, Stefan
Re: [gentoo-user] btrfs only, without dracut
Am 19.05.2014 22:51, schrieb Dale: I might add, I used dracut for a while. A while back when I went to boot back up, shutdown because my power went out, the init thingy failed. I had zero clue on how to fix it so I edited grub to ignore the init part and booted up the old way. Once booted, I kicked out the init thingy and haven't built one since. I posted this a good while back, init thingy fails, it's gone. You are right, it is one more thing that can go wrong. It certainly hasn't fixed anything yet but it sure did break and keep me from booting with it. ;-) you english speaking guy call that YMMV ... right? ;-) on the other hand this evening I was able to boot up a live cd on a brand new Fuji TX150, transfer some rootfs-backup to it and configure grub2/systemd/dracut/btrfs/kitchensink from the chroot so that grub2 and dracut booted up correctly on the first try. ... yeah ... I am quite experienced already (I think so, sorry for sounding arrogant) but I am not used to getting it right on the first time (usually you forget some fs/module/uuid-detail ... and chroot a 2nd time). This might not have been dracut's own merit but it worked anyway. Stefan
[gentoo-user] btrfs only, without dracut
(new thread to separate things a bit more) Today I took the effort to completely re-install one of my two older thinkpads. booted via USB (sysresccd) because the X220 has no optical drive, backed up the contents of / and the encrypted /home to an external drive and started up gdisk to reorder the partitions. There were: sda1/boot/efi sda2swap(encrypted) sda3/root (the old ext4) sda4encrypted /home sda5/root (the new btrfs) Wasting the ~25GB of sda3 was not acceptable ;-) and adding that device to the new btrfs-pool somehow lead to flaky results with grub2-mkconfig It seems to not detect or interpret correctly the fact that there are 2 physical devices in there and then the linux ... line for grub.cfg gets messed up, at least for me here. Played around with that and then decided to redo all that from scratch. Removed sda[345] and did: sda1/boot/efi sda2swap(encrypted) sda3/root (new bigger btrfs) sda4encrypted /home (with btrfs inside) copied back my stuff, chrooted and re-fiddled my grub2/EFI-setup, that took me a bit but now it works great. - And even better(?): no more initrd included now! grub2-mkconfig somehow decides not to need the initrds generated by Canek's kerninst and it boots up fine so far. I will check if I should keep it that way or somehow enforce the usage of the initrd. opinions? - I looked if I can get rid of lvm2-pkg completely but AFAI understand I need that for cryptsetup, right? So I masked the lvm2-activation-services ... they don't do anything now at boot time ... a bit more speed (tiny) and less complexity somehow. - So quite a learning curve these days :-) Thanks for all the help and infos on this list, btw ... Stefan
Re: [gentoo-user] btrfs only, without dracut
Am 17.05.2014 17:56, schrieb Stefan G. Weichinger: sda3 /root (the old ext4) sda5 /root (the new btrfs) sorry for the missing precision here ... I don't mean /root but the root filesystem here for sure ... Stefan
Re: [gentoo-user] boot problems
Am 15.05.2014 20:33, schrieb Canek Peláez Valdés: On Thu, May 15, 2014 at 1:27 PM, Stefan G. Weichinger li...@xunil.at wrote: Am 15.05.2014 20:05, schrieb Canek Peláez Valdés: With -H, you don't get the kernel cmdline, and therefore your kernel cannot load your LVM volumes since it doesn't know their... names? I don't knot the terminology. In any case, you need to set --hostonly-cmdline (or hostonly_cmdline=yes in the config file), *besides* -H. ok ... I pulled your changes (kerninst) from github ... on the web I see it, but it doesn't get into my copy here ... strange. As I don't need it right now, I will (a) wait or (b) edit manually. No problem. I actually *removed* -H from kerninst. That should be configured in the user's dracut.conf; now I have: hostonly=yes hostonly_cmdline=yes in my dracut.conf. Yes, I understood ... thanks. Aside from that a more general question: Does it it any way help to have a *small* (= as small as possible) initramfs? Maybe on embedded systems but on the big multi-GB-ram-machines we use it doesn't make much difference, right? I ask because in all my reorganizing furor I also thought that now with btrfs only I could get rid of lvm mdraid as dracut-modules. I can try ... ;-) (don't call me ricer) Additional in this context: does it make a noticeable difference which Kernel compression mode you choose? I assume it is again an issue for systems with (a) small boot-partitions and/or (b) slower CPUs to select something special here. I checked and see that I use LZ4 anyway already ... seems to be the fastest to unpack as far as I understand the help text. - And then, who writes the howto condensed out of this thread? ;-) Much to learn and understand as always, I appreciate it a lot. Stefan
Re: [gentoo-user] boot problems
Am 16.05.2014 13:56, schrieb Bruce Schultz: I ask because in all my reorganizing furor I also thought that now with btrfs only I could get rid of lvm mdraid as dracut-modules. I can try ... ;-) (don't call me ricer) If you have a multi-disk btrfs, I think you need to add the btrfs dracut module. At least that's how I remember it, but its been a while my memory could be failing me, or it could well have changed since then. I currently have in /etc/dracut.conf: add_dracutmodules+=bash systemd hostonly=yes hostonly_cmdline=yes and am able to boot via grub2 and efi, that means, /boot/efi (vfat) on /dev/sda1 (sda is the SSD) and / as btrfs-subvol on /dev/sda2 (with /boot as directory on it). So no multi-disk btrfs for / or /boot on this machine. - removing lvm mdraid from dracut slimmed down the initrd from around 6.8 MB to 5.5 MB ... nice, but not necessary as Canek mentioned. I just play with it to learn and understand even better. I am not sure what the module systemd does or is good for, and https://www.kernel.org/pub/linux/utils/boot/dracut/dracut.html#dracut.kernel does look scary and didn't tell me more about that module yet. I will read more when I find the time, for now it works very well here. Stefan
Re: [gentoo-user] boot problems
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Am 16.05.2014 14:03, schrieb Neil Bothwick: On Fri, 16 May 2014 07:14:27 -0400, cov...@ccs.covici.com wrote: So far, I have liked lvm, what's the advantage of btrfs over lvm? I have only looked at btrfs, with a consideration for switching from ZFS, but it seems to offer the same advantages as ZFS. That is, it makes things even easier than LVM does. with LVM you can easily resize volumes and the filesystems on them, but it is still two or three steps, more if you add RAID into the equation. The modern filesystems do it all at once. If you need a bigger var, you just tell it so. And it is exactly the same process for shrinking a volume, something that can be tricky with LVM because of the need to handle volume and filesystem separately. btrfs and zfs are removing the various layers we all had to deal with: partitions, logical volumes, raid-arrays, filesystems, and then snapshots etc. With these modern filesystems you are able to basically say: I have these physical devices/disks, create me a pool of storage with these properties and then just use that pool in a flexible and dynamic way. Your disk based storage is then usable in a way RAM is, you add it and it is available and you can then use it where you like it. No (or let's say much less ...) fixed and hard barriers like partition sizes, if you need space for /var, use it ... if you want to set quotas on /home, just set them for the subvolume, if you add another pair of harddisks, tell btrfs to redistribute redundancy information (re-balance). (I see that Alan right now answered basically the same ;-) ). You get checksums for your blocks and the possibility to repair rotted blocks ... you get snapshots within the filesystem, no more slow rsnapshot-crontabs ... I used zfs-fuse back then and learned about the concepts, and it blew my mind already years ago ;-) zfs on linux ... it works fine for me on one server, but I never really wanted it on my main machines (desktop and laptops) although I once even wrote some how to use zfs on your fully encrypted laptop for a magazine. It always feels like suboptimal because it is not in the kernel to me (think licensing issues here). btrfs is officially in the kernel, still marked experimental because it is in active development, after all I read over the last days it should be quite stable to use if you don't run very complex setups or so ... and doing regular backups should be usual for the people in this list, I assume? Distros like SLES come with btrfs as default fs (soon). I migrated ~3 machines to btrfs in the last days and I really love getting rid of all the partitions and raids that grew over the years ... for now it is cleaned up and flexible and so far solid. btrfs and zfs have different concepts for various aspects, but basically the same goals. I definitely recommend to get in touch with this generation of filesystems. Stefan -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.22 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQIcBAEBAgAGBQJTdgX8AAoJEClcuD1V0PzmUV0P/1wy3kioRTDQ0YAI8N605wFX wK+FbEXIR09EZ4Q7xukWrJFVo0NGFEU/Sf7N9RomLg83iaDEEaz3HJRGkNotL4aH LeAj0OpILF/7W1lR0bxNAzHNyMawbtrM8mZ9+kNZ8VJFYOq+48tFF/07P18RqDMg 2iw/R6+sXEyS5eMDj32O57uqu8cTK+s8UzIuXABSP/7bFyTj6J5flusZwaKRMtbX iQBdCGasPrDJHIYtEdC3/D/qC+ZJHiNFX8OGNESvDsrAorD38hemuOK3z6oYXegO FxEnF4UvAuBYt+sfYtpvDYyju4IyfGAcbtopPOHDgCrTx/23rqSnreq+OLUEITWL 7mkPnmt3UtkpUDgC8S7y2Xkw5LK9t3espePucv5vKqZJRctRxoMIFeKylPQrrMaP NL6NtrGIBa6iJoPF6lrazNWkaZF6fDUKs6U2BWVReqPZICziUK6T3pLjkNK57tS2 tReLqf8B6OAUHSpWp8lUWBI/Fg+2G4Y4w6mDwxxhUHSuWqQMtZmGTV0BMKHWLJY0 JV8+99dGRcPLNmbocQZqJRrcITMXXEBtMztynXAZ+G4XEwaTgbuH3It3Sp07stiN yns3MN4OoY3/edrOZE653LlX/ffAzQI7HsBo7lXfSBJ5kIHm4QGzls1Lv7DrNJkt ym/IQD3Y8fRBeOtK/vYO =+F6u -END PGP SIGNATURE-
Re: [gentoo-user] problems getting systemd to work
Am 16.05.2014 12:53, schrieb cov...@ccs.covici.com: Now for some systemd problems. The root file system was read only when I logged in, but I could remount it rw -- not sure why this was happening. Some units did start, but most did not. Maybe you only got into emergency mode? Also, even though my network names were correct, they did not come up, but I will try to look in the logs to see why not. So we have made some progress, but still a long way to go yet. Note also, that I am not booting into a display manager, just a regular console. What a lot of work just to get the system booted! Oh yes! very complex stuff all around. If you want send me the log off-list, I am curious to read through it. This really gets a challenge here ;-) Stefan
[gentoo-user] Re: LVM
Am 16.05.2014 13:06, schrieb Alan McKinnon: LVM is an excellent solution for what it was designed to do, which is to deal with stuff like this: Oops. I misjudged how big /var/log needed to be and now I need to add 50G to that partition. But it's sda6 and I have up to sda8. Argggh! Now I need 5 hour downtime to play 15-pieces with fdisk. LVM makes that 2 commands and 12 seconds. Yes, it's a bit complex and you have to hold the PV/VG/LV model in your head, but it also *fixes* the issue with rigid MSDOS partition style. Modern filesystems like ZFS and btrfs sidestep the need for LVM in a really elegant and wonderful way, none of which changes the fact that ZFS/btrfs weren't around when LVM was first coded. exactly. I loved LVM when it was new as it was a way to get the mentioned capability to resize filesystems and underlying partitions. And I still use it for servers, creating a VG on the mdadm-RAID-array and only providing a part of it for the customers ... if they then fill up their samba-shares with cat pictures I can easily ssh in and give them some more space in a minute ... that is nice to have! OK, I also had some issues with LVM over the years ... but not in a regular way, more when physical volumes got flaky or so. In general it just works for me (and show me one piece of tech where you are guaranteed to not have issues with ...) But sure, now I also think of using btrfs on one of the next fileservers I deliver ... and instead of using rsnapshots to give customers a readonly history of their data there could be btrfs-snapshots. time changes, things develop ... Stefan
Re: [gentoo-user] boot problems
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Am 16.05.2014 14:43, schrieb Neil Bothwick: On Fri, 16 May 2014 14:35:08 +0200, Stefan G. Weichinger wrote: zfs on linux ... it works fine for me on one server, but I never really wanted it on my main machines (desktop and laptops) although I once even wrote some how to use zfs on your fully encrypted laptop for a magazine. It always feels like suboptimal because it is not in the kernel to me (think licensing issues here). That's why I'm looking at btrfs. ZFS is great, it does all I want it to. But it is not in the kernel, which is not a major issue. More important is that it is based on an old version of ZFS, later versions are still closed source. That's a shame, because they support neat things like encryption (yet another separate layer got rid of) and it means ZFS on Linux can't really go anywhere beyond bug fixes and minor tweaks. Yes, this way one gets stuck somehow with ZFSonLinux. btrfs also does not yet support encryption ... I assume that will come over the time, I don't know if this is still correct: https://btrfs.wiki.kernel.org/index.php/Project_ideas#Encryption But the features available already are great ... https://btrfs.wiki.kernel.org/index.php/Main_Page#Features ;-) -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.22 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQIcBAEBAgAGBQJTdgyvAAoJEClcuD1V0PzmtWsQAIzyrvFT7gp6WblJi3tXtiDN pj/o4mVLGfQ99jT4eyEi3W3mTs6z1dnLk2tfg5PRmI+tAkV4Y/M/AQ4oKuRWqYGo zK6NFREqTQJlwRvHW1dZAWmOA0Jn2IRqPhfr6Q5ZoBMKhVJhS6zqjTvtxQc7qVwr TZCmkCtBHp8OY/lYD2wZpvqVYjZFcKDvtIXPEwGFCwoeQvn0QcYvdVGWTWe5kCvN JwC3ry6UlKXscqfwTUqqio6vcyxgpr0Pqun908oE0XT0UeIhySB2l6eVVgHc6I4S t5tIOngeqOEaIECchjmkuhau8lkQGUIZyIuzHqi/36TBmiWitHx91FrhONbj1TC7 qQywCcf0oRamBzelYGywqLPmH7Gjh0OXV9eXRNDCeyd5WXOPqBPxdR7jGLNX9G/Z vbD7jiPHOu/DyY96Ks/RiHkiFtfG2pzMivRF8Vu5pUf8H6KmLShm71yOGf+AsxtE BLDR2t1ibscd6FHlZ6kDQHkdDMf4wssDzP2ASiH8Std5vFVSJyNGC4VNkHSkNzLP JTFLAI6Q1hy5k6GkleioVNGVaMQCp09L8aY5pCherAAN+wE2POEyx0z3eHIK3Cxg m1AQWJVOIn7+ykBwJkLF4NgJEDGQ9L4J6GR0rUA+i6/x0nvUiizKPCeNdTv9O4Of GaoiLnwuetJaCLIzDnhY =MTN5 -END PGP SIGNATURE-
Re: [gentoo-user] boot problems
Am 16.05.2014 14:54, schrieb cov...@ccs.covici.com: Thanks much for that explanation. So where do I find some documentation for btrfs and its user space tools? There are many howtos and wiki-pages ... some examples, gentoo-related: https://btrfs.wiki.kernel.org/index.php/Getting_started http://www.funtoo.org/BTRFS_Fun Stefan
Re: [gentoo-user] Can't Get Systemd to Work
Am 16.05.2014 15:33, schrieb Hunter Jozwiak: -Original Message- From: Neil Bothwick [mailto:n...@digimed.co.uk] Sent: Friday, May 16, 2014 8:06 AM To: gentoo-user@lists.gentoo.org Subject: Re: [gentoo-user] Can't Get Systemd to Work On Fri, 16 May 2014 07:34:16 -0400, Hunter Jozwiak wrote: Hi all. I am having issues with Systemd as well. I added to the GRUB2 configuration file the needed command line to get Systemd to start, but for whatever reason, the kernel is adamant that I must use OrenRC. You need to tell us what you added and what the kernel complained about. The only information we have is what is in your mail, we are not the NSA, we cannot see what is on your computer. I recompiled with Genkernel-next a new kernel and initramfs, and that, for whatever reason, doesn't automount my /boot partition. Is there a fix to this? It is standard practice to not mount the /boot partition. By the time the boot process gets to mounting what is in /etc/fstab, /boot is no longer needed. That's why it is usually set to noauto in fstab. -- Neil Bothwick Guns don't kill people--it's those little pieces of lead. GRUB_CMD_LINE_LINUX=init=/usr/lib/system/system, rather. where is the quote, where is the text? And it's called systemd with a d - GRUB_CMD_LINE_LINUX=init=/usr/lib/system/systemd btw
Re: [gentoo-user] Can't Get Systemd to Work
Am 16.05.2014 15:50, schrieb Hunter Jozwiak: btw Changed the line to mirror that in the Grub file, no luck. #Append parameters to the Linux Kernel. GRUB_CMD_LINE_LINUX=init=/usr/lib/system/systemd Save the file. Mount /dev/sda2 /boot grub2-mkconfig -o /boot/grub/grub.cfg Why sda2 ? usually sda1 is /boot or / ... Show us lsblk and /etc/fstab ... we have very little information yet. And what is no luck ? What do you get? Stefan
Re: [gentoo-user] Can't Get Systemd to Work
Am 16.05.2014 16:00, schrieb Jc García: The same again you are mistyping systemd, is /usr/lib/systemd/systemd read carefully what you copy, and verify always those paths really exist. If you had done this, you would have noticed /usr/lib/system/system doesn't exist at all. ( Ah, I only spotted one missing d ... *oops* )
Re: [gentoo-user] btrfs conversion: first impressions
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Am 14.05.2014 11:30, schrieb Stefan G. Weichinger: But the encryption topic for me is interesting because I right now have it mixed on my thinkpad: sda1 - /boot/efi sda2 - btrfs - root etc sda3 - cryptsetup-partition - /home on it with ext4-fs I just now converted the ext4 to btrfs and edited pam_mount.conf.xml ... works! I just have to clean up the top level volume of btrfs as one should use a subvolume for the actual data. Now to changing the luks-passphrase and teaching gnome-something to unlock it. Weak old passphrase/password ... -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.22 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQIcBAEBAgAGBQJTdFwNAAoJEClcuD1V0PzmTJEQALC4p9+CxPJYhQrD7GIi4oqH tulczyMgi21GmmGKmsonhR//ZlwIWn2XAljwvEpmHREaDq/o+7dqh1aLABVjFeQN a+adtBZBNEBW8gWuRksXpf4AjQSB1OKRvcZ6nabnrgKTUMgiB7OcaxE7JBowPwwk BlxyVGmcmXKuFEXyMsQCdfcEU5/jPVFNB14hcMS4DmxLjVlLMhgEyGVY8qKjdPOs vFlxX3t01KQWam5kHtQ2BoUmBGVRTO4DqPtrLHuRVBOT6MToBhbTJZJupzx54kDE kLjie57K3gmoptAdLEVJjcv44hzK+VpPa+d0Fusl6VXNkB1CTaJl2CF53f5rZWXj aWc+psEgEsXibyXQSoj6vctQft9OMgn0bpTwKd7nA11jS+ANOcusOJbL8rDnSXNu zMk4KSL+CPLo+XkwtBIjI8k+fJMNh1rufvdcTvqBADiJSi67wMIsdlH8hal4O2Cb /X8BqApZQfTSWyDEq8KVUecMEIK5fINENqU+PQHHvAs36OemFMQ2Bf+Z6gjN9w3T cA14SOQquXVBkK2sd4BLmVReY0Gd8ulGw1EmVxSJ7l0VMk/amSsvq689UsFfxLC0 aCkn57ih4aEPRbOzwlsQg1tNhjD7D3rTVfJWUtblZSDddgKTyzqnzeHtwHMwIbJ7 xaRJGuOn8Lf7DXHbbMti =hUHb -END PGP SIGNATURE-
Re: [gentoo-user] boot problems
Am 15.05.2014 08:49, schrieb Canek Peláez Valdés: On Thu, May 15, 2014 at 1:21 AM, Canek Peláez Valdés can...@gmail.com wrote: On Mon, May 5, 2014 at 1:40 AM, Canek Peláez Valdés can...@gmail.com wrote: [ It's been more than a week since I last participated in the thread, so I'm just replying to my last participation. ] Stefan, have you tried to run dracut --print-cmdline and add that to your kernel command line? By the last thread related to systemd+dracut, that solved my problems when using dracut 037. Could you try to see if it solves your issues? Also, I just noticed the --hostonly-cmdline option. Have you tried that? Nope. I am away from LVM RAID now as mentioned in the other thread ... btrfs everywhere ;-) Stefan
Re: [gentoo-user] boot problems
Am 15.05.2014 09:08, schrieb Stefan G. Weichinger: Am 15.05.2014 08:49, schrieb Canek Peláez Valdés: On Thu, May 15, 2014 at 1:21 AM, Canek Peláez Valdés can...@gmail.com wrote: On Mon, May 5, 2014 at 1:40 AM, Canek Peláez Valdés can...@gmail.com wrote: [ It's been more than a week since I last participated in the thread, so I'm just replying to my last participation. ] Stefan, have you tried to run dracut --print-cmdline and add that to your kernel command line? By the last thread related to systemd+dracut, that solved my problems when using dracut 037. Could you try to see if it solves your issues? Also, I just noticed the --hostonly-cmdline option. Have you tried that? Nope. I am away from LVM RAID now as mentioned in the other thread ... btrfs everywhere ;-) Aside from that: I always use your tool kerninst so I have -H set as well. Stefan
Re: [gentoo-user] problems getting systemd to work
Am 15.05.2014 11:39, schrieb cov...@ccs.covici.com: I did not try the -H, I may test with that later. I did look at the --print-cmdline and copied the volumes they mentioned, but I have other lvm volumes in my fstab and none of them were activated, only the ones I specified in the command line! This is where I have run into problems. I have quite a few lvms, I want them all activated! Sure. I remember having an extra lvm.service for systemd to have all the LVs activated ... with that unit-file it worked more reliably for me (maybe not needed since some time). For sure that service file is only run *after* the initrd has found/activated/mounted your LVM-based root ... might be a workaround to specify the root-LV in the kernel command line (plus maybe rd.auto rd.lvm=1 ?) and then let the service file activate the rest of the LVs. Just to get you started at last ;-) Also, since I wrote the last message, I have been looking at the journalctl output and discovered a couple of things which I would like some help on, but getting the lvms to work is more important. First, whatever happened to DefaultControllers -- I want to disable those cpu hierarchies, but that option seems to have disappeared without a trace, although you can google and see it in some documentation. The keyword also was not accepted in an install section I have, what is the matter with that? What keyword? I don't understand right now. I want to use my sysklogd for my syslog, how can I use that with systemd? systemd's journal will be written to a socket if you configure it in /etc/systemd/journald.conf I would check man journald.conf and the option: ForwardToSyslog= and then let your chosen log-daemon listen there. IMO you should take a look at journalctl then anyway ... new concepts, but powerful features. Stefan
Re: [gentoo-user] boot problems
Am 15.05.2014 11:58, schrieb cov...@ccs.covici.com: What is kerninst? I do not see it in the repository. https://github.com/canek-pelaez/kerninst ... but it uses GRUB2
Re: [gentoo-user] problems getting systemd to work
Am 15.05.2014 12:19, schrieb cov...@ccs.covici.com: Sure, but what I was looking for was a way to start syslogd and klogd using systemd -- I do have a socket option so they can listen on the socket so that should be OK. So you look for service files? A quick google finds examples for these 2 daemons here: http://www.linuxfromscratch.org/hints/downloads/files/systemd.txt If they work it would be great to file a bug for adding systemd unit files to app-admin/sysklogd at bugs.gentoo.org ( I didn't check if the ebuild brings unit-files but at least I see it doesn't have a systemd USE flag). Stefan
Re: [gentoo-user] problems getting systemd to work
Am 15.05.2014 13:50, schrieb cov...@ccs.covici.com: Canek Peláez Valdés can...@gmail.com wrote: On Thu, May 15, 2014 at 1:18 AM, Canek Peláez Valdés can...@gmail.com wrote: On Wed, May 14, 2014 at 5:26 PM, cov...@ccs.covici.com wrote: [snip] Well, the workaround sort of worked -- it went through the initrd -- I had debug in the kernel command line, but it did not stop for nothing! When it went to the real root, however it did not activate any of the lvm volumes I had except for what I specified in the kernel command line, causing things not to work well. Also, I noticed that if insisted on using the predictable network names, even though I have /etc/udev/rules.d/70-persistent-net.rules and /etc/udev/rules.d/80-name-slot.rules which work fine in openrc to give me back my eth* names. So all in all, it was a mess and took me to an emergency shell and that was the end of that. I did eventually activate some volumes by lvchange -aay, but obviously that would not work well. OK, I was a little mystified about why dracut-036 worked on my system and 037 didn't. Before I tried any workaround, I wanted to know what changed from the previous version to the current one. So I generated an initramfs with dracut-036-r4 and another one with dracut-037-r1, and I tried to see what changed from one to the other. The answer is surprisingly easy: in /etc/cmdline.d/, the following files where in the 036-r4 version, but not in the 037-r4: 90crypt.conf 90lvm.conf 90mdraid.conf base.conf Te contents of those files are (90crypt.conf is empty): 90lvm.conf rd.lvm.lv=vg/vol1 rd.lvm.lv=vg/vol4 rd.lvm.lv=vg/vol3 90mdraid.conf rd.md.uuid=f4a59e68:fbe4039f:a39fc86d:e9e91e12 base.conf ro So I just changed my /etc/default/grub file: GRUB_CMDLINE_LINUX=init=/usr/lib/systemd/systemd quiet nosplash rd.lvm.lv=vg/vol1 rd.lvm.lv=vg/vol4 rd.lvm.lv=vg/vol3 rd.md.uuid=f4a59e68:fbe4039f:a39fc86d:e9e91e12 I regenerated my GRUB2 config, and now again my LVM test system works perfectly with the latest dracut version. I'm an idiot; I didn't saw the documentation about hostonly_cmdline; BTW Jc, you used host_cmdline, I think the former is the correct one. So, to resume: there is no bug, is just that before hostonly_cmdline was yes by default, and now is no by default. This change was documented, but I failed to notice it (and I think the ebuild in Gentoo should print an einfo message). Anyway, I think that explains all my problems; John, I don't know if it will solve yours. Again: did you used dracut --print-cmdline to get the command line? Also, have you tried to use -H to generate your initramfs? And finally, have you tried with --hostonly-cmdline? OK, I was looking through the journal output and I think the key to the lvm's not activating is the following: 4 12:54:57 ccs systemd[1]: Got notification message for unit systemd-journald.service 4 12:54:57 ccs systemd[1]: systemd-journald.service: Got notification message from PID 1750 (WATCHDOG=1...) 4 12:54:57 ccs systemd[1]: systemd-journald.service: got WATCHDOG=1 4 12:54:57 ccs systemd[1]: Received SIGCHLD from PID 2603 (lvm). 4 12:54:57 ccs systemd[1]: Child 2602 (lvm) died (code=exited, status=5/NOTINSSTALLED) 4 12:54:57 ccs systemd[1]: Child 2603 (lvm) died (code=exited, status=5/NOTINSSTALLED) 4 12:54:57 ccs systemd[1]: Child 2610 (lvm) died (code=exited, status=5/NOTINSSTALLED) 4 12:54:57 ccs systemd[1]: Job dev-mapper-linux\x2d\x2dfiles\x2dportage.device/start timed out. So what is not installed? My search tells me that this might be a misinterpreted return code. I might repeat myself but the thread gets quite large now: Did you enable lvm2-lvmetad.service or socket (and set use_lvmetad=1 in lvm.conf)? I think you don't have to, I just ask to check. What release of lvm2, btw? Also, for the first two lines, I get hundreds of thatpair of lines, how can I prevent such. The PID1 stuff ? So, between the lvm problem and the udev renaming my eth0 devices these are the key as to why things are going wrong -- with openrc udev is not renaming eth0 at all. We'll take care of eth0 as well as soon your box boots correctly ;-) Stefan
Re: [gentoo-user] problems getting systemd to work
Am 15.05.2014 14:38, schrieb cov...@ccs.covici.com: Stefan G. Weichinger li...@xunil.at wrote: Am 15.05.2014 13:50, schrieb cov...@ccs.covici.com: Canek Peláez Valdés can...@gmail.com wrote: On Thu, May 15, 2014 at 1:18 AM, Canek Peláez Valdés can...@gmail.com wrote: On Wed, May 14, 2014 at 5:26 PM, cov...@ccs.covici.com wrote: [snip] Well, the workaround sort of worked -- it went through the initrd -- I had debug in the kernel command line, but it did not stop for nothing! When it went to the real root, however it did not activate any of the lvm volumes I had except for what I specified in the kernel command line, causing things not to work well. Also, I noticed that if insisted on using the predictable network names, even though I have /etc/udev/rules.d/70-persistent-net.rules and /etc/udev/rules.d/80-name-slot.rules which work fine in openrc to give me back my eth* names. So all in all, it was a mess and took me to an emergency shell and that was the end of that. I did eventually activate some volumes by lvchange -aay, but obviously that would not work well. OK, I was a little mystified about why dracut-036 worked on my system and 037 didn't. Before I tried any workaround, I wanted to know what changed from the previous version to the current one. So I generated an initramfs with dracut-036-r4 and another one with dracut-037-r1, and I tried to see what changed from one to the other. The answer is surprisingly easy: in /etc/cmdline.d/, the following files where in the 036-r4 version, but not in the 037-r4: 90crypt.conf 90lvm.conf 90mdraid.conf base.conf Te contents of those files are (90crypt.conf is empty): 90lvm.conf rd.lvm.lv=vg/vol1 rd.lvm.lv=vg/vol4 rd.lvm.lv=vg/vol3 90mdraid.conf rd.md.uuid=f4a59e68:fbe4039f:a39fc86d:e9e91e12 base.conf ro So I just changed my /etc/default/grub file: GRUB_CMDLINE_LINUX=init=/usr/lib/systemd/systemd quiet nosplash rd.lvm.lv=vg/vol1 rd.lvm.lv=vg/vol4 rd.lvm.lv=vg/vol3 rd.md.uuid=f4a59e68:fbe4039f:a39fc86d:e9e91e12 I regenerated my GRUB2 config, and now again my LVM test system works perfectly with the latest dracut version. I'm an idiot; I didn't saw the documentation about hostonly_cmdline; BTW Jc, you used host_cmdline, I think the former is the correct one. So, to resume: there is no bug, is just that before hostonly_cmdline was yes by default, and now is no by default. This change was documented, but I failed to notice it (and I think the ebuild in Gentoo should print an einfo message). Anyway, I think that explains all my problems; John, I don't know if it will solve yours. Again: did you used dracut --print-cmdline to get the command line? Also, have you tried to use -H to generate your initramfs? And finally, have you tried with --hostonly-cmdline? OK, I was looking through the journal output and I think the key to the lvm's not activating is the following: 4 12:54:57 ccs systemd[1]: Got notification message for unit systemd-journald.service 4 12:54:57 ccs systemd[1]: systemd-journald.service: Got notification message from PID 1750 (WATCHDOG=1...) 4 12:54:57 ccs systemd[1]: systemd-journald.service: got WATCHDOG=1 4 12:54:57 ccs systemd[1]: Received SIGCHLD from PID 2603 (lvm). 4 12:54:57 ccs systemd[1]: Child 2602 (lvm) died (code=exited, status=5/NOTINSSTALLED) 4 12:54:57 ccs systemd[1]: Child 2603 (lvm) died (code=exited, status=5/NOTINSSTALLED) 4 12:54:57 ccs systemd[1]: Child 2610 (lvm) died (code=exited, status=5/NOTINSSTALLED) 4 12:54:57 ccs systemd[1]: Job dev-mapper-linux\x2d\x2dfiles\x2dportage.device/start timed out. So what is not installed? My search tells me that this might be a misinterpreted return code. I might repeat myself but the thread gets quite large now: Did you enable lvm2-lvmetad.service or socket (and set use_lvmetad=1 in lvm.conf)? Yep, did not see that starting. I think you don't have to, I just ask to check. What release of lvm2, btw? 105-r2 Would you test downgrading to 2.02.104 for checking if that changes something? Or 2.02.106 ... I find various bugs on b.g.o. around lvm2 Stefan
Re: [gentoo-user] problems getting systemd to work
Am 15.05.2014 20:23, schrieb Canek Peláez Valdés: John, could you please include here the output of lsblk, your fstab, your dracut.conf, and your lilo.conf? .. I agree! it's hard to keep track and overview in here :-)
Re: [gentoo-user] boot problems
Am 15.05.2014 20:05, schrieb Canek Peláez Valdés: With -H, you don't get the kernel cmdline, and therefore your kernel cannot load your LVM volumes since it doesn't know their... names? I don't knot the terminology. In any case, you need to set --hostonly-cmdline (or hostonly_cmdline=yes in the config file), *besides* -H. ok ... I pulled your changes (kerninst) from github ... on the web I see it, but it doesn't get into my copy here ... strange. As I don't need it right now, I will (a) wait or (b) edit manually. No problem.
Re: [gentoo-user] boot problems
Am 15.05.2014 20:27, schrieb Stefan G. Weichinger: Am 15.05.2014 20:05, schrieb Canek Peláez Valdés: With -H, you don't get the kernel cmdline, and therefore your kernel cannot load your LVM volumes since it doesn't know their... names? I don't knot the terminology. In any case, you need to set --hostonly-cmdline (or hostonly_cmdline=yes in the config file), *besides* -H. ok ... I pulled your changes (kerninst) from github ... on the web I see it, but it doesn't get into my copy here ... strange. As I don't need it right now, I will (a) wait or (b) edit manually. forget that. I had local changes ... git pull works.
Re: [gentoo-user] problems getting systemd to work
Am 15.05.2014 22:38, schrieb cov...@ccs.covici.com: image=/boot/vmlinuz-3.6.2-gentoo phew. 3.6.2 is from October 2012 ... Did you recompile it with the suggested options for systemd? Maybe it doesn't matter, but just a thought ... that kernel is quite old. Stefan
Re: [gentoo-user] btrfs conversion: first impressions
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Am 14.05.2014 02:39, schrieb Neil Bothwick: Doesn't that screw up the whole idea of checksumming etc ? Not to my mind. The bits are recorded and checksummed, that's what matters. If a bit on a platter is flipped, the decrypted bits will also change. But then the container of the btrfs would be corrupted, right? In my understanding the FS (=btrfs or zfs) should have the direct contact to the metal (=hdd/sdd) to be fully able to detect bitrot and stuff. It is a recommended method of encryption in the BTRFS FAQ. https://btrfs.wiki.kernel.org/index.php/FAQ#Does_btrfs_support_encryption.3F As btrfs does not support encryption itself, this or ecryptfs are the only options. Yes, I saw that as well. Will give it a try sometimes soon ... S -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.22 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQIcBAEBAgAGBQJTcyLmAAoJEClcuD1V0PzmV2MP+wWqxS7BhG2RcWgXsDycgstu yosr450brlmx+NRD4PUq47yj+GTsum/9l2WdxAlDZA90f8CaJefnWK9csNLhGBMA BqFT69WNSJEmOJ2l8x2FHZJ1gjyMOQp16q7r0d1G7Asdoubhx/uRSeSjJEnk5gqu UVA77/jbJ1CJSAv4ATnGl67RHWew3KR99VZbbFs7Cr3fjbOZmqWpuSKbf6ZdylHO UatP/sc+ye09sSpUWW5Q4i8v8gF0XC/qy80iPLy84G0+IzDaNaoTfQY3Ff2+u9Nn OAhn8lT/HmMJiJUTp4YeAVjzLIx+Nq2NrAqEoaIqER1sfGH5bh2oK5yiJ+mW/8cQ 4OBdcQXoXnDtyQvoT69EELq+vsm5nVi8ibb/msE9r9ImE2FJ+2mHKadFpluBGCnX xApAaxqkX4lPEphpysdlcq9GF1/eSyGRFM/3tDM/vefy9VokjhXHXAbZ2jhfSoTS PfWZpxi8sur3z/s/sIVaqMbLG8IdjOfoGKTgtzoYHVqvtlYxOubbvh52iI58CCL7 0LblkAeOSlk2UITYMV+yF3WB0naRjO41LngwwmxcJyRsJDvrzQkSEvhtWaJ9Qlh5 d/k6f2y/hDrpITLxf5C+I1/mg8WDtmgODczUTlSj+u6NCLMUT0onv5XdsEQXuGX6 7yFDEdLFjPEpGoMIBLO/ =dRlH -END PGP SIGNATURE-
Re: [gentoo-user] btrfs conversion: first impressions
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Am 14.05.2014 10:42, schrieb Neil Bothwick: On Wed, 14 May 2014 10:01:42 +0200, Stefan G. Weichinger wrote: But then the container of the btrfs would be corrupted, right? No, because each element of the RAID is encrypted separately, so btrfs can still use the good one to repair the bad one. If you were to create an mdadm array, put dm-crypt on that and then btrfs on top, which is more efficient because it encrypts each byte only once, then you would lose the check and repair facilities. What RAID? I think of a laptop with only one SSD inside. You mean the duplicated metadata in this case? -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.22 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQIcBAEBAgAGBQJTcy9LAAoJEClcuD1V0PzmacMP/0kSvPhK5iShKxwAQnJfuSRP S0Q+d1etq/H6TJoBCwRDuu1OLEU2iiyeOcMgPn7ZsFnFgP3joiNtV2OOVioFFbSY 7DvHujkSuTGrD3KxWGV59dZp1TCEX1UYL/L0UOkSujzDvspB1io7mbbEqlAhARpw 79cHZjMSK4juf6Go21Dos1Fnj5peSLPBASVZl7qmRjORZukZMOh70wVEcVcEVwoW VGDnme21GuaiMZn862ha1WMfIJVBArPsqial/hSsilS8l9np1IgtgZDUe1uH4VsA botwaEyr3wrPARBOipqLpCPmK/+R8zihFc/pIbO9c2PsSOKiRQPzVq4VAK4KWyc4 IutpBCO6tOpL6QBtjYmqJk+JF02/Bz1EtmaIfvyUSaQ4ZGP0nEb4qB9K+oWMriBd FDsOz2QT9+X+h/S7wfw3OPqCBHuqSlqqkyy/TFwCiO9e0GFLz8HONVV1rP+GeK5c 7Y3UBPbRDIbb4lsaySfDKgMtMDQ59ei6mwQL6A9CyA5MrL1R0wydYvOrkHyTRSHK xy+vuqxL384zHjORWX6uLj1Tu5hbJhG1JgNFrcHMdKwIV6kRJzYMUHMVYmLN+ENX 5Z2IWJRyVlr5yNGE/NoCDJQue2EO9H/gzxpSnwXeFjMpRSuvGN/2Ay2Ml5zSXB6x qrOj0Zp81jcky7zjXp01 =JG2q -END PGP SIGNATURE-
Re: [gentoo-user] btrfs conversion: first impressions
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Am 14.05.2014 11:26, schrieb Neil Bothwick: What RAID? I think of a laptop with only one SSD inside. You mean the duplicated metadata in this case? Ah right. I've got RAID n the brain because I'm currently resizing the partitions for a ZFS RAID so I can try out btrfs... and it's all your fault for starting this thread and piquing my interest in btrfs again! I didn't start it! :-P I also consider moving the data on a ZFS raid on one of my backup servers to a btrfs-based RAID ... But the encryption topic for me is interesting because I right now have it mixed on my thinkpad: sda1 - /boot/efi sda2 - btrfs - root etc sda3 - cryptsetup-partition - /home on it with ext4-fs S -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.22 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQIcBAEBAgAGBQJTczeoAAoJEClcuD1V0PzmT9YQAJKe8jnZN2kcOMuLV+uRfFcH ec8wihdOd9eWGB49GjgETgCdtyN3V36AEsaGjkOCWOOJ5z7e6C7N7Mg00eTpFCe+ 9yXcXL3g/HKDO/iRGNdh8aMqTmkTV+EtL4V/H0UiCH6AOpTT/ruGX0xBJtsVtJ9T p2/wt+uFKWJ7qexEcmS1o2DUDZoD2hzUIIxooiuK1U1V5DTzWFyW67/CuBfG0ol4 n48VfjzMWYN8EtHow3Op3mg1bQB3Bley/eqMUoZcgYG+GsCt1q9z0Cxb94Wiz5Kg l4BNOJDgdE8RZyRbOZ01D5gEk305PKHRaOBnsSmahIGjhB+ukkCv+YaPAecZHy9q 7hVZfyPMN2jqYliQO3kpoukifjcPuhefNor2inpdC0VbKnDs7HbJvihYunbdBJf8 hrP0+ZO2qg7EJQb+jy23YtPSMFmd3Rwvx2MibrkFvjYmqFU7ljDJcqmLYAlxL3uB VekUCHTZlOY9POcV3bt2nrA7kR6rQjdERJEd+Gw1FnPhLGt8c9iRue+bjE/Wg2QG +kbxWVzZ50Z7HCe7aqKE6aCuUSB96miBNntK+MQ+OqF6L9yjMUPlsS2jabqKDeUj VYN21rHj8/SxC2J5vEyAM88Lb4JxLZWqrizicjqCWgxVkQojnr0aWPfQOmC2YJPA WNv7VJxCgHzqXVwxmaOo =R2z9 -END PGP SIGNATURE-
