Grand Evening, /usr is part of / /boot is on it's own / is part of the LVM would that give SP2 a wobbly ? Viktor does this layout look Okay. It's been with us for some time. This on a SP-1 will migrate with out any "nags" but will fail with a missing /dev on the restart ipl --R
dali158:~ # df -h Filesystem Size Used Avail Use% Mounted on devtmpfs 2.0G 0 2.0G 0% /dev tmpfs 2.0G 0 2.0G 0% /dev/shm tmpfs 2.0G 18M 2.0G 1% /run tmpfs 2.0G 0 2.0G 0% /sys/fs/cgroup /dev/mapper/dali158-root 10G 3.7G 6.4G 37% / /dev/sdb1 189M 27M 154M 15% /boot/zipl /dev/mapper/dali158--data-0200 3.0G 1.3G 1.8G 42% /FS/0200 /dev/mapper/dali158--data-SLES11SP1 10G 33M 10G 1% /SLES11SP1 /dev/mapper/dali158--data-WM800 10G 3.0G 7.0G 31% /FS/WM800 /dev/mapper/dali158-tmp 4.0G 33M 4.0G 1% /tmp /dev/mapper/dali158--data-0290 6.0G 4.1G 2.0G 68% /FS/0290 /dev/mapper/dali158--data-0210 10G 9.0G 1.1G 90% /FS/0210 tmpfs 401M 0 401M 0% /run/user/0 daenus01:/vol/nfs_vol0/fs3411 700G 582G 119G 84% /MOUNTS/fs3411 dali158:~ # ll / total 64 lrwxrwxrwx 1 root root 36 Nov 30 10:19 ADAINFRA -> /FS/0210/compsrv/adasvn/sag/adainfra drwxr-xr-x 6 root root 125 Nov 30 10:29 FS lrwxrwxrwx 1 root root 3 Nov 30 10:19 MDISK -> /FS drwxr-xr-x 8 root root 0 Dec 7 20:47 MOUNTS drwxrwxr-x 2 root root 38 Nov 30 10:22 RDS drwxr-xr-x 2 root root 59 Nov 30 09:59 SAG drwxr-xr-x 2 root root 6 May 8 2014 SLES11SP1 drwxrwxr-x 2 root root 6 Nov 30 10:20 SW drwxrwxr-x 2 root root 24 Nov 30 10:21 WM drwxr-xr-x 2 root root 4096 Nov 30 19:10 bin drwxr-xr-x 4 root root 4096 Dec 7 20:47 boot drwxr-xr-x 17 root root 1660 Dec 7 20:47 dev drwxr-xr-x 114 root root 12288 Dec 7 20:47 etc drwxr-xr-x 18 root root 233 Nov 30 10:30 home drwxr-xr-x 13 root root 4096 Dec 6 10:00 lib drwxr-xr-x 6 root root 8192 Dec 6 10:00 lib64 drwxr-xr-x 2 root root 6 Sep 21 2014 mnt drwxr-xr-x 2 root root 21 Nov 30 10:39 opt dr-xr-xr-x 207 root root 0 Dec 7 20:47 proc drwx------ 9 root root 200 Dec 15 16:45 root drwxr-xr-x 24 root root 780 Dec 7 20:51 run drwxr-xr-x 2 root root 12288 Nov 30 19:10 sbin drwxr-xr-x 2 root root 6 Sep 21 2014 selinux drwxr-xr-x 4 root root 28 Nov 29 13:46 srv dr-xr-xr-x 13 root root 0 Dec 7 20:52 sys drwxrwxrwt 10 root root 260 Dec 15 16:46 tmp drwxr-xr-x 13 root root 166 Nov 29 13:46 usr drwxr-xr-x 13 root root 198 Nov 29 13:55 var dali158:~ # ll /usr total 276 drwxr-xr-x 3 root root 19 Nov 29 13:46 X11R6 drwxr-xr-x 2 root root 61440 Dec 7 20:46 bin drwxr-xr-x 2 root root 6 Sep 21 2014 games drwxr-xr-x 58 root root 8192 Nov 30 18:48 include drwxr-xr-x 90 root root 20480 Dec 7 20:46 lib drwxr-xr-x 101 root root 61440 Dec 7 20:46 lib64 drwxr-xr-x 11 root root 116 Nov 29 13:46 local drwxr-xr-x 5 root root 43 Nov 29 13:46 s390x-suse-linux drwxr-xr-x 2 root root 16384 Dec 6 10:00 sbin drwxr-xr-x 186 root root 8192 Nov 30 18:48 share drwxr-xr-x 3 root root 22 Nov 29 13:46 src lrwxrwxrwx 1 root root 10 Nov 29 13:46 tmp -> ../var/tmp dali158:~ # dali158:~ # ll /dev total 0 drwxr-xr-x 2 root root 60 Dec 7 20:47 3270 crw------- 1 root root 10, 235 Dec 7 20:47 autofs drwxr-xr-x 2 root root 360 Dec 7 20:47 block drwxr-xr-x 2 root root 140 Dec 7 20:47 bsg crw------- 1 root root 10, 234 Dec 7 20:47 btrfs-control drwxr-xr-x 2 root root 920 Dec 7 20:47 char crw------- 1 root root 5, 1 Dec 15 16:45 console lrwxrwxrwx 1 root root 11 Dec 7 20:47 core -> /proc/kcore crw------- 1 root root 10, 60 Dec 7 20:47 cpu_dma_latency drwxr-xr-x 2 root root 100 Dec 7 20:47 dali158 drwxr-xr-x 2 root root 140 Dec 7 20:47 dali158-data crw------- 1 root root 10, 56 Dec 7 20:47 dasd_eer lrwxrwxrwx 1 root root 14 Dec 7 20:47 device-mapper -> mapper/control drwxr-xr-x 5 root root 100 Dec 7 20:47 disk brw-rw---- 1 root disk 254, 0 Dec 7 20:47 dm-0 brw-rw---- 1 root disk 254, 1 Dec 7 20:47 dm-1 brw-rw---- 1 root disk 254, 2 Dec 7 20:47 dm-2 brw-rw---- 1 root disk 254, 3 Dec 7 20:47 dm-3 brw-rw---- 1 root disk 254, 4 Dec 7 20:47 dm-4 brw-rw---- 1 root disk 254, 5 Dec 7 20:47 dm-5 brw-rw---- 1 root disk 254, 6 Dec 7 20:47 dm-6 brw-rw---- 1 root disk 254, 7 Dec 7 20:47 dm-7 lrwxrwxrwx 1 root root 13 Dec 7 20:47 fd -> /proc/self/fd crw-rw-rw- 1 root root 1, 7 Dec 7 20:47 full crw-rw-rw- 1 root root 10, 229 Dec 7 20:47 fuse crw--w---- 1 root tty 229, 0 Dec 7 20:48 hvc0 crw------- 1 root root 229, 1 Dec 7 20:47 hvc1 crw------- 1 root root 229, 2 Dec 7 20:47 hvc2 crw------- 1 root root 229, 3 Dec 7 20:47 hvc3 crw------- 1 root root 229, 4 Dec 7 20:47 hvc4 crw------- 1 root root 229, 5 Dec 7 20:47 hvc5 crw------- 1 root root 229, 6 Dec 7 20:47 hvc6 crw------- 1 root root 229, 7 Dec 7 20:47 hvc7 lrwxrwxrwx 1 root root 25 Dec 7 20:47 initctl -> /run/systemd/initctl/fifo drwxr-xr-x 2 root root 60 Dec 7 20:47 input crw-r----- 1 root kmem 1, 2 Dec 7 20:47 kmem crw-r--r-- 1 root root 1, 11 Dec 7 20:47 kmsg crw------- 1 root root 10, 232 Dec 7 20:47 kvm drwxr-xr-x 2 root root 60 Dec 7 20:47 lightnvm lrwxrwxrwx 1 root root 28 Dec 7 20:47 log -> /run/systemd/journal/dev-log crw-rw---- 1 root disk 10, 237 Dec 7 20:47 loop-control drwxr-xr-x 2 root root 220 Dec 7 20:47 mapper crw-r----- 1 root kmem 1, 1 Dec 7 20:47 mem crw------- 1 root root 10, 57 Dec 7 20:47 memory_bandwidth drwxrwxrwt 2 root root 40 Dec 7 20:47 mqueue drwxr-xr-x 2 root root 60 Dec 7 20:47 net crw------- 1 root root 10, 59 Dec 7 20:47 network_latency crw------- 1 root root 10, 58 Dec 7 20:47 network_throughput crw-rw-rw- 1 root root 1, 3 Dec 7 20:47 null crw-r----- 1 root kmem 1, 4 Dec 7 20:47 port cr--r--r-- 1 root root 10, 55 Dec 7 20:47 prandom crw-rw-rw- 1 root tty 5, 2 Dec 15 17:03 ptmx drwxr-xr-x 2 root root 0 Dec 7 20:47 pts crw-rw-rw- 1 root root 1, 8 Dec 7 20:47 random lrwxrwxrwx 1 root root 4 Dec 7 20:47 root -> dm-1 crw------- 1 root root 10, 62 Dec 7 20:47 sclp brw-rw---- 1 root disk 8, 0 Dec 7 20:47 sda brw-rw---- 1 root disk 8, 1 Dec 7 20:47 sda1 brw-rw---- 1 root disk 8, 2 Dec 7 20:47 sda2 brw-rw---- 1 root disk 8, 3 Dec 7 20:47 sda3 brw-rw---- 1 root disk 8, 16 Dec 7 20:47 sdb brw-rw---- 1 root disk 8, 17 Dec 7 20:47 sdb1 brw-rw---- 1 root disk 8, 18 Dec 7 20:47 sdb2 brw-rw---- 1 root disk 8, 32 Dec 7 20:47 sdc crw-rw---- 1 root disk 21, 0 Dec 7 20:47 sg0 crw-rw---- 1 root disk 21, 1 Dec 7 20:47 sg1 crw-rw---- 1 root disk 21, 2 Dec 7 20:47 sg2 drwxrwxrwt 2 root root 40 Dec 7 20:47 shm crw------- 1 root root 10, 231 Dec 7 20:47 snapshot lrwxrwxrwx 1 root root 15 Dec 7 20:47 stderr -> /proc/self/fd/2 lrwxrwxrwx 1 root root 15 Dec 7 20:47 stdin -> /proc/self/fd/0 lrwxrwxrwx 1 root root 15 Dec 7 20:47 stdout -> /proc/self/fd/1 crw-rw-rw- 1 root tty 5, 0 Dec 7 20:47 tty crw--w---- 1 root tty 4, 64 Dec 7 20:48 ttyS0 crw--w---- 1 root tty 4, 65 Dec 7 20:48 ttysclp0 crw-rw-rw- 1 root root 1, 9 Dec 7 20:47 urandom drwxr-xr-x 2 root root 60 Dec 7 20:47 vfio crw------- 1 root root 10, 238 Dec 7 20:47 vhost-net crw------- 1 root root 10, 61 Dec 7 20:47 vmcp prw------- 1 root tty 0 Dec 15 16:45 xconsole crw-rw-rw- 1 root root 1, 5 Dec 7 20:47 zero dali158:~ # -----Original Message----- From: Linux on 390 Port [mailto:LINUX-390@VM.MARIST.EDU] On Behalf Of Viktor Mihajlovski Sent: Donnerstag, 15. Dezember 2016 13:55 To: LINUX-390@VM.MARIST.EDU Subject: Re: systemd Failed unmounting /usr On 14.12.2016 16:31, van Sleeuwen, Berry wrote: > Hi All, > > I have installed a new SLES12 SP2 guest. The root partition is on one > partition (/dev/dasda1). The remaining system directories are stored within > an lvm, rootvg. This lvm contains logical volumes for /usr, /opt, /home, /tmp > and /var. > > During boot, when systemd is started it tries to umount /usr. After a couple > of tries umount ends. But I did have one occasion where the umount apparently > succeeded as the guest came up in emergency mode, without /usr mounted. > > 2016-12-14T15:54:41.052380+01:00 SLES12 systemd[1]: systemd 228 > running in system mode. (+PAM -AUDIT +SELINUX -IMA +APPARMOR -SMACK > +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT -GNUTLS +ACL +XZ -LZ4 +SECCOMP > +BLKID -ELFUTILS +KMOD -IDN) > 2016-12-14T15:54:41.052387+01:00 SLES12 systemd[1]: Detected virtualization > zvm. > 2016-12-14T15:54:41.052389+01:00 SLES12 systemd[1]: Detected architecture > s390x. > 2016-12-14T15:54:41.052391+01:00 SLES12 systemd[1]: Set hostname to <SLES12>. > 2016-12-14T15:54:41.052394+01:00 SLES12 systemd[1]: nss-lookup.target: > Dependency Before=nss-lookup.target dropped > 2016-12-14T15:54:41.052396+01:00 SLES12 systemd-modules-load[784]: Inserted > module 'ecryptfs' > 2016-12-14T15:54:41.052398+01:00 SLES12 umount[774]: umount: /usr: > target is busy > 2016-12-14T15:54:41.052401+01:00 SLES12 umount[774]: (In some cases > useful info about processes that > 2016-12-14T15:54:41.052403+01:00 SLES12 umount[774]: use the device is > found by lsof(8) or fuser(1).) … <snip> … > 2016-12-14T15:54:41.052446+01:00 SLES12 umount[836]: umount: /usr: > target is busy > 2016-12-14T15:54:41.052448+01:00 SLES12 umount[836]: (In some cases > useful info about processes that > 2016-12-14T15:54:41.052450+01:00 SLES12 umount[836]: use the device is > found by lsof(8) or fuser(1).) > 2016-12-14T15:54:41.052453+01:00 SLES12 systemd[1]: usr.mount: Mount > process exited, code=exited status=32 > 2016-12-14T15:54:41.052462+01:00 SLES12 systemd[1]: Failed unmounting /usr. > 2016-12-14T15:54:41.052464+01:00 SLES12 systemd[1]: usr.mount: Unit is bound > to inactive unit dev-mapper-rootvg\x2dusrlv.device. Stopping, too. > 2016-12-14T15:54:41.052466+01:00 SLES12 systemd[1]: Unmounting /usr... > … <snip> … > 2016-12-14T15:54:41.052625+01:00 SLES12 systemd-udevd[855]: Network interface > NamePolicy= disabled by default. > 2016-12-14T15:54:41.052628+01:00 SLES12 umount[864]: umount: /usr: > target is busy > 2016-12-14T15:54:41.052630+01:00 SLES12 umount[864]: (In some cases > useful info about processes that > 2016-12-14T15:54:41.052632+01:00 SLES12 umount[864]: use the device is > found by lsof(8) or fuser(1).) > 2016-12-14T15:54:41.052634+01:00 SLES12 systemd[1]: usr.mount: Mount > process exited, code=exited status=32 > 2016-12-14T15:54:41.052636+01:00 SLES12 systemd[1]: Failed unmounting /usr. > 2016-12-14T15:54:41.052638+01:00 SLES12 systemd[1]: usr.mount: Unit is bound > to inactive unit dev-mapper-rootvg\x2dusrlv.device, but not stopping since we > tried this too often recently. > 2016-12-14T15:54:41.052640+01:00 SLES12 systemd[1]: Stopped File System Check > on /dev/rootvg/usrlv. > 2016-12-14T15:54:41.052643+01:00 SLES12 systemd[1]: Reached target Local File > Systems (Pre). > … Boot continues with starting services etc. > > Why does the startup produce these errors? And how can it be resolved? > > Met vriendelijke groet/With kind regards/Mit freundlichen Grüßen, > Berry van Sleeuwen Flight Forum 3000 5657 EW Eindhoven • +31 (0)6 > 22564276 > [cid:image001.jpg@01CE3508.E10AE080] > [cid:image002.jpg@01CE3508.E10AE080] > > > This e-mail and the documents attached are confidential and intended solely > for the addressee; it may also be privileged. If you receive this e-mail in > error, please notify the sender immediately and destroy it. As its integrity > cannot be secured on the Internet, Atos’ liability cannot be triggered for > the message content. Although the sender endeavours to maintain a computer > virus-free network, the sender does not warrant that this transmission is > virus-free and will not be liable for any damages resulting from any virus > transmitted. On all offers and agreements under which Atos Nederland B.V. > supplies goods and/or services of whatever nature, the Terms of Delivery from > Atos Nederland B.V. exclusively apply. The Terms of Delivery shall be > promptly submitted to you on your request. > Oh yes ... a similar issue has bitten me a few years ago when I was trying to configure the systemd service for the UPS for my server box at home. Anyway, with systemd you are actually discouraged from maintaining a separate /usr filesystem, details here: https://freedesktop.org/wiki/Software/systemd/separate-usr-is-broken/ In a nutshell: I have given up and keep /usr in my root filesystem now. Been a happy systemd camper ever since. -- Mit freundlichen Grüßen/Kind Regards Viktor Mihajlovski IBM Deutschland Research & Development GmbH Vorsitzender des Aufsichtsrats: Martina Köderitz Geschäftsführung: Dirk Wittkopp Sitz der Gesellschaft: Böblingen Registergericht: Amtsgericht Stuttgart, HRB 243294 ---------------------------------------------------------------------- For LINUX-390 subscribe / signoff / archive access instructions, send email to lists...@vm.marist.edu with the message: INFO LINUX-390 or visit http://www.marist.edu/htbin/wlvindex?LINUX-390 ---------------------------------------------------------------------- For more information on Linux on System z, visit http://wiki.linuxvm.org/ Software AG – Sitz/Registered office: Uhlandstraße 12, 64297 Darmstadt, Germany – Registergericht/Commercial register: Darmstadt HRB 1562 - Vorstand/Management Board: Karl-Heinz Streibich (Vorsitzender/Chairman), Eric Duffaut, Dr. Wolfram Jost, Arnd Zinnhardt; - Aufsichtsratsvorsitzender/Chairman of the Supervisory Board: Dr. Andreas Bereczky - http://www.softwareag.com
