Hello,
I cannot tell if this is expected on a node-ng system. I worked hard to
get it up and running like this. 2 Diskless Hosts (EPYC 2x16 Core, 256GB
RAM) boot via ISCSI ibft from Gigabit Onboard, Initial-Ramdisk
establishes multipathing and thats what I get (and want). So i've
redundant connections (1x1GB, 2x10GB Ethernet as bond) to my storage
(Ubuntu Box 1xEPYC 16 Core, 128Gig RAM currently 8 disks, 2xNvME SSD
with ZFS exporting NFS 4.2 and targetcli-fb ISCSI targets). All disk
images on NFS 4.2 and via ISCSI are thin-provisioned and the
sparse-files grow and shrink when discarding in VM's/Host via fstrim.
My exercises doing this also as UEFI boot were stopped by node-ng
installer partitioning which refused to set up a UEFI FAT Boot partition
on the already accessible ISCSI targets.. So systems do legacy BIOS boot
now.
This works happily even if I unplug one of the Ethernet-Cables.
[root@myhostname ~]# multipath -ll
mpath-myhostname-disk1 (36001405a26254e2bfd34b179d6e98ba4) dm-0 LIO-ORG
,myhostname-disk
size=50G features='1 queue_if_no_path' hwhandler='1 alua' wp=rw
|-+- policy='queue-length 0' prio=50 status=active
| `- 3:0:0:0 sdb 8:16 active ready running
|-+- policy='queue-length 0' prio=50 status=enabled
| `- 4:0:0:0 sdc 8:32 active ready running
`-+- policy='queue-length 0' prio=50 status=enabled
`- 0:0:0:0 sda 8:0 active ready running
See attached lsblk.
Am 08.01.2019 um 14:46 schrieb Nir Soffer:
> On Tue, Jan 8, 2019 at 1:29 PM Ralf Schenk <[email protected]
> <mailto:[email protected]>> wrote:
>
> Hello,
>
> I'm running my Ovirt-Node-NG based Hosts off ISCSI root. That is
> what "vdsm-tool config-lvm-filter" suggests. Is this correct ?
>
> [root@myhostname ~]# vdsm-tool config-lvm-filter
> Analyzing host...
> Found these mounted logical volumes on this host:
>
> logical volume: /dev/mapper/onn_myhostname--iscsi-home
> mountpoint: /home
> devices: /dev/mapper/mpath-myhostname-disk1p2
>
> logical volume:
> /dev/mapper/onn_myhostname--iscsi-ovirt--node--ng--4.2.7.1--0.20181209.0+1
> mountpoint: /
> devices: /dev/mapper/mpath-myhostname-disk1p2
>
> logical volume: /dev/mapper/onn_myhostname--iscsi-swap
> mountpoint: [SWAP]
> devices: /dev/mapper/mpath-myhostname-disk1p2
>
> logical volume: /dev/mapper/onn_myhostname--iscsi-tmp
> mountpoint: /tmp
> devices: /dev/mapper/mpath-myhostname-disk1p2
>
> logical volume: /dev/mapper/onn_myhostname--iscsi-var
> mountpoint: /var
> devices: /dev/mapper/mpath-myhostname-disk1p2
>
> logical volume: /dev/mapper/onn_myhostname--iscsi-var_crash
> mountpoint: /var/crash
> devices: /dev/mapper/mpath-myhostname-disk1p2
>
> logical volume: /dev/mapper/onn_myhostname--iscsi-var_log
> mountpoint: /var/log
> devices: /dev/mapper/mpath-myhostname-disk1p2
>
> logical volume: /dev/mapper/onn_myhostname--iscsi-var_log_audit
> mountpoint: /var/log/audit
> devices: /dev/mapper/mpath-myhostname-disk1p2
>
> This is the recommended LVM filter for this host:
>
> filter = [ "a|^/dev/mapper/mpath-myhostname-disk1p2$|", "r|.*|" ]
>
> This filter allows LVM to access the local devices used by the
> hypervisor, but not shared storage owned by Vdsm. If you add a new
> device to the volume group, you will need to edit the filter manually.
>
> Configure LVM filter? [yes,NO]
>
>
> Yoval, is /dev/mapper/mpath-myhostname-disk1p2 expected on node system?
>
> Ralf, can you share the output of:
> lsblk
> multipath -ll
> multipathd show paths format "%d %P"
>
> Nir
>
>
>
>
> Am 05.01.2019 um 19:34 schrieb [email protected]
> <mailto:[email protected]>:
>> Hello Greg,
>>
>> this is what i was looking for.
>>
>> After running "vdsm-tool config-lvm-filter" on all hosts (and rebooting
>> them) all PVs, VGs and LVs from ISCSI domain were not visible anymore to
>> local LVM on the ovirt hosts.
>>
>> Additionally i made following tests:
>> - Cloning + running a VM on the ISCSI domain
>> - Detaching + (re-)attaching of the ISCSI domain
>> - Detaching, removing + (re-)import of the ISCSI domain
>> - Creating new ISCSI domain (well, i needed to use "force operation"
>> because creating on same ISCSI target)
>>
>> All tests were successful.
>>
>> As you wished i filed a bug:
>> <https://github.com/oVirt/ovirt-site/issues/1857>
>> <https://github.com/oVirt/ovirt-site/issues/1857>
>> Thank you.
>>
>> Best regards,
>> Robert
>> _______________________________________________
>> Users mailing list -- [email protected] <mailto:[email protected]>
>> To unsubscribe send an email to [email protected]
>> <mailto:[email protected]>
>> Privacy Statement: https://www.ovirt.org/site/privacy-policy/
>> oVirt Code of Conduct:
>> https://www.ovirt.org/community/about/community-guidelines/
>> List Archives:
>> https://lists.ovirt.org/archives/list/[email protected]/message/VD6WCL343YGB2JVBWPZG54IMSQZ5VZ7M/
> --
>
>
> *Ralf Schenk*
> fon +49 (0) 24 05 / 40 83 70
> fax +49 (0) 24 05 / 40 83 759
> mail *[email protected]* <mailto:[email protected]>
>
> *Databay AG*
> Jens-Otto-Krag-Straße 11
> D-52146 Würselen
> *www.databay.de* <http://www.databay.de>
>
> Sitz/Amtsgericht Aachen • HRB:8437 • USt-IdNr.: DE 210844202
> Vorstand: Ralf Schenk, Dipl.-Ing. Jens Conze, Aresch Yavari,
> Dipl.-Kfm. Philipp Hermanns
> Aufsichtsratsvorsitzender: Wilhelm Dohmen
>
> ------------------------------------------------------------------------
> _______________________________________________
> Users mailing list -- [email protected] <mailto:[email protected]>
> To unsubscribe send an email to [email protected]
> <mailto:[email protected]>
> Privacy Statement: https://www.ovirt.org/site/privacy-policy/
> oVirt Code of Conduct:
> https://www.ovirt.org/community/about/community-guidelines/
> List Archives:
>
> https://lists.ovirt.org/archives/list/[email protected]/message/HX3LO46HW6GERQXDRCLRYUUN2NLURQTK/
>
--
*Ralf Schenk*
fon +49 (0) 24 05 / 40 83 70
fax +49 (0) 24 05 / 40 83 759
mail *[email protected]* <mailto:[email protected]>
*Databay AG*
Jens-Otto-Krag-Straße 11
D-52146 Würselen
*www.databay.de* <http://www.databay.de>
Sitz/Amtsgericht Aachen • HRB:8437 • USt-IdNr.: DE 210844202
Vorstand: Ralf Schenk, Dipl.-Ing. Jens Conze, Aresch Yavari, Dipl.-Kfm.
Philipp Hermanns
Aufsichtsratsvorsitzender: Wilhelm Dohmen
------------------------------------------------------------------------
[root@epycdphv01 ~]# lsblk
NAME
MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sda 8:0
0 50G 0 disk
└─mpath-myhostname-disk1 253:0
0 50G 0 mpath
├─mpath-myhostname-disk1p1 253:1
0 1G 0 part /boot
└─mpath-myhostname-disk1p2 253:2
0 49G 0 part
├─onn_myhostname--iscsi-pool00_tmeta 253:3
0 1G 0 lvm
│ └─onn_myhostname--iscsi-pool00-tpool 253:5
0 35.2G 0 lvm
│ ├─onn_myhostname--iscsi-var_log 253:6
0 8G 0 lvm /var/log
│ ├─onn_myhostname--iscsi-var 253:8
0 15G 0 lvm /var
│ ├─onn_myhostname--iscsi-home 253:9
0 1G 0 lvm /home
│ ├─onn_myhostname--iscsi-tmp 253:10
0 1G 0 lvm /tmp
│ ├─onn_myhostname--iscsi-var_log_audit 253:11
0 2G 0 lvm /var/log/audit
│ ├─onn_myhostname--iscsi-ovirt--node--ng--4.2.7.1--0.20181209.0+1 253:12
0 8.2G 0 lvm /
│ ├─onn_myhostname--iscsi-pool00 253:13
0 35.2G 0 lvm
│ └─onn_myhostname--iscsi-var_crash 253:15
0 10G 0 lvm /var/crash
├─onn_myhostname--iscsi-pool00_tdata 253:4
0 35.2G 0 lvm
│ └─onn_myhostname--iscsi-pool00-tpool 253:5
0 35.2G 0 lvm
│ ├─onn_myhostname--iscsi-var_log 253:6
0 8G 0 lvm /var/log
│ ├─onn_myhostname--iscsi-var 253:8
0 15G 0 lvm /var
│ ├─onn_myhostname--iscsi-home 253:9
0 1G 0 lvm /home
│ ├─onn_myhostname--iscsi-tmp 253:10
0 1G 0 lvm /tmp
│ ├─onn_myhostname--iscsi-var_log_audit 253:11
0 2G 0 lvm /var/log/audit
│ ├─onn_myhostname--iscsi-ovirt--node--ng--4.2.7.1--0.20181209.0+1 253:12
0 8.2G 0 lvm /
│ ├─onn_myhostname--iscsi-pool00 253:13
0 35.2G 0 lvm
│ └─onn_myhostname--iscsi-var_crash 253:15
0 10G 0 lvm /var/crash
└─onn_myhostname--iscsi-swap 253:7
0 4G 0 lvm [SWAP]
sdb 8:16
0 50G 0 disk
└─mpath-myhostname-disk1 253:0
0 50G 0 mpath
├─mpath-myhostname-disk1p1 253:1
0 1G 0 part /boot
└─mpath-myhostname-disk1p2 253:2
0 49G 0 part
├─onn_myhostname--iscsi-pool00_tmeta 253:3
0 1G 0 lvm
│ └─onn_myhostname--iscsi-pool00-tpool 253:5
0 35.2G 0 lvm
│ ├─onn_myhostname--iscsi-var_log 253:6
0 8G 0 lvm /var/log
│ ├─onn_myhostname--iscsi-var 253:8
0 15G 0 lvm /var
│ ├─onn_myhostname--iscsi-home 253:9
0 1G 0 lvm /home
│ ├─onn_myhostname--iscsi-tmp 253:10
0 1G 0 lvm /tmp
│ ├─onn_myhostname--iscsi-var_log_audit 253:11
0 2G 0 lvm /var/log/audit
│ ├─onn_myhostname--iscsi-ovirt--node--ng--4.2.7.1--0.20181209.0+1 253:12
0 8.2G 0 lvm /
│ ├─onn_myhostname--iscsi-pool00 253:13
0 35.2G 0 lvm
│ └─onn_myhostname--iscsi-var_crash 253:15
0 10G 0 lvm /var/crash
├─onn_myhostname--iscsi-pool00_tdata 253:4
0 35.2G 0 lvm
│ └─onn_myhostname--iscsi-pool00-tpool 253:5
0 35.2G 0 lvm
│ ├─onn_myhostname--iscsi-var_log 253:6
0 8G 0 lvm /var/log
│ ├─onn_myhostname--iscsi-var 253:8
0 15G 0 lvm /var
│ ├─onn_myhostname--iscsi-home 253:9
0 1G 0 lvm /home
│ ├─onn_myhostname--iscsi-tmp 253:10
0 1G 0 lvm /tmp
│ ├─onn_myhostname--iscsi-var_log_audit 253:11
0 2G 0 lvm /var/log/audit
│ ├─onn_myhostname--iscsi-ovirt--node--ng--4.2.7.1--0.20181209.0+1 253:12
0 8.2G 0 lvm /
│ ├─onn_myhostname--iscsi-pool00 253:13
0 35.2G 0 lvm
│ └─onn_myhostname--iscsi-var_crash 253:15
0 10G 0 lvm /var/crash
└─onn_myhostname--iscsi-swap 253:7
0 4G 0 lvm [SWAP]
sdc 8:32
0 50G 0 disk
└─mpath-myhostname-disk1 253:0
0 50G 0 mpath
├─mpath-myhostname-disk1p1 253:1
0 1G 0 part /boot
└─mpath-myhostname-disk1p2 253:2
0 49G 0 part
├─onn_myhostname--iscsi-pool00_tmeta 253:3
0 1G 0 lvm
│ └─onn_myhostname--iscsi-pool00-tpool 253:5
0 35.2G 0 lvm
│ ├─onn_myhostname--iscsi-var_log 253:6
0 8G 0 lvm /var/log
│ ├─onn_myhostname--iscsi-var 253:8
0 15G 0 lvm /var
│ ├─onn_myhostname--iscsi-home 253:9
0 1G 0 lvm /home
│ ├─onn_myhostname--iscsi-tmp 253:10
0 1G 0 lvm /tmp
│ ├─onn_myhostname--iscsi-var_log_audit 253:11
0 2G 0 lvm /var/log/audit
│ ├─onn_myhostname--iscsi-ovirt--node--ng--4.2.7.1--0.20181209.0+1 253:12
0 8.2G 0 lvm /
│ ├─onn_myhostname--iscsi-pool00 253:13
0 35.2G 0 lvm
│ └─onn_myhostname--iscsi-var_crash 253:15
0 10G 0 lvm /var/crash
├─onn_myhostname--iscsi-pool00_tdata 253:4
0 35.2G 0 lvm
│ └─onn_myhostname--iscsi-pool00-tpool 253:5
0 35.2G 0 lvm
│ ├─onn_myhostname--iscsi-var_log 253:6
0 8G 0 lvm /var/log
│ ├─onn_myhostname--iscsi-var 253:8
0 15G 0 lvm /var
│ ├─onn_myhostname--iscsi-home 253:9
0 1G 0 lvm /home
│ ├─onn_myhostname--iscsi-tmp 253:10
0 1G 0 lvm /tmp
│ ├─onn_myhostname--iscsi-var_log_audit 253:11
0 2G 0 lvm /var/log/audit
│ ├─onn_myhostname--iscsi-ovirt--node--ng--4.2.7.1--0.20181209.0+1 253:12
0 8.2G 0 lvm /
│ ├─onn_myhostname--iscsi-pool00 253:13
0 35.2G 0 lvm
│ └─onn_myhostname--iscsi-var_crash 253:15
0 10G 0 lvm /var/crash
└─onn_myhostname--iscsi-swap 253:7
0 4G 0 lvm [SWAP]
_______________________________________________
Users mailing list -- [email protected]
To unsubscribe send an email to [email protected]
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct:
https://www.ovirt.org/community/about/community-guidelines/
List Archives:
https://lists.ovirt.org/archives/list/[email protected]/message/AGS6CRGQ2KBN7SVKSE4OLDWJVYNCNFRF/
