Re: [ovirt-users] HostedEngine with HA
Hi Carlos, If you're using shared storage across the nodes/hypervisors, the HostedEngine VM should already be HA. Sometimes this allows the engine to drop while restarting it on another node. Usually when this happens the rest of the nodes running VMs stay up, and things resync when the downed node comes back. IE the only one to lose pings is the Hosted-Engine. Unless ofcourse there were VM's on the same node, in which case, if they were HA VMs they will be restarted/resumed depending on your settings. Thanks, Hanson On 08/17/2016 05:06 AM, Carlos Rodrigues wrote: Anyone can help me to build HA on HostedEngine VM? How can i guarantee that if host with HostedEngine VM goes down, the HostedEngine VM moves to another host? Regards, Carlos Rodrigues On Tue, 2016-08-16 at 11:53 +0100, Carlos Rodrigues wrote: On Sun, 2016-08-14 at 14:22 +0300, Roy Golan wrote: On 12 August 2016 at 20:23, Carlos Rodrigueswrote: Hello, I have one cluster with two hosts with power management correctly configured and one virtual machine with HostedEngine over shared storage with FiberChannel. When i shutdown the network of host with HostedEngine VM, it should be possible the HostedEngine VM migrate automatically to another host? migrate on which network? What is the expected behaviour on this HA scenario? After a few minutes your vm will be shutdown by the High Availability agent, as it can't see network, and started on another host. I'm testing this scenario and after shutdown network, it should be expected that agent shutdown ha and started on another host, but after couple minutes nothing happens and on host with network we getting the following messages: Aug 16 11:44:08 ied-blade11.install.eurotux.local ovirt-ha- agent[2779]: ovirt-ha-agent ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config ERROR Unable to get vm.conf from OVF_STORE, falling back to initial vm.conf I think the HA agent its trying to get vm configuration but some how it can't get vm.conf to start VM. Regards, Carlos Rodrigues Regards, -- Carlos Rodrigues Engenheiro de Software Sénior Eurotux Informática, S.A. | www.eurotux.com (t) +351 253 680 300 (m) +351 911 926 110 ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] HostedEngine with HA
I made more tests and i have two hosts (hosted_engine1 and hosted_engine2) configured to be hosted engine and after sent down the network interface (ifdown bond0 and i have ovirtmgmt over bond0) on hosted_engine1, the hosted_engined2 try to start engine: ==> /var/log/ovirt-hosted-engine-ha/agent.log <== MainThread::INFO::2016-11-07 18:17:18,598::ovf_store::103::ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(scan) Found OVF_STORE: imgUUID:8f567072-82d7-4a80-b643-76a1e1d273ef, volUUID:7b12f649-b8cd-426a-95d8-37bb223ac86f MainThread::INFO::2016-11-07 18:17:18,875::ovf_store::112::ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(getEngineVMOVF) Extracting Engine VM OVF from the OVF_STORE MainThread::INFO::2016-11-07 18:17:18,896::ovf_store::119::ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(getEngineVMOVF) OVF_STORE volume path: /rhev/data-center/mnt/blockSD/4c0104e0-dc8d-44b6-ab70-9d46599eb7f6/images/8f567072-82d7-4a80-b643-76a1e1d273ef/7b12f649-b8cd-426a-95d8-37bb223ac86f MainThread::INFO::2016-11-07 18:17:18,991::config::226::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config::(refresh_local_conf_file) Found an OVF for HE VM, trying to convert MainThread::INFO::2016-11-07 18:17:18,994::config::231::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config::(refresh_local_conf_file) Got vm.conf from OVF_STORE MainThread::INFO::2016-11-07 18:17:18,994::hosted_engine::1148::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_clean_vdsm_state) Ensuring VDSM state is clear for engine VM MainThread::INFO::2016-11-07 18:17:19,011::hosted_engine::1160::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_clean_vdsm_state) Vdsm state for VM clean MainThread::INFO::2016-11-07 18:17:19,011::hosted_engine::1109::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_start_engine_vm) Starting vm using `/usr/sbin/hosted-engine --vm-start` MainThread::INFO::2016-11-07 18:17:19,410::hosted_engine::1115::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_start_engine_vm) stdout: fe6a0618-62aa-434d-b9b8-459603a690ce Status = WaitForLaunch nicModel = rtl8139,pv statusTime = 4905357140 emulatedMachine = pc pid = 0 vmName = HostedEngine devices = [{'index': '0', 'iface': 'virtio', 'format': 'raw', 'bootOrder': '1', 'address': 'None', 'volumeID': '5e24a8ba-ff1f-409b-918c-b0c31565ae89', 'imageID': '23ec5c8d-d154-488b-8dd2-de29a0fd941d', 'readonly': 'false', 'domainID': '4c0104e0-dc8d-44b6-ab70-9d46599eb7f6', 'deviceId': '23ec5c8d-d154-488b-8dd2-de29a0fd941d', 'poolID': '----', 'device': 'disk', 'shared': 'exclusive', 'propagateErrors': 'off', 'type': 'disk'}, {'nicModel': 'pv', 'macAddr': '00:16:3e:1c:f3:7c', 'linkActive': 'true', 'network': 'ovirtmgmt', 'deviceId': '113617eb-d506-4df1-b542-26248ffd8027', 'address': 'None', 'device': 'bridge', 'type': 'interface'}, {'index': '2', 'iface': 'ide', 'readonly': 'true', 'deviceId': '8c3179ac-b322-4f5c-9449-c52e3665e0ae', 'address': {'bus': '1', 'controller': '0', 'type': 'drive', 'target': '0', 'unit': '0'}, 'device': 'cdrom', 'shared': 'false', 'path': '', 'type': 'disk'}] guestDiskMapping = {} vmType = kvm displaySecurePort = -1 memSize = 4096 displayPort = -1 clientIp = spiceSecureChannels = smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir smp = 2 displayIp = 0 display = vnc MainThread::INFO::2016-11-07 18:17:19,411::hosted_engine::1116::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_start_engine_vm) stderr: /usr/share/vdsm/vdsClient.py:33: DeprecationWarning: vdscli uses xmlrpc. since ovirt 3.6 xmlrpc is deprecated, please use vdsm.jsonrpcvdscli from vdsm import utils, vdscli, constants /usr/share/vdsm/vdsClient.py:33: DeprecationWarning: vdscli uses xmlrpc. since ovirt 3.6 xmlrpc is deprecated, please use vdsm.jsonrpcvdscli from vdsm import utils, vdscli, constants MainThread::INFO::2016-11-07 18:17:19,411::hosted_engine::1128::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_start_engine_vm) Engine VM started on localhost MainThread::INFO::2016-11-07 18:17:19,416::brokerlink::111::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1478542639.42 type=state_transition detail=EngineStart-EngineStarting hostname='ied-blade11.install.eurotux.local' MainThread::INFO::2016-11-07 18:17:19,681::brokerlink::120::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineStart-EngineStarting) sent? sent MainThread::INFO::2016-11-07 18:17:19,681::hosted_engine::612::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_vdsm) Initializing VDSM But i get the following error and don't see the hosted_engine1 receiving fence: ==> /var/log/ovirt-hosted-engine-ha/broker.log <==
Re: [ovirt-users] HostedEngine with HA
On Tue, 2016-08-23 at 14:16 +0200, Simone Tiraboschi wrote: > On Mon, Aug 22, 2016 at 1:10 PM, Carlos Rodrigues> wrote: > > > > On Fri, 2016-08-19 at 11:50 +0100, Carlos Rodrigues wrote: > > > > > > On Fri, 2016-08-19 at 12:24 +0200, Simone Tiraboschi wrote: > > > > > > > > > > > > On Fri, Aug 19, 2016 at 12:07 PM, Carlos Rodrigues > > > x.co > > > > m> > > > > wrote: > > > > > > > > > > > > > > > > > > > > On Fri, 2016-08-19 at 10:47 +0100, Carlos Rodrigues wrote: > > > > > > > > > > > > > > > > > > > > > > > > On Fri, 2016-08-19 at 11:36 +0200, Simone Tiraboschi wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Fri, Aug 19, 2016 at 11:29 AM, Carlos Rodrigues > > > > > > euro > > > > > > > tu > > > > > > > x.co > > > > > > > m> > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > After night, the OVF_STORE it was created: > > > > > > > > > > > > > > > > > > > > > > It's quite strange that it got so long but now it looks > > > > > > > fine. > > > > > > > > > > > > > > If the ISO_DOMAIN that I see in your screenshot is served > > > > > > > by > > > > > > > the > > > > > > > engine VM itself, I suggest to remove it and export from > > > > > > > an > > > > > > > external > > > > > > > server. > > > > > > > Serving the ISO storage domain from the engine VM itself > > > > > > > is > > > > > > > not > > > > > > > a > > > > > > > good idea since when the engine VM is down you can > > > > > > > experiment > > > > > > > long > > > > > > > delays before getting the engine VM restarted due to the > > > > > > > unavailable > > > > > > > storage domain. > > > > > > > > > > > > Ok, thank you for advice. > > > > > > > > > > > > Now, apparently is all ok. I'll do more tests with HA and > > > > > > any > > > > > > issue > > > > > > i'll tell you. > > > > > > > > > > > > Thank you for your support. > > > > > > > > > > > > Regards, > > > > > > Carlos Rodrigues > > > > > > > > > > > > > > > > I shutdown the network of host with engine VM and i expected > > > > > that > > > > > other > > > > > host fence the host and start engine VM but i don't see any > > > > > fence > > > > > action and the "free" host keep trying to start VM but get > > > > > and > > > > > error of > > > > > sanlock > > > > > > > > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: > > > > > qemu- > > > > > kvm: > > > > > sending ioctl 5326 to a partition! > > > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: > > > > > qemu- > > > > > kvm: > > > > > sending ioctl 80200204 to a partition! > > > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kvm[7867]: > > > > > 1 > > > > > guest > > > > > now active > > > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local > > > > > sanlock[884]: > > > > > 2016- > > > > > 08-19 11:03:03+0100 1023 [903]: r3 paxos_acquire owner 1 > > > > > delta 1 > > > > > 9 > > > > > 245502 alive > > > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local > > > > > sanlock[884]: > > > > > 2016- > > > > > 08-19 11:03:03+0100 1023 [903]: r3 acquire_token held error > > > > > -243 > > > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local > > > > > sanlock[884]: > > > > > 2016- > > > > > 08-19 11:03:03+0100 1023 [903]: r3 cmd_acquire 2,9,7862 > > > > > acquire_token > > > > > -243 lease owned by other host > > > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local > > > > > libvirtd[1369]: > > > > > resource busy: Failed to acquire lock: error -243 > > > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: > > > > > ovirtmgmt: > > > > > port 2(vnet0) entered disabled state > > > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: > > > > > device > > > > > vnet0 > > > > > left promiscuous mode > > > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: > > > > > ovirtmgmt: > > > > > port 2(vnet0) entered disabled state > > > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kvm[7885]: > > > > > 0 > > > > > guests > > > > > now active > > > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local systemd- > > > > > machined[7863]: Machine qemu-4-HostedEngine terminated. > > > > > > > > Maybe you hit this one: > > > > https://bugzilla.redhat.com/show_bug.cgi?id=1322849 > > > > > > > > > > > > Can you please check it as described in comment 28 and > > > > eventually > > > > apply the workaround in comment 18? > > > > > > > > > > Apparently the host-id its ok. I don't need to apply the > > > workaround. > > > > > > > Any other suggestion? > > I check that second host doens't fence the failed host and maybe > > this > > cause the lock of hosted storage domain. > > The picture isn't still that clear to me: ovirt-ha-agent is not > trying > to fence other hosted-engine hosts. > The communication between hosts simply acts trough the metadata area > on the shared storage. > > Do you also loose the
Re: [ovirt-users] HostedEngine with HA
On Mon, Aug 22, 2016 at 1:10 PM, Carlos Rodrigueswrote: > On Fri, 2016-08-19 at 11:50 +0100, Carlos Rodrigues wrote: >> On Fri, 2016-08-19 at 12:24 +0200, Simone Tiraboschi wrote: >> > >> > On Fri, Aug 19, 2016 at 12:07 PM, Carlos Rodrigues > > m> >> > wrote: >> > > >> > > >> > > On Fri, 2016-08-19 at 10:47 +0100, Carlos Rodrigues wrote: >> > > > >> > > > >> > > > On Fri, 2016-08-19 at 11:36 +0200, Simone Tiraboschi wrote: >> > > > > >> > > > > >> > > > > >> > > > > >> > > > > >> > > > > On Fri, Aug 19, 2016 at 11:29 AM, Carlos Rodrigues > > > > > tu >> > > > > x.co >> > > > > m> >> > > > > wrote: >> > > > > > >> > > > > > >> > > > > > >> > > > > > After night, the OVF_STORE it was created: >> > > > > > >> > > > > >> > > > > It's quite strange that it got so long but now it looks fine. >> > > > > >> > > > > If the ISO_DOMAIN that I see in your screenshot is served by >> > > > > the >> > > > > engine VM itself, I suggest to remove it and export from an >> > > > > external >> > > > > server. >> > > > > Serving the ISO storage domain from the engine VM itself is >> > > > > not >> > > > > a >> > > > > good idea since when the engine VM is down you can experiment >> > > > > long >> > > > > delays before getting the engine VM restarted due to the >> > > > > unavailable >> > > > > storage domain. >> > > > >> > > > Ok, thank you for advice. >> > > > >> > > > Now, apparently is all ok. I'll do more tests with HA and any >> > > > issue >> > > > i'll tell you. >> > > > >> > > > Thank you for your support. >> > > > >> > > > Regards, >> > > > Carlos Rodrigues >> > > > >> > > >> > > I shutdown the network of host with engine VM and i expected that >> > > other >> > > host fence the host and start engine VM but i don't see any fence >> > > action and the "free" host keep trying to start VM but get and >> > > error of >> > > sanlock >> > > >> > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: qemu- >> > > kvm: >> > > sending ioctl 5326 to a partition! >> > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: qemu- >> > > kvm: >> > > sending ioctl 80200204 to a partition! >> > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kvm[7867]: 1 >> > > guest >> > > now active >> > > Aug 19 11:03:03 ied-blade11.install.eurotux.local sanlock[884]: >> > > 2016- >> > > 08-19 11:03:03+0100 1023 [903]: r3 paxos_acquire owner 1 delta 1 >> > > 9 >> > > 245502 alive >> > > Aug 19 11:03:03 ied-blade11.install.eurotux.local sanlock[884]: >> > > 2016- >> > > 08-19 11:03:03+0100 1023 [903]: r3 acquire_token held error -243 >> > > Aug 19 11:03:03 ied-blade11.install.eurotux.local sanlock[884]: >> > > 2016- >> > > 08-19 11:03:03+0100 1023 [903]: r3 cmd_acquire 2,9,7862 >> > > acquire_token >> > > -243 lease owned by other host >> > > Aug 19 11:03:03 ied-blade11.install.eurotux.local libvirtd[1369]: >> > > resource busy: Failed to acquire lock: error -243 >> > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: >> > > ovirtmgmt: >> > > port 2(vnet0) entered disabled state >> > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: device >> > > vnet0 >> > > left promiscuous mode >> > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: >> > > ovirtmgmt: >> > > port 2(vnet0) entered disabled state >> > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kvm[7885]: 0 >> > > guests >> > > now active >> > > Aug 19 11:03:03 ied-blade11.install.eurotux.local systemd- >> > > machined[7863]: Machine qemu-4-HostedEngine terminated. >> > >> > Maybe you hit this one: >> > https://bugzilla.redhat.com/show_bug.cgi?id=1322849 >> > >> > >> > Can you please check it as described in comment 28 and eventually >> > apply the workaround in comment 18? >> > >> >> Apparently the host-id its ok. I don't need to apply the workaround. >> > > Any other suggestion? > I check that second host doens't fence the failed host and maybe this > cause the lock of hosted storage domain. The picture isn't still that clear to me: ovirt-ha-agent is not trying to fence other hosted-engine hosts. The communication between hosts simply acts trough the metadata area on the shared storage. Do you also loose the connection to the storage domain when you play with the management network on your host? > After recover network, engine VM check hosts and send fence commands to > the hosts. In some cases, it sends fence commands to both hosts. > > Regards, > Carlos Rodrigues > > >> >> > >> > >> > >> > > >> > > >> > > > >> > > > >> > > > > >> > > > > >> > > > > > >> > > > > > >> > > > > > Regards, >> > > > > > Carlos Rodrigues >> > > > > > >> > > > > > On Fri, 2016-08-19 at 08:29 +0200, Simone Tiraboschi wrote: >> > > > > > > >> > > > > > > >> > > > > > > >> > > > > > > >> > > > > > > >> > > > > > > On Thu, Aug 18, 2016 at 6:38 PM, Carlos Rodrigues > > > > > > > ur >> > > > > > > otux >> > > > > > > .c >> > > > > > > om> wrote: >> > > > > > > > >> > > > > > > > >> > > > > > > > >> > > > > > > >
Re: [ovirt-users] HostedEngine with HA
On Fri, 2016-08-19 at 11:50 +0100, Carlos Rodrigues wrote: > On Fri, 2016-08-19 at 12:24 +0200, Simone Tiraboschi wrote: > > > > On Fri, Aug 19, 2016 at 12:07 PM, Carlos Rodrigues> m> > > wrote: > > > > > > > > > On Fri, 2016-08-19 at 10:47 +0100, Carlos Rodrigues wrote: > > > > > > > > > > > > On Fri, 2016-08-19 at 11:36 +0200, Simone Tiraboschi wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Fri, Aug 19, 2016 at 11:29 AM, Carlos Rodrigues > > > > tu > > > > > x.co > > > > > m> > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > After night, the OVF_STORE it was created: > > > > > > > > > > > > > > > > It's quite strange that it got so long but now it looks fine. > > > > > > > > > > If the ISO_DOMAIN that I see in your screenshot is served by > > > > > the > > > > > engine VM itself, I suggest to remove it and export from an > > > > > external > > > > > server. > > > > > Serving the ISO storage domain from the engine VM itself is > > > > > not > > > > > a > > > > > good idea since when the engine VM is down you can experiment > > > > > long > > > > > delays before getting the engine VM restarted due to the > > > > > unavailable > > > > > storage domain. > > > > > > > > Ok, thank you for advice. > > > > > > > > Now, apparently is all ok. I'll do more tests with HA and any > > > > issue > > > > i'll tell you. > > > > > > > > Thank you for your support. > > > > > > > > Regards, > > > > Carlos Rodrigues > > > > > > > > > > I shutdown the network of host with engine VM and i expected that > > > other > > > host fence the host and start engine VM but i don't see any fence > > > action and the "free" host keep trying to start VM but get and > > > error of > > > sanlock > > > > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: qemu- > > > kvm: > > > sending ioctl 5326 to a partition! > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: qemu- > > > kvm: > > > sending ioctl 80200204 to a partition! > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kvm[7867]: 1 > > > guest > > > now active > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local sanlock[884]: > > > 2016- > > > 08-19 11:03:03+0100 1023 [903]: r3 paxos_acquire owner 1 delta 1 > > > 9 > > > 245502 alive > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local sanlock[884]: > > > 2016- > > > 08-19 11:03:03+0100 1023 [903]: r3 acquire_token held error -243 > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local sanlock[884]: > > > 2016- > > > 08-19 11:03:03+0100 1023 [903]: r3 cmd_acquire 2,9,7862 > > > acquire_token > > > -243 lease owned by other host > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local libvirtd[1369]: > > > resource busy: Failed to acquire lock: error -243 > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: > > > ovirtmgmt: > > > port 2(vnet0) entered disabled state > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: device > > > vnet0 > > > left promiscuous mode > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: > > > ovirtmgmt: > > > port 2(vnet0) entered disabled state > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kvm[7885]: 0 > > > guests > > > now active > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local systemd- > > > machined[7863]: Machine qemu-4-HostedEngine terminated. > > > > Maybe you hit this one: > > https://bugzilla.redhat.com/show_bug.cgi?id=1322849 > > > > > > Can you please check it as described in comment 28 and eventually > > apply the workaround in comment 18? > > > > Apparently the host-id its ok. I don't need to apply the workaround. > Any other suggestion? I check that second host doens't fence the failed host and maybe this cause the lock of hosted storage domain. After recover network, engine VM check hosts and send fence commands to the hosts. In some cases, it sends fence commands to both hosts. Regards, Carlos Rodrigues > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Regards, > > > > > > Carlos Rodrigues > > > > > > > > > > > > On Fri, 2016-08-19 at 08:29 +0200, Simone Tiraboschi wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Thu, Aug 18, 2016 at 6:38 PM, Carlos Rodrigues > > > > > > ur > > > > > > > otux > > > > > > > .c > > > > > > > om> wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Thu, 2016-08-18 at 17:45 +0200, Simone Tiraboschi > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Thu, Aug 18, 2016 at 5:43 PM, Carlos Rodrigues > > > > > > > > > > > > > > > > > @eur > > > > > > > > > ot > > > > > > > > > ux.com> wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > I increase hosted_engine disk space to 160G. How do > > > > > > > > > > i > > > > > > > > > > force
Re: [ovirt-users] HostedEngine with HA
On Fri, 2016-08-19 at 12:24 +0200, Simone Tiraboschi wrote: > On Fri, Aug 19, 2016 at 12:07 PM, Carlos Rodrigues> wrote: > > > > On Fri, 2016-08-19 at 10:47 +0100, Carlos Rodrigues wrote: > > > > > > On Fri, 2016-08-19 at 11:36 +0200, Simone Tiraboschi wrote: > > > > > > > > > > > > > > > > > > > > On Fri, Aug 19, 2016 at 11:29 AM, Carlos Rodrigues > > > x.co > > > > m> > > > > wrote: > > > > > > > > > > > > > > > After night, the OVF_STORE it was created: > > > > > > > > > > > > > It's quite strange that it got so long but now it looks fine. > > > > > > > > If the ISO_DOMAIN that I see in your screenshot is served by > > > > the > > > > engine VM itself, I suggest to remove it and export from an > > > > external > > > > server. > > > > Serving the ISO storage domain from the engine VM itself is not > > > > a > > > > good idea since when the engine VM is down you can experiment > > > > long > > > > delays before getting the engine VM restarted due to the > > > > unavailable > > > > storage domain. > > > > > > Ok, thank you for advice. > > > > > > Now, apparently is all ok. I'll do more tests with HA and any > > > issue > > > i'll tell you. > > > > > > Thank you for your support. > > > > > > Regards, > > > Carlos Rodrigues > > > > > > > I shutdown the network of host with engine VM and i expected that > > other > > host fence the host and start engine VM but i don't see any fence > > action and the "free" host keep trying to start VM but get and > > error of > > sanlock > > > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: qemu-kvm: > > sending ioctl 5326 to a partition! > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: qemu-kvm: > > sending ioctl 80200204 to a partition! > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kvm[7867]: 1 > > guest > > now active > > Aug 19 11:03:03 ied-blade11.install.eurotux.local sanlock[884]: > > 2016- > > 08-19 11:03:03+0100 1023 [903]: r3 paxos_acquire owner 1 delta 1 9 > > 245502 alive > > Aug 19 11:03:03 ied-blade11.install.eurotux.local sanlock[884]: > > 2016- > > 08-19 11:03:03+0100 1023 [903]: r3 acquire_token held error -243 > > Aug 19 11:03:03 ied-blade11.install.eurotux.local sanlock[884]: > > 2016- > > 08-19 11:03:03+0100 1023 [903]: r3 cmd_acquire 2,9,7862 > > acquire_token > > -243 lease owned by other host > > Aug 19 11:03:03 ied-blade11.install.eurotux.local libvirtd[1369]: > > resource busy: Failed to acquire lock: error -243 > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: > > ovirtmgmt: > > port 2(vnet0) entered disabled state > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: device > > vnet0 > > left promiscuous mode > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: > > ovirtmgmt: > > port 2(vnet0) entered disabled state > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kvm[7885]: 0 > > guests > > now active > > Aug 19 11:03:03 ied-blade11.install.eurotux.local systemd- > > machined[7863]: Machine qemu-4-HostedEngine terminated. > > Maybe you hit this one: > https://bugzilla.redhat.com/show_bug.cgi?id=1322849 > > > Can you please check it as described in comment 28 and eventually > apply the workaround in comment 18? > Apparently the host-id its ok. I don't need to apply the workaround. > > > > > > > > > > > > > > > > > > > > > Regards, > > > > > Carlos Rodrigues > > > > > > > > > > On Fri, 2016-08-19 at 08:29 +0200, Simone Tiraboschi wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Thu, Aug 18, 2016 at 6:38 PM, Carlos Rodrigues > > > > > otux > > > > > > .c > > > > > > om> wrote: > > > > > > > > > > > > > > > > > > > > > On Thu, 2016-08-18 at 17:45 +0200, Simone Tiraboschi > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > On Thu, Aug 18, 2016 at 5:43 PM, Carlos Rodrigues > > > > > > > @eur > > > > > > > > ot > > > > > > > > ux.com> wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > I increase hosted_engine disk space to 160G. How do i > > > > > > > > > force > > > > > > > > > to create > > > > > > > > > OVF_STORE. > > > > > > > > > > > > > > > > I think that restarting the engine on the engine VM > > > > > > > > will > > > > > > > > trigger it > > > > > > > > although I'm not sure that it was a size issue. > > > > > > > > > > > > > > > > > > > > > > I found to OVF_STORE on another storage domain with > > > > > > > "Domain > > > > > > > Type" "Data (Master)" > > > > > > > > > > > > > > > > > > > > > > > > > > Each storage domain has its own OVF_STORE volumes; you > > > > > > should > > > > > > get > > > > > > them also on the hosted-engine storage domain. > > > > > > Not really sure about how to trigger it again; adding Roy > > > > > > here. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > >
Re: [ovirt-users] HostedEngine with HA
On Fri, Aug 19, 2016 at 12:07 PM, Carlos Rodrigueswrote: > On Fri, 2016-08-19 at 10:47 +0100, Carlos Rodrigues wrote: >> On Fri, 2016-08-19 at 11:36 +0200, Simone Tiraboschi wrote: >> > >> > >> > >> > On Fri, Aug 19, 2016 at 11:29 AM, Carlos Rodrigues > > m> >> > wrote: >> > > >> > > After night, the OVF_STORE it was created: >> > > >> > >> > It's quite strange that it got so long but now it looks fine. >> > >> > If the ISO_DOMAIN that I see in your screenshot is served by the >> > engine VM itself, I suggest to remove it and export from an >> > external >> > server. >> > Serving the ISO storage domain from the engine VM itself is not a >> > good idea since when the engine VM is down you can experiment long >> > delays before getting the engine VM restarted due to the >> > unavailable >> > storage domain. >> >> Ok, thank you for advice. >> >> Now, apparently is all ok. I'll do more tests with HA and any issue >> i'll tell you. >> >> Thank you for your support. >> >> Regards, >> Carlos Rodrigues >> > > I shutdown the network of host with engine VM and i expected that other > host fence the host and start engine VM but i don't see any fence > action and the "free" host keep trying to start VM but get and error of > sanlock > > Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: qemu-kvm: > sending ioctl 5326 to a partition! > Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: qemu-kvm: > sending ioctl 80200204 to a partition! > Aug 19 11:03:03 ied-blade11.install.eurotux.local kvm[7867]: 1 guest > now active > Aug 19 11:03:03 ied-blade11.install.eurotux.local sanlock[884]: 2016- > 08-19 11:03:03+0100 1023 [903]: r3 paxos_acquire owner 1 delta 1 9 > 245502 alive > Aug 19 11:03:03 ied-blade11.install.eurotux.local sanlock[884]: 2016- > 08-19 11:03:03+0100 1023 [903]: r3 acquire_token held error -243 > Aug 19 11:03:03 ied-blade11.install.eurotux.local sanlock[884]: 2016- > 08-19 11:03:03+0100 1023 [903]: r3 cmd_acquire 2,9,7862 acquire_token > -243 lease owned by other host > Aug 19 11:03:03 ied-blade11.install.eurotux.local libvirtd[1369]: > resource busy: Failed to acquire lock: error -243 > Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: ovirtmgmt: > port 2(vnet0) entered disabled state > Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: device vnet0 > left promiscuous mode > Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: ovirtmgmt: > port 2(vnet0) entered disabled state > Aug 19 11:03:03 ied-blade11.install.eurotux.local kvm[7885]: 0 guests > now active > Aug 19 11:03:03 ied-blade11.install.eurotux.local systemd- > machined[7863]: Machine qemu-4-HostedEngine terminated. Maybe you hit this one: https://bugzilla.redhat.com/show_bug.cgi?id=1322849 Can you please check it as described in comment 28 and eventually apply the workaround in comment 18? >> > > Regards, >> > > Carlos Rodrigues >> > > >> > > On Fri, 2016-08-19 at 08:29 +0200, Simone Tiraboschi wrote: >> > > > >> > > > >> > > > >> > > > On Thu, Aug 18, 2016 at 6:38 PM, Carlos Rodrigues > > > > .c >> > > > om> wrote: >> > > > > >> > > > > On Thu, 2016-08-18 at 17:45 +0200, Simone Tiraboschi wrote: >> > > > > > >> > > > > > On Thu, Aug 18, 2016 at 5:43 PM, Carlos Rodrigues > > > > > > ot >> > > > > > ux.com> wrote: >> > > > > > > >> > > > > > > >> > > > > > > I increase hosted_engine disk space to 160G. How do i >> > > > > > > force >> > > > > > > to create >> > > > > > > OVF_STORE. >> > > > > > >> > > > > > I think that restarting the engine on the engine VM will >> > > > > > trigger it >> > > > > > although I'm not sure that it was a size issue. >> > > > > > >> > > > > >> > > > > I found to OVF_STORE on another storage domain with "Domain >> > > > > Type" "Data (Master)" >> > > > > >> > > > > >> > > > >> > > > Each storage domain has its own OVF_STORE volumes; you should >> > > > get >> > > > them also on the hosted-engine storage domain. >> > > > Not really sure about how to trigger it again; adding Roy here. >> > > > >> > > > >> > > > >> > > > >> > > > > >> > > > > >> > > > > >> > > > > >> > > > > > >> > > > > > > >> > > > > > > >> > > > > > > Regards, >> > > > > > > Carlos Rodrigues >> > > > > > > >> > > > > > > On Thu, 2016-08-18 at 12:14 +0100, Carlos Rodrigues >> > > > > > > wrote: >> > > > > > > > >> > > > > > > > >> > > > > > > > On Thu, 2016-08-18 at 12:34 +0200, Simone Tiraboschi >> > > > > > > > wrote: >> > > > > > > > > >> > > > > > > > > >> > > > > > > > > >> > > > > > > > > On Thu, Aug 18, 2016 at 12:11 PM, Carlos Rodrigues >> > > > > > > > > > > > > > > > > > r...@eurotux.co >> > > > > > > > > m> >> > > > > > > > > wrote: >> > > > > > > > > > >> > > > > > > > > > >> > > > > > > > > > >> > > > > > > > > > >> > > > > > > > > > On Thu, 2016-08-18 at 11:53 +0200, Simone >> > > > > > > > > > Tiraboschi >> > > > > > > > > > wrote: >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > >
Re: [ovirt-users] HostedEngine with HA
On Fri, 2016-08-19 at 10:47 +0100, Carlos Rodrigues wrote: > On Fri, 2016-08-19 at 11:36 +0200, Simone Tiraboschi wrote: > > > > > > > > On Fri, Aug 19, 2016 at 11:29 AM, Carlos Rodrigues> m> > > wrote: > > > > > > After night, the OVF_STORE it was created: > > > > > > > It's quite strange that it got so long but now it looks fine. > > > > If the ISO_DOMAIN that I see in your screenshot is served by the > > engine VM itself, I suggest to remove it and export from an > > external > > server. > > Serving the ISO storage domain from the engine VM itself is not a > > good idea since when the engine VM is down you can experiment long > > delays before getting the engine VM restarted due to the > > unavailable > > storage domain. > > Ok, thank you for advice. > > Now, apparently is all ok. I'll do more tests with HA and any issue > i'll tell you. > > Thank you for your support. > > Regards, > Carlos Rodrigues > I shutdown the network of host with engine VM and i expected that other host fence the host and start engine VM but i don't see any fence action and the "free" host keep trying to start VM but get and error of sanlock Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: qemu-kvm: sending ioctl 5326 to a partition! Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: qemu-kvm: sending ioctl 80200204 to a partition! Aug 19 11:03:03 ied-blade11.install.eurotux.local kvm[7867]: 1 guest now active Aug 19 11:03:03 ied-blade11.install.eurotux.local sanlock[884]: 2016- 08-19 11:03:03+0100 1023 [903]: r3 paxos_acquire owner 1 delta 1 9 245502 alive Aug 19 11:03:03 ied-blade11.install.eurotux.local sanlock[884]: 2016- 08-19 11:03:03+0100 1023 [903]: r3 acquire_token held error -243 Aug 19 11:03:03 ied-blade11.install.eurotux.local sanlock[884]: 2016- 08-19 11:03:03+0100 1023 [903]: r3 cmd_acquire 2,9,7862 acquire_token -243 lease owned by other host Aug 19 11:03:03 ied-blade11.install.eurotux.local libvirtd[1369]: resource busy: Failed to acquire lock: error -243 Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: ovirtmgmt: port 2(vnet0) entered disabled state Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: device vnet0 left promiscuous mode Aug 19 11:03:03 ied-blade11.install.eurotux.local kernel: ovirtmgmt: port 2(vnet0) entered disabled state Aug 19 11:03:03 ied-blade11.install.eurotux.local kvm[7885]: 0 guests now active Aug 19 11:03:03 ied-blade11.install.eurotux.local systemd- machined[7863]: Machine qemu-4-HostedEngine terminated. > > > > > > > > > > > > > > > > > > > Regards, > > > Carlos Rodrigues > > > > > > On Fri, 2016-08-19 at 08:29 +0200, Simone Tiraboschi wrote: > > > > > > > > > > > > > > > > On Thu, Aug 18, 2016 at 6:38 PM, Carlos Rodrigues > > > .c > > > > om> wrote: > > > > > > > > > > On Thu, 2016-08-18 at 17:45 +0200, Simone Tiraboschi wrote: > > > > > > > > > > > > On Thu, Aug 18, 2016 at 5:43 PM, Carlos Rodrigues > > > > > ot > > > > > > ux.com> wrote: > > > > > > > > > > > > > > > > > > > > > I increase hosted_engine disk space to 160G. How do i > > > > > > > force > > > > > > > to create > > > > > > > OVF_STORE. > > > > > > > > > > > > I think that restarting the engine on the engine VM will > > > > > > trigger it > > > > > > although I'm not sure that it was a size issue. > > > > > > > > > > > > > > > > I found to OVF_STORE on another storage domain with "Domain > > > > > Type" "Data (Master)" > > > > > > > > > > > > > > > > > > Each storage domain has its own OVF_STORE volumes; you should > > > > get > > > > them also on the hosted-engine storage domain. > > > > Not really sure about how to trigger it again; adding Roy here. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Regards, > > > > > > > Carlos Rodrigues > > > > > > > > > > > > > > On Thu, 2016-08-18 at 12:14 +0100, Carlos Rodrigues > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > On Thu, 2016-08-18 at 12:34 +0200, Simone Tiraboschi > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Thu, Aug 18, 2016 at 12:11 PM, Carlos Rodrigues > > > > > > > > > > > > > > > > > r...@eurotux.co > > > > > > > > > m> > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Thu, 2016-08-18 at 11:53 +0200, Simone > > > > > > > > > > Tiraboschi > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Thu, Aug 18, 2016 at 11:50 AM, Carlos > > > > > > > > > > > Rodrigues > > > > > > > > > > > > > > > > > > > > > x. > > > > > > > > > > > com> > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > >
Re: [ovirt-users] HostedEngine with HA
On Fri, 2016-08-19 at 11:36 +0200, Simone Tiraboschi wrote: > > > On Fri, Aug 19, 2016 at 11:29 AM, Carlos Rodrigues> wrote: > > After night, the OVF_STORE it was created: > > > > It's quite strange that it got so long but now it looks fine. > > If the ISO_DOMAIN that I see in your screenshot is served by the > engine VM itself, I suggest to remove it and export from an external > server. > Serving the ISO storage domain from the engine VM itself is not a > good idea since when the engine VM is down you can experiment long > delays before getting the engine VM restarted due to the unavailable > storage domain. Ok, thank you for advice. Now, apparently is all ok. I'll do more tests with HA and any issue i'll tell you. Thank you for your support. Regards, Carlos Rodrigues > > > > > > > > > Regards, > > Carlos Rodrigues > > > > On Fri, 2016-08-19 at 08:29 +0200, Simone Tiraboschi wrote: > > > > > > > > > On Thu, Aug 18, 2016 at 6:38 PM, Carlos Rodrigues > > om> wrote: > > > > On Thu, 2016-08-18 at 17:45 +0200, Simone Tiraboschi wrote: > > > > > On Thu, Aug 18, 2016 at 5:43 PM, Carlos Rodrigues > > > > ux.com> wrote: > > > > > > > > > > > > I increase hosted_engine disk space to 160G. How do i force > > > > > > to create > > > > > > OVF_STORE. > > > > > > > > > > I think that restarting the engine on the engine VM will > > > > > trigger it > > > > > although I'm not sure that it was a size issue. > > > > > > > > > > > > > I found to OVF_STORE on another storage domain with "Domain > > > > Type" "Data (Master)" > > > > > > > > > > > > > > Each storage domain has its own OVF_STORE volumes; you should get > > > them also on the hosted-engine storage domain. > > > Not really sure about how to trigger it again; adding Roy here. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Regards, > > > > > > Carlos Rodrigues > > > > > > > > > > > > On Thu, 2016-08-18 at 12:14 +0100, Carlos Rodrigues wrote: > > > > > > > > > > > > > > On Thu, 2016-08-18 at 12:34 +0200, Simone Tiraboschi > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > On Thu, Aug 18, 2016 at 12:11 PM, Carlos Rodrigues > > > > > > > r...@eurotux.co > > > > > > > > m> > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Thu, 2016-08-18 at 11:53 +0200, Simone Tiraboschi > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Thu, Aug 18, 2016 at 11:50 AM, Carlos Rodrigues > > > > > > > > > > > > > > > > > > > x. > > > > > > > > > > com> > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Thu, 2016-08-18 at 11:42 +0200, Simone > > > > > > > > > > > Tiraboschi wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Thu, Aug 18, 2016 at 11:25 AM, Carlos > > > > > > > > > > > > Rodrigues > > > > > > > > > > > ro > > > > > > > > > > > > tux. > > > > > > > > > > > > com> wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Thu, 2016-08-18 at 11:04 +0200, Simone > > > > > > > > > > > > > Tiraboschi > > > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Thu, Aug 18, 2016 at 10:36 AM, Carlos > > > > > > > > > > > > > > Rodrigues > > > > > > > > > > > > > > > > > > > > > > > > > > > euro > > > > > > > > > > > > > > tux.com> > > > > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Thu, 2016-08-18 at 10:27 +0200, Simone > > > > > > > > > > > > > > > Tiraboschi > > > > > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Thu, Aug 18, 2016 at 10:22 AM, > > > > > > > > > > > > > > > > Carlos Rodrigues > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > eurotux. > > > > > > > > > > > > > > > > com> > > > > > > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Thu, 2016-08-18 at 08:54 +0200, > > > > > > > > > > > > > > > > > Simone > > > > > > > > > > > > > > > > > Tiraboschi > > > > > > > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > >
Re: [ovirt-users] HostedEngine with HA
On Thu, Aug 18, 2016 at 6:38 PM, Carlos Rodrigueswrote: > On Thu, 2016-08-18 at 17:45 +0200, Simone Tiraboschi wrote: > > On Thu, Aug 18, 2016 at 5:43 PM, Carlos Rodrigues > wrote: > > > I increase hosted_engine disk space to 160G. How do i force to create > OVF_STORE. > > > I think that restarting the engine on the engine VM will trigger it > although I'm not sure that it was a size issue. > > > I found to OVF_STORE on another storage domain with "Domain Type" "Data > (Master)" > > Each storage domain has its own OVF_STORE volumes; you should get them also on the hosted-engine storage domain. Not really sure about how to trigger it again; adding Roy here. > > > > > Regards, > Carlos Rodrigues > > On Thu, 2016-08-18 at 12:14 +0100, Carlos Rodrigues wrote: > > > On Thu, 2016-08-18 at 12:34 +0200, Simone Tiraboschi wrote: > > > > On Thu, Aug 18, 2016 at 12:11 PM, Carlos Rodrigues m> > wrote: > > > > > On Thu, 2016-08-18 at 11:53 +0200, Simone Tiraboschi wrote: > > > > > > > On Thu, Aug 18, 2016 at 11:50 AM, Carlos Rodrigues x. > com> > wrote: > > > > > On Thu, 2016-08-18 at 11:42 +0200, Simone Tiraboschi wrote: > > > > > On Thu, Aug 18, 2016 at 11:25 AM, Carlos Rodrigues ro > tux. > com> wrote: > > > > > > On Thu, 2016-08-18 at 11:04 +0200, Simone Tiraboschi > wrote: > > > > > > On Thu, Aug 18, 2016 at 10:36 AM, Carlos Rodrigues > euro > tux.com> > wrote: > > > > > > > On Thu, 2016-08-18 at 10:27 +0200, Simone Tiraboschi > wrote: > > > > > > > On Thu, Aug 18, 2016 at 10:22 AM, Carlos Rodrigues > eurotux. > com> > wrote: > > > > > > > > On Thu, 2016-08-18 at 08:54 +0200, Simone > Tiraboschi > wrote: > > > > > > > > On Tue, Aug 16, 2016 at 12:53 PM, Carlos > Rodrigues mar@euro > tux. > com> > wrote: > > > > > > > > > On Sun, 2016-08-14 at 14:22 +0300, Roy Golan > wrote: > > > > > > > > > > > On 12 August 2016 at 20:23, Carlos > Rodrigues > r@eurotu > x.co > m> > wrote: > > > > > > > > > Hello, > > I have one cluster with two hosts with > power > management > correctly > configured and one virtual machine with > HostedEngine > over > shared > storage with FiberChannel. > > When i shutdown the network of host with > HostedEngine > VM, it > should be > possible the HostedEngine VM migrate > automatically to > another > host? > > migrate on which network? > > > > > > > > > What is the expected behaviour on this HA > scenario? > > > After a few minutes your vm will be > shutdown > by > the High > Availability > agent, as it can't see network, and started > on > another > host. > > > > I'm testing this scenario and after shutdown > network, it > should > be > expected that agent shutdown ha and started > on > another > host, > but > after > couple minutes nothing happens and on host > with > network we > getting > the > following messages: > > Aug 16 11:44:08 ied- > blade11.install.eurotux.local > ovirt-ha- > agent[2779]: > ovirt-ha-agent > ovirt_hosted_engine_ha.agent.hosted_engine.Ho > st > edEn > gine.con > fig > ERROR > Unable to get vm.conf from OVF_STORE, falling > back > to > initial > vm.conf > > I think the HA agent its trying to get vm > configuration but > some > how it > can't get vm.conf to start VM. > > > No, this is a different issues. > In 3.6 we added a feature to let the engine > manage > also the > engine VM > itself; ovirt-ha-agent will pickup the latest > engine > VM > configuration > from the OVF_STORE which is managed by the > engine. > If something goes wrong, ovirt-ha-agent could > fallback to the > initial > (bootstrap time) vm.conf. This will normally > happen > till you > add > your > first regular storage domain and the engine > imports > the > engine > VM. > > > But i already have my first storage domain and > storage > engine > domain > and already imported engine VM. > > I'm using 4.0 version. > > > This seams an issue, can you please share your > /var/log/ovirt-hosted-engine-ha/agent.log ? > > > I sent it in attachment. > > > Nothing strange here; > do you see a couple of disks with alias OVF_STORE on > the > hosted- > engine > storage domain if you check it from the engine? > > > Do you mean any disk label? > I don't have it anyone: > > [root@ied-blade11 ~]# ls /dev/disk/by-label/ > ls: cannot access /dev/disk/by-label/: No such file or > directory > > > No I mean: go to the engine web-ui, select the hosted- > engine > storage > domain, check the disks there. > > > No, the alias is virtio-disk0. > > > And this is the engine VM disk, so the issue is why the engine > has > still to create the OVF_STORE. > Can you please share your engine.log from the engine VM? > > > Go in attachment. > > > The creation of the OVF_STORE disk failed but it's not that clear > why: > > 2016-08-17 08:43:33,538 ERROR > [org.ovirt.engine.core.bll.storage.ovfstore.CreateOvfVolumeForStora > ge > DomainCommand] > (DefaultQuartzScheduler6) [6f1f1fd4] Ending command >
Re: [ovirt-users] HostedEngine with HA
On Thu, 2016-08-18 at 17:45 +0200, Simone Tiraboschi wrote: > > > On Thu, Aug 18, 2016 at 5:43 PM, Carlos Rodrigueswrote: > > > > > > I increase hosted_engine disk space to 160G. How do i force to create > > OVF_STORE. > > I think that restarting the engine on the engine VM will trigger it > although I'm not sure that it was a size issue. > I found to OVF_STORE on another storage domain with "Domain Type" "Data (Master)" > > > > Regards, > > Carlos Rodrigues > > > > On Thu, 2016-08-18 at 12:14 +0100, Carlos Rodrigues wrote: > > > > > > On Thu, 2016-08-18 at 12:34 +0200, Simone Tiraboschi wrote: > > > > > > > > > > > > > > > > On Thu, Aug 18, 2016 at 12:11 PM, Carlos Rodrigues > > > m> > > > > wrote: > > > > > > > > > > > > > > > > > > > > On Thu, 2016-08-18 at 11:53 +0200, Simone Tiraboschi wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Thu, Aug 18, 2016 at 11:50 AM, Carlos Rodrigues > > > > > x. > > > > > > com> > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Thu, 2016-08-18 at 11:42 +0200, Simone Tiraboschi wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Thu, Aug 18, 2016 at 11:25 AM, Carlos > > > > > > > > > > > > > > > > Rodrigues > > > > > > > ro > > > > > > > > tux. > > > > > > > > com> wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Thu, 2016-08-18 at 11:04 +0200, Simone Tiraboschi > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Thu, Aug 18, 2016 at 10:36 AM, Carlos Rodrigues > > > > > > > > > > > > > > > > > > > euro > > > > > > > > > > tux.com> > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Thu, 2016-08-18 at 10:27 +0200, > > > > > > > > > > > > > > > > > > > > > > Simone Tiraboschi > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Thu, Aug 18, 2016 at 10:22 > > > > > > > > > > > > > > > > > > > > > > > > AM, Carlos Rodrigues > > > > > > > > > > > > > > > > > > > > > > > eurotux. > > > > > > > > > > > > com> > > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Thu, 2016-08-18 at 08:54 +0200, Simone > > > > > > > > > > > > > Tiraboschi > > > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Tue, Aug 16, 2016 at 12:53 PM, Carlos > > > > > > > > > > > > > > Rodrigues > > > > > > > > > > > > > mar@euro > > > > > > > > > > > > > > tux. > > > > > > > > > > > > > > com> > > > > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Sun, 2016-08-14 > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > at 14:22 +0300, Roy Golan > > > > > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On 12 August 2016 at 20:23, Carlos > > > > > > > > > > > > > > > > Rodrigues > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > r@eurotu > > > > > > > > > > > > > > > > x.co > > > > > > > > > > > > > > > > m> > > > > > > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Hello, > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > I have one > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > cluster > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > with two > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > hosts with > > > > > > > > > > > > > > > > > power > > > > > > > > > > > > > > > > >
Re: [ovirt-users] HostedEngine with HA
On Thu, Aug 18, 2016 at 5:43 PM, Carlos Rodrigueswrote: > I increase hosted_engine disk space to 160G. How do i force to create > OVF_STORE. I think that restarting the engine on the engine VM will trigger it although I'm not sure that it was a size issue. > Regards, > Carlos Rodrigues > > On Thu, 2016-08-18 at 12:14 +0100, Carlos Rodrigues wrote: >> On Thu, 2016-08-18 at 12:34 +0200, Simone Tiraboschi wrote: >> > >> > On Thu, Aug 18, 2016 at 12:11 PM, Carlos Rodrigues > > m> >> > wrote: >> > > >> > > >> > > On Thu, 2016-08-18 at 11:53 +0200, Simone Tiraboschi wrote: >> > > > >> > > > >> > > > >> > > > >> > > > On Thu, Aug 18, 2016 at 11:50 AM, Carlos Rodrigues > > > > x. >> > > > com> >> > > > wrote: >> > > > > >> > > > > >> > > > > On Thu, 2016-08-18 at 11:42 +0200, Simone Tiraboschi wrote: >> > > > > > >> > > > > > >> > > > > > On Thu, Aug 18, 2016 at 11:25 AM, Carlos Rodrigues > > > > > > ro >> > > > > > tux. >> > > > > > com> wrote: >> > > > > > > >> > > > > > > >> > > > > > > >> > > > > > > On Thu, 2016-08-18 at 11:04 +0200, Simone Tiraboschi >> > > > > > > wrote: >> > > > > > > > >> > > > > > > > >> > > > > > > > >> > > > > > > > On Thu, Aug 18, 2016 at 10:36 AM, Carlos Rodrigues >> > > > > > > > > > > > > > > > euro >> > > > > > > > tux.com> >> > > > > > > > wrote: >> > > > > > > > > >> > > > > > > > > >> > > > > > > > > >> > > > > > > > > >> > > > > > > > > On Thu, 2016-08-18 at 10:27 +0200, Simone Tiraboschi >> > > > > > > > > wrote: >> > > > > > > > > > >> > > > > > > > > > >> > > > > > > > > > >> > > > > > > > > > >> > > > > > > > > > On Thu, Aug 18, 2016 at 10:22 AM, Carlos Rodrigues >> > > > > > > > > > > > > > > > > > > > eurotux. >> > > > > > > > > > com> >> > > > > > > > > > wrote: >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > On Thu, 2016-08-18 at 08:54 +0200, Simone >> > > > > > > > > > > Tiraboschi >> > > > > > > > > > > wrote: >> > > > > > > > > > > > >> > > > > > > > > > > > >> > > > > > > > > > > > >> > > > > > > > > > > > >> > > > > > > > > > > > >> > > > > > > > > > > > On Tue, Aug 16, 2016 at 12:53 PM, Carlos >> > > > > > > > > > > > Rodrigues > > > > > > > > > > > > mar@euro >> > > > > > > > > > > > tux. >> > > > > > > > > > > > com> >> > > > > > > > > > > > wrote: >> > > > > > > > > > > > > >> > > > > > > > > > > > > >> > > > > > > > > > > > > >> > > > > > > > > > > > > >> > > > > > > > > > > > > >> > > > > > > > > > > > > >> > > > > > > > > > > > > On Sun, 2016-08-14 at 14:22 +0300, Roy Golan >> > > > > > > > > > > > > wrote: >> > > > > > > > > > > > > > >> > > > > > > > > > > > > > >> > > > > > > > > > > > > > >> > > > > > > > > > > > > > >> > > > > > > > > > > > > > >> > > > > > > > > > > > > > >> > > > > > > > > > > > > > >> > > > > > > > > > > > > > >> > > > > > > > > > > > > > On 12 August 2016 at 20:23, Carlos >> > > > > > > > > > > > > > Rodrigues >> > > > > > > > > > > > > > > > > > > > > > > > > > > > r@eurotu >> > > > > > > > > > > > > > x.co >> > > > > > > > > > > > > > m> >> > > > > > > > > > > > > > wrote: >> > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > Hello, >> > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > I have one cluster with two hosts with >> > > > > > > > > > > > > > > power >> > > > > > > > > > > > > > > management >> > > > > > > > > > > > > > > correctly >> > > > > > > > > > > > > > > configured and one virtual machine with >> > > > > > > > > > > > > > > HostedEngine >> > > > > > > > > > > > > > > over >> > > > > > > > > > > > > > > shared >> > > > > > > > > > > > > > > storage with FiberChannel. >> > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > When i shutdown the network of host with >> > > > > > > > > > > > > > > HostedEngine >> > > > > > > > > > > > > > > VM, it >> > > > > > > > > > > > > > > should be >> > > > > > > > > > > > > > > possible the HostedEngine VM migrate >> > > > > > > > > > > > > > > automatically to >> > > > > > > > > > > > > > > another >> > > > > > > > > > > > > > > host? >> > > > > > > > > > > > > > > >> > > > > > > > > > > > > > migrate on which network? >> > > > > > > > > > > > > > >> > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > What is the expected behaviour on this HA >> > > > > > > > > > > > > > > scenario? >> > > > > > > > > > > > > > >> > > > > > > > > > > > > > After a few minutes your vm will be >> > > > > > > > > > > > > > shutdown >> > > > > > > > > > > > > > by >> > > > > > > > > > > > > > the High >> > > > > > > > > > > > > > Availability >> > > > > > > > > > > > > > agent, as it can't see
Re: [ovirt-users] HostedEngine with HA
I increase hosted_engine disk space to 160G. How do i force to create OVF_STORE. Regards, Carlos Rodrigues On Thu, 2016-08-18 at 12:14 +0100, Carlos Rodrigues wrote: > On Thu, 2016-08-18 at 12:34 +0200, Simone Tiraboschi wrote: > > > > On Thu, Aug 18, 2016 at 12:11 PM, Carlos Rodrigues> m> > > wrote: > > > > > > > > > On Thu, 2016-08-18 at 11:53 +0200, Simone Tiraboschi wrote: > > > > > > > > > > > > > > > > > > > > On Thu, Aug 18, 2016 at 11:50 AM, Carlos Rodrigues > > > x. > > > > com> > > > > wrote: > > > > > > > > > > > > > > > On Thu, 2016-08-18 at 11:42 +0200, Simone Tiraboschi wrote: > > > > > > > > > > > > > > > > > > On Thu, Aug 18, 2016 at 11:25 AM, Carlos Rodrigues > > > > > ro > > > > > > tux. > > > > > > com> wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Thu, 2016-08-18 at 11:04 +0200, Simone Tiraboschi > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Thu, Aug 18, 2016 at 10:36 AM, Carlos Rodrigues > > > > > > > > > > > > > > > euro > > > > > > > > tux.com> > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Thu, 2016-08-18 at 10:27 +0200, Simone Tiraboschi > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Thu, Aug 18, 2016 at 10:22 AM, Carlos Rodrigues > > > > > > > > > > > > > > > > > > > eurotux. > > > > > > > > > > com> > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Thu, 2016-08-18 at 08:54 +0200, Simone > > > > > > > > > > > Tiraboschi > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Tue, Aug 16, 2016 at 12:53 PM, Carlos > > > > > > > > > > > > Rodrigues > > > > > > > > > > > mar@euro > > > > > > > > > > > > tux. > > > > > > > > > > > > com> > > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Sun, 2016-08-14 at 14:22 +0300, Roy Golan > > > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On 12 August 2016 at 20:23, Carlos > > > > > > > > > > > > > > Rodrigues > > > > > > > > > > > > > > > > > > > > > > > > > > > r@eurotu > > > > > > > > > > > > > > x.co > > > > > > > > > > > > > > m> > > > > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Hello, > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > I have one cluster with two hosts with > > > > > > > > > > > > > > > power > > > > > > > > > > > > > > > management > > > > > > > > > > > > > > > correctly > > > > > > > > > > > > > > > configured and one virtual machine with > > > > > > > > > > > > > > > HostedEngine > > > > > > > > > > > > > > > over > > > > > > > > > > > > > > > shared > > > > > > > > > > > > > > > storage with FiberChannel. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > When i shutdown the network of host with > > > > > > > > > > > > > > > HostedEngine > > > > > > > > > > > > > > > VM, it > > > > > > > > > > > > > > > should be > > > > > > > > > > > > > > > possible the HostedEngine VM migrate > > > > > > > > > > > > > > > automatically to > > > > > > > > > > > > > > > another > > > > > > > > > > > > > > > host? > > > > > > > > > > > > > > > > > > > > > > > > > > > > > migrate on which network? > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > What is the expected behaviour on this HA > > > > > > > > > > > > > > > scenario? > > > > > > > > > > > > > > > > > > > > > > > > > > > > After a few minutes your vm will be > > > > > > > > > > > > > > shutdown > > > > > > > > > > > > > > by > > > > > > > > > > > > > > the High > > > > > > > > > > > > > > Availability > > > > > > > > > > > > > > agent, as it can't see network, and started > > > > > > > > > > > > > > on > > > > > > > > > > > > > > another > > > > > > > > > > > > > > host. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > I'm testing this scenario and after shutdown > > > > > > > > > > > > >
Re: [ovirt-users] HostedEngine with HA
On Thu, Aug 18, 2016 at 12:11 PM, Carlos Rodrigueswrote: > On Thu, 2016-08-18 at 11:53 +0200, Simone Tiraboschi wrote: >> >> >> On Thu, Aug 18, 2016 at 11:50 AM, Carlos Rodrigues >> wrote: >> > On Thu, 2016-08-18 at 11:42 +0200, Simone Tiraboschi wrote: >> > > On Thu, Aug 18, 2016 at 11:25 AM, Carlos Rodrigues > > > com> wrote: >> > > > >> > > > On Thu, 2016-08-18 at 11:04 +0200, Simone Tiraboschi wrote: >> > > > > >> > > > > On Thu, Aug 18, 2016 at 10:36 AM, Carlos Rodrigues > > > > > tux.com> >> > > > > wrote: >> > > > > > >> > > > > > >> > > > > > On Thu, 2016-08-18 at 10:27 +0200, Simone Tiraboschi wrote: >> > > > > > > >> > > > > > > >> > > > > > > On Thu, Aug 18, 2016 at 10:22 AM, Carlos Rodrigues > > > > > > > eurotux. >> > > > > > > com> >> > > > > > > wrote: >> > > > > > > > >> > > > > > > > >> > > > > > > > >> > > > > > > > On Thu, 2016-08-18 at 08:54 +0200, Simone Tiraboschi >> > > > > > > > wrote: >> > > > > > > > > >> > > > > > > > > >> > > > > > > > > >> > > > > > > > > On Tue, Aug 16, 2016 at 12:53 PM, Carlos Rodrigues > > > > > > > > > mar@euro >> > > > > > > > > tux. >> > > > > > > > > com> >> > > > > > > > > wrote: >> > > > > > > > > > >> > > > > > > > > > >> > > > > > > > > > >> > > > > > > > > > >> > > > > > > > > > On Sun, 2016-08-14 at 14:22 +0300, Roy Golan wrote: >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > On 12 August 2016 at 20:23, Carlos Rodrigues > > > > > > > > > > > r@eurotu >> > > > > > > > > > > x.co >> > > > > > > > > > > m> >> > > > > > > > > > > wrote: >> > > > > > > > > > > > >> > > > > > > > > > > > >> > > > > > > > > > > > >> > > > > > > > > > > > >> > > > > > > > > > > > Hello, >> > > > > > > > > > > > >> > > > > > > > > > > > I have one cluster with two hosts with power >> > > > > > > > > > > > management >> > > > > > > > > > > > correctly >> > > > > > > > > > > > configured and one virtual machine with >> > > > > > > > > > > > HostedEngine >> > > > > > > > > > > > over >> > > > > > > > > > > > shared >> > > > > > > > > > > > storage with FiberChannel. >> > > > > > > > > > > > >> > > > > > > > > > > > When i shutdown the network of host with >> > > > > > > > > > > > HostedEngine >> > > > > > > > > > > > VM, it >> > > > > > > > > > > > should be >> > > > > > > > > > > > possible the HostedEngine VM migrate >> > > > > > > > > > > > automatically to >> > > > > > > > > > > > another >> > > > > > > > > > > > host? >> > > > > > > > > > > > >> > > > > > > > > > > migrate on which network? >> > > > > > > > > > > >> > > > > > > > > > > > >> > > > > > > > > > > > >> > > > > > > > > > > > >> > > > > > > > > > > > >> > > > > > > > > > > > What is the expected behaviour on this HA >> > > > > > > > > > > > scenario? >> > > > > > > > > > > >> > > > > > > > > > > After a few minutes your vm will be shutdown by >> > > > > > > > > > > the High >> > > > > > > > > > > Availability >> > > > > > > > > > > agent, as it can't see network, and started on >> > > > > > > > > > > another >> > > > > > > > > > > host. >> > > > > > > > > > >> > > > > > > > > > >> > > > > > > > > > I'm testing this scenario and after shutdown >> > > > > > > > > > network, it >> > > > > > > > > > should >> > > > > > > > > > be >> > > > > > > > > > expected that agent shutdown ha and started on >> > > > > > > > > > another >> > > > > > > > > > host, >> > > > > > > > > > but >> > > > > > > > > > after >> > > > > > > > > > couple minutes nothing happens and on host with >> > > > > > > > > > network we >> > > > > > > > > > getting >> > > > > > > > > > the >> > > > > > > > > > following messages: >> > > > > > > > > > >> > > > > > > > > > Aug 16 11:44:08 ied-blade11.install.eurotux.local >> > > > > > > > > > ovirt-ha- >> > > > > > > > > > agent[2779]: >> > > > > > > > > > ovirt-ha-agent >> > > > > > > > > > ovirt_hosted_engine_ha.agent.hosted_engine.HostedEn >> > > > > > > > > > gine.con >> > > > > > > > > > fig >> > > > > > > > > > ERROR >> > > > > > > > > > Unable to get vm.conf from OVF_STORE, falling back >> > > > > > > > > > to >> > > > > > > > > > initial >> > > > > > > > > > vm.conf >> > > > > > > > > > >> > > > > > > > > > I think the HA agent its trying to get vm >> > > > > > > > > > configuration but >> > > > > > > > > > some >> > > > > > > > > > how it >> > > > > > > > > > can't get vm.conf to start VM. >> > > > > > > > > >> > > > > > > > > No, this is a different issues. >> > > > > > > > > In 3.6 we added a feature to let the engine manage >> > > > > > > > > also the >> > > > > > > > > engine VM >> > > > > > > > > itself; ovirt-ha-agent will pickup the latest engine >> > > > > > > > > VM >> > > > > > > > > configuration >> > > > > > > > > from the OVF_STORE which is managed by the engine. >> > > > > > > > > If something goes wrong, ovirt-ha-agent could >> > > > > > > > > fallback to the >> > > > > > > > > initial >> > >
Re: [ovirt-users] HostedEngine with HA
On Thu, Aug 18, 2016 at 11:50 AM, Carlos Rodrigueswrote: > On Thu, 2016-08-18 at 11:42 +0200, Simone Tiraboschi wrote: > > On Thu, Aug 18, 2016 at 11:25 AM, Carlos Rodrigues > wrote: > > > On Thu, 2016-08-18 at 11:04 +0200, Simone Tiraboschi wrote: > > > On Thu, Aug 18, 2016 at 10:36 AM, Carlos Rodrigues > wrote: > > > > On Thu, 2016-08-18 at 10:27 +0200, Simone Tiraboschi wrote: > > > > On Thu, Aug 18, 2016 at 10:22 AM, Carlos Rodrigues com> > wrote: > > > > > On Thu, 2016-08-18 at 08:54 +0200, Simone Tiraboschi wrote: > > > > > On Tue, Aug 16, 2016 at 12:53 PM, Carlos Rodrigues tux. > com> > wrote: > > > > > > On Sun, 2016-08-14 at 14:22 +0300, Roy Golan wrote: > > > > > > > > On 12 August 2016 at 20:23, Carlos Rodrigues x.co > m> > wrote: > > > > > > Hello, > > I have one cluster with two hosts with power management > correctly > configured and one virtual machine with HostedEngine > over > shared > storage with FiberChannel. > > When i shutdown the network of host with HostedEngine > VM, it > should be > possible the HostedEngine VM migrate automatically to > another > host? > > migrate on which network? > > > > > > What is the expected behaviour on this HA scenario? > > > After a few minutes your vm will be shutdown by the High > Availability > agent, as it can't see network, and started on another > host. > > > > I'm testing this scenario and after shutdown network, it > should > be > expected that agent shutdown ha and started on another > host, > but > after > couple minutes nothing happens and on host with network we > getting > the > following messages: > > Aug 16 11:44:08 ied-blade11.install.eurotux.local ovirt-ha- > agent[2779]: > ovirt-ha-agent > ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.con > fig > ERROR > Unable to get vm.conf from OVF_STORE, falling back to > initial > vm.conf > > I think the HA agent its trying to get vm configuration but > some > how it > can't get vm.conf to start VM. > > > No, this is a different issues. > In 3.6 we added a feature to let the engine manage also the > engine VM > itself; ovirt-ha-agent will pickup the latest engine VM > configuration > from the OVF_STORE which is managed by the engine. > If something goes wrong, ovirt-ha-agent could fallback to the > initial > (bootstrap time) vm.conf. This will normally happen till you > add > your > first regular storage domain and the engine imports the > engine > VM. > > > But i already have my first storage domain and storage engine > domain > and already imported engine VM. > > I'm using 4.0 version. > > > This seams an issue, can you please share your > /var/log/ovirt-hosted-engine-ha/agent.log ? > > > I sent it in attachment. > > > Nothing strange here; > do you see a couple of disks with alias OVF_STORE on the hosted- > engine > storage domain if you check it from the engine? > > > Do you mean any disk label? > I don't have it anyone: > > [root@ied-blade11 ~]# ls /dev/disk/by-label/ > ls: cannot access /dev/disk/by-label/: No such file or directory > > > No I mean: go to the engine web-ui, select the hosted-engine storage > domain, check the disks there. > > > No, the alias is virtio-disk0. > And this is the engine VM disk, so the issue is why the engine has still to create the OVF_STORE. Can you please share your engine.log from the engine VM? > > > > > > > > > > > > Regards, > Carlos Rodrigues > > > > > > > > > > > > Regards, > > -- > Carlos Rodrigues > > Engenheiro de Software Sénior > > Eurotux Informática, S.A. | www.eurotux.com > (t) +351 253 680 300 (m) +351 911 926 110 > > ___ > Users mailing list > Users@ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > > > -- > Carlos Rodrigues > > Engenheiro de Software Sénior > > Eurotux Informática, S.A. | www.eurotux.com > (t) +351 253 680 300 (m) +351 911 926 110 > > ___ > Users mailing list > Users@ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > > -- > Carlos Rodrigues > > Engenheiro de Software Sénior > > Eurotux Informática, S.A. | www.eurotux.com > (t) +351 253 680 300 (m) +351 911 926 110 > > -- > Carlos Rodrigues > > Engenheiro de Software Sénior > > Eurotux Informática, S.A. | www.eurotux.com > (t) +351 253 680 300 (m) +351 911 926 110 > > -- > Carlos Rodrigues > > Engenheiro de Software Sénior > > Eurotux Informática, S.A. | www.eurotux.com > (t) +351 253 680 300 (m) +351 911 926 110 > > -- > > Carlos Rodrigues > > Engenheiro de Software Sénior > > Eurotux Informática, S.A. | www.eurotux.com > (t) +351 253 680 300 (m) +351 911 926 110 > > ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] HostedEngine with HA
On Thu, 2016-08-18 at 11:42 +0200, Simone Tiraboschi wrote: > > > On Thu, Aug 18, 2016 at 11:25 AM, Carlos Rodrigueswrote: > > > > On Thu, 2016-08-18 at 11:04 +0200, Simone Tiraboschi wrote: > > > > > > > > > On Thu, Aug 18, 2016 at 10:36 AM, Carlos Rodrigues > > > wrote: > > > > > > > > > > > > On Thu, 2016-08-18 at 10:27 +0200, Simone Tiraboschi wrote: > > > > > > > > > > > > > > > > > > > > On Thu, Aug 18, 2016 at 10:22 AM, Carlos Rodrigues > > > > com> > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > On Thu, 2016-08-18 at 08:54 +0200, Simone Tiraboschi wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Tue, Aug 16, 2016 at 12:53 PM, Carlos Rodrigues > > > > > > tux. > > > > > > > com> > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Sun, 2016-08-14 at 14:22 +0300, Roy Golan wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On 12 August 2016 at 20:23, Carlos Rodrigues > > > > > > > > x.co > > > > > > > > > m> > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Hello, > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > I have one cluster with two hosts with > > > > > > > > > > > > > > > > > > > > power management > > > > > > > > > > correctly > > > > > > > > > > > > > > > > > > > > configured and one virtual machine with HostedEngine > > > > > > > > > > over > > > > > > > > > > shared > > > > > > > > > > storage with FiberChannel. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > When i shutdown the network of host with HostedEngine > > > > > > > > > > VM, it > > > > > > > > > > should be > > > > > > > > > > > > > > > > > > > > possible the HostedEngine VM migrate > > > > > > > > > > > > > > > > > > > > automatically to > > > > > > > > > > another > > > > > > > > > > host? > > > > > > > > > > > > > > > > > > > migrate on which network? > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > What is the expected behaviour on this HA scenario? > > > > > > > > > > > > > > > > > > > > > > > > > > > After a few minutes your vm will be > > > > > > > > > > > > > > > > > > shutdown by the High > > > > > > > > > Availability > > > > > > > > > > > > > > > > > > agent, as it can't see network, and started > > > > > > > > > > > > > > > > > > on another > > > > > > > > > host. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > I'm testing this scenario and after shutdown > > > > > > > > > > > > > > > > network, it > > > > > > > > should > > > > > > > > be > > > > > > > > expected that agent shutdown ha and started on another > > > > > > > > host, > > > > > > > > but > > > > > > > > after > > > > > > > > > > > > > > > > couple minutes nothing happens and on host with > > > > > > > > > > > > > > > > network we > > > > > > > > getting > > > > > > > > the > > > > > > > > following messages: > > > > > > > > > > > > > > > > > > > > > > > > Aug 16 11:44:08 > > > > > > > > > > > > > > > > ied-blade11.install.eurotux.local ovirt-ha- > > > > > > > > agent[2779]: > > > > > > > > ovirt-ha-agent > > > > > > > > > > > > > > > > ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine .con > > > > > > > > fig > > > > > > > > ERROR > > > > > > > > Unable to get vm.conf from OVF_STORE, falling back to > > > > > > > > initial > > > > > > > > vm.conf > > > > > > > > > > > > > > > > > > > > > > > > I think the HA agent its trying to get vm > > > > > > > > > > > > > > > > configuration but > > > > > > > > some > > > > > > > > how it > > > > > > > > can't get vm.conf to start VM. > > > > > > > > > > > > > > No, this is a different issues. > > > > > > > > > > > > > > In 3.6 we added a feature to let the engine manage > > > > > > > > > > > > > > also the > > > > > > > engine VM > > > > > > > itself; ovirt-ha-agent will pickup the latest engine VM > > > > > > > configuration > > > > > > > from the OVF_STORE which is managed by the engine. > > > > > > > > > > > > > > If something goes wrong, ovirt-ha-agent could > > > > > > > > > > > > > > fallback to the > > > > > > > initial > > > > > > > > > > > > > > (bootstrap time) vm.conf. This will normally happen > > > > > > > > > > > > > > till you > > > > > > > add > > > > > > > your > > > > > > > first regular storage domain and the engine imports the > > > > > > > engine > > > > > > > VM. > > > > > > > > > > > > > > > > > > But i already have my first storage domain and storage engine > > > > > > domain > > > > > > and already imported engine VM. > > > > > > > > > > > > I'm using 4.0 version. > > > > > > > > > > This seams an issue, can you please share your > > > > >
Re: [ovirt-users] HostedEngine with HA
On Thu, Aug 18, 2016 at 11:25 AM, Carlos Rodrigueswrote: > On Thu, 2016-08-18 at 11:04 +0200, Simone Tiraboschi wrote: >> On Thu, Aug 18, 2016 at 10:36 AM, Carlos Rodrigues >> wrote: >> > >> > On Thu, 2016-08-18 at 10:27 +0200, Simone Tiraboschi wrote: >> > > >> > > On Thu, Aug 18, 2016 at 10:22 AM, Carlos Rodrigues > > > com> >> > > wrote: >> > > > >> > > > >> > > > On Thu, 2016-08-18 at 08:54 +0200, Simone Tiraboschi wrote: >> > > > > >> > > > > >> > > > > On Tue, Aug 16, 2016 at 12:53 PM, Carlos Rodrigues > > > > > tux. >> > > > > com> >> > > > > wrote: >> > > > > > >> > > > > > >> > > > > > >> > > > > > On Sun, 2016-08-14 at 14:22 +0300, Roy Golan wrote: >> > > > > > > >> > > > > > > >> > > > > > > >> > > > > > > >> > > > > > > >> > > > > > > On 12 August 2016 at 20:23, Carlos Rodrigues > > > > > > > x.co >> > > > > > > m> >> > > > > > > wrote: >> > > > > > > > >> > > > > > > > >> > > > > > > > >> > > > > > > > Hello, >> > > > > > > > >> > > > > > > > I have one cluster with two hosts with power management >> > > > > > > > correctly >> > > > > > > > configured and one virtual machine with HostedEngine >> > > > > > > > over >> > > > > > > > shared >> > > > > > > > storage with FiberChannel. >> > > > > > > > >> > > > > > > > When i shutdown the network of host with HostedEngine >> > > > > > > > VM, it >> > > > > > > > should be >> > > > > > > > possible the HostedEngine VM migrate automatically to >> > > > > > > > another >> > > > > > > > host? >> > > > > > > > >> > > > > > > migrate on which network? >> > > > > > > >> > > > > > > > >> > > > > > > > >> > > > > > > > >> > > > > > > > What is the expected behaviour on this HA scenario? >> > > > > > > >> > > > > > > After a few minutes your vm will be shutdown by the High >> > > > > > > Availability >> > > > > > > agent, as it can't see network, and started on another >> > > > > > > host. >> > > > > > >> > > > > > >> > > > > > I'm testing this scenario and after shutdown network, it >> > > > > > should >> > > > > > be >> > > > > > expected that agent shutdown ha and started on another >> > > > > > host, >> > > > > > but >> > > > > > after >> > > > > > couple minutes nothing happens and on host with network we >> > > > > > getting >> > > > > > the >> > > > > > following messages: >> > > > > > >> > > > > > Aug 16 11:44:08 ied-blade11.install.eurotux.local ovirt-ha- >> > > > > > agent[2779]: >> > > > > > ovirt-ha-agent >> > > > > > ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.con >> > > > > > fig >> > > > > > ERROR >> > > > > > Unable to get vm.conf from OVF_STORE, falling back to >> > > > > > initial >> > > > > > vm.conf >> > > > > > >> > > > > > I think the HA agent its trying to get vm configuration but >> > > > > > some >> > > > > > how it >> > > > > > can't get vm.conf to start VM. >> > > > > >> > > > > No, this is a different issues. >> > > > > In 3.6 we added a feature to let the engine manage also the >> > > > > engine VM >> > > > > itself; ovirt-ha-agent will pickup the latest engine VM >> > > > > configuration >> > > > > from the OVF_STORE which is managed by the engine. >> > > > > If something goes wrong, ovirt-ha-agent could fallback to the >> > > > > initial >> > > > > (bootstrap time) vm.conf. This will normally happen till you >> > > > > add >> > > > > your >> > > > > first regular storage domain and the engine imports the >> > > > > engine >> > > > > VM. >> > > > >> > > > But i already have my first storage domain and storage engine >> > > > domain >> > > > and already imported engine VM. >> > > > >> > > > I'm using 4.0 version. >> > > >> > > This seams an issue, can you please share your >> > > /var/log/ovirt-hosted-engine-ha/agent.log ? >> > > >> > >> > I sent it in attachment. >> >> Nothing strange here; >> do you see a couple of disks with alias OVF_STORE on the hosted- >> engine >> storage domain if you check it from the engine? >> > > Do you mean any disk label? > I don't have it anyone: > > [root@ied-blade11 ~]# ls /dev/disk/by-label/ > ls: cannot access /dev/disk/by-label/: No such file or directory No I mean: go to the engine web-ui, select the hosted-engine storage domain, check the disks there. >> > > > > > Regards, >> > > > > > Carlos Rodrigues >> > > > > > >> > > > > > >> > > > > > > >> > > > > > > >> > > > > > > >> > > > > > > > >> > > > > > > > >> > > > > > > > >> > > > > > > > >> > > > > > > > Regards, >> > > > > > > > >> > > > > > > > -- >> > > > > > > > Carlos Rodrigues >> > > > > > > > >> > > > > > > > Engenheiro de Software Sénior >> > > > > > > > >> > > > > > > > Eurotux Informática, S.A. | www.eurotux.com >> > > > > > > > (t) +351 253 680 300 (m) +351 911 926 110 >> > > > > > > > >> > > > > > > > ___ >> > > > > > > > Users mailing list >> > > > > > > > Users@ovirt.org >> > > > > > > > http://lists.ovirt.org/mailman/listinfo/users >> > > > > > > > >> > > > > > > >> > > > > > -- >> > >
Re: [ovirt-users] HostedEngine with HA
On Thu, 2016-08-18 at 11:04 +0200, Simone Tiraboschi wrote: > On Thu, Aug 18, 2016 at 10:36 AM, Carlos Rodrigues> wrote: > > > > On Thu, 2016-08-18 at 10:27 +0200, Simone Tiraboschi wrote: > > > > > > On Thu, Aug 18, 2016 at 10:22 AM, Carlos Rodrigues > > com> > > > wrote: > > > > > > > > > > > > On Thu, 2016-08-18 at 08:54 +0200, Simone Tiraboschi wrote: > > > > > > > > > > > > > > > On Tue, Aug 16, 2016 at 12:53 PM, Carlos Rodrigues > > > > tux. > > > > > com> > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > On Sun, 2016-08-14 at 14:22 +0300, Roy Golan wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On 12 August 2016 at 20:23, Carlos Rodrigues > > > > > > x.co > > > > > > > m> > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Hello, > > > > > > > > > > > > > > > > I have one cluster with two hosts with power management > > > > > > > > correctly > > > > > > > > configured and one virtual machine with HostedEngine > > > > > > > > over > > > > > > > > shared > > > > > > > > storage with FiberChannel. > > > > > > > > > > > > > > > > When i shutdown the network of host with HostedEngine > > > > > > > > VM, it > > > > > > > > should be > > > > > > > > possible the HostedEngine VM migrate automatically to > > > > > > > > another > > > > > > > > host? > > > > > > > > > > > > > > > migrate on which network? > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > What is the expected behaviour on this HA scenario? > > > > > > > > > > > > > > After a few minutes your vm will be shutdown by the High > > > > > > > Availability > > > > > > > agent, as it can't see network, and started on another > > > > > > > host. > > > > > > > > > > > > > > > > > > I'm testing this scenario and after shutdown network, it > > > > > > should > > > > > > be > > > > > > expected that agent shutdown ha and started on another > > > > > > host, > > > > > > but > > > > > > after > > > > > > couple minutes nothing happens and on host with network we > > > > > > getting > > > > > > the > > > > > > following messages: > > > > > > > > > > > > Aug 16 11:44:08 ied-blade11.install.eurotux.local ovirt-ha- > > > > > > agent[2779]: > > > > > > ovirt-ha-agent > > > > > > ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.con > > > > > > fig > > > > > > ERROR > > > > > > Unable to get vm.conf from OVF_STORE, falling back to > > > > > > initial > > > > > > vm.conf > > > > > > > > > > > > I think the HA agent its trying to get vm configuration but > > > > > > some > > > > > > how it > > > > > > can't get vm.conf to start VM. > > > > > > > > > > No, this is a different issues. > > > > > In 3.6 we added a feature to let the engine manage also the > > > > > engine VM > > > > > itself; ovirt-ha-agent will pickup the latest engine VM > > > > > configuration > > > > > from the OVF_STORE which is managed by the engine. > > > > > If something goes wrong, ovirt-ha-agent could fallback to the > > > > > initial > > > > > (bootstrap time) vm.conf. This will normally happen till you > > > > > add > > > > > your > > > > > first regular storage domain and the engine imports the > > > > > engine > > > > > VM. > > > > > > > > But i already have my first storage domain and storage engine > > > > domain > > > > and already imported engine VM. > > > > > > > > I'm using 4.0 version. > > > > > > This seams an issue, can you please share your > > > /var/log/ovirt-hosted-engine-ha/agent.log ? > > > > > > > I sent it in attachment. > > Nothing strange here; > do you see a couple of disks with alias OVF_STORE on the hosted- > engine > storage domain if you check it from the engine? > Do you mean any disk label? I don't have it anyone: [root@ied-blade11 ~]# ls /dev/disk/by-label/ ls: cannot access /dev/disk/by-label/: No such file or directory > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Regards, > > > > > > Carlos Rodrigues > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Regards, > > > > > > > > > > > > > > > > -- > > > > > > > > Carlos Rodrigues > > > > > > > > > > > > > > > > Engenheiro de Software Sénior > > > > > > > > > > > > > > > > Eurotux Informática, S.A. | www.eurotux.com > > > > > > > > (t) +351 253 680 300 (m) +351 911 926 110 > > > > > > > > > > > > > > > > ___ > > > > > > > > Users mailing list > > > > > > > > Users@ovirt.org > > > > > > > > http://lists.ovirt.org/mailman/listinfo/users > > > > > > > > > > > > > > > > > > > > > -- > > > > > > Carlos Rodrigues > > > > > > > > > > > > Engenheiro de Software Sénior > > > > > > > > > > > > Eurotux Informática, S.A. | www.eurotux.com > > > > > > (t) +351 253 680 300 (m) +351 911 926 110 > > > > > > > > >
Re: [ovirt-users] HostedEngine with HA
On Thu, Aug 18, 2016 at 10:36 AM, Carlos Rodrigueswrote: > On Thu, 2016-08-18 at 10:27 +0200, Simone Tiraboschi wrote: >> On Thu, Aug 18, 2016 at 10:22 AM, Carlos Rodrigues >> wrote: >> > >> > On Thu, 2016-08-18 at 08:54 +0200, Simone Tiraboschi wrote: >> > > >> > > On Tue, Aug 16, 2016 at 12:53 PM, Carlos Rodrigues > > > com> >> > > wrote: >> > > > >> > > > >> > > > On Sun, 2016-08-14 at 14:22 +0300, Roy Golan wrote: >> > > > > >> > > > > >> > > > > >> > > > > >> > > > > On 12 August 2016 at 20:23, Carlos Rodrigues > > > > > m> >> > > > > wrote: >> > > > > > >> > > > > > >> > > > > > Hello, >> > > > > > >> > > > > > I have one cluster with two hosts with power management >> > > > > > correctly >> > > > > > configured and one virtual machine with HostedEngine over >> > > > > > shared >> > > > > > storage with FiberChannel. >> > > > > > >> > > > > > When i shutdown the network of host with HostedEngine >> > > > > > VM, it >> > > > > > should be >> > > > > > possible the HostedEngine VM migrate automatically to >> > > > > > another >> > > > > > host? >> > > > > > >> > > > > migrate on which network? >> > > > > >> > > > > > >> > > > > > >> > > > > > What is the expected behaviour on this HA scenario? >> > > > > >> > > > > After a few minutes your vm will be shutdown by the High >> > > > > Availability >> > > > > agent, as it can't see network, and started on another host. >> > > > >> > > > >> > > > I'm testing this scenario and after shutdown network, it should >> > > > be >> > > > expected that agent shutdown ha and started on another host, >> > > > but >> > > > after >> > > > couple minutes nothing happens and on host with network we >> > > > getting >> > > > the >> > > > following messages: >> > > > >> > > > Aug 16 11:44:08 ied-blade11.install.eurotux.local ovirt-ha- >> > > > agent[2779]: >> > > > ovirt-ha-agent >> > > > ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config >> > > > ERROR >> > > > Unable to get vm.conf from OVF_STORE, falling back to initial >> > > > vm.conf >> > > > >> > > > I think the HA agent its trying to get vm configuration but >> > > > some >> > > > how it >> > > > can't get vm.conf to start VM. >> > > >> > > No, this is a different issues. >> > > In 3.6 we added a feature to let the engine manage also the >> > > engine VM >> > > itself; ovirt-ha-agent will pickup the latest engine VM >> > > configuration >> > > from the OVF_STORE which is managed by the engine. >> > > If something goes wrong, ovirt-ha-agent could fallback to the >> > > initial >> > > (bootstrap time) vm.conf. This will normally happen till you add >> > > your >> > > first regular storage domain and the engine imports the engine >> > > VM. >> > >> > But i already have my first storage domain and storage engine >> > domain >> > and already imported engine VM. >> > >> > I'm using 4.0 version. >> >> This seams an issue, can you please share your >> /var/log/ovirt-hosted-engine-ha/agent.log ? >> > > I sent it in attachment. Nothing strange here; do you see a couple of disks with alias OVF_STORE on the hosted-engine storage domain if you check it from the engine? >> > > >> > > > >> > > > Regards, >> > > > Carlos Rodrigues >> > > > >> > > > >> > > > > >> > > > > >> > > > > > >> > > > > > >> > > > > > >> > > > > > Regards, >> > > > > > >> > > > > > -- >> > > > > > Carlos Rodrigues >> > > > > > >> > > > > > Engenheiro de Software Sénior >> > > > > > >> > > > > > Eurotux Informática, S.A. | www.eurotux.com >> > > > > > (t) +351 253 680 300 (m) +351 911 926 110 >> > > > > > >> > > > > > ___ >> > > > > > Users mailing list >> > > > > > Users@ovirt.org >> > > > > > http://lists.ovirt.org/mailman/listinfo/users >> > > > > > >> > > > > >> > > > -- >> > > > Carlos Rodrigues >> > > > >> > > > Engenheiro de Software Sénior >> > > > >> > > > Eurotux Informática, S.A. | www.eurotux.com >> > > > (t) +351 253 680 300 (m) +351 911 926 110 >> > > > >> > > > ___ >> > > > Users mailing list >> > > > Users@ovirt.org >> > > > http://lists.ovirt.org/mailman/listinfo/users >> > -- >> > Carlos Rodrigues >> > >> > Engenheiro de Software Sénior >> > >> > Eurotux Informática, S.A. | www.eurotux.com >> > (t) +351 253 680 300 (m) +351 911 926 110 >> > > -- > Carlos Rodrigues > > Engenheiro de Software Sénior > > Eurotux Informática, S.A. | www.eurotux.com > (t) +351 253 680 300 (m) +351 911 926 110 ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] HostedEngine with HA
On Thu, Aug 18, 2016 at 10:22 AM, Carlos Rodrigueswrote: > On Thu, 2016-08-18 at 08:54 +0200, Simone Tiraboschi wrote: >> On Tue, Aug 16, 2016 at 12:53 PM, Carlos Rodrigues >> wrote: >> > >> > On Sun, 2016-08-14 at 14:22 +0300, Roy Golan wrote: >> > > >> > > >> > > >> > > On 12 August 2016 at 20:23, Carlos Rodrigues >> > > wrote: >> > > > >> > > > Hello, >> > > > >> > > > I have one cluster with two hosts with power management >> > > > correctly >> > > > configured and one virtual machine with HostedEngine over >> > > > shared >> > > > storage with FiberChannel. >> > > > >> > > > When i shutdown the network of host with HostedEngine VM, it >> > > > should be >> > > > possible the HostedEngine VM migrate automatically to another >> > > > host? >> > > > >> > > migrate on which network? >> > > >> > > > >> > > > What is the expected behaviour on this HA scenario? >> > > >> > > After a few minutes your vm will be shutdown by the High >> > > Availability >> > > agent, as it can't see network, and started on another host. >> > >> > >> > I'm testing this scenario and after shutdown network, it should be >> > expected that agent shutdown ha and started on another host, but >> > after >> > couple minutes nothing happens and on host with network we getting >> > the >> > following messages: >> > >> > Aug 16 11:44:08 ied-blade11.install.eurotux.local ovirt-ha- >> > agent[2779]: >> > ovirt-ha-agent >> > ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config >> > ERROR >> > Unable to get vm.conf from OVF_STORE, falling back to initial >> > vm.conf >> > >> > I think the HA agent its trying to get vm configuration but some >> > how it >> > can't get vm.conf to start VM. >> >> No, this is a different issues. >> In 3.6 we added a feature to let the engine manage also the engine VM >> itself; ovirt-ha-agent will pickup the latest engine VM configuration >> from the OVF_STORE which is managed by the engine. >> If something goes wrong, ovirt-ha-agent could fallback to the initial >> (bootstrap time) vm.conf. This will normally happen till you add your >> first regular storage domain and the engine imports the engine VM. > > But i already have my first storage domain and storage engine domain > and already imported engine VM. > > I'm using 4.0 version. This seams an issue, can you please share your /var/log/ovirt-hosted-engine-ha/agent.log ? >> > Regards, >> > Carlos Rodrigues >> > >> > >> > > >> > > > >> > > > >> > > > Regards, >> > > > >> > > > -- >> > > > Carlos Rodrigues >> > > > >> > > > Engenheiro de Software Sénior >> > > > >> > > > Eurotux Informática, S.A. | www.eurotux.com >> > > > (t) +351 253 680 300 (m) +351 911 926 110 >> > > > >> > > > ___ >> > > > Users mailing list >> > > > Users@ovirt.org >> > > > http://lists.ovirt.org/mailman/listinfo/users >> > > > >> > > >> > -- >> > Carlos Rodrigues >> > >> > Engenheiro de Software Sénior >> > >> > Eurotux Informática, S.A. | www.eurotux.com >> > (t) +351 253 680 300 (m) +351 911 926 110 >> > >> > ___ >> > Users mailing list >> > Users@ovirt.org >> > http://lists.ovirt.org/mailman/listinfo/users > -- > Carlos Rodrigues > > Engenheiro de Software Sénior > > Eurotux Informática, S.A. | www.eurotux.com > (t) +351 253 680 300 (m) +351 911 926 110 > ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] HostedEngine with HA
On Thu, 2016-08-18 at 08:55 +0200, Simone Tiraboschi wrote: > On Wed, Aug 17, 2016 at 11:06 AM, Carlos Rodrigues> wrote: > > > > Anyone can help me to build HA on HostedEngine VM? > > > > How can i guarantee that if host with HostedEngine VM goes down, > > the > > HostedEngine VM moves to another host? > > it's in charge of ovirt-ha-agent running on your hosts. > > Can you please post the output of > hosted-engine --vm-status > ? There is the output of both hosts: [root@ied-blade11 ~]# hosted-engine --vm-status /usr/lib/python2.7/site- packages/ovirt_hosted_engine_ha/lib/storage_backends.py:15: DeprecationWarning: vdscli uses xmlrpc. since ovirt 3.6 xmlrpc is deprecated, please use vdsm.jsonrpcvdscli import vdsm.vdscli --== Host 1 status ==-- Status up-to-date : True Hostname : ied-blade13.install.eurotux.local Host ID: 1 Engine status : {"health": "good", "vm": "up", "detail": "up"} Score : 3400 stopped: False Local maintenance : False crc32 : a941698e Host timestamp : 153049 Extra metadata (valid at timestamp): metadata_parse_version=1 metadata_feature_version=1 timestamp=153049 (Thu Aug 18 09:22:02 2016) host-id=1 score=3400 maintenance=False state=EngineUp stopped=False --== Host 2 status ==-- Status up-to-date : True Hostname : ied-blade11.install.eurotux.local Host ID: 2 Engine status : {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"} Score : 3400 stopped: False Local maintenance : False crc32 : 8f79e0e7 Host timestamp : 143139 Extra metadata (valid at timestamp): metadata_parse_version=1 metadata_feature_version=1 timestamp=143139 (Thu Aug 18 09:22:12 2016) host-id=2 score=3400 maintenance=False state=EngineDown stopped=False [root@ied-blade13 ~]# hosted-engine --vm-status /usr/lib/python2.7/site- packages/ovirt_hosted_engine_ha/lib/storage_backends.py:15: DeprecationWarning: vdscli uses xmlrpc. since ovirt 3.6 xmlrpc is deprecated, please use vdsm.jsonrpcvdscli import vdsm.vdscli --== Host 1 status ==-- Status up-to-date : True Hostname : ied-blade13.install.eurotux.local Host ID: 1 Engine status : {"health": "good", "vm": "up", "detail": "up"} Score : 3400 stopped: False Local maintenance : False crc32 : cdd022a2 Host timestamp : 153085 Extra metadata (valid at timestamp): metadata_parse_version=1 metadata_feature_version=1 timestamp=153085 (Thu Aug 18 09:22:38 2016) host-id=1 score=3400 maintenance=False state=EngineUp stopped=False --== Host 2 status ==-- Status up-to-date : True Hostname : ied-blade11.install.eurotux.local Host ID: 2 Engine status : {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"} Score : 3400 stopped: False Local maintenance : False crc32 : fbbad961 Host timestamp : 143175 Extra metadata (valid at timestamp): metadata_parse_version=1 metadata_feature_version=1 timestamp=143175 (Thu Aug 18 09:22:48 2016) host-id=2 score=3400 maintenance=False state=EngineDown stopped=False > > > > > Regards, > > Carlos Rodrigues > > > > On Tue, 2016-08-16 at 11:53 +0100, Carlos Rodrigues wrote: > > > > > > On Sun, 2016-08-14 at 14:22 +0300, Roy Golan wrote: > > > > > > > > > > > > > > > > > > > > On 12 August 2016 at 20:23, Carlos Rodrigues > > > > wrote: > > > > > > > > > > > > > > > Hello, > > > > > > > > > > I have one cluster with two hosts with power management > > > > > correctly > > > > > configured and one virtual machine with HostedEngine over > > > > > shared > > > > > storage with FiberChannel. > > > > > > > > > > When i shutdown the network of host with HostedEngine VM, it > > > > > should be > > > > > possible the HostedEngine VM migrate automatically to another > > > > > host? > > > > > > > > > migrate on which network? > > > > > > > > > > > > > > > > > > > What is the expected behaviour on this HA scenario? > > >
Re: [ovirt-users] HostedEngine with HA
On Thu, 2016-08-18 at 08:54 +0200, Simone Tiraboschi wrote: > On Tue, Aug 16, 2016 at 12:53 PM, Carlos Rodrigues> wrote: > > > > On Sun, 2016-08-14 at 14:22 +0300, Roy Golan wrote: > > > > > > > > > > > > On 12 August 2016 at 20:23, Carlos Rodrigues > > > wrote: > > > > > > > > Hello, > > > > > > > > I have one cluster with two hosts with power management > > > > correctly > > > > configured and one virtual machine with HostedEngine over > > > > shared > > > > storage with FiberChannel. > > > > > > > > When i shutdown the network of host with HostedEngine VM, it > > > > should be > > > > possible the HostedEngine VM migrate automatically to another > > > > host? > > > > > > > migrate on which network? > > > > > > > > > > > What is the expected behaviour on this HA scenario? > > > > > > After a few minutes your vm will be shutdown by the High > > > Availability > > > agent, as it can't see network, and started on another host. > > > > > > I'm testing this scenario and after shutdown network, it should be > > expected that agent shutdown ha and started on another host, but > > after > > couple minutes nothing happens and on host with network we getting > > the > > following messages: > > > > Aug 16 11:44:08 ied-blade11.install.eurotux.local ovirt-ha- > > agent[2779]: > > ovirt-ha-agent > > ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config > > ERROR > > Unable to get vm.conf from OVF_STORE, falling back to initial > > vm.conf > > > > I think the HA agent its trying to get vm configuration but some > > how it > > can't get vm.conf to start VM. > > No, this is a different issues. > In 3.6 we added a feature to let the engine manage also the engine VM > itself; ovirt-ha-agent will pickup the latest engine VM configuration > from the OVF_STORE which is managed by the engine. > If something goes wrong, ovirt-ha-agent could fallback to the initial > (bootstrap time) vm.conf. This will normally happen till you add your > first regular storage domain and the engine imports the engine VM. But i already have my first storage domain and storage engine domain and already imported engine VM. I'm using 4.0 version. > > > > > Regards, > > Carlos Rodrigues > > > > > > > > > > > > > > > > > > > Regards, > > > > > > > > -- > > > > Carlos Rodrigues > > > > > > > > Engenheiro de Software Sénior > > > > > > > > Eurotux Informática, S.A. | www.eurotux.com > > > > (t) +351 253 680 300 (m) +351 911 926 110 > > > > > > > > ___ > > > > Users mailing list > > > > Users@ovirt.org > > > > http://lists.ovirt.org/mailman/listinfo/users > > > > > > > > > -- > > Carlos Rodrigues > > > > Engenheiro de Software Sénior > > > > Eurotux Informática, S.A. | www.eurotux.com > > (t) +351 253 680 300 (m) +351 911 926 110 > > > > ___ > > Users mailing list > > Users@ovirt.org > > http://lists.ovirt.org/mailman/listinfo/users -- Carlos Rodrigues Engenheiro de Software Sénior Eurotux Informática, S.A. | www.eurotux.com (t) +351 253 680 300 (m) +351 911 926 110 ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] HostedEngine with HA
On Tue, Aug 16, 2016 at 12:53 PM, Carlos Rodrigueswrote: > On Sun, 2016-08-14 at 14:22 +0300, Roy Golan wrote: >> >> >> On 12 August 2016 at 20:23, Carlos Rodrigues >> wrote: >> > Hello, >> > >> > I have one cluster with two hosts with power management correctly >> > configured and one virtual machine with HostedEngine over shared >> > storage with FiberChannel. >> > >> > When i shutdown the network of host with HostedEngine VM, it >> > should be >> > possible the HostedEngine VM migrate automatically to another host? >> > >> migrate on which network? >> >> > What is the expected behaviour on this HA scenario? >> >> After a few minutes your vm will be shutdown by the High Availability >> agent, as it can't see network, and started on another host. > > > I'm testing this scenario and after shutdown network, it should be > expected that agent shutdown ha and started on another host, but after > couple minutes nothing happens and on host with network we getting the > following messages: > > Aug 16 11:44:08 ied-blade11.install.eurotux.local ovirt-ha-agent[2779]: > ovirt-ha-agent > ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config ERROR > Unable to get vm.conf from OVF_STORE, falling back to initial vm.conf > > I think the HA agent its trying to get vm configuration but some how it > can't get vm.conf to start VM. No, this is a different issues. In 3.6 we added a feature to let the engine manage also the engine VM itself; ovirt-ha-agent will pickup the latest engine VM configuration from the OVF_STORE which is managed by the engine. If something goes wrong, ovirt-ha-agent could fallback to the initial (bootstrap time) vm.conf. This will normally happen till you add your first regular storage domain and the engine imports the engine VM. > Regards, > Carlos Rodrigues > > >> > >> > Regards, >> > >> > -- >> > Carlos Rodrigues >> > >> > Engenheiro de Software Sénior >> > >> > Eurotux Informática, S.A. | www.eurotux.com >> > (t) +351 253 680 300 (m) +351 911 926 110 >> > >> > ___ >> > Users mailing list >> > Users@ovirt.org >> > http://lists.ovirt.org/mailman/listinfo/users >> > >> > -- > Carlos Rodrigues > > Engenheiro de Software Sénior > > Eurotux Informática, S.A. | www.eurotux.com > (t) +351 253 680 300 (m) +351 911 926 110 > > ___ > Users mailing list > Users@ovirt.org > http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] HostedEngine with HA
Anyone can help me to build HA on HostedEngine VM? How can i guarantee that if host with HostedEngine VM goes down, the HostedEngine VM moves to another host? Regards, Carlos Rodrigues On Tue, 2016-08-16 at 11:53 +0100, Carlos Rodrigues wrote: > On Sun, 2016-08-14 at 14:22 +0300, Roy Golan wrote: > > > > > > > > On 12 August 2016 at 20:23, Carlos Rodrigues> > wrote: > > > > > > Hello, > > > > > > I have one cluster with two hosts with power management correctly > > > configured and one virtual machine with HostedEngine over shared > > > storage with FiberChannel. > > > > > > When i shutdown the network of host with HostedEngine VM, it > > > should be > > > possible the HostedEngine VM migrate automatically to another > > > host? > > > > > migrate on which network? > > > > > > > > What is the expected behaviour on this HA scenario? > > > > After a few minutes your vm will be shutdown by the High > > Availability > > agent, as it can't see network, and started on another host. > > > I'm testing this scenario and after shutdown network, it should be > expected that agent shutdown ha and started on another host, but > after > couple minutes nothing happens and on host with network we getting > the > following messages: > > Aug 16 11:44:08 ied-blade11.install.eurotux.local ovirt-ha- > agent[2779]: > ovirt-ha-agent > ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config ERROR > Unable to get vm.conf from OVF_STORE, falling back to initial vm.conf > > I think the HA agent its trying to get vm configuration but some how > it > can't get vm.conf to start VM. > > Regards, > Carlos Rodrigues > > > > > > > > > > > > > Regards, > > > > > > -- > > > Carlos Rodrigues > > > > > > Engenheiro de Software Sénior > > > > > > Eurotux Informática, S.A. | www.eurotux.com > > > (t) +351 253 680 300 (m) +351 911 926 110 > > > > > > ___ > > > Users mailing list > > > Users@ovirt.org > > > http://lists.ovirt.org/mailman/listinfo/users > > > > > -- Carlos Rodrigues Engenheiro de Software Sénior Eurotux Informática, S.A. | www.eurotux.com (t) +351 253 680 300 (m) +351 911 926 110 ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] HostedEngine with HA
On 12 August 2016 at 20:23, Carlos Rodrigueswrote: > Hello, > > I have one cluster with two hosts with power management correctly > configured and one virtual machine with HostedEngine over shared > storage with FiberChannel. > > When i shutdown the network of host with HostedEngine VM, it should be > possible the HostedEngine VM migrate automatically to another host? > > migrate on which network? > What is the expected behaviour on this HA scenario? > After a few minutes your vm will be shutdown by the High Availability agent, as it can't see network, and started on another host. > > Regards, > > -- > Carlos Rodrigues > > Engenheiro de Software Sénior > > Eurotux Informática, S.A. | www.eurotux.com > (t) +351 253 680 300 (m) +351 911 926 110 > > ___ > Users mailing list > Users@ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
[ovirt-users] HostedEngine with HA
Hello, I have one cluster with two hosts with power management correctly configured and one virtual machine with HostedEngine over shared storage with FiberChannel. When i shutdown the network of host with HostedEngine VM, it should be possible the HostedEngine VM migrate automatically to another host? What is the expected behaviour on this HA scenario? Regards, -- Carlos Rodrigues Engenheiro de Software Sénior Eurotux Informática, S.A. | www.eurotux.com (t) +351 253 680 300 (m) +351 911 926 110 ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users