[ovirt-users] Ovirt-engine-ha cannot to see live status of Hosted Engine
Good day for all.
I have some issues with Ovirt 4.2.6. But now the main this of it:
I have two Centos 7 Nodes with same config and last Ovirt 4.2.6 with
Hostedengine with disk on NFS storage.
Also some of virtual machines working good.
But, when HostedEngine running on one node (srv02.local) everything is fine.
After migrating to another node (srv00.local), i see that agent cannot to check
livelinness of HostedEngine. After few minutes HostedEngine going to reboot and
after some time i see some situation. After migration to another node
(srv00.local) all looks OK.
hosted-engine --vm-status commang when HosterEngine on srv00 node:
--== Host 1 status ==--
conf_on_shared_storage : True
Status up-to-date : True
Hostname : srv02.local
Host ID: 1
Engine status : {"reason": "vm not running on this host",
"health": "bad", "vm": "down_unexpected", "detail": "unknown"}
Score : 0
stopped: False
Local maintenance : False
crc32 : ecc7ad2d
local_conf_timestamp : 78328
Host timestamp : 78328
Extra metadata (valid at timestamp):
metadata_parse_version=1
metadata_feature_version=1
timestamp=78328 (Tue Sep 18 12:44:18 2018)
host-id=1
score=0
vm_conf_refresh_time=78328 (Tue Sep 18 12:44:18 2018)
conf_on_shared_storage=True
maintenance=False
state=EngineUnexpectedlyDown
stopped=False
timeout=Fri Jan 2 03:49:58 1970
--== Host 2 status ==--
conf_on_shared_storage : True
Status up-to-date : True
Hostname : srv00.local
Host ID: 2
Engine status : {"reason": "failed liveliness check",
"health": "bad", "vm": "up", "detail": "Up"}
Score : 3400
stopped: False
Local maintenance : False
crc32 : 1d62b106
local_conf_timestamp : 326288
Host timestamp : 326288
Extra metadata (valid at timestamp):
metadata_parse_version=1
metadata_feature_version=1
timestamp=326288 (Tue Sep 18 12:44:21 2018)
host-id=2
score=3400
vm_conf_refresh_time=326288 (Tue Sep 18 12:44:21 2018)
conf_on_shared_storage=True
maintenance=False
state=EngineStarting
stopped=False
Log agent.log from srv00.local:
MainThread::INFO::2018-09-18
12:40:51,749::states::779::ovirt_hosted_engine_ha.agent.hosted_engine.HostedE
ngine::(consume) VM is powering up..
MainThread::INFO::2018-09-18
12:40:52,052::hosted_engine::491::ovirt_hosted_engine_ha.agent.hosted_engine.
HostedEngine::(_monitoring_loop) Current state EngineStarting (score: 3400)
MainThread::INFO::2018-09-18
12:41:01,066::states::779::ovirt_hosted_engine_ha.agent.hosted_engine.HostedE
ngine::(consume) VM is powering up..
MainThread::INFO::2018-09-18
12:41:01,374::hosted_engine::491::ovirt_hosted_engine_ha.agent.hosted_engine.
HostedEngine::(_monitoring_loop) Current state EngineStarting (score: 3400)
MainThread::INFO::2018-09-18
12:41:11,393::state_machine::169::ovirt_hosted_engine_ha.agent.hosted_engine.
HostedEngine::(refresh) Global metadata: {'maintenance': False}
MainThread::INFO::2018-09-18
12:41:11,393::state_machine::174::ovirt_hosted_engine_ha.agent.hosted_engine.
HostedEngine::(refresh) Host srv02.local.pioner.kz (id 1):
{'conf_on_shared_storage': True, 'extra': 'meta
data_parse_version=1\nmetadata_feature_version=1\ntimestamp=78128 (Tue Sep 18
12:40:58 2018)\nhost-id=1\ns
core=0\nvm_conf_refresh_time=78128 (Tue Sep 18 12:40:58
2018)\nconf_on_shared_storage=True\nmaintenance=Fa
lse\nstate=EngineUnexpectedlyDown\nstopped=False\ntimeout=Fri Jan 2 03:49:58
1970\n', 'hostname': 'srv02.
local.pioner.kz', 'alive': True, 'host-id': 1, 'engine-status': {'reason': 'vm
not running on this host',
'health': 'bad', 'vm': 'down_unexpected', 'detail': 'unknown'}, 'score': 0,
'stopped': False, 'maintenance
': False, 'crc32': 'e18e3f22', 'local_conf_timestamp': 78128, 'host-ts': 78128}
MainThread::INFO::2018-09-18
12:41:11,393::state_machine::177::ovirt_hosted_engine_ha.agent.hosted_engine.
HostedEngine::(refresh) Local (id 2): {'engine-health': {'reason': 'failed
liveliness check', 'health': 'b
ad', 'vm': 'up', 'detail': 'Up'}, 'bridge': True, 'mem-free': 12763.0,
'maintenance': False, 'cpu-load': 0
.0364, 'gateway': 1.0, 'storage-domain': True}
MainThread::INFO::2018-09-18
12:41:11,393::states::779::ovirt_hosted_engine_ha.agent.hosted_engine.HostedE
ngine::(consume) VM is powering up..
MainThread::INFO::2018-09-18
12:41:11,703::hosted_engine::491::ovirt_hosted_engine_ha.agent.hosted_engine.
HostedEngine::(_monitoring_loop) Current state EngineStarting (score
Re: [ovirt-users] ovirt engine HA
In case you need HA for the engine you need to deploy it to other hosts also through the GUI. On Tue, Apr 3, 2018 at 4:47 PM, FERNANDO FREDIANI wrote: > Is it enough to deploy the Self-Hosted engine in just one Host of the > cluster or is it necessary to repeat the process in each of the nodes that > must be able to run it ? > > Thanks > Fernando > > 2018-04-03 2:01 GMT-03:00 Vincent Royer : > >> Same thing, the engine in this case is "self-hosted", as in, it runs in a >> VM hosted on the cluster that it is managing. I am a beginner here, but >> from my understanding, each node is always checking on the health of the >> engine VM. If the engine is missing (ie, the host running it has gone >> down), then another available, healthy host will spawn up the engine and >> you will regain access. >> >> In my experience this has worked very reliably. I have 2 hosts, both are >> "able" to run the engine VM. If I take one host down, I am not able to >> load the engine GUI. But if I wait a few minutes, then I regain access, >> and see that the engine is now running on the remaining healthy host. >> >> *Vincent Royer* >> *778-825-1057 <(778)%20825-1057>* >> >> >> <http://www.epicenergy.ca/> >> *SUSTAINABLE MOBILE ENERGY SOLUTIONS* >> >> >> >> >> On Mon, Apr 2, 2018 at 6:07 PM, wrote: >> >>> what different between self-hosted engine and hosted engine? I find a >>> project ovirt-hosted-engine-ha >>> <https://github.com/oVirt/ovirt-hosted-engine-ha> https: >>> //github.com/oVirt/ovirt-hosted-engine-ha >>> - 原始邮件 - >>> 发件人：Vincent Royer >>> 收件人：dhy...@sina.com >>> 抄送人：users >>> 主题：Re: [ovirt-users] ovirt engine HA >>> 日期：2018年04月03日 08点57分 >>> >>> If your node running self-hosted engine crashes, the hosted engine will >>> be started up on another node. It just takes a few minutes for this all to >>> happen, but it works reliably in my experience. >>> >>> >>> >>> On Mon, Apr 2, 2018 at 5:42 PM, wrote: >>> >>> How to solute ovirt engine HA, I have a three node cluster, one of is >>> deploy engine and node , others are node, if node that deplay engine and >>> node crash, How to ensure my server is up? >>> ___ >>> Users mailing list >>> Users@ovirt.org >>> http://lists.ovirt.org/mailman/listinfo/users >>> >>> >>> >> >> ___ >> Users mailing list >> Users@ovirt.org >> http://lists.ovirt.org/mailman/listinfo/users >> >> > > ___ > Users mailing list > Users@ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > > ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] ovirt engine HA
Is it enough to deploy the Self-Hosted engine in just one Host of the cluster or is it necessary to repeat the process in each of the nodes that must be able to run it ? Thanks Fernando 2018-04-03 2:01 GMT-03:00 Vincent Royer : > Same thing, the engine in this case is "self-hosted", as in, it runs in a > VM hosted on the cluster that it is managing. I am a beginner here, but > from my understanding, each node is always checking on the health of the > engine VM. If the engine is missing (ie, the host running it has gone > down), then another available, healthy host will spawn up the engine and > you will regain access. > > In my experience this has worked very reliably. I have 2 hosts, both are > "able" to run the engine VM. If I take one host down, I am not able to > load the engine GUI. But if I wait a few minutes, then I regain access, > and see that the engine is now running on the remaining healthy host. > > *Vincent Royer* > *778-825-1057 <(778)%20825-1057>* > > > <http://www.epicenergy.ca/> > *SUSTAINABLE MOBILE ENERGY SOLUTIONS* > > > > > On Mon, Apr 2, 2018 at 6:07 PM, wrote: > >> what different between self-hosted engine and hosted engine? I find a >> project ovirt-hosted-engine-ha >> <https://github.com/oVirt/ovirt-hosted-engine-ha> https: >> //github.com/oVirt/ovirt-hosted-engine-ha >> - 原始邮件 - >> 发件人：Vincent Royer >> 收件人：dhy...@sina.com >> 抄送人：users >> 主题：Re: [ovirt-users] ovirt engine HA >> 日期：2018年04月03日 08点57分 >> >> If your node running self-hosted engine crashes, the hosted engine will >> be started up on another node. It just takes a few minutes for this all to >> happen, but it works reliably in my experience. >> >> >> >> On Mon, Apr 2, 2018 at 5:42 PM, wrote: >> >> How to solute ovirt engine HA, I have a three node cluster, one of is >> deploy engine and node , others are node, if node that deplay engine and >> node crash, How to ensure my server is up? >> ___ >> Users mailing list >> Users@ovirt.org >> http://lists.ovirt.org/mailman/listinfo/users >> >> >> > > ___ > Users mailing list > Users@ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > > ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] ovirt engine HA
Sounds like you should start here https://ovirt.org/documentation/self-hosted/Self-Hosted_Engine_Guide/ On Mon, Apr 2, 2018, 10:42 PM , wrote: > Thank you, How to deploy self-hosted engine? may you give me some data for > self-hosted engine. > - 原始邮件 - > 发件人：Vincent Royer > 收件人：dhy...@sina.com > 抄送人：users > 主题：Re: Re: [ovirt-users] ovirt engine HA > 日期：2018年04月03日 13点02分 > > Same thing, the engine in this case is "self-hosted", as in, it runs in a > VM hosted on the cluster that it is managing. I am a beginner here, but > from my understanding, each node is always checking on the health of the > engine VM. If the engine is missing (ie, the host running it has gone > down), then another available, healthy host will spawn up the engine and > you will regain access. > > In my experience this has worked very reliably. I have 2 hosts, both are > "able" to run the engine VM. If I take one host down, I am not able to > load the engine GUI. But if I wait a few minutes, then I regain access, > and see that the engine is now running on the remaining healthy host. > > *Vincent Royer* > *778-825-1057* > > > <http://www.epicenergy.ca/> > *SUSTAINABLE MOBILE ENERGY SOLUTIONS* > > > > > On Mon, Apr 2, 2018 at 6:07 PM, wrote: > > what different between self-hosted engine and hosted engine? I find a > project ovirt-hosted-engine-ha > <https://github.com/oVirt/ovirt-hosted-engine-ha> > https://github.com/oVirt/ovirt-hosted-engine-ha > - 原始邮件 - > 发件人：Vincent Royer > 收件人：dhy...@sina.com > 抄送人：users > 主题：Re: [ovirt-users] ovirt engine HA > 日期：2018年04月03日 08点57分 > > If your node running self-hosted engine crashes, the hosted engine will be > started up on another node. It just takes a few minutes for this all to > happen, but it works reliably in my experience. > > > > On Mon, Apr 2, 2018 at 5:42 PM, wrote: > > How to solute ovirt engine HA, I have a three node cluster, one of is > deploy engine and node , others are node, if node that deplay engine and > node crash, How to ensure my server is up? > ___ > Users mailing list > Users@ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > > > > ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] ovirt engine HA
Same thing, the engine in this case is "self-hosted", as in, it runs in a VM hosted on the cluster that it is managing. I am a beginner here, but from my understanding, each node is always checking on the health of the engine VM. If the engine is missing (ie, the host running it has gone down), then another available, healthy host will spawn up the engine and you will regain access. In my experience this has worked very reliably. I have 2 hosts, both are "able" to run the engine VM. If I take one host down, I am not able to load the engine GUI. But if I wait a few minutes, then I regain access, and see that the engine is now running on the remaining healthy host. *Vincent Royer* *778-825-1057* <http://www.epicenergy.ca/> *SUSTAINABLE MOBILE ENERGY SOLUTIONS* On Mon, Apr 2, 2018 at 6:07 PM, wrote: > what different between self-hosted engine and hosted engine? I find a > project ovirt-hosted-engine-ha > <https://github.com/oVirt/ovirt-hosted-engine-ha> https: > //github.com/oVirt/ovirt-hosted-engine-ha > - 原始邮件 - > 发件人：Vincent Royer > 收件人：dhy...@sina.com > 抄送人：users > 主题：Re: [ovirt-users] ovirt engine HA > 日期：2018年04月03日 08点57分 > > If your node running self-hosted engine crashes, the hosted engine will be > started up on another node. It just takes a few minutes for this all to > happen, but it works reliably in my experience. > > > > On Mon, Apr 2, 2018 at 5:42 PM, wrote: > > How to solute ovirt engine HA, I have a three node cluster, one of is > deploy engine and node , others are node, if node that deplay engine and > node crash, How to ensure my server is up? > ___ > Users mailing list > Users@ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > > > ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] ovirt engine HA
If your node running self-hosted engine crashes, the hosted engine will be started up on another node. It just takes a few minutes for this all to happen, but it works reliably in my experience. On Mon, Apr 2, 2018 at 5:42 PM, wrote: > How to solute ovirt engine HA, I have a three node cluster, one of is > deploy engine and node , others are node, if node that deplay engine and > node crash, How to ensure my server is up? > ___ > Users mailing list > Users@ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > > ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
[ovirt-users] ovirt engine HA
How to solute ovirt engine HA, I have a three node cluster, one of is deploy engine and node , others are node, if node that deplay engine and node crash, How to ensure my server is up?___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] Ovirt-Engine HA
On Fri, Aug 19, 2016 at 8:11 PM, Scott wrote: > Hi Sandvik, > > I believe this ultimately is what the self hosted engine is planned to > solve. It's up to you as to whether you feel comfortable with that idea > currently. > Indeed. And many in the community are using it. > Outside of that, I would point you to the Red Hat Cluster Suite in a > RHEV/RHEL environment. The high availability component of that is based on > Linux-HA but I have only used Red Hat's implementation. > > Lastly, the poor man's solution if this isn't critical infrastructure > would be a hot standby server. Keep the packages in sync between the two > however you feel appropriate. Run engine-backup as frequently as needed and > copy it to the second server. Have your engine address as a secondary > address with appropriate DNS and move it between them in a fail over (or > use a CNAME). Restore the backup in a fail over and run engine-setup. I > think you get the idea. > I don't like this approach very much - you always forget some configuration. (For example, we've had an issue with Kerberos database later on when migrating). You are also 'wasting' a server. Y. > Personally I use hosted engine in all but my main production cluster. That > one will use it once I've upgraded those hosts to RHEL 7. > > Hope that helps. > > Scott > > On Fri, Aug 19, 2016, 11:40 AM Sandvik Agustin > wrote: > >> Hi Ovirt Users, >> >> Do you have any documentation, tutorial, howto or workaround to perform >> or to have an ovirt-engine HA? Iv'e tried to google about this but I can't >> find any. >> >> let's say I want to have two engine, engine1 is currently managing two >> hypervisor, then engin2 is my reserved engine, so I can still managed those >> vm that are running inside of my hypervisor if ever engine1 fails. >> >> TIA :) >> Sandvik >> ___ >> Users mailing list >> Users@ovirt.org >> http://lists.ovirt.org/mailman/listinfo/users >> > > ___ > Users mailing list > Users@ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > > ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] Ovirt-Engine HA
Hi Scott, Thanks for the quick reply, "self hosted engine" are you talking about the hosted-engine? I tried hosted-engine, I think twice, and I'm having problem with VLAN(s), I can't manipulate the NIC of the hosted engine. I think I need to read more about this "self hosted engine". TIA Sandvik On Sat, Aug 20, 2016 at 1:11 AM, Scott wrote: > Hi Sandvik, > > I believe this ultimately is what the self hosted engine is planned to > solve. It's up to you as to whether you feel comfortable with that idea > currently. > > Outside of that, I would point you to the Red Hat Cluster Suite in a > RHEV/RHEL environment. The high availability component of that is based on > Linux-HA but I have only used Red Hat's implementation. > > Lastly, the poor man's solution if this isn't critical infrastructure > would be a hot standby server. Keep the packages in sync between the two > however you feel appropriate. Run engine-backup as frequently as needed and > copy it to the second server. Have your engine address as a secondary > address with appropriate DNS and move it between them in a fail over (or > use a CNAME). Restore the backup in a fail over and run engine-setup. I > think you get the idea. > > Personally I use hosted engine in all but my main production cluster. That > one will use it once I've upgraded those hosts to RHEL 7. > > Hope that helps. > > Scott > > On Fri, Aug 19, 2016, 11:40 AM Sandvik Agustin > wrote: > >> Hi Ovirt Users, >> >> Do you have any documentation, tutorial, howto or workaround to perform >> or to have an ovirt-engine HA? Iv'e tried to google about this but I can't >> find any. >> >> let's say I want to have two engine, engine1 is currently managing two >> hypervisor, then engin2 is my reserved engine, so I can still managed those >> vm that are running inside of my hypervisor if ever engine1 fails. >> >> TIA :) >> Sandvik >> ___ >> Users mailing list >> Users@ovirt.org >> http://lists.ovirt.org/mailman/listinfo/users >> > ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] Ovirt-Engine HA
Hi Sandvik, I believe this ultimately is what the self hosted engine is planned to solve. It's up to you as to whether you feel comfortable with that idea currently. Outside of that, I would point you to the Red Hat Cluster Suite in a RHEV/RHEL environment. The high availability component of that is based on Linux-HA but I have only used Red Hat's implementation. Lastly, the poor man's solution if this isn't critical infrastructure would be a hot standby server. Keep the packages in sync between the two however you feel appropriate. Run engine-backup as frequently as needed and copy it to the second server. Have your engine address as a secondary address with appropriate DNS and move it between them in a fail over (or use a CNAME). Restore the backup in a fail over and run engine-setup. I think you get the idea. Personally I use hosted engine in all but my main production cluster. That one will use it once I've upgraded those hosts to RHEL 7. Hope that helps. Scott On Fri, Aug 19, 2016, 11:40 AM Sandvik Agustin wrote: > Hi Ovirt Users, > > Do you have any documentation, tutorial, howto or workaround to perform or > to have an ovirt-engine HA? Iv'e tried to google about this but I can't > find any. > > let's say I want to have two engine, engine1 is currently managing two > hypervisor, then engin2 is my reserved engine, so I can still managed those > vm that are running inside of my hypervisor if ever engine1 fails. > > TIA :) > Sandvik > ___ > Users mailing list > Users@ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
[ovirt-users] Ovirt-Engine HA
Hi Ovirt Users, Do you have any documentation, tutorial, howto or workaround to perform or to have an ovirt-engine HA? Iv'e tried to google about this but I can't find any. let's say I want to have two engine, engine1 is currently managing two hypervisor, then engin2 is my reserved engine, so I can still managed those vm that are running inside of my hypervisor if ever engine1 fails. TIA :) Sandvik ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] ovirt-engine-ha: 012TypeError: get_all_stats_for_service_type() got an unexpected keyword argument 'storage_dir'
On 23.10.2014 15:39, Sandro Bonazzola wrote: > Il 23/10/2014 15:30, Daniel Helgenberger ha scritto: >> On 23.10.2014 14:15, Martin Sivak wrote: >>> Hi, >>> >>> yes it is possible. VDSM is probably still using the old version of the >>> brokerlink library because of it. >> thanks Martin, this seems to have worked. >> Question: is VDSM fully backward compatible with ovirt-engine-ha? >> >> Anyway, my conclusion is *not* to use host-deploy any more on HA nodes >> but rather yum upadate/manual service restart. Also, it might be a good >> idea for host-deploy to detect ovirt-engine-ha and upgrade it along with >> VDSM if applicable. If you or someone agrees I will file an RFE .. >> though Allon might not be happy ;) > +1 > for 3.6 host-deploy must be aware of hosted engine anyway for allowing to add > new host to the HE cluster from the web admin interface. Added, https://bugzilla.redhat.com/show_bug.cgi?id=1156163 > > >>> >>> >>> -- >>> Martin Sivák >>> msi...@redhat.com >>> Red Hat Czech >>> RHEV-M SLA / Brno, CZ >>> >>> - Original Message - Hm, I upgraded vdsm and restarted it *before* iI upgraded engine HA; 7042 vdsmSun Oct 19 16:24:24 2014 3-19:05:00 18:20:44 /usr/bin/python /usr/share/vdsm/vdsm --pidfile /var/run/vdsm/vdsmd.pid Might this be the problem? On 23.10.2014 12:12, Martin Sivak wrote: > Ah, > > what about vdsm? It queries the broker every now and then to get the > information it reports to the webadmin. > > -- > Martin Sivák > msi...@redhat.com > Red Hat Czech > RHEV-M SLA / Brno, CZ > > - Original Message - >> On 23.10.2014 11:09, Martin Sivak wrote: >>> It seems that your running version of broker is not compatible with the >>> agent. Did you restart both services after upgrade? >> I did, please see below. >>> Can you check when were the services started and compare it? >>> >>> ps -eo pid,comm,lstart,etime,time,args >> 15474 ovirt-ha-agent Tue Oct 21 13:39:56 2014 1-21:49:28 00:09:38 >> /usr/bin/python /usr/share/ovirt-hosted-engine-ha/ovirt-ha-agent >> 15568 ovirt-ha-broker Tue Oct 21 13:40:06 2014 1-21:49:18 00:54:01 >> /usr/bin/python /usr/share/ovirt-hosted-engine-ha/ovirt-ha-broker >> >>> -- >>> Martin Sivák >>> msi...@redhat.com >>> Red Hat Czech >>> RHEV-M SLA / Brno, CZ >>> >>> - Original Message - Hello, might this be a bug? Logs are filling up with his on hosts the engine is *not* running on. When I migrate the engine to this host, the error stops and starts on the host migrated from. If so, I would open a bug. CentOS 2.6.32-431.29.2.el6.x86_64 #1 SMP Tue Sep 9 21:36:05 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux ovirt-hosted-engine-ha-1.2.4-1.el6.noarch example -- Oct 22 00:44:15 nodehv02 ovirt-ha-broker ovirt_hosted_engine_ha.broker.listener.ConnectionHandler ERROR Error handling request, data: 'get-stats storage_dir=/rhev/data-center/mnt/192.168.50.11:_volumes_tank_ovirt-vdsmd/bcfa7ec4-5278-44d8-9f31-682f2d9de91d/ha_agent service_type=hosted-engine'#012Traceback (most recent call last):#012 File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/broker/listener.py", line 166, in handle#012data)#012 File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/broker/listener.py", line 268, in _dispatch#012.get_all_stats_for_service_type(client, **options)#012TypeError: get_all_stats_for_service_type() got an unexpected keyword argument 'storage_dir' Oct 22 00:44:15 nodehv02 vdsm vds ERROR failed to retrieve Hosted Engine HA info#012Traceback (most recent call last):#012 File "/usr/share/vdsm/API.py", line 1678, in _getHaInfo#012stats = instance.get_all_stats()#012 File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 86, in get_all_stats#012 self._check_liveness_metadata(stats[host_id], broker)#012 File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 171, in get_stats_from_storage#012try:#012 File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 199, in _checked_communicate#012"""#012RequestError: Request failed: - -- Daniel Helgenberger m box bewegtbild GmbH P: +49/30/2408781-22 F: +49/30/2408781-10 ACKERSTR. 19 D-10115 BERLIN www.m-box.de www.monkeymen.tv Geschäftsführer: Martin Retschitzegger / Michaela Göllner >
Re: [ovirt-users] ovirt-engine-ha: 012TypeError: get_all_stats_for_service_type() got an unexpected keyword argument 'storage_dir'
Il 23/10/2014 15:30, Daniel Helgenberger ha scritto: > > On 23.10.2014 14:15, Martin Sivak wrote: >> Hi, >> >> yes it is possible. VDSM is probably still using the old version of the >> brokerlink library because of it. > thanks Martin, this seems to have worked. > Question: is VDSM fully backward compatible with ovirt-engine-ha? > > Anyway, my conclusion is *not* to use host-deploy any more on HA nodes > but rather yum upadate/manual service restart. Also, it might be a good > idea for host-deploy to detect ovirt-engine-ha and upgrade it along with > VDSM if applicable. If you or someone agrees I will file an RFE .. > though Allon might not be happy ;) +1 for 3.6 host-deploy must be aware of hosted engine anyway for allowing to add new host to the HE cluster from the web admin interface. >> >> >> -- >> Martin Sivák >> msi...@redhat.com >> Red Hat Czech >> RHEV-M SLA / Brno, CZ >> >> - Original Message - >>> Hm, >>> >>> I upgraded vdsm and restarted it *before* iI upgraded engine HA; >>> 7042 vdsmSun Oct 19 16:24:24 2014 3-19:05:00 18:20:44 >>> /usr/bin/python /usr/share/vdsm/vdsm --pidfile /var/run/vdsm/vdsmd.pid >>> >>> Might this be the problem? >>> >>> On 23.10.2014 12:12, Martin Sivak wrote: Ah, what about vdsm? It queries the broker every now and then to get the information it reports to the webadmin. -- Martin Sivák msi...@redhat.com Red Hat Czech RHEV-M SLA / Brno, CZ - Original Message - > On 23.10.2014 11:09, Martin Sivak wrote: >> It seems that your running version of broker is not compatible with the >> agent. Did you restart both services after upgrade? > I did, please see below. >> Can you check when were the services started and compare it? >> >> ps -eo pid,comm,lstart,etime,time,args > 15474 ovirt-ha-agent Tue Oct 21 13:39:56 2014 1-21:49:28 00:09:38 > /usr/bin/python /usr/share/ovirt-hosted-engine-ha/ovirt-ha-agent > 15568 ovirt-ha-broker Tue Oct 21 13:40:06 2014 1-21:49:18 00:54:01 > /usr/bin/python /usr/share/ovirt-hosted-engine-ha/ovirt-ha-broker > >> -- >> Martin Sivák >> msi...@redhat.com >> Red Hat Czech >> RHEV-M SLA / Brno, CZ >> >> - Original Message - >>> Hello, >>> >>> might this be a bug? Logs are filling up with his on hosts the engine is >>> *not* running on. When I migrate the engine to this host, the error >>> stops and starts on the host migrated from. If so, I would open a bug. >>> >>> CentOS 2.6.32-431.29.2.el6.x86_64 #1 SMP Tue Sep 9 21:36:05 UTC 2014 >>> x86_64 x86_64 x86_64 GNU/Linux >>> ovirt-hosted-engine-ha-1.2.4-1.el6.noarch >>> >>> example >>> -- >>> Oct 22 00:44:15 nodehv02 ovirt-ha-broker >>> ovirt_hosted_engine_ha.broker.listener.ConnectionHandler ERROR Error >>> handling request, data: 'get-stats >>> storage_dir=/rhev/data-center/mnt/192.168.50.11:_volumes_tank_ovirt-vdsmd/bcfa7ec4-5278-44d8-9f31-682f2d9de91d/ha_agent >>> service_type=hosted-engine'#012Traceback (most recent call last):#012 >>> File >>> "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/broker/listener.py", >>> line 166, in handle#012data)#012 File >>> "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/broker/listener.py", >>> line 268, in _dispatch#012.get_all_stats_for_service_type(client, >>> **options)#012TypeError: get_all_stats_for_service_type() got an >>> unexpected keyword argument 'storage_dir' >>> Oct 22 00:44:15 nodehv02 vdsm vds ERROR failed to retrieve Hosted Engine >>> HA info#012Traceback (most recent call last):#012 File >>> "/usr/share/vdsm/API.py", line 1678, in _getHaInfo#012stats = >>> instance.get_all_stats()#012 File >>> "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", >>> line 86, in get_all_stats#012 >>> self._check_liveness_metadata(stats[host_id], broker)#012 File >>> "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", >>> line 171, in get_stats_from_storage#012try:#012 File >>> "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", >>> line 199, in _checked_communicate#012"""#012RequestError: Request >>> failed: >>> - >>> >>> -- >>> Daniel Helgenberger >>> m box bewegtbild GmbH >>> >>> P: +49/30/2408781-22 >>> F: +49/30/2408781-10 >>> >>> ACKERSTR. 19 >>> D-10115 BERLIN >>> >>> >>> www.m-box.de www.monkeymen.tv >>> >>> Geschäftsführer: Martin Retschitzegger / Michaela Göllner >>> Handeslregister: Amtsgericht Charlottenburg / HRB 112767 >>> >>> ___ >>> Users mailing list >>> Users@ovirt.org >>> http://lists.ovirt.org/mailman/listinfo/users >>> > -
Re: [ovirt-users] ovirt-engine-ha: 012TypeError: get_all_stats_for_service_type() got an unexpected keyword argument 'storage_dir'
On 23.10.2014 14:15, Martin Sivak wrote: > Hi, > > yes it is possible. VDSM is probably still using the old version of the > brokerlink library because of it. thanks Martin, this seems to have worked. Question: is VDSM fully backward compatible with ovirt-engine-ha? Anyway, my conclusion is *not* to use host-deploy any more on HA nodes but rather yum upadate/manual service restart. Also, it might be a good idea for host-deploy to detect ovirt-engine-ha and upgrade it along with VDSM if applicable. If you or someone agrees I will file an RFE .. though Allon might not be happy ;) > > > -- > Martin Sivák > msi...@redhat.com > Red Hat Czech > RHEV-M SLA / Brno, CZ > > - Original Message - >> Hm, >> >> I upgraded vdsm and restarted it *before* iI upgraded engine HA; >> 7042 vdsmSun Oct 19 16:24:24 2014 3-19:05:00 18:20:44 >> /usr/bin/python /usr/share/vdsm/vdsm --pidfile /var/run/vdsm/vdsmd.pid >> >> Might this be the problem? >> >> On 23.10.2014 12:12, Martin Sivak wrote: >>> Ah, >>> >>> what about vdsm? It queries the broker every now and then to get the >>> information it reports to the webadmin. >>> >>> -- >>> Martin Sivák >>> msi...@redhat.com >>> Red Hat Czech >>> RHEV-M SLA / Brno, CZ >>> >>> - Original Message - On 23.10.2014 11:09, Martin Sivak wrote: > It seems that your running version of broker is not compatible with the > agent. Did you restart both services after upgrade? I did, please see below. > Can you check when were the services started and compare it? > > ps -eo pid,comm,lstart,etime,time,args 15474 ovirt-ha-agent Tue Oct 21 13:39:56 2014 1-21:49:28 00:09:38 /usr/bin/python /usr/share/ovirt-hosted-engine-ha/ovirt-ha-agent 15568 ovirt-ha-broker Tue Oct 21 13:40:06 2014 1-21:49:18 00:54:01 /usr/bin/python /usr/share/ovirt-hosted-engine-ha/ovirt-ha-broker > -- > Martin Sivák > msi...@redhat.com > Red Hat Czech > RHEV-M SLA / Brno, CZ > > - Original Message - >> Hello, >> >> might this be a bug? Logs are filling up with his on hosts the engine is >> *not* running on. When I migrate the engine to this host, the error >> stops and starts on the host migrated from. If so, I would open a bug. >> >> CentOS 2.6.32-431.29.2.el6.x86_64 #1 SMP Tue Sep 9 21:36:05 UTC 2014 >> x86_64 x86_64 x86_64 GNU/Linux >> ovirt-hosted-engine-ha-1.2.4-1.el6.noarch >> >> example >> -- >> Oct 22 00:44:15 nodehv02 ovirt-ha-broker >> ovirt_hosted_engine_ha.broker.listener.ConnectionHandler ERROR Error >> handling request, data: 'get-stats >> storage_dir=/rhev/data-center/mnt/192.168.50.11:_volumes_tank_ovirt-vdsmd/bcfa7ec4-5278-44d8-9f31-682f2d9de91d/ha_agent >> service_type=hosted-engine'#012Traceback (most recent call last):#012 >> File >> "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/broker/listener.py", >> line 166, in handle#012data)#012 File >> "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/broker/listener.py", >> line 268, in _dispatch#012.get_all_stats_for_service_type(client, >> **options)#012TypeError: get_all_stats_for_service_type() got an >> unexpected keyword argument 'storage_dir' >> Oct 22 00:44:15 nodehv02 vdsm vds ERROR failed to retrieve Hosted Engine >> HA info#012Traceback (most recent call last):#012 File >> "/usr/share/vdsm/API.py", line 1678, in _getHaInfo#012stats = >> instance.get_all_stats()#012 File >> "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", >> line 86, in get_all_stats#012 >> self._check_liveness_metadata(stats[host_id], broker)#012 File >> "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", >> line 171, in get_stats_from_storage#012try:#012 File >> "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", >> line 199, in _checked_communicate#012"""#012RequestError: Request >> failed: >> - >> >> -- >> Daniel Helgenberger >> m box bewegtbild GmbH >> >> P: +49/30/2408781-22 >> F: +49/30/2408781-10 >> >> ACKERSTR. 19 >> D-10115 BERLIN >> >> >> www.m-box.de www.monkeymen.tv >> >> Geschäftsführer: Martin Retschitzegger / Michaela Göllner >> Handeslregister: Amtsgericht Charlottenburg / HRB 112767 >> >> ___ >> Users mailing list >> Users@ovirt.org >> http://lists.ovirt.org/mailman/listinfo/users >> -- Daniel Helgenberger m box bewegtbild GmbH P: +49/30/2408781-22 F: +49/30/2408781-10 ACKERSTR. 19 D-10115 BERLIN www.m-box.de www.monkeymen.tv Geschäftsführer: Martin Retschitzegger / Michaela Göllner Handeslregister: Amtsgericht Charlottenburg / HRB 11276
Re: [ovirt-users] ovirt-engine-ha: 012TypeError: get_all_stats_for_service_type() got an unexpected keyword argument 'storage_dir'
Hi, yes it is possible. VDSM is probably still using the old version of the brokerlink library because of it. -- Martin Sivák msi...@redhat.com Red Hat Czech RHEV-M SLA / Brno, CZ - Original Message - > Hm, > > I upgraded vdsm and restarted it *before* iI upgraded engine HA; > 7042 vdsmSun Oct 19 16:24:24 2014 3-19:05:00 18:20:44 > /usr/bin/python /usr/share/vdsm/vdsm --pidfile /var/run/vdsm/vdsmd.pid > > Might this be the problem? > > On 23.10.2014 12:12, Martin Sivak wrote: > > Ah, > > > > what about vdsm? It queries the broker every now and then to get the > > information it reports to the webadmin. > > > > -- > > Martin Sivák > > msi...@redhat.com > > Red Hat Czech > > RHEV-M SLA / Brno, CZ > > > > - Original Message - > >> On 23.10.2014 11:09, Martin Sivak wrote: > >>> It seems that your running version of broker is not compatible with the > >>> agent. Did you restart both services after upgrade? > >> I did, please see below. > >>> Can you check when were the services started and compare it? > >>> > >>> ps -eo pid,comm,lstart,etime,time,args > >> 15474 ovirt-ha-agent Tue Oct 21 13:39:56 2014 1-21:49:28 00:09:38 > >> /usr/bin/python /usr/share/ovirt-hosted-engine-ha/ovirt-ha-agent > >> 15568 ovirt-ha-broker Tue Oct 21 13:40:06 2014 1-21:49:18 00:54:01 > >> /usr/bin/python /usr/share/ovirt-hosted-engine-ha/ovirt-ha-broker > >> > >>> -- > >>> Martin Sivák > >>> msi...@redhat.com > >>> Red Hat Czech > >>> RHEV-M SLA / Brno, CZ > >>> > >>> - Original Message - > Hello, > > might this be a bug? Logs are filling up with his on hosts the engine is > *not* running on. When I migrate the engine to this host, the error > stops and starts on the host migrated from. If so, I would open a bug. > > CentOS 2.6.32-431.29.2.el6.x86_64 #1 SMP Tue Sep 9 21:36:05 UTC 2014 > x86_64 x86_64 x86_64 GNU/Linux > ovirt-hosted-engine-ha-1.2.4-1.el6.noarch > > example > -- > Oct 22 00:44:15 nodehv02 ovirt-ha-broker > ovirt_hosted_engine_ha.broker.listener.ConnectionHandler ERROR Error > handling request, data: 'get-stats > storage_dir=/rhev/data-center/mnt/192.168.50.11:_volumes_tank_ovirt-vdsmd/bcfa7ec4-5278-44d8-9f31-682f2d9de91d/ha_agent > service_type=hosted-engine'#012Traceback (most recent call last):#012 > File > "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/broker/listener.py", > line 166, in handle#012data)#012 File > "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/broker/listener.py", > line 268, in _dispatch#012.get_all_stats_for_service_type(client, > **options)#012TypeError: get_all_stats_for_service_type() got an > unexpected keyword argument 'storage_dir' > Oct 22 00:44:15 nodehv02 vdsm vds ERROR failed to retrieve Hosted Engine > HA info#012Traceback (most recent call last):#012 File > "/usr/share/vdsm/API.py", line 1678, in _getHaInfo#012stats = > instance.get_all_stats()#012 File > "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", > line 86, in get_all_stats#012 > self._check_liveness_metadata(stats[host_id], broker)#012 File > "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", > line 171, in get_stats_from_storage#012try:#012 File > "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", > line 199, in _checked_communicate#012"""#012RequestError: Request > failed: > - > > -- > Daniel Helgenberger > m box bewegtbild GmbH > > P: +49/30/2408781-22 > F: +49/30/2408781-10 > > ACKERSTR. 19 > D-10115 BERLIN > > > www.m-box.de www.monkeymen.tv > > Geschäftsführer: Martin Retschitzegger / Michaela Göllner > Handeslregister: Amtsgericht Charlottenburg / HRB 112767 > > ___ > Users mailing list > Users@ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > > >> -- > >> Daniel Helgenberger > >> m box bewegtbild GmbH > >> > >> P: +49/30/2408781-22 > >> F: +49/30/2408781-10 > >> > >> ACKERSTR. 19 > >> D-10115 BERLIN > >> > >> > >> www.m-box.de www.monkeymen.tv > >> > >> Geschäftsführer: Martin Retschitzegger / Michaela Göllner > >> Handeslregister: Amtsgericht Charlottenburg / HRB 112767 > >> > >> > > -- > Daniel Helgenberger > m box bewegtbild GmbH > > P: +49/30/2408781-22 > F: +49/30/2408781-10 > > ACKERSTR. 19 > D-10115 BERLIN > > > www.m-box.de www.monkeymen.tv > > Geschäftsführer: Martin Retschitzegger / Michaela Göllner > Handeslregister: Amtsgericht Charlottenburg / HRB 112767 > > ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] ovirt-engine-ha: 012TypeError: get_all_stats_for_service_type() got an unexpected keyword argument 'storage_dir'
Hm, I upgraded vdsm and restarted it *before* iI upgraded engine HA; 7042 vdsmSun Oct 19 16:24:24 2014 3-19:05:00 18:20:44 /usr/bin/python /usr/share/vdsm/vdsm --pidfile /var/run/vdsm/vdsmd.pid Might this be the problem? On 23.10.2014 12:12, Martin Sivak wrote: > Ah, > > what about vdsm? It queries the broker every now and then to get the > information it reports to the webadmin. > > -- > Martin Sivák > msi...@redhat.com > Red Hat Czech > RHEV-M SLA / Brno, CZ > > - Original Message - >> On 23.10.2014 11:09, Martin Sivak wrote: >>> It seems that your running version of broker is not compatible with the >>> agent. Did you restart both services after upgrade? >> I did, please see below. >>> Can you check when were the services started and compare it? >>> >>> ps -eo pid,comm,lstart,etime,time,args >> 15474 ovirt-ha-agent Tue Oct 21 13:39:56 2014 1-21:49:28 00:09:38 >> /usr/bin/python /usr/share/ovirt-hosted-engine-ha/ovirt-ha-agent >> 15568 ovirt-ha-broker Tue Oct 21 13:40:06 2014 1-21:49:18 00:54:01 >> /usr/bin/python /usr/share/ovirt-hosted-engine-ha/ovirt-ha-broker >> >>> -- >>> Martin Sivák >>> msi...@redhat.com >>> Red Hat Czech >>> RHEV-M SLA / Brno, CZ >>> >>> - Original Message - Hello, might this be a bug? Logs are filling up with his on hosts the engine is *not* running on. When I migrate the engine to this host, the error stops and starts on the host migrated from. If so, I would open a bug. CentOS 2.6.32-431.29.2.el6.x86_64 #1 SMP Tue Sep 9 21:36:05 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux ovirt-hosted-engine-ha-1.2.4-1.el6.noarch example -- Oct 22 00:44:15 nodehv02 ovirt-ha-broker ovirt_hosted_engine_ha.broker.listener.ConnectionHandler ERROR Error handling request, data: 'get-stats storage_dir=/rhev/data-center/mnt/192.168.50.11:_volumes_tank_ovirt-vdsmd/bcfa7ec4-5278-44d8-9f31-682f2d9de91d/ha_agent service_type=hosted-engine'#012Traceback (most recent call last):#012 File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/broker/listener.py", line 166, in handle#012data)#012 File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/broker/listener.py", line 268, in _dispatch#012.get_all_stats_for_service_type(client, **options)#012TypeError: get_all_stats_for_service_type() got an unexpected keyword argument 'storage_dir' Oct 22 00:44:15 nodehv02 vdsm vds ERROR failed to retrieve Hosted Engine HA info#012Traceback (most recent call last):#012 File "/usr/share/vdsm/API.py", line 1678, in _getHaInfo#012stats = instance.get_all_stats()#012 File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 86, in get_all_stats#012 self._check_liveness_metadata(stats[host_id], broker)#012 File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 171, in get_stats_from_storage#012try:#012 File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 199, in _checked_communicate#012"""#012RequestError: Request failed: - -- Daniel Helgenberger m box bewegtbild GmbH P: +49/30/2408781-22 F: +49/30/2408781-10 ACKERSTR. 19 D-10115 BERLIN www.m-box.de www.monkeymen.tv Geschäftsführer: Martin Retschitzegger / Michaela Göllner Handeslregister: Amtsgericht Charlottenburg / HRB 112767 ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users >> -- >> Daniel Helgenberger >> m box bewegtbild GmbH >> >> P: +49/30/2408781-22 >> F: +49/30/2408781-10 >> >> ACKERSTR. 19 >> D-10115 BERLIN >> >> >> www.m-box.de www.monkeymen.tv >> >> Geschäftsführer: Martin Retschitzegger / Michaela Göllner >> Handeslregister: Amtsgericht Charlottenburg / HRB 112767 >> >> -- Daniel Helgenberger m box bewegtbild GmbH P: +49/30/2408781-22 F: +49/30/2408781-10 ACKERSTR. 19 D-10115 BERLIN www.m-box.de www.monkeymen.tv Geschäftsführer: Martin Retschitzegger / Michaela Göllner Handeslregister: Amtsgericht Charlottenburg / HRB 112767 ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] ovirt-engine-ha: 012TypeError: get_all_stats_for_service_type() got an unexpected keyword argument 'storage_dir'
Ah, what about vdsm? It queries the broker every now and then to get the information it reports to the webadmin. -- Martin Sivák msi...@redhat.com Red Hat Czech RHEV-M SLA / Brno, CZ - Original Message - > > On 23.10.2014 11:09, Martin Sivak wrote: > > It seems that your running version of broker is not compatible with the > > agent. Did you restart both services after upgrade? > I did, please see below. > > Can you check when were the services started and compare it? > > > > ps -eo pid,comm,lstart,etime,time,args > 15474 ovirt-ha-agent Tue Oct 21 13:39:56 2014 1-21:49:28 00:09:38 > /usr/bin/python /usr/share/ovirt-hosted-engine-ha/ovirt-ha-agent > 15568 ovirt-ha-broker Tue Oct 21 13:40:06 2014 1-21:49:18 00:54:01 > /usr/bin/python /usr/share/ovirt-hosted-engine-ha/ovirt-ha-broker > > > > > -- > > Martin Sivák > > msi...@redhat.com > > Red Hat Czech > > RHEV-M SLA / Brno, CZ > > > > - Original Message - > >> Hello, > >> > >> might this be a bug? Logs are filling up with his on hosts the engine is > >> *not* running on. When I migrate the engine to this host, the error > >> stops and starts on the host migrated from. If so, I would open a bug. > >> > >> CentOS 2.6.32-431.29.2.el6.x86_64 #1 SMP Tue Sep 9 21:36:05 UTC 2014 > >> x86_64 x86_64 x86_64 GNU/Linux > >> ovirt-hosted-engine-ha-1.2.4-1.el6.noarch > >> > >> example > >> -- > >> Oct 22 00:44:15 nodehv02 ovirt-ha-broker > >> ovirt_hosted_engine_ha.broker.listener.ConnectionHandler ERROR Error > >> handling request, data: 'get-stats > >> storage_dir=/rhev/data-center/mnt/192.168.50.11:_volumes_tank_ovirt-vdsmd/bcfa7ec4-5278-44d8-9f31-682f2d9de91d/ha_agent > >> service_type=hosted-engine'#012Traceback (most recent call last):#012 > >> File > >> "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/broker/listener.py", > >> line 166, in handle#012data)#012 File > >> "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/broker/listener.py", > >> line 268, in _dispatch#012.get_all_stats_for_service_type(client, > >> **options)#012TypeError: get_all_stats_for_service_type() got an > >> unexpected keyword argument 'storage_dir' > >> Oct 22 00:44:15 nodehv02 vdsm vds ERROR failed to retrieve Hosted Engine > >> HA info#012Traceback (most recent call last):#012 File > >> "/usr/share/vdsm/API.py", line 1678, in _getHaInfo#012stats = > >> instance.get_all_stats()#012 File > >> "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", > >> line 86, in get_all_stats#012 > >> self._check_liveness_metadata(stats[host_id], broker)#012 File > >> "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", > >> line 171, in get_stats_from_storage#012try:#012 File > >> "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", > >> line 199, in _checked_communicate#012"""#012RequestError: Request > >> failed: > >> - > >> > >> -- > >> Daniel Helgenberger > >> m box bewegtbild GmbH > >> > >> P: +49/30/2408781-22 > >> F: +49/30/2408781-10 > >> > >> ACKERSTR. 19 > >> D-10115 BERLIN > >> > >> > >> www.m-box.de www.monkeymen.tv > >> > >> Geschäftsführer: Martin Retschitzegger / Michaela Göllner > >> Handeslregister: Amtsgericht Charlottenburg / HRB 112767 > >> > >> ___ > >> Users mailing list > >> Users@ovirt.org > >> http://lists.ovirt.org/mailman/listinfo/users > >> > > -- > Daniel Helgenberger > m box bewegtbild GmbH > > P: +49/30/2408781-22 > F: +49/30/2408781-10 > > ACKERSTR. 19 > D-10115 BERLIN > > > www.m-box.de www.monkeymen.tv > > Geschäftsführer: Martin Retschitzegger / Michaela Göllner > Handeslregister: Amtsgericht Charlottenburg / HRB 112767 > > ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] ovirt-engine-ha: 012TypeError: get_all_stats_for_service_type() got an unexpected keyword argument 'storage_dir'
On 23.10.2014 11:09, Martin Sivak wrote: > It seems that your running version of broker is not compatible with the > agent. Did you restart both services after upgrade? I did, please see below. > Can you check when were the services started and compare it? > > ps -eo pid,comm,lstart,etime,time,args 15474 ovirt-ha-agent Tue Oct 21 13:39:56 2014 1-21:49:28 00:09:38 /usr/bin/python /usr/share/ovirt-hosted-engine-ha/ovirt-ha-agent 15568 ovirt-ha-broker Tue Oct 21 13:40:06 2014 1-21:49:18 00:54:01 /usr/bin/python /usr/share/ovirt-hosted-engine-ha/ovirt-ha-broker > > -- > Martin Sivák > msi...@redhat.com > Red Hat Czech > RHEV-M SLA / Brno, CZ > > - Original Message - >> Hello, >> >> might this be a bug? Logs are filling up with his on hosts the engine is >> *not* running on. When I migrate the engine to this host, the error >> stops and starts on the host migrated from. If so, I would open a bug. >> >> CentOS 2.6.32-431.29.2.el6.x86_64 #1 SMP Tue Sep 9 21:36:05 UTC 2014 >> x86_64 x86_64 x86_64 GNU/Linux >> ovirt-hosted-engine-ha-1.2.4-1.el6.noarch >> >> example >> -- >> Oct 22 00:44:15 nodehv02 ovirt-ha-broker >> ovirt_hosted_engine_ha.broker.listener.ConnectionHandler ERROR Error >> handling request, data: 'get-stats >> storage_dir=/rhev/data-center/mnt/192.168.50.11:_volumes_tank_ovirt-vdsmd/bcfa7ec4-5278-44d8-9f31-682f2d9de91d/ha_agent >> service_type=hosted-engine'#012Traceback (most recent call last):#012 >> File >> "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/broker/listener.py", >> line 166, in handle#012data)#012 File >> "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/broker/listener.py", >> line 268, in _dispatch#012.get_all_stats_for_service_type(client, >> **options)#012TypeError: get_all_stats_for_service_type() got an >> unexpected keyword argument 'storage_dir' >> Oct 22 00:44:15 nodehv02 vdsm vds ERROR failed to retrieve Hosted Engine >> HA info#012Traceback (most recent call last):#012 File >> "/usr/share/vdsm/API.py", line 1678, in _getHaInfo#012stats = >> instance.get_all_stats()#012 File >> "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", >> line 86, in get_all_stats#012 >> self._check_liveness_metadata(stats[host_id], broker)#012 File >> "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", >> line 171, in get_stats_from_storage#012try:#012 File >> "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", >> line 199, in _checked_communicate#012"""#012RequestError: Request >> failed: >> - >> >> -- >> Daniel Helgenberger >> m box bewegtbild GmbH >> >> P: +49/30/2408781-22 >> F: +49/30/2408781-10 >> >> ACKERSTR. 19 >> D-10115 BERLIN >> >> >> www.m-box.de www.monkeymen.tv >> >> Geschäftsführer: Martin Retschitzegger / Michaela Göllner >> Handeslregister: Amtsgericht Charlottenburg / HRB 112767 >> >> ___ >> Users mailing list >> Users@ovirt.org >> http://lists.ovirt.org/mailman/listinfo/users >> -- Daniel Helgenberger m box bewegtbild GmbH P: +49/30/2408781-22 F: +49/30/2408781-10 ACKERSTR. 19 D-10115 BERLIN www.m-box.de www.monkeymen.tv Geschäftsführer: Martin Retschitzegger / Michaela Göllner Handeslregister: Amtsgericht Charlottenburg / HRB 112767 ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] ovirt-engine-ha: 012TypeError: get_all_stats_for_service_type() got an unexpected keyword argument 'storage_dir'
It seems that your running version of broker is not compatible with the agent. Did you restart both services after upgrade? Can you check when were the services started and compare it? ps -eo pid,comm,lstart,etime,time,args -- Martin Sivák msi...@redhat.com Red Hat Czech RHEV-M SLA / Brno, CZ - Original Message - > Hello, > > might this be a bug? Logs are filling up with his on hosts the engine is > *not* running on. When I migrate the engine to this host, the error > stops and starts on the host migrated from. If so, I would open a bug. > > CentOS 2.6.32-431.29.2.el6.x86_64 #1 SMP Tue Sep 9 21:36:05 UTC 2014 > x86_64 x86_64 x86_64 GNU/Linux > ovirt-hosted-engine-ha-1.2.4-1.el6.noarch > > example > -- > Oct 22 00:44:15 nodehv02 ovirt-ha-broker > ovirt_hosted_engine_ha.broker.listener.ConnectionHandler ERROR Error > handling request, data: 'get-stats > storage_dir=/rhev/data-center/mnt/192.168.50.11:_volumes_tank_ovirt-vdsmd/bcfa7ec4-5278-44d8-9f31-682f2d9de91d/ha_agent > service_type=hosted-engine'#012Traceback (most recent call last):#012 > File > "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/broker/listener.py", > line 166, in handle#012data)#012 File > "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/broker/listener.py", > line 268, in _dispatch#012.get_all_stats_for_service_type(client, > **options)#012TypeError: get_all_stats_for_service_type() got an > unexpected keyword argument 'storage_dir' > Oct 22 00:44:15 nodehv02 vdsm vds ERROR failed to retrieve Hosted Engine > HA info#012Traceback (most recent call last):#012 File > "/usr/share/vdsm/API.py", line 1678, in _getHaInfo#012stats = > instance.get_all_stats()#012 File > "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", > line 86, in get_all_stats#012 > self._check_liveness_metadata(stats[host_id], broker)#012 File > "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", > line 171, in get_stats_from_storage#012try:#012 File > "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", > line 199, in _checked_communicate#012"""#012RequestError: Request > failed: > - > > -- > Daniel Helgenberger > m box bewegtbild GmbH > > P: +49/30/2408781-22 > F: +49/30/2408781-10 > > ACKERSTR. 19 > D-10115 BERLIN > > > www.m-box.de www.monkeymen.tv > > Geschäftsführer: Martin Retschitzegger / Michaela Göllner > Handeslregister: Amtsgericht Charlottenburg / HRB 112767 > > ___ > Users mailing list > Users@ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
[ovirt-users] ovirt-engine-ha: 012TypeError: get_all_stats_for_service_type() got an unexpected keyword argument 'storage_dir'
Hello, might this be a bug? Logs are filling up with his on hosts the engine is *not* running on. When I migrate the engine to this host, the error stops and starts on the host migrated from. If so, I would open a bug. CentOS 2.6.32-431.29.2.el6.x86_64 #1 SMP Tue Sep 9 21:36:05 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux ovirt-hosted-engine-ha-1.2.4-1.el6.noarch example -- Oct 22 00:44:15 nodehv02 ovirt-ha-broker ovirt_hosted_engine_ha.broker.listener.ConnectionHandler ERROR Error handling request, data: 'get-stats storage_dir=/rhev/data-center/mnt/192.168.50.11:_volumes_tank_ovirt-vdsmd/bcfa7ec4-5278-44d8-9f31-682f2d9de91d/ha_agent service_type=hosted-engine'#012Traceback (most recent call last):#012 File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/broker/listener.py", line 166, in handle#012data)#012 File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/broker/listener.py", line 268, in _dispatch#012.get_all_stats_for_service_type(client, **options)#012TypeError: get_all_stats_for_service_type() got an unexpected keyword argument 'storage_dir' Oct 22 00:44:15 nodehv02 vdsm vds ERROR failed to retrieve Hosted Engine HA info#012Traceback (most recent call last):#012 File "/usr/share/vdsm/API.py", line 1678, in _getHaInfo#012stats = instance.get_all_stats()#012 File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 86, in get_all_stats#012 self._check_liveness_metadata(stats[host_id], broker)#012 File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 171, in get_stats_from_storage#012try:#012 File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 199, in _checked_communicate#012"""#012RequestError: Request failed: - -- Daniel Helgenberger m box bewegtbild GmbH P: +49/30/2408781-22 F: +49/30/2408781-10 ACKERSTR. 19 D-10115 BERLIN www.m-box.de www.monkeymen.tv Geschäftsführer: Martin Retschitzegger / Michaela Göllner Handeslregister: Amtsgericht Charlottenburg / HRB 112767 ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
