Re: [Users] Host offline due to storage error
Hi Ian, I can't see any activity in the vdsm log around the time you cited from the engine log. Are you sure the vdsmd libvirtd deamons are running? Please run service vdsmd status service libvirtd status on the node. If they are indeed running, please check the BRIDGE settings on said node, they should be as follows: http://www.ovirt.org/Installing_VDSM_from_rpm#Configuring_the_bridge_Interface Please let me know the outcome of the above. Regards, Vered - Original Message - From: Vered Volansky ve...@redhat.com To: Ian Mordey ian.mor...@wandisco.com Cc: users users@ovirt.org Sent: Wednesday, December 11, 2013 2:19:02 PM Subject: Re: [Users] Host offline due to storage error Adding the list, my bad. - Original Message - From: Ian Mordey ian.mor...@wandisco.com To: Vered Volansky ve...@redhat.com Sent: Wednesday, December 11, 2013 2:11:46 PM Subject: Re: [Users] Host offline due to storage error I've attached the whole of /var/log/ovirt-engine and the vdsm.log from one of the nodes. This is a CentOS6 manager box and F19 nodes. Please let me know if you need more info. Thanks! Ian On Wed, Dec 11, 2013 at 12:00 PM, Vered Volansky ve...@redhat.com wrote: Hi Ian, Would you please send full logs? Also - Is there a point in time during this process when the Storage Domain is active? Regards, vered - Original Message - From: Ian Mordey ian.mor...@wandisco.com To: users@ovirt.org Sent: Tuesday, December 10, 2013 10:48:11 PM Subject: [Users] Host offline due to storage error Hi there I've got a 3 node oVirt 3.3.1 setup connecting to an Equallogic iSCSI SAN array. My nodes keep going offline with these errors: Host reports about one of the Active Storage Domains as Problematic. Host cannot access one of the Storage Domains attached to the Data Center DC Setting Host state to Non-Operational The host is then fenced, reboots and comes back up normally. I see some of these errors prior to the event: 2013-12-10 13:36:49,442 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.ListVDSCommand] (DefaultQuartzScheduler_Worker-14) Command ListVDS execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused 2013-12-10 13:36:49,448 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-14) Failed to refresh VDS , vds = 7f74b28a-149a-4f87-9689-b23db6d435f7 : hostname , VDS Network Error, continuing. 2013-12-10 13:36:52,490 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-59) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused Any ideas where to look? I can't see any errors on the switches or SAN.. Thanks Ian -- Listed on the London Stock Exchange: WANDhttp://www.bloomberg.com/quote/WAND:LN THIS MESSAGE AND ANY ATTACHMENTS ARE CONFIDENTIAL, PROPRIETARY, AND MAY BE PRIVILEGED. If this message was misdirected, WANdisco, Inc. and its subsidiaries, (WANdisco) does not waive any confidentiality or privilege. If you are not the intended recipient, please notify us immediately and destroy the message without disclosing its contents to anyone. Any distribution, use or copying of this e-mail or the information it contains by other than an intended recipient is unauthorized. The views and opinions expressed in this e-mail message are the author's own and may not reflect the views and opinions of WANdisco, unless the author is authorized by WANdisco to express such views or opinions on its behalf. All email sent to or from this address is subject to electronic storage and review by WANdisco. Although WANdisco operates anti-virus programs, it does not accept responsibility for any damage whatsoever caused by viruses being passed. ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users -- Listed on the London Stock Exchange: WANDhttp://www.bloomberg.com/quote/WAND:LN THIS MESSAGE AND ANY ATTACHMENTS ARE CONFIDENTIAL, PROPRIETARY, AND MAY BE PRIVILEGED. If this message was misdirected, WANdisco, Inc. and its subsidiaries, (WANdisco) does not waive any confidentiality or privilege. If you are not the intended recipient, please notify us immediately and destroy the message without disclosing its contents to anyone. Any distribution, use or copying of this e-mail or the information it contains by other than an intended recipient is unauthorized. The views and opinions expressed in this e-mail message are the author's own and may not reflect the views
[Users] Host offline due to storage error
Hi there I've got a 3 node oVirt 3.3.1 setup connecting to an Equallogic iSCSI SAN array. My nodes keep going offline with these errors: Host reports about one of the Active Storage Domains as Problematic. Host cannot access one of the Storage Domains attached to the Data Center DC Setting Host state to Non-Operational The host is then fenced, reboots and comes back up normally. I see some of these errors prior to the event: 2013-12-10 13:36:49,442 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.ListVDSCommand] (DefaultQuartzScheduler_Worker-14) Command ListVDS execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused 2013-12-10 13:36:49,448 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-14) Failed to refresh VDS , vds = 7f74b28a-149a-4f87-9689-b23db6d435f7 : hostname , VDS Network Error, continuing. 2013-12-10 13:36:52,490 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-59) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused Any ideas where to look? I can't see any errors on the switches or SAN.. Thanks Ian -- Listed on the London Stock Exchange: WANDhttp://www.bloomberg.com/quote/WAND:LN THIS MESSAGE AND ANY ATTACHMENTS ARE CONFIDENTIAL, PROPRIETARY, AND MAY BE PRIVILEGED. If this message was misdirected, WANdisco, Inc. and its subsidiaries, (WANdisco) does not waive any confidentiality or privilege. If you are not the intended recipient, please notify us immediately and destroy the message without disclosing its contents to anyone. Any distribution, use or copying of this e-mail or the information it contains by other than an intended recipient is unauthorized. The views and opinions expressed in this e-mail message are the author's own and may not reflect the views and opinions of WANdisco, unless the author is authorized by WANdisco to express such views or opinions on its behalf. All email sent to or from this address is subject to electronic storage and review by WANdisco. Although WANdisco operates anti-virus programs, it does not accept responsibility for any damage whatsoever caused by viruses being passed. ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [Users] Host offline due to storage error
Adding the list, my bad. - Original Message - From: Ian Mordey ian.mor...@wandisco.com To: Vered Volansky ve...@redhat.com Sent: Wednesday, December 11, 2013 2:11:46 PM Subject: Re: [Users] Host offline due to storage error I've attached the whole of /var/log/ovirt-engine and the vdsm.log from one of the nodes. This is a CentOS6 manager box and F19 nodes. Please let me know if you need more info. Thanks! Ian On Wed, Dec 11, 2013 at 12:00 PM, Vered Volansky ve...@redhat.com wrote: Hi Ian, Would you please send full logs? Also - Is there a point in time during this process when the Storage Domain is active? Regards, vered - Original Message - From: Ian Mordey ian.mor...@wandisco.com To: users@ovirt.org Sent: Tuesday, December 10, 2013 10:48:11 PM Subject: [Users] Host offline due to storage error Hi there I've got a 3 node oVirt 3.3.1 setup connecting to an Equallogic iSCSI SAN array. My nodes keep going offline with these errors: Host reports about one of the Active Storage Domains as Problematic. Host cannot access one of the Storage Domains attached to the Data Center DC Setting Host state to Non-Operational The host is then fenced, reboots and comes back up normally. I see some of these errors prior to the event: 2013-12-10 13:36:49,442 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.ListVDSCommand] (DefaultQuartzScheduler_Worker-14) Command ListVDS execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused 2013-12-10 13:36:49,448 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-14) Failed to refresh VDS , vds = 7f74b28a-149a-4f87-9689-b23db6d435f7 : hostname , VDS Network Error, continuing. 2013-12-10 13:36:52,490 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-59) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused Any ideas where to look? I can't see any errors on the switches or SAN.. Thanks Ian -- Listed on the London Stock Exchange: WANDhttp://www.bloomberg.com/quote/WAND:LN THIS MESSAGE AND ANY ATTACHMENTS ARE CONFIDENTIAL, PROPRIETARY, AND MAY BE PRIVILEGED. If this message was misdirected, WANdisco, Inc. and its subsidiaries, (WANdisco) does not waive any confidentiality or privilege. If you are not the intended recipient, please notify us immediately and destroy the message without disclosing its contents to anyone. Any distribution, use or copying of this e-mail or the information it contains by other than an intended recipient is unauthorized. The views and opinions expressed in this e-mail message are the author's own and may not reflect the views and opinions of WANdisco, unless the author is authorized by WANdisco to express such views or opinions on its behalf. All email sent to or from this address is subject to electronic storage and review by WANdisco. Although WANdisco operates anti-virus programs, it does not accept responsibility for any damage whatsoever caused by viruses being passed. ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users -- Listed on the London Stock Exchange: WANDhttp://www.bloomberg.com/quote/WAND:LN THIS MESSAGE AND ANY ATTACHMENTS ARE CONFIDENTIAL, PROPRIETARY, AND MAY BE PRIVILEGED. If this message was misdirected, WANdisco, Inc. and its subsidiaries, (WANdisco) does not waive any confidentiality or privilege. If you are not the intended recipient, please notify us immediately and destroy the message without disclosing its contents to anyone. Any distribution, use or copying of this e-mail or the information it contains by other than an intended recipient is unauthorized. The views and opinions expressed in this e-mail message are the author's own and may not reflect the views and opinions of WANdisco, unless the author is authorized by WANdisco to express such views or opinions on its behalf. All email sent to or from this address is subject to electronic storage and review by WANdisco. Although WANdisco operates anti-virus programs, it does not accept responsibility for any damage whatsoever caused by viruses being passed. ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users