Re: [ovirt-users] Can't add logical network
Hi Maxence, It seems much more likely that the problem is on the hypervisor side. How did you configure the bond? With initscripts, with NetworkManager directly, or indirectly through Cockpit? What files are in /etc/sysconfig/network-scripts on the hypervisor? An sosreport would be useful here, or at least /var/log/vdsm/supervdsm.log Thanks, Ondra On 19.9.2016 11:53, Maxence Sartiaux wrote: Hello, On a clean install ovirt 4.0.3-1, i've configured my bond on my hypervisor, created a new network on the engine and now i try to assign the logical network to my bond in the host network settings. When i save the configuration, the engine throw me an error and the following event /VDSM hypervisor1 command failed: [Errno 2] No such file or directory: u'/etc/sysconfig/network-scripts/ifcfg-lan'/ if i "touch" the file manually i don't have this error but my file only contain "MTU=1500" nothing more. Engine bug or i miss something ? Thank you. ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] VM Networking not working
Chris, in /var/log/vdsm/vdsm.log on a host, you should find JSON data with (also) the host's networking information. Can you please share it? I would suggest to clone the VM and see if inter-VM communication is possible, through the bridge. Also, can you try to reach to external networks directly from your host beforehand? Can you verify that the tagged VLAN is routed properly even from the host? Or an even more basic test: does the VM network work with no VLAN tagging? Thanks, Ondra - Original Message - > From: "Christopher Lord"> To: users@ovirt.org > Sent: Friday, May 27, 2016 6:25:01 AM > Subject: [ovirt-users] VM Networking not working > > > > I asked this on the IRC channel but I thought I'd ask here too. > > > > > I have set up a 3 node hosted-engine ovirt cluster. On each host I have > bonded 2 10Gb ports that I use for Storage, and 2 10Gb ports that I intend > to use for VM traffic. However when I created my first VM and added a VLAN > tagged network to it, the VM can't access any external network. > > > > > I can see the bond, and the bridge on the host. If I give the bridge an IP on > the host it can access the network. > > > > > Also none of the network information is populated in the ovirt engine web ui > for the VM. All the Guest Agent Data is blank. > > > > > Am I missing something? Please let me know what logs will be helpful to > troubleshoot. > > > > > Thanks, > > > > > Chris > > ___ > Users mailing list > Users@ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] How to setup host network to link ovirtmgmt with eth0 automatically?
Kai, The symptoms after removal of vdsm-hook-ovs look just like the ovirtmgmt bridged network was not created. The log to look in would be supervdsm.log, but it looks like yours has been rotated after supervdsmd was restarted (the warning is benign). Can you dig out "supervdsm.log.1"? OVS started to be supported by the hook initially (this was the first attempt at supporting OVS). Currently, proper OVS support is in development and should appear in 4.0 as a tech-preview. Thanks, Ondra (osvob...@redhat.com) On 25.5.2016 11:01, Kai Kang wrote: On Tue, May 24, 2016 at 8:43 PM, Ondřej Svoboda <ond...@svobodasoft.cz <mailto:ond...@svobodasoft.cz>> wrote: Hi again, (correcting myself a bit) are using the Open vSwitch hook intentionally? If not, you can |yum remove vdsm-hook-ovs| for a while. What is your exact VDSM version? My VDSM version is 4.17.24 and ovirt-engine is 3.6.4. When after remove ovs hooks, it still fails with: "Host node3 does not comply with the cluster Default networks, the following networks are missing on host: 'ovirtmgmt'". I checked vdsm.log it seems no erros there. And in supervdsm.log, it shows warnings: sourceRoute::INFO::2016-05-25 07:57:41,779::sourceroutethread::60::root::(process_IN_CLOSE_WRITE_filePath) interface ovirtmgmt is not a libvirt interface sourceRoute::WARNING::2016-05-25 07:57:41,780::utils::140::root::(rmFile) File: /var/run/vdsm/trackedInterfaces/ovirtmgmt already removed What should I check next? Thanks. I uploaded vdsm.log to: https://gist.github.com/parr0tr1ver/1e38171b5d12cf77321101530276d368 and supervdsm.log: https://gist.github.com/parr0tr1ver/97805698a485f1cd49ded2b095297531 Also, can you give a little more context from your vdsm.log, and also from supervdsm.log? I think the vdsm.log failure is only related to stats reporting, and is not the root problem. If you don't have any confidential information in the logs (or you can remove it), I suggest that you open a bug on product=vdsm at https://bugzilla.redhat.com/ Have no fear about naming the bug, it can be renamed if necessary. I find there is a bug on https://bugzilla.redhat.com/show_bug.cgi?id=1234867. The "Target Milestone" to "support ovs via vdsm hook" is ovirt-3.6.7. Does that mean ovs does not work actually in previous versions? Thanks a lot. --Kai Thanks, Ondra On 24.5.2016 11:47, Kai Kang wrote: Hi, I checked vdsm.log, it show error: jsonrpc.Executor/0::DEBUG::2016-05-24 09:46:04,056::utils::671::root::(execCmd) /usr/bin/taskset --cpu-list 0-7 /usr/lib64/vdsm/vdsm/hooks/after_get_stats/50_ovs (cwd None) jsonrpc.Executor/0::DEBUG::2016-05-24 09:46:04,136::utils::689::root::(execCmd) FAILED: = 'Traceback (most recent call last):\n File "/usr/lib64/vdsm/vdsm/hooks/after_get_stats/50_ovs", line 72, in \nmain()\n File "/usr/lib64/vdsm/vdsm/hooks/after_get_stats/50_ovs", line 66, in main\n stats[\'network\'].update(ovs_networks_stats(stats[\'network\']))\nKeyError: \'network\'\n\n'; = 2 jsonrpc.Executor/0::INFO::2016-05-24 09:46:04,136::hooks::98::root::(_runHooksDir) Traceback (most recent call last): File "/usr/lib64/vdsm/vdsm/hooks/after_get_stats/50_ovs", line 72, in main() File "/usr/lib64/vdsm/vdsm/hooks/after_get_stats/50_ovs", line 66, in main stats['network'].update(ovs_networks_stats(stats['network'])) KeyError: 'network' I'm checking what wrong with it. Thanks, Kai On Tue, May 24, 2016 at 3:57 PM, Kai Kang <kai.7.k...@gmail.com <mailto:kai.7.k...@gmail.com>> wrote: And network configurations on node: [root at ovirt-node] # brctl show bridge name bridge id STP enabled interfaces docker0 8000.0242ae1de711 no ovirtmgmt 8000.001320ff73aa no eth0 [root at ovirt-node] # ifconfig -a docker0 Link encap:Ethernet HWaddr 02:42:ae:1d:e7:11 inet addr:172.17.0.1 Bcast:0.0.0.0 Mask:255.255.0.0 UP BROADCAST MULTICAST MTU:1500 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 B) TX bytes:0 (0.0 B) eth0 Link encap:Ethernet HWaddr 00:13:20:ff:73:aa UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:6331 errors:0 dropped:0 overruns:0 frame:0 TX packets:2866 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:762182 (744.3 KiB) TX bytes:210611 (205.6 KiB) Interrupt:20 Memory:d1
Re: [ovirt-users] How to setup host network to link ovirtmgmt with eth0 automatically?
Hi again, (correcting myself a bit) are using the Open vSwitch hook intentionally? If not, you can |yum remove vdsm-hook-ovs| for a while. What is your exact VDSM version? Also, can you give a little more context from your vdsm.log, and also from supervdsm.log? I think the vdsm.log failure is only related to stats reporting, and is not the root problem. If you don't have any confidential information in the logs (or you can remove it), I suggest that you open a bug on product=vdsm at https://bugzilla.redhat.com/ Have no fear about naming the bug, it can be renamed if necessary. Thanks, Ondra On 24.5.2016 11:47, Kai Kang wrote: Hi, I checked vdsm.log, it show error: jsonrpc.Executor/0::DEBUG::2016-05-24 09:46:04,056::utils::671::root::(execCmd) /usr/bin/taskset --cpu-list 0-7 /usr/lib64/vdsm/vdsm/hooks/after_get_stats/50_ovs (cwd None) jsonrpc.Executor/0::DEBUG::2016-05-24 09:46:04,136::utils::689::root::(execCmd) FAILED: = 'Traceback (most recent call last):\n File "/usr/lib64/vdsm/vdsm/hooks/after_get_stats/50_ovs", line 72, in \nmain()\n File "/usr/lib64/vdsm/vdsm/hooks/after_get_stats/50_ovs", line 66, in main\n stats[\'network\'].update(ovs_networks_stats(stats[\'network\']))\nKeyError: \'network\'\n\n'; = 2 jsonrpc.Executor/0::INFO::2016-05-24 09:46:04,136::hooks::98::root::(_runHooksDir) Traceback (most recent call last): File "/usr/lib64/vdsm/vdsm/hooks/after_get_stats/50_ovs", line 72, in main() File "/usr/lib64/vdsm/vdsm/hooks/after_get_stats/50_ovs", line 66, in main stats['network'].update(ovs_networks_stats(stats['network'])) KeyError: 'network' I'm checking what wrong with it. Thanks, Kai On Tue, May 24, 2016 at 3:57 PM, Kai Kang> wrote: And network configurations on node: [root at ovirt-node] # brctl show bridge name bridge id STP enabled interfaces docker0 8000.0242ae1de711 no ovirtmgmt 8000.001320ff73aa no eth0 [root at ovirt-node] # ifconfig -a docker0 Link encap:Ethernet HWaddr 02:42:ae:1d:e7:11 inet addr:172.17.0.1 Bcast:0.0.0.0 Mask:255.255.0.0 UP BROADCAST MULTICAST MTU:1500 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 B) TX bytes:0 (0.0 B) eth0 Link encap:Ethernet HWaddr 00:13:20:ff:73:aa UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:6331 errors:0 dropped:0 overruns:0 frame:0 TX packets:2866 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:762182 (744.3 KiB) TX bytes:210611 (205.6 KiB) Interrupt:20 Memory:d110-d112 loLink encap:Local Loopback inet addr:127.0.0.1 Mask:255.0.0.0 inet6 addr: ::1/128 Scope:Host UP LOOPBACK RUNNING MTU:65536 Metric:1 RX packets:36 errors:0 dropped:0 overruns:0 frame:0 TX packets:36 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:2478 (2.4 KiB) TX bytes:2478 (2.4 KiB) ovirtmgmt Link encap:Ethernet HWaddr 00:13:20:ff:73:aa inet addr:128.224.165.170 Bcast:128.224.165.255 Mask:255.255.255.0 inet6 addr: fe80::213:20ff:feff:73aa/64 Scope:Link inet6 addr: 11:2233:4455:6677:213:20ff:feff:73aa/64 Scope:Global UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:6295 errors:0 dropped:6 overruns:0 frame:0 TX packets:2831 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:644421 (629.3 KiB) TX bytes:177616 (173.4 KiB) sit0 Link encap:UNSPEC HWaddr 00-00-00-00-32-33-33-00-00-00-00-00-00-00-00-00 NOARP MTU:1480 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 B) TX bytes:0 (0.0 B) wlan0 Link encap:Ethernet HWaddr 80:86:f2:8b:1d:cf BROADCAST MULTICAST MTU:1500 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:0 (0.0 B) TX bytes:0 (0.0 B) Thanks, Kai On Tue, May 24, 2016 at 3:36 PM, Kai Kang wrote: Hi, When I install a host, it fails with: 2016-05-24 07:00:01,749 ERROR [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-4)
Re: [ovirt-users] How to setup host network to link ovirtmgmt with eth0 automatically?
Hi, are using the Open vSwitch hook intentionally? If not, you |yum remove vdsm-hook-ovs for a while. What is your exact VDSM version? | Thanks, Ondra On 24.5.2016 11:47, Kai Kang wrote: Hi, I checked vdsm.log, it show error: jsonrpc.Executor/0::DEBUG::2016-05-24 09:46:04,056::utils::671::root::(execCmd) /usr/bin/taskset --cpu-list 0-7 /usr/lib64/vdsm/vdsm/hooks/after_get_stats/50_ovs (cwd None) jsonrpc.Executor/0::DEBUG::2016-05-24 09:46:04,136::utils::689::root::(execCmd) FAILED: = 'Traceback (most recent call last):\n File "/usr/lib64/vdsm/vdsm/hooks/after_get_stats/50_ovs", line 72, in \nmain()\n File "/usr/lib64/vdsm/vdsm/hooks/after_get_stats/50_ovs", line 66, in main\n stats[\'network\'].update(ovs_networks_stats(stats[\'network\']))\nKeyError: \'network\'\n\n'; = 2 jsonrpc.Executor/0::INFO::2016-05-24 09:46:04,136::hooks::98::root::(_runHooksDir) Traceback (most recent call last): File "/usr/lib64/vdsm/vdsm/hooks/after_get_stats/50_ovs", line 72, in main() File "/usr/lib64/vdsm/vdsm/hooks/after_get_stats/50_ovs", line 66, in main stats['network'].update(ovs_networks_stats(stats['network'])) KeyError: 'network' I'm checking what wrong with it. Thanks, Kai On Tue, May 24, 2016 at 3:57 PM, Kai Kang> wrote: And network configurations on node: [root at ovirt-node] # brctl show bridge name bridge id STP enabled interfaces docker0 8000.0242ae1de711 no ovirtmgmt 8000.001320ff73aa noeth0 [root at ovirt-node] # ifconfig -a docker0 Link encap:Ethernet HWaddr 02:42:ae:1d:e7:11 inet addr:172.17.0.1 Bcast:0.0.0.0 Mask:255.255.0.0 UP BROADCAST MULTICAST MTU:1500 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 B) TX bytes:0 (0.0 B) eth0 Link encap:Ethernet HWaddr 00:13:20:ff:73:aa UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:6331 errors:0 dropped:0 overruns:0 frame:0 TX packets:2866 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:762182 (744.3 KiB) TX bytes:210611 (205.6 KiB) Interrupt:20 Memory:d110-d112 loLink encap:Local Loopback inet addr:127.0.0.1 Mask:255.0.0.0 inet6 addr: ::1/128 Scope:Host UP LOOPBACK RUNNING MTU:65536 Metric:1 RX packets:36 errors:0 dropped:0 overruns:0 frame:0 TX packets:36 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:2478 (2.4 KiB) TX bytes:2478 (2.4 KiB) ovirtmgmt Link encap:Ethernet HWaddr 00:13:20:ff:73:aa inet addr:128.224.165.170 Bcast:128.224.165.255 Mask:255.255.255.0 inet6 addr: fe80::213:20ff:feff:73aa/64 Scope:Link inet6 addr: 11:2233:4455:6677:213:20ff:feff:73aa/64 Scope:Global UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:6295 errors:0 dropped:6 overruns:0 frame:0 TX packets:2831 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:644421 (629.3 KiB) TX bytes:177616 (173.4 KiB) sit0 Link encap:UNSPEC HWaddr 00-00-00-00-32-33-33-00-00-00-00-00-00-00-00-00 NOARP MTU:1480 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 B) TX bytes:0 (0.0 B) wlan0 Link encap:Ethernet HWaddr 80:86:f2:8b:1d:cf BROADCAST MULTICAST MTU:1500 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:0 (0.0 B) TX bytes:0 (0.0 B) Thanks, Kai On Tue, May 24, 2016 at 3:36 PM, Kai Kang > wrote: Hi, When I install a host, it fails with: 2016-05-24 07:00:01,749 ERROR [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-4) [1bf36cd4] Host 'node3' is set to Non-Operational, it is missing the following networks: 'ovirtmgmt' 2016-05-24 07:00:01,781 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-4) [1bf36cd4] Correlation ID: 1bf36cd4, Job ID: db281e8f-67cc-441a-b44c-90b135e509bd, Call Stack: null, Custom Event ID: -1, Message: Host node3
Re: [ovirt-users] [ANN] oVirt 3.6.4 Second Release Candidate is now available for testing
Thank you very much, Sandro! centos-ovirt36 now works for me. On 24.3.2016 09:00, Sandro Bonazzola wrote: On Wed, Mar 23, 2016 at 4:22 PM, Ondřej Svoboda <ond...@svobodasoft.cz <mailto:ond...@svobodasoft.cz>> wrote: Hi Sandro, I just ran yum -y install http://plain.resources.ovirt.org/pub/yum-repo/ovirt-release36.rpm <http://www.google.com/url?q=http%3A%2F%2Fplain.resources.ovirt.org%2Fpub%2Fyum-repo%2Fovirt-release36.rpm=D=1=AFQjCNHQ3_R-I3QwEv9bTQHIIfj5FJpCQg> on my fresh EL7 (not CentOS) system. In /etc/yum.repos.d/ovirt-3.6-dependencies.repo, there was a broken centos-ovirt36 source: http://mirror.centos.org/centos/7Server/virt/x86_64/ovirt-3.6/repodata/repomd.xml: [Errno 14] HTTP Error 404 - Not Found Fixed pointing to http://mirror.centos.org/centos/7/virt/x86_64/ovirt-3.6/repodata/repomd.xml Released a new ovirt-release36 package including the fix. I had to disable this repo before I was even able to update my system. [centos-ovirt36] name=CentOS-$releasever - oVirt 3.6 baseurl=http://mirror.centos.org/centos/$releasever/virt/$basearch/ovirt-3.6/ gpgcheck=0 enabled=1 skip_if_unavailable = 1 keepcache = 0 Then I managed to install ovirt-engine all right, so I think the above repo should simply not be enabled in ovirt-release36.rpm <http://www.google.com/url?q=http%3A%2F%2Fplain.resources.ovirt.org%2Fpub%2Fyum-repo%2Fovirt-release36.rpm=D=1=AFQjCNHQ3_R-I3QwEv9bTQHIIfj5FJpCQg>. Thanks for your reply. Ondra On 22.3.2016 18:28, Sandro Bonazzola wrote: The oVirt Project is pleased to announce the availability of the Second Release Candidate of oVirt 3.6.4 for testing, as of March 22nd, 2016 This release is available now for: * Fedora 22 * Red Hat Enterprise Linux 6.7 * CentOS Linux 6.7 (or similar) * Red Hat Enterprise Linux 7.2 or later * CentOS Linux (or similar) 7.2 or later This release supports Hypervisor Hosts running: * Red Hat Enterprise Linux 7.2 or later * CentOS Linux (or similar) 7.2 or later * Fedora 22 This release is also available with experimental support for: * Debian 8.3 Jessie This release candidate includes the following updated packages: * ovirt-engine * ovirt-hosted-engine-ha See the release notes [1] for installation / upgrade instructions and a list of new features and bugs fixed. Notes: * A new oVirt Live ISO will be available soon [2]. * Mirrors[3] might need up to one day to synchronize. Additional Resources: * Read more about the oVirt 3.6.3 release highlights:http://www.ovirt.org/release/3.6.4/ * Get more oVirt Project updates on Twitter: https://twitter.com/ovirt * Check out the latest project news on the oVirt blog: http://www.ovirt.org/blog/ [1] http://www.ovirt.org/release/3.6.4/ [2] http://resources.ovirt.org/pub/ovirt-3.6-pre/iso/ [3] http://www.ovirt.org/Repository_mirrors#Current_mirrors -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com <http://redhat.com> ___ Users mailing list Users@ovirt.org <mailto:Users@ovirt.org> http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org <mailto:Users@ovirt.org> http://lists.ovirt.org/mailman/listinfo/users -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com <http://redhat.com> ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] SUCCESS / error
Hi, in general, programs use stderr (which you see after ) to output miscellaneous information. You can see here that "dd" is an example of this behaviour. While it exited successfully, it also wrote non-essential information to its secondary output. You do not see stdout (the primary channel) in the log because "dd" doesn't use it in this case. Cheers, Ondra On 2.3.2016 17:41, p...@email.cz wrote: Hi, next explanation VDSM log give me following message Is this live checking for storage availability ? If "SUCCESS" then why " " ??? regs. Pavel Thread-233::DEBUG::2016-03-02 17:31:55,275::fileSD::262::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.00022692 s, 1.5 MB/s\n'; = 0 Thread-299::DEBUG::2016-03-02 17:31:57,870::fileSD::262::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/glusterSD/localhost:_2KVM12__P4/300e9ac8-3c2f-4703-9bb1-1df2130c7c97/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-299::DEBUG::2016-03-02 17:31:57,886::fileSD::262::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n734 bytes (734 B) copied, 0.000391403 s, 1.9 MB/s\n'; = 0 Thread-209::DEBUG::2016-03-02 17:31:58,301::fileSD::262::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-BCK/0fcad888-d573-47be-bef3-0bc0b7a99fb7/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-209::DEBUG::2016-03-02 17:31:58,318::fileSD::262::Storage.Misc.excCmd::(getReadDelay) SUCCESS: = '0+1 records in\n0+1 records out\n335 bytes (335 B) copied, 0.00048095 s, 697 kB/s\n'; = 0 Thread-198::DEBUG::2016-03-02 17:31:58,885::fileSD::262::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/installshare:_DATA3/7f334c9d-ac01-4b2a-9f29-af1d2f24c3e0/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) dist = RHEL - 7 - 2.1511 kernel = 3.10.0 - 327.10.1.el7.x86_64 KVM = 2.3.0 - 29.1.el7 libvirt = libvirt-1.2.17-13.el7_2.3 vdsm = vdsm-4.16.30-0.el7 GlusterFS = glusterfs-3.7.8-1.el7 ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] Host loses all network configuration on update to oVirt 3.5.4
Hi everyone, it turns out that ifcfg files can be lost even in this very simple scenario: 1) Install/upgrade to VDSM 4.16.21/oVirt 3.5.4 2) Setup a network over eth0 vdsClient -s 0 setupNetworks 'networks={pokus:{nic:eth0,bootproto:dhcp,blockingdhcp:true,bridged:false}}' 3) Persist the configuration (declare it safe) vdsClient -s 0 setSafeNetworkConfig 4) Add a placeholder in /var/lib/vdsm/netconfback/ifcfg-eth0 with: # original file did not exist 5) Reboot I created a fix [1] and prepared it for backport to 3.6 [2] and 3.5 branches [3] (so as to appear in 3.5.5) and linked it to https://bugzilla.redhat.com/show_bug.cgi?id=1256252 Patrick, to apply the patch you can also run the two commands and paste it (the line after "nicFile.writelines(l)" is a single space, so please add it if it gets eaten by e-mail goblins): cd /usr/share/vdsm/ patch -p1 diff --git vdsm/network/configurators/ifcfg.py vdsm/network/configurators/ifcfg.py index 161a3b2..8332224 100644 --- vdsm/network/configurators/ifcfg.py +++ vdsm/network/configurators/ifcfg.py @@ -647,11 +647,21 @@ class ConfigWriter(object): def removeNic(self, nic): cf = netinfo.NET_CONF_PREF + nic self._backup(cf) -with open(cf) as nicFile: -hwlines = [line for line in nicFile if line.startswith('HWADDR=')] +try: +with open(cf) as nicFile: +hwlines = [line for line in nicFile if line.startswith( +'HWADDR=')] +except IOError as e: +logging.warning("%s couldn't be read (errno %s)", cf, e.errno) +try: +hwlines = ['HWADDR=%s\n' % netinfo.gethwaddr(nic)] +except IOError as e: +logging.exception("couldn't determine hardware address of %s " + "(errno %s)", nic, e.errno) +hwlines = [] l = [self.CONFFILE_HEADER + '\n', 'DEVICE=%s\n' % nic, 'ONBOOT=yes\n', 'MTU=%s\n' % netinfo.DEFAULT_MTU] + hwlines -l += 'NM_CONTROLLED=no\n' +l.append('NM_CONTROLLED=no\n') with open(cf, 'w') as nicFile: nicFile.writelines(l) Michael, will you please give it a try as well? Thanks, Ondra [1] https://gerrit.ovirt.org/#/c/45893/ [2] https://gerrit.ovirt.org/#/c/45932/ [3] https://gerrit.ovirt.org/#/c/45933/ - Original Message - > From: "Patrick Hurrelmann"> To: "Dan Kenigsberg" > Cc: "oVirt Mailing List" > Sent: Monday, September 7, 2015 2:46:05 PM > Subject: Re: [ovirt-users] Host loses all network configuration on update to > oVirt 3.5.4 > > On 07.09.2015 14:44, Patrick Hurrelmann wrote: > > On 07.09.2015 13:54, Dan Kenigsberg wrote: > >> On Mon, Sep 07, 2015 at 11:47:48AM +0200, Patrick Hurrelmann wrote: > >>> On 06.09.2015 11:30, Dan Kenigsberg wrote: > On Fri, Sep 04, 2015 at 10:26:39AM +0200, Patrick Hurrelmann wrote: > > Hi all, > > > > I just updated my existing oVirt 3.5.3 installation (iSCSI > > hosted-engine on > > CentOS 7.1). The engine update went fine. Updating the hosts succeeds > > until the > > first reboot. After a reboot the host does not come up again. It is > > missing all > > network configuration. All network cfgs in > > /etc/sysconfig/network-scripts are > > missing except ifcfg-lo. The host boots up without working networking. > > Using > > IPMI and config backups, I was able to restore the lost network > > configs. Once > > these are restored and the host is rebooted again all seems to be back > > to good. > > This has now happend to 2 updated hosts (this installation has a total > > of 4 > > hosts, so 2 more to debug/try). I'm happy to assist in furter > > debugging. > > > > Before updating the second host, I gathered some information. All these > > hosts > > have 3 physical nics. One is used for the ovirtmgmt bridge and the > > other 2 are > > used for iSCSI storage vlans. > > > > ifcfgs before update: > > > > /etc/sysconfig/network-scripts/ifcfg-em1 > > # Generated by VDSM version 4.16.20-0.el7.centos > > DEVICE=em1 > > HWADDR=d0:67:e5:f0:e5:c6 > > BRIDGE=ovirtmgmt > > ONBOOT=yes > > NM_CONTROLLED=no > /etc/sysconfig/network-scripts/ifcfg-lo > > DEVICE=lo > > IPADDR=127.0.0.1 > > NETMASK=255.0.0.0 > > NETWORK=127.0.0.0 > > # If you're having problems with gated making 127.0.0.0/8 a martian, > > # you can change this to something else (255.255.255.255, for example) > > BROADCAST=127.255.255.255 > > ONBOOT=yes > > NAME=loopback > > > > /etc/sysconfig/network-scripts/ifcfg-ovirtmgmt > > # Generated by VDSM version 4.16.20-0.el7.centos > > DEVICE=ovirtmgmt > > TYPE=Bridge > > DELAY=0 > > STP=off > > ONBOOT=yes > > IPADDR=1.2.3.16 > > NETMASK=255.255.255.0 >
Re: [ovirt-users] vdsm keeps removing BOOTPROTO=dhcp from ifcfg-ovirtmgmt
Ahoj Kubo, would you try running 'sudo vdsClient -s 0 setSafeNetworkConfig' right after restarting the network service? I think your configuration needs be persisted in VDSM's network persistence so it is restored (with the same configuration) on startup. Anyway, VDSM should be used to configure networks (directly using vdsClient or indirectly through oVirt engine or via other means -- RPC). Your network may be configured by running (assuming your NIC is eth0): vdsClient -s 0 setupNetworks 'networks={ovirtmgmt:{nic:eth0,bootproto:dhcp,blockingdhcp:true,bridged:true,stp:false,defaultRoute:false}}' If this doesn't help please attach /var/log/vdsm/supervdsm.log or file a bug with myself as the assignee :-) Thanks, Ondra On 11.8.2015 13:04, Jakub Niedermertl wrote: Hi all, I'd like my ovirtmgmt bridge to fetch ip address from dhcp, but vdsm keeps removing 'BOOTPROTO=dhcp' from /etc/sysconfig/network-scripts/ifcfg-ovirtmgmt. I set the file as follows: DEVICE=ovirtmgmt TYPE=Bridge DELAY=0 STP=off ONBOOT=yes BOOTPROTO=dhcp MTU=1500 DEFROUTE=no NM_CONTROLLED=no IPV6INIT=no call 'sudo systemctl restart network' and ip address is successfully assigned. Then reboot the machine and ip address is not fetched and ifcfg-ovirtmgmt looks like this # Generated by VDSM version 4.17.0-1240.git487a19e.fc22 DEVICE=ovirtmgmt TYPE=Bridge DELAY=0 STP=off ONBOOT=yes MTU=1500 DEFROUTE=no NM_CONTROLLED=no IPV6INIT=no HOTPLUG=no Is there any way how to prevent vdsm from removing BOOTPROTO statement or make ovirtmgmt to work with dhcp? Environment: Host: runs in virt-manager vm, Fedora 22 vdsm: 4.17.0-1240.git487a19e.fc22 from http://resources.ovirt.org/pub/ovirt-3.6-pre/rpm/fc$releasever/ Thanks. Jakub ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] copy-paste in a console without X server
Nathanaël, if you are looking for a host-side copypaste functinality in console, the gpm daemon might help. But I assume you would like to have a shared clipboard between the host and the client. For that you will probably need X (and a guest agent). Regards, Ondra On 18.2.2015 09:22, Nathanaël Blanchet wrote: Hi all, Is there a way for copy and paste in a spice console which runs a minimal OS (e.g. without loaded qlx driver)? It can be very useful when no ssh access is possible when network is down. ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] Network config
Jorick, just what comes to my mind: do you have NetworkManager running, by any chance? VDSM and NetworkManager don't mix well currently so please try # systemctl stop NetworkManager # systemctl disable NetworkManager Regards, Ondra Svoboda On 27.1.2015 14:10, Jorick Astrego wrote: On 01/27/2015 01:56 PM, Koen Vanoppen wrote: Hello everybody, Just wanted to know if anybody else has the problem, that when you restart your network configuration of a hypervisor, all the settings concerning the bonding are gone... Do I file a bug report for this or is this already a known issue? Kind regards, Koen Hmm, I cannot restart the network service from the host for some reason: Jan 27 14:00:27 test2 systemd: network.service: control process exited, code=exited status=1 Jan 27 14:00:27 test2 systemd: Failed to start LSB: Bring up/down networking. systemctl status network.service network.service - LSB: Bring up/down networking Loaded: loaded (/etc/rc.d/init.d/network) Active: failed (Result: exit-code) since Tue 2015-01-27 14:00:27 CET; 1min 56s ago Process: 4113 ExecStart=/etc/rc.d/init.d/network start (code=exited, status=1/FAILURE) Jan 27 14:00:27 test2.netbulae.test network[4113]: RTNETLINK answers: File exists Jan 27 14:00:27 test2.netbulae.test network[4113]: RTNETLINK answers: File exists Jan 27 14:00:27 test2.netbulae.test network[4113]: RTNETLINK answers: File exists Jan 27 14:00:27 test2.netbulae.test network[4113]: RTNETLINK answers: File exists Jan 27 14:00:27 test2.netbulae.test network[4113]: RTNETLINK answers: File exists Jan 27 14:00:27 test2.netbulae.test network[4113]: RTNETLINK answers: File exists Jan 27 14:00:27 test2.netbulae.test network[4113]: RTNETLINK answers: File exists Jan 27 14:00:27 test2.netbulae.test systemd[1]: network.service: control process exited, code=exited status=1 Jan 27 14:00:27 test2.netbulae.test systemd[1]: Failed to start LSB: Bring up/down networking. Jan 27 14:00:27 test2.netbulae.test systemd[1]: Unit network.service entered failed state. -- Subject: Unit network.service has failed -- Defined-By: systemd -- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel -- -- Unit network.service has failed. -- -- The result is failed. Jan 27 14:00:27 test2.netbulae.test systemd[1]: Unit network.service entered failed state. In supervdsm I find lots and lots of these: sourceRoute::DEBUG::2015-01-27 14:02:40,802::utils::739::root::(execCmd) /sbin/ip -4 route add 0.0.0.0/0 via **.***.**.** dev bond0 table 174351414 (cwd None) sourceRoute::DEBUG::2015-01-27 14:02:40,806::utils::759::root::(execCmd) FAILED: err = 'RTNETLINK answers: File exists\n'; rc = 2 sourceRoute::ERROR::2015-01-27 14:02:40,806::sourceroute::88::root::(configure) ip binary failed during source route configuration: ['RTNETLINK answers: File exists'] sourceRoute::WARNING::2015-01-27 14:02:40,807::utils::129::root::(rmFile) File: /var/run/vdsm/trackedInterfaces/bond0 already removed sourceRoute::DEBUG::2015-01-27 14:07:09,047::sourceroutethread::39::root::(process_IN_CLOSE_WRITE_filePath) Responding to DHCP response in /var/run/vdsm/sourceRoutes/1422364029 sourceRoute::INFO::2015-01-27 14:07:09,052::sourceroute::78::root::(configure) Configuring gateway - ip: **.***.**.***, network: **.***.**.**0/24, subnet: 255.255.255.0, gateway: **.***.**.**, table: 174351414, device: bond0 sourceRoute::DEBUG::2015-01-27 14:07:09,052::utils::739::root::(execCmd) /sbin/ip -4 route add 0.0.0.0/0 via **.***.**.** dev bond0 table 174351414 (cwd None) sourceRoute::DEBUG::2015-01-27 14:07:09,057::utils::759::root::(execCmd) FAILED: err = 'RTNETLINK answers: File exists\n'; rc = 2 sourceRoute::ERROR::2015-01-27 14:07:09,057::sourceroute::88::root::(configure) ip binary failed during source route configuration: ['RTNETLINK answers: File exists'] sourceRoute::WARNING::2015-01-27 14:07:09,057::utils::129::root::(rmFile) File: /var/run/vdsm/trackedInterfaces/bond0 already removed The hosts are all Centos 7 freshly provisioned. With these vdsm packages: vdsm-python-zombiereaper-4.16.10-8.gitc937927.el7.noarch vdsm-python-4.16.10-8.gitc937927.el7.noarch vdsm-yajsonrpc-4.16.10-8.gitc937927.el7.noarch vdsm-4.16.10-8.gitc937927.el7.x86_64 vdsm-xmlrpc-4.16.10-8.gitc937927.el7.noarch vdsm-jsonrpc-4.16.10-8.gitc937927.el7.noarch vdsm-cli-4.16.10-8.gitc937927.el7.noarch Met vriendelijke groet, With kind regards, Jorick Astrego* Netbulae Virtualization Experts * Tel: 053 20 30 270 i...@netbulae.euStaalsteden 4-3AKvK 08198180 Fax: 053 20 30 271 www.netbulae.eu 7547 TA
Re: [ovirt-users] Network config
From the first log (journal): VDSM managed to start, only it is being run too early (it should be waiting patiently for its supervdsm component to start responding). Are there no RTNETLINK answers: File exists errors anymore? Second log: This is normal operation. So the host stopped responding? It should have come up, assuming that it obtained the same address from DHCP (which it should, but please check). Could you try using static network configuration first? And when it succeeds you can try DHCP again. === About the GUI: Is your host's status now Not Operational? In that case oVirt cannot tell anything about the status of the host's interfaces, it may only reflect the status before communication was lost. Please file a bug if this is really the case I described :-) It would then be a matter of discussion if oVirt should display a yellow unknown status of the interfaces, or keep displaying the last known one. (The first solution would make it obvious that we really lost the host and go looking for the host's status to discover it is Not Operational. The other is informative as well, just in a different way.) On 27.1.2015 16:31, Jorick Astrego wrote: Done, maybe this helps: Jan 27 16:20:26 test2 vdsmd_init_common.sh: vdsm: Running unified_network_persistence_upgrade Jan 27 16:20:26 test2 vdsmd_init_common.sh: vdsm: Running restore_nets Jan 27 16:21:47 test2 systemd-logind: New session 5 of user root. Jan 27 16:21:47 test2 systemd: Starting Session 5 of user root. Jan 27 16:21:47 test2 systemd: Started Session 5 of user root. Jan 27 16:21:55 test2 systemd: vdsmd.service operation timed out. Terminating. Jan 27 16:21:55 test2 journal: End of file while reading data: Input/output error Jan 27 16:21:55 test2 systemd: Failed to start Virtual Desktop Server Manager. Jan 27 16:21:55 test2 systemd: Unit vdsmd.service entered failed state. Jan 27 16:21:55 test2 systemd: vdsmd.service holdoff time over, scheduling restart. Jan 27 16:21:55 test2 systemd: Stopping Virtual Desktop Server Manager... Jan 27 16:21:55 test2 systemd: Starting Virtual Desktop Server Manager... Jan 27 16:21:55 test2 vdsmd_init_common.sh: vdsm: Running mkdirs Still: MainThread::INFO::2015-01-27 16:21:56,964::netconfpersistence::158::root::(_clearDisk) Clearing /var/run/vdsm/netconf/nets/ and /var/run/vdsm/netconf/bonds/ MainThread::DEBUG::2015-01-27 16:21:56,964::netconfpersistence::166::root::(_clearDisk) No existent config to clear. MainThread::INFO::2015-01-27 16:21:56,964::netconfpersistence::182::root::(save) Saved new config RunningConfig({}, {}) to /var/run/vdsm/netconf/nets/ and /var/run/vdsm/netconf/bonds/ MainThread::DEBUG::2015-01-27 16:21:56,965::netconfpersistence::134::root::(_getConfigs) Non-existing config set. And when I want to reapply setup networks in ovirt I get: Error while executing action Commit Network changes: Network error during communication with the Host. Every interface and bond is still green and visible in the webgui by the way. That is also strange, every interface of the host is bonded and up while in reality the host has lost it's network config and doesn't respond anymore. Shouldn't they all be red on communication failure to the host? Cheers, Jorick On 01/27/2015 04:01 PM, Ondřej Svoboda wrote: This is weird, like there were multiple dhclients on the bond. Can you stop VDSM (systemctl stop vdsmd supervdsmd) and maybe `killall -SIGKILL dhclient` and restart VDSM afterwards? On 27.1.2015 14:43, Jorick Astrego wrote: Ah yes, I forgot to disable it as I switched to foreman provisioning. Maybe it can be auto detected and disabled in the install host scripts when ovirt installs vdsm and sets up the networking. For people who forget to disable it. But now I get this: sourceRoute::DEBUG::2015-01-27 14:33:57,416::utils::739::root::(execCmd) /sbin/ip -4 route add 0.0.0.0/0 via ***.***.***.*** dev bond0 table 174351414 (cwd None) sourceRoute::DEBUG::2015-01-27 14:33:57,420::utils::759::root::(execCmd) FAILED: err = 'RTNETLINK answers: File exists\n'; rc = 2 sourceRoute::ERROR::2015-01-27 14:33:57,420::sourceroute::88::root::(configure) ip binary failed during source route configuration: ['RTNETLINK answers: File exists'] sourceRoute::WARNING::2015-01-27 14:33:57,420::utils::129::root::(rmFile) File: /var/run/vdsm/trackedInterfaces/bond0 already removed Jan 27 14:38:19 test3.netbulae.test network[3042]: RTNETLINK answers: File exists Jan 27 14:38:19 test3.netbulae.test systemd[1]: network.service: control process exited, code=exited status=1 Jan 27 14:38:19 test3.netbulae.test systemd[1]: Failed to start LSB: Bring up/down networking. -- Subject: Unit network.service has failed -- Defined-By: systemd -- Support: http
Re: [ovirt-users] Network config
I can see in the log that VDSM tried to obtain information about bond1 and (bridge) Internet, both of which did not exist (yet?) in a procedure which reports the information back to oVirt. But this just means that no information about them was reported, it shows no real error. There was no network configuration to be stored (persisted), this is why the directories /var/run/vdsm/netconf/nets and /var/run/vdsm/netconf/bonds/ are not there. If you use a static address/gateway, does the creation of the bond and the network succeed in Setup host networks? If it does not I suggest that you attach the whole logs. On 27.1.2015 15:59, Jorick Astrego wrote: On 01/27/2015 01:56 PM, Koen Vanoppen wrote: Hello everybody, Just wanted to know if anybody else has the problem, that when you restart your network configuration of a hypervisor, all the settings concerning the bonding are gone... Do I file a bug report for this or is this already a known issue? Kind regards, Koen After a host restart the bonds are indead gone, except for bond and I get this output: MainThread::DEBUG::2015-01-27 15:44:18,343::api::623::root::(setupNetworks) Validating configuration MainThread::DEBUG::2015-01-27 15:44:18,355::api::635::setupNetworks::(setupNetworks) Applying... MainThread::DEBUG::2015-01-27 15:44:18,355::netconfpersistence::134::root::(_getConfigs) Non-existing config set. MainThread::DEBUG::2015-01-27 15:44:18,356::netconfpersistence::134::root::(_getConfigs) Non-existing config set. MainThread::DEBUG::2015-01-27 15:44:18,356::utils::739::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) MainThread::DEBUG::2015-01-27 15:44:18,358::utils::759::root::(execCmd) SUCCESS: err = ''; rc = 0 MainThread::INFO::2015-01-27 15:44:18,366::netinfo::555::root::(_getNetInfo) Obtaining info for net bond1. Traceback (most recent call last): File /usr/lib/python2.7/site-packages/vdsm/netinfo.py, line 552, in _getNetInfo 'mtu': str(getMtu(iface))}) File /usr/lib/python2.7/site-packages/vdsm/netinfo.py, line 182, in getMtu mtu = open('/sys/class/net/%s/mtu' % iface).readline().rstrip() IOError: [Errno 2] No such file or directory: u'/sys/class/net/bond1/mtu' MainThread::INFO::2015-01-27 15:44:18,366::netinfo::555::root::(_getNetInfo) Obtaining info for net Internet. Traceback (most recent call last): File /usr/lib/python2.7/site-packages/vdsm/netinfo.py, line 536, in _getNetInfo data.update({'ports': ports(iface), 'stp': bridge_stp_state(iface), File /usr/lib/python2.7/site-packages/vdsm/netinfo.py, line 178, in ports return os.listdir('/sys/class/net/' + bridge + '/brif') OSError: [Errno 2] No such file or directory: '/sys/class/net/Internet/brif' MainThread::DEBUG::2015-01-27 15:44:18,373::utils::739::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) MainThread::DEBUG::2015-01-27 15:44:18,375::utils::759::root::(execCmd) SUCCESS: err = ''; rc = 0 MainThread::INFO::2015-01-27 15:44:18,384::netconfpersistence::158::root::(_clearDisk) Clearing /var/run/vdsm/netconf/nets/ and /var/run/vdsm/netconf/bonds/ MainThread::DEBUG::2015-01-27 15:44:18,384::netconfpersistence::166::root::(_clearDisk) No existent config to clear. MainThread::INFO::2015-01-27 15:44:18,384::netconfpersistence::182::root::(save) Saved new config RunningConfig({}, {}) to /var/run/vdsm/netconf/nets/ and /var/run/vdsm/netconf/bonds/ MainThread::DEBUG::2015-01-27 15:44:18,386::netconfpersistence::134::root::(_getConfigs) Non-existing config set. MainThread::DEBUG::2015-01-27 15:44:18,386::netconfpersistence::134::root::(_getConfigs) Non-existing config set. MainThread::DEBUG::2015-01-27 15:44:18,470::utils::739::root::(execCmd) /usr/sbin/ifdown Internet (cwd None) MainThread::DEBUG::2015-01-27 15:45:46,165::netconfpersistence::134::root::(_getConfigs) Non-existing config set. MainThread::DEBUG::2015-01-27 15:45:46,165::netconfpersistence::134::root::(_getConfigs) Non-existing config set. This is what I get later after I try Setup host networks again: MainThread::INFO::2015-01-27 15:53:16,739::netconfpersistence::182::root::(save) Saved new config RunningConfig({}, {}) to /var/run/vdsm/netconf/nets/ and /var/run/vdsm/netconf/bonds/ MainThread::DEBUG::2015-01-27 15:53:16,740::netconfpersistence::134::root::(_getConfigs) Non-existing config set. MainThread::DEBUG::2015-01-27 15:53:16,740::netconfpersistence::134::root::(_getConfigs) Non-existing config set. MainThread::DEBUG::2015-01-27 15:53:16,743::utils::739::root::(execCmd) /usr/sbin/ifdown Internet (cwd None) MainThread::DEBUG::2015-01-27
Re: [ovirt-users] Network config
This is weird, like there were multiple dhclients on the bond. Can you stop VDSM (systemctl stop vdsmd supervdsmd) and maybe `killall -SIGKILL dhclient` and restart VDSM afterwards? On 27.1.2015 14:43, Jorick Astrego wrote: Ah yes, I forgot to disable it as I switched to foreman provisioning. Maybe it can be auto detected and disabled in the install host scripts when ovirt installs vdsm and sets up the networking. For people who forget to disable it. But now I get this: sourceRoute::DEBUG::2015-01-27 14:33:57,416::utils::739::root::(execCmd) /sbin/ip -4 route add 0.0.0.0/0 via ***.***.***.*** dev bond0 table 174351414 (cwd None) sourceRoute::DEBUG::2015-01-27 14:33:57,420::utils::759::root::(execCmd) FAILED: err = 'RTNETLINK answers: File exists\n'; rc = 2 sourceRoute::ERROR::2015-01-27 14:33:57,420::sourceroute::88::root::(configure) ip binary failed during source route configuration: ['RTNETLINK answers: File exists'] sourceRoute::WARNING::2015-01-27 14:33:57,420::utils::129::root::(rmFile) File: /var/run/vdsm/trackedInterfaces/bond0 already removed Jan 27 14:38:19 test3.netbulae.test network[3042]: RTNETLINK answers: File exists Jan 27 14:38:19 test3.netbulae.test systemd[1]: network.service: control process exited, code=exited status=1 Jan 27 14:38:19 test3.netbulae.test systemd[1]: Failed to start LSB: Bring up/down networking. -- Subject: Unit network.service has failed -- Defined-By: systemd -- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel -- -- Unit network.service has failed. -- -- The result is failed. Jan 27 14:38:19 test3.netbulae.test systemd[1]: Unit network.service entered failed state. Bond0 is still there though sourceRoute::DEBUG::2015-01-27 14:33:57,410::sourceroutethread::39::root::(process_IN_CLOSE_WRITE_filePath) Responding to DHCP response in /var/run/vdsm/sourceRoutes/1422365637 sourceRoute::INFO::2015-01-27 14:33:57,416::sourceroute::78::root::(configure) Configuring gateway - ip: **.***.**.**, network: 10.100.100.0/24, subnet: 255.255.255.0, gateway: **.***.**.**, table: 174351414, device: bond0 sourceRoute::DEBUG::2015-01-27 14:33:57,416::utils::739::root::(execCmd) /sbin/ip -4 route add 0.0.0.0/0 via **.***.**.** dev bond0 table 174351414 (cwd None) sourceRoute::DEBUG::2015-01-27 14:33:57,420::utils::759::root::(execCmd) FAILED: err = 'RTNETLINK answers: File exists\n'; rc = 2 sourceRoute::ERROR::2015-01-27 14:33:57,420::sourceroute::88::root::(configure) ip binary failed during source route configuration: ['RTNETLINK answers: File exists'] sourceRoute::WARNING::2015-01-27 14:33:57,420::utils::129::root::(rmFile) File: /var/run/vdsm/trackedInterfaces/bond0 already removed sourceRoute::DEBUG::2015-01-27 14:37:52,085::sourceroutethread::39::root::(process_IN_CLOSE_WRITE_filePath) Responding to DHCP response in /var/run/vdsm/sourceRoutes/1422365872 sourceRoute::INFO::2015-01-27 14:37:52,090::sourceroute::78::root::(configure) Configuring gateway - ip: **.***.**.**, network: 10.100.100.0/24, subnet: 255.255.255.0, gateway: **.***.**.**, table: 174351414, device: bond0 sourceRoute::DEBUG::2015-01-27 14:37:52,090::utils::739::root::(execCmd) /sbin/ip -4 route add 0.0.0.0/0 via **.***.**.** dev bond0 table 174351414 (cwd None) sourceRoute::DEBUG::2015-01-27 14:37:52,094::utils::759::root::(execCmd) FAILED: err = 'RTNETLINK answers: File exists\n'; rc = 2 sourceRoute::ERROR::2015-01-27 14:37:52,094::sourceroute::88::root::(configure) ip binary failed during source route configuration: ['RTNETLINK answers: File exists'] sourceRoute::WARNING::2015-01-27 14:37:52,094::utils::129::root::(rmFile) File: /var/run/vdsm/trackedInterfaces/bond0 already removed If you need more info, let me know. On 01/27/2015 02:20 PM, Ondřej Svoboda wrote: Jorick, just what comes to my mind: do you have NetworkManager running, by any chance? VDSM and NetworkManager don't mix well currently so please try # systemctl stop NetworkManager # systemctl disable NetworkManager Regards, Ondra Svoboda On 27.1.2015 14:10, Jorick Astrego wrote: On 01/27/2015 01:56 PM, Koen Vanoppen wrote: Hello everybody, Just wanted to know if anybody else has the problem, that when you restart your network configuration of a hypervisor, all the settings concerning the bonding are gone... Do I file a bug report for this or is this already a known issue? Kind regards, Koen Hmm, I cannot restart the network service from the host for some reason: Jan 27 14:00:27 test2 systemd: network.service: control process exited, code=exited status=1 Jan 27 14:00:27 test2 systemd: Failed to start LSB: Bring up/down networking. systemctl status network.service network.service - LSB: Bring up/down
Re: [ovirt-users] Network config
On 27.1.2015 19:10, Ondřej Svoboda wrote: From the first log (journal): VDSM managed to start, only it is being run too early (it should be waiting patiently for its supervdsm component to start responding). Are there no RTNETLINK answers: File exists errors anymore? Second log: This is normal operation. So the host stopped responding? It should have come up, assuming that it obtained the same address from DHCP (which it should, but please check). Could you try using static network configuration first? And when it succeeds you can try DHCP again. === About the GUI: Is your host's status now Not Operational? In that case oVirt cannot tell anything about the status of the host's interfaces, it may only reflect the status before communication was lost. Please file a bug if this is really the case I described :-) It would then be a matter of discussion if oVirt should display a yellow unknown status of the interfaces, or keep displaying the last known one. (The first solution would make it obvious that we really lost the host and go looking for the host's status to discover it is Not Operational. The other is informative as well, just in a different way.) I should add that the yellow, unknown state is just a suggestion, it need not exist yet. On 27.1.2015 16:31, Jorick Astrego wrote: Done, maybe this helps: Jan 27 16:20:26 test2 vdsmd_init_common.sh: vdsm: Running unified_network_persistence_upgrade Jan 27 16:20:26 test2 vdsmd_init_common.sh: vdsm: Running restore_nets Jan 27 16:21:47 test2 systemd-logind: New session 5 of user root. Jan 27 16:21:47 test2 systemd: Starting Session 5 of user root. Jan 27 16:21:47 test2 systemd: Started Session 5 of user root. Jan 27 16:21:55 test2 systemd: vdsmd.service operation timed out. Terminating. Jan 27 16:21:55 test2 journal: End of file while reading data: Input/output error Jan 27 16:21:55 test2 systemd: Failed to start Virtual Desktop Server Manager. Jan 27 16:21:55 test2 systemd: Unit vdsmd.service entered failed state. Jan 27 16:21:55 test2 systemd: vdsmd.service holdoff time over, scheduling restart. Jan 27 16:21:55 test2 systemd: Stopping Virtual Desktop Server Manager... Jan 27 16:21:55 test2 systemd: Starting Virtual Desktop Server Manager... Jan 27 16:21:55 test2 vdsmd_init_common.sh: vdsm: Running mkdirs Still: MainThread::INFO::2015-01-27 16:21:56,964::netconfpersistence::158::root::(_clearDisk) Clearing /var/run/vdsm/netconf/nets/ and /var/run/vdsm/netconf/bonds/ MainThread::DEBUG::2015-01-27 16:21:56,964::netconfpersistence::166::root::(_clearDisk) No existent config to clear. MainThread::INFO::2015-01-27 16:21:56,964::netconfpersistence::182::root::(save) Saved new config RunningConfig({}, {}) to /var/run/vdsm/netconf/nets/ and /var/run/vdsm/netconf/bonds/ MainThread::DEBUG::2015-01-27 16:21:56,965::netconfpersistence::134::root::(_getConfigs) Non-existing config set. And when I want to reapply setup networks in ovirt I get: Error while executing action Commit Network changes: Network error during communication with the Host. Every interface and bond is still green and visible in the webgui by the way. That is also strange, every interface of the host is bonded and up while in reality the host has lost it's network config and doesn't respond anymore. Shouldn't they all be red on communication failure to the host? Cheers, Jorick On 01/27/2015 04:01 PM, Ondřej Svoboda wrote: This is weird, like there were multiple dhclients on the bond. Can you stop VDSM (systemctl stop vdsmd supervdsmd) and maybe `killall -SIGKILL dhclient` and restart VDSM afterwards? On 27.1.2015 14:43, Jorick Astrego wrote: Ah yes, I forgot to disable it as I switched to foreman provisioning. Maybe it can be auto detected and disabled in the install host scripts when ovirt installs vdsm and sets up the networking. For people who forget to disable it. But now I get this: sourceRoute::DEBUG::2015-01-27 14:33:57,416::utils::739::root::(execCmd) /sbin/ip -4 route add 0.0.0.0/0 via ***.***.***.*** dev bond0 table 174351414 (cwd None) sourceRoute::DEBUG::2015-01-27 14:33:57,420::utils::759::root::(execCmd) FAILED: err = 'RTNETLINK answers: File exists\n'; rc = 2 sourceRoute::ERROR::2015-01-27 14:33:57,420::sourceroute::88::root::(configure) ip binary failed during source route configuration: ['RTNETLINK answers: File exists'] sourceRoute::WARNING::2015-01-27 14:33:57,420::utils::129::root::(rmFile) File: /var/run/vdsm/trackedInterfaces/bond0 already removed Jan 27 14:38:19 test3.netbulae.test network[3042]: RTNETLINK answers: File exists Jan 27 14:38:19 test3.netbulae.test systemd[1]: network.service: control process exited, code=exited status=1 Jan 27 14:38:19 test3.netbulae.test systemd[1]: Failed to start
Re: [ovirt-users] Network config
Hello Koen, please share parts of your /var/log/vdsm/vdsm.log and /var/log/vdsm/supervdsm.log and maybe also `journalctl` output that do not pose any security risk to you. Regards, Ondra On 27.1.2015 13:56, Koen Vanoppen wrote: Hello everybody, Just wanted to know if anybody else has the problem, that when you restart your network configuration of a hypervisor, all the settings concerning the bonding are gone... Do I file a bug report for this or is this already a known issue? Kind regards, Koen ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
[ovirt-users] IPv6 configuration through custom network properties and vdsm-hook-ipv6
Hi all, let us invite you to try out the latest addition to VDSM hooks: simple IPv6 configuration with oVirt's custom network properties :-) In oVirt GUI you can now control 4 properties understood by VDSM's new IPv6 hook: ipv6addr, ipv6gateway (IPv6 addresses) ipv6autoconf, dhcpv6 (booleans; use '1' or 'true' to enable them) You will need oVirt 3.5 and VDSM = 4.16.7 and vdsm-hook-ipv6. Define the new properties in oVirt engine as follows (do not omit ;ethtool_opts=.* if you are using it): PROPERTIES='ipv6addr=.*;ipv6gateway=.*;ipv6autoconf=.*;dhcpv6=.*' engine-config -s UserDefinedNetworkCustomProperties=$PROPERTIES --cver='3.5' You can install the hook from oVirt's nightly build (also for el7, fc20...): http://resources.ovirt.org/pub/ovirt-master-snapshot/rpm/el6/noarch/ After you restart the ovirt-engine service you are welcome to test configuring the new custom properties in Edit Network dialog. Please note that there is little functionality available (e.g. no migration) apart from the basic configuration but we are working to make IPv6 in oVirt a reality. Recently, we tested manual IPv6 fencing, which was one of our goals on http://www.ovirt.org/Features/IPv6_support. We will update the feature page next week. We are interested in your feedback. Stay tuned! Cheers, Ondra Svoboda PS: If you are building VDSM from Git, your packages (namely the vdsm package required by the hook) are versioned as 4.16.0-nnn-gitid, which does not satisfy the 4.16.7 requirement. Please run 'git tag v4.16.7-fake' in your Git repository so the next time you 'make rpm' you get compatible packages. ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users