[openstack-dev] [nova]Live-migration error in openstack kilo
Hi all, I have configured openstack kilo setup in debian jessie with one controller node and two compute nodes. I have used glusterfs for shared storage. I have mounted the shared storage in /var/lib/nova/instances on both nodes. I can do normal migration of vm’s between nodes.. But live-migration throws following error.. Pls do guide *Libvirt version: 2.3* *Qemu version: 1.2.9* Log of current node where the vm resides libvirt LOG 2017-03-04 11:36:50.484+: 171461: *error : virNetSocketReadWire:1568 : End of file while reading data: : Input/output error* 2017-03-04 11:36:50.484+: 171461:* error : virNetClientSendInternal:1950 : internal error: client socket is closed* nova LOG 2017-03-04 17:03:52.842 171181 ERROR nova.virt.libvirt.driver [req-35e04dac-fc4a-44e5-a8fb-d297e9dc2b49 03c4073dda924464a60b7fd88ad94e8e 2cae75f18d594a0ea93b6cbf1d23f435 - - -] [instance: 96213241-7c98-4ef1-88e8-bb461e573c82] *Live Migration failure: End of file while reading data: : Input/output error* 2017-03-04 17:03:52.871 171181 ERROR nova.virt.libvirt.driver [req-35e04dac-fc4a-44e5-a8fb-d297e9dc2b49 03c4073dda924464a60b7fd88ad94e8e 2cae75f18d594a0ea93b6cbf1d23f435 - - -] [instance: 96213241-7c98-4ef1-88e8-bb461e573c82] *Migration operation has aborted* Log of target node where the vm should be migrated syslog Mar 4 17:37:19 compute1 NetworkManager[1050]: (tap273847c9-20): new Tun device (driver: 'unknown' ifindex: 215) Mar 4 17:37:19 compute1 NetworkManager[1050]: (tap273847c9-20): exported as /org/freedesktop/NetworkManager/Devices/214 Mar 4 17:37:19 compute1 NetworkManager[1050]: devices added (path: /sys/devices/virtual/net/tap273847c9-20, iface: tap273847c9-20) Mar 4 17:37:19 compute1 NetworkManager[1050]: device added (path: /sys/devices/virtual/net/tap273847c9-20, iface: tap273847c9-20): no ifupdown configuration found. Mar 4 17:37:19 compute1 NetworkManager[1050]: (qbr273847c9-20): bridge port tap273847c9-20 was attached Mar 4 17:37:19 compute1 NetworkManager[1050]: (tap273847c9-20): enslaved to qbr273847c9-20 Mar 4 17:37:19 compute1 NetworkManager[1050]: (tap273847c9-20): link connected Mar 4 17:37:19 compute1 kernel: [694000.283071] device tap273847c9-20 entered promiscuous mode Mar 4 17:37:19 compute1 kernel: [694000.283773] qbr273847c9-20: port 2(tap273847c9-20) entered forwarding state Mar 4 17:37:19 compute1 kernel: [694000.283786] qbr273847c9-20: port 2(tap273847c9-20) entered forwarding state Mar 4 17:37:19 compute1 systemd[1]: libvirtd.service: main process exited, code=killed, status=11/SEGV Mar 4 17:37:19 compute1 systemd[1]: Unit libvirtd.service entered failed state. Mar 4 17:37:19 compute1 kernel: [694000.608098] libvirtd[149373]: segfault at 0 ip 7fccf1d36ed7 sp 7fccff02b830 error 4 in libvirt_driver_qemu.so[7fccf1cb9000+118000] Mar 4 17:37:19 compute1 avahi-daemon[1083]: Withdrawing workstation service for tap273847c9-20. Mar 4 17:37:19 compute1 kernel: [694000.619736] qbr273847c9-20: port 2(tap273847c9-20) entered disabled state Mar 4 17:37:19 compute1 kernel: [694000.619820] device tap273847c9-20 left promiscuous mode Mar 4 17:37:19 compute1 kernel: [694000.619830] qbr273847c9-20: port 2(tap273847c9-20) entered disabled state Mar 4 17:37:19 compute1 systemd[149484]: Stopping Default. Mar 4 17:37:19 compute1 systemd[149484]: Stopped target Default. Mar 4 17:37:19 compute1 systemd[149484]: Stopping Basic System. Mar 4 17:37:19 compute1 systemd[149484]: Stopped target Basic System. Mar 4 17:37:19 compute1 systemd[149484]: Stopping Paths. Mar 4 17:37:19 compute1 systemd[149484]: Stopped target Paths. Mar 4 17:37:19 compute1 systemd[149484]: Stopping Timers. Mar 4 17:37:19 compute1 systemd[149484]: Stopped target Timers. Mar 4 17:37:19 compute1 systemd[149484]: Stopping Sockets. Mar 4 17:37:19 compute1 systemd[149484]: Stopped target Sockets. Mar 4 17:37:19 compute1 systemd[149484]: Starting Shutdown. Mar 4 17:37:19 compute1 systemd[149484]: Reached target Shutdown. Mar 4 17:37:19 compute1 systemd[149484]: Starting Exit the Session... Mar 4 17:37:19 compute1 systemd[149484]: Received SIGRTMIN+24 from PID 149512 (kill). Mar 4 17:37:19 compute1 NetworkManager[1050]: devices removed (path: /sys/devices/virtual/net/tap273847c9-20, iface: tap273847c9-20) Mar 4 17:37:19 compute1 gnome-session[127136]: Gjs-Message: JS LOG: Removing a network device that was not added Qemu/instance.log char device redirected to /dev/pts/2 (label charserial1) *qemu-system-x86_64: load of migration failed: Invalid argument: shutting down* libvirt log 2017-03-04 11:33:52.546+: 143586: warning : qemuDomainObjTaint:1899 : Domain id=42 name='instance-0027' uuid=96213241-7c98-4ef1-88e8- bb461e573c82* is tainted: high-privileges* 2017-03-04 11:33:53.277+: 144256: info : libvirt version: 1.2.9, package: 9 (buildd 2015-02-06-16:39:25 binet) 2017-03-04 11:33:53.277+: 144256: error : qemuMonitorOpenUnix:309 :
[openstack-dev] [swift]Connection error with swift mitaka version
Hi all,
We have installed swift(mitaka version). its able to authenticate with
keystone.. but couldnt process the request in swift side.. swift(proxy
server) is not accepting the request/token..
I got the following error when i give openstack container list
Starting new HTTP connection (1): swifthost
Unable to establish connection to
http://swifthost:8080/v1/AUTH_080e4cf4b97846fe846fd3f679d7f5a3
Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/cliff/app.py", line 387, in
run_subcommand
result = cmd.run(parsed_args)
File
"/usr/local/lib/python2.7/dist-packages/openstackclient/common/command.py",
line 38, in run
return super(Command, self).run(parsed_args)
File "/usr/local/lib/python2.7/dist-packages/cliff/display.py", line 100,
in run
column_names, data = self.take_action(parsed_args)
File
"/usr/local/lib/python2.7/dist-packages/openstackclient/object/v1/container.py",
line 151, in take_action
**kwargs
File
"/usr/local/lib/python2.7/dist-packages/openstackclient/api/object_store_v1.py",
line 124, in container_list
return self.list('', **params)
File "/usr/local/lib/python2.7/dist-packages/openstackclient/api/api.py",
line 197, in list
params=params,
File "/usr/local/lib/python2.7/dist-packages/openstackclient/api/api.py",
line 83, in _request
return session.request(url, method, **kwargs)
File
"/usr/local/lib/python2.7/dist-packages/openstackclient/common/session.py",
line 40, in request
resp = super(TimingSession, self).request(url, method, **kwargs)
File "/usr/local/lib/python2.7/dist-packages/positional/__init__.py", line
101, in inner
return wrapped(*args, **kwargs)
File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/session.py",
line 555, in request
resp = send(**kwargs)
File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/session.py",
line 599, in _send_request
raise exceptions.ConnectFailure(msg)
ConnectFailure: Unable to establish connection to
http://swifthost:8080/v1/AUTH_080e4cf4b97846fe846fd3f679d7f5a3
clean_up ListContainer: Unable to establish connection to
http://swifthost:8080/v1/AUTH_080e4cf4b97846fe846fd3f679d7f5a3
Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/openstackclient/shell.py",
line 118, in run
ret_val = super(OpenStackShell, self).run(argv)
File "/usr/local/lib/python2.7/dist-packages/cliff/app.py", line 267, in run
result = self.run_subcommand(remainder)
File "/usr/local/lib/python2.7/dist-packages/openstackclient/shell.py",
line 153, in run_subcommand
ret_value = super(OpenStackShell, self).run_subcommand(argv)
File "/usr/local/lib/python2.7/dist-packages/cliff/app.py", line 387, in
run_subcommand
result = cmd.run(parsed_args)
File
"/usr/local/lib/python2.7/dist-packages/openstackclient/common/command.py",
line 38, in run
return super(Command, self).run(parsed_args)
File "/usr/local/lib/python2.7/dist-packages/cliff/display.py", line 100,
in run
column_names, data = self.take_action(parsed_args)
File
"/usr/local/lib/python2.7/dist-packages/openstackclient/object/v1/container.py",
line 151, in take_action
**kwargs
File
"/usr/local/lib/python2.7/dist-packages/openstackclient/api/object_store_v1.py",
line 124, in container_list
return self.list('', **params)
File "/usr/local/lib/python2.7/dist-packages/openstackclient/api/api.py",
line 197, in list
params=params,
File "/usr/local/lib/python2.7/dist-packages/openstackclient/api/api.py",
line 83, in _request
return session.request(url, method, **kwargs)
File
"/usr/local/lib/python2.7/dist-packages/openstackclient/common/session.py",
line 40, in request
resp = super(TimingSession, self).request(url, method, **kwargs)
File "/usr/local/lib/python2.7/dist-packages/positional/__init__.py", line
101, in inner
return wrapped(*args, **kwargs)
File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/session.py",
line 555, in request
resp = send(**kwargs)
File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/session.py",
line 599, in _send_request
raise exceptions.ConnectFailure(msg)
ConnectFailure: Unable to establish connection to
http://swifthost:8080/v1/AUTH_080e4cf4b97846fe846fd3f679d7f5a3
END return value: 1
Also my swift.log always throwing 404 error which follows
Jan 2 19:05:12 swifthost2 proxy-server: 10.208.252.2 10.208.252.2
02/Jan/2017/13/35/12 OPTIONS / HTTP/1.0 404 - - - - 70 -
tx333cbe62e4234c8aa7abc-00586a5710 - 0.0015 - - 1483364112.814496994
1483364112.816014051 -
Jan 2 19:05:12 swifthost2 proxy-server: 10.208.252.2 10.208.252.2
02/Jan/2017/13/35/12 OPTIONS / HTTP/1.0 404 - - - - 70 -
tx410e29ac554c4d6bbb7ea-00586a5710 - 0.0016 - - 1483364112.815314054
1483364112.816864967 -
Jan 2 19:05:14 swifthost2 object-auditor: Begin object audit "forever" mode
(ZBF)
Jan 2 19:05:14 swifthost2 object-auditor: Object audit (ZBF) "forever" mode
completed: 0.00s. Total quarantined: 0, Total errors: 0, Total files/sec:
0.00, Total bytes/sec: 0.00, Auditing time: 0.00, Rate: 0.00
Jan 2
