subject:"\[Yahoo\-eng\-team\] \[Bug 1706772\] Re\: InternalServerError\: Internal Server Error \(HTTP 500\) in n\-cpu logs on startup with Ironic driver"

[Yahoo-eng-team] [Bug 1706772] Re: InternalServerError: Internal Server Error (HTTP 500) in n-cpu logs on startup with Ironic driver

2017-08-28 Thread Dmitry Tantsur

** Changed in: ironic
   Status: Confirmed => Invalid

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1706772

Title:
  InternalServerError: Internal Server Error (HTTP 500) in n-cpu logs on
  startup with Ironic driver

Status in Ironic:
  Invalid
Status in OpenStack Compute (nova):
  Fix Released
Status in OpenStack Compute (nova) ocata series:
  Fix Committed

Bug description:
  The init_host stacktraces on startup, killing the thread:

  http://logs.openstack.org/49/484949/14/check/gate-tempest-dsvm-ironic-
  ipa-wholedisk-bios-agent_ipmitool-tinyipa-ubuntu-xenial-
  nv/69b18d7/logs/screen-n-cpu.txt.gz?level=TRACE

  Jul 24 22:26:26.423871 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service [None 
req-414af81a-44e7-4a67-9cbd-74e549deb41b None None] Error starting thread.: 
InternalServerError: Internal Server Error (HTTP 500)
  Jul 24 22:26:26.423993 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service Traceback (most recent call 
last):
  Jul 24 22:26:26.424084 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service   File 
"/usr/local/lib/python2.7/dist-packages/oslo_service/service.py", line 721, in 
run_service
  Jul 24 22:26:26.424167 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service service.start()
  Jul 24 22:26:26.424250 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service   File 
"/opt/stack/new/nova/nova/service.py", line 143, in start
  Jul 24 22:26:26.424330 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service self.manager.init_host()
  Jul 24 22:26:26.424417 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service   File 
"/opt/stack/new/nova/nova/compute/manager.py", line 1100, in init_host
  Jul 24 22:26:26.424498 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service 
self.driver.init_host(host=self.host)
  Jul 24 22:26:26.424638 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service   File 
"/opt/stack/new/nova/nova/virt/ironic/driver.py", line 449, in init_host
  Jul 24 22:26:26.424717 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service self._refresh_cache()
  Jul 24 22:26:26.424798 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service   File 
"/opt/stack/new/nova/nova/virt/ironic/driver.py", line 608, in _refresh_cache
  Jul 24 22:26:26.425096 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service for node in 
self._get_node_list(detail=True, limit=0):
  Jul 24 22:26:26.425187 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service   File 
"/opt/stack/new/nova/nova/virt/ironic/driver.py", line 527, in _get_node_list
  Jul 24 22:26:26.425278 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service node_list = 
self.ironicclient.call("node.list", **kwargs)
  Jul 24 22:26:26.425359 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service   File 
"/opt/stack/new/nova/nova/virt/ironic/client_wrapper.py", line 146, in call
  Jul 24 22:26:26.425440 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service return 
self._multi_getattr(client, method)(*args, **kwargs)
  Jul 24 22:26:26.425536 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service   File 
"/usr/local/lib/python2.7/dist-packages/ironicclient/v1/node.py", line 143, in 
list
  Jul 24 22:26:26.425614 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service limit=limit)
  Jul 24 22:26:26.425708 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service   File 
"/usr/local/lib/python2.7/dist-packages/ironicclient/common/base.py", line 149, 
in _list_pagination
  Jul 24 22:26:26.425788 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service resp, body = 
self.api.json_request('GET', url)
  Jul 24 22:26:26.425866 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service   File 
"/usr/local/lib/python2.7/dist-packages/ironicclient/common/http.py", line 558, 
in json_request
  Jul 24 22:26:26.425945 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service resp = 
self._http_request(url, method, **kwargs)
  Jul 24 22:26:26.426027 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service   File 
"/usr/local/lib/python2.7/dist-packages/ironicclient/common/http.py", line 188, 
in wrapper
  Jul 24 22:26:26.426114

[Yahoo-eng-team] [Bug 1706772] Re: InternalServerError: Internal Server Error (HTTP 500) in n-cpu logs on startup with Ironic driver

2017-08-08 Thread OpenStack Infra

Reviewed:  https://review.openstack.org/487925
Committed: 
https://git.openstack.org/cgit/openstack/nova/commit/?id=c2d33c3271370358d48553233b41bf9119d834fb
Submitter: Jenkins
Branch:master

commit c2d33c3271370358d48553233b41bf9119d834fb
Author: EdLeafe 
Date:   Wed Jul 26 23:07:38 2017 +

Handle ironicclient failures in Ironic driver

The ironic driver uses ironicclient to get the list of nodes from the
Ironic service. If that service is not running, or something otherwise
prevents the ironicclient's call from succeeding, and unhandled
exception will occur. This patch adds a generic exception handler for
this call, logging an error and continuing.

Co-Authored-By: Lucas Alvares Gomes 

Closes-Bug: #1706772

Change-Id: I4ebebcf221dfe29e2aa125f5956aec10108f8fbe


** Changed in: nova
   Status: In Progress => Fix Released

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1706772

Title:
  InternalServerError: Internal Server Error (HTTP 500) in n-cpu logs on
  startup with Ironic driver

Status in Ironic:
  Confirmed
Status in OpenStack Compute (nova):
  Fix Released
Status in OpenStack Compute (nova) ocata series:
  In Progress

Bug description:
  The init_host stacktraces on startup, killing the thread:

  http://logs.openstack.org/49/484949/14/check/gate-tempest-dsvm-ironic-
  ipa-wholedisk-bios-agent_ipmitool-tinyipa-ubuntu-xenial-
  nv/69b18d7/logs/screen-n-cpu.txt.gz?level=TRACE

  Jul 24 22:26:26.423871 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service [None 
req-414af81a-44e7-4a67-9cbd-74e549deb41b None None] Error starting thread.: 
InternalServerError: Internal Server Error (HTTP 500)
  Jul 24 22:26:26.423993 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service Traceback (most recent call 
last):
  Jul 24 22:26:26.424084 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service   File 
"/usr/local/lib/python2.7/dist-packages/oslo_service/service.py", line 721, in 
run_service
  Jul 24 22:26:26.424167 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service service.start()
  Jul 24 22:26:26.424250 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service   File 
"/opt/stack/new/nova/nova/service.py", line 143, in start
  Jul 24 22:26:26.424330 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service self.manager.init_host()
  Jul 24 22:26:26.424417 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service   File 
"/opt/stack/new/nova/nova/compute/manager.py", line 1100, in init_host
  Jul 24 22:26:26.424498 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service 
self.driver.init_host(host=self.host)
  Jul 24 22:26:26.424638 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service   File 
"/opt/stack/new/nova/nova/virt/ironic/driver.py", line 449, in init_host
  Jul 24 22:26:26.424717 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service self._refresh_cache()
  Jul 24 22:26:26.424798 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service   File 
"/opt/stack/new/nova/nova/virt/ironic/driver.py", line 608, in _refresh_cache
  Jul 24 22:26:26.425096 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service for node in 
self._get_node_list(detail=True, limit=0):
  Jul 24 22:26:26.425187 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service   File 
"/opt/stack/new/nova/nova/virt/ironic/driver.py", line 527, in _get_node_list
  Jul 24 22:26:26.425278 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service node_list = 
self.ironicclient.call("node.list", **kwargs)
  Jul 24 22:26:26.425359 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service   File 
"/opt/stack/new/nova/nova/virt/ironic/client_wrapper.py", line 146, in call
  Jul 24 22:26:26.425440 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service return 
self._multi_getattr(client, method)(*args, **kwargs)
  Jul 24 22:26:26.425536 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service   File 
"/usr/local/lib/python2.7/dist-packages/ironicclient/v1/node.py", line 143, in 
list
  Jul 24 22:26:26.425614 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service limit=limit)
  Jul 24 22:26:26.425708 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service   File

[Yahoo-eng-team] [Bug 1706772] Re: InternalServerError: Internal Server Error (HTTP 500) in n-cpu logs on startup with Ironic driver

2017-08-08 Thread Matt Riedemann

** Also affects: nova/ocata
   Importance: Undecided
   Status: New

** Changed in: nova/ocata
   Status: New => Confirmed

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1706772

Title:
  InternalServerError: Internal Server Error (HTTP 500) in n-cpu logs on
  startup with Ironic driver

Status in Ironic:
  Confirmed
Status in OpenStack Compute (nova):
  In Progress
Status in OpenStack Compute (nova) ocata series:
  Confirmed

Bug description:
  The init_host stacktraces on startup, killing the thread:

  http://logs.openstack.org/49/484949/14/check/gate-tempest-dsvm-ironic-
  ipa-wholedisk-bios-agent_ipmitool-tinyipa-ubuntu-xenial-
  nv/69b18d7/logs/screen-n-cpu.txt.gz?level=TRACE

  Jul 24 22:26:26.423871 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service [None 
req-414af81a-44e7-4a67-9cbd-74e549deb41b None None] Error starting thread.: 
InternalServerError: Internal Server Error (HTTP 500)
  Jul 24 22:26:26.423993 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service Traceback (most recent call 
last):
  Jul 24 22:26:26.424084 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service   File 
"/usr/local/lib/python2.7/dist-packages/oslo_service/service.py", line 721, in 
run_service
  Jul 24 22:26:26.424167 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service service.start()
  Jul 24 22:26:26.424250 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service   File 
"/opt/stack/new/nova/nova/service.py", line 143, in start
  Jul 24 22:26:26.424330 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service self.manager.init_host()
  Jul 24 22:26:26.424417 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service   File 
"/opt/stack/new/nova/nova/compute/manager.py", line 1100, in init_host
  Jul 24 22:26:26.424498 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service 
self.driver.init_host(host=self.host)
  Jul 24 22:26:26.424638 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service   File 
"/opt/stack/new/nova/nova/virt/ironic/driver.py", line 449, in init_host
  Jul 24 22:26:26.424717 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service self._refresh_cache()
  Jul 24 22:26:26.424798 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service   File 
"/opt/stack/new/nova/nova/virt/ironic/driver.py", line 608, in _refresh_cache
  Jul 24 22:26:26.425096 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service for node in 
self._get_node_list(detail=True, limit=0):
  Jul 24 22:26:26.425187 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service   File 
"/opt/stack/new/nova/nova/virt/ironic/driver.py", line 527, in _get_node_list
  Jul 24 22:26:26.425278 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service node_list = 
self.ironicclient.call("node.list", **kwargs)
  Jul 24 22:26:26.425359 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service   File 
"/opt/stack/new/nova/nova/virt/ironic/client_wrapper.py", line 146, in call
  Jul 24 22:26:26.425440 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service return 
self._multi_getattr(client, method)(*args, **kwargs)
  Jul 24 22:26:26.425536 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service   File 
"/usr/local/lib/python2.7/dist-packages/ironicclient/v1/node.py", line 143, in 
list
  Jul 24 22:26:26.425614 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service limit=limit)
  Jul 24 22:26:26.425708 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service   File 
"/usr/local/lib/python2.7/dist-packages/ironicclient/common/base.py", line 149, 
in _list_pagination
  Jul 24 22:26:26.425788 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service resp, body = 
self.api.json_request('GET', url)
  Jul 24 22:26:26.425866 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service   File 
"/usr/local/lib/python2.7/dist-packages/ironicclient/common/http.py", line 558, 
in json_request
  Jul 24 22:26:26.425945 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service resp = 
self._http_request(url, method, **kwargs)
  Jul 24 22:26:26.426027 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service   File

[Yahoo-eng-team] [Bug 1706772] Re: InternalServerError: Internal Server Error (HTTP 500) in n-cpu logs on startup with Ironic driver

2017-07-27 Thread OpenStack Infra

Fix proposed to branch: master
Review: https://review.openstack.org/487925

** Changed in: nova
   Status: Invalid => In Progress

** Changed in: nova
 Assignee: (unassigned) => Ed Leafe (ed-leafe)

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1706772

Title:
  InternalServerError: Internal Server Error (HTTP 500) in n-cpu logs on
  startup with Ironic driver

Status in Ironic:
  Confirmed
Status in OpenStack Compute (nova):
  In Progress

Bug description:
  The init_host stacktraces on startup, killing the thread:

  http://logs.openstack.org/49/484949/14/check/gate-tempest-dsvm-ironic-
  ipa-wholedisk-bios-agent_ipmitool-tinyipa-ubuntu-xenial-
  nv/69b18d7/logs/screen-n-cpu.txt.gz?level=TRACE

  Jul 24 22:26:26.423871 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service [None 
req-414af81a-44e7-4a67-9cbd-74e549deb41b None None] Error starting thread.: 
InternalServerError: Internal Server Error (HTTP 500)
  Jul 24 22:26:26.423993 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service Traceback (most recent call 
last):
  Jul 24 22:26:26.424084 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service   File 
"/usr/local/lib/python2.7/dist-packages/oslo_service/service.py", line 721, in 
run_service
  Jul 24 22:26:26.424167 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service service.start()
  Jul 24 22:26:26.424250 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service   File 
"/opt/stack/new/nova/nova/service.py", line 143, in start
  Jul 24 22:26:26.424330 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service self.manager.init_host()
  Jul 24 22:26:26.424417 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service   File 
"/opt/stack/new/nova/nova/compute/manager.py", line 1100, in init_host
  Jul 24 22:26:26.424498 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service 
self.driver.init_host(host=self.host)
  Jul 24 22:26:26.424638 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service   File 
"/opt/stack/new/nova/nova/virt/ironic/driver.py", line 449, in init_host
  Jul 24 22:26:26.424717 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service self._refresh_cache()
  Jul 24 22:26:26.424798 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service   File 
"/opt/stack/new/nova/nova/virt/ironic/driver.py", line 608, in _refresh_cache
  Jul 24 22:26:26.425096 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service for node in 
self._get_node_list(detail=True, limit=0):
  Jul 24 22:26:26.425187 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service   File 
"/opt/stack/new/nova/nova/virt/ironic/driver.py", line 527, in _get_node_list
  Jul 24 22:26:26.425278 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service node_list = 
self.ironicclient.call("node.list", **kwargs)
  Jul 24 22:26:26.425359 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service   File 
"/opt/stack/new/nova/nova/virt/ironic/client_wrapper.py", line 146, in call
  Jul 24 22:26:26.425440 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service return 
self._multi_getattr(client, method)(*args, **kwargs)
  Jul 24 22:26:26.425536 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service   File 
"/usr/local/lib/python2.7/dist-packages/ironicclient/v1/node.py", line 143, in 
list
  Jul 24 22:26:26.425614 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service limit=limit)
  Jul 24 22:26:26.425708 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service   File 
"/usr/local/lib/python2.7/dist-packages/ironicclient/common/base.py", line 149, 
in _list_pagination
  Jul 24 22:26:26.425788 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service resp, body = 
self.api.json_request('GET', url)
  Jul 24 22:26:26.425866 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service   File 
"/usr/local/lib/python2.7/dist-packages/ironicclient/common/http.py", line 558, 
in json_request
  Jul 24 22:26:26.425945 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service resp = 
self._http_request(url, method, **kwargs)
  Jul 24 22:26:26.426027 ubuntu-xenial-osic-cloud1-disk-10052658 
nova-compute[13755]: ERROR oslo_service.service   File

[Yahoo-eng-team] [Bug 1706772] Re: InternalServerError: Internal Server Error (HTTP 500) in n-cpu logs on startup with Ironic driver

2017-07-26 Thread Matt Riedemann

Looks like the failure is in ironic-api on startup:

http://logs.openstack.org/80/461480/5/check/gate-tempest-dsvm-ironic-
ipa-wholedisk-bios-agent_ipmitool-tinyipa-ubuntu-xenial-nv/834477a/logs
/screen-ir-api.txt.gz#_Jul_19_03_34_01_680460

Jul 19 03:34:01.678194 ubuntu-xenial-citycloud-la1-9927584 ironic-api[16734]: 
WARNING keystoneauth.identity.generic.base [-] Failed to discover available 
identity versions when contacting http://10.0.1.4/identity. Attempting to parse 
version from URL.: ConnectFailure: Unable to establish connection to 
http://10.0.1.4/identity: HTTPConnectionPool(host='10.0.1.4', port=80): Max 
retries exceeded with url: /identity (Caused by 
NewConnectionError(': Failed to establish a new connection: [Errno 111] 
ECONNREFUSED',))
Jul 19 03:34:01.680460 ubuntu-xenial-citycloud-la1-9927584 ironic-api[16734]: 
INFO eventlet.wsgi.server [-] Traceback (most recent call last):
Jul 19 03:34:01.680615 ubuntu-xenial-citycloud-la1-9927584 ironic-api[16734]:   
File "/usr/local/lib/python2.7/dist-packages/eventlet/wsgi.py", line 490, in 
handle_one_response
Jul 19 03:34:01.680747 ubuntu-xenial-citycloud-la1-9927584 ironic-api[16734]:   
  result = self.application(self.environ, start_response)
Jul 19 03:34:01.680907 ubuntu-xenial-citycloud-la1-9927584 ironic-api[16734]:   
File "/opt/stack/new/ironic/ironic/api/app.py", line 114, in __call__
Jul 19 03:34:01.681047 ubuntu-xenial-citycloud-la1-9927584 ironic-api[16734]:   
  return self.v1(environ, start_response)
Jul 19 03:34:01.681215 ubuntu-xenial-citycloud-la1-9927584 ironic-api[16734]:   
File "/usr/local/lib/python2.7/dist-packages/webob/dec.py", line 131, in 
__call__
Jul 19 03:34:01.681359 ubuntu-xenial-citycloud-la1-9927584 ironic-api[16734]:   
  resp = self.call_func(req, *args, **self.kwargs)
Jul 19 03:34:01.681488 ubuntu-xenial-citycloud-la1-9927584 ironic-api[16734]:   
File "/usr/local/lib/python2.7/dist-packages/webob/dec.py", line 196, in 
call_func
Jul 19 03:34:01.681622 ubuntu-xenial-citycloud-la1-9927584 ironic-api[16734]:   
  return self.func(req, *args, **kwargs)
Jul 19 03:34:01.681747 ubuntu-xenial-citycloud-la1-9927584 ironic-api[16734]:   
File "/usr/local/lib/python2.7/dist-packages/oslo_middleware/base.py", line 
131, in __call__
Jul 19 03:34:01.681871 ubuntu-xenial-citycloud-la1-9927584 ironic-api[16734]:   
  response = req.get_response(self.application)
Jul 19 03:34:01.682003 ubuntu-xenial-citycloud-la1-9927584 ironic-api[16734]:   
File "/usr/local/lib/python2.7/dist-packages/webob/request.py", line 1316, in 
send
Jul 19 03:34:01.682142 ubuntu-xenial-citycloud-la1-9927584 ironic-api[16734]:   
  application, catch_exc_info=False)
Jul 19 03:34:01.682279 ubuntu-xenial-citycloud-la1-9927584 ironic-api[16734]:   
File "/usr/local/lib/python2.7/dist-packages/webob/request.py", line 1280, in 
call_application
Jul 19 03:34:01.682408 ubuntu-xenial-citycloud-la1-9927584 ironic-api[16734]:   
  app_iter = application(self.environ, start_response)
Jul 19 03:34:01.682541 ubuntu-xenial-citycloud-la1-9927584 ironic-api[16734]:   
File "/opt/stack/new/ironic/ironic/api/middleware/auth_token.py", line 59, in 
__call__
Jul 19 03:34:01.682666 ubuntu-xenial-citycloud-la1-9927584 ironic-api[16734]:   
  return super(AuthTokenMiddleware, self).__call__(env, start_response)
Jul 19 03:34:01.682790 ubuntu-xenial-citycloud-la1-9927584 ironic-api[16734]:   
File "/usr/local/lib/python2.7/dist-packages/webob/dec.py", line 131, in 
__call__
Jul 19 03:34:01.682913 ubuntu-xenial-citycloud-la1-9927584 ironic-api[16734]:   
  resp = self.call_func(req, *args, **self.kwargs)
Jul 19 03:34:01.683038 ubuntu-xenial-citycloud-la1-9927584 ironic-api[16734]:   
File "/usr/local/lib/python2.7/dist-packages/webob/dec.py", line 196, in 
call_func
Jul 19 03:34:01.683176 ubuntu-xenial-citycloud-la1-9927584 ironic-api[16734]:   
  return self.func(req, *args, **kwargs)
Jul 19 03:34:01.683302 ubuntu-xenial-citycloud-la1-9927584 ironic-api[16734]:   
File 
"/usr/local/lib/python2.7/dist-packages/keystonemiddleware/auth_token/__init__.py",
 line 332, in __call__
Jul 19 03:34:01.683440 ubuntu-xenial-citycloud-la1-9927584 ironic-api[16734]:   
  response = self.process_request(req)
Jul 19 03:34:01.683565 ubuntu-xenial-citycloud-la1-9927584 ironic-api[16734]:   
File 
"/usr/local/lib/python2.7/dist-packages/keystonemiddleware/auth_token/__init__.py",
 line 623, in process_request
Jul 19 03:34:01.683692 ubuntu-xenial-citycloud-la1-9927584 ironic-api[16734]:   
  resp = super(AuthProtocol, self).process_request(request)
Jul 19 03:34:01.683823 ubuntu-xenial-citycloud-la1-9927584 ironic-api[16734]:   
File 
"/usr/local/lib/python2.7/dist-packages/keystonemiddleware/auth_token/__init__.py",
 line 405, in process_request
Jul 19 03:34:01.683952 ubuntu-xenial-citycloud-la1-9927584 ironic-api[16734]:   
  allow_expired=allow_expired)
Jul 19 03:34:01.684104 ubuntu-xenial-citycloud-la1-9927584 ironic-api[16734]:   
File

[Yahoo-eng-team] [Bug 1706772] Re: InternalServerError: Internal Server Error (HTTP 500) in n-cpu logs on startup with Ironic driver

[Yahoo-eng-team] [Bug 1706772] Re: InternalServerError: Internal Server Error (HTTP 500) in n-cpu logs on startup with Ironic driver

[Yahoo-eng-team] [Bug 1706772] Re: InternalServerError: Internal Server Error (HTTP 500) in n-cpu logs on startup with Ironic driver

[Yahoo-eng-team] [Bug 1706772] Re: InternalServerError: Internal Server Error (HTTP 500) in n-cpu logs on startup with Ironic driver

[Yahoo-eng-team] [Bug 1706772] Re: InternalServerError: Internal Server Error (HTTP 500) in n-cpu logs on startup with Ironic driver

5 matches

Site Navigation

Mail list logo

Footer information