Re: [openstack-dev] [oslo] Exception in rpc_dispatcher
On 05/07/2015 03:34 AM, Vikash Kumar wrote: I did following in my agent code: import eventlet eventlet.monkey_patch() but still I see same issue. Unfortunately, monkey patching in an agent is probably too late. The monkey patching has to happen at application startup to be done before everything else. See the section starting at line 30 or so in https://review.openstack.org/#/c/154642/2/specs/eventlet-best-practices.rst On Thu, May 7, 2015 at 1:22 PM, Mehdi Abaakouk sil...@sileht.net wrote: Hi, This is a well known issue when eventlet monkey patching is not done correctly. The application must do the monkey patching before anything else even loading another module that eventlet. You can find more information here: https://bugs.launchpad.net/oslo.messaging/+bug/1288878 Or some examples of how nova and ceilometer ensure that: https://github.com/openstack/nova/blob/master/nova/cmd/__init__.py https://github.com/openstack/ceilometer/blob/master/ceilometer/cmd/__init__.py More recent version of oslo.messaging already outputs a better error message in this case. Cheers, --- Mehdi Abaakouk mail: sil...@sileht.net irc: sileht Le 2015-05-07 08:11, Vikash Kumar a écrit : Hi, I am getting this error in my agent side. I am getting same message twice, one after other. 2015-05-07 11:39:28.189 11363 ERROR oslo.messaging.rpc.dispatcher [req-43875dc3-99a9-4803-aba2-5cff22943c2c ] Exception during message handling: _oslo_messaging_localcontext_7a1e392197394132b7bfc1bda8239a82 2015-05-07 11:39:28.189 11363 TRACE oslo.messaging.rpc.dispatcher Traceback (most recent call last): 2015-05-07 11:39:28.189 11363 TRACE oslo.messaging.rpc.dispatcher File /usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py, line 134, in _dispatch_and_reply 2015-05-07 11:39:28.189 11363 TRACE oslo.messaging.rpc.dispatcher incoming.message)) 2015-05-07 11:39:28.189 11363 TRACE oslo.messaging.rpc.dispatcher File /usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py, line 179, in _dispatch 2015-05-07 11:39:28.189 11363 TRACE oslo.messaging.rpc.dispatcher localcontext.clear_local_context() 2015-05-07 11:39:28.189 11363 TRACE oslo.messaging.rpc.dispatcher File /usr/lib/python2.7/dist-packages/oslo/messaging/localcontext.py, line 55, in clear_local_context 2015-05-07 11:39:28.189 11363 TRACE oslo.messaging.rpc.dispatcher delattr(_STORE, _KEY) 2015-05-07 11:39:28.189 11363 TRACE oslo.messaging.rpc.dispatcher AttributeError: _oslo_messaging_localcontext_7a1e392197394132b7bfc1bda8239a82 2015-05-07 11:39:28.189 11363 TRACE oslo.messaging.rpc.dispatcher __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev signature.asc Description: OpenPGP digital signature __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [oslo] Exception in rpc_dispatcher
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 Hi, This is a well known issue when eventlet monkey patching is not done correctly. The application must do the monkey patching before anything else even loading another module that eventlet. You can find more information here: https://bugs.launchpad.net/oslo.messaging/+bug/1288878 Or some examples of how nova and ceilometer ensure that: https://github.com/openstack/nova/blob/master/nova/cmd/__init__.py https://github.com/openstack/ceilometer/blob/master/ceilometer/cmd/__init__.py More recent version of oslo.messaging already outputs a better error message in this case. Cheers, - --- Mehdi Abaakouk mail: sil...@sileht.net irc: sileht Le 2015-05-07 08:11, Vikash Kumar a écrit : Hi, I am getting this error in my agent side. I am getting same message twice, one after other. 2015-05-07 11:39:28.189 11363 ERROR oslo.messaging.rpc.dispatcher [req-43875dc3-99a9-4803-aba2-5cff22943c2c ] Exception during message handling: _oslo_messaging_localcontext_7a1e392197394132b7bfc1bda8239a82 2015-05-07 11:39:28.189 11363 TRACE oslo.messaging.rpc.dispatcher Traceback (most recent call last): 2015-05-07 11:39:28.189 11363 TRACE oslo.messaging.rpc.dispatcher File /usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py, line 134, in _dispatch_and_reply 2015-05-07 11:39:28.189 11363 TRACE oslo.messaging.rpc.dispatcher incoming.message)) 2015-05-07 11:39:28.189 11363 TRACE oslo.messaging.rpc.dispatcher File /usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py, line 179, in _dispatch 2015-05-07 11:39:28.189 11363 TRACE oslo.messaging.rpc.dispatcher localcontext.clear_local_context() 2015-05-07 11:39:28.189 11363 TRACE oslo.messaging.rpc.dispatcher File /usr/lib/python2.7/dist-packages/oslo/messaging/localcontext.py, line 55, in clear_local_context 2015-05-07 11:39:28.189 11363 TRACE oslo.messaging.rpc.dispatcher delattr(_STORE, _KEY) 2015-05-07 11:39:28.189 11363 TRACE oslo.messaging.rpc.dispatcher AttributeError: _oslo_messaging_localcontext_7a1e392197394132b7bfc1bda8239a82 2015-05-07 11:39:28.189 11363 TRACE oslo.messaging.rpc.dispatcher __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev -BEGIN PGP SIGNATURE- Version: OpenPGP.js v.1.20131017 Comment: http://openpgpjs.org wsFcBAEBCAAQBQJVSxmkCRAYkrQvzqrryAAAcA4P/iTf59F9HbqQF6uuKDM6 HMPWg0PovpzUg0opOMMBE8ZwiQ6B+w5MS3rkwDzbcXfqijDxM8A0BAOwG5/v iFGfENKPIVm2Y/7iHmg84+MXSKSYDNmsuZc0AOP0i9Ar9D6E8SZbC5hMSfAO KOZBbVmBP14/KhXesxJPx5nbDknhRPLravV9o/iyMnLSWBGQa80X92G1tkz6 6PI/UCCp1SGyky0eg0ZoZ5+IX3r9UsyjGDRS+le+lQEu4T0e05G1jBnvw9H7 qIo7ecWDSUwwxl7sz2HlgaF0st4bjCtRtSPbbcW2nShKBVbIdAxfncj2O8Ux PVwk4ZaEdyQ+O2RJp/vq6v9jcNsoh/3jCLojEwUv4BlLS7qEW4Ime0coJoxD zgC1vdgSojS8pxRto8kh7NJ91MpILRDfm3bJ/bpTGb04Wh4LYGHmoeQMrCex rPmYgDkWTXUpsqAgwHpP8DZpRXY40hx6yCiWp/1lNLI/CYx4B6fDOOS7Xf8k kjmRrzV8QriQ+02M9cCWIgLyskAUIWRzEn/ZhtAiQTvaCJEuMvQTHSYMf30J m1hW2bL5UcuwA+4Or6nxzfF14EDaWZv2dD2hPNvfJ3qMXgCHQoQUVp061sto p7RPmzWVWuNrwmVIp0JcJSLDGRSifGadDw/3Uiygpo9M9RfUJEpC2RJ85WjU DSE8 =nSuZ -END PGP SIGNATURE- __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [oslo] Exception in rpc_dispatcher
I did following in my agent code: import eventlet eventlet.monkey_patch() but still I see same issue. On Thu, May 7, 2015 at 1:22 PM, Mehdi Abaakouk sil...@sileht.net wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA256 Hi, This is a well known issue when eventlet monkey patching is not done correctly. The application must do the monkey patching before anything else even loading another module that eventlet. You can find more information here: https://bugs.launchpad.net/oslo.messaging/+bug/1288878 Or some examples of how nova and ceilometer ensure that: https://github.com/openstack/nova/blob/master/nova/cmd/__init__.py https://github.com/openstack/ceilometer/blob/master/ceilometer/cmd/__init__.py More recent version of oslo.messaging already outputs a better error message in this case. Cheers, - --- Mehdi Abaakouk mail: sil...@sileht.net irc: sileht Le 2015-05-07 08:11, Vikash Kumar a écrit : Hi, I am getting this error in my agent side. I am getting same message twice, one after other. 2015-05-07 11:39:28.189 11363 ERROR oslo.messaging.rpc.dispatcher [req-43875dc3-99a9-4803-aba2-5cff22943c2c ] Exception during message handling: _oslo_messaging_localcontext_7a1e392197394132b7bfc1bda8239a82 2015-05-07 11:39:28.189 11363 TRACE oslo.messaging.rpc.dispatcher Traceback (most recent call last): 2015-05-07 11:39:28.189 11363 TRACE oslo.messaging.rpc.dispatcher File /usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py, line 134, in _dispatch_and_reply 2015-05-07 11:39:28.189 11363 TRACE oslo.messaging.rpc.dispatcher incoming.message)) 2015-05-07 11:39:28.189 11363 TRACE oslo.messaging.rpc.dispatcher File /usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py, line 179, in _dispatch 2015-05-07 11:39:28.189 11363 TRACE oslo.messaging.rpc.dispatcher localcontext.clear_local_context() 2015-05-07 11:39:28.189 11363 TRACE oslo.messaging.rpc.dispatcher File /usr/lib/python2.7/dist-packages/oslo/messaging/localcontext.py, line 55, in clear_local_context 2015-05-07 11:39:28.189 11363 TRACE oslo.messaging.rpc.dispatcher delattr(_STORE, _KEY) 2015-05-07 11:39:28.189 11363 TRACE oslo.messaging.rpc.dispatcher AttributeError: _oslo_messaging_localcontext_7a1e392197394132b7bfc1bda8239a82 2015-05-07 11:39:28.189 11363 TRACE oslo.messaging.rpc.dispatcher __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev -BEGIN PGP SIGNATURE- Version: OpenPGP.js v.1.20131017 Comment: http://openpgpjs.org wsFcBAEBCAAQBQJVSxmkCRAYkrQvzqrryAAAcA4P/iTf59F9HbqQF6uuKDM6 HMPWg0PovpzUg0opOMMBE8ZwiQ6B+w5MS3rkwDzbcXfqijDxM8A0BAOwG5/v iFGfENKPIVm2Y/7iHmg84+MXSKSYDNmsuZc0AOP0i9Ar9D6E8SZbC5hMSfAO KOZBbVmBP14/KhXesxJPx5nbDknhRPLravV9o/iyMnLSWBGQa80X92G1tkz6 6PI/UCCp1SGyky0eg0ZoZ5+IX3r9UsyjGDRS+le+lQEu4T0e05G1jBnvw9H7 qIo7ecWDSUwwxl7sz2HlgaF0st4bjCtRtSPbbcW2nShKBVbIdAxfncj2O8Ux PVwk4ZaEdyQ+O2RJp/vq6v9jcNsoh/3jCLojEwUv4BlLS7qEW4Ime0coJoxD zgC1vdgSojS8pxRto8kh7NJ91MpILRDfm3bJ/bpTGb04Wh4LYGHmoeQMrCex rPmYgDkWTXUpsqAgwHpP8DZpRXY40hx6yCiWp/1lNLI/CYx4B6fDOOS7Xf8k kjmRrzV8QriQ+02M9cCWIgLyskAUIWRzEn/ZhtAiQTvaCJEuMvQTHSYMf30J m1hW2bL5UcuwA+4Or6nxzfF14EDaWZv2dD2hPNvfJ3qMXgCHQoQUVp061sto p7RPmzWVWuNrwmVIp0JcJSLDGRSifGadDw/3Uiygpo9M9RfUJEpC2RJ85WjU DSE8 =nSuZ -END PGP SIGNATURE- __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev -- Regards, Vikash __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
[openstack-dev] [oslo] Exception in rpc_dispatcher
Hi, I am getting this error in my agent side. I am getting same message twice, one after other. 2015-05-07 11:39:28.189 11363 ERROR oslo.messaging.rpc.dispatcher [req-43875dc3-99a9-4803-aba2-5cff22943c2c ] Exception during message handling: _oslo_messaging_localcontext_7a1e392197394132b7bfc1bda8239a82 2015-05-07 11:39:28.189 11363 TRACE oslo.messaging.rpc.dispatcher Traceback (most recent call last): 2015-05-07 11:39:28.189 11363 TRACE oslo.messaging.rpc.dispatcher File /usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py, line 134, in _dispatch_and_reply 2015-05-07 11:39:28.189 11363 TRACE oslo.messaging.rpc.dispatcher incoming.message)) 2015-05-07 11:39:28.189 11363 TRACE oslo.messaging.rpc.dispatcher File /usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py, line 179, in _dispatch 2015-05-07 11:39:28.189 11363 TRACE oslo.messaging.rpc.dispatcher localcontext.clear_local_context() 2015-05-07 11:39:28.189 11363 TRACE oslo.messaging.rpc.dispatcher File /usr/lib/python2.7/dist-packages/oslo/messaging/localcontext.py, line 55, in clear_local_context 2015-05-07 11:39:28.189 11363 TRACE oslo.messaging.rpc.dispatcher delattr(_STORE, _KEY) 2015-05-07 11:39:28.189 11363 TRACE oslo.messaging.rpc.dispatcher AttributeError: _oslo_messaging_localcontext_7a1e392197394132b7bfc1bda8239a82 2015-05-07 11:39:28.189 11363 TRACE oslo.messaging.rpc.dispatcher -- Regards, Vikash __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
