Pierre-Luc, I'm still investigating this. Could you please share details about your environment? Is it devstack? You can find me in #openstack-ceilometer channel in irc, maybe it would be faster to find out the root cause (nick _nadya_). The problem is that the issue may be related not only to HBase.
Thanks On Tue, Jun 16, 2015 at 3:53 PM, Pierre-Luc Dion <[email protected]> wrote: > Thanks Nadya, > > I still have my test setup in place so if there is a fix to test, I should > be able to pretty fast. > > Regards, > > > > On Tue, Jun 16, 2015 at 5:27 AM, Nadya Privalova <[email protected]> > wrote: > >> Hi Pierre-Luc, >> >> From logs it's seen that the message which was processed is >> >> {u'read_only': False, u'instance_uuid': None, u'domain': None, >> u'show_deleted': False, u'user_identity': u'- - - - -', u'project_domain': >> None, u'auth_token': None, u'is_admin': True, u'user': None, u'request_id': >> u'req-bf3c927f-03f4-4b64-a903-df3770cfef48', u'user_domain': None, >> u'tenant': None} >> >> So it doesn't contain resource_id. HBase needs this field to put data >> into 'resource' table. Anyway, we need to handle this situation properly. >> Thanks for filing a bug, I will work on it. >> >> Thanks, >> Nadya >> >> >> On Fri, Jun 12, 2015 at 10:54 PM, Pierre-Luc Dion <[email protected]> >> wrote: >> >>> Hi, >>> >>> Did anyone tried using hbase as backend for Ceilometer to collect Swift >>> Metrics. >>> I've setup a test environement and It collect some metrics from >>> swift-proxy but those 3 are missings: >>> and I got the following trace in ceilometer-collector.log: >>> >>> >>> 2015-06-12 14:53:23.741 10403 ERROR oslo_messaging.notify.dispatcher [-] >>> Exception during message handling >>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher >>> Traceback (most recent call last): >>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher >>> File >>> "/usr/lib/python2.7/dist-packages/oslo_messaging/notify/dispatcher.py", >>> line 91, in _dispatch_and_handle_error >>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher >>> executor_callback) >>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher >>> File >>> "/usr/lib/python2.7/dist-packages/oslo_messaging/notify/dispatcher.py", >>> line 134, in _dispatch >>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher >>> metadata) >>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher >>> File "/usr/lib/python2.7/dist-packages/ceilometer/collector.py", line 167, >>> in sample >>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher >>> self.dispatcher_manager.map_method(self.method, payload) >>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher >>> File "/usr/lib/python2.7/dist-packages/stevedore/extension.py", line 251, >>> in map_method >>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher >>> method_name, *args, **kwds) >>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher >>> File "/usr/lib/python2.7/dist-packages/stevedore/extension.py", line 224, >>> in map >>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher >>> self._invoke_one_plugin(response.append, func, e, args, kwds) >>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher >>> File "/usr/lib/python2.7/dist-packages/stevedore/extension.py", line 255, >>> in _invoke_one_plugin >>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher >>> response_callback(func(e, *args, **kwds)) >>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher >>> File "/usr/lib/python2.7/dist-packages/stevedore/extension.py", line 229, >>> in _call_extension_method >>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher >>> return getattr(extension.obj, method_name)(*args, **kwds) >>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher >>> File "/usr/lib/python2.7/dist-packages/ceilometer/dispatcher/database.py", >>> line 89, in record_metering_data >>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher >>> self.meter_conn.record_metering_data(meter) >>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher >>> File "/usr/lib/python2.7/dist-packages/ceilometer/storage/impl_hbase.py", >>> line 175, in record_metering_data >>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher >>> resource, ts) >>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher >>> File "/usr/lib/python2.7/dist-packages/happybase/table.py", line 434, in put >>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher >>> batch.put(row, data) >>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher >>> File "/usr/lib/python2.7/dist-packages/happybase/batch.py", line 132, in >>> __exit__ >>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher >>> self.send() >>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher >>> File "/usr/lib/python2.7/dist-packages/happybase/batch.py", line 58, in send >>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher >>> self._table.name, bms, self._timestamp, {}) >>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher >>> File "/usr/lib/python2.7/dist-packages/happybase/hbase/Hbase.py", line >>> 1588, in mutateRowsTs >>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher >>> self.recv_mutateRowsTs() >>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher >>> File "/usr/lib/python2.7/dist-packages/happybase/hbase/Hbase.py", line >>> 1607, in recv_mutateRowsTs >>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher >>> raise x >>> 2015-06-12 14:53:23.741 10403 TRACE oslo_messaging.notify.dispatcher >>> TApplicationException: Internal error processing mutateRowsTs >>> >>> >>> I've open this bug [1] as reference. >>> >>> >>> Thanks, >>> >>> >>> [1] https://bugs.launchpad.net/ceilometer/+bug/1464265 >>> >>> >>> >>> >>> _______________________________________________ >>> Mailing list: >>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack >>> Post to : [email protected] >>> Unsubscribe : >>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack >>> >>> >> >
_______________________________________________ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : [email protected] Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
