Re: [openstack-dev] [ceilometer][panko][pike] elasticsearch integration

2018-06-20 Thread cristian.calin
4 TRACE ceilometer.pipeline  >>>>>return _inner()
2018-06-20 07:06:11.537 24 TRACE ceilometer.pipeline  >>>>>  File 
"/opt/ceilometer/lib/python3.5/site-packages/tenacity/__init__.py", line 171, 
in wrapped_f
2018-06-20 07:06:11.537 24 TRACE ceilometer.pipeline  >>>>>return 
self.call(f, *args, **kw)
2018-06-20 07:06:11.537 24 TRACE ceilometer.pipeline  >>>>>  File 
"/opt/ceilometer/lib/python3.5/site-packages/tenacity/__init__.py", line 248, 
in call
2018-06-20 07:06:11.537 24 TRACE ceilometer.pipeline  >>>>>
start_time=start_time)
2018-06-20 07:06:11.537 24 TRACE ceilometer.pipeline  >>>>>  File 
"/opt/ceilometer/lib/python3.5/site-packages/tenacity/__init__.py", line 217, 
in iter
2018-06-20 07:06:11.537 24 TRACE ceilometer.pipeline  >>>>>    
six.raise_from(RetryError(fut), fut.exception())
2018-06-20 07:06:11.537 24 TRACE ceilometer.pipeline  >>>>>  File "", 
line 2, in raise_from
2018-06-20 07:06:11.537 24 TRACE ceilometer.pipeline  >>>>>tenacity.RetryError: 
RetryError[]
2018-06-20 07:06:11.537 24 TRACE ceilometer.pipeline  >>>>>

I changed my panko.conf to:
[database]
connection = es://user:password@elasticsearch.service.consul.:9200
es_ssl_enable = False
[storage]
es_index_name = events

But I get the same error which means that the es_* parameters are not properly 
merged from panko.conf when ceilometer-agent-notification starts up.

From: cristian.ca...@orange.com [mailto:cristian.ca...@orange.com]
Sent: Wednesday, June 20, 2018 9:44 AM
To: openstack-operat...@lists.openstack.org
Cc: openstack-dev@lists.openstack.org
Subject: [openstack-dev] [ceilometer][panko][pike] elasticsearch integration

Hello,


I'm trying to run ceilometer with panko publishers in pike release and when I 
run the ceilometer-agent-notification I get a trace complaining about 
NoSuchOptError, but without the actual parameter that is missing (see trace 
below).

I have configured panko.conf with the following:

[database]
connection = es://user:password@elasticsearch.service.consul.:9200
[storage]
es_ssl_enable = False
es_index_name = events


As far as I  can tell from the debug log, the storage.es_ssl_enable and 
storage.es_index_name parameters are not loaded, they don't show up in the 
"cotyledon.oslo_config_glue" output so I assume the trace relates to these 
parameters. Has anybody else seen this error before?

PS: sorry for CC'ing the dev list but I hope to reach the right audience
 TRACE 
{"asctime": "2018-06-20 05:49:09.405","process": "59","levelname": 
"DEBUG","name": "panko.storage", "instance": {},"message":"looking for 'es' 
driver in panko.storage"} {"funcName": "get_connection","source": {"p
ath": 
"/opt/ceilometer/lib/python2.7/site-packages/panko/storage/__init__.py","lineno":
 "84"}}
{"asctime": "2018-06-20 05:49:10.436","process": "61","levelname": 
"DEBUG","name": "panko.storage", "instance": {},"message":"looking for 'es' 
driver in panko.storage"} {"funcName": "get_connection","source": {"p
ath": 
"/opt/ceilometer/lib/python2.7/site-packages/panko/storage/__init__.py","lineno":
 "84"}}
{"asctime": "2018-06-20 05:49:11.409","process": "63","levelname": 
"DEBUG","name": "panko.storage", "instance": {},"message":"looking for 'es' 
driver in panko.storage"} {"funcName": "get_connection","source": {"p
ath": 
"/opt/ceilometer/lib/python2.7/site-packages/panko/storage/__init__.py","lineno":
 "84"}}
{"asctime": "2018-06-20 05:49:18.467","process": "57","levelname": 
"DEBUG","name": "panko.storage", "instance": {},"message":"looking for 'es' 
driver in panko.storage"} {"funcName": "get_connection","source": {"p
ath": 
"/opt/ceilometer/lib/python2.7/site-packages/panko/storage/__init__.py","lineno":
 "84"}}
{"asctime": "2018-06-20 05:49:18.468","process": "57","levelname": 
"ERROR","name": "ceilometer.pipeline", "instance": {},"message":"Unable to load 
publisher panko://"}: RetryError: RetryError[]
201

[openstack-dev] [ceilometer][panko][pike] elasticsearch integration

2018-06-19 Thread cristian.calin
Hello,


I'm trying to run ceilometer with panko publishers in pike release and when I 
run the ceilometer-agent-notification I get a trace complaining about 
NoSuchOptError, but without the actual parameter that is missing (see trace 
below).

I have configured panko.conf with the following:

[database]
connection = es://user:password@elasticsearch.service.consul.:9200
[storage]
es_ssl_enable = False
es_index_name = events


As far as I  can tell from the debug log, the storage.es_ssl_enable and 
storage.es_index_name parameters are not loaded, they don't show up in the 
"cotyledon.oslo_config_glue" output so I assume the trace relates to these 
parameters. Has anybody else seen this error before?

PS: sorry for CC'ing the dev list but I hope to reach the right audience
 TRACE 
{"asctime": "2018-06-20 05:49:09.405","process": "59","levelname": 
"DEBUG","name": "panko.storage", "instance": {},"message":"looking for 'es' 
driver in panko.storage"} {"funcName": "get_connection","source": {"p
ath": 
"/opt/ceilometer/lib/python2.7/site-packages/panko/storage/__init__.py","lineno":
 "84"}}
{"asctime": "2018-06-20 05:49:10.436","process": "61","levelname": 
"DEBUG","name": "panko.storage", "instance": {},"message":"looking for 'es' 
driver in panko.storage"} {"funcName": "get_connection","source": {"p
ath": 
"/opt/ceilometer/lib/python2.7/site-packages/panko/storage/__init__.py","lineno":
 "84"}}
{"asctime": "2018-06-20 05:49:11.409","process": "63","levelname": 
"DEBUG","name": "panko.storage", "instance": {},"message":"looking for 'es' 
driver in panko.storage"} {"funcName": "get_connection","source": {"p
ath": 
"/opt/ceilometer/lib/python2.7/site-packages/panko/storage/__init__.py","lineno":
 "84"}}
{"asctime": "2018-06-20 05:49:18.467","process": "57","levelname": 
"DEBUG","name": "panko.storage", "instance": {},"message":"looking for 'es' 
driver in panko.storage"} {"funcName": "get_connection","source": {"p
ath": 
"/opt/ceilometer/lib/python2.7/site-packages/panko/storage/__init__.py","lineno":
 "84"}}
{"asctime": "2018-06-20 05:49:18.468","process": "57","levelname": 
"ERROR","name": "ceilometer.pipeline", "instance": {},"message":"Unable to load 
publisher panko://"}: RetryError: RetryError[]
2018-06-20 05:49:18.468 57 TRACE ceilometer.pipeline  >Traceback (most 
recent call last):
2018-06-20 05:49:18.468 57 TRACE ceilometer.pipeline  >  File 
"/opt/ceilometer/lib/python2.7/site-packages/ceilometer/pipeline.py", line 419, 
in __init__
2018-06-20 05:49:18.468 57 TRACE ceilometer.pipeline  >
self.publishers.append(publisher_manager.get(p))
2018-06-20 05:49:18.468 57 TRACE ceilometer.pipeline  >  File 
"/opt/ceilometer/lib/python2.7/site-packages/ceilometer/pipeline.py", line 713, 
in get
2018-06-20 05:49:18.468 57 TRACE ceilometer.pipeline  >
'ceilometer.%s.publisher' % self._purpose)
2018-06-20 05:49:18.468 57 TRACE ceilometer.pipeline  >  File 
"/opt/ceilometer/lib/python2.7/site-packages/ceilometer/publisher/__init__.py", 
line 36, in get_publisher
2018-06-20 05:49:18.468 57 TRACE ceilometer.pipeline  >return 
loaded_driver.driver(parse_result)
2018-06-20 05:49:18.468 57 TRACE ceilometer.pipeline  >  File 
"/opt/ceilometer/lib/python2.7/site-packages/panko/publisher/database.py", line 
35, in __init__
2018-06-20 05:49:18.468 57 TRACE ceilometer.pipeline  >self.conn = 
storage.get_connection_from_config(conf)
2018-06-20 05:49:18.468 57 TRACE ceilometer.pipeline  >  File 
"/opt/ceilometer/lib/python2.7/site-packages/panko/storage/__init__.py", line 
73, in get_connection_from_config
2018-06-20 05:49:18.468 57 TRACE ceilometer.pipeline  >return _inner()
2018-06-20 05:49:18.468 57 TRACE ceilometer.pipeline  >  File 
"/opt/ceilometer/lib/python2.7/site-packages/tenacity/__init__.py", line 171, 
in wrapped_f
2018-06-20 05:49:18.468 57 TRACE ceilometer.pipeline  >return 
self.call(f, *args, **kw)
2018-06-20 05:49:18.468 57 TRACE ceilometer.pipeline  >  File 
"/opt/ceilometer/lib/python2.7/site-packages/tenacity/__init__.py", line 248, 
in call
2018-06-20 05:49:18.468 57 TRACE ceilometer.pipeline  >
start_time=start_time)
2018-06-20 05:49:18.468 57 TRACE ceilometer.pipeline  >  File 
"/opt/ceilometer/lib/python2.7/site-packages/tenacity/__init__.py", line 217, 
in iter
2018-06-20 05:49:18.468 57 TRACE ceilometer.pipeline  >
six.raise_from(RetryError(fut), fut.exception())
2018-06-20 05:49:18.468 57 TRACE ceilometer.pipeline  >  File 
"/opt/ceilometer/lib/python2.7/site-packages/six.py", line 718, in raise_from
2018-06-20 05:49:18.468 57 TRACE ceilometer.pipeline  >raise value
2018-06-20 05:49:18.468 57 TRACE ceilometer.pipeline  >RetryError: 
RetryError[]
2018-06-20 05:49:18.468 57 TRACE ceilometer.pipeline  >

_

Ce message et ses pieces j