Hi,
Decanter Prometheus exposes the Prometheus servlet. So, it’s not pushing, it’s
polling: prometheus polls data from the prometheus servlet exposed by decanter.
If you want pushing, you can directly push to prometheus backend (but it’s not
the prometheus appender).
Regards
JB
> Le 3 nov. 2020 à 23:53, Mark Bordelon <mborde...@savoirtech.com> a écrit :
>
> Hi JB.
> Got things to work by just setting the prefix and making sure everything was
> lowercase!
> Next problem is getting the data from the karaf endpoint
> (decanter/prometheus) to a prometheus server (promeefee:9090/graph)
> I see nothing in the decanter documentation on prometheus appender for
> pushing data to a url.
> Is it assumed that a prometheus server must always pull from the
> decanter/prometheus endpoint?
>
>> On Nov 3, 2020, at 12:51, Jean-Baptiste Onofre <j...@nanthrax.net> wrote:
>>
>> Hi Mark
>>
>> 6.8, ok, the tests are using newer version.
>>
>> But it should work anyway. I will test it tomorrow.
>>
>> Regards
>> JB
>>
>>> Le 3 nov. 2020 à 21:44, Mark Bordelon <mborde...@savoirtech.com> a écrit :
>>>
>>> Hi JB,
>>>
>>> This is the version of the Elastic Search I wish to push to:
>>>
>>> {
>>> "name" : "sitesc104w224m7",
>>> "cluster_name" : "vela",
>>> "cluster_uuid" : "fNKKGBcoTJmh42LDDxDkow",
>>> "version" : {
>>> "number" : "6.8.12",
>>> "build_flavor" : "default",
>>> "build_type" : "tar",
>>> "build_hash" : "7a15d2a",
>>> "build_date" : "2020-08-12T07:27:20.804867Z",
>>> "build_snapshot" : false,
>>> "lucene_version" : "7.7.3",
>>> "minimum_wire_compatibility_version" : "5.6.0",
>>> "minimum_index_compatibility_version" : "5.0.0"
>>> },
>>> "tagline" : "You Know, for Search"
>>> }
>>>
>>>> On Nov 2, 2020, at 21:17, Jean-Baptiste Onofre <j...@nanthrax.net> wrote:
>>>>
>>>> Hi Mark,
>>>>
>>>> What elasticsearch version are you using ?
>>>>
>>>> Regards
>>>> JB
>>>>
>>>>> Le 2 nov. 2020 à 22:11, Mark Bordelon <mborde...@savoirtech.com> a écrit :
>>>>>
>>>>> With the following minimal configuration, (just setting the address,
>>>>> authentication, and index prefix) …
>>>>>
>>>>> ################################################
>>>>> # Decanter Elasticsearch Appender Configuration
>>>>> ################################################
>>>>>
>>>>> # HTTP address of the elasticsearch nodes (separated with comma)
>>>>> addresses=http://elasticsearch-vela-1.sit.etrade.com:9200
>>>>> <http://elasticsearch-vela-1.sit.etrade.com:9200/>
>>>>>
>>>>> # Basic username and password authentication
>>>>> username=batchoi
>>>>> password=batchoipwd
>>>>>
>>>>> # The index name.
>>>>> # The index prefix is a static string used to construct the index
>>>>> index.prefix=karafCamelCWS
>>>>> # If true, it creates an index per Decanter event day
>>>>> #index.event.timestamped=true
>>>>> # For Elasticsearch < 7.5, index type is mandatory (not defined by
>>>>> default)
>>>>> index.type=
>>>>>
>>>>> # Marshaller to use (json is heavily recommended)
>>>>> marshaller.target=(dataFormat=json)
>>>>>
>>>>>
>>>>> I get this 405 error when i install the elasticsearch appender feature.
>>>>>
>>>>> 2020-11-02T15:32:15,870 | WARN | EventAdminAsyncThread #23 |
>>>>> ElasticsearchAppender | 188 -
>>>>> org.apache.karaf.decanter.appender.elasticsearch - 2.5.0 | Can't append
>>>>> into Elasticsearch
>>>>> org.elasticsearch.client.ResponseException: method [POST], host
>>>>> [http://elasticsearch-vela-1.sit.etrade.com:9200], URI
>>>>> [/karafCamelCWS-2020.11.02/], status line [HTTP/1.1 405 Method Not
>>>>> Allowed <http://elasticsearch-vela-1.sit.etrade.com:9200], uri
>>>>> [/karafCamelCWS-2020.11.02/], status line [HTTP/1.1 405 Method Not
>>>>> Allowed>]
>>>>> {"error":"Incorrect HTTP method for uri [/karafCamelCWS-2020.11.02/] and
>>>>> method [POST], allowed: [HEAD, GET, PUT, DELETE]","status":405}
>>>>> at
>>>>> org.elasticsearch.client.RestClient.convertResponse(RestClient.java:283)
>>>>> ~[!/:?]
>>>>> at
>>>>> org.elasticsearch.client.RestClient.performRequest(RestClient.java:261)
>>>>> ~[!/:?]
>>>>> at
>>>>> org.elasticsearch.client.RestClient.performRequest(RestClient.java:235)
>>>>> ~[!/:?]
>>>>> at
>>>>> org.apache.karaf.decanter.appender.elasticsearch.ElasticsearchAppender.send(ElasticsearchAppender.java:172)
>>>>> ~[!/:?]
>>>>> at
>>>>> org.apache.karaf.decanter.appender.elasticsearch.ElasticsearchAppender.handleEvent(ElasticsearchAppender.java:152)
>>>>> [!/:?]
>>>>> at
>>>>> org.apache.felix.eventadmin.impl.handler.EventHandlerProxy.sendEvent(EventHandlerProxy.java:415)
>>>>> [!/:?]
>>>>> at
>>>>> org.apache.felix.eventadmin.impl.tasks.HandlerTask.runWithoutBlacklistTiming(HandlerTask.java:82)
>>>>> [!/:?]
>>>>> at
>>>>> org.apache.felix.eventadmin.impl.tasks.SyncDeliverTasks.execute(SyncDeliverTasks.java:104)
>>>>> [!/:?]
>>>>> at
>>>>> org.apache.felix.eventadmin.impl.tasks.AsyncDeliverTasks$TaskExecuter.run(AsyncDeliverTasks.java:166)
>>>>> [!/:?]
>>>>> at
>>>>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>>>>> [?:1.8.0_51]
>>>>> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>>>>> [?:1.8.0_51]
>>>>> at
>>>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>>>>> [?:1.8.0_51]
>>>>> at
>>>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>>>>> [?:1.8.0_51]
>>>>> at java.lang.Thread.run(Thread.java:745) [?:1.8.0_51]
>>>>>
>>>>>
>>>>> If the HTTP verb could be set to PUT, seems like it might work based on
>>>>> this:
>>>>> curl -H "Content-Type: application/json" --user batchoi:batchoipwd \
>>>>> -XPOST "http://elasticsearch-vela-1.sit.etrade.com:9200/karafCamelCws
>>>>> <http://elasticsearch-vela-1.sit.etrade.com:9200/karafCamelCws>" -d ‘{
>>>>> "field" : "value"}’
>>>>> {"error":"Incorrect HTTP method for uri [/] and method [POST], allowed:
>>>>> [HEAD, GET, DELETE]","status":405}
>>>>>
>>>>> curl -H "Content-Type: application/json" --user batchoi:batchoipwd \
>>>>> -XPUT "http://elasticsearch-vela-1.sit.etrade.com:9200/karafCamelCws
>>>>> <http://elasticsearch-vela-1.sit.etrade.com:9200/karafCamelCws>" -d ‘{
>>>>> "field" : "value"}’
>>>>> {"error":{"root_cause":[{"type":"remote_transport_exception","reason":"[sitesm111w88m7][10.247.33.25:9300][indices:admin/create]"}],"type":"illegal_argument_exception","reason":"unknown
>>>>> setting [index.field] please check that any required plugins are
>>>>> installed, or check the breaking changes documentation for removed
>>>>> settings"},"status":400}
>>>>>
>>>>
>>>
>>
>
