[GitHub] [incubator-druid] smokemonster99 commented on issue #4194: Kafka lag emitter - Kafka Indexing Service
smokemonster99 commented on issue #4194: Kafka lag emitter - Kafka Indexing
Service
URL: https://github.com/apache/incubator-druid/pull/4194#issuecomment-551900265
Actually @wankunde my config file has
"ingest/kafka/lag" : { "dimensions" : ["dataSource"], "type" : "gauge" },
"ingest/kafka/maxLag" : { "dimensions" : ["dataSource"], "type" : "gauge"
},
"ingest/kafka/avgLag" : { "dimensions" : ["dataSource"], "type" : "gauge"
},
And I notice that my metrics do not have my datasource in the name like
yours do. My metric posts like .druid.coordinator.ingest.kafka.lag
I plan to add more datasources shortly so will need that differentiation. Do
I need to change ["datasource"] to an actual list of my datasources?
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
With regards,
Apache Git Services
-
To unsubscribe, e-mail: commits-unsubscr...@druid.apache.org
For additional commands, e-mail: commits-h...@druid.apache.org
[GitHub] [incubator-druid] smokemonster99 commented on issue #4194: Kafka lag emitter - Kafka Indexing Service
smokemonster99 commented on issue #4194: Kafka lag emitter - Kafka Indexing Service URL: https://github.com/apache/incubator-druid/pull/4194#issuecomment-551895380 Thanks guys, I rebuilt my cluster from scratch (terraform deployment) and today the 3 lag metrics started posting to datadog! Not sure exactly what changed but I am not complaining. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: commits-unsubscr...@druid.apache.org For additional commands, e-mail: commits-h...@druid.apache.org
[GitHub] [incubator-druid] smokemonster99 commented on issue #4194: Kafka lag emitter - Kafka Indexing Service
smokemonster99 commented on issue #4194: Kafka lag emitter - Kafka Indexing Service URL: https://github.com/apache/incubator-druid/pull/4194#issuecomment-546131178 Thanks @pjain1 ! Back to the Kafka lag, I have the emitter set to the statsd-emitter sending to dogstatsd (Datadog). I am getting many metrics related to sys, jvm etc. As far as Kafka lag, I only saw druid.coordinator.ingest.kafka.lag, druid.coordinator.ingest.kafka.avglag and druid.coordinator.ingest.kafka.maxlag and since i saw them in datadog metrics explorer it means druid tried to post it at some point, yet there is never any values associated with THESE metrics. You said to expect them as middlemgr metrics but they are not being posted by middlemgr, just coordinator apparently and these are all no value (not even 0). I am running 0.15.1. Any further help would be appreciated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: commits-unsubscr...@druid.apache.org For additional commands, e-mail: commits-h...@druid.apache.org
[GitHub] [incubator-druid] smokemonster99 commented on issue #4194: Kafka lag emitter - Kafka Indexing Service
smokemonster99 commented on issue #4194: Kafka lag emitter - Kafka Indexing Service URL: https://github.com/apache/incubator-druid/pull/4194#issuecomment-542287669 @pjain1 thanks! That was it, I just needed to actually send something to kafka to get the metrics to show up in datadog via dogstatsd. Maybe you can help with this somewhat related question...My configured monitors such as jvm and sys work fine but I see there is a realtime monitor for ingestion, (org.apache.druid.segment.realtime.RealtimeMetricsMonitor) but when I configure it as a monitor on middlemanager, I get errors in the logs such as "No implementation for java.util.List was bound." Any ideas here? I am just looking for ingest metrics and thought that one was the best to use... This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: commits-unsubscr...@druid.apache.org For additional commands, e-mail: commits-h...@druid.apache.org
[GitHub] [incubator-druid] smokemonster99 commented on issue #4194: Kafka lag emitter - Kafka Indexing Service
smokemonster99 commented on issue #4194: Kafka lag emitter - Kafka Indexing Service URL: https://github.com/apache/incubator-druid/pull/4194#issuecomment-541327515 I have the emitter configured and it is sending out jvm and other metrics but I do not see Kafka lag. Maybe because there are no remaining unread Kafka messages? Also I am using the stated-emitter but that shouldn’t matter. I can send some new messages to Kafka and see if it sends them then. I’ll get back, thanks. Sent from my iPad > On Oct 12, 2019, at 4:54 AM, Parag Jain wrote: > > @smokemonster99 you don't need to include any monitor, you just need to enable emitter (http://druid.incubator.apache.org/docs/latest/configuration/index.html#emitting-metrics), then you can see the metrics depending on emitter. The metrics would be emitted from tasks running on middle manager nodes. > > — > You are receiving this because you were mentioned. > Reply to this email directly, view it on GitHub, or unsubscribe. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: commits-unsubscr...@druid.apache.org For additional commands, e-mail: commits-h...@druid.apache.org
[GitHub] [incubator-druid] smokemonster99 commented on issue #4194: Kafka lag emitter - Kafka Indexing Service
smokemonster99 commented on issue #4194: Kafka lag emitter - Kafka Indexing Service URL: https://github.com/apache/incubator-druid/pull/4194#issuecomment-541230998 Very late here...but is there a particular monitor that needs to be configured in order to get these metrics? I have kafka indexing extension loaded and tasks running but do not see these lag metrics being emitted, nor any complaints about missing dimensions when the emitter runs. Doc here does not say which monitor is required http://druid.incubator.apache.org/docs/latest/operations/metrics.html Also would i expect the middlemanager node to be emitting these since that is the node running the kafka tasks? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: commits-unsubscr...@druid.apache.org For additional commands, e-mail: commits-h...@druid.apache.org
