[GitHub] [incubator-druid] smokemonster99 commented on issue #4194: Kafka lag emitter - Kafka Indexing Service

2019-11-08 Thread GitBox
smokemonster99 commented on issue #4194: Kafka lag emitter - Kafka Indexing Service URL: https://github.com/apache/incubator-druid/pull/4194#issuecomment-551900265 Actually @wankunde my config file has "ingest/kafka/lag" : { "dimensions" : ["dataSource"], "type" : "gauge" },

[GitHub] [incubator-druid] smokemonster99 commented on issue #4194: Kafka lag emitter - Kafka Indexing Service

2019-11-08 Thread GitBox
smokemonster99 commented on issue #4194: Kafka lag emitter - Kafka Indexing Service URL: https://github.com/apache/incubator-druid/pull/4194#issuecomment-551895380 Thanks guys, I rebuilt my cluster from scratch (terraform deployment) and today the 3 lag metrics started posting to datadog!

[GitHub] [incubator-druid] smokemonster99 commented on issue #4194: Kafka lag emitter - Kafka Indexing Service

2019-10-24 Thread GitBox
smokemonster99 commented on issue #4194: Kafka lag emitter - Kafka Indexing Service URL: https://github.com/apache/incubator-druid/pull/4194#issuecomment-546131178 Thanks @pjain1 ! Back to the Kafka lag, I have the emitter set to the statsd-emitter sending to dogstatsd (Datadog). I

[GitHub] [incubator-druid] smokemonster99 commented on issue #4194: Kafka lag emitter - Kafka Indexing Service

2019-10-15 Thread GitBox
smokemonster99 commented on issue #4194: Kafka lag emitter - Kafka Indexing Service URL: https://github.com/apache/incubator-druid/pull/4194#issuecomment-542287669 @pjain1 thanks! That was it, I just needed to actually send something to kafka to get the metrics to show up in datadog via

[GitHub] [incubator-druid] smokemonster99 commented on issue #4194: Kafka lag emitter - Kafka Indexing Service

2019-10-12 Thread GitBox
smokemonster99 commented on issue #4194: Kafka lag emitter - Kafka Indexing Service URL: https://github.com/apache/incubator-druid/pull/4194#issuecomment-541327515 I have the emitter configured and it is sending out jvm and other metrics but I do not see Kafka lag. Maybe because there are

[GitHub] [incubator-druid] smokemonster99 commented on issue #4194: Kafka lag emitter - Kafka Indexing Service

2019-10-11 Thread GitBox
smokemonster99 commented on issue #4194: Kafka lag emitter - Kafka Indexing Service URL: https://github.com/apache/incubator-druid/pull/4194#issuecomment-541230998 Very late here...but is there a particular monitor that needs to be configured in order to get these metrics? I have kafka