vogievetsky commented on issue #8582: Consumer group id creation (via Kafka indexer) URL: https://github.com/apache/incubator-druid/issues/8582#issuecomment-536777738 If you are using the streaming data loader (added in 0.16.0) then in this step:  You can enter a filter to only look at a specific value  The spec from ☝️ is: ```json { "type": "kafka", "ioConfig": { "type": "kafka", "consumerProperties": { "bootstrap.servers": "172.31.15.10:9092" }, "topic": "wikiticker" }, "tuningConfig": { "type": "kafka" }, "dataSchema": { "dataSource": "wikiticker", "granularitySpec": { "type": "uniform", "queryGranularity": "HOUR", "segmentGranularity": "HOUR", "rollup": true }, "parser": { "type": "string", "parseSpec": { "format": "json", "timestampSpec": { "column": "timestamp", "format": "iso" }, "dimensionsSpec": { "dimensions": [ "channel", "cityName", "comment", "countryIsoCode", "countryName", "diffUrl", "flags", "isAnonymous", "isMinor", "isNew", "isRobot", "isUnpatrolled", "namespace", "page", "regionIsoCode", "regionName", "user" ] } } }, "metricsSpec": [ { "name": "count", "type": "count" }, { "name": "sum_added", "type": "longSum", "fieldName": "added" }, { "name": "sum_commentLength", "type": "longSum", "fieldName": "commentLength" }, { "name": "sum_deleted", "type": "longSum", "fieldName": "deleted" }, { "name": "sum_delta", "type": "longSum", "fieldName": "delta" }, { "name": "sum_deltaBucket", "type": "longSum", "fieldName": "deltaBucket" }, { "name": "sum_metroCode", "type": "longSum", "fieldName": "metroCode" } ], "transformSpec": { "filter": { "type": "selector", "dimension": "channel", "value": "#es.wikipedia" } } } } ``` Notice the `transformSpec.fitler`
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
