abk-code opened a new issue #8582: Consumer group id creation (via Kafka indexer) URL: https://github.com/apache/incubator-druid/issues/8582 Please provide a detailed title (e.g. "Broker crashes when using TopN query with Bound filter" instead of just "Broker crashes"). ### Affected Version 15.1 The Druid version where the problem was encountered. ### Description Please include as much detailed information about the problem as possible. - 5 node - Configurations in use - Steps to reproduce the problem I'm doing some POC where I am using Kafka connector/indexer service to ingest the data into Druid.We are going to have multiple topics and consumers will be Druid (using indexer service). Ingestion works ok so far. But I am wondering what is the way to create SINGLE topic and let multiple consumers can consume using group_id. Idea is to have different rollups (materialized views) using different consumer on same kafka topic. In the specfile I specify something like following, but it's not really creating consumer group when I verify the same on Kafka side. Please help. Here is the excerpt for the specfile on the Druid side. Basically this is part of ioConfig > consumerProperties. "ioConfig:" { ... "consumerProperties": { "group.id" : "group_id" } IF there is a template to use the right specfile format, please share. - The error message or stack traces encountered. Providing more context, such as nearby log messages or even entire logs, can be helpful. No error perse, since there are no CG created from the connector/indexer. - Any debugging that you have already done Verified that CG are not created on Kafka side by listing the consumer group. Created multiple topics and let the consumer run on multiple topics for data ingestion.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
