FrankChen021 commented on pull request #11240: URL: https://github.com/apache/druid/pull/11240#issuecomment-855937391
> so I use broker name + queueID as partition offset for each partition is stored in metadata, if it changes, the consumption will start from the beginning or the latest position. So, is broker name + queueID immutable ? > If some one wants to adapt to other extensions, the components need some necessary features. SeekableStreamXXX provides a way to ingest data exactly once, 'seekable' is one of the most feature to do that. I don't know whether there're strong needs to ingest data directly from traditional message queue system like ActiveMQ/RabbitMQ. If there're, I think running an independent component, which forwards message to Kafka, is much easier, one reason is that these MQ systems use a PUSH model which differs a lot from PULL model on which current SeekableStreamXXX is based > Where should I add descriptions, in code or in this page? Putting in the description of this PR is OK. Thanks for your explanation. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
