aditya-r-m commented on issue #5773: gcloud pubsub support URL: https://github.com/apache/druid/issues/5773#issuecomment-570144252 @glasser the shared service for Kafka & Kinesis can't support pubsub. Primary reasons being the following, 1. Instead of offsets & commits, pubsub subscribers work with pulling packets in batch from cloud & sending acks. 2. There is no concept of partitions or strictly ordered logs in pubsub, topics are fully replicated into multiple subscriptions which do not provide strong ordering guarantees when pulling packets. I have created a very primitive working implementation for pubsub supervisors/tasks & the extension doesn't share much with the kafka/kinesis specific handling apart from package & config structure.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
