Hi Spark Team, I am using Spark 3.4.0 version in my application which is use to consume messages from Kafka topics.
I have below queries: 1. Does DStream support pause/resume streaming message consumption at runtime on particular condition? If yes, please provide details. 2. I tried to revoke partition from consumer at runtime which cause error. throw new IllegalStateException(s"Previously tracked partitions " + s"${revokedPartitions.mkString("[", ",", "]")} been revoked by Kafka because of consumer " + s"rebalance. This is mostly due to another stream with same group id joined, " + s"please check if there're different streaming application misconfigure to use same " + s"group id. Fundamentally different stream should use different group id") 3. Does Spark support Blue/Green Deployment. I need to implement Blue/Green Deployment scenario with Spark. Facing problem as need to deploy both Blue and Green deployment with same consumer-group-id. As I read, spark does not support 2 deployment with same consumer group-id, this implementation is failing. Please guide how this can be implemented with Spark. 4. Does Spark support Active-Active deployment. It will be great if you can reply on above queries please. -- Regards, Saurabh Agrawal Software Development Specialist, IPaaS R&D [A picture containing logoDescription automatically generated] This email and the information contained herein is proprietary and confidential and subject to the Amdocs Email Terms of Service, which you may review at https://www.amdocs.com/about/email-terms-of-service <https://www.amdocs.com/about/email-terms-of-service>