+1 on using the manual assignment for the reasons specified below. We will see duplicates even in stable conditions which is not good. I don’t see any reason not to switch to manual assignment. While we are at it we should refactor the KafkaConfig part. It should be as simple as accepting the kafka consumer config or properties file and forwarding it to KafkaConsumer. We made it overly complex and unnecessary.
Thanks, Harsha