Izzy Harker created KAFKA-21102:
-----------------------------------

             Summary: Soften the validation for group upgrade and downgrade 
paths
                 Key: KAFKA-21102
                 URL: https://issues.apache.org/jira/browse/KAFKA-21102
             Project: Kafka
          Issue Type: Bug
          Components: group-coordinator
            Reporter: Izzy Harker
            Assignee: Izzy Harker


For upgrades and downgrades to/from consumer groups and streams groups, the old 
group is deleted then a new group of the desired type 
(classic/consumer/streams) is created. Currently on replay, the group deletion 
fails loading and throws IllegalStateException when the 
TargetAssignmentMetadata tombstone is missing, which can happen if the group 
coordinator loads concurrent with a late compaction run.

Therefore, we should soften the validation on the upgrade/downgrade path to 
avoid this.

Similar updates have been made for tombstone/replay validation - see 
https://issues.apache.org/jira/browse/KAFKA-17306

 

e.g.

we can load record for streams group A

then streams group A is downgraded offline to classic group and compaction 
removes group delete for streams group A

then load record for streams group tombstone -> loading fails with an exception 
like 

{{ERROR: java.lang.IllegalStateException: Received a tombstone record to delete 
group <id> but did not receive StreamsGroupTargetAssignmentMetadataValue 
tombstone. at GroupMetadataManager.replay(GroupMetadataManager.java:6264)}}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to