bpattarkine opened a new pull request, #1432: URL: https://github.com/apache/flink-agents/pull/1432
Linked issue: apache/flink-agents#1431. Related: apache/flink-agents#1425, apache/flink-agents#1426, and apache/flink-agents#1430. ### Purpose of change Start experimental support for `pipeline.generic-types=false` on the fork by giving processing-key state an explicit serializer. During operator open, the state manager receives the job serializer configuration and the keyed state backend's input key serializer. It registers the existing union-list state using a duplicate of that serializer when generic types are disabled. The input key serializer already defines how job keys are stored. Reusing it avoids a separate generic serializer for those same keys. ### Behavioral Semantics #### Interaction decisions | Flink job setting | Processing-key state serializer | | --- | --- | | Generic types enabled | Existing serializer derived from `Object` type information | | Generic types disabled | Input key serializer supplied by Flink | #### Behavioral contracts With generic types enabled, the processing-key state retains its existing serialization. With generic types disabled, registration of this state uses the job's key serializer. #### Failure behavior Other generic serialization paths still prevent an agent job from using the disabled setting end to end. Existing serializer and state registration failures propagate through operator initialization. Restore across the two serializer formats is outside this draft. ### Tests | Contract | Evidence | | --- | --- | | Enabled setting retains the existing serializer | `OperatorStateManagerProcessingKeysTest` with generic types enabled | | Disabled setting registers the input key serializer | `OperatorStateManagerProcessingKeysTest` with generic types disabled | The focused Maven run also included the operator and operator migration tests. Full Java and Python job execution, cross-format restore, and durable restart with generic types disabled remain open. <details> <summary>State descriptor details</summary> The state name remains `currentProcessingKeys`, and the operator still uses union-list state for rescale recovery. </details> ### API No public API changes. Generic-types-enabled jobs keep their existing state descriptor and serializer. A compatibility contract for switching existing jobs to the disabled setting is still needed. ### Documentation - [x] `doc-needed` - [ ] `doc-not-needed` - [ ] `doc-included` ### Was this patch authored or co-authored using generative AI tooling? - [x] Yes - [ ] No Generated-by: Codex CLI 0.171.0 (GPT-6) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
