bpattarkine opened a new pull request, #1432:
URL: https://github.com/apache/flink-agents/pull/1432

   Linked issue: apache/flink-agents#1431. Related: apache/flink-agents#1425, 
apache/flink-agents#1426, and apache/flink-agents#1430.
   
   ### Purpose of change
   
   Start experimental support for `pipeline.generic-types=false` on the fork by 
giving processing-key state an explicit serializer. During operator open, the 
state manager receives the job serializer configuration and the keyed state 
backend's input key serializer. It registers the existing union-list state 
using a duplicate of that serializer when generic types are disabled.
   
   The input key serializer already defines how job keys are stored. Reusing it 
avoids a separate generic serializer for those same keys.
   
   ### Behavioral Semantics
   
   #### Interaction decisions
   
   | Flink job setting | Processing-key state serializer |
   | --- | --- |
   | Generic types enabled | Existing serializer derived from `Object` type 
information |
   | Generic types disabled | Input key serializer supplied by Flink |
   
   #### Behavioral contracts
   
   With generic types enabled, the processing-key state retains its existing 
serialization. With generic types disabled, registration of this state uses the 
job's key serializer.
   
   #### Failure behavior
   
   Other generic serialization paths still prevent an agent job from using the 
disabled setting end to end. Existing serializer and state registration 
failures propagate through operator initialization. Restore across the two 
serializer formats is outside this draft.
   
   ### Tests
   
   | Contract | Evidence |
   | --- | --- |
   | Enabled setting retains the existing serializer | 
`OperatorStateManagerProcessingKeysTest` with generic types enabled |
   | Disabled setting registers the input key serializer | 
`OperatorStateManagerProcessingKeysTest` with generic types disabled |
   
   The focused Maven run also included the operator and operator migration 
tests. Full Java and Python job execution, cross-format restore, and durable 
restart with generic types disabled remain open.
   
   <details>
   <summary>State descriptor details</summary>
   
   The state name remains `currentProcessingKeys`, and the operator still uses 
union-list state for rescale recovery.
   
   </details>
   
   ### API
   
   No public API changes. Generic-types-enabled jobs keep their existing state 
descriptor and serializer. A compatibility contract for switching existing jobs 
to the disabled setting is still needed.
   
   ### Documentation
   
   - [x] `doc-needed`
   - [ ] `doc-not-needed`
   - [ ] `doc-included`
   
   ### Was this patch authored or co-authored using generative AI tooling?
   
   - [x] Yes
   - [ ] No
   
   Generated-by: Codex CLI 0.171.0 (GPT-6)
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to