DB Tsai created SPARK-61507:
-------------------------------

             Summary: Separate unresolved Rust client plan payloads from 
structural inputs
                 Key: SPARK-61507
                 URL: https://issues.apache.org/jira/browse/SPARK-61507
             Project: Spark
          Issue Type: Improvement
          Components: Connect
    Affects Versions: connect-rust-4.3.0
            Reporter: DB Tsai


The Rust client's LogicalPlan enum keeps structural inputs in operator-specific 
fields. Generic plan consumers must repeat every input layout to traverse or 
rebuild unresolved plans.

Represent an unresolved plan as a checked LogicalPlan node with a 
LogicalPlanKind payload, ordered shared Arc inputs and optional common-metadata 
overrides. Preserve existing DataFrame APIs, wire payloads, stable request IDs, 
ownership, Observation collection, depth bounds and iterative structural 
destruction. Check input arity and reject opaque ML input replacement that 
would retain the old wire input. Guard opaque node cloning using its actual 
relation depth.

Direct Rust enum construction and pattern matching migrate to LogicalPlanKind 
and children accessors. Add a migration guide and structural tests for 
construction, rebuilding, traversal, metadata and ownership.

Generated-by: OpenAI Codex




--
This message was sent by Atlassian Jira
(v10.3.26#10030026)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to