DB Tsai created SPARK-61507:
-------------------------------
Summary: Separate unresolved Rust client plan payloads from
structural inputs
Key: SPARK-61507
URL: https://issues.apache.org/jira/browse/SPARK-61507
Project: Spark
Issue Type: Improvement
Components: Connect
Affects Versions: connect-rust-4.3.0
Reporter: DB Tsai
The Rust client's LogicalPlan enum keeps structural inputs in operator-specific
fields. Generic plan consumers must repeat every input layout to traverse or
rebuild unresolved plans.
Represent an unresolved plan as a checked LogicalPlan node with a
LogicalPlanKind payload, ordered shared Arc inputs and optional common-metadata
overrides. Preserve existing DataFrame APIs, wire payloads, stable request IDs,
ownership, Observation collection, depth bounds and iterative structural
destruction. Check input arity and reject opaque ML input replacement that
would retain the old wire input. Guard opaque node cloning using its actual
relation depth.
Direct Rust enum construction and pattern matching migrate to LogicalPlanKind
and children accessors. Add a migration guide and structural tests for
construction, rebuilding, traversal, metadata and ownership.
Generated-by: OpenAI Codex
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]