Yuheng Chang created SPARK-53796:
------------------------------------
Summary: Add extension field to pipeline protos to support forward
compatibility
Key: SPARK-53796
URL: https://issues.apache.org/jira/browse/SPARK-53796
Project: Spark
Issue Type: Sub-task
Components: Declarative Pipelines
Affects Versions: 4.1.0
Reporter: Yuheng Chang
Adding {{google.protobuf.Any extension = 999;}} field to
{{{}PipelineCommand{}}}, {{{}DefineDataset{}}}, and {{DefineFlow}} Protos to
support forward-compatibility by carrying additional pipeline command types /
dataset or flow's fields that are not yet defined in this version of the proto.
During the planning stage, the Spark Server will resolve and dispatch command /
message to the correct handler.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
