amaliujia commented on code in PR #39451:
URL: https://github.com/apache/spark/pull/39451#discussion_r1064077151
##########
connector/connect/common/src/main/protobuf/spark/connect/relations.proto:
##########
@@ -211,6 +211,11 @@ message SetOperation {
// Only UNION supports this option.
optional bool by_name = 5;
+ // (Optional) If to perform the Set operation and allow missing columns.
Review Comment:
This was designed intentionally.
Basically we could also extend `by_name` to `intersect` and `except` (even
though we do not have it now) so we believed that they all belong to a
SetOperation which includes UNION, INTERSECT, EXCEPT and sharing the same set
of parameters.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
