Github user cloud-fan commented on the pull request:
https://github.com/apache/spark/pull/13322
@zhzhan , for outer join, if it's a typed join, then both of the join side
will include this hidden column, as their columns are produced by serializing
custom object. If we need to return null for one join side, we will null out
all columns of that side, including the hidden column. Then when we deserialize
it, we can know that this join side is null and we can build a null object for
it.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]