c21 commented on pull request #35648:
URL: https://github.com/apache/spark/pull/35648#issuecomment-1050503495
> However in which case will it exists unmatched rows?
@leesf - Beside the equi join condition, we also have non-equi condition.
e.g.
```
SELECT *
FROM t1
JOIN t2
ON
t1.k = t2.k
AND t1.v != t2.v <- this is the non-equi condition
```
So rows in left, right buffers have same values for join keys (i.e. `k`
column here), but not necessarily pass the non-equi join condition (i.e. `v`
column here). `SortMergeJoinExec.condition` is the non-equi condition (i.e.
`t1.v != t2.v` here).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]