Github user chenghao-intel commented on the pull request:
https://github.com/apache/spark/pull/5612#issuecomment-95446474
Assume we have data t1(2), t3((2,2), (2,1))
`select a1 from t1 left semi join t3 on t1.a1 = t3.a3 and t1.a1>=t3.b3`
will only outputs 2.
However, if we transformed that as Left Outer Join + Filter, which kind of
like: (as you did in another PR)
`SELECT a1 from (select t1.a1, t3.b3 from t1 left outer join t3 on
t1.a1=t3.a3) where t1.a1>=t3.b3`, it will output 2 rows (2, 2).
That's why we have to add the `condition` field for `HashLeftSemiJoin`, as
well as the broadcast left semijoin.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
