farshad delavarpour created SPARK-32460:
-------------------------------------------
Summary: how spark collects non-match results after performing
broadcast left outer join
Key: SPARK-32460
URL: https://issues.apache.org/jira/browse/SPARK-32460
Project: Spark
Issue Type: Question
Components: Spark Core, SQL
Affects Versions: 2.4.0
Reporter: farshad delavarpour
Does anybody know how spark collects non-match results after performing
broadcast hash left outer join?
Suppose we have 4 nodes. 1 driver and 3 executors. We broadcast the left table.
After left outer join is performed in each executor, how does spark recognize
which records have not been matched, and how does it collect them to the final
result?
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
