GitHub user MaxGekk opened a pull request:
https://github.com/apache/spark/pull/21727
[SPARK-24757][SQL] Improving the error message for broadcast timeouts
## What changes were proposed in this pull request?
In the PR, I propose to provide a tip to user how to resolve the issue of
timeout expiration for broadcast joins. In particular, they can increase the
timeout via **spark.sql.broadcastTimeout** or disable the broadcast at all by
setting **spark.sql.autoBroadcastJoinThreshold** to `-1`.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/MaxGekk/spark-1 broadcast-timeout-error
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/21727.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #21727
----
commit 0d0b3f34a90469ba894a207639456b4b815a90e8
Author: Maxim Gekk <maxim.gekk@...>
Date: 2018-07-07T14:46:21Z
Improving the error message for broadcast timeouts
I added a recommendation for increasing broadcast timeout. This sentence is
added to existing error message:
```
You can increase the timeout for broadcasts via
${SQLConf.BROADCAST_TIMEOUT.key}
```
Author: Maxim Gekk <[email protected]>
Closes #2801 from MaxGekk/broadcast-error-message.
commit 86587edca7c1345b8a3687877b598d8389fbd56b
Author: Maxim Gekk <maxim.gekk@...>
Date: 2018-07-07T15:57:36Z
Remove empty line in imports
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
