[
https://issues.apache.org/jira/browse/SPARK-37717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17464208#comment-17464208
]
Apache Spark commented on SPARK-37717:
--------------------------------------
User 'ekoifman' has created a pull request for this issue:
https://github.com/apache/spark/pull/34990
> Improve logging in BroadcastExchangeExec
> ----------------------------------------
>
> Key: SPARK-37717
> URL: https://issues.apache.org/jira/browse/SPARK-37717
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 2.4.6
> Reporter: Eugene Koifman
> Priority: Minor
>
> The logging and errors from inside
> {code:java}
> override lazy val relationFuture: Future[broadcast.Broadcast[Any]] = {
> SQLExecution.withThreadLocalCaptured[broadcast.Broadcast[Any]](
> session, BroadcastExchangeExec.executionContext) {
> try {
> .....
> } {code}
> are hard to relate to the right join in a plan with lost of Broadcast joins.
> Spark UI displays {noformat}BroadcastExchangeExec.runId{noformat} but it's
> not in the logs.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
