Hello,

looking at BroadcastHashJoinExec, it seems to me that it never destroys the
broadcasted variables. And I think this can cause problems like SPARK-22575.

Anyway, when I tried to add a "cleanup" to destroy the variable, I saw some
test failure because it was trying to access a the destroyed broadcasted
variable.

I think that the reason of this relies in BroadcastExchangeExec, where the
same broadcasted relation can be provided if there are 2 or more
invocations.

Then my questions are: first of all, am I right or am I missing something?
If I am right, in which cases a BroadcastExchangeExec can be used more than
once (I can't think of any)?

Thanks,
Marco

Reply via email to