[
https://issues.apache.org/jira/browse/SPARK-55447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Enrico Minack updated SPARK-55447:
----------------------------------
Description:
Calling {{BlockManagerMaster}} methods {{{}removeRdd{}}}, {{removeShuffle}} and
{{removeBroadcast}} with {{blocking = false}} still blocks.
These methods call {{{}driverEndpoint.askSync{}}}, which (as the name implies}}
waits for the future's result:
{code:java}
def askSync[T: ClassTag](message: Any): T = askSync(message, defaultAskTimeout)
def askSync[T: ClassTag](message: Any, timeout: RpcTimeout): T = {
val future = ask[T](message, timeout)
timeout.awaitResult(future)
}
{code}
Further, the `spark.cleaner.referenceTracking.blocking.timeout` is eclipsed by
{{RpcUtils.askRpcTimeout(conf)}}.
was:
Calling {{BlockManagerMaster}} methods {{removeRdd}}, {{removeShuffle}} and
{{removeBroadcast}} with {{blocking = false}} still blocks.
These methods call {{driverEndpoint.askSync}}, which (as the name implies}}
waits for the future's result:
{code}
def askSync[T: ClassTag](message: Any): T = askSync(message, defaultAskTimeout)
def askSync[T: ClassTag](message: Any, timeout: RpcTimeout): T = {
val future = ask[T](message, timeout)
timeout.awaitResult(future)
}
{code}
> Deleting blocks via BlockManagerMaster and blocking = false is still blocking
> -----------------------------------------------------------------------------
>
> Key: SPARK-55447
> URL: https://issues.apache.org/jira/browse/SPARK-55447
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 4.2.0
> Reporter: Enrico Minack
> Priority: Major
>
> Calling {{BlockManagerMaster}} methods {{{}removeRdd{}}}, {{removeShuffle}}
> and {{removeBroadcast}} with {{blocking = false}} still blocks.
> These methods call {{{}driverEndpoint.askSync{}}}, which (as the name
> implies}} waits for the future's result:
> {code:java}
> def askSync[T: ClassTag](message: Any): T = askSync(message,
> defaultAskTimeout)
> def askSync[T: ClassTag](message: Any, timeout: RpcTimeout): T = {
> val future = ask[T](message, timeout)
> timeout.awaitResult(future)
> }
> {code}
> Further, the `spark.cleaner.referenceTracking.blocking.timeout` is eclipsed
> by {{RpcUtils.askRpcTimeout(conf)}}.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
