[
https://issues.apache.org/jira/browse/SPARK-61274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alejandro Morgante updated SPARK-61274:
---------------------------------------
Description:
awaitTermination truncated tiny positive timeouts (e.g. 0.0001s) to 0ms,
crashing on Connect or returning immediately on classic.
Before:
{code}
timeout_ms=0 -> IllegalArgumentException (Connect) / no wait at all (classic)
{code}
After:
{code}
timeout_ms=max(1, int(timeout * 1000)) -> at least 1
{code}
PR: https://github.com/apache/spark/pull/60230
> Clamp awaitTermination's sub-millisecond timeout to 1ms
> -------------------------------------------------------
>
> Key: SPARK-61274
> URL: https://issues.apache.org/jira/browse/SPARK-61274
> Project: Spark
> Issue Type: Bug
> Components: PySpark
> Affects Versions: 5.0.0
> Reporter: Alejandro Morgante
> Priority: Major
>
> awaitTermination truncated tiny positive timeouts (e.g. 0.0001s) to 0ms,
> crashing on Connect or returning immediately on classic.
> Before:
> {code}
> timeout_ms=0 -> IllegalArgumentException (Connect) / no wait at all (classic)
> {code}
> After:
> {code}
> timeout_ms=max(1, int(timeout * 1000)) -> at least 1
> {code}
> PR: https://github.com/apache/spark/pull/60230
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
