[
https://issues.apache.org/jira/browse/SPARK-61273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alejandro Morgante updated SPARK-61273:
---------------------------------------
Description:
nan/inf timeouts slipped past the positivity check and crashed with a raw
Python error.
Before:
{code}
OverflowError: cannot convert float infinity to integer
{code}
After:
{code}
[VALUE_NOT_FINITE] Value for `timeout` must be finite, got 'inf'.
{code}
PR: https://github.com/apache/spark/pull/60228
> Reject nan/inf timeouts with a proper PySpark error
> ---------------------------------------------------
>
> Key: SPARK-61273
> URL: https://issues.apache.org/jira/browse/SPARK-61273
> Project: Spark
> Issue Type: Bug
> Components: PySpark
> Affects Versions: 5.0.0
> Reporter: Alejandro Morgante
> Priority: Major
>
> nan/inf timeouts slipped past the positivity check and crashed with a raw
> Python error.
> Before:
> {code}
> OverflowError: cannot convert float infinity to integer
> {code}
> After:
> {code}
> [VALUE_NOT_FINITE] Value for `timeout` must be finite, got 'inf'.
> {code}
> PR: https://github.com/apache/spark/pull/60228
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
