[
https://issues.apache.org/jira/browse/SPARK-60163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tian Gao resolved SPARK-60163.
------------------------------
Fix Version/s: 4.4.0
Resolution: Fixed
Issue resolved by pull request 59364
[https://github.com/apache/spark/pull/59364]
> Remove type: ignore[no-untyped-def] in pyspark.sql
> ---------------------------------------------------
>
> Key: SPARK-60163
> URL: https://issues.apache.org/jira/browse/SPARK-60163
> Project: Spark
> Issue Type: Improvement
> Components: PySpark
> Affects Versions: 4.4.0
> Reporter: Jerry Su
> Assignee: Jerry Su
> Priority: Minor
> Labels: pull-request-available
> Fix For: 4.4.0
>
>
> Add type annotations to four internal functions in pyspark.sql and remove the
> corresponding "# type: ignore[no-untyped-def]" comments, so that mypy checks
> their bodies:
> - check_string_field in pyspark/sql/functions/builtin.py (window)
> - infer_eval_type_for_udf in pyspark/sql/pandas/typehints.py
> - process in pyspark/sql/connect/streaming/worker/foreach_batch_worker.py
> - process in pyspark/sql/connect/streaming/worker/listener_worker.py
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
