[ https://issues.apache.org/jira/browse/SPARK-34629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hyukjin Kwon updated SPARK-34629: --------------------------------- Shepherd: Maciej Szymkiewicz > Python type hints improvement > ----------------------------- > > Key: SPARK-34629 > URL: https://issues.apache.org/jira/browse/SPARK-34629 > Project: Spark > Issue Type: Improvement > Components: PySpark > Affects Versions: 3.1.2 > Reporter: Hyukjin Kwon > Priority: Critical > > We added PySpark type hints at SPARK-32681 > However, looks like there are still many missing APIs to type. I maintain a > project called [Koalas](https://github.com/databricks/koalas), and I found > these errors > https://gist.github.com/HyukjinKwon/9faabc5f2680b56007d71ef7cf0ad400 > For example, {{pyspark.__version__}} and {{pyspark.sql.Column.contains}} are > missing in the type hints. > I believe this is the same case to other projects that enables mypy in their > project (presumably also given SPARK-34544). > This umbrella JIRA targets to identify such cases and improve Python type > hints in PySpark. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org