iamkhav commented on issue #56141: URL: https://github.com/apache/spark/issues/56141#issuecomment-4562004015
> Opened PR [#56150](https://github.com/apache/spark/pull/56150) to address this issue by exposing the relevant methods to static analyzers via TYPE_CHECKING while preserving existing runtime behavior for remote-only environments. > > The PR also adds typing regression tests for: > > * DataFrame.rdd > > * SparkSession.sparkContext > > * SparkSession.newSession > > > Verified with the existing PySpark typing test suite (13 passed). Thank you! Will this be released to 4.0.x as a patch as well? That is the version that AWS clusters use. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
