HyukjinKwon opened a new pull request #33487:
URL: https://github.com/apache/spark/pull/33487


   ### What changes were proposed in this pull request?
   
   This PR proposes to make the PySpark codebase compatible with other versions 
of MyPy.
   
   ### Why are the changes needed?
   
   
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141519/console
   
   ```
   python/pyspark/mllib/tree.pyi:29: error: Overloaded function signatures 1 
and 2 overlap with incompatible return types
   python/pyspark/mllib/tree.pyi:38: error: Overloaded function signatures 1 
and 2 overlap with incompatible return types
   python/pyspark/mllib/feature.pyi:34: error: Overloaded function signatures 1 
and 2 overlap with incompatible return types
   python/pyspark/mllib/feature.pyi:42: error: Overloaded function signatures 1 
and 2 overlap with incompatible return types
   python/pyspark/mllib/feature.pyi:48: error: Overloaded function signatures 1 
and 2 overlap with incompatible return types
   python/pyspark/mllib/feature.pyi:54: error: Overloaded function signatures 1 
and 2 overlap with incompatible return types
   python/pyspark/mllib/feature.pyi:76: error: Overloaded function signatures 1 
and 2 overlap with incompatible return types
   python/pyspark/mllib/feature.pyi:124: error: Overloaded function signatures 
1 and 2 overlap with incompatible return types
   python/pyspark/mllib/feature.pyi:165: error: Overloaded function signatures 
1 and 2 overlap with incompatible return types
   python/pyspark/mllib/clustering.pyi:45: error: Overloaded function 
signatures 1 and 2 overlap with incompatible return types
   python/pyspark/mllib/clustering.pyi:72: error: Overloaded function 
signatures 1 and 2 overlap with incompatible return types
   python/pyspark/mllib/classification.pyi:39: error: Overloaded function 
signatures 1 and 2 overlap with incompatible return types
   python/pyspark/mllib/classification.pyi:52: error: Overloaded function 
signatures 1 and 2 overlap with incompatible return types
   Found 13 errors in 4 files (checked 314 source files)
   1
   ```
   
   Jenkins installed mypy at SPARK-32797 but seems the version installed is not 
same as GIthub Actions. we should make the codebase compatible with it.
   
   ### Does this PR introduce _any_ user-facing change?
   
   No, dev-only.
   
   ### How was this patch tested?
   
   Jenkins job in this PR should test it out.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to