This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.2 by this push: new 9cd3708 [SPARK-36254][PYTHON][FOLLOW-UP] Skip mlflow related tests in pandas on Spark 9cd3708 is described below commit 9cd370894baafb59d76d269595f6fdbaf94c76b8 Author: Hyukjin Kwon <gurwls...@apache.org> AuthorDate: Fri Jul 30 22:28:19 2021 +0900 [SPARK-36254][PYTHON][FOLLOW-UP] Skip mlflow related tests in pandas on Spark ### What changes were proposed in this pull request? This PR is a partial revert of https://github.com/apache/spark/pull/33567 that keeps the logic to skip mlflow related tests if that's not installed. ### Why are the changes needed? It's consistent with other libraries, e.g) PyArrow. It also fixes up the potential dev breakage (see also https://github.com/apache/spark/pull/33567#issuecomment-889841829) ### Does this PR introduce _any_ user-facing change? No, dev-only. ### How was this patch tested? This is a partial revert. CI should test it out too. Closes #33589 from HyukjinKwon/SPARK-36254. Authored-by: Hyukjin Kwon <gurwls...@apache.org> Signed-off-by: Hyukjin Kwon <gurwls...@apache.org> (cherry picked from commit dd2ca0aee25f6da1a1cf36ea8c7e0095420b7c00) Signed-off-by: Hyukjin Kwon <gurwls...@apache.org> --- python/pyspark/pandas/mlflow.py | 8 +++++++- 1 file changed, 7 insertions(+), 1 deletion(-) diff --git a/python/pyspark/pandas/mlflow.py b/python/pyspark/pandas/mlflow.py index 4e48369..719db40 100644 --- a/python/pyspark/pandas/mlflow.py +++ b/python/pyspark/pandas/mlflow.py @@ -229,4 +229,10 @@ def _test() -> None: if __name__ == "__main__": - _test() + try: + import mlflow # noqa: F401 + import sklearn # noqa: F401 + + _test() + except ImportError: + pass --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org