Hyukjin Kwon created SPARK-44963:
------------------------------------
Summary: Make PySpark (pyspark-ml module) tests passing without
any dependency
Key: SPARK-44963
URL: https://issues.apache.org/jira/browse/SPARK-44963
Project: Spark
Issue Type: Improvement
Components: PySpark, Tests
Affects Versions: 4.0.0
Reporter: Hyukjin Kwon
{code}
./python/run-tests --python-executables=python3 --modules=pyspark-ml
...
Starting test(python3): pyspark.ml.tests.test_model_cache (temp output:
/Users/hyukjin.kwon/workspace/forked/spark/python/target/f6f88c1e-0cb2-43e6-980e-47f1cdb9b463/python3__pyspark.ml.tests.test_model_cache__zij05l1u.log)
Traceback (most recent call last):
File
"/Users/hyukjin.kwon/miniconda3/envs/vanilla-3.10/lib/python3.10/runpy.py",
line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File
"/Users/hyukjin.kwon/miniconda3/envs/vanilla-3.10/lib/python3.10/runpy.py",
line 86, in _run_code
exec(code, run_globals)
File
"/Users/hyukjin.kwon/workspace/forked/spark/python/pyspark/ml/tests/test_functions.py",
line 18, in <module>
import pandas as pd
ModuleNotFoundError: No module named 'pandas'
{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
