[scikit-learn] scikit-learn 0.24 installation fails with ModuleNotFoundError: No module named 'scipy'

To whom it may concern, I am trying to install scikit-learn in a PySpark job using the install_pypi_package PySpark API but the install fails with : sc.install_pypi_package("scikit-learn") Collecting scikit-learn Using cached https://files.pythonhosted.org/packages/db/e2/9c0bde5f81394b627f623

Re: [scikit-learn] scikit-learn 0.24 installation fails with ModuleNotFoundError: No module named 'scipy'

Basically it get the tar with the source and recompile instead of using the wheel. Could you force an install from PyPI without using the cached file. We pushed wheels yesterday for 0.24.1 as well so it should not get the 0.24.0 version. For 0.23.2, you can see that it used the wheel (.whl). 

Re: [scikit-learn] scikit-learn 0.24 installation fails with ModuleNotFoundError: No module named 'scipy'

Use the Anaconda Python installation. "You won't find the right answers if you don't ask the right questions!" (Robert Helmbold, 2013) On Wednesday, January 20, 2021, 04:16:15 PM MST, Guillaume Lemaître wrote: #yiv4846675950 #yiv4846675950response_container_BBPPID{font-family:initial