nchammas opened a new pull request #27928: [SPARK-31167][BUILD] Refactor how we track Python test/build dependencies URL: https://github.com/apache/spark/pull/27928 ### What changes were proposed in this pull request? This PR refactors how we track various Python test and build dependencies so they are pinned and internally consistent. ### Why are the changes needed? This should make it easier to bump dependencies (since they are specified in fewer places) and promote more consistent build behavior across Docker, Jenkins, GitHub, and local development environments. ### Does this PR introduce any user-facing change? No. ### How was this patch tested? I built the Docker image just far enough to confirm that the dependencies are installed correctly: ``` Step 16/31 : RUN pip install -r docs-requirements.txt ---> Running in b0c66cb2a543 Collecting sphinx==2.3.1 Downloading Sphinx-2.3.1-py3-none-any.whl (2.7 MB) Collecting mkdocs==1.0.4 Downloading mkdocs-1.0.4-py2.py3-none-any.whl (1.2 MB) Collecting numpy==1.18.1 Downloading numpy-1.18.1-cp37-cp37m-manylinux1_x86_64.whl (20.1 MB) ... ``` The GitHub workflow will be tested as part of this PR.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
