nchammas commented on code in PR #44546: URL: https://github.com/apache/spark/pull/44546#discussion_r1439674215
########## dev/py-tests/requirements-sql.txt: ########## @@ -0,0 +1,11 @@ +# PySpark dependencies for SQL tests + +numpy==1.26.2 Review Comment: Would you be open to my making another attempt at the approach in #27928? (@zhengruifeng can also take this on if they prefer, of course.) Basically, we have two sets of development dependencies: - `requirements.txt`: direct dependencies only that are as flexible as possible; this is what devs install on their laptops - `requirements-pinned.txt`: pinned dependencies derived automatically from `requirements.txt` using [pip-tools][1]; this is used for CI I know this adds a new tool that non-Python developers may not be familiar with (pip-tools), but it's extremely easy to use, has been around a long time, and is in use by many large projects, the most notable of which is [Warehouse][2], the project that backs PyPI. [1]: https://github.com/jazzband/pip-tools [2]: https://github.com/pypi/warehouse -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
