nchammas commented on code in PR #45236:
URL: https://github.com/apache/spark/pull/45236#discussion_r1510012804
##########
python/pyspark/pandas/supported_api_gen.py:
##########
@@ -38,7 +38,7 @@
MAX_MISSING_PARAMS_SIZE = 5
COMMON_PARAMETER_SET = {"kwargs", "args", "cls"}
MODULE_GROUP_MATCH = [(pd, ps), (pdw, psw), (pdg, psg)]
-PANDAS_LATEST_VERSION = "2.2.0"
+PANDAS_LATEST_VERSION = "2.2.1"
Review Comment:
There are multiple ways to get an older version. Since the requirement only
asks for `pandas>=1.4.4`, then setting up the virtual environment months ago
will install a version that remains valid even if you rerun `pip install -r
...` today. Another way is, yes, if a different requirement specifically
prevents 2.2.1 from being installed.
The way we manage Python dependencies leaves a lot to be desired. I tried to
fix it in the past (e.g. #27928) but failed to get enough committer support. I
am inclined to try again, because I see a constant stream of commits just
trying to keep the Python build working, and I think there should be a way to
make this easier for everyone.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
