HyukjinKwon commented on PR #41767:
URL: https://github.com/apache/spark/pull/41767#issuecomment-1635248255
Hmmm .. seems like this actually brings some problem to Spark Connect dev.
e.g.,:
```
The conflict is caused by:
The user requested protobuf==3.19.5
grpcio-status 1.56.0 depends on protobuf>=4.21.6
```
But we specify protobuf:
https://github.com/apache/spark/blob/master/dev/requirements.txt#L55
that is only used for dev.
We can't easily upgrade protobuf otherwise it will change the generated
codes, and we should take a closer look for compatibility at
https://github.com/apache/spark/tree/master/python/pyspark/sql/connect/proto
because it requires a major version bumpup.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
