pan3793 commented on PR #37787: URL: https://github.com/apache/spark/pull/37787#issuecomment-1256123496
> May I ask who is we? I mean the Spark project/community. > And, this is a part of Apache Spark community effort which is trying to reduce the dependency of protobuf 2.5.0. That's why I ask it in the Spark community. > However, removing protobuf 2.5.0 from Apache Spark distribution is a different issue. I agree, but it's related to this issue, because I see "[ORC-1212](https://issues.apache.org/jira/browse/ORC-1212) Upgrade protobuf-java to 3.17.3" in the ORC 1.8.0 release note. As far as I know, Spark requires protobuf-java 2.5.0 for Hadoop2 and ORC 1.7 and earlier versions, as Spark already switched to Hadoop Shaded client for Hadoop3, I think maybe Spark can remove protobuf 2.5.0 from the binary release(only for hadoop3 profile). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
