Xinyao Zhang created SPARK-60537:
------------------------------------
Summary: Fix ProtobufSerdeSuite descriptor lookup in Maven builds
Key: SPARK-60537
URL: https://issues.apache.org/jira/browse/SPARK-60537
Project: Spark
Issue Type: Sub-task
Components: Protobuf
Affects Versions: 5.0.0
Reporter: Xinyao Zhang
Parent: SPARK-60531.
The SPARK-59112 test in ProtobufSerdeSuite looks up SimpleMessageJavaTypes
using serde_suite.desc, although the message is declared in
functions_suite.proto. Maven generates separate descriptors and the test fails
with PROTOBUF_MESSAGE_NOT_FOUND. SBT's combined descriptors can hide the
incorrect reference.
Observed in Maven Java 17, Java 21, Java 25, and Java 21 ARM runs; macOS has
the same failure plus unrelated failures. Example:
https://github.com/apache/spark/actions/runs/39968091301.
Proposed fix: use functionsDesc for this lookup. Implementation:
https://github.com/apache/spark/pull/59772.
Validation: Maven Java 21 reproduced the failure before the fix; all 8
ProtobufSerdeSuite tests passed afterward, along with the 20-module reactor and
Scalastyle. Fork CI also passed all 8 suite tests. A successful affected master
workflow after integration remains to be verified.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
