wangxiaopeng0329 created HUDI-9522:
--------------------------------------
Summary: The grpc-api versions conflict is reported based on hudi
0.15.0 and spark3.5 build task
Key: HUDI-9522
URL: https://issues.apache.org/jira/browse/HUDI-9522
Project: Apache Hudi
Issue Type: Bug
Components: compile
Reporter: wangxiaopeng0329
Fix For: 0.15.0
The grpc-api versions conflict is reported when build task is executed
using{color:#FF0000} hudi 0.15.0 and spark3.5{color}. The following modules
report error messages with the same cause:
{code:java}
hudi-cli/pom.xml
hudi-examples/hudi-examples-spark/pom.xml
hudi-kafka-connect/pom.xml
packaging/hudi-cli-bundle/pom.xml
packaging/hudi-kafka-connect-bundle/pom.xml
packaging/hudi-utilities-bundle/pom.xml {code}
The command and error information is as follows:
{code:java}
mvn clean install -DskipTests=true -P spark3.5,scala-2.12 {code}
{code:java}
[INFO] Reactor Summary for Hudi 0.15.0:
[INFO]
[INFO] Hudi ............................................... SUCCESS [ 1.063 s]
[INFO] hudi-tests-common .................................. SUCCESS [ 1.906 s]
[INFO] hudi-io ............................................ SUCCESS [ 3.299 s]
[INFO] hudi-common ........................................ SUCCESS [ 11.121 s]
[INFO] hudi-hadoop-common ................................. SUCCESS [ 4.640 s]
[INFO] hudi-hadoop-mr ..................................... SUCCESS [ 3.545 s]
[INFO] hudi-sync-common ................................... SUCCESS [ 1.379 s]
[INFO] hudi-hive-sync ..................................... SUCCESS [ 4.065 s]
[INFO] hudi-aws ........................................... SUCCESS [ 3.459 s]
[INFO] hudi-timeline-service .............................. SUCCESS [ 1.860 s]
[INFO] hudi-client ........................................ SUCCESS [ 0.053 s]
[INFO] hudi-client-common ................................. SUCCESS [ 7.124 s]
[INFO] hudi-spark-client .................................. SUCCESS [ 19.440 s]
[INFO] hudi-spark-datasource .............................. SUCCESS [ 0.045 s]
[INFO] hudi-spark-common_2.12 ............................. SUCCESS [ 16.776 s]
[INFO] hudi-spark3-common ................................. SUCCESS [ 6.682 s]
[INFO] hudi-spark3.2plus-common ........................... SUCCESS [ 7.627 s]
[INFO] hudi-spark3.5.x_2.12 ............................... SUCCESS [ 12.461 s]
[INFO] hudi-java-client ................................... SUCCESS [ 3.491 s]
[INFO] hudi-spark_2.12 .................................... SUCCESS [ 28.172 s]
[INFO] hudi-gcp ........................................... SUCCESS [ 1.798 s]
[INFO] hudi-utilities_2.12 ................................ SUCCESS [ 9.899 s]
[INFO] hudi-utilities-bundle_2.12 ......................... FAILURE [ 0.064 s]
[INFO] hudi-cli ........................................... SKIPPED
[INFO] hudi-flink-client .................................. SKIPPED
[INFO] hudi-datahub-sync .................................. SKIPPED
[INFO] hudi-adb-sync ...................................... SKIPPED
[INFO] hudi-sync .......................................... SKIPPED
[INFO] hudi-hadoop-mr-bundle .............................. SKIPPED
[INFO] hudi-datahub-sync-bundle ........................... SKIPPED
[INFO] hudi-hive-sync-bundle .............................. SKIPPED
[INFO] hudi-aws-bundle .................................... SKIPPED
[INFO] hudi-gcp-bundle .................................... SKIPPED
[INFO] hudi-spark3.5-bundle_2.12 .......................... SKIPPED
[INFO] hudi-presto-bundle ................................. SKIPPED
[INFO] hudi-utilities-slim-bundle_2.12 .................... SKIPPED
[INFO] hudi-timeline-server-bundle ........................ SKIPPED
[INFO] hudi-trino-bundle .................................. SKIPPED
[INFO] hudi-examples ...................................... SKIPPED
[INFO] hudi-examples-common ............................... SKIPPED
[INFO] hudi-examples-spark ................................ SKIPPED
[INFO] hudi-flink-datasource .............................. SKIPPED
[INFO] hudi-flink1.18.x ................................... SKIPPED
[INFO] hudi-flink ......................................... SKIPPED
[INFO] hudi-examples-flink ................................ SKIPPED
[INFO] hudi-examples-java ................................. SKIPPED
[INFO] hudi-flink1.14.x ................................... SKIPPED
[INFO] hudi-flink1.15.x ................................... SKIPPED
[INFO] hudi-flink1.16.x ................................... SKIPPED
[INFO] hudi-flink1.17.x ................................... SKIPPED
[INFO] hudi-kafka-connect ................................. SKIPPED
[INFO] hudi-flink1.18-bundle .............................. SKIPPED
[INFO] hudi-kafka-connect-bundle .......................... SKIPPED
[INFO] hudi-cli-bundle_2.12 ............................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:30 min
[INFO] Finished at: 2025-06-13T09:50:13+08:00
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project hudi-utilities-bundle_2.12: Could not
resolve dependencies for project
org.apache.hudi:hudi-utilities-bundle_2.12:jar:0.15.0: Failed to collect
dependencies for org.apache.hudi:hudi-utilities-bundle_2.12:
jar:0.15.0: Could not resolve version conflict among
[org.apache.hudi:hudi-utilities_2.12:jar:0.15.0 ->
org.apache.hudi:hudi-gcp:jar:0.15.0 ->
com.google.cloud:google-cloud-bigquery:jar:2.26.0 ->
io.grpc:grpc-api:jar:1.54.0, org.apache.hudi:hudi-
utilities_2.12:jar:0.15.0 -> org.apache.hudi:hudi-gcp:jar:0.15.0 ->
com.google.cloud:google-cloud-pubsub:jar:1.123.12 ->
io.grpc:grpc-api:jar:1.54.0, org.apache.hudi:hudi-utilities_2.12:jar:0.15.0 ->
org.apache.hudi:hudi-gcp:jar:0.15.0 -> com.goo
gle.cloud.bigdataoss:gcs-connector:jar:hadoop2-2.2.7 ->
com.google.cloud.bigdataoss:gcsio:jar:2.2.7 -> io.grpc:grpc-api:jar:1.43.2,
org.apache.hudi:hudi-utilities_2.12:jar:0.15.0 ->
org.apache.hudi:hudi-gcp:jar:0.15.0 -> com.google.cloud.bigdatao
ss:gcs-connector:jar:hadoop2-2.2.7 ->
com.google.cloud.bigdataoss:gcsio:jar:2.2.7 -> io.grpc:grpc-census:jar:1.43.2
-> io.grpc:grpc-api:jar:[1.43.2,1.43.2],
org.apache.hudi:hudi-utilities_2.12:jar:0.15.0 ->
org.apache.hudi:hudi-gcp:jar:0.15.0 ->
com.google.cloud.bigdataoss:gcs-connector:jar:hadoop2-2.2.7 ->
com.google.cloud.bigdataoss:gcsio:jar:2.2.7 ->
com.google.api.grpc:grpc-google-cloud-storage-v2:jar:2.2.2-alpha ->
io.grpc:grpc-api:jar:1.42.1, org.apache.parquet:parquet-avro:jar:1.1
3.1 -> org.apache.parquet:parquet-hadoop:jar:1.13.1 ->
io.grpc:grpc-netty-shaded:jar:1.31.1 -> io.grpc:grpc-core:jar:[1.31.1,1.31.1]
-> io.grpc:grpc-api:jar:[1.31.1,1.31.1],
org.apache.parquet:parquet-avro:jar:1.13.1 -> org.apache.parquet:parquet
-hadoop:jar:1.13.1 -> io.grpc:grpc-protobuf:jar:1.31.1 ->
io.grpc:grpc-api:jar:1.31.1, org.apache.parquet:parquet-avro:jar:1.13.1 ->
org.apache.parquet:parquet-hadoop:jar:1.13.1 -> io.grpc:grpc-stub:jar:1.31.1 ->
io.grpc:grpc-api:jar:1.31.1] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <args> -rf :hudi-utilities-bundle_2.12
{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
