xiaozhongcheng created HUDI-4383:
------------------------------------
Summary: Make hudi-flink-bundle module compile with the correct
flink version
Key: HUDI-4383
URL: https://issues.apache.org/jira/browse/HUDI-4383
Project: Apache Hudi
Issue Type: Bug
Reporter: xiaozhongcheng
Fix For: 0.12.0
At present, If I compile hudi withe the compile command of
{code:java}
mvn clean package -DskipTests -Dhive.version=3.1.2 -Dscala.version=2.12.12
-Dscala.binary.version=2.12 -Pflink-bundle-shade-hive3 -Pflink1.15
-Dcheckstyle.skip=true -Dspark3.2 -Dscala-2.12 {code}
the flink version of hudi-flink-bundle is still 1.14.
Compile output:
{code:java}
[root@hadoop3 hudi-master]# mvn clean package -DskipTests -Dhive.version=3.1.2
-Dscala.version=2.12.12 -Dscala.binary.version=2.12 -Pflink-bundle-shade-hive3
-Pflink1.15 -Dcheckstyle.skip=true -Dspark3.2 -Dscala-2.12
[INFO] Scanning for projects...
[WARNING]
[WARNING] Some problems were encountered while building the effective model for
org.apache.hudi:hudi-common:jar:0.12.0-SNAPSHOT
[WARNING]
'dependencyManagement.dependencies.dependency.(groupId:artifactId:type:classifier)'
must be unique: org.apache.logging.log4j:log4j-core:jar -> version
${log4j2.version} vs ${log4j.test.version} @
org.apache.hudi:hudi:0.12.0-SNAPSHOT, /data/hudi-master/pom.xml, line 1175,
column 19
[WARNING]
'dependencyManagement.dependencies.dependency.(groupId:artifactId:type:classifier)'
must be unique: org.apache.logging.log4j:log4j-api:jar -> version
${log4j2.version} vs ${log4j.test.version} @
org.apache.hudi:hudi:0.12.0-SNAPSHOT, /data/hudi-master/pom.xml, line 1182,
column 19
[WARNING]
[WARNING] Some problems were encountered while building the effective model for
org.apache.hudi:hudi-cli:jar:0.12.0-SNAPSHOT
[WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must
be unique: org.apache.logging.log4j:log4j-core:jar -> duplicate declaration of
version (?) @ line 216, column 17
[WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must
be unique: org.apache.logging.log4j:log4j-api:jar -> duplicate declaration of
version (?) @ line 222, column 17
[WARNING]
[WARNING] Some problems were encountered while building the effective model for
org.apache.hudi:hudi-spark-common_2.12:jar:0.12.0-SNAPSHOT
[WARNING] 'artifactId' contains an expression but should be a constant. @
org.apache.hudi:hudi-spark-common_${scala.binary.version}:0.12.0-SNAPSHOT,
/data/hudi-master/hudi-spark-datasource/hudi-spark-common/pom.xml, line 24,
column 15
[WARNING]
[WARNING] Some problems were encountered while building the effective model for
org.apache.hudi:hudi-spark_2.12:jar:0.12.0-SNAPSHOT
[WARNING] 'artifactId' contains an expression but should be a constant. @
org.apache.hudi:hudi-spark_${scala.binary.version}:0.12.0-SNAPSHOT,
/data/hudi-master/hudi-spark-datasource/hudi-spark/pom.xml, line 26, column 15
[WARNING]
[WARNING] Some problems were encountered while building the effective model for
org.apache.hudi:hudi-utilities_2.12:jar:0.12.0-SNAPSHOT
[WARNING] 'artifactId' contains an expression but should be a constant. @
org.apache.hudi:hudi-utilities_${scala.binary.version}:0.12.0-SNAPSHOT,
/data/hudi-master/hudi-utilities/pom.xml, line 26, column 15
[WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must
be unique: org.apache.logging.log4j:log4j-core:jar -> duplicate declaration of
version (?) @
org.apache.hudi:hudi-utilities_${scala.binary.version}:0.12.0-SNAPSHOT,
/data/hudi-master/hudi-utilities/pom.xml, line 501, column 17
[WARNING]
[WARNING] Some problems were encountered while building the effective model for
org.apache.hudi:hudi-hive-sync:jar:0.12.0-SNAPSHOT
[WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must
be unique: org.apache.logging.log4j:log4j-core:jar -> duplicate declaration of
version (?) @ line 162, column 17
[WARNING]
[WARNING] Some problems were encountered while building the effective model for
org.apache.hudi:hudi-spark3.2-bundle_2.12:jar:0.12.0-SNAPSHOT
[WARNING] 'artifactId' contains an expression but should be a constant. @
org.apache.hudi:hudi-spark${sparkbundle.version}-bundle_${scala.binary.version}:0.12.0-SNAPSHOT,
/data/hudi-master/packaging/hudi-spark-bundle/pom.xml, line 26, column 15
[WARNING]
[WARNING] Some problems were encountered while building the effective model for
org.apache.hudi:hudi-utilities-bundle_2.12:jar:0.12.0-SNAPSHOT
[WARNING] 'artifactId' contains an expression but should be a constant. @
org.apache.hudi:hudi-utilities-bundle_${scala.binary.version}:0.12.0-SNAPSHOT,
/data/hudi-master/packaging/hudi-utilities-bundle/pom.xml, line 26, column 15
[WARNING]
[WARNING] Some problems were encountered while building the effective model for
org.apache.hudi:hudi-utilities-slim-bundle_2.12:jar:0.12.0-SNAPSHOT
[WARNING] 'artifactId' contains an expression but should be a constant. @
org.apache.hudi:hudi-utilities-slim-bundle_${scala.binary.version}:0.12.0-SNAPSHOT,
/data/hudi-master/packaging/hudi-utilities-slim-bundle/pom.xml, line 26,
column 15
[WARNING]
[WARNING] Some problems were encountered while building the effective model for
org.apache.hudi:hudi-flink1.14-bundle:jar:0.12.0-SNAPSHOT
[WARNING] 'artifactId' contains an expression but should be a constant. @
org.apache.hudi:hudi-flink${flink.bundle.version}-bundle:0.12.0-SNAPSHOT,
/data/hudi-master/packaging/hudi-flink-bundle/pom.xml, line 28, column 15
[WARNING]
[WARNING] Some problems were encountered while building the effective model for
org.apache.hudi:hudi-spark2_2.12:jar:0.12.0-SNAPSHOT
[WARNING] 'artifactId' contains an expression but should be a constant. @
org.apache.hudi:hudi-spark2_${scala.binary.version}:0.12.0-SNAPSHOT,
/data/hudi-master/hudi-spark-datasource/hudi-spark2/pom.xml, line 24, column 15
[WARNING]
[WARNING] Some problems were encountered while building the effective model for
org.apache.hudi:hudi:pom:0.12.0-SNAPSHOT
[WARNING]
'dependencyManagement.dependencies.dependency.(groupId:artifactId:type:classifier)'
must be unique: org.apache.logging.log4j:log4j-core:jar -> version
${log4j2.version} vs ${log4j.test.version} @ line 1175, column 19
[WARNING]
'dependencyManagement.dependencies.dependency.(groupId:artifactId:type:classifier)'
must be unique: org.apache.logging.log4j:log4j-api:jar -> version
${log4j2.version} vs ${log4j.test.version} @ line 1182, column 19
[WARNING]
[WARNING] It is highly recommended to fix these problems because they threaten
the stability of your build.
[WARNING]
[WARNING] For this reason, future Maven versions might no longer support
building such malformed projects.
[WARNING]
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Build Order:
[INFO]
[INFO] Hudi [pom]
[INFO] hudi-common [jar]
[INFO] hudi-hadoop-mr [jar]
[INFO] hudi-sync-common [jar]
[INFO] hudi-hive-sync [jar]
[INFO] hudi-aws [jar]
[INFO] hudi-timeline-service [jar]
[INFO] hudi-client [pom]
[INFO] hudi-client-common [jar]
[INFO] hudi-spark-client [jar]
[INFO] hudi-spark-datasource [pom]
[INFO] hudi-spark-common_2.12 [jar]
[INFO] hudi-spark3-common [jar]
[INFO] hudi-spark3_2.12 [jar]
[INFO] hudi-java-client [jar]
[INFO] hudi-spark_2.12 [jar]
[INFO] hudi-utilities_2.12 [jar]
[INFO] hudi-utilities-bundle_2.12 [jar]
[INFO] hudi-cli [jar]
[INFO] hudi-flink-client [jar]
[INFO] hudi-gcp [jar]
[INFO] hudi-datahub-sync [jar]
[INFO] hudi-adb-sync [jar]
[INFO] hudi-sync [pom]
[INFO] hudi-hadoop-mr-bundle [jar]
[INFO] hudi-datahub-sync-bundle [jar]
[INFO] hudi-hive-sync-bundle [jar]
[INFO] hudi-aws-bundle [jar]
[INFO] hudi-gcp-bundle [jar]
[INFO] hudi-spark3.2-bundle_2.12 [jar]
[INFO] hudi-presto-bundle [jar]
[INFO] hudi-utilities-slim-bundle_2.12 [jar]
[INFO] hudi-timeline-server-bundle [jar]
[INFO] hudi-trino-bundle [jar]
[INFO] hudi-examples [pom]
[INFO] hudi-examples-common [jar]
[INFO] hudi-examples-spark [jar]
[INFO] hudi-flink-datasource [pom]
[INFO] hudi-flink1.14.x [jar]
[INFO] hudi-flink [jar]
[INFO] hudi-examples-flink [jar]
[INFO] hudi-examples-java [jar]
[INFO] hudi-flink1.13.x [jar]
[INFO] hudi-flink1.15.x [jar]
[INFO] hudi-kafka-connect [jar]
[INFO] hudi-flink1.14-bundle [jar]
[INFO] hudi-kafka-connect-bundle [jar]
[INFO] hudi-spark2_2.12 [jar]
[INFO] hudi-spark2-common [jar]
[INFO]
[INFO] ------------------------< org.apache.hudi:hudi >------------------------
[INFO] Building Hudi 0.12.0-SNAPSHOT [1/49]
[INFO] --------------------------------[ pom ]---------------------------------
[INFO]
[INFO] --- maven-clean-plugin:3.1.0:clean (default-clean) @ hudi ---
[INFO] Deleting /data/hudi-master/target
[INFO]
......{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
