[
https://issues.apache.org/jira/browse/HUDI-4383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-4383:
---------------------------------
Labels: pull-request-available (was: )
> Make hudi-flink-bundle module compile with the correct flink version
> --------------------------------------------------------------------
>
> Key: HUDI-4383
> URL: https://issues.apache.org/jira/browse/HUDI-4383
> Project: Apache Hudi
> Issue Type: Bug
> Reporter: xiaozhongcheng
> Priority: Major
> Labels: pull-request-available
> Fix For: 0.12.0
>
>
> At present, If I compile hudi withe the compile command of
> {code:java}
> mvn clean package -DskipTests -Dhive.version=3.1.2 -Dscala.version=2.12.12
> -Dscala.binary.version=2.12 -Pflink-bundle-shade-hive3 -Pflink1.15
> -Dcheckstyle.skip=true -Dspark3.2 -Dscala-2.12 {code}
> the flink version of hudi-flink-bundle is still 1.14.
> Compile output:
> {code:java}
> [root@hadoop3 hudi-master]# mvn clean package -DskipTests
> -Dhive.version=3.1.2 -Dscala.version=2.12.12 -Dscala.binary.version=2.12
> -Pflink-bundle-shade-hive3 -Pflink1.15 -Dcheckstyle.skip=true -Dspark3.2
> -Dscala-2.12
> [INFO] Scanning for projects...
> [WARNING]
> [WARNING] Some problems were encountered while building the effective model
> for org.apache.hudi:hudi-common:jar:0.12.0-SNAPSHOT
> [WARNING]
> 'dependencyManagement.dependencies.dependency.(groupId:artifactId:type:classifier)'
> must be unique: org.apache.logging.log4j:log4j-core:jar -> version
> ${log4j2.version} vs ${log4j.test.version} @
> org.apache.hudi:hudi:0.12.0-SNAPSHOT, /data/hudi-master/pom.xml, line 1175,
> column 19
> [WARNING]
> 'dependencyManagement.dependencies.dependency.(groupId:artifactId:type:classifier)'
> must be unique: org.apache.logging.log4j:log4j-api:jar -> version
> ${log4j2.version} vs ${log4j.test.version} @
> org.apache.hudi:hudi:0.12.0-SNAPSHOT, /data/hudi-master/pom.xml, line 1182,
> column 19
> [WARNING]
> [WARNING] Some problems were encountered while building the effective model
> for org.apache.hudi:hudi-cli:jar:0.12.0-SNAPSHOT
> [WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must
> be unique: org.apache.logging.log4j:log4j-core:jar -> duplicate declaration
> of version (?) @ line 216, column 17
> [WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must
> be unique: org.apache.logging.log4j:log4j-api:jar -> duplicate declaration of
> version (?) @ line 222, column 17
> [WARNING]
> [WARNING] Some problems were encountered while building the effective model
> for org.apache.hudi:hudi-spark-common_2.12:jar:0.12.0-SNAPSHOT
> [WARNING] 'artifactId' contains an expression but should be a constant. @
> org.apache.hudi:hudi-spark-common_${scala.binary.version}:0.12.0-SNAPSHOT,
> /data/hudi-master/hudi-spark-datasource/hudi-spark-common/pom.xml, line 24,
> column 15
> [WARNING]
> [WARNING] Some problems were encountered while building the effective model
> for org.apache.hudi:hudi-spark_2.12:jar:0.12.0-SNAPSHOT
> [WARNING] 'artifactId' contains an expression but should be a constant. @
> org.apache.hudi:hudi-spark_${scala.binary.version}:0.12.0-SNAPSHOT,
> /data/hudi-master/hudi-spark-datasource/hudi-spark/pom.xml, line 26, column 15
> [WARNING]
> [WARNING] Some problems were encountered while building the effective model
> for org.apache.hudi:hudi-utilities_2.12:jar:0.12.0-SNAPSHOT
> [WARNING] 'artifactId' contains an expression but should be a constant. @
> org.apache.hudi:hudi-utilities_${scala.binary.version}:0.12.0-SNAPSHOT,
> /data/hudi-master/hudi-utilities/pom.xml, line 26, column 15
> [WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must
> be unique: org.apache.logging.log4j:log4j-core:jar -> duplicate declaration
> of version (?) @
> org.apache.hudi:hudi-utilities_${scala.binary.version}:0.12.0-SNAPSHOT,
> /data/hudi-master/hudi-utilities/pom.xml, line 501, column 17
> [WARNING]
> [WARNING] Some problems were encountered while building the effective model
> for org.apache.hudi:hudi-hive-sync:jar:0.12.0-SNAPSHOT
> [WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must
> be unique: org.apache.logging.log4j:log4j-core:jar -> duplicate declaration
> of version (?) @ line 162, column 17
> [WARNING]
> [WARNING] Some problems were encountered while building the effective model
> for org.apache.hudi:hudi-spark3.2-bundle_2.12:jar:0.12.0-SNAPSHOT
> [WARNING] 'artifactId' contains an expression but should be a constant. @
> org.apache.hudi:hudi-spark${sparkbundle.version}-bundle_${scala.binary.version}:0.12.0-SNAPSHOT,
> /data/hudi-master/packaging/hudi-spark-bundle/pom.xml, line 26, column 15
> [WARNING]
> [WARNING] Some problems were encountered while building the effective model
> for org.apache.hudi:hudi-utilities-bundle_2.12:jar:0.12.0-SNAPSHOT
> [WARNING] 'artifactId' contains an expression but should be a constant. @
> org.apache.hudi:hudi-utilities-bundle_${scala.binary.version}:0.12.0-SNAPSHOT,
> /data/hudi-master/packaging/hudi-utilities-bundle/pom.xml, line 26, column 15
> [WARNING]
> [WARNING] Some problems were encountered while building the effective model
> for org.apache.hudi:hudi-utilities-slim-bundle_2.12:jar:0.12.0-SNAPSHOT
> [WARNING] 'artifactId' contains an expression but should be a constant. @
> org.apache.hudi:hudi-utilities-slim-bundle_${scala.binary.version}:0.12.0-SNAPSHOT,
> /data/hudi-master/packaging/hudi-utilities-slim-bundle/pom.xml, line 26,
> column 15
> [WARNING]
> [WARNING] Some problems were encountered while building the effective model
> for org.apache.hudi:hudi-flink1.14-bundle:jar:0.12.0-SNAPSHOT
> [WARNING] 'artifactId' contains an expression but should be a constant. @
> org.apache.hudi:hudi-flink${flink.bundle.version}-bundle:0.12.0-SNAPSHOT,
> /data/hudi-master/packaging/hudi-flink-bundle/pom.xml, line 28, column 15
> [WARNING]
> [WARNING] Some problems were encountered while building the effective model
> for org.apache.hudi:hudi-spark2_2.12:jar:0.12.0-SNAPSHOT
> [WARNING] 'artifactId' contains an expression but should be a constant. @
> org.apache.hudi:hudi-spark2_${scala.binary.version}:0.12.0-SNAPSHOT,
> /data/hudi-master/hudi-spark-datasource/hudi-spark2/pom.xml, line 24, column
> 15
> [WARNING]
> [WARNING] Some problems were encountered while building the effective model
> for org.apache.hudi:hudi:pom:0.12.0-SNAPSHOT
> [WARNING]
> 'dependencyManagement.dependencies.dependency.(groupId:artifactId:type:classifier)'
> must be unique: org.apache.logging.log4j:log4j-core:jar -> version
> ${log4j2.version} vs ${log4j.test.version} @ line 1175, column 19
> [WARNING]
> 'dependencyManagement.dependencies.dependency.(groupId:artifactId:type:classifier)'
> must be unique: org.apache.logging.log4j:log4j-api:jar -> version
> ${log4j2.version} vs ${log4j.test.version} @ line 1182, column 19
> [WARNING]
> [WARNING] It is highly recommended to fix these problems because they
> threaten the stability of your build.
> [WARNING]
> [WARNING] For this reason, future Maven versions might no longer support
> building such malformed projects.
> [WARNING]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Build Order:
> [INFO]
> [INFO] Hudi
> [pom]
> [INFO] hudi-common
> [jar]
> [INFO] hudi-hadoop-mr
> [jar]
> [INFO] hudi-sync-common
> [jar]
> [INFO] hudi-hive-sync
> [jar]
> [INFO] hudi-aws
> [jar]
> [INFO] hudi-timeline-service
> [jar]
> [INFO] hudi-client
> [pom]
> [INFO] hudi-client-common
> [jar]
> [INFO] hudi-spark-client
> [jar]
> [INFO] hudi-spark-datasource
> [pom]
> [INFO] hudi-spark-common_2.12
> [jar]
> [INFO] hudi-spark3-common
> [jar]
> [INFO] hudi-spark3_2.12
> [jar]
> [INFO] hudi-java-client
> [jar]
> [INFO] hudi-spark_2.12
> [jar]
> [INFO] hudi-utilities_2.12
> [jar]
> [INFO] hudi-utilities-bundle_2.12
> [jar]
> [INFO] hudi-cli
> [jar]
> [INFO] hudi-flink-client
> [jar]
> [INFO] hudi-gcp
> [jar]
> [INFO] hudi-datahub-sync
> [jar]
> [INFO] hudi-adb-sync
> [jar]
> [INFO] hudi-sync
> [pom]
> [INFO] hudi-hadoop-mr-bundle
> [jar]
> [INFO] hudi-datahub-sync-bundle
> [jar]
> [INFO] hudi-hive-sync-bundle
> [jar]
> [INFO] hudi-aws-bundle
> [jar]
> [INFO] hudi-gcp-bundle
> [jar]
> [INFO] hudi-spark3.2-bundle_2.12
> [jar]
> [INFO] hudi-presto-bundle
> [jar]
> [INFO] hudi-utilities-slim-bundle_2.12
> [jar]
> [INFO] hudi-timeline-server-bundle
> [jar]
> [INFO] hudi-trino-bundle
> [jar]
> [INFO] hudi-examples
> [pom]
> [INFO] hudi-examples-common
> [jar]
> [INFO] hudi-examples-spark
> [jar]
> [INFO] hudi-flink-datasource
> [pom]
> [INFO] hudi-flink1.14.x
> [jar]
> [INFO] hudi-flink
> [jar]
> [INFO] hudi-examples-flink
> [jar]
> [INFO] hudi-examples-java
> [jar]
> [INFO] hudi-flink1.13.x
> [jar]
> [INFO] hudi-flink1.15.x
> [jar]
> [INFO] hudi-kafka-connect
> [jar]
> [INFO] hudi-flink1.14-bundle
> [jar]
> [INFO] hudi-kafka-connect-bundle
> [jar]
> [INFO] hudi-spark2_2.12
> [jar]
> [INFO] hudi-spark2-common
> [jar]
> [INFO]
> [INFO] ------------------------< org.apache.hudi:hudi
> >------------------------
> [INFO] Building Hudi 0.12.0-SNAPSHOT
> [1/49]
> [INFO] --------------------------------[ pom
> ]---------------------------------
> [INFO]
> [INFO] --- maven-clean-plugin:3.1.0:clean (default-clean) @ hudi ---
> [INFO] Deleting /data/hudi-master/target
> [INFO]
> ......{code}
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
