guyuqi opened a new pull request, #1077: URL: https://github.com/apache/bigtop/pull/1077
https://issues.apache.org/jira/browse/BIGTOP-3893 <!-- Thanks for sending a pull request! 1. If this is your first time, please read our contributor guidelines: https://cwiki.apache.org/confluence/display/BIGTOP/How+to+Contribute 2. Make sure your PR title starts with JIRA issue id, e.g., 'BIGTOP-3638: Your PR title ...'. --> ### Description of PR Fix Hadoop3.3.4 build issues on ppc64le. ``` Haoop common depends on protobuf-2.5.0: [ERROR] Failed to execute goal org.xolstice.maven.plugins:protobuf-maven-plugin:0.5.1:compile (src-compile-protoc-legacy) on project hadoop-common: Missing: [ERROR] ---------- [ERROR] 1) com.google.protobuf:protoc:exe:linux-ppcle_64:2.5.0 [ERROR] [ERROR] Try downloading the file manually from the project website. [ERROR] [ERROR] Then, install it using the command: [ERROR] mvn install:install-file -DgroupId=com.google.protobuf -DartifactId=protoc -Dversion=2.5.0 -Dclassifier=linux-ppcle_64 -Dpackaging=exe -Dfile=/path/to/file [ERROR] [ERROR] Alternatively, if you host your own repository you can deploy the file there: [ERROR] mvn deploy:deploy-file -DgroupId=com.google.protobuf -DartifactId=protoc -Dversion=2.5.0 -Dclassifier=linux-ppcle_64 -Dpackaging=exe -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id] [ERROR] [ERROR] Path to dependency: [ERROR] 1) org.apache.hadoop:hadoop-common:jar:3.3.4 [ERROR] 2) com.google.protobuf:protoc:exe:linux-ppcle_64:2.5.0 [ERROR] [ERROR] ---------- [ERROR] 1 required artifact is missing. [ERROR] ``` In Haddop YARN CSI, it depends on protobuf-3.6.1 and grpc-java 1.26.0. But there is no pre-built binary of protobuf-3.6.1 and grpc-java-1.26.0 for ppc64le. It's needed to build protobuf-3.6.1 and grpc-java Binaries in Bigtop toolchain: ``` INFO] Apache Hadoop YARN CSI ............................. FAILURE [ 0.552 s [ERROR] Failed to execute goal org.xolstice.maven.plugins:protobuf-maven-plugin:0.5.1:compile (default) on project hadoop-yarn-csi: Missing: [ERROR] ---------- [ERROR] 1) com.google.protobuf:protoc:exe:linux-ppcle_64:3.6.1 [ERROR] [ERROR] Try downloading the file manually from the project website. [ERROR] [ERROR] Then, install it using the command: [ERROR] mvn install:install-file -DgroupId=com.google.protobuf -DartifactId=protoc -Dversion=3.6.1 -Dclassifier=linux-ppcle_64 -Dpackagin g=exe -Dfile=/path/to/file [ERROR] [ERROR] Alternatively, if you host your own repository you can deploy the file there: [ERROR] mvn deploy:deploy-file -DgroupId=com.google.protobuf -DartifactId=protoc -Dversion=3.6.1 -Dclassifier=linux-ppcle_64 -Dpackaging= exe -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id] [ERROR] [ERROR] Path to dependency: [ERROR] 1) org.apache.hadoop:hadoop-yarn-csi:jar:3.3.4 [ERROR] 2) com.google.protobuf:protoc:exe:linux-ppcle_64:3.6.1 [ERROR] [ERROR] ---------- [ERROR] 1 required artifact is missing. [ERROR] [ERROR] for artifact: [ERROR] org.apache.hadoop:hadoop-yarn-csi:jar:3.3.4 [ERROR] [ERROR] from the specified remote repositories: [ERROR] apache.snapshots.https (https://repository.apache.org/content/repositories/snapshots, releases=true, snapshots=true), [ERROR] repository.jboss.org (https://repository.jboss.org/nexus/content/groups/public/, releases=true, snapshots=false), [ERROR] central (https://repo.maven.apache.org/maven2, releases=true, snapshots=false) [ERROR] ############################################################################# [ERROR] ---------- [ERROR] 1) io.grpc:protoc-gen-grpc-java:exe:linux-ppcle_64:1.26.0 [ERROR] [ERROR] Try downloading the file manually from the project website. [ERROR] [ERROR] Then, install it using the command: [ERROR] mvn install:install-file -DgroupId=io.grpc -DartifactId=protoc-gen-grpc-java -Dversion=1.26.0 -Dclassifier=linux-ppcle_64 -Dpackaging=exe -Dfile=/path/to/file [ERROR] [ERROR] Alternatively, if you host your own repository you can deploy the file there: [ERROR] mvn deploy:deploy-file -DgroupId=io.grpc -DartifactId=protoc-gen-grpc-java -Dversion=1.26.0 -Dclassifier=linux-ppcle_64 -Dpackaging=exe -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id] [ERROR] [ERROR] Path to dependency: [ERROR] 1) org.apache.hadoop:hadoop-yarn-csi:jar:3.3.4 [ERROR] 2) io.grpc:protoc-gen-grpc-java:exe:linux-ppcle_64:1.26.0 ``` ### How was this patch tested? Build bigtop toolchain (bigtop/slaves docker images) and build Hadoop on ppcle64. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
