Junping Du created HIVE-16532:
---------------------------------
Summary: HIVE on hadoop 3 build failed due to hdfs client/server
jar separation
Key: HIVE-16532
URL: https://issues.apache.org/jira/browse/HIVE-16532
Project: Hive
Issue Type: Sub-task
Reporter: Junping Du
Assignee: Junping Du
Priority: Blocker
Just like TEZ-3690, hdfs-client jar separated from hadoop-hdfs will cause build
failures, something like:
{noformat}
...
07:00:01 2017/04/25 14:00:00 INFO : [INFO] Executed tasks
07:00:01 2017/04/25 14:00:00 INFO : [INFO]
07:00:01 2017/04/25 14:00:00 INFO : [INFO] ---
maven-compiler-plugin:3.6.1:compile (default-compile) @ hive-shims-0.23 ---
07:00:01 2017/04/25 14:00:00 INFO : [INFO] Compiling 4 source files to
/grid/0/jenkins/workspace/HDP-parallel-centos6/SOURCES/hive/shims/0.23/target/classes
07:00:02 2017/04/25 14:00:01 INFO : [INFO]
/grid/0/jenkins/workspace/HDP-parallel-centos6/SOURCES/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java:
/grid/0/jenkins/workspace/HDP-parallel-centos6/SOURCES/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java
uses or overrides a deprecated API.
07:00:02 2017/04/25 14:00:01 INFO : [INFO]
/grid/0/jenkins/workspace/HDP-parallel-centos6/SOURCES/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java:
Recompile with -Xlint:deprecation for details.
07:00:02 2017/04/25 14:00:01 INFO : [INFO]
/grid/0/jenkins/workspace/HDP-parallel-centos6/SOURCES/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java:
/grid/0/jenkins/workspace/HDP-parallel-centos6/SOURCES/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java
uses unchecked or unsafe operations.
07:00:02 2017/04/25 14:00:01 INFO : [INFO]
/grid/0/jenkins/workspace/HDP-parallel-centos6/SOURCES/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java:
Recompile with -Xlint:unchecked for details.
07:00:02 2017/04/25 14:00:01 INFO : [INFO]
-------------------------------------------------------------
07:00:02 2017/04/25 14:00:01 INFO : [ERROR] COMPILATION ERROR :
07:00:02 2017/04/25 14:00:01 INFO : [INFO]
-------------------------------------------------------------
…
07:00:02 2017/04/25 14:00:02 INFO : [WARNING] The requested profile
"hadoop-2" could not be activated because it does not exist.
07:00:02 2017/04/25 14:00:02 INFO : [ERROR] Failed to execute goal
org.apache.maven.plugins:maven-compiler-plugin:3.6.1:compile (default-compile)
on project hive-shims-0.23: Compilation failure: Compilation failure:
07:00:02 2017/04/25 14:00:02 INFO : [ERROR]
/grid/0/jenkins/workspace/HDP-parallel-centos6/SOURCES/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java:[59,30]
cannot find symbol
07:00:02 2017/04/25 14:00:02 INFO : [ERROR] symbol: class DFSClient
07:00:02 2017/04/25 14:00:02 INFO : [ERROR] location: package
org.apache.hadoop.hdfs
07:00:02 2017/04/25 14:00:02 INFO : [ERROR]
/grid/0/jenkins/workspace/HDP-parallel-centos6/SOURCES/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java:[61,30]
cannot find symbol
07:00:02 2017/04/25 14:00:02 INFO : [ERROR] symbol: class
DistributedFileSystem
07:00:02 2017/04/25 14:00:02 INFO : [ERROR] location: package
org.apache.hadoop.hdfs
07:00:02 2017/04/25 14:00:02 INFO : [ERROR]
/grid/0/jenkins/workspace/HDP-parallel-centos6/SOURCES/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java:[64,37]
package org.apache.hadoop.hdfs.client does not exist
07:00:02 2017/04/25 14:00:02 INFO : [ERROR]
/grid/0/jenkins/workspace/HDP-parallel-centos6/SOURCES/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java:[65,39]
cannot find symbol
07:00:02 2017/04/25 14:00:02 INFO : [ERROR] symbol: class DirectoryListing
07:00:02 2017/04/25 14:00:02 INFO : [ERROR] location: package
org.apache.hadoop.hdfs.protocol
07:00:02 2017/04/25 14:00:02 INFO : [ERROR]
/grid/0/jenkins/workspace/HDP-parallel-centos6/SOURCES/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java:[66,39]
cannot find symbol
07:00:02 2017/04/25 14:00:02 INFO : [ERROR] symbol: class EncryptionZone
07:00:02 2017/04/25 14:00:02 INFO : [ERROR] location: package
org.apache.hadoop.hdfs.protocol
07:00:02 2017/04/25 14:00:02 INFO : [ERROR]
/grid/0/jenkins/workspace/HDP-parallel-centos6/SOURCES/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java:[67,39]
cannot find symbol
07:00:02 2017/04/25 14:00:02 INFO : [ERROR] symbol: class HdfsConstants
07:00:02 2017/04/25 14:00:02 INFO : [ERROR] location: package
org.apache.hadoop.hdfs.protocol
07:00:02 2017/04/25 14:00:02 INFO : [ERROR]
/grid/0/jenkins/workspace/HDP-parallel-centos6/SOURCES/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java:[68,39]
cannot find symbol
07:00:02 2017/04/25 14:00:02 INFO : [ERROR] symbol: class
HdfsLocatedFileStatus
07:00:02 2017/04/25 14:00:02 INFO : [ERROR] location: package
org.apache.hadoop.hdfs.protocol
07:00:02 2017/04/25 14:00:02 INFO : [ERROR]
/grid/0/jenkins/workspace/HDP-parallel-centos6/SOURCES/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java:[580,38]
cannot find symbol
07:00:02 2017/04/25 14:00:02 INFO : [ERROR] symbol: class DFSClient
07:00:02 2017/04/25 14:00:02 INFO : [ERROR] location: class
org.apache.hadoop.hive.shims.Hadoop23Shims
07:00:02 2017/04/25 14:00:02 INFO : [ERROR]
/grid/0/jenkins/workspace/HDP-parallel-centos6/SOURCES/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java:[773,11]
cannot find symbol
07:00:02 2017/04/25 14:00:02 INFO : [ERROR] symbol: class
DistributedFileSystem
07:00:02 2017/04/25 14:00:02 INFO : [ERROR] location: class
org.apache.hadoop.hive.shims.Hadoop23Shims
07:00:02 2017/04/25 14:00:02 INFO : [ERROR]
/grid/0/jenkins/workspace/HDP-parallel-centos6/SOURCES/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java:[1045,19]
cannot find symbol
07:00:02 2017/04/25 14:00:02 INFO : [ERROR] symbol: class
DistributedFileSystem
07:00:02 2017/04/25 14:00:02 INFO : [ERROR] location: class
org.apache.hadoop.hive.shims.Hadoop23Shims.StoragePolicyShim
07:00:02 2017/04/25 14:00:02 INFO : [ERROR]
/grid/0/jenkins/workspace/HDP-parallel-centos6/SOURCES/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java:[1047,30]
cannot find symbol
07:00:02 2017/04/25 14:00:02 INFO : [ERROR] symbol: class
DistributedFileSystem
07:00:02 2017/04/25 14:00:02 INFO : [ERROR] location: class
org.apache.hadoop.hive.shims.Hadoop23Shims.StoragePolicyShim
07:00:02 2017/04/25 14:00:02 INFO : [ERROR]
/grid/0/jenkins/workspace/HDP-parallel-centos6/SOURCES/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java:[1140,13]
cannot find symbol
07:00:02 2017/04/25 14:00:02 INFO : [ERROR] symbol: class HdfsAdmin
07:00:02 2017/04/25 14:00:02 INFO : [ERROR] location: class
org.apache.hadoop.hive.shims.Hadoop23Shims.HdfsEncryptionShim
07:00:02 2017/04/25 14:00:02 INFO : [ERROR]
/grid/0/jenkins/workspace/HDP-parallel-centos6/SOURCES/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java:[1158,41]
cannot find symbol
07:00:02 2017/04/25 14:00:02 INFO : [ERROR] symbol: class DFSClient
07:00:02 2017/04/25 14:00:02 INFO : [ERROR] location: class
org.apache.hadoop.hive.shims.Hadoop23Shims.HdfsEncryptionShim
07:00:02 2017/04/25 14:00:02 INFO : [ERROR]
/grid/0/jenkins/workspace/HDP-parallel-centos6/SOURCES/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java:[1195,47]
cannot find symbol
07:00:02 2017/04/25 14:00:02 INFO : [ERROR] symbol: class EncryptionZone
07:00:02 2017/04/25 14:00:02 INFO : [ERROR] location: class
org.apache.hadoop.hive.shims.Hadoop23Shims.HdfsEncryptionShim
07:00:02 2017/04/25 14:00:02 INFO : [ERROR]
/grid/0/jenkins/workspace/HDP-parallel-centos6/SOURCES/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java:[1195,69]
cannot find symbol
07:00:02 2017/04/25 14:00:02 INFO : [ERROR] symbol: class EncryptionZone
07:00:02 2017/04/25 14:00:02 INFO : [ERROR] location: class
org.apache.hadoop.hive.shims.Hadoop23Shims.HdfsEncryptionShim
07:00:02 2017/04/25 14:00:02 INFO : [ERROR]
/grid/0/jenkins/workspace/HDP-parallel-centos6/SOURCES/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java:[570,23]
cannot access org.apache.hadoop.hdfs.DistributedFileSystem
...
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
