[ https://issues.apache.org/jira/browse/HIVE-7378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268983#comment-14268983 ]
Chuan Jin commented on HIVE-7378: --------------------------------- I also encountered this problem, but zero copy is a new feature in hadoopshims. If you don't need it ,you can overpass it by removing this class and build again. Maybe using a higher version of hadoop to compile and build hive 0.13.1 is also a considerable choice. https://issues.apache.org/jira/browse/HIVE-6346 > Could not build hive 0.13.1 with hadoop 2.2.0 > --------------------------------------------- > > Key: HIVE-7378 > URL: https://issues.apache.org/jira/browse/HIVE-7378 > Project: Hive > Issue Type: Bug > Affects Versions: 0.13.1 > Reporter: John > > I attemped to build hive 0.13.1 with hadoop 2.2.0 and got a failure. > 1. Steps > a. set `hadoop-23.version' to 2.2.0 in main pom file > b. build with command `mvn clean install -DskipTests -Phadoop-2' > 2. Error Messages > [INFO] > ------------------------------------------------------------------------ > [INFO] Building Hive Shims 0.23 0.13.1 > [INFO] > ------------------------------------------------------------------------ > [INFO] > [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hive-shims-0.23 --- > [INFO] Deleting /home/apache/hive/shims/0.23/target > [INFO] Deleting /home/apache/hive/shims/0.23 (includes = [datanucleus.log, > derby.log], excludes = []) > [INFO] > [INFO] --- maven-remote-resources-plugin:1.5:process (default) @ > hive-shims-0.23 --- > [INFO] > [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ > hive-shims-0.23 --- > [INFO] Using 'UTF-8' encoding to copy filtered resources. > [INFO] skip non existing resourceDirectory > /home/apache/hive/shims/0.23/src/main/resources > [INFO] Copying 3 resources > [INFO] > [INFO] --- maven-antrun-plugin:1.7:run (define-classpath) @ hive-shims-0.23 > --- > [INFO] Executing tasks > main: > [INFO] Executed tasks > [INFO] > [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ > hive-shims-0.23 --- > [INFO] Compiling 4 source files to /home/apache/hive/shims/0.23/target/classes > [INFO] ------------------------------------------------------------- > [WARNING] COMPILATION WARNING : > [INFO] ------------------------------------------------------------- > [WARNING] > /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java: > > /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java > uses or overrides a deprecated API. > [WARNING] > /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java: > Recompile with -Xlint:deprecation for details. > [INFO] 2 warnings > [INFO] ------------------------------------------------------------- > [INFO] ------------------------------------------------------------- > [ERROR] COMPILATION ERROR : > [INFO] ------------------------------------------------------------- > [ERROR] > /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[25,28] > cannot find symbol > symbol: class ReadOption > location: package org.apache.hadoop.fs > [ERROR] > /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[28,28] > cannot find symbol > symbol: class ByteBufferPool > location: package org.apache.hadoop.io > [ERROR] > /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[29,37] > cannot find symbol > symbol: class DirectDecompressor > location: package org.apache.hadoop.io.compress > [ERROR] > /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[30,63] > cannot find symbol > symbol: class SnappyDirectDecompressor > location: class org.apache.hadoop.io.compress.snappy.SnappyDecompressor > [ERROR] > /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[32,59] > cannot find symbol > symbol: class ZlibDirectDecompressor > location: class org.apache.hadoop.io.compress.zlib.ZlibDecompressor > [ERROR] > /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[38,63] > cannot find symbol > symbol: class ByteBufferPool > location: class org.apache.hadoop.hive.shims.ZeroCopyShims > [ERROR] > /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[59,34] > cannot find symbol > symbol: class ReadOption > location: class org.apache.hadoop.hive.shims.ZeroCopyShims.ZeroCopyAdapter > [ERROR] > /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[61,34] > cannot find symbol > symbol: class ReadOption > location: class org.apache.hadoop.hive.shims.ZeroCopyShims.ZeroCopyAdapter > [ERROR] > /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[94,19] > cannot find symbol > symbol: class DirectDecompressor > location: class > org.apache.hadoop.hive.shims.ZeroCopyShims.DirectDecompressorAdapter > [ERROR] > /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[96,38] > cannot find symbol > symbol: class DirectDecompressor > location: class > org.apache.hadoop.hive.shims.ZeroCopyShims.DirectDecompressorAdapter > [ERROR] > /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[45,5] > method does not override or implement a method from a supertype > [ERROR] > /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[50,5] > method does not override or implement a method from a supertype > [ERROR] > /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[60,17] > cannot find symbol > symbol: class ReadOption > location: class org.apache.hadoop.hive.shims.ZeroCopyShims.ZeroCopyAdapter > [ERROR] > /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[62,13] > cannot find symbol > symbol: variable ReadOption > location: class org.apache.hadoop.hive.shims.ZeroCopyShims.ZeroCopyAdapter > [ERROR] > /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[75,15] > cannot find symbol > symbol: class ReadOption > location: class org.apache.hadoop.hive.shims.ZeroCopyShims.ZeroCopyAdapter > [ERROR] > /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[83,14] > cannot find symbol > symbol: method releaseBuffer(java.nio.ByteBuffer) > location: variable in of type org.apache.hadoop.fs.FSDataInputStream > [ERROR] > /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[107,5] > cannot find symbol > symbol: class DirectDecompressor > location: class org.apache.hadoop.hive.shims.ZeroCopyShims > [ERROR] > /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[110,26] > cannot find symbol > symbol: class ZlibDirectDecompressor > location: class org.apache.hadoop.hive.shims.ZeroCopyShims > [ERROR] > /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[114,26] > cannot find symbol > symbol: class ZlibDirectDecompressor > location: class org.apache.hadoop.hive.shims.ZeroCopyShims > [ERROR] > /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[118,26] > cannot find symbol > symbol: class SnappyDirectDecompressor > location: class org.apache.hadoop.hive.shims.ZeroCopyShims > [INFO] 20 errors > [INFO] ------------------------------------------------------------- > [INFO] > ------------------------------------------------------------------------ > [INFO] Reactor Summary: > [INFO] > [INFO] Hive .............................................. SUCCESS [2.371s] > [INFO] Hive Ant Utilities ................................ SUCCESS [1.769s] > [INFO] Hive Shims Common ................................. SUCCESS [1.020s] > [INFO] Hive Shims 0.20 ................................... SUCCESS [0.745s] > [INFO] Hive Shims Secure Common .......................... SUCCESS [1.039s] > [INFO] Hive Shims 0.20S .................................. SUCCESS [0.607s] > [INFO] Hive Shims 0.23 ................................... FAILURE [1.617s] > [INFO] Hive Shims ........................................ SKIPPED > [INFO] Hive Common ....................................... SKIPPED > [INFO] Hive Serde ........................................ SKIPPED > [INFO] Hive Metastore .................................... SKIPPED > [INFO] Hive Query Language ............................... SKIPPED > [INFO] Hive Service ...................................... SKIPPED > [INFO] Hive JDBC ......................................... SKIPPED > [INFO] Hive Beeline ...................................... SKIPPED > [INFO] Hive CLI .......................................... SKIPPED > [INFO] Hive Contrib ...................................... SKIPPED > [INFO] Hive HBase Handler ................................ SKIPPED > [INFO] Hive HCatalog ..................................... SKIPPED > [INFO] Hive HCatalog Core ................................ SKIPPED > [INFO] Hive HCatalog Pig Adapter ......................... SKIPPED > [INFO] Hive HCatalog Server Extensions ................... SKIPPED > [INFO] Hive HCatalog Webhcat Java Client ................. SKIPPED > [INFO] Hive HCatalog Webhcat ............................. SKIPPED > [INFO] Hive HCatalog HBase Storage Handler ............... SKIPPED > [INFO] Hive HCatalog Streaming ........................... SKIPPED > [INFO] Hive HWI .......................................... SKIPPED > [INFO] Hive ODBC ......................................... SKIPPED > [INFO] Hive Shims Aggregator ............................. SKIPPED > [INFO] Hive TestUtils .................................... SKIPPED > [INFO] Hive Packaging .................................... SKIPPED > [INFO] > ------------------------------------------------------------------------ > [INFO] BUILD FAILURE > [INFO] > ------------------------------------------------------------------------ > [INFO] Total time: 9.910s > [INFO] Finished at: Thu Jul 10 10:28:54 CST 2014 > [INFO] Final Memory: 47M/493M > [INFO] > ------------------------------------------------------------------------ > [ERROR] Failed to execute goal > org.apache.maven.plugins:maven-compiler-plugin:3.1:compile (default-compile) > on project hive-shims-0.23: Compilation failure: Compilation failure: > [ERROR] > /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[25,28] > cannot find symbol > [ERROR] symbol: class ReadOption > [ERROR] location: package org.apache.hadoop.fs > [ERROR] > /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[28,28] > cannot find symbol > [ERROR] symbol: class ByteBufferPool > [ERROR] location: package org.apache.hadoop.io > [ERROR] > /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[29,37] > cannot find symbol > [ERROR] symbol: class DirectDecompressor > [ERROR] location: package org.apache.hadoop.io.compress > [ERROR] > /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[30,63] > cannot find symbol > [ERROR] symbol: class SnappyDirectDecompressor > [ERROR] location: class > org.apache.hadoop.io.compress.snappy.SnappyDecompressor > [ERROR] > /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[32,59] > cannot find symbol > [ERROR] symbol: class ZlibDirectDecompressor > [ERROR] location: class org.apache.hadoop.io.compress.zlib.ZlibDecompressor > [ERROR] > /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[38,63] > cannot find symbol > [ERROR] symbol: class ByteBufferPool > [ERROR] location: class org.apache.hadoop.hive.shims.ZeroCopyShims > [ERROR] > /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[59,34] > cannot find symbol > [ERROR] symbol: class ReadOption > [ERROR] location: class > org.apache.hadoop.hive.shims.ZeroCopyShims.ZeroCopyAdapter > [ERROR] > /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[61,34] > cannot find symbol > [ERROR] symbol: class ReadOption > [ERROR] location: class > org.apache.hadoop.hive.shims.ZeroCopyShims.ZeroCopyAdapter > [ERROR] > /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[94,19] > cannot find symbol > [ERROR] symbol: class DirectDecompressor > [ERROR] location: class > org.apache.hadoop.hive.shims.ZeroCopyShims.DirectDecompressorAdapter > [ERROR] > /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[96,38] > cannot find symbol > [ERROR] symbol: class DirectDecompressor > [ERROR] location: class > org.apache.hadoop.hive.shims.ZeroCopyShims.DirectDecompressorAdapter > [ERROR] > /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[45,5] > method does not override or implement a method from a supertype > [ERROR] > /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[50,5] > method does not override or implement a method from a supertype > [ERROR] > /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[60,17] > cannot find symbol > [ERROR] symbol: class ReadOption > [ERROR] location: class > org.apache.hadoop.hive.shims.ZeroCopyShims.ZeroCopyAdapter > [ERROR] > /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[62,13] > cannot find symbol > [ERROR] symbol: variable ReadOption > [ERROR] location: class > org.apache.hadoop.hive.shims.ZeroCopyShims.ZeroCopyAdapter > [ERROR] > /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[75,15] > cannot find symbol > [ERROR] symbol: class ReadOption > [ERROR] location: class > org.apache.hadoop.hive.shims.ZeroCopyShims.ZeroCopyAdapter > [ERROR] > /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[83,14] > cannot find symbol > [ERROR] symbol: method releaseBuffer(java.nio.ByteBuffer) > [ERROR] location: variable in of type org.apache.hadoop.fs.FSDataInputStream > [ERROR] > /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[107,5] > cannot find symbol > [ERROR] symbol: class DirectDecompressor > [ERROR] location: class org.apache.hadoop.hive.shims.ZeroCopyShims > [ERROR] > /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[110,26] > cannot find symbol > [ERROR] symbol: class ZlibDirectDecompressor > [ERROR] location: class org.apache.hadoop.hive.shims.ZeroCopyShims > [ERROR] > /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[114,26] > cannot find symbol > [ERROR] symbol: class ZlibDirectDecompressor > [ERROR] location: class org.apache.hadoop.hive.shims.ZeroCopyShims > [ERROR] > /home/apache/hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/ZeroCopyShims.java:[118,26] > cannot find symbol > [ERROR] symbol: class SnappyDirectDecompressor > [ERROR] location: class org.apache.hadoop.hive.shims.ZeroCopyShims > [ERROR] -> [Help 1] > [ERROR] > [ERROR] To see the full stack trace of the errors, re-run Maven with the -e > switch. > [ERROR] Re-run Maven using the -X switch to enable full debug logging. > [ERROR] > [ERROR] For more information about the errors and possible solutions, please > read the following articles: > [ERROR] [Help 1] > http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException > [ERROR] > [ERROR] After correcting the problems, you can resume the build with the > command > [ERROR] mvn <goals> -rf :hive-shims-0.23 -- This message was sent by Atlassian JIRA (v6.3.4#6332)