Hi, pal ! i cloned https://github.com/apache/incubator-spark repo and build with command mvn -Dyarn.version=2.2.0 -Dhadoop.version=2.2.0 -Pnew-yarn clean package
error : [INFO] --- scala-maven-plugin:3.1.5:compile (scala-compile-first) @ spark-core_2.10 --- [WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile [INFO] Using incremental compilation [INFO] Compiling 283 Scala sources and 17 Java sources to /home/hd/incubator-spark-master/core/target/scala-2.10/classes... [WARNING] /home/hd/incubator-spark-master/core/src/main/scala/org/apache/spark/api/python/PythonRDD.scala:213: non-variable type argument Array[Byte] in type pattern (Array[Byte], Array[Byte]) is unchecked since it is eliminated by erasure [WARNING] case pair: (Array[Byte], Array[Byte]) => [WARNING] ^ [WARNING] Class com.google.protobuf.Parser not found - continuing with a stub. [ERROR] error while loading RpcResponseHeaderProto, class file '/home/hd/.m2/repository/org/apache/hadoop/hadoop-common/2.2.0/hadoop-common-2.2.0.jar(org/apache/hadoop/ipc/protobuf/RpcHeaderProtos$RpcResponseHeaderProto.class)' is broken (class java.lang.NullPointerException/null) [WARNING] two warnings found [ERROR] one error found [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Spark Project Parent POM .......................... SUCCESS [2.568s] [INFO] Spark Project Core ................................ FAILURE [33.912s] [INFO] Spark Project Bagel ............................... SKIPPED [INFO] Spark Project Streaming ........................... SKIPPED [INFO] Spark Project ML Library .......................... SKIPPED [INFO] Spark Project Examples ............................ SKIPPED [INFO] Spark Project Tools ............................... SKIPPED [INFO] Spark Project REPL ................................ SKIPPED [INFO] Spark Project Assembly ............................ SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 37.056s could you give me some guide about how to build it with hadoop2.2.0 ? thx!
