Hi Abe, Thanks for your e-mail. Compilation problem is solved now. The reason for it is that sqoop2 branch still uses the old version 3.0 of maven-site-plugin. It should be changed to 3.3.
Sqoop2 branch is using the same outdated version in docs/pom.xml<https://github.com/apache/sqoop/blob/0eb2352411a60073591ed0f51d0f5673c216d6b9/docs/pom.xml#L58> : <groupId>org.apache.maven.plugins</groupId> <artifactId>maven-site-plugin</artifactId> <version>3.0-beta-3</version> This solution was found by Joe (http://stackoverflow.com/users/733345/joe) and is described here: http://stackoverflow.com/questions/22036248/which-maven-version-i-need-to-build-sqoop2/22038499#22038499 cheers, Dmitri On Wed, Feb 26, 2014 at 9:28 PM, Abraham Elmahrek <[email protected]> wrote: > Hey there, > > For your compilation issues, could you try 'mvn install' first? This > should put some of the missing jars into your local repository for 'mvn > compile' to pick up. > > -Abe > > > On Wed, Feb 26, 2014 at 1:12 AM, dokondr <[email protected]> wrote: > >> Please help to build Sqoop2 from source. I use Maven 3.2.1 on CentOS 6.5. >> When I try to compile Sqoop2 with command: >> >> mvn compile >> >> I get exception resulting from: >> >> missing org.apache.sqoop:sqoop-core:test-jar:tests:2.0.0-SNAPSHOT >> >> >> When I try to build Sqoop2 with command: >> >> mvn package -Pbinary >> >> I get exception resulting from: >> >> Missing org/sonatype/aether/graph/DependencyFilter >> >> Any ideas? >> >> Detailed exception logs: >> >> *** Compile *** >> >> $ mvn compile -Dhadoop.profile=200 >> >> [INFO] Scanning for projects... >> [WARNING] >> [WARNING] Some problems were encountered while building the effective model >> for org.apache.sqoop:sqoop-common:jar:2.0.0-SNAPSHOT >> [WARNING] 'build.plugins.plugin.version' for >> org.codehaus.mojo:build-helper-maven-plugin is missing. @ line 73, column 15 >> [WARNING] >> [WARNING] It is highly recommended to fix these problems because they >> threaten the stability of your build. >> [WARNING] >> [WARNING] For this reason, future Maven versions might no longer support >> building such malformed projects. >> [WARNING] >> [INFO] >> ------------------------------------------------------------------------ >> [INFO] Reactor Build Order: >> [INFO] >> [INFO] Sqoop >> [INFO] Sqoop Common >> [INFO] Sqoop SPI >> [INFO] Sqoop Core >> [INFO] Sqoop Repository >> [INFO] Sqoop Derby Repository >> [INFO] Sqoop Tools >> [INFO] Sqoop Execution Engines >> [INFO] Sqoop Mapreduce Execution Engine >> [INFO] Sqoop Submission Engines >> [INFO] Sqoop Mapreduce Submission Engine >> [INFO] Sqoop Connectors >> [INFO] Sqoop Connector SDK >> [INFO] Sqoop Generic JDBC Connector >> [INFO] Sqoop Server >> [INFO] Sqoop Client >> [INFO] Sqoop Shell >> [INFO] Sqoop Documentation >> [INFO] Sqoop Tomcat additions >> [INFO] Sqoop Distribution >> [INFO] Sqoop Integration Tests >> [INFO] >> [INFO] Using the builder >> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder >> with a thread count of 1 >> [INFO] >> [INFO] >> ------------------------------------------------------------------------ >> [INFO] Building Sqoop 2.0.0-SNAPSHOT >> [INFO] >> ------------------------------------------------------------------------ >> [INFO] >> [INFO] --- maven-remote-resources-plugin:1.1:process (default) @ sqoop --- >> [INFO] Setting property: classpath.resource.loader.class => >> 'org.codehaus.plexus.velocity.ContextClassLoaderResourceLoader'. >> [INFO] Setting property: velocimacro.messages.on => 'false'. >> [INFO] Setting property: resource.loader => 'classpath'. >> [INFO] Setting property: resource.manager.logwhenfound => 'false'. >> [INFO] >> [INFO] >> ------------------------------------------------------------------------ >> [INFO] Building Sqoop Common 2.0.0-SNAPSHOT >> [INFO] >> ------------------------------------------------------------------------ >> [INFO] >> [INFO] --- maven-antrun-plugin:1.6:run (save-version) @ sqoop-common --- >> [INFO] Executing tasks >> >> main: >> [INFO] Executed tasks >> [INFO] >> [INFO] --- build-helper-maven-plugin:1.8:add-source (add-source) @ >> sqoop-common --- >> [INFO] Source directory: >> /home/dk/wks/sqoop2/common/target/generated-sources/java added. >> [INFO] >> [INFO] --- maven-remote-resources-plugin:1.1:process (default) @ >> sqoop-common --- >> [INFO] >> [INFO] --- maven-resources-plugin:2.4.3:resources (default-resources) @ >> sqoop-common --- >> [INFO] Using 'UTF-8' encoding to copy filtered resources. >> [INFO] skip non existing resourceDirectory >> /home/dk/wks/sqoop2/common/src/main/resources >> [INFO] Copying 3 resources >> [INFO] >> [INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ >> sqoop-common --- >> [INFO] Nothing to compile - all classes are up to date >> [INFO] >> [INFO] >> ------------------------------------------------------------------------ >> [INFO] Building Sqoop SPI 2.0.0-SNAPSHOT >> [INFO] >> ------------------------------------------------------------------------ >> [INFO] >> [INFO] --- maven-remote-resources-plugin:1.1:process (default) @ sqoop-spi >> --- >> [INFO] >> [INFO] --- maven-resources-plugin:2.4.3:resources (default-resources) @ >> sqoop-spi --- >> [INFO] Using 'UTF-8' encoding to copy filtered resources. >> [INFO] skip non existing resourceDirectory >> /home/dk/wks/sqoop2/spi/src/main/resources >> [INFO] Copying 3 resources >> [INFO] >> [INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ sqoop-spi >> --- >> [INFO] Nothing to compile - all classes are up to date >> [INFO] >> [INFO] >> ------------------------------------------------------------------------ >> [INFO] Building Sqoop Core 2.0.0-SNAPSHOT >> [INFO] >> ------------------------------------------------------------------------ >> [INFO] >> [INFO] --- maven-remote-resources-plugin:1.1:process (default) @ sqoop-core >> --- >> [INFO] >> [INFO] --- maven-resources-plugin:2.4.3:resources (default-resources) @ >> sqoop-core --- >> [INFO] Using 'UTF-8' encoding to copy filtered resources. >> [INFO] Copying 1 resource >> [INFO] Copying 3 resources >> [INFO] >> [INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ >> sqoop-core --- >> [INFO] Nothing to compile - all classes are up to date >> [INFO] >> [INFO] >> ------------------------------------------------------------------------ >> [INFO] Building Sqoop Repository 2.0.0-SNAPSHOT >> [INFO] >> ------------------------------------------------------------------------ >> [INFO] >> [INFO] --- maven-remote-resources-plugin:1.1:process (default) @ repository >> --- >> [INFO] >> [INFO] >> ------------------------------------------------------------------------ >> [INFO] Building Sqoop Derby Repository 2.0.0-SNAPSHOT >> [INFO] >> ------------------------------------------------------------------------ >> [INFO] >> [INFO] --- maven-remote-resources-plugin:1.1:process (default) @ >> sqoop-repository-derby --- >> [INFO] >> ------------------------------------------------------------------------ >> [INFO] Reactor Summary: >> [INFO] >> [INFO] Sqoop ............................................. SUCCESS [ 1.220 >> s] >> [INFO] Sqoop Common ...................................... SUCCESS [ 2.352 >> s] >> [INFO] Sqoop SPI ......................................... SUCCESS [ 0.106 >> s] >> [INFO] Sqoop Core ........................................ SUCCESS [ 0.365 >> s] >> [INFO] Sqoop Repository .................................. SUCCESS [ 0.073 >> s] >> [INFO] Sqoop Derby Repository ............................ FAILURE [ 0.257 >> s] >> [INFO] Sqoop Tools ....................................... SKIPPED >> [INFO] Sqoop Execution Engines ........................... SKIPPED >> [INFO] Sqoop Mapreduce Execution Engine .................. SKIPPED >> [INFO] Sqoop Submission Engines .......................... SKIPPED >> [INFO] Sqoop Mapreduce Submission Engine ................. SKIPPED >> [INFO] Sqoop Connectors .................................. SKIPPED >> [INFO] Sqoop Connector SDK ............................... SKIPPED >> [INFO] Sqoop Generic JDBC Connector ...................... SKIPPED >> [INFO] Sqoop Server ...................................... SKIPPED >> [INFO] Sqoop Client ...................................... SKIPPED >> [INFO] Sqoop Shell ....................................... SKIPPED >> [INFO] Sqoop Documentation ............................... SKIPPED >> [INFO] Sqoop Tomcat additions ............................ SKIPPED >> [INFO] Sqoop Distribution ................................ SKIPPED >> [INFO] Sqoop Integration Tests ........................... SKIPPED >> [INFO] >> ------------------------------------------------------------------------ >> [INFO] BUILD FAILURE >> [INFO] >> ------------------------------------------------------------------------ >> [INFO] Total time: 5.639 s >> [INFO] Finished at: 2014-02-25T18:08:27+04:00 >> [INFO] Final Memory: 17M/119M >> [INFO] >> ------------------------------------------------------------------------ >> [ERROR] Failed to execute goal >> org.apache.maven.plugins:maven-remote-resources-plugin:1.1:process (default) >> on project sqoop-repository-derby: Failed to resolve dependencies for one or >> more projects in the reactor. Reason: Missing: >> [ERROR] ---------- >> [ERROR] 1) org.apache.sqoop:sqoop-core:test-jar:tests:2.0.0-SNAPSHOT >> [ERROR] >> [ERROR] Try downloading the file manually from the project website. >> [ERROR] >> [ERROR] Then, install it using the command: >> [ERROR] mvn install:install-file -DgroupId=org.apache.sqoop >> -DartifactId=sqoop-core -Dversion=2.0.0-SNAPSHOT -Dclassifier=tests >> -Dpackaging=test-jar -Dfile=/path/to/file >> [ERROR] >> [ERROR] Alternatively, if you host your own repository you can deploy the >> file there: >> [ERROR] mvn deploy:deploy-file -DgroupId=org.apache.sqoop >> -DartifactId=sqoop-core -Dversion=2.0.0-SNAPSHOT -Dclassifier=tests >> -Dpackaging=test-jar -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id] >> [ERROR] >> [ERROR] Path to dependency: >> [ERROR] 1) >> org.apache.sqoop.repository:sqoop-repository-derby:jar:2.0.0-SNAPSHOT >> [ERROR] 2) org.apache.sqoop:sqoop-core:test-jar:tests:2.0.0-SNAPSHOT >> [ERROR] >> [ERROR] ---------- >> [ERROR] 1 required artifact is missing. >> [ERROR] >> [ERROR] for artifact: >> [ERROR] org.apache.sqoop.repository:sqoop-repository-derby:jar:2.0.0-SNAPSHOT >> [ERROR] >> [ERROR] from the specified remote repositories: >> [ERROR] apache.snapshots (http://repository.apache.org/snapshots, >> releases=false, snapshots=true), >> [ERROR] central (http://repo.maven.apache.org/maven2, releases=true, >> snapshots=false) >> [ERROR] -> [Help 1] >> [ERROR] >> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e >> switch. >> [ERROR] Re-run Maven using the -X switch to enable full debug logging. >> [ERROR] >> [ERROR] For more information about the errors and possible solutions, please >> read the following articles: >> [ERROR] [Help 1] >> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException >> [ERROR] >> [ERROR] After correcting the problems, you can resume the build with the >> command >> [ERROR] mvn <goals> -rf :sqoop-repository-derby >> >> >> *** Build *** >> >> mvn package -Pbinary >> >> [ERROR] Failed to execute goal >> org.apache.maven.plugins:maven-site-plugin:3.0-beta-3:site >> (packaging-documentation) on project sqoop-docs: Execution >> packaging-documentation of goal >> org.apache.maven.plugins:maven-site-plugin:3.0-beta-3:site failed: A >> required class was missing while executing >> org.apache.maven.plugins:maven-site-plugin:3.0-beta-3:site: >> org/sonatype/aether/graph/DependencyFilter >> [ERROR] ----------------------------------------------------- >> [ERROR] realm = >> plugin>org.apache.maven.plugins:maven-site-plugin:3.0-beta-3 >> [ERROR] strategy = org.codehaus.plexus.classworlds.strategy.SelfFirstStrategy >> [ERROR] urls[0] = >> file:/home/dk/.m2/repository/org/apache/maven/plugins/maven-site-plugin/3.0-beta-3/maven-site-plugin-3.0-beta-3.jar >> [ERROR] urls[1] = >> file:/home/dk/.m2/repository/org/apache/maven/reporting/maven-reporting-api/3.0/maven-reporting-api-3.0.jar >> [ERROR] urls[2] = >> file:/home/dk/.m2/repository/org/codehaus/plexus/plexus-interpolation/1.14/plexus-interpolation-1.14.jar >> [ERROR] urls[3] = >> file:/home/dk/.m2/repository/org/sonatype/sisu/sisu-inject-bean/1.4.2/sisu-inject-bean-1.4.2.jar >> [ERROR] urls[4] = >> file:/home/dk/.m2/repository/org/sonatype/sisu/sisu-guice/2.1.7/sisu-guice-2.1.7-noaop.jar >> [ERROR] urls[5] = >> file:/home/dk/.m2/repository/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar >> [ERROR] urls[6] = >> file:/home/dk/.m2/repository/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.jar >> [ERROR] urls[7] = >> file:/home/dk/.m2/repository/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.jar >> [ERROR] urls[8] = >> file:/home/dk/.m2/repository/org/sonatype/aether/aether-util/1.7/aether-util-1.7.jar >> [ERROR] urls[9] = >> file:/home/dk/.m2/repository/org/apache/maven/doxia/doxia-sink-api/1.1.3/doxia-sink-api-1.1.3.jar >> [ERROR] urls[10] = >> file:/home/dk/.m2/repository/org/apache/maven/doxia/doxia-logging-api/1.1.3/doxia-logging-api-1.1.3.jar >> [ERROR] urls[11] = >> file:/home/dk/.m2/repository/org/apache/maven/doxia/doxia-core/1.1.3/doxia-core-1.1.3.jar >> [ERROR] urls[12] = >> file:/home/dk/.m2/repository/xerces/xercesImpl/2.9.1/xercesImpl-2.9.1.jar >> [ERROR] urls[13] = >> file:/home/dk/.m2/repository/xml-apis/xml-apis/1.3.04/xml-apis-1.3.04.jar >> [ERROR] urls[14] = >> file:/home/dk/.m2/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar >> [ERROR] urls[15] = >> file:/home/dk/.m2/repository/commons-codec/commons-codec/1.2/commons-codec-1.2.jar >> [ERROR] urls[16] = >> file:/home/dk/.m2/repository/org/apache/maven/doxia/doxia-module-xhtml/1.1.3/doxia-module-xhtml-1.1.3.jar >> [ERROR] urls[17] = >> file:/home/dk/.m2/repository/org/apache/maven/doxia/doxia-module-apt/1.1.3/doxia-module-apt-1.1.3.jar >> [ERROR] urls[18] = >> file:/home/dk/.m2/repository/org/apache/maven/doxia/doxia-module-xdoc/1.1.3/doxia-module-xdoc-1.1.3.jar >> [ERROR] urls[19] = >> file:/home/dk/.m2/repository/org/apache/maven/doxia/doxia-module-fml/1.1.3/doxia-module-fml-1.1.3.jar >> [ERROR] urls[20] = >> file:/home/dk/.m2/repository/javax/servlet/servlet-api/2.5/servlet-api-2.5.jar >> [ERROR] urls[21] = >> file:/home/dk/.m2/repository/org/apache/maven/doxia/doxia-decoration-model/1.1.3/doxia-decoration-model-1.1.3.jar >> [ERROR] urls[22] = >> file:/home/dk/.m2/repository/org/apache/maven/doxia/doxia-site-renderer/1.1.3/doxia-site-renderer-1.1.3.jar >> [ERROR] urls[23] = >> file:/home/dk/.m2/repository/org/apache/velocity/velocity/1.5/velocity-1.5.jar >> [ERROR] urls[24] = file:/home/dk/.m2/repository/oro/oro/2.0.8/oro-2.0.8.jar >> [ERROR] urls[25] = >> file:/home/dk/.m2/repository/commons-collections/commons-collections/3.2/commons-collections-3.2.jar >> [ERROR] urls[26] = >> file:/home/dk/.m2/repository/org/codehaus/plexus/plexus-velocity/1.1.8/plexus-velocity-1.1.8.jar >> [ERROR] urls[27] = >> file:/home/dk/.m2/repository/org/apache/maven/shared/maven-doxia-tools/1.2.1/maven-doxia-tools-1.2.1.jar >> [ERROR] urls[28] = >> file:/home/dk/.m2/repository/org/apache/maven/wagon/wagon-file/1.0-beta-6/wagon-file-1.0-beta-6.jar >> [ERROR] urls[29] = >> file:/home/dk/.m2/repository/org/apache/maven/wagon/wagon-http-lightweight/1.0-beta-6/wagon-http-lightweight-1.0-beta-6.jar >> [ERROR] urls[30] = >> file:/home/dk/.m2/repository/org/apache/maven/wagon/wagon-http-shared/1.0-beta-6/wagon-http-shared-1.0-beta-6.jar >> [ERROR] urls[31] = >> file:/home/dk/.m2/repository/nekohtml/xercesMinimal/1.9.6.2/xercesMinimal-1.9.6.2.jar >> [ERROR] urls[32] = >> file:/home/dk/.m2/repository/nekohtml/nekohtml/1.9.6.2/nekohtml-1.9.6.2.jar >> [ERROR] urls[33] = >> file:/home/dk/.m2/repository/org/apache/maven/wagon/wagon-ssh/1.0-beta-6/wagon-ssh-1.0-beta-6.jar >> [ERROR] urls[34] = >> file:/home/dk/.m2/repository/com/jcraft/jsch/0.1.38/jsch-0.1.38.jar >> [ERROR] urls[35] = >> file:/home/dk/.m2/repository/org/apache/maven/wagon/wagon-ssh-common/1.0-beta-6/wagon-ssh-common-1.0-beta-6.jar >> [ERROR] urls[36] = >> file:/home/dk/.m2/repository/org/codehaus/plexus/plexus-interactivity-api/1.0-alpha-6/plexus-interactivity-api-1.0-alpha-6.jar >> [ERROR] urls[37] = >> file:/home/dk/.m2/repository/org/apache/maven/wagon/wagon-ssh-external/1.0-beta-6/wagon-ssh-external-1.0-beta-6.jar >> [ERROR] urls[38] = >> file:/home/dk/.m2/repository/org/apache/maven/wagon/wagon-ftp/1.0-beta-6/wagon-ftp-1.0-beta-6.jar >> [ERROR] urls[39] = >> file:/home/dk/.m2/repository/commons-net/commons-net/2.0/commons-net-2.0.jar >> [ERROR] urls[40] = >> file:/home/dk/.m2/repository/org/apache/maven/wagon/wagon-webdav-jackrabbit/1.0-beta-6/wagon-webdav-jackrabbit-1.0-beta-6.jar >> [ERROR] urls[41] = >> file:/home/dk/.m2/repository/org/apache/jackrabbit/jackrabbit-webdav/1.5.0/jackrabbit-webdav-1.5.0.jar >> [ERROR] urls[42] = >> file:/home/dk/.m2/repository/org/apache/jackrabbit/jackrabbit-jcr-commons/1.5.0/jackrabbit-jcr-commons-1.5.0.jar >> [ERROR] urls[43] = >> file:/home/dk/.m2/repository/org/apache/maven/wagon/wagon-scm/1.0-beta-6/wagon-scm-1.0-beta-6.jar >> [ERROR] urls[44] = >> file:/home/dk/.m2/repository/org/apache/maven/scm/maven-scm-manager-plexus/1.0/maven-scm-manager-plexus-1.0.jar >> [ERROR] urls[45] = >> file:/home/dk/.m2/repository/org/apache/maven/scm/maven-scm-api/1.4/maven-scm-api-1.4.jar >> [ERROR] urls[46] = >> file:/home/dk/.m2/repository/org/apache/maven/scm/maven-scm-provider-svnexe/1.4/maven-scm-provider-svnexe-1.4.jar >> [ERROR] urls[47] = >> file:/home/dk/.m2/repository/org/apache/maven/scm/maven-scm-provider-svn-commons/1.4/maven-scm-provider-svn-commons-1.4.jar >> [ERROR] urls[48] = >> file:/home/dk/.m2/repository/regexp/regexp/1.3/regexp-1.3.jar >> [ERROR] urls[49] = >> file:/home/dk/.m2/repository/org/codehaus/plexus/plexus-archiver/1.0-alpha-9/plexus-archiver-1.0-alpha-9.jar >> [ERROR] urls[50] = >> file:/home/dk/.m2/repository/org/codehaus/plexus/plexus-io/1.0-alpha-1/plexus-io-1.0-alpha-1.jar >> [ERROR] urls[51] = >> file:/home/dk/.m2/repository/org/codehaus/plexus/plexus-i18n/1.0-beta-7/plexus-i18n-1.0-beta-7.jar >> [ERROR] urls[52] = >> file:/home/dk/.m2/repository/org/codehaus/plexus/plexus-utils/1.5.10/plexus-utils-1.5.10.jar >> [ERROR] urls[53] = >> file:/home/dk/.m2/repository/org/mortbay/jetty/jetty/6.1.25/jetty-6.1.25.jar >> [ERROR] urls[54] = >> file:/home/dk/.m2/repository/org/mortbay/jetty/jetty-util/6.1.25/jetty-util-6.1.25.jar >> [ERROR] urls[55] = >> file:/home/dk/.m2/repository/org/mortbay/jetty/servlet-api/2.5-20081211/servlet-api-2.5-20081211.jar >> [ERROR] urls[56] = >> file:/home/dk/.m2/repository/org/slf4j/slf4j-api/1.5.3/slf4j-api-1.5.3.jar >> [ERROR] urls[57] = >> file:/home/dk/.m2/repository/org/slf4j/slf4j-simple/1.5.3/slf4j-simple-1.5.3.jar >> [ERROR] urls[58] = >> file:/home/dk/.m2/repository/org/slf4j/jcl-over-slf4j/1.6.1/jcl-over-slf4j-1.6.1.jar >> [ERROR] urls[59] = >> file:/home/dk/.m2/repository/commons-lang/commons-lang/2.5/commons-lang-2.5.jar >> [ERROR] urls[60] = >> file:/home/dk/.m2/repository/commons-io/commons-io/1.4/commons-io-1.4.jar >> [ERROR] urls[61] = >> file:/home/dk/.m2/repository/junit/junit/4.8.1/junit-4.8.1.jar >> [ERROR] Number of foreign imports: 1 >> [ERROR] import: Entry[import from realm ClassRealm[maven.api, parent: null]] >> [ERROR] >> [ERROR] -----------------------------------------------------: >> org.sonatype.aether.graph.DependencyFilter >> [ERROR] -> [Help 1] >> [ERROR] >> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e >> switch. >> [ERROR] Re-run Maven using the -X switch to enable full debug logging. >> [ERROR] >> [ERROR] For more information about the errors and possible solutions, please >> read the following articles: >> [ERROR] [Help 1] >> http://cwiki.apache.org/confluence/display/MAVEN/AetherClassNotFound >> [ERROR] >> [ERROR] After correcting the problems, you can resume the build with the >> command >> [ERROR] mvn <goals> -rf :sqoop-docs >> >> >
