Download patch from jira : https://issues.apache.org/jira/i#browse/HADOOP-9922
Thanks & Regards Rohith Sharma K S From: Venkat Ramakrishnan [mailto:venkat.archit...@gmail.com] Sent: 10 February 2015 17:06 To: user@hadoop.apache.org Subject: Re: Error with winutils.sln Thank you Rohit. Could you please point me to the documentation/information/location related to Hadoop's 9922 patch? Thx, Venkat. On Tue, Feb 10, 2015 at 4:51 PM, Rohith Sharma K S <rohithsharm...@huawei.com<mailto:rohithsharm...@huawei.com>> wrote: There are some issues for compiling Hadoop in win32 platform. Even I am facing same issues. I think it is explicitly removed the support. But It is possible to compile successfully by tweaking some of the files. Follow the below instructions 1. Apply the patch HADOOP-9922.patch to your 2.6 version patch –p1 < HADOOP-9922.patch 2. Replace “Release|x64” with “Release|Win32” in $HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln 3. Replace “x64” with “Win32” in $HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\winutils.vcxproj and $HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\libwinutils.vcxproj If in your machine native compilation does not happen because of cmake not installed or any other reason then you will face issue while compiling hdfs project. So, for the sake of compiling you can skip native compilation at hdfs. 4. To skip native compilation, add “<skip>${skipTests}</skip>” or “<skip>true</skip>” in $HADOOP_HOME \hadoop-hdfs-project\hadoop-hdfs\pom.xml. <configuration> <skip>${skipTests}</skip> <target> <mkdir dir="${project.build.directory}/native"/> Note : there are 2 occurrences, you add at both 2 occurrence And compile using “mvn clean install –DskipTests” Hope this will help to compile.. enjoy with Hadoop!!! Thanks & Regards Rohith Sharma K S From: Venkat Ramakrishnan [mailto:venkat.archit...@gmail.com<mailto:venkat.archit...@gmail.com>] Sent: 10 February 2015 16:22 To: user@hadoop.apache.org<mailto:user@hadoop.apache.org> Subject: Error with winutils.sln Hello, I'm getting the following error while compiling with Windows 7 (32 bit). I have set the Platform as Win32. The error complains about solution configuration being different from winutils.sln: . . . . [DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from plugin realm ClassRealm[plugin>org.codehaus.mojo:exec-maven-plugin:1.2, parent: sun.misc.Launcher$AppClassLoader@647e05<mailto:sun.misc.Launcher$AppClassLoader@647e05>] [DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec' with basic configurator --> [DEBUG] (f) arguments = [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln, /nologo, /p:Configuration=Release, /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/, /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/, /p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml] [DEBUG] (f) basedir = D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common [DEBUG] (f) classpathScope = runtime [DEBUG] (f) executable = msbuild [DEBUG] (f) longClasspath = false [DEBUG] (f) project = MavenProject: org.apache.hadoop:hadoop-common:2.6.0 @ D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml [DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72<mailto:org.apache.maven.execution.MavenSession@157dc72> [DEBUG] (f) skip = false [DEBUG] -- end configuration -- [DEBUG] Executing command line: msbuild D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln /nologo /p:Configuration=Release /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/ /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/ /p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml Build started 07-02-2015 09:55:21. Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" on node 1 (default targets). D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln] Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default targets) -- FAILED. Build FAILED. "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default target) (1) -> (ValidateSolutionConfiguration target) -> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln] 0 Warning(s) 1 Error(s) Time Elapsed 00:00:04.41 [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop Main ................................. SUCCESS [ 5.314 s] [INFO] Apache Hadoop Project POM .......................... SUCCESS [ 3.756 s] [INFO] Apache Hadoop Annotations .......................... SUCCESS [ 7.977 s] [INFO] Apache Hadoop Assemblies ........................... SUCCESS [ 0.312 s] [INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [ 4.561 s] [INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [ 10.205 s] [INFO] Apache Hadoop MiniKDC .............................. SUCCESS [ 7.418 s] [INFO] Apache Hadoop Auth ................................. SUCCESS [ 10.640 s] [INFO] Apache Hadoop Auth Examples ........................ SUCCESS [ 8.438 s] [INFO] Apache Hadoop Common ............................... FAILURE [01:04 min] [INFO] Apache Hadoop NFS .................................. SKIPPED [INFO] Apache Hadoop KMS .................................. SKIPPED [INFO] Apache Hadoop Common Project ....................... SKIPPED [INFO] Apache Hadoop HDFS ................................. SKIPPED [INFO] Apache Hadoop HttpFS ............................... SKIPPED [INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED [INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED [INFO] Apache Hadoop HDFS Project ......................... SKIPPED [INFO] hadoop-yarn ........................................ SKIPPED [INFO] hadoop-yarn-api .................................... SKIPPED [INFO] hadoop-yarn-common ................................. SKIPPED [INFO] hadoop-yarn-server ................................. SKIPPED [INFO] hadoop-yarn-server-common .......................... SKIPPED [INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED [INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED [INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED [INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED [INFO] hadoop-yarn-server-tests ........................... SKIPPED [INFO] hadoop-yarn-client ................................. SKIPPED [INFO] hadoop-yarn-applications ........................... SKIPPED [INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED [INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED [INFO] hadoop-yarn-site ................................... SKIPPED [INFO] hadoop-yarn-registry ............................... SKIPPED [INFO] hadoop-yarn-project ................................ SKIPPED [INFO] hadoop-mapreduce-client ............................ SKIPPED [INFO] hadoop-mapreduce-client-core ....................... SKIPPED [INFO] hadoop-mapreduce-client-common ..................... SKIPPED [INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED [INFO] hadoop-mapreduce-client-app ........................ SKIPPED [INFO] hadoop-mapreduce-client-hs ......................... SKIPPED [INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED [INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED [INFO] Apache Hadoop MapReduce Examples ................... SKIPPED [INFO] hadoop-mapreduce ................................... SKIPPED [INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED [INFO] Apache Hadoop Distributed Copy ..................... SKIPPED [INFO] Apache Hadoop Archives ............................. SKIPPED [INFO] Apache Hadoop Rumen ................................ SKIPPED [INFO] Apache Hadoop Gridmix .............................. SKIPPED [INFO] Apache Hadoop Data Join ............................ SKIPPED [INFO] Apache Hadoop Ant Tasks ............................ SKIPPED [INFO] Apache Hadoop Extras ............................... SKIPPED [INFO] Apache Hadoop Pipes ................................ SKIPPED [INFO] Apache Hadoop OpenStack support .................... SKIPPED [INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED [INFO] Apache Hadoop Client ............................... SKIPPED [INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED [INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED [INFO] Apache Hadoop Tools Dist ........................... SKIPPED [INFO] Apache Hadoop Tools ................................ SKIPPED [INFO] Apache Hadoop Distribution ......................... SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 02:07 min [INFO] Finished at: 2015-02-07T09:55:26+05:30 [INFO] Final Memory: 55M/151M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed. Process exited with an error: 1(Exit value: 1) -> [Help 1] org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed. at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80) at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51) at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120) at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347) at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154) at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582) at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214) at org.apache.maven.cli.MavenCli.main(MavenCli.java:158) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:483) at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289) at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229) at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415) at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356) Caused by: org.apache.maven.plugin.MojoExecutionException: Command execution failed. at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:345) at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208) ... 19 more Caused by: org.apache.commons.exec.ExecuteException: Process exited with an error: 1(Exit value: 1) at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346) at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149) at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:589) at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:335) ... 21 more [ERROR] [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :hadoop-common Can someone please tell me how to correct this error and move forward? Thanks, Venkat.
