Gautham Banasandra created HADOOP-17193:
-------------------------------------------

             Summary: Compile Hadoop on Windows natively
                 Key: HADOOP-17193
                 URL: https://issues.apache.org/jira/browse/HADOOP-17193
             Project: Hadoop Common
          Issue Type: Improvement
          Components: build, native
    Affects Versions: 3.1.3
         Environment: Windows 10
            Reporter: Gautham Banasandra


Hadoop compiles flawlessly on Linux whereas, one has to hack around to compile 
it on Windows. The reason is obvious, there's a very large proportion of C/C++ 
codebase that's written in a platform specific manner that's amenable to Linux.

Thus, compiling Hadoop on Windows involves using the MinGW or the Cygwin 
toolchains. This third party dependency might be seen as a risk for those who 
want to deploy Hadoop on Windows nodes in production. The primary reason for 
this is that the MinGW/Cygwin runtimes on Windows don't produce core dumps. 
Whereas the Visual C++ runtime is able to do so, which greatly enables 
debugging.

Another reason to use the Visual C++ compiler for compiling Hadoop on Windows 
is that Visual C++ is native to Windows and one will have access to a large 
collection of tools that can be used for instrumentation, telemetry and 
fine-tuning the settings of Hadoop to run better on Windows.

Modern C++ has a plethora of APIs that one can use to write safe, 
cross-platform code, which can be leveraged to refactor the existing Linux 
specific code, thereby enabling compilation on Windows using the native Visual 
C++ compiler.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org

Reply via email to