[
https://issues.apache.org/jira/browse/HDFS-13362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16417665#comment-16417665
]
Jason Lowe commented on HDFS-13362:
-----------------------------------
Part of the problem with the excessive build time is that the build isn't being
performed in parallel. I noticed we're not using the cmake plugin but rather
invoking cmake and make directly via the ant plugin. Is there a good reason to
not using the cmake plugin like all the other native builds in the project do?
Doing so would automatically leverage parallel builds.
I tried forcing a parallel build manually by specifying -Dnative_make_args=-j4
but it failed with a missing ClientNamenodeProtocol.pb.h. Looks like the
dependencies aren't fully specified in the makefile, which may explain why we
can't use the cmake plugin. I think fixing automatic parallel builds would
significantly improve native build time on most setups.
> add a flag to skip the libhdfs++ build
> --------------------------------------
>
> Key: HDFS-13362
> URL: https://issues.apache.org/jira/browse/HDFS-13362
> Project: Hadoop HDFS
> Issue Type: Task
> Reporter: James Clampffer
> Priority: Minor
>
> libhdfs++ has significantly increased clean build times for the native client
> on trunk. This covers adding a flag that would let people build libhdfs
> without all of libhdfs++ if they don't need it; it should be built by default
> to maintain compatibility with as many environments as possible.
> Some thoughts:
> -The increase in compile time only impacts clean builds. Incremental
> rebuilds aren't significantly more expensive than they used to be if the code
> hasn't changed.
> -Compile times for libhdfs++ can most likely be reduced but that's a longer
> term project. boost::asio and tr1::optional are header-only libraries that
> are heavily templated so every compilation unit that includes them has to do
> a lot of parsing.
> Is it common to do completely clean builds frequently for interactive users?
> Are there opinions on what would be an acceptable compilation time?
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
