[ http://issues.apache.org/jira/browse/HADOOP-538?page=all ]
Arun C Murthy updated HADOOP-538:
---------------------------------
Attachment: HADOOP-538_20061005.tgz
Here is an updated patch incorporating the following:
* Completely integrated with GNU autotools (autoconf, automake, libtool) to
ease building of native-hadoop on a wide-variety of platforms.
* Use GNU libtool to create the actual native-hadoop library to ensure platform
specfic builds and also uses java.lang.System.loadLibrary consistently to
handle platform specific mappings.
* The 'fallback' feature and libhadoop-linux-i386.so provided by default as
discussed here.
* Complete integration with build.xml and autotools. I have put in 3 new
targets: compile-native, clean-native and package-native which need to be
called explicitly.
* I have also ensured that no 'generated files' are ever placed in src/native
directory; only in build/ to ensure 'ant clean' works as of today. This is
accomplished via 'vpath' tweaks to the Makefiles.
* Uses -Djava.library.path (in both bin/hadoop and build.xml) to help find the
native hadoop library.
I'd appreciate any feedback on any of the above; particularly since I'm a
autotools n00bie...
I haven't tested this on cygwin yet; on my todo list.
Doug -
* Could you please copy the attached libhadoop-linux-i386.so in
trunk/lib/native first before attempting to build native-hadoop?
* Also, please treat this as 'almost complete' again and hold off committing
it? I feel we should skip this patch for release 0.7... thanks!
> Implement a nio's 'direct buffer' based wrapper over zlib to improve
> performance of java.util.zip.{De|In}flater as a 'custom codec'
> -----------------------------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-538
> URL: http://issues.apache.org/jira/browse/HADOOP-538
> Project: Hadoop
> Issue Type: Improvement
> Affects Versions: 0.6.1
> Reporter: Arun C Murthy
> Assigned To: Arun C Murthy
> Fix For: 0.7.0
>
> Attachments: HADOOP-538.patch, HADOOP-538_20061005.tgz,
> HADOOP-538_benchmarks.tgz
>
>
> There has been more than one instance where java.util.zip's {De|In}flater
> classes perform unreliably, a simple wrapper over zlib-1.2.3 (latest stable)
> using java.nio.ByteBuffer (i.e. direct buffers) should go a long way in
> alleviating these woes.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
