[
https://issues.apache.org/jira/browse/HADOOP-1824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12562637#action_12562637
]
Arun C Murthy commented on HADOOP-1824:
---------------------------------------
bq. How is a java.io.InputStream passed and used in native code. The header
file represents it as a jobject which I tried casting to FILE * and reading, it
did not work as expected.
I'm not sure what exactly you are trying, but the way I implemented the native
codecs was to read data from the InputStream in the Java layer, put the data
into a direct-buffer and then pass it to the native zlib library.
The stream you are talking about is the handle to the zlib stream, which is
zlib specific. That just represents the state of the zlib stream.
bq. Can a native method call return structures that can be converted to java
objects ? If so how ?
I'm sure that can be done via some hoops, but would be quite involved (I think).
Some details here: http://java.sun.com/docs/books/jni/html/other.html#30942
JNI Documentation from Sun: http://java.sun.com/docs/books/jni/html/jniTOC.html
Hope that helps.
> want InputFormat for zip files
> ------------------------------
>
> Key: HADOOP-1824
> URL: https://issues.apache.org/jira/browse/HADOOP-1824
> Project: Hadoop Core
> Issue Type: New Feature
> Components: mapred
> Affects Versions: 0.15.2
> Reporter: Doug Cutting
> Attachments: ZipInputFormat_fixed.patch
>
>
> HDFS is inefficient with large numbers of small files. Thus one might pack
> many small files into large, compressed, archives. But, for efficient
> map-reduce operation, it is desireable to be able to split inputs into
> smaller chunks, with one or more small original file per split. The zip
> format, unlike tar, permits enumeration of files in the archive without
> scanning the entire archive. Thus a zip InputFormat could efficiently permit
> splitting large archives into splits that contain one or more archived files.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
