[
https://issues.apache.org/jira/browse/HADOOP-3315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12633826#action_12633826
]
stack commented on HADOOP-3315:
-------------------------------
I took a look at the new PDF doc (Haven't looked at the patch yet -- excuse me
if my questions are answered therein)
We would like to leverage TFile in hbase. memcmp-sort of keys won't work for
us. Will it be hard to add support for another comparator?
On page 8., the awkward-looking for-loop at the head of the page with its
isCursorAtEnd and advanceCursor has some justification in practicality, I
presume. otherwise why not use the hasNext/next Iterator common (java) idiom?
On the performance numbers above, how about adding in test of random accesses
into TFiles/SequenceFiles? (If you need a tool to to test random accessing,
the MapFilePerformanceEvaluation tool in hbase-test.jar might help:
http://svn.apache.org/viewvc/hadoop/hbase/trunk/src/test/org/apache/hadoop/hbase/MapFilePerformanceEvaluation.java?view=markup)
> New binary file format
> ----------------------
>
> Key: HADOOP-3315
> URL: https://issues.apache.org/jira/browse/HADOOP-3315
> Project: Hadoop Core
> Issue Type: New Feature
> Components: io
> Reporter: Owen O'Malley
> Assignee: Amir Youssefi
> Attachments: HADOOP-3315_20080908_TFILE_PREVIEW_WITH_LZO_TESTS.patch,
> HADOOP-3315_20080915_TFILE.patch, TFile Specification Final.pdf
>
>
> SequenceFile's block compression format is too complex and requires 4 codecs
> to compress or decompress. It would be good to have a file format that only
> needs
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
