[
https://issues.apache.org/jira/browse/HADOOP-3315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12636476#action_12636476
]
Amir Youssefi commented on HADOOP-3315:
---------------------------------------
Row ID needs to be changed to Row Number (or Sequence Number). Row ID + 1
doesn't have a meaning whereas Row Number + 1 is next row.
- Row ID carries meaning of being unique. Like a primary key and nothing else.
- Row Number/Sequence Number carries uniqueness and having position/sequence.
Row Number + 1 is next row. It helps creating splits.
Also as discussed, we could ahve the counter relative to begining of DataBlock
or dynamically any time a Scanner is created. Absolute (counter starts from
first row of TFile and continues across data blocks) has the vote so far.
> New binary file format
> ----------------------
>
> Key: HADOOP-3315
> URL: https://issues.apache.org/jira/browse/HADOOP-3315
> Project: Hadoop Core
> Issue Type: New Feature
> Components: io
> Reporter: Owen O'Malley
> Assignee: Amir Youssefi
> Attachments: HADOOP-3315_20080908_TFILE_PREVIEW_WITH_LZO_TESTS.patch,
> HADOOP-3315_20080915_TFILE.patch, TFile Specification Final.pdf
>
>
> SequenceFile's block compression format is too complex and requires 4 codecs
> to compress or decompress. It would be good to have a file format that only
> needs
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
