[jira] [Created] (HBASE-5674) add support in HBase to overwrite hbase timestamp to a version number during major compaction

2012-03-29 Thread He Yongqiang (Created) (JIRA)
add support in HBase to overwrite hbase timestamp to a version number during 
major compaction
-

 Key: HBASE-5674
 URL: https://issues.apache.org/jira/browse/HBASE-5674
 Project: HBase
  Issue Type: Improvement
Reporter: He Yongqiang
Assignee: He Yongqiang


Right now, a millisecond-level timestamp is attached to every record. 
In our case, we only need a version number (mostly it will be just zero etc). A 
millisecond timestamp is too heavy to carry. We should add support to overwrite 
it to zero during major compaction. 
KVs before major compaction will remain using system timestamp. And this should 
be configurable, so that we should not mess up if the hbase timestamp is 
specified by application.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Created] (HBASE-5605) compression does not work in Store.java trunk

2012-03-20 Thread He Yongqiang (Created) (JIRA)
compression does not work in Store.java trunk
-

 Key: HBASE-5605
 URL: https://issues.apache.org/jira/browse/HBASE-5605
 Project: HBase
  Issue Type: Bug
Reporter: He Yongqiang
Assignee: He Yongqiang




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Created] (HBASE-5521) Move compression/decompression to an encoder specific encoding context

2012-03-05 Thread He Yongqiang (Created) (JIRA)
Move compression/decompression to an encoder specific encoding context
--

 Key: HBASE-5521
 URL: https://issues.apache.org/jira/browse/HBASE-5521
 Project: HBase
  Issue Type: Improvement
Reporter: He Yongqiang


As part of working on HBASE-5313, we want to add a new columnar 
encoder/decoder. It makes sense to move compression to be part of 
encoder/decoder:
1) a scanner for a columnar encoded block can do lazy decompression to a 
specific part of a key value object
2) avoid an extra bytes copy from encoder to hblock-writer. 

If there is no encoder specified for a writer, the HBlock.Writer will use a 
default compression-context to do something very similar to today's code.


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Created] (HBASE-5457) add inline index in data block for data which are not clustered together

2012-02-22 Thread He Yongqiang (Created) (JIRA)
add inline index in data block for data which are not clustered together


 Key: HBASE-5457
 URL: https://issues.apache.org/jira/browse/HBASE-5457
 Project: HBase
  Issue Type: New Feature
Reporter: He Yongqiang


As we are go through our data schema, and we found we have one large column 
family which is just duplicating data from another column family and is just a 
re-org of the data to cluster data in a different way than the original column 
family in order to serve another type of queries efficiently.

If we compare this second column family with similar situation in mysql, it is 
like an index in mysql. So if we can add inline block index on required 
columns, the second column family then is not needed.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira