[ 
https://issues.apache.org/jira/browse/TRAFODION-2953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16461213#comment-16461213
 ] 

Hans Zeller commented on TRAFODION-2953:
----------------------------------------

My comments/suggestions for this project:

* Use a 16 bit (or maybe 32 bit) table id in the first 2 (or 4) bytes of the 
HBase key to identify the table.
* Don't make this table id column visible at the SQL layer (unlike the _SALT_ 
and _DIVISION_n_ columns).
* Add the code to deal with the table id in the generator, ignore it in 
parser/binder/normalizer/optimizer.
* When dropping a table, have the option of abandoning the rows in the table 
and making sure we don't reuse the same table id until we run a command to 
clean up data for any dropped Trafodion tables inside the HBase table.
* Enforce that all Trafodion tables within an HBase table have the same owner.
* Don't allow salting of such tables. If we allow salting, keep the table id as 
the first bytes of the key and add the salt after it. Maybe in a second phase, 
allow pre-salted tables the way this JIRA describes it, where the salt column 
precedes the table id in the key.
* Indexes always follow the table, indexes are part of a super table if and 
only if the table is a part of it.
* Add a CQD to make all newly created eligible tables part of a super table. 
This could be used in regression tests to speed them up.

> support multiple small size table map to a single or a few hbase table
> ----------------------------------------------------------------------
>
>                 Key: TRAFODION-2953
>                 URL: https://issues.apache.org/jira/browse/TRAFODION-2953
>             Project: Apache Trafodion
>          Issue Type: Improvement
>            Reporter: liu ming
>            Assignee: liu ming
>            Priority: Major
>         Attachments: Small_tables_in_one_HBase_region.pdf
>
>
> To support >10K tables and most are small tables (<100M) , save them in a 
> single or a few underlying hbase table (region).
>  
> need a design doc, will add it later.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to