[
https://issues.apache.org/jira/browse/TRAFODION-2953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16461213#comment-16461213
]
Hans Zeller commented on TRAFODION-2953:
----------------------------------------
My comments/suggestions for this project:
* Use a 16 bit (or maybe 32 bit) table id in the first 2 (or 4) bytes of the
HBase key to identify the table.
* Don't make this table id column visible at the SQL layer (unlike the _SALT_
and _DIVISION_n_ columns).
* Add the code to deal with the table id in the generator, ignore it in
parser/binder/normalizer/optimizer.
* When dropping a table, have the option of abandoning the rows in the table
and making sure we don't reuse the same table id until we run a command to
clean up data for any dropped Trafodion tables inside the HBase table.
* Enforce that all Trafodion tables within an HBase table have the same owner.
* Don't allow salting of such tables. If we allow salting, keep the table id as
the first bytes of the key and add the salt after it. Maybe in a second phase,
allow pre-salted tables the way this JIRA describes it, where the salt column
precedes the table id in the key.
* Indexes always follow the table, indexes are part of a super table if and
only if the table is a part of it.
* Add a CQD to make all newly created eligible tables part of a super table.
This could be used in regression tests to speed them up.
> support multiple small size table map to a single or a few hbase table
> ----------------------------------------------------------------------
>
> Key: TRAFODION-2953
> URL: https://issues.apache.org/jira/browse/TRAFODION-2953
> Project: Apache Trafodion
> Issue Type: Improvement
> Reporter: liu ming
> Assignee: liu ming
> Priority: Major
> Attachments: Small_tables_in_one_HBase_region.pdf
>
>
> To support >10K tables and most are small tables (<100M) , save them in a
> single or a few underlying hbase table (region).
>
> need a design doc, will add it later.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)