[
https://issues.apache.org/jira/browse/HIVE-21762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sankar Hariappan updated HIVE-21762:
------------------------------------
Description:
- REPL DUMP syntax:
{code}
REPL DUMP <repl_policy> [FROM <last_repl_id> WITH <key_values_list>;
{code}
- New format for the Replication policy have 3 parts all separated with Dot
(.).
1. First part is DB name.
2. Second part is included list. Comma separated table names/regex with in
square brackets[]. If square brackets are not there, then it is treated as
single table replication which skips DB level events.
3. Third part is excluded list. Comma separated table names/regex with in
square brackets[].
{code}
<db_name> -- Full DB replication which is currently supported
<db_name>.[] - Full DB replication
<db_name>.['.*?'] - Full DB replication
<db_name>.t1 -- Single table replication (DB events excluded) which is
currently supported
<db_name>.['t1', 't2'] -- DB replication with static list of tables t1 and t2
included.
<db_name>.['t1*', 't2', '*t3'].['t100', '5t3', 't4'] -- DB replication with all
tables having prefix t1, with suffix t3 and include table t2 and exclude t100
which has the prefix t1, 5t3 which suffix t3 and t4.
{code}
- Need to support regular expression of any format.
- A table is included in dump only if it matches the regular expressions in
included list and doesn't match the excluded list.
was:
- REPL DUMP syntax:
{code}
REPL DUMP <repl_policy> [FROM <last_repl_id> WITH <key_values_list>;
{code}
- New format for the Replication policy have 3 parts all separated with Dot
(.).
1. First part is DB name.
2. Second part is included list. Comma separated table names/regex with in
square brackets[]. If square brackets are not there, then it is treated as
single table replication which skips DB level events.
3. Third part is excluded list. Comma separated table names/regex with in
square brackets[].
{code}
<db_name> -- Full DB replication which is currently supported
<db_name>.[] - Full DB replication
<db_name>.['*'] - Full DB replication
<db_name>.t1 -- Single table replication (DB events excluded) which is
currently supported
<db_name>.['t1', 't2'] -- DB replication with static list of tables t1 and t2
included.
<db_name>.['t1*', 't2', '*t3'].['t100', '5t3', 't4'] -- DB replication with all
tables having prefix t1, with suffix t3 and include table t2 and exclude t100
which has the prefix t1, 5t3 which suffix t3 and t4.
{code}
- Need to support regular expression of any format.
- A table is included in dump only if it matches the regular expressions in
included list and doesn't match the excluded list.
> REPL DUMP to support new format for replication policy input to take included
> tables list.
> ------------------------------------------------------------------------------------------
>
> Key: HIVE-21762
> URL: https://issues.apache.org/jira/browse/HIVE-21762
> Project: Hive
> Issue Type: Sub-task
> Components: repl
> Reporter: Sankar Hariappan
> Assignee: Sankar Hariappan
> Priority: Major
> Labels: DR, Replication, pull-request-available
> Attachments: HIVE-21762.01.patch, HIVE-21762.02.patch
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> - REPL DUMP syntax:
> {code}
> REPL DUMP <repl_policy> [FROM <last_repl_id> WITH <key_values_list>;
> {code}
> - New format for the Replication policy have 3 parts all separated with Dot
> (.).
> 1. First part is DB name.
> 2. Second part is included list. Comma separated table names/regex with in
> square brackets[]. If square brackets are not there, then it is treated as
> single table replication which skips DB level events.
> 3. Third part is excluded list. Comma separated table names/regex with in
> square brackets[].
> {code}
> <db_name> -- Full DB replication which is currently supported
> <db_name>.[] - Full DB replication
> <db_name>.['.*?'] - Full DB replication
> <db_name>.t1 -- Single table replication (DB events excluded) which is
> currently supported
> <db_name>.['t1', 't2'] -- DB replication with static list of tables t1 and
> t2 included.
> <db_name>.['t1*', 't2', '*t3'].['t100', '5t3', 't4'] -- DB replication with
> all tables having prefix t1, with suffix t3 and include table t2 and exclude
> t100 which has the prefix t1, 5t3 which suffix t3 and t4.
> {code}
> - Need to support regular expression of any format.
> - A table is included in dump only if it matches the regular expressions in
> included list and doesn't match the excluded list.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
