[
https://issues.apache.org/jira/browse/HBASE-28565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Duo Zhang updated HBASE-28565:
------------------------------
Release Note:
For TableOutputFormat
The OUTPUT_CONF_PREFIX and QUORUM_ADDRESS are deprecated, a new OUTPUT_CLUSTER
field is introduced. Please use OUTPUT_CLUSTER to specify the target cluster
through connection URI. You can also carry the extra configuration values
through the queries of the connection URI, which is the same with what
OUTPUT_CONF_PREFIX provides.
For CopyTable
A new '--peer.uri' command line option is introduced, for specifying target
cluster through connection URI, the old '--peer,adr' option is deprecated. If
both options are presented, only '--peer.uri' will take effect.
For SyncTable
Introduced '--sourceuri' and '--targeturi' command line options for specifying
source/target cluster through connection URI. The old '--sourcezkcluster' and
'--targetzkcluster' are deprecated. If '--sourceuri' and '--sourcezkcluster'
are both presented, only '--sourceuri' will take effect. It is the same for
'--targeturi' and '--targetzkcluster'.
For VerifyReplication
Since we may load the peer cluster from ReplicationPeerConfig, so here we do
not introduce new command line options, you can just use connection uri as the
peer quorum address. The support for old cluster key format will be removed in
future releases.
For TableMapReduceUtil
Add a new initCredentialsForCluster method which takes a URI as parameter
public static void initCredentialsForCluster(Job job, Configuration conf, URI
uri) throws IOException;
Deprecated two methods which take quorumAddress as a parameter
public static void initTableReducerJob(String table, Class<? extends
TableReducer> reducer, Job job, Class partitioner, String quorumAddress) throws
IOException
public static void initTableReducerJob(String table, Class<? extends
TableReducer> reducer, Job job, Class partitioner, String quorumAddress,
boolean addDependencyJars) throws IOException;
Introduced two new methods which take a URI as parameter
public static void initTableReducerJob(String table, Class<? extends
TableReducer> reducer, Job job, Class partitioner, URI outputCluster) throws
IOException;
public static void initTableReducerJob(String table, Class<? extends
TableReducer> reducer, Job job, Class partitioner, URI outputCluster, boolean
addDependencyJars) throws IOException;
was:
For TableOutputFormat
The OUTPUT_CONF_PREFIX and QUORUM_ADDRESS are deprecated, a new OUTPUT_CLUSTER
field is introduced. Please use OUTPUT_CLUSTER to specify the target cluster
through connection URI. You can also carry the extra configuration values
through the queries of the connection URI, which is the same with what
OUTPUT_CONF_PREFIX provides.
For CopyTable
A new '--peer.uri' command line option is introduced, for specifying target
cluster through connection URI, the old '--peer,adr' option is deprecated. If
both options are presented, only '--peer.uri' will take effect.
For SyncTable
Introduced '--sourceuri' and '--targeturi' command line options for specifying
source/target cluster through connection URI. The old '--sourcezkcluster' and
'--targetzkcluster' are deprecated. If '--sourceuri' and '--sourcezkcluster'
are both presented, only '--sourceuri' will take effect. It is the same for
'--targeturi' and '--targetzkcluster'.
> Make map reduce jobs accept connection uri when specifying peer cluster
> -----------------------------------------------------------------------
>
> Key: HBASE-28565
> URL: https://issues.apache.org/jira/browse/HBASE-28565
> Project: HBase
> Issue Type: Improvement
> Components: mapreduce, Replication
> Reporter: Duo Zhang
> Assignee: Duo Zhang
> Priority: Major
> Labels: pull-request-available
> Fix For: 3.0.0-beta-2
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
