[
https://issues.apache.org/jira/browse/FLINK-17384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yu Li updated FLINK-17384:
--------------------------
Description:
Currently when using hbase connector with Flink SQL, below manual steps are
required:
# export HBASE_CONF_DIR
# add hbase libs to flink_lib(because the hbase connnector doesn't have
client's( and others) jar)
And we should improve this.
For 1) we could support read hbase conf dir from flink-conf.yaml just like
hadoop/yarn does.
For 2) we should support HBASE_CLASSPATH in config.sh. In case of jar conflicts
such as guava, we also should support flink-hbase-shaded just like hadoop does
In this JIRA we focus on implementing the 1st proposal.
was:
hi all:
when user interacts with hbase should do 2 things when using sql
# export HBASE_CONF_DIR
# add hbase libs to flink_lib(because the hbase connnector doesn't have
client's( and others) jar)
i think it needs to optimise it.
for 1) we should support read hbase conf dir from flink.conf just like
hadoop_conf in config.sh
for 2) we should support HBASE_CLASSPATH in config.sh. In case of jar
conflicts such as guava , we also should support flink-hbase-shaded just like
hadoop does
Editing the JIRA description to better reflect what the related PR resolves.
Please feel free to open another one for the 2nd proposal (while I think the
shaded part would need some discussions and reach consensus before working on
it) [~jackylau].
> Support reading hbase conf dir from flink-conf.yaml
> ---------------------------------------------------
>
> Key: FLINK-17384
> URL: https://issues.apache.org/jira/browse/FLINK-17384
> Project: Flink
> Issue Type: Improvement
> Components: Connectors / HBase, Deployment / Scripts
> Affects Versions: 1.10.0
> Reporter: jackylau
> Assignee: jackylau
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.12.0
>
>
> Currently when using hbase connector with Flink SQL, below manual steps are
> required:
> # export HBASE_CONF_DIR
> # add hbase libs to flink_lib(because the hbase connnector doesn't have
> client's( and others) jar)
> And we should improve this.
> For 1) we could support read hbase conf dir from flink-conf.yaml just like
> hadoop/yarn does.
> For 2) we should support HBASE_CLASSPATH in config.sh. In case of jar
> conflicts such as guava, we also should support flink-hbase-shaded just like
> hadoop does
> In this JIRA we focus on implementing the 1st proposal.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
