[
https://issues.apache.org/jira/browse/FLINK-25909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17720887#comment-17720887
]
Lijie Wang edited comment on FLINK-25909 at 5/9/23 10:01 AM:
-------------------------------------------------------------
Hi [~jackwangcs] [~gaborgsomogyi]
I'm using 1.17 recently, and found that the following log is always printed in
the JM log, which really confuses me:
{code:java}
org.apache.flink.runtime.security.token.hadoop.HBaseDelegationTokenProvider []
- HBase is not available (not packaged with this application):
ClassNotFoundException : "org.apache.hadoop.hbase.HBaseConfiguration".
{code}
After a quick look, I found it's because we always try to load the
{{org.apache.hadoop.hbase.HBaseConfiguration}} in
{{HBaseDelegationTokenProvider}} but the hbase-related classes are not packaged.
I have 2 questions:
# Is it necessary to put the {{HBaseDelegationTokenProvider}} in flink-runtime
and enable it by default ?
# If it is, can we optimize the log to be more friendly? for example, print
log only when the hbase is available(something like "Successfully load hbase
delegation token provider"), and print nothing if it's not available. Current
log may confuse users, especially some users will scan the logs for words like
"exception" "cause" to find problems in time.
was (Author: wanglijie95):
Hi [~jackwangcs] [~gaborgsomogyi]
I'm using 1.17 recently, and found that the following log is always printed in
the JM log, which confuses me:
{code:java}
org.apache.flink.runtime.security.token.hadoop.HBaseDelegationTokenProvider []
- HBase is not available (not packaged with this application):
ClassNotFoundException : "org.apache.hadoop.hbase.HBaseConfiguration".
{code}
After a quick look, I found it's because we always try to load the
{{org.apache.hadoop.hbase.HBaseConfiguration}} in
{{HBaseDelegationTokenProvider}} but the hbase-related classes are not packaged.
I have 2 questions:
# Is it necessary to put the {{HBaseDelegationTokenProvider}} in flink-runtime
and enable it by default ?
# If it is, can we optimize the log to be more friendly? for example, print
log only when the hbase is available(something like "Successfully load hbase
delegation token provider"), and print nothing if it's not available. Current
log may confuse users, especially some users will scan the logs for words like
"exception" "cause" to find problems in time.
> Move HBase token obtain functionality into HBaseDelegationTokenProvider
> -----------------------------------------------------------------------
>
> Key: FLINK-25909
> URL: https://issues.apache.org/jira/browse/FLINK-25909
> Project: Flink
> Issue Type: Sub-task
> Affects Versions: 1.15.0
> Reporter: Gabor Somogyi
> Assignee: Gabor Somogyi
> Priority: Major
> Labels: pull-request-available, stale-assigned
> Fix For: 1.17.0
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
