JackWangCS commented on PR #20307:
URL: https://github.com/apache/flink/pull/20307#issuecomment-1190357468
Hi @gaborgsomogyi , it works after I add this configuration for hadoofs
delegation token provider. Here is the related log:
```log
2022-07-20 14:22:03,080 INFO
org.apache.flink.runtime.security.token.HBaseDelegationTokenProvider [] - Added
HBase Kerberos security token to credentials.
2022-07-20 14:22:03,080 INFO org.apache.zookeeper.ClientCnxn
[] - EventThread shut down for session: 0x1000003c15a000c
2022-07-20 14:22:03,080 DEBUG
org.apache.flink.runtime.security.token.KerberosDelegationTokenManager [] -
Obtained delegation token for service hbase successfully
2022-07-20 14:22:03,085 DEBUG
org.apache.flink.runtime.security.token.KerberosDelegationTokenManager [] -
Kind: HBASE_AUTH_TOKEN, Service: 17785c00-d402-492d-ba4f-e62ebf5acc25, Ident:
((username=hadoop/[email protected], keyId=3,
issueDate=1658326923059, expirationDate=1658931723059, sequenceNumber=0))
2022-07-20 14:22:03,086 DEBUG
org.apache.flink.runtime.security.token.KerberosDelegationTokenManager [] -
Kind: HDFS_DELEGATION_TOKEN, Service: 10.101.113.223:8020, Ident:
(HDFS_DELEGATION_TOKEN token 1 for hadoop)
2022-07-20 14:22:03,086 DEBUG
org.apache.flink.runtime.security.token.KerberosDelegationTokenManager [] -
Kind: kms-dt, Service: 10.101.113.223:9700, Ident: (owner=hadoop, renewer=yarn,
realUser=, issueDate=1658326922230, maxDate=1658931722230, sequenceNumber=1,
masterKeyId=2)
2022-07-20 14:22:03,086 INFO
org.apache.flink.runtime.security.token.KerberosDelegationTokenManager [] -
Delegation tokens obtained successfully
2022-07-20 14:22:03,086 DEBUG org.apache.flink.yarn.YarnClusterDescriptor
[] - Tokens Obtained by DelegationTokenManager
2022-07-20 14:22:03,086 DEBUG org.apache.flink.yarn.YarnClusterDescriptor
[] - Kind: HBASE_AUTH_TOKEN, Service:
17785c00-d402-492d-ba4f-e62ebf5acc25, Ident:
((username=hadoop/[email protected], keyId=3,
issueDate=1658326923059, expirationDate=1658931723059, sequenceNumber=0))
2022-07-20 14:22:03,087 DEBUG org.apache.flink.yarn.YarnClusterDescriptor
[] - Kind: HDFS_DELEGATION_TOKEN, Service: 10.101.113.223:8020,
Ident: (HDFS_DELEGATION_TOKEN token 1 for hadoop)
2022-07-20 14:22:03,087 DEBUG org.apache.flink.yarn.YarnClusterDescriptor
[] - Kind: kms-dt, Service: 10.101.113.223:9700, Ident:
(owner=hadoop, renewer=yarn, realUser=, issueDate=1658326922230,
maxDate=1658931722230, sequenceNumber=1, masterKeyId=2)
2022-07-20 14:22:03,087 INFO org.apache.flink.yarn.YarnClusterDescriptor
[] - Delegation tokens added to the AM container.
2022-07-20 14:22:03,092 INFO org.apache.flink.yarn.YarnClusterDescriptor
[] - Submitting application master application_1658306268998_0001
2022-07-20 14:22:03,103 INFO
org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl [] - Timeline
service address: ip-10-101-113-223.ec2.internal:8188
2022-07-20 14:22:04,704 INFO
org.apache.hadoop.yarn.client.api.impl.YarnClientImpl [] - Submitted
application application_1658306268998_0001
2022-07-20 14:22:04,704 INFO org.apache.flink.yarn.YarnClusterDescriptor
[] - Waiting for the cluster to be allocated
2022-07-20 14:22:04,706 DEBUG org.apache.flink.yarn.YarnClusterDescriptor
[] - Application State: ACCEPTED
```
As you can see, the renewer is set to yarn for kms-dt token.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
