[
https://issues.apache.org/jira/browse/HDFS-13716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang updated HDFS-13716:
-----------------------------------
Description:
We can see HDFS and Hive delegation token (DT) creation as INFO messages in
Spark application logs but not for KMS DTs:
18/06/07 10:02:35 INFO hdfs.DFSClient: Created token for admin:
HDFS_DELEGATION_TOKEN [email protected], renewer=yarn, realUser=,
issueDate=1528390955760, maxDate=1528995755760, sequenceNumber=125659,
masterKeyId=795 on ha-hdfs:dev
18/06/07 10:02:37 INFO hive.metastore: Trying to connect to metastore with URI
thrift://hostnam.example.net:9083
18/06/07 10:02:37 INFO hive.metastore: Opened a connection to metastore,
current connections: 1
18/06/07 10:02:37 INFO hive.metastore: Connected to metastore.
18/06/07 10:02:37 INFO security.HiveCredentialProvider: Get Token from hive
metastore: Kind: HIVE_DELEGATION_TOKEN, Service: , Ident: 00 1b 61 6e 69 73 68
2d 61 64 6d 69 6e 40 43 4f 52 50 2e 49 4e 54 55 49 54 2e 4e 45 54 04 68 69 76
65 00 8a 01 63 db 33 3a 83 8a 01 63 ff 3f be 83 8e 17 8d 8e 06 96
Please implement KMS DT acquisition events at INFO level as it will help
supportability of encrypted HDSF filesystems.
was:
We can see HDFS and Hive delegation token (DT) creation as INFO messages in
Spark application logs but not for KMS DTs:
18/06/07 10:02:35 INFO hdfs.DFSClient: Created token for anish-admin:
HDFS_DELEGATION_TOKEN [email protected], renewer=yarn, realUser=,
issueDate=1528390955760, maxDate=1528995755760, sequenceNumber=125659,
masterKeyId=795 on ha-hdfs:dev
18/06/07 10:02:37 INFO hive.metastore: Trying to connect to metastore with URI
thrift://hostnam.example.net:9083
18/06/07 10:02:37 INFO hive.metastore: Opened a connection to metastore,
current connections: 1
18/06/07 10:02:37 INFO hive.metastore: Connected to metastore.
18/06/07 10:02:37 INFO security.HiveCredentialProvider: Get Token from hive
metastore: Kind: HIVE_DELEGATION_TOKEN, Service: , Ident: 00 1b 61 6e 69 73 68
2d 61 64 6d 69 6e 40 43 4f 52 50 2e 49 4e 54 55 49 54 2e 4e 45 54 04 68 69 76
65 00 8a 01 63 db 33 3a 83 8a 01 63 ff 3f be 83 8e 17 8d 8e 06 96
Please implement KMS DT acquisition events at INFO level as it will help
supportability of encrypted HDSF filesystems.
> hdfs.DFSclient should log KMS DT acquisition at INFO level
> ----------------------------------------------------------
>
> Key: HDFS-13716
> URL: https://issues.apache.org/jira/browse/HDFS-13716
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: hdfs, hdfs-client, kms
> Affects Versions: 3.1.0
> Reporter: Kitti Nanasi
> Assignee: Kitti Nanasi
> Priority: Minor
>
> We can see HDFS and Hive delegation token (DT) creation as INFO messages in
> Spark application logs but not for KMS DTs:
> 18/06/07 10:02:35 INFO hdfs.DFSClient: Created token for admin:
> HDFS_DELEGATION_TOKEN [email protected], renewer=yarn, realUser=,
> issueDate=1528390955760, maxDate=1528995755760, sequenceNumber=125659,
> masterKeyId=795 on ha-hdfs:dev
> 18/06/07 10:02:37 INFO hive.metastore: Trying to connect to metastore with
> URI thrift://hostnam.example.net:9083
> 18/06/07 10:02:37 INFO hive.metastore: Opened a connection to metastore,
> current connections: 1
> 18/06/07 10:02:37 INFO hive.metastore: Connected to metastore.
> 18/06/07 10:02:37 INFO security.HiveCredentialProvider: Get Token from hive
> metastore: Kind: HIVE_DELEGATION_TOKEN, Service: , Ident: 00 1b 61 6e 69 73
> 68 2d 61 64 6d 69 6e 40 43 4f 52 50 2e 49 4e 54 55 49 54 2e 4e 45 54 04 68 69
> 76 65 00 8a 01 63 db 33 3a 83 8a 01 63 ff 3f be 83 8e 17 8d 8e 06 96
> Please implement KMS DT acquisition events at INFO level as it will help
> supportability of encrypted HDSF filesystems.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
