[
https://issues.apache.org/jira/browse/HDFS-13885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16601967#comment-16601967
]
Kitti Nanasi commented on HDFS-13885:
-------------------------------------
[~xiaochen], thanks for the suggestion, the log does look more self explaining
like that.
The logs look like this when debug log is enabled:
{code:java}
2018-09-03 11:51:01,903 [Thread-16] DEBUG hdfs.DFSClient
(DFSClient.java:createWrappedOutputStream(956)) - Start decrypting EDEK for
file: /test-dir/TestEZ1/testData.0.dat, output stream: 0x599cc196
2018-09-03 11:51:02,053 [Thread-16] DEBUG hdfs.DFSClient
(DFSClient.java:createWrappedOutputStream(960)) - Decrypted EDEK for file:
/test-dir/TestEZ1/testData.0.dat, output stream: 0x599cc196
2018-09-03 11:51:02,667 [Thread-16] DEBUG hdfs.DFSClient
(DFSClient.java:createWrappedOutputStream(956)) - Start decrypting EDEK for
file: /test-dir/TestEZ1/testData.1.dat, output stream: 0x58878926
2018-09-03 11:51:02,683 [Thread-16] DEBUG hdfs.DFSClient
(DFSClient.java:createWrappedOutputStream(960)) - Decrypted EDEK for file:
/test-dir/TestEZ1/testData.1.dat, output stream: 0x58878926
{code}
> Improve debugging experience of dfsclient decrypts
> --------------------------------------------------
>
> Key: HDFS-13885
> URL: https://issues.apache.org/jira/browse/HDFS-13885
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: hdfs-client
> Affects Versions: 3.1.0
> Reporter: Kitti Nanasi
> Assignee: Kitti Nanasi
> Priority: Major
> Attachments: HDFS-13885.001.patch, HDFS-13885.002.patch,
> HDFS-13885.003.patch
>
>
> We want to know from the hdfs client log (e.g. hbase RS logs) for each
> CryptoOutputstream, approximately when does the decrypt happen and when does
> the file read happen, to help us rule out or identify hdfs NN / kms / DN
> being slow.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
