[
https://issues.apache.org/jira/browse/HDFS-13656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yiqun Lin updated HDFS-13656:
-----------------------------
Description:
We found the error when dfs client completes file.
!error-hdfs.png!
Now the error log is too simple and cannot provide enough info for debugging.
And this error will failed the write operation and finally lead our critical
tasks failed. It will be good to print retry time and file path info in
{{DFSOutputStream#completeFile}}. In addition, the log level can be updated
from INFO to WARN, it won't be ignored easily by users.
was:
We found the error when dfs client completes file.
!error-hdfs.png!
Now the error log is too simple and cannot provide enough info for debugging.
And this error will lead write operation failed. It will be good to print retry
time and file path info in {{.DFSOutputStream.completeFile}}. In addition, the
log level can be updated from INFO to WARN, it won't be ignored easily by users.
> Logging more info when client completes file error
> --------------------------------------------------
>
> Key: HDFS-13656
> URL: https://issues.apache.org/jira/browse/HDFS-13656
> Project: Hadoop HDFS
> Issue Type: Improvement
> Affects Versions: 3.0.2
> Reporter: Yiqun Lin
> Priority: Minor
> Attachments: error-hdfs.png
>
>
> We found the error when dfs client completes file.
> !error-hdfs.png!
> Now the error log is too simple and cannot provide enough info for debugging.
> And this error will failed the write operation and finally lead our critical
> tasks failed. It will be good to print retry time and file path info in
> {{DFSOutputStream#completeFile}}. In addition, the log level can be updated
> from INFO to WARN, it won't be ignored easily by users.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
