[
https://issues.apache.org/jira/browse/HDFS-16117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17378127#comment-17378127
]
Kihwal Lee commented on HDFS-16117:
-----------------------------------
Traditionally audit log format changes have been marked incompatible. I just
set the flag.
{{getListing}} has a configured limit for each response size, so you will see
multiple rpc calls for the same path from the same path multiple times in the
audit log, if the user is listing a big directory. You can guess how big the
directory is from this. The number of calls already reflects how many directory
entries were returned.
More importantly, it will be beneficial to distinguish between listStatus and
listLocatedStatus. We have an internal patch to report separate rpc metrics for
these and it is helpful. Not sure whether it can be applied as is to trunk, as
we have other RPC changes that are being tested.
> Add file count info in audit log to record the file count for delete and
> getListing RPC request to assist user trouble shooting when RPC cost is
> increasing
> ------------------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: HDFS-16117
> URL: https://issues.apache.org/jira/browse/HDFS-16117
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: namenode
> Affects Versions: 3.3.1
> Reporter: Daniel Ma
> Assignee: Daniel Ma
> Priority: Major
> Fix For: 3.3.1
>
> Attachments: 0001-HDFS-16117.patch
>
>
> Currently, there is no file count in audit log for delete and getListing RPC
> request, therefore， for the increasing RPC call, it is not easy to configure
> it out whether the time-consuming RPC request is related to too many files
> be operated in the RPC request.
>
> Therefore, It it necessary to add file count info in the audit log to assist
> maintenance
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
