[
https://issues.apache.org/jira/browse/HDFS-12172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daryn Sharp updated HDFS-12172:
-------------------------------
Attachment: HDFS-12172.patch
Rather simple changes that existing tests provide coverage.
* EncryptionZoneInt is used when possible to unnecessary building of full path.
* Move validity uses the original IIP instead of allocating another.
* Some methods now accept the EncryptionZoneInt that was previously looked up
by caller to avoid re-lookups.
Will dovetail with additional changes for optimizing listStatus to not traverse
ancestors for every child entry.
> Reduce EZ lookup overhead
> -------------------------
>
> Key: HDFS-12172
> URL: https://issues.apache.org/jira/browse/HDFS-12172
> Project: Hadoop HDFS
> Issue Type: Improvement
> Affects Versions: 2.7.0
> Reporter: Daryn Sharp
> Assignee: Daryn Sharp
> Attachments: HDFS-12172.patch
>
>
> A number of inefficiencies exist in EZ lookups. These are amplified by
> frequent operations like list status. Once one encryption zone exists, all
> operations take the performance penalty.
> Ex. Operations should not perform redundant lookups. EZ path reconstruction
> should be lazy since it's not required in the common case. Renames do not
> need to reallocate new IIPs to check parent dirs for EZ.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
