Uma Maheswara Rao G created HDFS-12911:
------------------------------------------
Summary: [SPS]: Fix review comments from discussions in HDFS-10285
Key: HDFS-12911
URL: https://issues.apache.org/jira/browse/HDFS-12911
Project: Hadoop HDFS
Issue Type: Sub-task
Components: datanode, namenode
Reporter: Uma Maheswara Rao G
Assignee: Rakesh R
This is the JIRA for tracking the possible improvements or issues discussed in
main JIRA
So, far from Daryn:
1. Lock should not kept while executing placement policy.
2. While starting up the NN, SPS Xattrs checks happen even if feature
disabled. This could potentially impact the startup speed.
I am adding one more possible improvement to reduce Xattr objects significantly.
SPS Xattr is constant object. So, we create one Xattr deduplication object
once statically and use the same object reference when required to add SPS
Xattr to Inode. So, here additional bytes required for storing SPS Xattr would
turn to same as single object ref ( i.e 4 bytes in 32 bit). So Xattr overhead
should come down significantly IMO. Lets explore the feasibility on this option.
Xattr list Future will not be specially created for SPS, that list would have
been created by SetStoragePolicy already on the same directory. So, no extra
Future creation because of SPS alone.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
