Hari Sekhon created HDFS-13724:
----------------------------------
Summary: Storage Tiering Show Policies Paths
Key: HDFS-13724
URL: https://issues.apache.org/jira/browse/HDFS-13724
Project: Hadoop HDFS
Issue Type: Improvement
Reporter: Hari Sekhon
Improvement Request to add an hdfs storagepolicies command to find paths for
which storage policies have been applied.
Right now you must explicitly query a single directory to get its policy to
determine if one has been applied, but if another hadoop admin has configured
policies on anything but trivially obvious paths such as /archive then there is
no way to find which paths have policies applied to them other than by querying
every single directory and subdirectory one by one which might potentially have
a policy, eg:
{code:java}
hdfs storagepolicies -getStoragePolicy -path /dir3/subdir1
hdfs storagepolicies -getStoragePolicy -path /dir2
hdfs storagepolicies -getStoragePolicy -path /dir3
hdfs storagepolicies -getStoragePolicy -path /dir3/subdir1
hdfs storagepolicies -getStoragePolicy -path /dir3/subdir2
hdfs storagepolicies -getStoragePolicy -path /dir3/subdir3
...
hdfs storagepolicies -getStoragePolicy -path /dirN
...
hdfs storagepolicies -getStoragePolicy -path /dirN/subdirN/subsubdirN
...{code}
In my current environment for example, a policy was configured for /data/blah
which doesn't show when trying
{code:java}
hdfs storagepolicies -getStoragePolicy -path /data{code}
and I had no way of knowing that I had to do:
{code:java}
hdfs storagepolicies -getStoragePolicy -path /data/blah{code}
other than trial and error of trying every directory and every subdirectory in
hdfs.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
