[
https://issues.apache.org/jira/browse/HDFS-13093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16348128#comment-16348128
]
liaoyuxiangqin commented on HDFS-13093:
---------------------------------------
Thanks [~xyao] review this and give detail reason explanations and many
solutions. As above you proposed three options which can resolve the problem of
"hdfs dfs count" CLI return an inconsistent result, but because the incorrect
remaining quota can't limit client continue write data to HDFS, so that the
"hdfs dfs count" CLI may be return negative number for remaining quota after
NN restarted.
{noformat}
SSD_QUOTA REM_SSD_QUOTA DISK_QUOTA REM_DISK_QUOTA ARCHIVE_QUOTA
REM_ARCHIVE_QUOTA PROVIDED_QUOTA REM_PROVIDED_QUOTA PATHNAME
none inf 6 G -3 G none inf none inf /hot
{noformat}
> Quota set don't compute usage of unspecified storage policy content
> -------------------------------------------------------------------
>
> Key: HDFS-13093
> URL: https://issues.apache.org/jira/browse/HDFS-13093
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: namenode
> Affects Versions: 3.1.0
> Environment: hdfs: hadoop-3.1.0-SNAPSHOT
> node:1 namenode, 9 datanodes
> Reporter: liaoyuxiangqin
> Priority: Major
> Original Estimate: 48h
> Remaining Estimate: 48h
>
> test as following steps:
> 1. hdfs dfs -mkdir /hot
> 2. hdfs dfs -put 1G.img /hot/file1
> 3. hdfs dfsadmin -setSpaceQuota 6442450944 -storageType DISK /hot
> 4. hdfs storagepolicies -setStoragePolicy -path /hot -policy HOT
> 5. hdfs dfs -count -q -h -v -t DISK /hot
> {code:java}
> SSD_QUOTA REM_SSD_QUOTA DISK_QUOTA REM_DISK_QUOTA ARCHIVE_QUOTA
> REM_ARCHIVE_QUOTA PROVIDED_QUOTA REM_PROVIDED_QUOTA PATHNAME
> none inf 6 G 6 G none inf none inf /hot{code}
> In step5 i speculation the remaining quota is 3G(quota - 1G*3 replicas )，but
> 6G actually.
> if i change the turn of step3 and step4, then the remaining quota equal to
> what I think 3G.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
