[
https://issues.apache.org/jira/browse/HADOOP-17997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xichaomin updated HADOOP-17997:
-------------------------------
Description:
# mkdir on each subcluster /test10
# mount table: hdfs dfsrouteradmin -add /test10 ns1,ns2 /test10
# set quota: hdfs dfsrouteradmin -setQuota /test10 -nsQuota 4
# touch two files under hdfs://\{fed}/test10, now the namespace usage is 4(2
directories and 2 files).
# refresh and put a new file, the put is successfull, and the namespace usage
comes to 5.
!1636424307319.jpg!
The router checks quota without considering the increments, It is difficult to
limit quota precisely without increments , but throw exception when usage >=
quota will be better.
was:
# mkdir on each subcluster /test10
# mount table: hdfs dfsrouteradmin -add /test10 ns1,ns2 /test10
# set quota: hdfs dfsrouteradmin -setQuota /test10 -nsQuota 4
# touch two files under hdfs://\{fed}/test10, now the namespace usage is 4(2
directories and 2 files).
# refresh and put a new file, the put is successfull, and the namespace usage
comes to 5.
!1636424307319.jpg!
> RBF: Namespace usage of mount table with multi subclusters can exceed quota
> ---------------------------------------------------------------------------
>
> Key: HADOOP-17997
> URL: https://issues.apache.org/jira/browse/HADOOP-17997
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Reporter: xichaomin
> Priority: Major
> Attachments: 1636424307319.jpg
>
>
> # mkdir on each subcluster /test10
> # mount table: hdfs dfsrouteradmin -add /test10 ns1,ns2 /test10
> # set quota: hdfs dfsrouteradmin -setQuota /test10 -nsQuota 4
> # touch two files under hdfs://\{fed}/test10, now the namespace usage is 4(2
> directories and 2 files).
> # refresh and put a new file, the put is successfull, and the namespace
> usage comes to 5.
> !1636424307319.jpg!
> The router checks quota without considering the increments, It is difficult
> to limit quota precisely without increments , but throw exception when usage
> >= quota will be better.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
