[
https://issues.apache.org/jira/browse/HDFS-15510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17181323#comment-17181323
]
Hemanth Boyina commented on HDFS-15510:
---------------------------------------
thanks for your analysis and for your comment [~ayushtkn]
{quote}create a directory {{/router_test/dir}} and then set quota on it, If
there are two namespaces, the {{setQuota}} will be a concurrent call and set on
both namespaces, The point is with #3 in count command the quota will shows
correct, but will it throw Quota exceeded exception at the value? I tried a
quick UT and it didn't. since for the namespace directories the quota is
maintained at router
{quote}
it wont throw quota exceeded exception here , because router has quota
validation for only mount points as this directory {{/router_test/dir}} is not
a mount point there wont be any validation in router
{quote}{color:#172b4d}The present code, overlooks the overflow of
{color}{{LONG}}{color:#172b4d} due to addition of quota, set nsQuota to
{color}{{LONG.MAX-2}}{color:#172b4d} in the current code and this goes
wrong.{color}{quote}
yes it goes wrong , as this happens while aggregation in content summary ,
though in mount table store we have only the value which is set without any
modifications
{quote}Can you check once, if for directories quota is protected, not just
{{mount entries}}
please feel free to ignore and move ahead, if others are happy
{quote}
as this jira is mainly pointed about Quota for Mount points , i think we can go
ahead and we can raise a new jira for quota in router for non mount points
> RBF: Quota and Content Summary was not correct in Multiple Destinations
> -----------------------------------------------------------------------
>
> Key: HDFS-15510
> URL: https://issues.apache.org/jira/browse/HDFS-15510
> Project: Hadoop HDFS
> Issue Type: Bug
> Reporter: Hemanth Boyina
> Assignee: Hemanth Boyina
> Priority: Critical
> Attachments: 15510.png, HDFS-15510.001.patch, HDFS-15510.002.patch
>
>
> steps :
> *) create a mount entry with multiple destinations ( for suppose 2)
> *) Set NS quota as 10 for mount entry by dfsrouteradmin command, Content
> Summary on the Mount Entry shows NS quota as 20
> *) Create 10 files through router, on creating 11th file , NS Quota Exceeded
> Exception is coming
> though the Content Summary showing the NS quota as 20 , we are not able to
> create 20 files
>
> the problem here is router stores the mount entry's NS quota as 10 , but
> invokes NS quota on both the name services by set NS quota as 10 , so content
> summary on mount entry aggregates the content summary of both the name
> services by making NS quota as 20
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
