[ 
https://issues.apache.org/jira/browse/HDFS-15510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17181323#comment-17181323
 ] 

Hemanth Boyina commented on HDFS-15510:
---------------------------------------

thanks for your analysis and for your comment [~ayushtkn] 
{quote}create a directory {{/router_test/dir}} and then set quota on it, If 
there are two namespaces, the {{setQuota}} will be a concurrent call and set on 
both namespaces, The point is with #3 in count command the quota will shows 
correct, but will it throw Quota exceeded exception at the value? I tried a 
quick UT and it didn't. since for the namespace directories the quota is 
maintained at router
{quote}
it wont throw quota exceeded exception here , because router has quota 
validation for only mount points as this directory {{/router_test/dir}}  is not 
a mount point there wont be any validation in router 
{quote}{color:#172b4d}The present code, overlooks the overflow of 
{color}{{LONG}}{color:#172b4d} due to addition of quota, set nsQuota to 
{color}{{LONG.MAX-2}}{color:#172b4d} in the current code and this goes 
wrong.{color}{quote}
 

yes it goes wrong , as this happens while aggregation in content summary , 
though in mount table store we have only the value  which is  set without any 
modifications
{quote}Can you check once, if for directories quota is protected, not just 
{{mount entries}}

please feel free to ignore and move ahead, if others are happy
{quote}
as this jira is mainly pointed about Quota for Mount points , i think we can go 
ahead and we can raise a new jira for quota in router for non mount points 

 

> RBF: Quota and Content Summary was not correct in Multiple Destinations
> -----------------------------------------------------------------------
>
>                 Key: HDFS-15510
>                 URL: https://issues.apache.org/jira/browse/HDFS-15510
>             Project: Hadoop HDFS
>          Issue Type: Bug
>            Reporter: Hemanth Boyina
>            Assignee: Hemanth Boyina
>            Priority: Critical
>         Attachments: 15510.png, HDFS-15510.001.patch, HDFS-15510.002.patch
>
>
> steps :
> *) create a mount entry with multiple destinations ( for suppose 2)
> *) Set NS quota as 10 for mount entry by dfsrouteradmin command, Content 
> Summary on the Mount Entry shows NS quota as 20
> *) Create 10 files through router, on creating 11th file , NS Quota Exceeded 
> Exception is coming 
> though the Content Summary showing the NS quota as 20 , we are not able to 
> create 20 files
>  
> the problem here is router stores the mount entry's NS quota as 10 , but 
> invokes NS quota on both the name services by set NS quota as 10 , so content 
> summary on mount entry aggregates the content summary of both the name 
> services by making NS quota as 20



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

Reply via email to