[jira] [Commented] (HDFS-14143) RBF: After clrQuota mount point is not allowing to create new files
[
https://issues.apache.org/jira/browse/HDFS-14143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16720989#comment-16720989
]
Takanobu Asanuma commented on HDFS-14143:
-
I created it by HDFS-14150.
> RBF: After clrQuota mount point is not allowing to create new files
>
>
> Key: HDFS-14143
> URL: https://issues.apache.org/jira/browse/HDFS-14143
> Project: Hadoop HDFS
> Issue Type: Bug
>Affects Versions: 3.1.1
>Reporter: Harshakiran Reddy
>Assignee: Takanobu Asanuma
>Priority: Major
> Labels: RBF
>
> {noformat}
> bin> ./hdfs dfsrouteradmin -setQuota /src10 -nsQuota 3
> Successfully set quota for mount point /src10
> bin> ./hdfs dfsrouteradmin -clrQuota /src10
> Successfully clear quota for mount point /src10
> bin> ./hdfs dfs -put harsha /dest10/file1
> bin> ./hdfs dfs -put harsha /dest10/file2
> bin> ./hdfs dfs -put harsha /dest10/file3
> put: The NameSpace quota (directories and files) of directory /dest10 is
> exceeded: quota=3 file count=4
> bin> ./hdfs dfsrouteradmin -ls /src10
> Mount Table Entries:
> SourceDestinations Owner
> Group Mode Quota/Usage
> /src10hacluster->/dest10hdfs
> hadooprwxr-xr-x [NsQuota: -/-, SsQuota:
> -/-]
> bin>
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-14143) RBF: After clrQuota mount point is not allowing to create new files
[
https://issues.apache.org/jira/browse/HDFS-14143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16720977#comment-16720977
]
Takanobu Asanuma commented on HDFS-14143:
-
[~linyiqun] Sure, thanks for your kind! I'll create another jira.
> RBF: After clrQuota mount point is not allowing to create new files
>
>
> Key: HDFS-14143
> URL: https://issues.apache.org/jira/browse/HDFS-14143
> Project: Hadoop HDFS
> Issue Type: Bug
>Affects Versions: 3.1.1
>Reporter: Harshakiran Reddy
>Assignee: Takanobu Asanuma
>Priority: Major
> Labels: RBF
>
> {noformat}
> bin> ./hdfs dfsrouteradmin -setQuota /src10 -nsQuota 3
> Successfully set quota for mount point /src10
> bin> ./hdfs dfsrouteradmin -clrQuota /src10
> Successfully clear quota for mount point /src10
> bin> ./hdfs dfs -put harsha /dest10/file1
> bin> ./hdfs dfs -put harsha /dest10/file2
> bin> ./hdfs dfs -put harsha /dest10/file3
> put: The NameSpace quota (directories and files) of directory /dest10 is
> exceeded: quota=3 file count=4
> bin> ./hdfs dfsrouteradmin -ls /src10
> Mount Table Entries:
> SourceDestinations Owner
> Group Mode Quota/Usage
> /src10hacluster->/dest10hdfs
> hadooprwxr-xr-x [NsQuota: -/-, SsQuota:
> -/-]
> bin>
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-14143) RBF: After clrQuota mount point is not allowing to create new files
[
https://issues.apache.org/jira/browse/HDFS-14143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16720958#comment-16720958
]
Yiqun Lin commented on HDFS-14143:
--
{quote}
This is because the quotas of the subclusters still remain after "hdfs
dfsrouteradmin -rm". And "hdfs dfsrouteradmin -add" doesn't reflect the
existing quotas.
{quote}
[~tasanuma0829], this is a good catch. Are you interested in improving this
(Just unset sub-filesystem's quota when removing mount tables.)? I can help the
review, :).
> RBF: After clrQuota mount point is not allowing to create new files
>
>
> Key: HDFS-14143
> URL: https://issues.apache.org/jira/browse/HDFS-14143
> Project: Hadoop HDFS
> Issue Type: Bug
>Affects Versions: 3.1.1
>Reporter: Harshakiran Reddy
>Assignee: Takanobu Asanuma
>Priority: Major
> Labels: RBF
>
> {noformat}
> bin> ./hdfs dfsrouteradmin -setQuota /src10 -nsQuota 3
> Successfully set quota for mount point /src10
> bin> ./hdfs dfsrouteradmin -clrQuota /src10
> Successfully clear quota for mount point /src10
> bin> ./hdfs dfs -put harsha /dest10/file1
> bin> ./hdfs dfs -put harsha /dest10/file2
> bin> ./hdfs dfs -put harsha /dest10/file3
> put: The NameSpace quota (directories and files) of directory /dest10 is
> exceeded: quota=3 file count=4
> bin> ./hdfs dfsrouteradmin -ls /src10
> Mount Table Entries:
> SourceDestinations Owner
> Group Mode Quota/Usage
> /src10hacluster->/dest10hdfs
> hadooprwxr-xr-x [NsQuota: -/-, SsQuota:
> -/-]
> bin>
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-14143) RBF: After clrQuota mount point is not allowing to create new files
[
https://issues.apache.org/jira/browse/HDFS-14143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16720947#comment-16720947
]
Takanobu Asanuma commented on HDFS-14143:
-
[~ayushtkn] Yes, I waited for a while after mounting the subcluster. But the
existing quota of the subcluster didn't show in the output of "dfsrouteradmin
-ls".
> RBF: After clrQuota mount point is not allowing to create new files
>
>
> Key: HDFS-14143
> URL: https://issues.apache.org/jira/browse/HDFS-14143
> Project: Hadoop HDFS
> Issue Type: Bug
>Affects Versions: 3.1.1
>Reporter: Harshakiran Reddy
>Assignee: Takanobu Asanuma
>Priority: Major
> Labels: RBF
>
> {noformat}
> bin> ./hdfs dfsrouteradmin -setQuota /src10 -nsQuota 3
> Successfully set quota for mount point /src10
> bin> ./hdfs dfsrouteradmin -clrQuota /src10
> Successfully clear quota for mount point /src10
> bin> ./hdfs dfs -put harsha /dest10/file1
> bin> ./hdfs dfs -put harsha /dest10/file2
> bin> ./hdfs dfs -put harsha /dest10/file3
> put: The NameSpace quota (directories and files) of directory /dest10 is
> exceeded: quota=3 file count=4
> bin> ./hdfs dfsrouteradmin -ls /src10
> Mount Table Entries:
> SourceDestinations Owner
> Group Mode Quota/Usage
> /src10hacluster->/dest10hdfs
> hadooprwxr-xr-x [NsQuota: -/-, SsQuota:
> -/-]
> bin>
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-14143) RBF: After clrQuota mount point is not allowing to create new files
[
https://issues.apache.org/jira/browse/HDFS-14143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16720924#comment-16720924
]
Ayush Saxena commented on HDFS-14143:
-
[~tasanuma0829] Did you wait till the
dfs.federation.router.quota-cache.update.interval".?
> RBF: After clrQuota mount point is not allowing to create new files
>
>
> Key: HDFS-14143
> URL: https://issues.apache.org/jira/browse/HDFS-14143
> Project: Hadoop HDFS
> Issue Type: Bug
>Affects Versions: 3.1.1
>Reporter: Harshakiran Reddy
>Assignee: Takanobu Asanuma
>Priority: Major
> Labels: RBF
>
> {noformat}
> bin> ./hdfs dfsrouteradmin -setQuota /src10 -nsQuota 3
> Successfully set quota for mount point /src10
> bin> ./hdfs dfsrouteradmin -clrQuota /src10
> Successfully clear quota for mount point /src10
> bin> ./hdfs dfs -put harsha /dest10/file1
> bin> ./hdfs dfs -put harsha /dest10/file2
> bin> ./hdfs dfs -put harsha /dest10/file3
> put: The NameSpace quota (directories and files) of directory /dest10 is
> exceeded: quota=3 file count=4
> bin> ./hdfs dfsrouteradmin -ls /src10
> Mount Table Entries:
> SourceDestinations Owner
> Group Mode Quota/Usage
> /src10hacluster->/dest10hdfs
> hadooprwxr-xr-x [NsQuota: -/-, SsQuota:
> -/-]
> bin>
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-14143) RBF: After clrQuota mount point is not allowing to create new files
[
https://issues.apache.org/jira/browse/HDFS-14143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16720923#comment-16720923
]
Takanobu Asanuma commented on HDFS-14143:
-
Hi, [~Harsha1206]. As [~linyiqun] and [~brahmareddy] said, it seems HDFS-13583
fixed the issue. If that is your case, please close this jira.
> RBF: After clrQuota mount point is not allowing to create new files
>
>
> Key: HDFS-14143
> URL: https://issues.apache.org/jira/browse/HDFS-14143
> Project: Hadoop HDFS
> Issue Type: Bug
>Affects Versions: 3.1.1
>Reporter: Harshakiran Reddy
>Assignee: Takanobu Asanuma
>Priority: Major
> Labels: RBF
>
> {noformat}
> bin> ./hdfs dfsrouteradmin -setQuota /src10 -nsQuota 3
> Successfully set quota for mount point /src10
> bin> ./hdfs dfsrouteradmin -clrQuota /src10
> Successfully clear quota for mount point /src10
> bin> ./hdfs dfs -put harsha /dest10/file1
> bin> ./hdfs dfs -put harsha /dest10/file2
> bin> ./hdfs dfs -put harsha /dest10/file3
> put: The NameSpace quota (directories and files) of directory /dest10 is
> exceeded: quota=3 file count=4
> bin> ./hdfs dfsrouteradmin -ls /src10
> Mount Table Entries:
> SourceDestinations Owner
> Group Mode Quota/Usage
> /src10hacluster->/dest10hdfs
> hadooprwxr-xr-x [NsQuota: -/-, SsQuota:
> -/-]
> bin>
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-14143) RBF: After clrQuota mount point is not allowing to create new files
[
https://issues.apache.org/jira/browse/HDFS-14143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16720921#comment-16720921
]
Takanobu Asanuma commented on HDFS-14143:
-
Actually, the problem I saw is different. Seems {{clrQuota}} works well. Sorry
for the confusion.
I didn't use {{clrQuota}}. I just removed and added the mount point.
{noformat}
$ hdfs dfsrouteradmin -add /ns1_data ns1 /data
$ hdfs dfsrouteradmin -setQuota /ns1_data -nsQuota 10 -ssQuota 10
$ hdfs dfsrouteradmin -ls /ns1_data
SourceDestinations Owner
Group Mode Quota/Usage
/ns1_datans1->/data tasanuma
users rwxr-xr-x [NsQuota: 10/1, SsQuota:
10 B/0 B]
$ hdfs dfsrouteradmin -rm /ns1_data
$ hdfs dfsrouteradmin -add /ns1_data ns1 /data
$ hdfs dfsrouteradmin -ls /ns1_data
SourceDestinations Owner
Group Mode Quota/Usage
/ns1_datans1->/data tasanuma
users rwxr-xr-x [NsQuota: -/-, SsQuota:
-/-]
$ hadoop fs -put file1 /ns1_data/file1
put: The DiskSpace quota of /data is exceeded: quota = 10 B = 10 B but
diskspace consumed = 402653184 B = 384 MB
{noformat}
This is because the quotas of the subclusters still remain after "{{hdfs
dfsrouteradmin -rm}}". And "{{hdfs dfsrouteradmin -add}}" doesn't reflect the
existing quotas.
> RBF: After clrQuota mount point is not allowing to create new files
>
>
> Key: HDFS-14143
> URL: https://issues.apache.org/jira/browse/HDFS-14143
> Project: Hadoop HDFS
> Issue Type: Bug
>Affects Versions: 3.1.1
>Reporter: Harshakiran Reddy
>Assignee: Takanobu Asanuma
>Priority: Major
> Labels: RBF
>
> {noformat}
> bin> ./hdfs dfsrouteradmin -setQuota /src10 -nsQuota 3
> Successfully set quota for mount point /src10
> bin> ./hdfs dfsrouteradmin -clrQuota /src10
> Successfully clear quota for mount point /src10
> bin> ./hdfs dfs -put harsha /dest10/file1
> bin> ./hdfs dfs -put harsha /dest10/file2
> bin> ./hdfs dfs -put harsha /dest10/file3
> put: The NameSpace quota (directories and files) of directory /dest10 is
> exceeded: quota=3 file count=4
> bin> ./hdfs dfsrouteradmin -ls /src10
> Mount Table Entries:
> SourceDestinations Owner
> Group Mode Quota/Usage
> /src10hacluster->/dest10hdfs
> hadooprwxr-xr-x [NsQuota: -/-, SsQuota:
> -/-]
> bin>
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-14143) RBF: After clrQuota mount point is not allowing to create new files
[
https://issues.apache.org/jira/browse/HDFS-14143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16719687#comment-16719687
]
Brahma Reddy Battula commented on HDFS-14143:
-
AFAIK,As [~linyiqun] mentioned HDFS-13583 fixes this..[~tasanuma0829] what's
the value configured for
*"dfs.federation.router.quota-cache.update.interval"*..? it's default by 1 min,
did you seen this issue after this interval *atmost*..? Hope you enabled the
router Quota (*dfs.federation.router.quota.enable*).
> RBF: After clrQuota mount point is not allowing to create new files
>
>
> Key: HDFS-14143
> URL: https://issues.apache.org/jira/browse/HDFS-14143
> Project: Hadoop HDFS
> Issue Type: Bug
>Affects Versions: 3.1.1
>Reporter: Harshakiran Reddy
>Assignee: Takanobu Asanuma
>Priority: Major
> Labels: RBF
>
> {noformat}
> bin> ./hdfs dfsrouteradmin -setQuota /src10 -nsQuota 3
> Successfully set quota for mount point /src10
> bin> ./hdfs dfsrouteradmin -clrQuota /src10
> Successfully clear quota for mount point /src10
> bin> ./hdfs dfs -put harsha /dest10/file1
> bin> ./hdfs dfs -put harsha /dest10/file2
> bin> ./hdfs dfs -put harsha /dest10/file3
> put: The NameSpace quota (directories and files) of directory /dest10 is
> exceeded: quota=3 file count=4
> bin> ./hdfs dfsrouteradmin -ls /src10
> Mount Table Entries:
> SourceDestinations Owner
> Group Mode Quota/Usage
> /src10hacluster->/dest10hdfs
> hadooprwxr-xr-x [NsQuota: -/-, SsQuota:
> -/-]
> bin>
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-14143) RBF : after clrQuota mount point is not allowing to create new files
[
https://issues.apache.org/jira/browse/HDFS-14143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16719093#comment-16719093
]
Takanobu Asanuma commented on HDFS-14143:
-
I'd like to work on this jira and assign it to me.
[~Harsha1206] Please let me know if you have already worked on the issue.
Thanks for catching it.
> RBF : after clrQuota mount point is not allowing to create new files
> -
>
> Key: HDFS-14143
> URL: https://issues.apache.org/jira/browse/HDFS-14143
> Project: Hadoop HDFS
> Issue Type: Bug
>Affects Versions: 3.1.1
>Reporter: Harshakiran Reddy
>Priority: Major
> Labels: RBF
>
> {noformat}
> bin> ./hdfs dfsrouteradmin -setQuota /src10 -nsQuota 3
> Successfully set quota for mount point /src10
> bin> ./hdfs dfsrouteradmin -clrQuota /src10
> Successfully clear quota for mount point /src10
> bin> ./hdfs dfs -put harsha /dest10/file1
> bin> ./hdfs dfs -put harsha /dest10/file2
> bin> ./hdfs dfs -put harsha /dest10/file3
> put: The NameSpace quota (directories and files) of directory /dest10 is
> exceeded: quota=3 file count=4
> bin> ./hdfs dfsrouteradmin -ls /src10
> Mount Table Entries:
> SourceDestinations Owner
> Group Mode Quota/Usage
> /src10hacluster->/dest10hdfs
> hadooprwxr-xr-x [NsQuota: -/-, SsQuota:
> -/-]
> bin>
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-14143) RBF : after clrQuota mount point is not allowing to create new files
[
https://issues.apache.org/jira/browse/HDFS-14143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16718918#comment-16718918
]
Takanobu Asanuma commented on HDFS-14143:
-
I've also seen this problem by Hadoop-3.2.0 which includes HDFS-13583.
It looks cleared through the output of {{dfsrouteradmin}} and Router WebUI but
clients can't create files.
> RBF : after clrQuota mount point is not allowing to create new files
> -
>
> Key: HDFS-14143
> URL: https://issues.apache.org/jira/browse/HDFS-14143
> Project: Hadoop HDFS
> Issue Type: Bug
>Affects Versions: 3.1.1
>Reporter: Harshakiran Reddy
>Priority: Major
> Labels: RBF
>
> {noformat}
> bin> ./hdfs dfsrouteradmin -setQuota /src10 -nsQuota 3
> Successfully set quota for mount point /src10
> bin> ./hdfs dfsrouteradmin -clrQuota /src10
> Successfully clear quota for mount point /src10
> bin> ./hdfs dfs -put harsha /dest10/file1
> bin> ./hdfs dfs -put harsha /dest10/file2
> bin> ./hdfs dfs -put harsha /dest10/file3
> put: The NameSpace quota (directories and files) of directory /dest10 is
> exceeded: quota=3 file count=4
> bin> ./hdfs dfsrouteradmin -ls /src10
> Mount Table Entries:
> SourceDestinations Owner
> Group Mode Quota/Usage
> /src10hacluster->/dest10hdfs
> hadooprwxr-xr-x [NsQuota: -/-, SsQuota:
> -/-]
> bin>
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-14143) RBF : after clrQuota mount point is not allowing to create new files
[
https://issues.apache.org/jira/browse/HDFS-14143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16718818#comment-16718818
]
Yiqun Lin commented on HDFS-14143:
--
Is duplicate to HDFS-13583?
> RBF : after clrQuota mount point is not allowing to create new files
> -
>
> Key: HDFS-14143
> URL: https://issues.apache.org/jira/browse/HDFS-14143
> Project: Hadoop HDFS
> Issue Type: Bug
>Affects Versions: 3.1.1
>Reporter: Harshakiran Reddy
>Priority: Major
> Labels: RBF
>
> {noformat}
> bin> ./hdfs dfsrouteradmin -setQuota /src10 -nsQuota 3
> Successfully set quota for mount point /src10
> bin> ./hdfs dfsrouteradmin -clrQuota /src10
> Successfully clear quota for mount point /src10
> bin> ./hdfs dfs -put harsha /dest10/file1
> bin> ./hdfs dfs -put harsha /dest10/file2
> bin> ./hdfs dfs -put harsha /dest10/file3
> put: The NameSpace quota (directories and files) of directory /dest10 is
> exceeded: quota=3 file count=4
> bin> ./hdfs dfsrouteradmin -ls /src10
> Mount Table Entries:
> SourceDestinations Owner
> Group Mode Quota/Usage
> /src10hacluster->/dest10hdfs
> hadooprwxr-xr-x [NsQuota: -/-, SsQuota:
> -/-]
> bin>
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
