[jira] [Commented] (HDFS-14814) RBF: The quota should be set the same as the nearest parent in Global Quota.

[ https://issues.apache.org/jira/browse/HDFS-14814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931078#comment-16931078 ] Jinglun commented on HDFS-14814: Hi [~ayushtkn], thanks for your nice comments ! At present when we call

[jira] [Commented] (HDFS-14813) RBF: Make Global quota and Remote quota consistent.

[ https://issues.apache.org/jira/browse/HDFS-14813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931063#comment-16931063 ] Jinglun commented on HDFS-14813: My bad, I miss [~ayushtkn] comments in HDFS-14814. Let's discuss inherit

[jira] [Updated] (HDFS-14814) RBF: The quota should be set the same as the nearest parent in Global Quota.

[ https://issues.apache.org/jira/browse/HDFS-14814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14814: --- Description: I want to add a rule *'The quota should be set the same as the nearest parent'* to Global

[jira] [Commented] (HDFS-14568) setStoragePolicy should check quota and update consume on storage type quota.

[ https://issues.apache.org/jira/browse/HDFS-14568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931056#comment-16931056 ] Jinglun commented on HDFS-14568: Hi [~xyao] [~surendrasingh], do you have time for this?  Could you help

[jira] [Updated] (HDFS-14568) setStoragePolicy should check quota and update consume on storage type quota.

[ https://issues.apache.org/jira/browse/HDFS-14568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14568: --- Labels: imcompatible (was: ) > setStoragePolicy should check quota and update consume on storage type

[jira] [Updated] (HDFS-14813) RBF: Make Global quota and Remote quota consistent.

[ https://issues.apache.org/jira/browse/HDFS-14813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14813: --- Description: Make Global quota and remote quota consistent. (Global quota: the quota on mount table, Remote

[jira] [Commented] (HDFS-14833) RBF: Router Update Doesn't Sync Quota

[ https://issues.apache.org/jira/browse/HDFS-14833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929918#comment-16929918 ] Jinglun commented on HDFS-14833: Thanks [~ayushtkn] for working on this. Patch-002 makes sense to me.

[jira] [Commented] (HDFS-14813) RBF: Make Global quota and Remote quota consistent.

[ https://issues.apache.org/jira/browse/HDFS-14813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929953#comment-16929953 ] Jinglun commented on HDFS-14813: Hi [~ayushtkn], yes HDFS-13346 will help! My thought is to enable

[jira] [Comment Edited] (HDFS-14813) RBF: Make Global quota and Remote quota consistent.

[ https://issues.apache.org/jira/browse/HDFS-14813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929953#comment-16929953 ] Jinglun edited comment on HDFS-14813 at 9/15/19 11:26 AM: -- Hi [~ayushtkn], yes

[jira] [Updated] (HDFS-14814) RBF: The quota should be set the same as the nearest parent in Global Quota.

[ https://issues.apache.org/jira/browse/HDFS-14814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14814: --- Attachment: HDFS-14814.003.patch > RBF: The quota should be set the same as the nearest parent in Global

[jira] [Commented] (HDFS-14833) RBF: Router Update Doesn't Sync Quota

[ https://issues.apache.org/jira/browse/HDFS-14833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929965#comment-16929965 ] Jinglun commented on HDFS-14833: LGTM. +1 on v04. > RBF: Router Update Doesn't Sync Quota >

[jira] [Commented] (HDFS-14813) RBF: Make Global quota and Remote quota consistent.

[ https://issues.apache.org/jira/browse/HDFS-14813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929919#comment-16929919 ] Jinglun commented on HDFS-14813: Hi [~ayushtkn], could you help taking a look at the proposals?  Looking

[jira] [Commented] (HDFS-14813) RBF: Make Global quota and Remote quota consistent.

[ https://issues.apache.org/jira/browse/HDFS-14813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929966#comment-16929966 ] Jinglun commented on HDFS-14813: Yes, that exactly what I mean ! > RBF: Make Global quota and Remote

[jira] [Updated] (HDFS-14814) RBF: The quota should be set the same as the nearest parent in Global Quota.

[ https://issues.apache.org/jira/browse/HDFS-14814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14814: --- Attachment: (was: HDFS-14814.002.patch) > RBF: The quota should be set the same as the nearest parent in

[jira] [Updated] (HDFS-14814) RBF: The quota should be set the same as the nearest parent in Global Quota.

[ https://issues.apache.org/jira/browse/HDFS-14814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14814: --- Attachment: HDFS-14814.002.patch > RBF: The quota should be set the same as the nearest parent in Global

[jira] [Updated] (HDFS-14814) RBF: The quota should be set the same as the nearest parent in Global Quota.

[ https://issues.apache.org/jira/browse/HDFS-14814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14814: --- Attachment: HDFS-14814.002.patch > RBF: The quota should be set the same as the nearest parent in Global

[jira] [Commented] (HDFS-14833) RBF: Router Update Doesn't Sync Quota

[ https://issues.apache.org/jira/browse/HDFS-14833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929952#comment-16929952 ] Jinglun commented on HDFS-14833: Hi [~ayushtkn] thanks for your quick reply. Sorry for my bad expression

[jira] [Commented] (HDFS-14568) setStoragePolicy should check quota and update consume on storage type quota.

[ https://issues.apache.org/jira/browse/HDFS-14568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926292#comment-16926292 ] Jinglun commented on HDFS-14568: Hi [~surendrasingh], sorry for my late response. Do you mean to set SSD

[jira] [Commented] (HDFS-13596) NN restart fails after RollingUpgrade from 2.x to 3.x

[ https://issues.apache.org/jira/browse/HDFS-13596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16895884#comment-16895884 ] Jinglun commented on HDFS-13596: Hi [~ferhui], may I ask a question. In patch-008 FSNamesystem.java line

[jira] [Resolved] (HDFS-14542) Remove redundant code when verify quota

[ https://issues.apache.org/jira/browse/HDFS-14542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun resolved HDFS-14542. Resolution: Duplicate Thanks [~jojochuang] for your reminding, I'll close this with Resolution:

[jira] [Updated] (HDFS-14631) The DirectoryScanner doesn't fix the wrongly placed replica.

[ https://issues.apache.org/jira/browse/HDFS-14631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14631: --- Resolution: Duplicate Status: Resolved (was: Patch Available) Thanks [~jojochuang] for your

[jira] [Issue Comment Deleted] (HDFS-14631) The DirectoryScanner doesn't fix the wrongly placed replica.

[ https://issues.apache.org/jira/browse/HDFS-14631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14631: --- Comment: was deleted (was: Thanks [~jojochuang] for your reminding, I'll close it with Resolution:

[jira] [Reopened] (HDFS-14631) The DirectoryScanner doesn't fix the wrongly placed replica.

[ https://issues.apache.org/jira/browse/HDFS-14631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun reopened HDFS-14631: > The DirectoryScanner doesn't fix the wrongly placed replica. >

[jira] [Updated] (HDFS-14631) The DirectoryScanner doesn't fix the wrongly placed replica.

[ https://issues.apache.org/jira/browse/HDFS-14631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14631: --- Attachment: HDFS-14631.004.patch > The DirectoryScanner doesn't fix the wrongly placed replica. >

[jira] [Updated] (HDFS-14631) The DirectoryScanner doesn't fix the wrongly placed replica.

[ https://issues.apache.org/jira/browse/HDFS-14631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14631: --- Attachment: HDFS-14631.004.patch > The DirectoryScanner doesn't fix the wrongly placed replica. >

[jira] [Updated] (HDFS-14631) The DirectoryScanner doesn't fix the wrongly placed replica.

[ https://issues.apache.org/jira/browse/HDFS-14631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14631: --- Attachment: (was: HDFS-14631.004.patch) > The DirectoryScanner doesn't fix the wrongly placed replica. >

[jira] [Reopened] (HDFS-14631) The DirectoryScanner doesn't fix the wrongly placed replica.

[ https://issues.apache.org/jira/browse/HDFS-14631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun reopened HDFS-14631: upload patch for branch-2.x > The DirectoryScanner doesn't fix the wrongly placed replica. >

[jira] [Updated] (HDFS-14631) The DirectoryScanner doesn't fix the wrongly placed replica.

[ https://issues.apache.org/jira/browse/HDFS-14631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14631: --- Fix Version/s: 2.9.3 Attachment: HDFS-14631-branch-2.9.001.patch Status: Patch Available

[jira] [Commented] (HDFS-14631) The DirectoryScanner doesn't fix the wrongly placed replica.

[ https://issues.apache.org/jira/browse/HDFS-14631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16902063#comment-16902063 ] Jinglun commented on HDFS-14631: Hi [~xkrogen], thanks for your reminding. Yes, it's relevant to

[jira] [Commented] (HDFS-13901) INode access time is ignored because of race between open and rename

[ https://issues.apache.org/jira/browse/HDFS-13901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16897708#comment-16897708 ] Jinglun commented on HDFS-13901: Upload patch-002 making the unit test more readable. Do you have time to

[jira] [Updated] (HDFS-13901) INode access time is ignored because of race between open and rename

[ https://issues.apache.org/jira/browse/HDFS-13901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13901: --- Attachment: HDFS-13901.002.patch > INode access time is ignored because of race between open and rename >

[jira] [Commented] (HDFS-13901) INode access time is ignored because of race between open and rename

[ https://issues.apache.org/jira/browse/HDFS-13901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16898686#comment-16898686 ] Jinglun commented on HDFS-13901: Hi [~jojochuang]  [~hexiaoqiao], thanks for your great comments! I

[jira] [Commented] (HDFS-14645) ViewFileSystem should close the child FileSystems in close()

[ https://issues.apache.org/jira/browse/HDFS-14645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16898025#comment-16898025 ] Jinglun commented on HDFS-14645: Hi [~jojochuang] [~Jihyun.Cho], I was thinking closing all children

[jira] [Comment Edited] (HDFS-14645) ViewFileSystem should close the child FileSystems in close()

[ https://issues.apache.org/jira/browse/HDFS-14645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16898025#comment-16898025 ] Jinglun edited comment on HDFS-14645 at 8/1/19 12:09 PM: - Hi [~jojochuang]

[jira] [Updated] (HDFS-14631) The DirectoryScanner doesn't fix the wrongly placed replica.

[ https://issues.apache.org/jira/browse/HDFS-14631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14631: --- Attachment: HDFS-14631.003.patch > The DirectoryScanner doesn't fix the wrongly placed replica. >

[jira] [Commented] (HDFS-14631) The DirectoryScanner doesn't fix the wrongly placed replica.

[ https://issues.apache.org/jira/browse/HDFS-14631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887946#comment-16887946 ] Jinglun commented on HDFS-14631: Thanks [~hexiaoqiao] for your nice comments. In the new patch-003 I

[jira] [Commented] (HDFS-14547) DirectoryWithQuotaFeature.quota costs additional memory even the storage type quota is not set.

[ https://issues.apache.org/jira/browse/HDFS-14547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16886624#comment-16886624 ] Jinglun commented on HDFS-14547: Thanks [~xkrogen] for your nice review and comments.:) >

[jira] [Updated] (HDFS-14547) DirectoryWithQuotaFeature.quota costs additional memory even the storage type quota is not set.

[ https://issues.apache.org/jira/browse/HDFS-14547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14547: --- Attachment: HDFS-14547-branch-2.9.003.patch > DirectoryWithQuotaFeature.quota costs additional memory even

[jira] [Commented] (HDFS-14547) DirectoryWithQuotaFeature.quota costs additional memory even the storage type quota is not set.

[ https://issues.apache.org/jira/browse/HDFS-14547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885770#comment-16885770 ] Jinglun commented on HDFS-14547: My bad:(, I should check the patch more carefully, very sorry for that.

[jira] [Updated] (HDFS-13901) INode access time is ignored because of race between open and rename

[ https://issues.apache.org/jira/browse/HDFS-13901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13901: --- Attachment: HDFS-13901.006.patch > INode access time is ignored because of race between open and rename >

[jira] [Commented] (HDFS-13901) INode access time is ignored because of race between open and rename

[ https://issues.apache.org/jira/browse/HDFS-13901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938253#comment-16938253 ] Jinglun commented on HDFS-13901: Thanks [~jojochuang]  for your nice comments ! I delete the old comment

[jira] [Updated] (HDFS-14814) RBF: RouterQuotaUpdateService supports inherited rule.

[ https://issues.apache.org/jira/browse/HDFS-14814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14814: --- Attachment: HDFS-14814.007.patch > RBF: RouterQuotaUpdateService supports inherited rule. >

[jira] [Updated] (HDFS-13901) INode access time is ignored because of race between open and rename

[ https://issues.apache.org/jira/browse/HDFS-13901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13901: --- Attachment: HDFS-13901.005.patch > INode access time is ignored because of race between open and rename >

[jira] [Updated] (HDFS-14814) RBF: RouterQuotaUpdateService supports inherited rule.

[ https://issues.apache.org/jira/browse/HDFS-14814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14814: --- Attachment: HDFS-14814.006.patch > RBF: RouterQuotaUpdateService supports inherited rule. >

[jira] [Commented] (HDFS-14814) RBF: RouterQuotaUpdateService supports inherited rule.

[ https://issues.apache.org/jira/browse/HDFS-14814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938292#comment-16938292 ] Jinglun commented on HDFS-14814: Thanks [~ayushtkn] for your nice comments. Agree with your suggestions !

[jira] [Commented] (HDFS-14814) RBF: RouterQuotaUpdateService supports inherited rule.

[ https://issues.apache.org/jira/browse/HDFS-14814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941451#comment-16941451 ] Jinglun commented on HDFS-14814: Thank [~elgoiri] for your fast reply ! Agree with your comments,

[jira] [Commented] (HDFS-13901) INode access time is ignored because of race between open and rename

[ https://issues.apache.org/jira/browse/HDFS-13901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938476#comment-16938476 ] Jinglun commented on HDFS-13901: The failed unit tests are unrelated and work well on my pc. Upload v007

[jira] [Updated] (HDFS-13901) INode access time is ignored because of race between open and rename

[ https://issues.apache.org/jira/browse/HDFS-13901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13901: --- Attachment: HDFS-13901.007.patch > INode access time is ignored because of race between open and rename >

[jira] [Updated] (HDFS-14814) RBF: RouterQuotaUpdateService supports inherited rule.

[ https://issues.apache.org/jira/browse/HDFS-14814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14814: --- Attachment: HDFS-14814.008.patch > RBF: RouterQuotaUpdateService supports inherited rule. >

[jira] [Commented] (HDFS-14814) RBF: RouterQuotaUpdateService supports inherited rule.

[ https://issues.apache.org/jira/browse/HDFS-14814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938487#comment-16938487 ] Jinglun commented on HDFS-14814: A test case is broke by v07. Fix both the test case and checkstyle in

[jira] [Commented] (HDFS-14814) RBF: RouterQuotaUpdateService supports inherited rule.

[ https://issues.apache.org/jira/browse/HDFS-14814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16939076#comment-16939076 ] Jinglun commented on HDFS-14814: Thanks [~ayushtkn] [~elgoiri] your nice comments and suggestions ! 

[jira] [Updated] (HDFS-14814) RBF: RouterQuotaUpdateService supports inherited rule.

[ https://issues.apache.org/jira/browse/HDFS-14814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14814: --- Attachment: HDFS-14814.009.patch > RBF: RouterQuotaUpdateService supports inherited rule. >

[jira] [Comment Edited] (HDFS-14739) RBF: LS command for mount point shows wrong owner and permission information.

[ https://issues.apache.org/jira/browse/HDFS-14739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935534#comment-16935534 ] Jinglun edited comment on HDFS-14739 at 9/23/19 10:23 AM: -- Hi [~xuzq_zander], I

[jira] [Updated] (HDFS-14814) RBF: RouterQuotaUpdateService supports inherited rule.

[ https://issues.apache.org/jira/browse/HDFS-14814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14814: --- Attachment: HDFS-14814.004.patch > RBF: RouterQuotaUpdateService supports inherited rule. >

[jira] [Updated] (HDFS-14814) RBF: RouterQuotaUpdateService supports inherited rule.

[ https://issues.apache.org/jira/browse/HDFS-14814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14814: --- Attachment: (was: HDFS-14814.010.patch) > RBF: RouterQuotaUpdateService supports inherited rule. >

[jira] [Commented] (HDFS-14814) RBF: RouterQuotaUpdateService supports inherited rule.

[ https://issues.apache.org/jira/browse/HDFS-14814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940593#comment-16940593 ] Jinglun commented on HDFS-14814:   {quote}If you want to return a List of Entry, just create a new Map.

[jira] [Updated] (HDFS-14814) RBF: RouterQuotaUpdateService supports inherited rule.

[ https://issues.apache.org/jira/browse/HDFS-14814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14814: --- Attachment: HDFS-14814.010.patch > RBF: RouterQuotaUpdateService supports inherited rule. >

[jira] [Updated] (HDFS-14814) RBF: RouterQuotaUpdateService supports inherited rule.

[ https://issues.apache.org/jira/browse/HDFS-14814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14814: --- Attachment: HDFS-14814.010.patch > RBF: RouterQuotaUpdateService supports inherited rule. >

[jira] [Updated] (HDFS-14814) RBF: RouterQuotaUpdateService supports inherited rule.

[ https://issues.apache.org/jira/browse/HDFS-14814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14814: --- Attachment: HDFS-14814.005.patch > RBF: RouterQuotaUpdateService supports inherited rule. >

[jira] [Commented] (HDFS-14814) RBF: RouterQuotaUpdateService supports inherited rule.

[ https://issues.apache.org/jira/browse/HDFS-14814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16936410#comment-16936410 ] Jinglun commented on HDFS-14814: Thanks [~ayushtkn] [~elgoiri] for your nice comments !  Follow your

[jira] [Updated] (HDFS-14568) setStoragePolicy should check quota and update consume on storage type quota.

[ https://issues.apache.org/jira/browse/HDFS-14568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14568: --- Description: At present when the storage policy of a directory or a file is changed, we just simply change

[jira] [Updated] (HDFS-14568) setStoragePolicy should check quota and update consume on storage type quota.

[ https://issues.apache.org/jira/browse/HDFS-14568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14568: --- Description: At present when the storage policy of a directory or a file is changed, we just simply change

[jira] [Commented] (HDFS-14562) The behaviour of getContentSummaryInt() in getQuotaUsage() should be configurable.

[ https://issues.apache.org/jira/browse/HDFS-14562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16863664#comment-16863664 ] Jinglun commented on HDFS-14562: Hi [~hexiaoqiao], good idea. I'll start a parent issue for all my quota

[jira] [Created] (HDFS-14566) Quota improvment in HDFS

Jinglun created HDFS-14566: -- Summary: Quota improvment in HDFS Key: HDFS-14566 URL: https://issues.apache.org/jira/browse/HDFS-14566 Project: Hadoop HDFS Issue Type: Improvement Affects

[jira] [Commented] (HDFS-14547) DirectoryWithQuotaFeature.quota costs additional memory even the storage type quota is not set.

[ https://issues.apache.org/jira/browse/HDFS-14547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16863756#comment-16863756 ] Jinglun commented on HDFS-14547: Thanks [~hexiaoqiao] for review and comments. Upload patch-004 following

[jira] [Created] (HDFS-14568) The quota and consume of the file's ancestors are not handled when the storage policy of the file is changed.

Jinglun created HDFS-14568: -- Summary: The quota and consume of the file's ancestors are not handled when the storage policy of the file is changed. Key: HDFS-14568 URL: https://issues.apache.org/jira/browse/HDFS-14568

[jira] [Updated] (HDFS-14568) The quota and consume of the file's ancestors are not handled when the storage policy of the file is changed.

[ https://issues.apache.org/jira/browse/HDFS-14568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14568: --- Attachment: HDFS-14568-unit-test.patch > The quota and consume of the file's ancestors are not handled when

[jira] [Assigned] (HDFS-14568) The quota and consume of the file's ancestors are not handled when the storage policy of the file is changed.

[ https://issues.apache.org/jira/browse/HDFS-14568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun reassigned HDFS-14568: -- Assignee: Jinglun > The quota and consume of the file's ancestors are not handled when the > storage

[jira] [Updated] (HDFS-14633) The StorageType quota and consume in QuotaFeature is not handled when rename and setStoragePolicy etc.

[ https://issues.apache.org/jira/browse/HDFS-14633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14633: --- Description: The NameNode manages the global state of the cluster. We should always take NameNode's records

[jira] [Updated] (HDFS-14633) The StorageType quota and consume in QuotaFeature is not handled when rename and setStoragePolicy etc.

[ https://issues.apache.org/jira/browse/HDFS-14633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14633: --- Description: The NameNode manages the global state of the cluster. We should always take NameNode's records

[jira] [Updated] (HDFS-14633) The StorageType quota and consume in QuotaFeature is not handled when rename and setStoragePolicy etc.

[ https://issues.apache.org/jira/browse/HDFS-14633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14633: --- Summary: The StorageType quota and consume in QuotaFeature is not handled when rename and setStoragePolicy

[jira] [Commented] (HDFS-14568) The quota and consume of the file's ancestors are not handled when the storage policy of the file is changed.

[ https://issues.apache.org/jira/browse/HDFS-14568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16879657#comment-16879657 ] Jinglun commented on HDFS-14568: Hi [~ayushtkn], before the change setStoragePolicy() throws IOException

[jira] [Comment Edited] (HDFS-14568) The quota and consume of the file's ancestors are not handled when the storage policy of the file is changed.

[ https://issues.apache.org/jira/browse/HDFS-14568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16879657#comment-16879657 ] Jinglun edited comment on HDFS-14568 at 7/6/19 11:42 AM: - Hi [~ayushtkn], thanks

[jira] [Created] (HDFS-14633) The StorageType consume in QuotaFeature is not handled when addBlock, delete, rename, setStoragePolicy etc.

Jinglun created HDFS-14633: -- Summary: The StorageType consume in QuotaFeature is not handled when addBlock, delete, rename, setStoragePolicy etc. Key: HDFS-14633 URL: https://issues.apache.org/jira/browse/HDFS-14633

[jira] [Updated] (HDFS-14568) setStoragePolicy should check quota and update consume on storage type quota.

[ https://issues.apache.org/jira/browse/HDFS-14568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14568: --- Summary: setStoragePolicy should check quota and update consume on storage type quota. (was: The quota and

[jira] [Updated] (HDFS-14633) The StorageType qutoa and consume in QuotaFeature is not handled when addBlock, delete, rename, setStoragePolicy etc.

[ https://issues.apache.org/jira/browse/HDFS-14633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14633: --- Summary: The StorageType qutoa and consume in QuotaFeature is not handled when addBlock, delete, rename,

[jira] [Updated] (HDFS-14633) The StorageType quota and consume in QuotaFeature is not handled when addBlock, delete, rename, setStoragePolicy etc.

[ https://issues.apache.org/jira/browse/HDFS-14633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14633: --- Summary: The StorageType quota and consume in QuotaFeature is not handled when addBlock, delete, rename,

[jira] [Commented] (HDFS-14633) The StorageType consume in QuotaFeature is not handled when addBlock, delete, rename, setStoragePolicy etc.

[ https://issues.apache.org/jira/browse/HDFS-14633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16879660#comment-16879660 ] Jinglun commented on HDFS-14633: Hi [~ayushtkn] [~jojochuang] [~xkrogen] [~hexiaoqiao], do you have time

[jira] [Updated] (HDFS-14633) The StorageType quota and consume in QuotaFeature is not handled when addBlock, delete, rename, setStoragePolicy etc.

[ https://issues.apache.org/jira/browse/HDFS-14633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14633: --- Description: The NameNode manages the global state of the cluster. We should always take NameNode's records

[jira] [Updated] (HDFS-14633) The StorageType quota and consume in QuotaFeature is not handled when rename and setStoragePolicy etc.

[ https://issues.apache.org/jira/browse/HDFS-14633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14633: --- Description: The NameNode manages the global state of the cluster. We should always take NameNode's records

[jira] [Commented] (HDFS-14815) RBF: Update the quota in MountTable when calling setQuota on a MountTable src.

[ https://issues.apache.org/jira/browse/HDFS-14815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967194#comment-16967194 ] Jinglun commented on HDFS-14815: Thanks [~elgoiri] [~ayushtkn] your nice comments ! Upload v03. > RBF:

[jira] [Updated] (HDFS-14815) RBF: Update the quota in MountTable when calling setQuota on a MountTable src.

[ https://issues.apache.org/jira/browse/HDFS-14815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14815: --- Attachment: HDFS-14815.003.patch > RBF: Update the quota in MountTable when calling setQuota on a MountTable

[jira] [Commented] (HDFS-14815) RBF: Update the quota in MountTable when calling setQuota on a MountTable src.

[ https://issues.apache.org/jira/browse/HDFS-14815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967285#comment-16967285 ] Jinglun commented on HDFS-14815: Hi [~elgoiri] thanks your comments ! Agree with your suggestions. Upload

[jira] [Updated] (HDFS-14815) RBF: Update the quota in MountTable when calling setQuota on a MountTable src.

[ https://issues.apache.org/jira/browse/HDFS-14815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14815: --- Attachment: HDFS-14815.004.patch > RBF: Update the quota in MountTable when calling setQuota on a MountTable

[jira] [Commented] (HDFS-14908) LeaseManager should check parent-child relationship when filter open files.

[ https://issues.apache.org/jira/browse/HDFS-14908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16965572#comment-16965572 ] Jinglun commented on HDFS-14908: Hi [~elgoiri], I reran all the failed tests on my pc and they all

[jira] [Updated] (HDFS-14813) RBF: Make Global quota and Remote quota consistent.

[ https://issues.apache.org/jira/browse/HDFS-14813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14813: --- Description: Make Global quota and remote quota consistent. (Global quota: the quota on mount table, Remote

[jira] [Created] (HDFS-14955) RBF: getQuotaUsage() on mount point should return global quota.

Jinglun created HDFS-14955: -- Summary: RBF: getQuotaUsage() on mount point should return global quota. Key: HDFS-14955 URL: https://issues.apache.org/jira/browse/HDFS-14955 Project: Hadoop HDFS

[jira] [Commented] (HDFS-13811) RBF: Race condition between router admin quota update and periodic quota update service

[ https://issues.apache.org/jira/browse/HDFS-13811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969145#comment-16969145 ] Jinglun commented on HDFS-13811: {quote}IMO we should not update the mount table statestore internally,

[jira] [Assigned] (HDFS-13811) RBF: Race condition between router admin quota update and periodic quota update service

[ https://issues.apache.org/jira/browse/HDFS-13811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun reassigned HDFS-13811: -- Assignee: Jinglun (was: Dibyendu Karmakar) > RBF: Race condition between router admin quota update

[jira] [Commented] (HDFS-14908) LeaseManager should check parent-child relationship when filter open files.

[ https://issues.apache.org/jira/browse/HDFS-14908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969752#comment-16969752 ] Jinglun commented on HDFS-14908: Hi [~elgoiri], would you help to commit v05 ? Do we need another review

[jira] [Updated] (HDFS-14955) RBF: getQuotaUsage() on mount point should return global quota.

[ https://issues.apache.org/jira/browse/HDFS-14955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14955: --- Attachment: HDFS-14955.002.patch > RBF: getQuotaUsage() on mount point should return global quota. >

[jira] [Commented] (HDFS-14955) RBF: getQuotaUsage() on mount point should return global quota.

[ https://issues.apache.org/jira/browse/HDFS-14955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16973239#comment-16973239 ] Jinglun commented on HDFS-14955: Hi [~elgoiri], thanks your nice comments ! Update javadoc in v02. About

[jira] [Updated] (HDFS-14955) RBF: getQuotaUsage() on mount point should return global quota.

[ https://issues.apache.org/jira/browse/HDFS-14955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14955: --- Attachment: HDFS-14955.003.patch > RBF: getQuotaUsage() on mount point should return global quota. >

[jira] [Commented] (HDFS-14955) RBF: getQuotaUsage() on mount point should return global quota.

[ https://issues.apache.org/jira/browse/HDFS-14955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976270#comment-16976270 ] Jinglun commented on HDFS-14955: Hi [~ayushtkn], thanks your nice suggestion ! Upload v03. > RBF:

[jira] [Updated] (HDFS-14955) RBF: getQuotaUsage() on mount point should return global quota.

[ https://issues.apache.org/jira/browse/HDFS-14955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14955: --- Attachment: (was: HDFS-14955.003.patch) > RBF: getQuotaUsage() on mount point should return global

[jira] [Updated] (HDFS-14955) RBF: getQuotaUsage() on mount point should return global quota.

[ https://issues.apache.org/jira/browse/HDFS-14955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14955: --- Attachment: HDFS-14955.003.patch > RBF: getQuotaUsage() on mount point should return global quota. >

[jira] [Commented] (HDFS-14908) LeaseManager should check parent-child relationship when filter open files.

[ https://issues.apache.org/jira/browse/HDFS-14908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976378#comment-16976378 ] Jinglun commented on HDFS-14908: Would anybody like to give v05 a double check ? :) > LeaseManager

[jira] [Commented] (HDFS-14568) setStoragePolicy should check quota and update consume on storage type quota.

[ https://issues.apache.org/jira/browse/HDFS-14568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976496#comment-16976496 ] Jinglun commented on HDFS-14568: Hi [~xyao], would you like to help taking a review of v04 ? Thanks ! >

[jira] [Commented] (HDFS-14815) RBF: Update the quota in MountTable when calling setQuota on a MountTable src.

[ https://issues.apache.org/jira/browse/HDFS-14815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968870#comment-16968870 ] Jinglun commented on HDFS-14815: Hi [~ayushtkn], thanks your suggestions. Yes 'Mount entry' is more

[jira] [Updated] (HDFS-14815) RBF: Update the quota in MountTable when calling setQuota on a MountTable src.

[ https://issues.apache.org/jira/browse/HDFS-14815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14815: --- Attachment: HDFS-14815.005.patch > RBF: Update the quota in MountTable when calling setQuota on a MountTable

<    1   2   3   4   5   6   7   8   9   >