[jira] [Commented] (HDFS-15584) Improve HDFS large deletion cause namenode lockqueue boom and pending deletion boom.

2020-09-17 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17198133#comment-17198133 ] Hadoop QA commented on HDFS-15584: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-15585) ViewDFS#getDelegationToken should not throw UnsupportedOperationException.

2020-09-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-15585: -- Labels: pull-request-available (was: ) > ViewDFS#getDelegationToken should not throw

[jira] [Work logged] (HDFS-15585) ViewDFS#getDelegationToken should not throw UnsupportedOperationException.

2020-09-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15585?focusedWorklogId=486062=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-486062 ] ASF GitHub Bot logged work on HDFS-15585: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15579) RBF: The constructor of PathLocation may got some misunderstanding

2020-09-17 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17198106#comment-17198106 ] Hadoop QA commented on HDFS-15579: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Work logged] (HDFS-15548) Allow configuring DISK/ARCHIVE storage types on same device mount

2020-09-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15548?focusedWorklogId=486056=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-486056 ] ASF GitHub Bot logged work on HDFS-15548: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15548) Allow configuring DISK/ARCHIVE storage types on same device mount

2020-09-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15548?focusedWorklogId=486055=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-486055 ] ASF GitHub Bot logged work on HDFS-15548: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15548) Allow configuring DISK/ARCHIVE storage types on same device mount

2020-09-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15548?focusedWorklogId=486054=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-486054 ] ASF GitHub Bot logged work on HDFS-15548: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15584) Improve HDFS large deletion cause namenode lockqueue boom and pending deletion boom.

2020-09-17 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17198093#comment-17198093 ] zhuqi commented on HDFS-15584: -- cc [~sodonnell] ,   [~hexiaoqiao]  I add the draft patch without unit test.

[jira] [Updated] (HDFS-15584) Improve HDFS large deletion cause namenode lockqueue boom and pending deletion boom.

2020-09-17 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated HDFS-15584: - Attachment: HDFS-15584.001.patch Status: Patch Available (was: Open) > Improve HDFS large deletion

[jira] [Updated] (HDFS-15578) Fix the rename issues with fallback fs enabled

2020-09-17 Thread Uma Maheswara Rao G (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-15578: --- Fix Version/s: 3.4.0 3.3.1 Hadoop Flags: Reviewed

[jira] [Created] (HDFS-15585) ViewDFS#getDelegationToken should not throw UnsupportedOperationException.

2020-09-17 Thread Uma Maheswara Rao G (Jira)
Uma Maheswara Rao G created HDFS-15585: -- Summary: ViewDFS#getDelegationToken should not throw UnsupportedOperationException. Key: HDFS-15585 URL: https://issues.apache.org/jira/browse/HDFS-15585

[jira] [Work logged] (HDFS-15548) Allow configuring DISK/ARCHIVE storage types on same device mount

2020-09-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15548?focusedWorklogId=486043=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-486043 ] ASF GitHub Bot logged work on HDFS-15548: - Author: ASF GitHub Bot

[jira] [Created] (HDFS-15584) Improve HDFS large deletion cause namenode lockqueue boom and pending deletion boom.

2020-09-17 Thread zhuqi (Jira)
zhuqi created HDFS-15584: Summary: Improve HDFS large deletion cause namenode lockqueue boom and pending deletion boom. Key: HDFS-15584 URL: https://issues.apache.org/jira/browse/HDFS-15584 Project: Hadoop

[jira] [Updated] (HDFS-15579) RBF: The constructor of PathLocation may got some misunderstanding

2020-09-17 Thread Janus Chow (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Janus Chow updated HDFS-15579: -- Attachment: HDFS-15579-002.patch > RBF: The constructor of PathLocation may got some misunderstanding

[jira] [Commented] (HDFS-15579) RBF: The constructor of PathLocation may got some misunderstanding

2020-09-17 Thread Janus Chow (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17198072#comment-17198072 ] Janus Chow commented on HDFS-15579: --- Updated the static function version [^HDFS-15579-002.patch],

[jira] [Work logged] (HDFS-15548) Allow configuring DISK/ARCHIVE storage types on same device mount

2020-09-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15548?focusedWorklogId=486031=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-486031 ] ASF GitHub Bot logged work on HDFS-15548: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15548) Allow configuring DISK/ARCHIVE storage types on same device mount

2020-09-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15548?focusedWorklogId=486033=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-486033 ] ASF GitHub Bot logged work on HDFS-15548: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15548) Allow configuring DISK/ARCHIVE storage types on same device mount

2020-09-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15548?focusedWorklogId=486030=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-486030 ] ASF GitHub Bot logged work on HDFS-15548: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15548) Allow configuring DISK/ARCHIVE storage types on same device mount

2020-09-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15548?focusedWorklogId=486029=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-486029 ] ASF GitHub Bot logged work on HDFS-15548: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15548) Allow configuring DISK/ARCHIVE storage types on same device mount

2020-09-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15548?focusedWorklogId=486027=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-486027 ] ASF GitHub Bot logged work on HDFS-15548: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15579) RBF: The constructor of PathLocation may got some misunderstanding

2020-09-17 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17197890#comment-17197890 ] Íñigo Goiri commented on HDFS-15579: We should probably make this new method static right? > RBF:

[jira] [Assigned] (HDFS-15579) RBF: The constructor of PathLocation may got some misunderstanding

2020-09-17 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri reassigned HDFS-15579: -- Assignee: Janus Chow > RBF: The constructor of PathLocation may got some misunderstanding >

[jira] [Updated] (HDFS-15579) RBF: The constructor of PathLocation may got some misunderstanding

2020-09-17 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-15579: --- Status: Patch Available (was: Open) > RBF: The constructor of PathLocation may got some

[jira] [Updated] (HDFS-15583) Backport DirectoryScanner improvements HDFS-14476, HDFS-14751 and HDFS-15048 to branch 3.2 and 3.1

2020-09-17 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15583: - Affects Version/s: 3.2.0 3.2.1 Status: Patch

[jira] [Updated] (HDFS-15583) Backport DirectoryScanner improvements HDFS-14476, HDFS-14751 and HDFS-15048 to branch 3.2 and 3.1

2020-09-17 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15583: - Attachment: HDFS-15583.branch-3.2.001.patch > Backport DirectoryScanner improvements

[jira] [Created] (HDFS-15583) Backport DirectoryScanner improvements HDFS-14476, HDFS-14751 and HDFS-15048 to branch 3.2 and 3.1

2020-09-17 Thread Stephen O'Donnell (Jira)
Stephen O'Donnell created HDFS-15583: Summary: Backport DirectoryScanner improvements HDFS-14476, HDFS-14751 and HDFS-15048 to branch 3.2 and 3.1 Key: HDFS-15583 URL:

[jira] [Commented] (HDFS-15415) Reduce locking in Datanode DirectoryScanner

2020-09-17 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17197710#comment-17197710 ] Stephen O'Donnell commented on HDFS-15415: -- All tests passed locally. I have committed to trunk

[jira] [Updated] (HDFS-15415) Reduce locking in Datanode DirectoryScanner

2020-09-17 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15415: - Fix Version/s: 3.4.0 > Reduce locking in Datanode DirectoryScanner >

[jira] [Updated] (HDFS-15415) Reduce locking in Datanode DirectoryScanner

2020-09-17 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15415: - Attachment: HDFS-15415.branch-3.3.001.patch > Reduce locking in Datanode

[jira] [Updated] (HDFS-15582) Reduce NameNode audit log

2020-09-17 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15582: --- Attachment: HDFS-15582.001.patch > Reduce NameNode audit log > - > >

[jira] [Updated] (HDFS-15582) Reduce NameNode audit log

2020-09-17 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15582: --- Attachment: HDFS-15582.001.patch Status: Patch Available (was: Open) > Reduce NameNode audit log >

[jira] [Updated] (HDFS-15582) Reduce NameNode audit log

2020-09-17 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15582: --- Attachment: (was: HDFS-15582.001.patch) > Reduce NameNode audit log > - > >

[jira] [Created] (HDFS-15582) Reduce NameNode audit log

2020-09-17 Thread Jinglun (Jira)
Jinglun created HDFS-15582: -- Summary: Reduce NameNode audit log Key: HDFS-15582 URL: https://issues.apache.org/jira/browse/HDFS-15582 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Assigned] (HDFS-15582) Reduce NameNode audit log

2020-09-17 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun reassigned HDFS-15582: -- Assignee: Jinglun > Reduce NameNode audit log > - > > Key:

[jira] [Work logged] (HDFS-15548) Allow configuring DISK/ARCHIVE storage types on same device mount

2020-09-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15548?focusedWorklogId=485723=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-485723 ] ASF GitHub Bot logged work on HDFS-15548: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15098) Add SM4 encryption method for HDFS

2020-09-17 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17197585#comment-17197585 ] Hadoop QA commented on HDFS-15098: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (HDFS-15568) namenode start failed to start when dfs.namenode.snapshot.max.limit set

2020-09-17 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee resolved HDFS-15568. Fix Version/s: 3.4.0 Resolution: Fixed > namenode start failed to start

[jira] [Work logged] (HDFS-15568) namenode start failed to start when dfs.namenode.snapshot.max.limit set

2020-09-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15568?focusedWorklogId=485609=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-485609 ] ASF GitHub Bot logged work on HDFS-15568: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15568) namenode start failed to start when dfs.namenode.snapshot.max.limit set

2020-09-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15568?focusedWorklogId=485610=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-485610 ] ASF GitHub Bot logged work on HDFS-15568: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15098) Add SM4 encryption method for HDFS

2020-09-17 Thread Vinayakumar B (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17197405#comment-17197405 ] Vinayakumar B commented on HDFS-15098: -- Thanks [~seanlau] for the update. Only one nit from my