[jira] [Updated] (HDFS-15340) RBF: Implement BalanceProcedureScheduler basic framework

2020-05-13 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15340: --- Attachment: HDFS-15340.005.patch > RBF: Implement BalanceProcedureScheduler basic framework >

[jira] [Created] (HDFS-15353) Allow nologin hdfs user to run secure DataNode

2020-05-13 Thread Akira Ajisaka (Jira)
Akira Ajisaka created HDFS-15353: Summary: Allow nologin hdfs user to run secure DataNode Key: HDFS-15353 URL: https://issues.apache.org/jira/browse/HDFS-15353 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-15353) Allow nologin hdfs user to run secure DataNode

2020-05-13 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-15353: - Component/s: (was: hdfs) datanode > Allow nologin hdfs user to run secure

[jira] [Commented] (HDFS-15340) RBF: Implement BalanceProcedureScheduler basic framework

2020-05-13 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106092#comment-17106092 ] Hadoop QA commented on HDFS-15340: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-15340) RBF: Implement BalanceProcedureScheduler basic framework

2020-05-13 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106014#comment-17106014 ] Jinglun commented on HDFS-15340: Hi [~linyiqun], thanks your great comments !  Upload v05. {quote}How

[jira] [Commented] (HDFS-15340) RBF: Implement BalanceProcedureScheduler basic framework

2020-05-13 Thread Yiqun Lin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106006#comment-17106006 ] Yiqun Lin commented on HDFS-15340: -- Additional comments for the unit test: {code:java} +

[jira] [Assigned] (HDFS-15353) Allow nologin hdfs user to run secure DataNode

2020-05-13 Thread Kei Kori (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kei Kori reassigned HDFS-15353: --- Assignee: Kei Kori > Allow nologin hdfs user to run secure DataNode >

[jira] [Commented] (HDFS-15340) RBF: Implement BalanceProcedureScheduler basic framework

2020-05-13 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106226#comment-17106226 ] Hadoop QA commented on HDFS-15340: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-15340) RBF: Implement BalanceProcedureScheduler basic framework

2020-05-13 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15340: --- Attachment: HDFS-15340.006.patch > RBF: Implement BalanceProcedureScheduler basic framework >

[jira] [Commented] (HDFS-15340) RBF: Implement BalanceProcedureScheduler basic framework

2020-05-13 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106185#comment-17106185 ] Jinglun commented on HDFS-15340: Hi [~linyiqun], thanks your nice  comments ! Upload v06. {quote}We need

[jira] [Commented] (HDFS-15310) RBF: Not proxy client's clientId and callId caused RetryCache invalid in NameNode.

2020-05-13 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106491#comment-17106491 ] Íñigo Goiri commented on HDFS-15310: It looks like we are more or less in the same patch. Should we

[jira] [Updated] (HDFS-15351) Blocks Scheduled Count was wrong on Truncate

2020-05-13 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15351: - Attachment: HDFS-15351.003.patch > Blocks Scheduled Count was wrong on Truncate >

[jira] [Commented] (HDFS-15038) TestFsck testFsckListCorruptSnapshotFiles is failing in trunk

2020-05-13 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106444#comment-17106444 ] Jim Brennan commented on HDFS-15038: [~ayushtkn], [~hemanthboyina], [~inigoiri], we are seeing this

[jira] [Commented] (HDFS-15175) Multiple CloseOp shared block instance causes the standby namenode to crash when rolling editlog

2020-05-13 Thread Wan Chang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106439#comment-17106439 ] Wan Chang commented on HDFS-15175: -- Hi [~caiyicong]  I dig for a while but can not find a convenient

[jira] [Commented] (HDFS-15351) Blocks Scheduled Count was wrong on Truncate

2020-05-13 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106649#comment-17106649 ] Hadoop QA commented on HDFS-15351: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15038) TestFsck testFsckListCorruptSnapshotFiles is failing in trunk

2020-05-13 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106474#comment-17106474 ] Ayush Saxena commented on HDFS-15038: - Seems me and [~elgoiri] saw it together :) Anyway thanks

[jira] [Commented] (HDFS-15351) Blocks Scheduled Count was wrong on Truncate

2020-05-13 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106488#comment-17106488 ] Íñigo Goiri commented on HDFS-15351: Thanks [~hemanthboyina], I was thinking more about extracting

[jira] [Commented] (HDFS-15351) Blocks Scheduled Count was wrong on Truncate

2020-05-13 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106503#comment-17106503 ] hemanthboyina commented on HDFS-15351: -- thanks for the review [~elgoiri] have updated the patch ,

[jira] [Updated] (HDFS-15349) Adapt the netty4 ARM support switch(YARN-9898)

2020-05-13 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15349: Resolution: Duplicate Status: Resolved (was: Patch Available) > Adapt the netty4 ARM

[jira] [Updated] (HDFS-15038) TestFsck testFsckListCorruptSnapshotFiles is failing in trunk

2020-05-13 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated HDFS-15038: --- Attachment: HDFS-15038-branch-2.10.001.patch > TestFsck testFsckListCorruptSnapshotFiles is failing

[jira] [Updated] (HDFS-15038) TestFsck testFsckListCorruptSnapshotFiles is failing in trunk

2020-05-13 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15038: Status: Patch Available (was: Reopened) > TestFsck testFsckListCorruptSnapshotFiles is failing in

[jira] [Reopened] (HDFS-15038) TestFsck testFsckListCorruptSnapshotFiles is failing in trunk

2020-05-13 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena reopened HDFS-15038: - Reopening for branch-2 backport > TestFsck testFsckListCorruptSnapshotFiles is failing in trunk >

[jira] [Commented] (HDFS-15340) RBF: Implement BalanceProcedureScheduler basic framework

2020-05-13 Thread Yiqun Lin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106419#comment-17106419 ] Yiqun Lin commented on HDFS-15340: -- The comment makes sense to me, thanks [~LiJinglun]. And the latest

[jira] [Commented] (HDFS-15038) TestFsck testFsckListCorruptSnapshotFiles is failing in trunk

2020-05-13 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106471#comment-17106471 ] Íñigo Goiri commented on HDFS-15038: To avoid conflicts with [~ayushtkn], I'll let Yetus go ahead and

[jira] [Commented] (HDFS-12288) Fix DataNode's xceiver count calculation

2020-05-13 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106483#comment-17106483 ] Íñigo Goiri commented on HDFS-12288: +1 on [^HDFS-12288.008.patch]. It would be nice to have

[jira] [Commented] (HDFS-15351) Blocks Scheduled Count was wrong on Truncate

2020-05-13 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106486#comment-17106486 ] hemanthboyina commented on HDFS-15351: -- thanks for the review [~elgoiri] i have updated the patch ,

[jira] [Updated] (HDFS-15351) Blocks Scheduled Count was wrong on Truncate

2020-05-13 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15351: - Attachment: HDFS-15351.002.patch > Blocks Scheduled Count was wrong on Truncate >

[jira] [Resolved] (HDFS-15344) DataNode#checkSuperuserPrivilege should use UGI#getGroups after HADOOP-13442

2020-05-13 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDFS-15344. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Thanks all for the

[jira] [Commented] (HDFS-15344) DataNode#checkSuperuserPrivilege should use UGI#getGroups after HADOOP-13442

2020-05-13 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106586#comment-17106586 ] Hudson commented on HDFS-15344: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18252 (See

[jira] [Created] (HDFS-15354) clearCorruptLazyPersistFiles incrementalBlock removal should be out side write lock

2020-05-13 Thread Uma Maheswara Rao G (Jira)
Uma Maheswara Rao G created HDFS-15354: -- Summary: clearCorruptLazyPersistFiles incrementalBlock removal should be out side write lock Key: HDFS-15354 URL: https://issues.apache.org/jira/browse/HDFS-15354

[jira] [Commented] (HDFS-15038) TestFsck testFsckListCorruptSnapshotFiles is failing in trunk

2020-05-13 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106596#comment-17106596 ] Hadoop QA commented on HDFS-15038: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15038) TestFsck testFsckListCorruptSnapshotFiles is failing in trunk

2020-05-13 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106466#comment-17106466 ] Íñigo Goiri commented on HDFS-15038: Thanks [~Jim_Brennan] for the backport. I'm committing to

[jira] [Commented] (HDFS-15351) Blocks Scheduled Count was wrong on Truncate

2020-05-13 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106631#comment-17106631 ] Hadoop QA commented on HDFS-15351: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15207) VolumeScanner skip to scan blocks accessed during recent scan peroid

2020-05-13 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106826#comment-17106826 ] Yang Yun commented on HDFS-15207: - Thanks  [~elgoiri] [~weichiu] for the review. Is this patch ready to

[jira] [Updated] (HDFS-15355) Make the default block storage policy ID configurable

2020-05-13 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15355: Attachment: (was: HDFS-15355.001.patch) > Make the default block storage policy ID configurable >

[jira] [Updated] (HDFS-15355) Make the default block storage policy ID configurable

2020-05-13 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15355: Attachment: HDFS-15355.001.patch Status: Patch Available (was: Open) > Make the default block

[jira] [Created] (HDFS-15355) Make the default block storage policy ID configurable

2020-05-13 Thread Yang Yun (Jira)
Yang Yun created HDFS-15355: --- Summary: Make the default block storage policy ID configurable Key: HDFS-15355 URL: https://issues.apache.org/jira/browse/HDFS-15355 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-15355) Make the default block storage policy ID configurable

2020-05-13 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15355: Attachment: HDFS-15355.001.patch Priority: Minor (was: Major) > Make the default block storage

[jira] [Commented] (HDFS-15355) Make the default block storage policy ID configurable

2020-05-13 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106842#comment-17106842 ] Ayush Saxena commented on HDFS-15355: - We can set the storage policy on root, and it will behave same

[jira] [Commented] (HDFS-15333) Vulnerability fixes need for jackson-databinding HDFS dependency library

2020-05-13 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106840#comment-17106840 ] Masatake Iwasaki commented on HDFS-15333: - {quote} We should just remove htrace from dependency.

[jira] [Commented] (HDFS-15355) Make the default block storage policy ID configurable

2020-05-13 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106851#comment-17106851 ] Yang Yun commented on HDFS-15355: - Thanks [~ayushtkn] for the review. Yes, set the sotrage policy on

[jira] [Updated] (HDFS-15316) Deletion failure should not remove directory from snapshottables

2020-05-13 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-15316: -- Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved

[jira] [Commented] (HDFS-15316) Deletion failure should not remove directory from snapshottables

2020-05-13 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106173#comment-17106173 ] Hudson commented on HDFS-15316: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18250 (See

[jira] [Commented] (HDFS-15198) RBF: Add test for MountTableRefresherService failed to refresh other router MountTableEntries in secure mode

2020-05-13 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106384#comment-17106384 ] Ayush Saxena commented on HDFS-15198: - [~zhengchenyu] plans updating? > RBF: Add test for