[jira] [Commented] (HDFS-15023) [SBN read] ZKFC should check the state before joining the election

2019-12-03 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987610#comment-16987610 ] Ayush Saxena commented on HDFS-15023: - Thanx [~ferhui], overall Looks Good. {code:java} 276

[jira] [Commented] (HDFS-13811) RBF: Race condition between router admin quota update and periodic quota update service

2019-12-03 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987586#comment-16987586 ] Jinglun commented on HDFS-13811: Hi [~linyiqun], thanks your comments ! I rollback the changes except the

[jira] [Updated] (HDFS-13811) RBF: Race condition between router admin quota update and periodic quota update service

2019-12-03 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13811: --- Attachment: HDFS-13811.007.patch > RBF: Race condition between router admin quota update and periodic quota

[jira] [Updated] (HDFS-15023) [SBN read] ZKFC should check the state before joining the election

2019-12-03 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-15023: --- Attachment: HDFS-15023.002.patch > [SBN read] ZKFC should check the state before joining the election >

[jira] [Commented] (HDFS-15023) [SBN read] ZKFC should check the state before joining the election

2019-12-03 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987578#comment-16987578 ] Fei Hui commented on HDFS-15023: [~ayushtkn] Thanks for your comments. I had a mistake. I shouldn't

[jira] [Commented] (HDFS-14990) HDFS: No symbolic icon to represent decommissioning state of datanode in Name node WEB UI

2019-12-03 Thread Xieming Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987568#comment-16987568 ] Xieming Li commented on HDFS-14990: --- [~ayushtkn] Thank you for your feedback. I will just ignore this

[jira] [Commented] (HDFS-14983) RBF: Add dfsrouteradmin -refreshSuperUserGroupsConfiguration command option

2019-12-03 Thread Xieming Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987567#comment-16987567 ] Xieming Li commented on HDFS-14983: --- I have uploaded a patch that works, and I hope to get some

[jira] [Commented] (HDFS-14990) HDFS: No symbolic icon to represent decommissioning state of datanode in Name node WEB UI

2019-12-03 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987566#comment-16987566 ] Ayush Saxena commented on HDFS-14990: - The symbol is there for me in the UI too > HDFS: No symbolic

[jira] [Updated] (HDFS-14983) RBF: Add dfsrouteradmin -refreshSuperUserGroupsConfiguration command option

2019-12-03 Thread Xieming Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xieming Li updated HDFS-14983: -- Attachment: HDFS-14983.draft.001.patch Status: Patch Available (was: In Progress) > RBF: Add

[jira] [Updated] (HDFS-14990) HDFS: No symbolic icon to represent decommissioning state of datanode in Name node WEB UI

2019-12-03 Thread Xieming Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xieming Li updated HDFS-14990: -- Status: Open (was: Patch Available) > HDFS: No symbolic icon to represent decommissioning state of

[jira] [Updated] (HDFS-14990) HDFS: No symbolic icon to represent decommissioning state of datanode in Name node WEB UI

2019-12-03 Thread Xieming Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xieming Li updated HDFS-14990: -- Attachment: (was: HDFS-14893.draft.001.patch) > HDFS: No symbolic icon to represent

[jira] [Commented] (HDFS-15031) Allow BootstrapStandby to download FSImage if the directory is already formatted

2019-12-03 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987561#comment-16987561 ] Hadoop QA commented on HDFS-15031: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-14990) HDFS: No symbolic icon to represent decommissioning state of datanode in Name node WEB UI

2019-12-03 Thread Xieming Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xieming Li updated HDFS-14990: -- Attachment: HDFS-14893.draft.001.patch Status: Patch Available (was: In Progress) > HDFS: No

[jira] [Commented] (HDFS-14990) HDFS: No symbolic icon to represent decommissioning state of datanode in Name node WEB UI

2019-12-03 Thread Xieming Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987560#comment-16987560 ] Xieming Li commented on HDFS-14990: --- Ping. Any thoughts on this ticket? > HDFS: No symbolic icon to

[jira] [Commented] (HDFS-15027) Correct target DN's log while balancing.

2019-12-03 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987559#comment-16987559 ] Hadoop QA commented on HDFS-15027: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14997) BPServiceActor process command from NameNode asynchronously

2019-12-03 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987530#comment-16987530 ] Xiaoqiao He commented on HDFS-14997: Ping [~elgoiri],[~sodonnell],[~weichiu] any furthermore comments

[jira] [Commented] (HDFS-15010) BlockPoolSlice#addReplicaThreadPool static pool should be initialized by static method

2019-12-03 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987532#comment-16987532 ] Surendra Singh Lilhore commented on HDFS-15010: --- [~yuvaldeg],  Sure, I will do it. Need to

[jira] [Commented] (HDFS-14519) NameQuota is not update after concat operation, so namequota is wrong

2019-12-03 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987529#comment-16987529 ] Ayush Saxena commented on HDFS-14519: - Will try backport in couple of days. > NameQuota is not

[jira] [Commented] (HDFS-15009) FSCK "-list-corruptfileblocks" return Invalid Entries

2019-12-03 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987528#comment-16987528 ] Ayush Saxena commented on HDFS-15009: - [~hemanthboyina] can you reopen and provide patches for lower

[jira] [Comment Edited] (HDFS-15024) [SBN read] In FailoverOnNetworkExceptionRetry , Number of NameNodes as a condition of calculation of sleep time

2019-12-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16986882#comment-16986882 ] huhaiyang edited comment on HDFS-15024 at 12/4/19 4:17 AM: --- [~xkrogen] [~csun]

[jira] [Commented] (HDFS-14546) Document block placement policies

2019-12-03 Thread Amithsha (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987504#comment-16987504 ] Amithsha commented on HDFS-14546: - [~weichiu] Yes will remove the PR from jira. Have updated the git but

[jira] [Commented] (HDFS-13811) RBF: Race condition between router admin quota update and periodic quota update service

2019-12-03 Thread Yiqun Lin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987503#comment-16987503 ] Yiqun Lin commented on HDFS-13811: -- [~LiJinglun], following change of the unit test can also rollback.

[jira] [Commented] (HDFS-15005) Backport HDFS-12300 to branch-2

2019-12-03 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987494#comment-16987494 ] Hadoop QA commented on HDFS-15005: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14825) [Dynamometer] Workload doesn't start unless an absolute path of Mapper class given

2019-12-03 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987462#comment-16987462 ] Hudson commented on HDFS-14825: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17716 (See

[jira] [Commented] (HDFS-15027) Correct target DN's log while balancing.

2019-12-03 Thread Xudong Cao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987459#comment-16987459 ] Xudong Cao commented on HDFS-15027: --- cc [~weichiu] Sorry, patch uploaded again, this is just a minor

[jira] [Comment Edited] (HDFS-15027) Correct target DN's log while balancing.

2019-12-03 Thread Xudong Cao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987459#comment-16987459 ] Xudong Cao edited comment on HDFS-15027 at 12/4/19 2:40 AM: cc [~weichiu] 

[jira] [Updated] (HDFS-15027) Correct target DN's log while balancing.

2019-12-03 Thread Xudong Cao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xudong Cao updated HDFS-15027: -- Attachment: HDFS-15027.000.patch > Correct target DN's log while balancing. >

[jira] [Updated] (HDFS-15027) Correct target DN's log while balancing.

2019-12-03 Thread Xudong Cao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xudong Cao updated HDFS-15027: -- Description: During HDFS balancing, after the target DN copied a block from the proxy DN, it prints a

[jira] [Updated] (HDFS-15027) Correct target DN's log while balancing.

2019-12-03 Thread Xudong Cao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xudong Cao updated HDFS-15027: -- Description: During HDFS balancing, after the target DN copied a block from the proxy DN, it prints a

[jira] [Commented] (HDFS-14998) Update Observer Namenode doc for ZKFC after HDFS-14130

2019-12-03 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987452#comment-16987452 ] Hadoop QA commented on HDFS-14998: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Resolved] (HDFS-14825) [Dynamometer] Workload doesn't start unless an absolute path of Mapper class given

2019-12-03 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-14825. -- Fix Version/s: 3.3.0 Hadoop Flags: Reviewed Resolution: Fixed Merged into trunk.

[jira] [Assigned] (HDFS-14980) diskbalancer query command always tries to contact to port 9867

2019-12-03 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan reassigned HDFS-14980: Assignee: Aravindan Vijayan (was: Siddharth Wagle) > diskbalancer query command

[jira] [Assigned] (HDFS-14980) diskbalancer query command always tries to contact to port 9867

2019-12-03 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan reassigned HDFS-14980: Assignee: Siddharth Wagle (was: Aravindan Vijayan) > diskbalancer query command

[jira] [Updated] (HDFS-15031) Allow BootstrapStandby to download FSImage if the directory is already formatted

2019-12-03 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-15031: --- Status: Patch Available (was: Open) > Allow BootstrapStandby to download FSImage if the directory

[jira] [Updated] (HDFS-15031) Allow BootstrapStandby to download FSImage if the directory is already formatted

2019-12-03 Thread Danny Becker (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Becker updated HDFS-15031: Attachment: HDFS-15031.000.patch > Allow BootstrapStandby to download FSImage if the directory is

[jira] [Assigned] (HDFS-15031) Allow BootstrapStandby to download FSImage if the directory is already formatted

2019-12-03 Thread Danny Becker (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Becker reassigned HDFS-15031: --- Assignee: Danny Becker > Allow BootstrapStandby to download FSImage if the directory is

[jira] [Created] (HDFS-15031) Allow BootstrapStandby to download FSImage if the directory is already formatted

2019-12-03 Thread Danny Becker (Jira)
Danny Becker created HDFS-15031: --- Summary: Allow BootstrapStandby to download FSImage if the directory is already formatted Key: HDFS-15031 URL: https://issues.apache.org/jira/browse/HDFS-15031

[jira] [Commented] (HDFS-14998) Update Observer Namenode doc for ZKFC after HDFS-14130

2019-12-03 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987416#comment-16987416 ] Fei Hui commented on HDFS-14998: [~ayushtkn][~csun][~shv] Thanks for your comments. Upload v005 patch.

[jira] [Updated] (HDFS-14998) Update Observer Namenode doc for ZKFC after HDFS-14130

2019-12-03 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-14998: --- Attachment: HDFS-14998.004.patch > Update Observer Namenode doc for ZKFC after HDFS-14130 >

[jira] [Commented] (HDFS-14963) Add HDFS Client machine caching active namenode index mechanism.

2019-12-03 Thread Xudong Cao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987411#comment-16987411 ] Xudong Cao commented on HDFS-14963: --- cc [~weichiu] All review comments have been resolved, could

[jira] [Updated] (HDFS-15005) Backport HDFS-12300 to branch-2

2019-12-03 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-15005: Attachment: HDFS-15005-branch-2.002.patch > Backport HDFS-12300 to branch-2 >

[jira] [Commented] (HDFS-15005) Backport HDFS-12300 to branch-2

2019-12-03 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987346#comment-16987346 ] Chao Sun commented on HDFS-15005: - Thansk [~weichiu] and sorry missed many unused imports. One question

[jira] [Commented] (HDFS-14998) Update Observer Namenode doc for ZKFC after HDFS-14130

2019-12-03 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987338#comment-16987338 ] Konstantin Shvachko commented on HDFS-14998: I see you guys are all on the same page here,

[jira] [Commented] (HDFS-15010) BlockPoolSlice#addReplicaThreadPool static pool should be initialized by static method

2019-12-03 Thread Yuval Degani (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987305#comment-16987305 ] Yuval Degani commented on HDFS-15010: - [~surendrasingh], would you consider backporting this patch to

[jira] [Commented] (HDFS-15009) FSCK "-list-corruptfileblocks" return Invalid Entries

2019-12-03 Thread Yuval Degani (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987303#comment-16987303 ] Yuval Degani commented on HDFS-15009: - [~ayushtkn], [~hemanthboyina], would you mind backporting this

[jira] [Commented] (HDFS-14519) NameQuota is not update after concat operation, so namequota is wrong

2019-12-03 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987291#comment-16987291 ] Erik Krogen commented on HDFS-14519: [~RANith] or [~ayushtkn], are you interested in putting together

[jira] [Commented] (HDFS-15027) Correct target DN's log while balancing.

2019-12-03 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987284#comment-16987284 ] Wei-Chiu Chuang commented on HDFS-15027: Was the patch file deleted from the attachments? >

[jira] [Commented] (HDFS-15030) Add setQuota operation to HttpFS

2019-12-03 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987280#comment-16987280 ] Wei-Chiu Chuang commented on HDFS-15030: I thought it was added by HDFS-8631? Looks like the

[jira] [Commented] (HDFS-15022) Add new RPC to transfer data block with external shell script across Datanode

2019-12-03 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987276#comment-16987276 ] Wei-Chiu Chuang commented on HDFS-15022: This looks like a new feature to me. Can we add

[jira] [Commented] (HDFS-15005) Backport HDFS-12300 to branch-2

2019-12-03 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987274#comment-16987274 ] Wei-Chiu Chuang commented on HDFS-15005: Cool. For my future reference:

[jira] [Commented] (HDFS-14546) Document block placement policies

2019-12-03 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987251#comment-16987251 ] Wei-Chiu Chuang commented on HDFS-14546: [~Amithsha] sounds like you moved to the patch files

[jira] [Commented] (HDFS-14957) INodeReference Space Consumed was not same in QuotaUsage and ContentSummary

2019-12-03 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987235#comment-16987235 ] Hadoop QA commented on HDFS-14957: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-14998) Update Observer Namenode doc for ZKFC after HDFS-14130

2019-12-03 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987202#comment-16987202 ] Ayush Saxena commented on HDFS-14998: - [~ferhui] you need to exactly copy paste the words, if you

[jira] [Commented] (HDFS-15016) RBF: getDatanodeReport() should return the latest update

2019-12-03 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987196#comment-16987196 ] Ayush Saxena commented on HDFS-15016: - Not as such preference, I am fine as far as it covers our

[jira] [Commented] (HDFS-14908) LeaseManager should check parent-child relationship when filter open files.

2019-12-03 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987194#comment-16987194 ] Íñigo Goiri commented on HDFS-14908: Thanks for rebasing and checking the issue. HDFS-15009 seems to

[jira] [Commented] (HDFS-14957) INodeReference Space Consumed was not same in QuotaUsage and ContentSummary

2019-12-03 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987189#comment-16987189 ] Ayush Saxena commented on HDFS-14957: - bq. for calculating space consumed , we are cosidering file

[jira] [Commented] (HDFS-15016) RBF: getDatanodeReport() should return the latest update

2019-12-03 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987188#comment-16987188 ] Íñigo Goiri commented on HDFS-15016: Thanks [~ayushtkn], let me fix the logging. Any preference for

[jira] [Commented] (HDFS-15012) NN fails to parse Edit logs after applying HDFS-13101

2019-12-03 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987183#comment-16987183 ] Ayush Saxena commented on HDFS-15012: - HDFS-13101 is fixing FSImage Corruption, that too seems a

[jira] [Commented] (HDFS-15016) RBF: getDatanodeReport() should return the latest update

2019-12-03 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987172#comment-16987172 ] Ayush Saxena commented on HDFS-15016: - Thanx [~elgoiri] for the patch. Fix LGTM. Just FYI. this Log,

[jira] [Commented] (HDFS-15012) NN fails to parse Edit logs after applying HDFS-13101

2019-12-03 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987164#comment-16987164 ] Wei-Chiu Chuang commented on HDFS-15012: We are actively working on this. However given the

[jira] [Updated] (HDFS-15012) NN fails to parse Edit logs after applying HDFS-13101

2019-12-03 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15012: --- Target Version/s: 3.0.4, 3.3.0, 2.8.6, 2.9.3, 3.1.4, 3.2.2, 2.10.1 Labels:

[jira] [Updated] (HDFS-15012) NN fails to parse Edit logs after applying HDFS-13101

2019-12-03 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15012: --- Priority: Blocker (was: Critical) > NN fails to parse Edit logs after applying HDFS-13101 >

[jira] [Commented] (HDFS-14957) INodeReference Space Consumed was not same in QuotaUsage and ContentSummary

2019-12-03 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987144#comment-16987144 ] Íñigo Goiri commented on HDFS-14957: * Can we minimize the diff? Currently lines 889 to 893 are the

[jira] [Commented] (HDFS-14901) RBF: Add Encryption Zone related ClientProtocol APIs

2019-12-03 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987140#comment-16987140 ] Íñigo Goiri commented on HDFS-14901: The test is fairly fast:

[jira] [Commented] (HDFS-14998) Update Observer Namenode doc for ZKFC after HDFS-14130

2019-12-03 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987138#comment-16987138 ] Chao Sun commented on HDFS-14998: - [~ferhui] without ZKFC running it is not quite useful to just run the

[jira] [Created] (HDFS-15030) Add setQuota operation to HttpFS

2019-12-03 Thread hemanthboyina (Jira)
hemanthboyina created HDFS-15030: Summary: Add setQuota operation to HttpFS Key: HDFS-15030 URL: https://issues.apache.org/jira/browse/HDFS-15030 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-14957) INodeReference Space Consumed was not same in QuotaUsage and ContentSummary

2019-12-03 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987095#comment-16987095 ] hemanthboyina commented on HDFS-14957: -- attached patch , please review > INodeReference Space

[jira] [Updated] (HDFS-14957) INodeReference Space Consumed was not same in QuotaUsage and ContentSummary

2019-12-03 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-14957: - Attachment: HDFS-14957.001.patch Status: Patch Available (was: Open) > INodeReference

[jira] [Commented] (HDFS-13811) RBF: Race condition between router admin quota update and periodic quota update service

2019-12-03 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16986920#comment-16986920 ] Hadoop QA commented on HDFS-13811: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Comment Edited] (HDFS-15024) [SBN read] In FailoverOnNetworkExceptionRetry , Number of NameNodes as a condition of calculation of sleep time

2019-12-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16986891#comment-16986891 ] huhaiyang edited comment on HDFS-15024 at 12/3/19 1:26 PM: --- Current In

[jira] [Comment Edited] (HDFS-15024) [SBN read] In FailoverOnNetworkExceptionRetry , Number of NameNodes as a condition of calculation of sleep time

2019-12-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16986891#comment-16986891 ] huhaiyang edited comment on HDFS-15024 at 12/3/19 1:26 PM: --- Current In

[jira] [Commented] (HDFS-15024) [SBN read] In FailoverOnNetworkExceptionRetry , Number of NameNodes as a condition of calculation of sleep time

2019-12-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16986891#comment-16986891 ] huhaiyang commented on HDFS-15024: -- In RetryPolicies Implemented /** * @return 0 if this is our

[jira] [Comment Edited] (HDFS-15024) [SBN read] In FailoverOnNetworkExceptionRetry , Number of NameNodes as a condition of calculation of sleep time

2019-12-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16986882#comment-16986882 ] huhaiyang edited comment on HDFS-15024 at 12/3/19 1:11 PM: --- [~xkrogen] [~csun]

[jira] [Comment Edited] (HDFS-15024) [SBN read] In FailoverOnNetworkExceptionRetry , Number of NameNodes as a condition of calculation of sleep time

2019-12-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16986882#comment-16986882 ] huhaiyang edited comment on HDFS-15024 at 12/3/19 1:09 PM: ---

[jira] [Commented] (HDFS-15024) [SBN read] In FailoverOnNetworkExceptionRetry , Number of NameNodes as a condition of calculation of sleep time

2019-12-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16986882#comment-16986882 ] huhaiyang commented on HDFS-15024: -- [~xkrogen][~csun][~vagarychen] Thanks for your comments! I

[jira] [Commented] (HDFS-13811) RBF: Race condition between router admin quota update and periodic quota update service

2019-12-03 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16986867#comment-16986867 ] Jinglun commented on HDFS-13811: Hi [~linyiqun], thanks your nice comments ! Fix the failed unit tests

[jira] [Updated] (HDFS-13811) RBF: Race condition between router admin quota update and periodic quota update service

2019-12-03 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13811: --- Attachment: HDFS-13811.006.patch > RBF: Race condition between router admin quota update and periodic quota

[jira] [Commented] (HDFS-13671) Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2019-12-03 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16986840#comment-16986840 ] Stephen O'Donnell commented on HDFS-13671: -- I have seen a few occurrences of an issue where

[jira] [Commented] (HDFS-14998) Update Observer Namenode doc for ZKFC after HDFS-14130

2019-12-03 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16986832#comment-16986832 ] Fei Hui commented on HDFS-14998: [~csun] [~ayushtkn] Thanks for your comments. {quote} With ZKFC running

[jira] [Commented] (HDFS-15028) Keep the capacity of volume and reduce a system call

2019-12-03 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16986774#comment-16986774 ] Yang Yun commented on HDFS-15028: - I have no number how much the overhead is reduced by the change for

[jira] [Commented] (HDFS-13811) RBF: Race condition between router admin quota update and periodic quota update service

2019-12-03 Thread Yiqun Lin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16986773#comment-16986773 ] Yiqun Lin commented on HDFS-13811: -- Thanks for updating the patch, [~LiJinglun]. The change almost looks