[jira] [Commented] (HDFS-11242) Add refresh cluster network topology operation to dfs admin

2019-06-23 Thread Reid Chan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870532#comment-16870532 ] Reid Chan commented on HDFS-11242: -- Yes, only if any committer or member can review or comment, most

[jira] [Commented] (HDFS-11242) Add refresh cluster network topology operation to dfs admin

2019-06-23 Thread Lars Francke (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870483#comment-16870483 ] Lars Francke commented on HDFS-11242: - This would be super useful to have. [~reidchan] are you by

[jira] [Comment Edited] (HDFS-12914) Block report leases cause missing blocks until next report

2019-06-23 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870714#comment-16870714 ] Wei-Chiu Chuang edited comment on HDFS-12914 at 6/24/19 12:36 AM: -- Looks

[jira] [Created] (HDFS-14599) HDFS-12487 breaks test TestDiskBalancer.testDiskBalancerWithFedClusterWithOneNameServiceEmpty

2019-06-23 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-14599: -- Summary: HDFS-12487 breaks test TestDiskBalancer.testDiskBalancerWithFedClusterWithOneNameServiceEmpty Key: HDFS-14599 URL: https://issues.apache.org/jira/browse/HDFS-14599

[jira] [Comment Edited] (HDFS-12914) Block report leases cause missing blocks until next report

2019-06-23 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870714#comment-16870714 ] Wei-Chiu Chuang edited comment on HDFS-12914 at 6/24/19 12:36 AM: -- Looks

[jira] [Updated] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-06-23 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14313: --- Attachment: HDFS-14313.002.patch > Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in

[jira] [Created] (HDFS-14598) Findbugs warning caused by HDFS-12487

2019-06-23 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-14598: -- Summary: Findbugs warning caused by HDFS-12487 Key: HDFS-14598 URL: https://issues.apache.org/jira/browse/HDFS-14598 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-12914) Block report leases cause missing blocks until next report

2019-06-23 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870714#comment-16870714 ] Wei-Chiu Chuang commented on HDFS-12914: Looks like HDFS-12487 breaks the getBlockToCopy test. >

[jira] [Commented] (HDFS-14593) RBF: RouterAdmin should be able to remove expired routers from Routers Information

2019-06-23 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870729#comment-16870729 ] Takanobu Asanuma commented on HDFS-14593: - Thanks for your comment, [~crh]. IIUC, currently

[jira] [Commented] (HDFS-14590) [SBN Read] Add the document link to the top page

2019-06-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870739#comment-16870739 ] Hadoop QA commented on HDFS-14590: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-12914) Block report leases cause missing blocks until next report

2019-06-23 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870775#comment-16870775 ] Wei-Chiu Chuang commented on HDFS-12914: +1 for the branch-3.1 002 patch. Other than the

[jira] [Issue Comment Deleted] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-06-23 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14313: --- Comment: was deleted (was: [~jojochuang] Thanks for your comments.  I add lock in 

[jira] [Updated] (HDFS-12914) Block report leases cause missing blocks until next report

2019-06-23 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12914: --- Fix Version/s: 3.1.3 > Block report leases cause missing blocks until next report >

[jira] [Updated] (HDFS-12914) Block report leases cause missing blocks until next report

2019-06-23 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12914: --- Fix Version/s: 3.0.4 > Block report leases cause missing blocks until next report >

[jira] [Commented] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-06-23 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870797#comment-16870797 ] Lisheng Sun commented on HDFS-14313: [~jojochuang] Thanks for your comment .I add synchronized to

[jira] [Commented] (HDFS-11242) Add refresh cluster network topology operation to dfs admin

2019-06-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870486#comment-16870486 ] Hadoop QA commented on HDFS-11242: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12914) Block report leases cause missing blocks until next report

2019-06-23 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870712#comment-16870712 ] Wei-Chiu Chuang commented on HDFS-12914: Filed  HDFS-14598 for the findbugs warning. > Block

[jira] [Commented] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-06-23 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870773#comment-16870773 ] Lisheng Sun commented on HDFS-14313: [~jojochuang] Thanks for your comments.  I add lock in 

[jira] [Commented] (HDFS-14586) Trash missing delete the folder which near timeout checkpoint

2019-06-23 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870692#comment-16870692 ] maobaolong commented on HDFS-14586: --- [~hexiaoqiao] i have another viewpoint, we need to keep checkpoint

[jira] [Updated] (HDFS-14590) [SBN Read] Add the document link to the top page

2019-06-23 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-14590: Attachment: HDFS-14590.002.patch > [SBN Read] Add the document link to the top page >

[jira] [Commented] (HDFS-14590) [SBN Read] Add the document link to the top page

2019-06-23 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870719#comment-16870719 ] Takanobu Asanuma commented on HDFS-14590: - Thanks for your review, [~ayushtkn]. I agree with you.

[jira] [Updated] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-06-23 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14313: --- Attachment: HDFS-14313.003.patch > Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in

[jira] [Commented] (HDFS-11242) Add refresh cluster network topology operation to dfs admin

2019-06-23 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870542#comment-16870542 ] He Xiaoqiao commented on HDFS-11242: It looks like a good idea in some ways. But I do not think we

[jira] [Commented] (HDFS-14577) RBF: FederationUtil#newInstance should allow constructor without context

2019-06-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870543#comment-16870543 ] Hadoop QA commented on HDFS-14577: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11242) Add refresh cluster network topology operation to dfs admin

2019-06-23 Thread Lars Francke (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870546#comment-16870546 ] Lars Francke commented on HDFS-11242: - Specifically: What [~reidchan] can currently already be done

[jira] [Commented] (HDFS-11242) Add refresh cluster network topology operation to dfs admin

2019-06-23 Thread Lars Francke (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870544#comment-16870544 ] Lars Francke commented on HDFS-11242: - [~hexiaoqiao] I don't understand. Can you be more specific?

[jira] [Updated] (HDFS-14429) Block remain in COMMITTED but not COMPLETE cause by Decommission

2019-06-23 Thread Yicong Cai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yicong Cai updated HDFS-14429: -- Attachment: HDFS-14429.branch-2.01.patch > Block remain in COMMITTED but not COMPLETE cause by

[jira] [Updated] (HDFS-14429) Block remain in COMMITTED but not COMPLETE cause by Decommission

2019-06-23 Thread Yicong Cai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yicong Cai updated HDFS-14429: -- Attachment: (was: HDFS-14429.02.patch) > Block remain in COMMITTED but not COMPLETE cause by

[jira] [Updated] (HDFS-14429) Block remain in COMMITTED but not COMPLETE cause by Decommission

2019-06-23 Thread Yicong Cai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yicong Cai updated HDFS-14429: -- Attachment: HDFS-14429.02.patch > Block remain in COMMITTED but not COMPLETE cause by Decommission >

[jira] [Commented] (HDFS-11242) Add refresh cluster network topology operation to dfs admin

2019-06-23 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870557#comment-16870557 ] He Xiaoqiao commented on HDFS-11242: Thanks [~larsfrancke] for your quick response. IIUC, namenode

[jira] [Commented] (HDFS-11242) Add refresh cluster network topology operation to dfs admin

2019-06-23 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870574#comment-16870574 ] He Xiaoqiao commented on HDFS-11242: Thanks [~larsfrancke] for your doubt and the detailed comments.

[jira] [Commented] (HDFS-11242) Add refresh cluster network topology operation to dfs admin

2019-06-23 Thread Lars Francke (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870634#comment-16870634 ] Lars Francke commented on HDFS-11242: - I'm afraid I still don't fully understand. Either way

[jira] [Updated] (HDFS-14429) Block remain in COMMITTED but not COMPLETE cause by Decommission

2019-06-23 Thread Yicong Cai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yicong Cai updated HDFS-14429: -- Attachment: HDFS-14429.02.patch > Block remain in COMMITTED but not COMPLETE cause by Decommission >

[jira] [Commented] (HDFS-11242) Add refresh cluster network topology operation to dfs admin

2019-06-23 Thread Lars Francke (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870566#comment-16870566 ] Lars Francke commented on HDFS-11242: - I think I'm getting a clearer picture now but (and there's

[jira] [Commented] (HDFS-14429) Block remain in COMMITTED but not COMPLETE cause by Decommission

2019-06-23 Thread Yicong Cai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870579#comment-16870579 ] Yicong Cai commented on HDFS-14429: --- Provided branch-2 [^HDFS-14429.branch-2.01.patch] and trunck 

[jira] [Commented] (HDFS-12914) Block report leases cause missing blocks until next report

2019-06-23 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870558#comment-16870558 ] He Xiaoqiao commented on HDFS-12914: I found failed unit tests also failed before patch. Any changes

[jira] [Updated] (HDFS-14429) Block remain in COMMITTED but not COMPLETE cause by Decommission

2019-06-23 Thread Yicong Cai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yicong Cai updated HDFS-14429: -- Target Version/s: 2.10.0, 3.3.0, 2.9.3 (was: 3.3.0, 2.9.3) > Block remain in COMMITTED but not

[jira] [Commented] (HDFS-14429) Block remain in COMMITTED but not COMPLETE cause by Decommission

2019-06-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870593#comment-16870593 ] Hadoop QA commented on HDFS-14429: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14429) Block remain in COMMITTED but not COMPLETE cause by Decommission

2019-06-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870607#comment-16870607 ] Hadoop QA commented on HDFS-14429: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||