[jira] [Commented] (HDDS-1532) Ozone: Freon: Improve the concurrent testing framework.

2019-07-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16876624#comment-16876624 ] Junping Du commented on HDDS-1532: -- bq. In this environment, writing the same amount of data, by

[jira] [Commented] (HDDS-698) Support Topology Awareness for Ozone

2019-01-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16757215#comment-16757215 ] Junping Du commented on HDDS-698: - Thanks [~szetszwo] and sorry for late response, the design document is

[jira] [Commented] (HDDS-698) Support Topology Awareness for Ozone

2019-01-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740089#comment-16740089 ] Junping Du commented on HDDS-698: - No enough bandwidth shortly, reassign to [~Sammi]. > Support Topology

[jira] [Assigned] (HDDS-698) Support Topology Awareness for Ozone

2019-01-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned HDDS-698: --- Assignee: Sammi Chen (was: Junping Du) > Support Topology Awareness for Ozone >

[jira] [Updated] (HDDS-698) Support Topology Awareness for Ozone

2018-12-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDDS-698: Description: This is an umbrella JIRA to add topology aware support for Ozone Pipelines, Containers and

[jira] [Updated] (HDFS-12914) Block report leases cause missing blocks until next report

2018-09-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-12914: -- Target Version/s: 2.8.6 (was: 2.8.5) > Block report leases cause missing blocks until next report >

[jira] [Updated] (HDFS-12136) BlockSender performance regression due to volume scanner edge case

2018-09-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-12136: -- Target Version/s: 2.8.6 (was: 2.8.5) > BlockSender performance regression due to volume scanner edge

[jira] [Updated] (HDFS-7967) Reduce the performance impact of the balancer

2018-09-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-7967: - Target Version/s: 2.8.6 (was: 2.8.5) > Reduce the performance impact of the balancer >

[jira] [Updated] (HDFS-13111) Close recovery may incorrectly mark blocks corrupt

2018-09-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-13111: -- Target Version/s: 2.8.6 (was: 2.8.5) > Close recovery may incorrectly mark blocks corrupt >

[jira] [Updated] (HDFS-12704) FBR may corrupt block state

2018-09-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-12704: -- Target Version/s: 2.8.6 (was: 2.8.5) > FBR may corrupt block state > --- > >

[jira] [Updated] (HDFS-12703) Exceptions are fatal to decommissioning monitor

2018-09-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-12703: -- Target Version/s: 2.8.6 (was: 2.8.5) > Exceptions are fatal to decommissioning monitor >

[jira] [Updated] (HDFS-12747) Lease monitor may infinitely loop on the same lease

2018-09-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-12747: -- Target Version/s: 2.8.6 (was: 2.8.5) > Lease monitor may infinitely loop on the same lease >

[jira] [Commented] (HDFS-12747) Lease monitor may infinitely loop on the same lease

2018-09-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16607955#comment-16607955 ] Junping Du commented on HDFS-12747: --- move out to 2.8.6 given no progress for a while. > Lease monitor

[jira] [Assigned] (HDDS-286) Fix NodeReportPublisher.getReport NPE

2018-07-24 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned HDDS-286: --- Assignee: Junjie Chen > Fix NodeReportPublisher.getReport NPE > -

[jira] [Updated] (HDDS-188) TestOmMetrcis should not use the deprecated WhiteBox class

2018-07-23 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDDS-188: Description: TestOmMetrcis should stop using {{org.apache.hadoop.test.Whitebox}}. (was: TestKSMMetrcis

[jira] [Commented] (HDDS-188) TestKSMMetrcis should not use the deprecated WhiteBox class

2018-07-23 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16553826#comment-16553826 ] Junping Du commented on HDDS-188: - Looks like TestKSMMetrics get renamed to TestOmMetrics, update title and

[jira] [Updated] (HDDS-188) TestOmMetrcis should not use the deprecated WhiteBox class

2018-07-23 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDDS-188: Summary: TestOmMetrcis should not use the deprecated WhiteBox class (was: TestKSMMetrcis should not use the

[jira] [Assigned] (HDDS-117) Wrapper for set/get Standalone, Ratis and Rest Ports in DatanodeDetails.

2018-07-23 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned HDDS-117: --- Assignee: chao.wu (was: Junping Du) > Wrapper for set/get Standalone, Ratis and Rest Ports in

[jira] [Assigned] (HDDS-164) Add unit test for HddsDatanodeService

2018-07-20 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned HDDS-164: --- Assignee: Junjie Chen > Add unit test for HddsDatanodeService > -

[jira] [Commented] (HDFS-12914) Block report leases cause missing blocks until next report

2018-07-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16547561#comment-16547561 ] Junping Du commented on HDFS-12914: --- [~daryn] Do we still hit the issue, any clue to fix it? > Block

[jira] [Commented] (HDFS-10664) layoutVersion mismatch between Namenode VERSION file and Journalnode VERSION file after cluster upgrade

2018-06-27 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524639#comment-16524639 ] Junping Du commented on HDFS-10664: --- Failed tests are not related to the patch and verified that tests

[jira] [Commented] (HDFS-10664) layoutVersion mismatch between Namenode VERSION file and Journalnode VERSION file after cluster upgrade

2018-06-26 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16523615#comment-16523615 ] Junping Du commented on HDFS-10664: --- This patch seems to correct some harmless but silly mistake for JN

[jira] [Commented] (HDFS-12136) BlockSender performance regression due to volume scanner edge case

2018-05-07 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466776#comment-16466776 ] Junping Du commented on HDFS-12136: --- looks like HDFS-11187 may not cover all fix here. [~jojochuang], do

[jira] [Updated] (HDFS-12136) BlockSender performance regression due to volume scanner edge case

2018-05-07 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-12136: -- Target Version/s: 2.8.5 (was: 2.8.4) > BlockSender performance regression due to volume scanner edge

[jira] [Commented] (HDFS-12136) BlockSender performance regression due to volume scanner edge case

2018-04-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16457439#comment-16457439 ] Junping Du commented on HDFS-12136: --- Thanks [~jojochuang] for comments. I agree with you that previous

[jira] [Commented] (HDFS-7967) Reduce the performance impact of the balancer

2018-04-26 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16455663#comment-16455663 ] Junping Du commented on HDFS-7967: -- move it to 2.8.5 given no response for a while. > Reduce the

[jira] [Updated] (HDFS-7967) Reduce the performance impact of the balancer

2018-04-26 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-7967: - Target Version/s: 2.8.5 (was: 2.8.4) > Reduce the performance impact of the balancer >

[jira] [Updated] (HDFS-12703) Exceptions are fatal to decommissioning monitor

2018-04-26 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-12703: -- Target Version/s: 2.8.5 (was: 2.8.4) > Exceptions are fatal to decommissioning monitor >

[jira] [Commented] (HDFS-13111) Close recovery may incorrectly mark blocks corrupt

2018-04-26 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16455659#comment-16455659 ] Junping Du commented on HDFS-13111: --- move to 2.8.5 given this jira has been quiet for a while. > Close

[jira] [Updated] (HDFS-13111) Close recovery may incorrectly mark blocks corrupt

2018-04-26 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-13111: -- Target Version/s: 2.8.5 (was: 2.8.4) > Close recovery may incorrectly mark blocks corrupt >

[jira] [Updated] (HDFS-12914) Block report leases cause missing blocks until next report

2018-04-26 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-12914: -- Target Version/s: 2.8.5 (was: 2.8.4) > Block report leases cause missing blocks until next report >

[jira] [Updated] (HDFS-12747) Lease monitor may infinitely loop on the same lease

2018-04-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-12747: -- Target Version/s: 2.8.5 (was: 2.8.4) > Lease monitor may infinitely loop on the same lease >

[jira] [Commented] (HDFS-12704) FBR may corrupt block state

2018-04-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16437151#comment-16437151 ] Junping Du commented on HDFS-12704: --- move to 2.8.5 given issue has been quiet for a while. > FBR may

[jira] [Updated] (HDFS-12704) FBR may corrupt block state

2018-04-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-12704: -- Target Version/s: 2.8.5 (was: 2.8.4) > FBR may corrupt block state > --- > >

[jira] [Commented] (HDFS-7967) Reduce the performance impact of the balancer

2018-04-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16437131#comment-16437131 ] Junping Du commented on HDFS-7967: -- [~kihwal] and [~daryn], do we need this patch on trunk/hadoop-3.x? If

[jira] [Commented] (HDFS-13281) Namenode#createFile should be /.reserved/raw/ aware.

2018-04-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16437122#comment-16437122 ] Junping Du commented on HDFS-13281: --- Hi [~shahrs87] and [~xiaochen], do we have plan to get this patch

[jira] [Commented] (HDFS-12703) Exceptions are fatal to decommissioning monitor

2018-04-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16437110#comment-16437110 ] Junping Du commented on HDFS-12703: --- Hi Daryn, I saw this issue has been quiet for a while. Can we move

[jira] [Commented] (HDFS-12136) BlockSender performance regression due to volume scanner edge case

2018-04-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16437109#comment-16437109 ] Junping Du commented on HDFS-12136: --- Hi [~daryn], I saw this issue has been quiet for a while. Can we

[jira] [Updated] (HDFS-12136) BlockSender performance regression due to volume scanner edge case

2018-04-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-12136: -- Target Version/s: 2.8.4 (was: 2.8.3) > BlockSender performance regression due to volume scanner edge

[jira] [Updated] (HDFS-13111) Close recovery may incorrectly mark blocks corrupt

2018-04-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-13111: -- Target Version/s: 2.8.4 (was: 2.8.3) > Close recovery may incorrectly mark blocks corrupt >

[jira] [Updated] (HDFS-7967) Reduce the performance impact of the balancer

2018-04-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-7967: - Target Version/s: 2.8.4 (was: 2.8.3) > Reduce the performance impact of the balancer >

[jira] [Updated] (HDFS-12703) Exceptions are fatal to decommissioning monitor

2018-04-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-12703: -- Target Version/s: 2.8.4 (was: 2.8.3) > Exceptions are fatal to decommissioning monitor >

[jira] [Updated] (HDFS-12704) FBR may corrupt block state

2018-04-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-12704: -- Target Version/s: 2.8.4 (was: 2.8.3) > FBR may corrupt block state > --- > >

[jira] [Commented] (HDFS-12747) Lease monitor may infinitely loop on the same lease

2018-04-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16428151#comment-16428151 ] Junping Du commented on HDFS-12747: --- move to 2.8.4 as 2.8.3 has been released. > Lease monitor may

[jira] [Updated] (HDFS-12747) Lease monitor may infinitely loop on the same lease

2018-04-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-12747: -- Target Version/s: 2.8.4 (was: 2.8.3) > Lease monitor may infinitely loop on the same lease >

[jira] [Commented] (HDFS-13174) hdfs mover -p /path times out after 20 min

2018-03-19 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16405746#comment-16405746 ] Junping Du commented on HDFS-13174: --- drop fixed version as no patch get committed yet. > hdfs mover -p

[jira] [Updated] (HDFS-13174) hdfs mover -p /path times out after 20 min

2018-03-19 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-13174: -- Target Version/s: 3.1.0, 2.9.1, 3.0.1, 2.8.4, 2.7.6 Fix Version/s: (was: 2.7.6)

[jira] [Commented] (HDFS-12920) HDFS default value change (with adding time unit) breaks old version MR tarball work with new version (3.0) of hadoop

2017-12-15 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293555#comment-16293555 ] Junping Du commented on HDFS-12920: --- bq. An alternative to reverting the change is to deprecate the old

[jira] [Commented] (HDFS-12920) HDFS default value change (with adding time unit) breaks old version MR tarball work with new version (3.0) of hadoop

2017-12-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16288948#comment-16288948 ] Junping Du commented on HDFS-12920: --- bq. So the right way should be to revert HDFS-10845 and get rid of

[jira] [Commented] (HDFS-12920) HDFS default value change (with adding time unit) breaks old version MR tarball work with new version (3.0) of hadoop

2017-12-12 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16288568#comment-16288568 ] Junping Du commented on HDFS-12920: --- CC [~andrew.wang], [~linyiqun], [~chris.douglas]. > HDFS default

[jira] [Updated] (HDFS-12920) HDFS default value change (with adding time unit) breaks old version MR tarball work with new version (3.0) of hadoop

2017-12-12 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-12920: -- Description: After HADOOP-15059 get resolved. I tried to deploy 2.9.0 tar ball with 3.0.0 RC1, and run

[jira] [Updated] (HDFS-12920) HDFS default value change (with adding time unit) breaks old version MR tarball work with new version (3.0) of hadoop

2017-12-12 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-12920: -- Description: After HADOOP-15059 get resolved. I tried to deploy 2.9.0 tar ball with 3.0.0 RC1, and run

[jira] [Created] (HDFS-12920) HDFS default value change (with adding time unit) breaks old version MR tarball work with new version (3.0) of hadoop

2017-12-12 Thread Junping Du (JIRA)
Junping Du created HDFS-12920: - Summary: HDFS default value change (with adding time unit) breaks old version MR tarball work with new version (3.0) of hadoop Key: HDFS-12920 URL:

[jira] [Updated] (HDFS-12832) INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit

2017-12-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-12832: -- Fix Version/s: (was: 2.8.4) 2.8.3 > INode.getFullPathName may throw

[jira] [Commented] (HDFS-12832) INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit

2017-12-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16277839#comment-16277839 ] Junping Du commented on HDFS-12832: --- Merge to branch-2.8.3 as well. > INode.getFullPathName may throw

[jira] [Commented] (HDFS-12638) Delete copy-on-truncate block along with the original block, when deleting a file being truncated

2017-12-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16277838#comment-16277838 ] Junping Du commented on HDFS-12638: --- Merge to branch-2.8.3 as well. > Delete copy-on-truncate block

[jira] [Updated] (HDFS-12638) Delete copy-on-truncate block along with the original block, when deleting a file being truncated

2017-12-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-12638: -- Fix Version/s: (was: 2.8.4) 2.8.3 > Delete copy-on-truncate block along with the

[jira] [Commented] (HDFS-12638) NameNode exits due to ReplicationMonitor thread received Runtime exception in ReplicationWork#chooseTargets

2017-11-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269808#comment-16269808 ] Junping Du commented on HDFS-12638: --- Ping... [~szetszwo] and [~jingzhao], do you agree with [~shv]'s

[jira] [Updated] (HDFS-12832) INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit

2017-11-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-12832: -- Target Version/s: 2.8.3, 2.7.5, 3.0.0, 3.1.0, 2.9.1 (was: 2.8.3, 2.7.5, 3.0.0, 2.9.1) >

[jira] [Updated] (HDFS-12832) INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit

2017-11-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-12832: -- Target Version/s: 2.8.3, 2.7.5, 3.0.0, 2.9.1 (was: 2.7.5) > INode.getFullPathName may throw

[jira] [Commented] (HDFS-12832) INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit

2017-11-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269792#comment-16269792 ] Junping Du commented on HDFS-12832: --- Thanks [~shv] for the patch and [~zhz] for review. I think we also

[jira] [Updated] (HDFS-12638) NameNode exits due to ReplicationMonitor thread received Runtime exception in ReplicationWork#chooseTargets

2017-11-22 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-12638: -- Target Version/s: 2.8.3, 3.0.0, 2.9.1 (was: 2.8.3) > NameNode exits due to ReplicationMonitor thread

[jira] [Commented] (HDFS-12638) NameNode exits due to ReplicationMonitor thread received Runtime exception in ReplicationWork#chooseTargets

2017-11-22 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263649#comment-16263649 ] Junping Du commented on HDFS-12638: --- Should be a blocker for 2.9.1 and 3.0.0 as well. Add them into

[jira] [Commented] (HDFS-12638) NameNode exits due to ReplicationMonitor thread received Runtime exception in ReplicationWork#chooseTargets

2017-11-22 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263522#comment-16263522 ] Junping Du commented on HDFS-12638: --- [~jingzhao] and [~szetszwo], any comments on Konstantin's proposal

[jira] [Commented] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

2017-11-15 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254332#comment-16254332 ] Junping Du commented on HDFS-12681: --- bq. We hope that clients would request locations in the first RPC

[jira] [Updated] (HDFS-12420) Add an option to disallow 'namenode format -force'

2017-10-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-12420: -- Fix Version/s: (was: 2.8.2) 2.8.3 > Add an option to disallow 'namenode format

[jira] [Commented] (HDFS-12420) Add an option to disallow 'namenode format -force'

2017-10-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210386#comment-16210386 ] Junping Du commented on HDFS-12420: --- Drop 2.8.2 from fix version as the patch only commit to branch-2.8

[jira] [Commented] (HDFS-12495) TestPendingInvalidateBlock#testPendingDeleteUnknownBlocks fails intermittently

2017-10-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210288#comment-16210288 ] Junping Du commented on HDFS-12495: --- I don't find the patch landed in branch-2.8.2. Drop 2.8.2 in fix

[jira] [Updated] (HDFS-12495) TestPendingInvalidateBlock#testPendingDeleteUnknownBlocks fails intermittently

2017-10-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-12495: -- Fix Version/s: (was: 2.8.2) > TestPendingInvalidateBlock#testPendingDeleteUnknownBlocks fails

[jira] [Updated] (HDFS-12473) Change hosts JSON file format

2017-09-21 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-12473: -- Fix Version/s: (was: 2.8.3) > Change hosts JSON file format > - > >

[jira] [Updated] (HDFS-12372) Document the impact of HDFS-11069 (Tighten the authorization of datanode RPC)

2017-09-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-12372: -- Target Version/s: 2.9.0, 2.8.3, 3.0.0 (was: 2.9.0, 2.8.2, 3.0.0) > Document the impact of HDFS-11069

[jira] [Updated] (HDFS-11885) createEncryptionZone should not block on initializing EDEK cache

2017-09-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-11885: -- Target Version/s: 2.9.0, 3.0.0-beta1, 2.8.3 (was: 2.9.0, 3.0.0-beta1, 2.8.2) > createEncryptionZone

[jira] [Updated] (HDFS-12142) Files may be closed before streamer is done

2017-09-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-12142: -- Target Version/s: 2.8.3 (was: 2.8.2) > Files may be closed before streamer is done >

[jira] [Updated] (HDFS-11616) Namenode doesn't mark the block as non-corrupt if the reason for corruption was INVALID_STATE

2017-09-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-11616: -- Target Version/s: 2.8.3 (was: 2.8.1) > Namenode doesn't mark the block as non-corrupt if the reason

[jira] [Updated] (HDFS-11602) Enable HttpFS Tomcat access logging

2017-09-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-11602: -- Target Version/s: 2.8.3 (was: 2.8.1) > Enable HttpFS Tomcat access logging >

[jira] [Updated] (HDFS-12008) Improve the available-space block placement policy

2017-09-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-12008: -- Target Version/s: 2.8.3 (was: 2.8.2) > Improve the available-space block placement policy >

[jira] [Updated] (HDFS-12070) Failed block recovery leaves files open indefinitely and at risk for data loss

2017-09-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-12070: -- Target Version/s: 2.8.3 (was: 2.8.2) > Failed block recovery leaves files open indefinitely and at

[jira] [Updated] (HDFS-11617) Datanode should delete the block from rbw directory when it finds duplicate in finalized directory.

2017-09-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-11617: -- Target Version/s: 2.8.3 (was: 2.8.1) > Datanode should delete the block from rbw directory when it

[jira] [Commented] (HDFS-9696) Garbage snapshot records lingering forever

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149858#comment-16149858 ] Junping Du commented on HDFS-9696: -- Add 2.8.0 and 2.9.0 in fix version given patch get landed there. >

[jira] [Updated] (HDFS-9696) Garbage snapshot records lingering forever

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9696: - Fix Version/s: 2.8.0 2.9.0 > Garbage snapshot records lingering forever >

[jira] [Commented] (HDFS-10763) Open files can leak permanently due to inconsistent lease update

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149856#comment-16149856 ] Junping Du commented on HDFS-10763: --- Add 2.8.0, 2.9.0 in fix version given patch get landed there. >

[jira] [Updated] (HDFS-10763) Open files can leak permanently due to inconsistent lease update

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-10763: -- Fix Version/s: 2.8.0 2.9.0 > Open files can leak permanently due to inconsistent

[jira] [Updated] (HDFS-11947) When constructing a thread name, BPOfferService may print a bogus warning message

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-11947: -- Fix Version/s: (was: 2.8.2) > When constructing a thread name, BPOfferService may print a bogus

[jira] [Commented] (HDFS-11947) When constructing a thread name, BPOfferService may print a bogus warning message

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149749#comment-16149749 ] Junping Du commented on HDFS-11947: --- Sounds like we only commit to trunk and branch-2. Dropping 2.8.2 in

[jira] [Commented] (HDFS-10326) Disable setting tcp socket send/receive buffers for write pipelines

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149744#comment-16149744 ] Junping Du commented on HDFS-10326: --- Sounds like we only commit the patch to branch-2.8 but forget to

[jira] [Commented] (HDFS-11078) Fix NPE in LazyPersistFileScrubber

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149714#comment-16149714 ] Junping Du commented on HDFS-11078: --- Ok. As [~brahmareddy] mentioned above, we are missing jira ID in

[jira] [Commented] (HDFS-11078) Fix NPE in LazyPersistFileScrubber

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149709#comment-16149709 ] Junping Du commented on HDFS-11078: --- I don't find this fix landed in branch-2.8 or branch-2.8.2.

[jira] [Commented] (HDFS-12102) VolumeScanner throttle dropped (fast scan enabled) when there is a corrupt block

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149706#comment-16149706 ] Junping Du commented on HDFS-12102: --- Drop 2.8.2 in fix version given patch haven't been committed. >

[jira] [Updated] (HDFS-12102) VolumeScanner throttle dropped (fast scan enabled) when there is a corrupt block

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-12102: -- Fix Version/s: (was: 2.8.2) > VolumeScanner throttle dropped (fast scan enabled) when there is a

[jira] [Commented] (HDFS-11896) Non-dfsUsed will be doubled on dead node re-registration

2017-08-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144632#comment-16144632 ] Junping Du commented on HDFS-11896: --- Thanks [~brahmareddy] for identify this not landing on

[jira] [Updated] (HDFS-11896) Non-dfsUsed will be doubled on dead node re-registration

2017-08-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-11896: -- Fix Version/s: (was: 2.8.3) > Non-dfsUsed will be doubled on dead node re-registration >

[jira] [Commented] (HDFS-12319) DirectoryScanner will throw IllegalStateException when Multiple BP's are present

2017-08-24 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140603#comment-16140603 ] Junping Du commented on HDFS-12319: --- Got it. Thanks [~arpitagarwal] for confirm. I will hold on 2.8.2

[jira] [Updated] (HDFS-7967) Reduce the performance impact of the balancer

2017-08-23 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-7967: - Target Version/s: 2.8.3 (was: 2.8.1) > Reduce the performance impact of the balancer >

[jira] [Commented] (HDFS-7967) Reduce the performance impact of the balancer

2017-08-23 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139432#comment-16139432 ] Junping Du commented on HDFS-7967: -- Got it. [~kihwal]. Let's move it to 2.8.3. > Reduce the performance

[jira] [Commented] (HDFS-12319) DirectoryScanner will throw IllegalStateException when Multiple BP's are present

2017-08-23 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139386#comment-16139386 ] Junping Du commented on HDFS-12319: --- Hi [~arpitagarwal], can you confirm that if it should be blocker

[jira] [Commented] (HDFS-7967) Reduce the performance impact of the balancer

2017-08-20 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134707#comment-16134707 ] Junping Du commented on HDFS-7967: -- Hi [~daryn] and [~kihwal], I am planning to kicking off RC0 soon for

[jira] [Updated] (HDFS-12049) Recommissioning live nodes stalls the NN

2017-07-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-12049: -- Target Version/s: 2.9.0 (was: 2.8.2) > Recommissioning live nodes stalls the NN >

[jira] [Commented] (HDFS-12049) Recommissioning live nodes stalls the NN

2017-07-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16108222#comment-16108222 ] Junping Du commented on HDFS-12049: --- Moved. Thanks Daryn. > Recommissioning live nodes stalls the NN >

[jira] [Commented] (HDFS-12049) Recommissioning live nodes stalls the NN

2017-07-20 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095329#comment-16095329 ] Junping Du commented on HDFS-12049: --- It seems to be a long term existing issues and a bit

[jira] [Commented] (HDFS-11661) GetContentSummary uses excessive amounts of memory

2017-04-21 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15979508#comment-15979508 ] Junping Du commented on HDFS-11661: --- Thanks [~nroberts] and all for reporting the issue. +1 on reverting

  1   2   3   4   5   6   7   8   9   10   >