[jira] [Updated] (HDFS-9555) LazyPersistFileScrubber should still sleep if there are errors in the clear progress

2016-03-20 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HDFS-9555: Target Version/s: 2.8.0, 2.7.3, 2.6.5 (was: 2.6.5) > LazyPersistFileScrubber should still sleep if there

[jira] [Commented] (HDFS-7648) Verify that HDFS blocks are in the correct datanode directories

2016-03-20 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203741#comment-15203741 ] Rakesh R commented on HDFS-7648: Thanks [~dwatzke], [~szetszwo] bq. Agree that it should print out the

[jira] [Updated] (HDFS-10186) DirectoryScanner: Improve logs by adding full path of both actual and expected block directories

2016-03-20 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10186: Status: Patch Available (was: Open) > DirectoryScanner: Improve logs by adding full path of both actual

[jira] [Commented] (HDFS-10185) TestHFlushInterrupted verifies interrupt state incorrectly

2016-03-20 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203735#comment-15203735 ] Lin Yiqun commented on HDFS-10185: -- {quote} Your new code essentially tests whether

[jira] [Updated] (HDFS-10186) DirectoryScanner: Improve logs by adding full path of both actual and expected block directories

2016-03-20 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10186: Attachment: HDFS-10186-001.patch > DirectoryScanner: Improve logs by adding full path of both actual and >

[jira] [Created] (HDFS-10186) DirectoryScanner: Improve logs by adding full path of both actual and expected block directories

2016-03-20 Thread Rakesh R (JIRA)
Rakesh R created HDFS-10186: --- Summary: DirectoryScanner: Improve logs by adding full path of both actual and expected block directories Key: HDFS-10186 URL: https://issues.apache.org/jira/browse/HDFS-10186

[jira] [Commented] (HDFS-10185) TestHFlushInterrupted verifies interrupt state incorrectly

2016-03-20 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203699#comment-15203699 ] John Zhuge commented on HDFS-10185: --- Thanks [~linyiqun] for working on the unit test issue which is very

[jira] [Updated] (HDFS-10185) TestHFlushInterrupted verifies interrupt state incorrectly

2016-03-20 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-10185: - Status: Patch Available (was: Open) Attach a initial patch, kindly review. > TestHFlushInterrupted

[jira] [Updated] (HDFS-10185) TestHFlushInterrupted verifies interrupt state incorrectly

2016-03-20 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-10185: - Attachment: HDFS-10185.001.patch > TestHFlushInterrupted verifies interrupt state incorrectly >

[jira] [Created] (HDFS-10185) TestHFlushInterrupted verifies interrupt state incorrectly

2016-03-20 Thread Lin Yiqun (JIRA)
Lin Yiqun created HDFS-10185: Summary: TestHFlushInterrupted verifies interrupt state incorrectly Key: HDFS-10185 URL: https://issues.apache.org/jira/browse/HDFS-10185 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-9917) IBR accumulate more objects when SNN was down for sometime.

2016-03-20 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203661#comment-15203661 ] Brahma Reddy Battula commented on HDFS-9917: Ping [~szetszwo]. > IBR accumulate more objects

[jira] [Commented] (HDFS-9951) Use string constants for XML tags in OfflineImageReconstructor

2016-03-20 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203612#comment-15203612 ] Lin Yiqun commented on HDFS-9951: - The remained failed unit tests look not related. > Use string constants

[jira] [Commented] (HDFS-7166) SbNN Web UI shows #Under replicated blocks and #pending deletion blocks

2016-03-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203586#comment-15203586 ] Hudson commented on HDFS-7166: -- FAILURE: Integrated in Hadoop-trunk-Commit #9480 (See

[jira] [Updated] (HDFS-7166) SbNN Web UI shows #Under replicated blocks and #pending deletion blocks

2016-03-20 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7166: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Created] (HDFS-10184) Introduce unit tests framework for HDFS UI

2016-03-20 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-10184: - Summary: Introduce unit tests framework for HDFS UI Key: HDFS-10184 URL: https://issues.apache.org/jira/browse/HDFS-10184 Project: Hadoop HDFS Issue Type: Test

[jira] [Commented] (HDFS-8356) Document missing properties in hdfs-default.xml

2016-03-20 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15201347#comment-15201347 ] Akira AJISAKA commented on HDFS-8356: - Thanks [~rchiang] for updating the patch! Reviewed to

[jira] [Commented] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

2016-03-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15198302#comment-15198302 ] Andrew Wang commented on HDFS-3702: --- Hi Arpit, We've got +1's from HBase developers like Stack and

[jira] [Updated] (HDFS-9923) Datanode disk failure handling is not consistent

2016-03-20 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9923: -- Summary: Datanode disk failure handling is not consistent (was: Datanode disk failure handling

[jira] [Commented] (HDFS-10183) Prevent race condition during class initialization

2016-03-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203277#comment-15203277 ] Hadoop QA commented on HDFS-10183: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9949) Add a test case to ensure that the DataNode does not regenerate its UUID when a storage directory is cleared

2016-03-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9949: --- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-9949) Add a test case to ensure that the DataNode does not regenerate its UUID when a storage directory is cleared

2016-03-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200117#comment-15200117 ] Hudson commented on HDFS-9949: -- FAILURE: Integrated in Hadoop-trunk-Commit #9473 (See

[jira] [Commented] (HDFS-9709) DiskBalancer : Add tests for disk balancer using a Mock Mover class.

2016-03-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15198597#comment-15198597 ] Hadoop QA commented on HDFS-9709: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9260) Improve the performance and GC friendliness of NameNode startup and full block reports

2016-03-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15197863#comment-15197863 ] Colin Patrick McCabe commented on HDFS-9260: Sure, would you like to backport it to 2.9? >

[jira] [Updated] (HDFS-10183) Prevent race condition during class initialization

2016-03-20 Thread Pavel Avgustinov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pavel Avgustinov updated HDFS-10183: Attachment: HDFS-10183.2.patch Adding v2 of the patch, which resolves the new checkstyle

[jira] [Updated] (HDFS-9709) DiskBalancer : Add tests for disk balancer using a Mock Mover class.

2016-03-20 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9709: --- Attachment: HDFS-9709-HDFS-1312.003.patch Fix test failures > DiskBalancer : Add tests for disk

[jira] [Commented] (HDFS-9405) When starting a file, NameNode should generate EDEK in a separate thread

2016-03-20 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15201072#comment-15201072 ] Xiao Chen commented on HDFS-9405: - Failed tests look unrelated, checkstyle is configuration over 80 chars.

[jira] [Commented] (HDFS-9847) HDFS configuration without time unit name should accept friendly time units

2016-03-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203167#comment-15203167 ] Hadoop QA commented on HDFS-9847: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10182) Hedged read might overwrite user's buf

2016-03-20 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-10182: Status: Patch Available (was: Open) > Hedged read might overwrite user's buf >

[jira] [Commented] (HDFS-10169) TestEditLog.testBatchedSyncWithClosedLogs sometimes fails.

2016-03-20 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15201796#comment-15201796 ] Chris Nauroth commented on HDFS-10169: -- Perhaps HDFS-10183 is related? >

[jira] [Updated] (HDFS-9885) In distcp cmd ouput, Display name should be given for org.apache.hadoop.tools.mapred.CopyMapper$Counter.

2016-03-20 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-9885: - Attachment: HDFS-9885.002.patch Thanks [~jzhuge] Attached updated patch, Please

[jira] [Commented] (HDFS-10176) WebHdfs LISTSTATUS does not offer any sorting

2016-03-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200320#comment-15200320 ] Andrew Wang commented on HDFS-10176: Hi Romain, is the request to expose additional fields in the

[jira] [Commented] (HDFS-9874) Long living DataXceiver threads cause volume shutdown to block.

2016-03-20 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15201604#comment-15201604 ] Kihwal Lee commented on HDFS-9874: -- This patch will kick out writers even for "graceful" removals. But

[jira] [Updated] (HDFS-10172) hdfs erasurecode command should remove the redundant -usage option

2016-03-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10172: --- Labels: newbie (was: ) > hdfs erasurecode command should remove the redundant -usage option >

[jira] [Commented] (HDFS-9857) Erasure Coding: Rename replication-based names in BlockManager to more generic [part-1]

2016-03-20 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15197486#comment-15197486 ] Zhe Zhang commented on HDFS-9857: - Thanks Rakesh for the update. {{testMetasaveAfterDelete}} failure seems

[jira] [Commented] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

2016-03-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15198253#comment-15198253 ] Arpit Agarwal commented on HDFS-3702: - Hi Andrew, there is still much plumbing required to communicate