[jira] [Commented] (HDFS-8777) Erasure Coding: add tests for taking snapshots on EC files

2015-10-30 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982092#comment-14982092 ] Rakesh R commented on HDFS-8777: Thanks a lot [~zhz] for the useful comments. - 1, 2, 3 >> Agreed and will

[jira] [Commented] (HDFS-9323) Randomize the DFSStripedOutputStreamWithFailure tests

2015-10-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982187#comment-14982187 ] Hudson commented on HDFS-9323: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2547 (See

[jira] [Assigned] (HDFS-9344) QUEUE_WITH_CORRUPT_BLOCKS is no longer needed

2015-10-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen reassigned HDFS-9344: --- Assignee: Xiao Chen (was: Jagadesh Kiran N) > QUEUE_WITH_CORRUPT_BLOCKS is no longer needed >

[jira] [Commented] (HDFS-9323) Randomize the DFSStripedOutputStreamWithFailure tests

2015-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14981988#comment-14981988 ] Hadoop QA commented on HDFS-9323: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9275) Wait previous ErasureCodingWork to finish before schedule another one

2015-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982022#comment-14982022 ] Hadoop QA commented on HDFS-9275: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9236) Missing sanity check for block size during block recovery

2015-10-30 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982020#comment-14982020 ] Walter Su commented on HDFS-9236: - If a buggy DN does return RUR without throwing

[jira] [Issue Comment Deleted] (HDFS-9323) Randomize the DFSStripedOutputStreamWithFailure tests

2015-10-30 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9323: -- Comment: was deleted (was: Filed HDFS-9346 testMultipleDatanodeFailure56.) > Randomize

[jira] [Commented] (HDFS-9323) Randomize the DFSStripedOutputStreamWithFailure tests

2015-10-30 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982078#comment-14982078 ] Tsz Wo Nicholas Sze commented on HDFS-9323: --- Filed HDFS-9346 testMultipleDatanodeFailure56. >

[jira] [Created] (HDFS-9344) QUEUE_WITH_CORRUPT_BLOCKS is no longer needed

2015-10-30 Thread Zhe Zhang (JIRA)
Zhe Zhang created HDFS-9344: --- Summary: QUEUE_WITH_CORRUPT_BLOCKS is no longer needed Key: HDFS-9344 URL: https://issues.apache.org/jira/browse/HDFS-9344 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-9346) TestDFSStripedOutputStreamWithFailure.testMultipleDatanodeFailure56 may throw NPE

2015-10-30 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-9346: - Summary: TestDFSStripedOutputStreamWithFailure.testMultipleDatanodeFailure56 may throw NPE Key: HDFS-9346 URL: https://issues.apache.org/jira/browse/HDFS-9346

[jira] [Commented] (HDFS-9343) Empty caller context considered invalid

2015-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982153#comment-14982153 ] Hadoop QA commented on HDFS-9343: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9236) Missing sanity check for block size during block recovery

2015-10-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982006#comment-14982006 ] Zhe Zhang commented on HDFS-9236: - bq. If a DN has a RUR, it will return RecoveryInProgressException.

[jira] [Commented] (HDFS-9276) Failed to Update HDFS Delegation Token for long running application in HA mode

2015-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982036#comment-14982036 ] Hadoop QA commented on HDFS-9276: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9323) Randomize the DFSStripedOutputStreamWithFailure tests

2015-10-30 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982059#comment-14982059 ] Tsz Wo Nicholas Sze commented on HDFS-9323: --- I see what you mean now. Thanks for reviewing the

[jira] [Commented] (HDFS-9323) Randomize the DFSStripedOutputStreamWithFailure tests

2015-10-30 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982065#comment-14982065 ] Tsz Wo Nicholas Sze commented on HDFS-9323: --- The failure of testMultipleDatanodeFailure56 is not

[jira] [Commented] (HDFS-9323) Randomize the DFSStripedOutputStreamWithFailure tests

2015-10-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982162#comment-14982162 ] Hudson commented on HDFS-9323: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #605 (See

[jira] [Updated] (HDFS-9289) Make DataStreamer#block thread safe and verify genStamp in commitBlock

2015-10-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9289: Summary: Make DataStreamer#block thread safe and verify genStamp in commitBlock (was: check genStamp when

[jira] [Commented] (HDFS-9344) QUEUE_WITH_CORRUPT_BLOCKS is no longer needed

2015-10-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14981969#comment-14981969 ] Xiao Chen commented on HDFS-9344: - Thanks for creating the JIRA Zhe. I'll be working on it. >

[jira] [Assigned] (HDFS-9344) QUEUE_WITH_CORRUPT_BLOCKS is no longer needed

2015-10-30 Thread Jagadesh Kiran N (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jagadesh Kiran N reassigned HDFS-9344: -- Assignee: Jagadesh Kiran N > QUEUE_WITH_CORRUPT_BLOCKS is no longer needed >

[jira] [Created] (HDFS-9345) Erasure Coding: create dummy coder and schema

2015-10-30 Thread Rui Li (JIRA)
Rui Li created HDFS-9345: Summary: Erasure Coding: create dummy coder and schema Key: HDFS-9345 URL: https://issues.apache.org/jira/browse/HDFS-9345 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-9229) Expose size of NameNode directory as a metric

2015-10-30 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14981986#comment-14981986 ] Surendra Singh Lilhore commented on HDFS-9229: -- Thanks [~zhz] for reviews and commit. >

[jira] [Commented] (HDFS-9289) Make DataStreamer#block thread safe and verify genStamp in commitBlock

2015-10-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14981971#comment-14981971 ] Zhe Zhang commented on HDFS-9289: - Thanks Chang for the update. The main code change looks good. I'll take

[jira] [Updated] (HDFS-9276) Failed to Update HDFS Delegation Token for long running application in HA mode

2015-10-30 Thread Liangliang Gu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liangliang Gu updated HDFS-9276: Attachment: HDFS-9276.09.patch > Failed to Update HDFS Delegation Token for long running application

[jira] [Commented] (HDFS-9342) Erasure coding: client should update and commit block based on acknowledged size

2015-10-30 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982192#comment-14982192 ] Walter Su commented on HDFS-9342: - Both {{updatePipeline}} and {{commitBlock}} will set the visible length

[jira] [Commented] (HDFS-9343) Empty caller context considered invalid

2015-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982004#comment-14982004 ] Hadoop QA commented on HDFS-9343: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9323) Randomize the DFSStripedOutputStreamWithFailure tests

2015-10-30 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9323: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0

[jira] [Commented] (HDFS-9323) Randomize the DFSStripedOutputStreamWithFailure tests

2015-10-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982116#comment-14982116 ] Hudson commented on HDFS-9323: -- FAILURE: Integrated in Hadoop-trunk-Commit #8728 (See

[jira] [Commented] (HDFS-9323) Randomize the DFSStripedOutputStreamWithFailure tests

2015-10-30 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982079#comment-14982079 ] Tsz Wo Nicholas Sze commented on HDFS-9323: --- Filed HDFS-9346 testMultipleDatanodeFailure56. >

[jira] [Updated] (HDFS-9348) DFS GetErasureCodingPolicy API on a non-existent file should be handled properly

2015-10-30 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-9348: --- Attachment: HDFS-9348-00.patch > DFS GetErasureCodingPolicy API on a non-existent file should be handled >

[jira] [Updated] (HDFS-9348) DFS GetErasureCodingPolicy API on a non-existent file should be handled properly

2015-10-30 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-9348: --- Target Version/s: 3.0.0 Status: Patch Available (was: Open) > DFS GetErasureCodingPolicy API on

[jira] [Updated] (HDFS-9254) HDFS Secure Mode Documentation updates

2015-10-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9254: Attachment: HDFS-9254.03.patch v3 patch. # I had fixed incorrect defaults in hdfs-defaults.xml which

[jira] [Commented] (HDFS-9329) TestBootstrapStandby#testRateThrottling is flaky because fsimage size is smaller than IO buffer size

2015-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983476#comment-14983476 ] Hadoop QA commented on HDFS-9329: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-9349) Reconfigure NN protected directories on the fly

2015-10-30 Thread Xiaobing Zhou (JIRA)
Xiaobing Zhou created HDFS-9349: --- Summary: Reconfigure NN protected directories on the fly Key: HDFS-9349 URL: https://issues.apache.org/jira/browse/HDFS-9349 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-9343) Empty caller context considered invalid

2015-10-30 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9343: Status: Open (was: Patch Available) > Empty caller context considered invalid >

[jira] [Updated] (HDFS-9343) Empty caller context considered invalid

2015-10-30 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9343: Status: Patch Available (was: Open) > Empty caller context considered invalid >

[jira] [Updated] (HDFS-9262) Reconfigure DN lazy writer interval on the fly

2015-10-30 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9262: Summary: Reconfigure DN lazy writer interval on the fly (was: Reconfigure lazy writer interval on

[jira] [Updated] (HDFS-9254) HDFS Secure Mode Documentation updates

2015-10-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9254: Attachment: HDFS-9254.02.patch > HDFS Secure Mode Documentation updates >

[jira] [Updated] (HDFS-9330) Reconfigure DN deleting duplicate replica on the fly

2015-10-30 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9330: Summary: Reconfigure DN deleting duplicate replica on the fly (was: Reconfigure deleting duplicate

[jira] [Assigned] (HDFS-9349) Reconfigure NN protected directories on the fly

2015-10-30 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou reassigned HDFS-9349: --- Assignee: Xiaobing Zhou > Reconfigure NN protected directories on the fly >

[jira] [Commented] (HDFS-9308) Add truncateMeta() and deleteMeta() to MiniDFSCluster

2015-10-30 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983478#comment-14983478 ] Lei (Eddy) Xu commented on HDFS-9308: - Hi, [~twu] Thanks for working on this. It looks good overall.

[jira] [Resolved] (HDFS-9344) QUEUE_WITH_CORRUPT_BLOCKS is no longer needed

2015-10-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HDFS-9344. - Resolution: Invalid Thanks Xiao! Good analysis! Closing this as invalid. > QUEUE_WITH_CORRUPT_BLOCKS is

[jira] [Updated] (HDFS-9341) Simulated slow disk in SimulatedFSDataset

2015-10-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9341: Status: Patch Available (was: Open) Maybe we can dedicate this JIRA to adding random slowness. Attaching

[jira] [Updated] (HDFS-9350) Avoid creating temprorary strings in Block.toString() and getBlockName()

2015-10-30 Thread Staffan Friberg (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Staffan Friberg updated HDFS-9350: -- Status: Patch Available (was: Open) > Avoid creating temprorary strings in Block.toString() and

[jira] [Updated] (HDFS-9350) Avoid creating temprorary strings in Block.toString() and getBlockName()

2015-10-30 Thread Staffan Friberg (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Staffan Friberg updated HDFS-9350: -- Attachment: HDFS-9350.001.patch > Avoid creating temprorary strings in Block.toString() and

[jira] [Assigned] (HDFS-9350) Avoid creating temprorary strings in Block.toString() and getBlockName()

2015-10-30 Thread Staffan Friberg (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Staffan Friberg reassigned HDFS-9350: - Assignee: Staffan Friberg > Avoid creating temprorary strings in Block.toString() and

[jira] [Commented] (HDFS-9103) Retry reads on DN failure

2015-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983470#comment-14983470 ] Hadoop QA commented on HDFS-9103: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8777) Erasure Coding: add tests for taking snapshots on EC files

2015-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983528#comment-14983528 ] Hadoop QA commented on HDFS-8777: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9341) Simulated slow disk in SimulatedFSDataset

2015-10-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9341: Attachment: HDFS-9341.00.patch > Simulated slow disk in SimulatedFSDataset >

[jira] [Commented] (HDFS-9305) Delayed heartbeat processing causes storm of subsequent heartbeats

2015-10-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983629#comment-14983629 ] Arpit Agarwal commented on HDFS-9305: - That is right, thanks for updating it. > Delayed heartbeat

[jira] [Updated] (HDFS-9305) Delayed heartbeat processing causes storm of subsequent heartbeats

2015-10-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9305: Target Version/s: (was: 2.7.2) > Delayed heartbeat processing causes storm of subsequent

[jira] [Updated] (HDFS-9305) Delayed heartbeat processing causes storm of subsequent heartbeats

2015-10-30 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-9305: - Fix Version/s: 2.7.2 Setting the fix version to 2.7.2. [~arpitagarwal] - if that's not right,

[jira] [Commented] (HDFS-9276) Failed to Update HDFS Delegation Token for long running application in HA mode

2015-10-30 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982267#comment-14982267 ] Steve Loughran commented on HDFS-9276: -- in the test, you don't need to catch that exception and

[jira] [Commented] (HDFS-9323) Randomize the DFSStripedOutputStreamWithFailure tests

2015-10-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982263#comment-14982263 ] Hudson commented on HDFS-9323: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1340 (See

[jira] [Commented] (HDFS-9323) Randomize the DFSStripedOutputStreamWithFailure tests

2015-10-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982274#comment-14982274 ] Hudson commented on HDFS-9323: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #617 (See

[jira] [Commented] (HDFS-9328) Formalize coding standards for libhdfs++ and put them in a README.txt

2015-10-30 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982268#comment-14982268 ] Steve Loughran commented on HDFS-9328: -- Are you proposing a different cpp guide from the rest of the

[jira] [Commented] (HDFS-9323) Randomize the DFSStripedOutputStreamWithFailure tests

2015-10-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982295#comment-14982295 ] Hudson commented on HDFS-9323: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #554 (See

[jira] [Updated] (HDFS-9173) Erasure Coding: Lease recovery for striped file

2015-10-30 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-9173: Attachment: HDFS-9173.05.patch rebased > Erasure Coding: Lease recovery for striped file >

[jira] [Commented] (HDFS-9236) Missing sanity check for block size during block recovery

2015-10-30 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983718#comment-14983718 ] Walter Su commented on HDFS-9236: - I agree with [~zhz] that a buggy DN could cause this issue. And I agree

[jira] [Updated] (HDFS-9352) Hadoop-Trunk test cases start failing from morning

2015-10-30 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9352: --- Priority: Blocker (was: Major) > Hadoop-Trunk test cases start failing from morning >

[jira] [Updated] (HDFS-9340) libhdfspp fails to compile after HDFS-9207

2015-10-30 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9340: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-8707 Status: Resolved

[jira] [Updated] (HDFS-9351) No checkNNStartup() is called when fsck calls FSNamesystem.getSnapshottableDirs()

2015-10-30 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9351: Description: I looked further at HDFS-9231 change I reviewed earlier, and realize I missed one

[jira] [Commented] (HDFS-9129) Move the safemode block count into BlockManager

2015-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983695#comment-14983695 ] Hadoop QA commented on HDFS-9129: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9341) Simulated slow disk in SimulatedFSDataset

2015-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983835#comment-14983835 ] Hadoop QA commented on HDFS-9341: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (HDFS-9351) No checkNNStartup() is called when fsck calls FSNamesystem.getSnapshottableDirs()

2015-10-30 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang reassigned HDFS-9351: --- Assignee: Xiao Chen Hi Xiao, would you please look into? thanks much. > No checkNNStartup()

[jira] [Commented] (HDFS-9348) DFS GetErasureCodingPolicy API on a non-existent file should be handled properly

2015-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983713#comment-14983713 ] Hadoop QA commented on HDFS-9348: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9236) Missing sanity check for block size during block recovery

2015-10-30 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983731#comment-14983731 ] Walter Su commented on HDFS-9236: - {{syncBlock}} already has an assumption that there's no RUR in syncList.

[jira] [Created] (HDFS-9352) Hadoop-Trunk test cases start failing from morning

2015-10-30 Thread Brahma Reddy Battula (JIRA)
Brahma Reddy Battula created HDFS-9352: -- Summary: Hadoop-Trunk test cases start failing from morning Key: HDFS-9352 URL: https://issues.apache.org/jira/browse/HDFS-9352 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9254) HDFS Secure Mode Documentation updates

2015-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983793#comment-14983793 ] Hadoop QA commented on HDFS-9254: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9236) Missing sanity check for block size during block recovery

2015-10-30 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983828#comment-14983828 ] Yongjun Zhang commented on HDFS-9236: - Hi [~walter.k.su], Thanks for the comments. Agree that

[jira] [Commented] (HDFS-9351) No checkNNStartup() is called when fsck calls FSNamesystem.getSnapshottableDirs()

2015-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983829#comment-14983829 ] Hadoop QA commented on HDFS-9351: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9236) Missing sanity check for block size during block recovery

2015-10-30 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983844#comment-14983844 ] Walter Su commented on HDFS-9236: - I mean RUR shouldn't be put in syncList. > Missing sanity check for

[jira] [Updated] (HDFS-9351) No checkNNStartup() is called when fsck calls FSNamesystem.getSnapshottableDirs()

2015-10-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9351: Attachment: HDFS-9351.patch Thanks very much for the additional review and creating this JIRA. Good catch! I

[jira] [Commented] (HDFS-9329) TestBootstrapStandby#testRateThrottling is flaky because fsimage size is smaller than IO buffer size

2015-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983721#comment-14983721 ] Hadoop QA commented on HDFS-9329: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-9353) Code and comment mismatch in JavaKeyStoreProvider

2015-10-30 Thread nijel (JIRA)
nijel created HDFS-9353: --- Summary: Code and comment mismatch in JavaKeyStoreProvider Key: HDFS-9353 URL: https://issues.apache.org/jira/browse/HDFS-9353 Project: Hadoop HDFS Issue Type: Task

[jira] [Commented] (HDFS-4937) ReplicationMonitor can infinite-loop in BlockPlacementPolicyDefault#chooseRandom()

2015-10-30 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983824#comment-14983824 ] Vinayakumar B commented on HDFS-4937: - hi [~aw], any idea why tests did not run in last precommit for

[jira] [Created] (HDFS-9351) No checkNNStartup() is called when fsck calls FSNamesystem.getSnapshottableDirs()

2015-10-30 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-9351: --- Summary: No checkNNStartup() is called when fsck calls FSNamesystem.getSnapshottableDirs() Key: HDFS-9351 URL: https://issues.apache.org/jira/browse/HDFS-9351 Project:

[jira] [Commented] (HDFS-9320) libhdfspp should not use sizeof for stream parsing

2015-10-30 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983669#comment-14983669 ] Haohui Mai commented on HDFS-9320: -- {code} +const unsigned int kSizeofJavaShort = 2; +const unsigned int

[jira] [Updated] (HDFS-9351) No checkNNStartup() is called when fsck calls FSNamesystem.getSnapshottableDirs()

2015-10-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9351: Status: Patch Available (was: Open) > No checkNNStartup() is called when fsck calls >

[jira] [Updated] (HDFS-9308) Add truncateMeta() and deleteMeta() to MiniDFSCluster

2015-10-30 Thread Tony Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tony Wu updated HDFS-9308: -- Attachment: HDFS-9308.003.patch In v3 patch: * Addressed [~eddyxu]'s review comments. *Please note:*

[jira] [Commented] (HDFS-9276) Failed to Update HDFS Delegation Token for long running application in HA mode

2015-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982499#comment-14982499 ] Hadoop QA commented on HDFS-9276: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9323) Randomize the DFSStripedOutputStreamWithFailure tests

2015-10-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982542#comment-14982542 ] Hudson commented on HDFS-9323: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2492 (See

[jira] [Commented] (HDFS-9275) Wait previous ErasureCodingWork to finish before schedule another one

2015-10-30 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982604#comment-14982604 ] Walter Su commented on HDFS-9275: - The failed tests are not related. > Wait previous ErasureCodingWork to

[jira] [Commented] (HDFS-4937) ReplicationMonitor can infinite-loop in BlockPlacementPolicyDefault#chooseRandom()

2015-10-30 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982643#comment-14982643 ] Kihwal Lee commented on HDFS-4937: -- Also committed to branch-2.7. > ReplicationMonitor can infinite-loop

[jira] [Updated] (HDFS-9320) libhdfspp should not use sizeof for stream parsing

2015-10-30 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9320: -- Attachment: HDFS-9320.HDFS-8707.000.patch Added constants defining the size of java ints and

[jira] [Assigned] (HDFS-9320) libhdfspp should not use sizeof for stream parsing

2015-10-30 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer reassigned HDFS-9320: - Assignee: James Clampffer > libhdfspp should not use sizeof for stream parsing >

[jira] [Commented] (HDFS-9289) Make DataStreamer#block thread safe and verify genStamp in commitBlock

2015-10-30 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982617#comment-14982617 ] Chang Li commented on HDFS-9289: Thanks [~zhz], the jira title looks good to me. Looking forward to your

[jira] [Updated] (HDFS-4937) ReplicationMonitor can infinite-loop in BlockPlacementPolicyDefault#chooseRandom()

2015-10-30 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-4937: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 3.0.0

[jira] [Updated] (HDFS-9320) libhdfspp should not use sizeof for stream parsing

2015-10-30 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9320: -- Status: Patch Available (was: Open) > libhdfspp should not use sizeof for stream parsing >

[jira] [Resolved] (HDFS-9272) Implement a unix-like cat utility

2015-10-30 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer resolved HDFS-9272. --- Resolution: Won't Fix I went down the wrong path with this so I'll close it. Will either open

[jira] [Commented] (HDFS-4937) ReplicationMonitor can infinite-loop in BlockPlacementPolicyDefault#chooseRandom()

2015-10-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982633#comment-14982633 ] Hudson commented on HDFS-4937: -- FAILURE: Integrated in Hadoop-trunk-Commit #8730 (See

[jira] [Updated] (HDFS-4937) ReplicationMonitor can infinite-loop in BlockPlacementPolicyDefault#chooseRandom()

2015-10-30 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-4937: - Fix Version/s: (was: 2.8.0) 2.7.2 > ReplicationMonitor can infinite-loop in >

[jira] [Commented] (HDFS-4937) ReplicationMonitor can infinite-loop in BlockPlacementPolicyDefault#chooseRandom()

2015-10-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982676#comment-14982676 ] Hudson commented on HDFS-4937: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2549 (See

[jira] [Commented] (HDFS-1477) Make NameNode Reconfigurable.

2015-10-30 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983266#comment-14983266 ] Xiaobing Zhou commented on HDFS-1477: - Thanks [~arpitagarwal] for review! The next patch will address

[jira] [Commented] (HDFS-9348) DFS GetErasureCodingPolicy API on a non-existent file should be handled properly

2015-10-30 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983301#comment-14983301 ] Uma Maheswara Rao G commented on HDFS-9348: --- Hi Rakesh, unifying the behaviors would be a good

[jira] [Assigned] (HDFS-2746) Add a parameter to `hdfs dfsadmin -saveNamespace' to allow an arbitrary storage dir

2015-10-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen reassigned HDFS-2746: --- Assignee: Xiao Chen > Add a parameter to `hdfs dfsadmin -saveNamespace' to allow an arbitrary >

[jira] [Commented] (HDFS-2746) Add a parameter to `hdfs dfsadmin -saveNamespace' to allow an arbitrary storage dir

2015-10-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983502#comment-14983502 ] Xiao Chen commented on HDFS-2746: - Thanks ATM and Harsh for creating this issue and clarifying. This sounds

[jira] [Work started] (HDFS-9140) Discover conf parameters that need no DataNode restart to make changes effective

2015-10-30 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-9140 started by Xiaobing Zhou. --- > Discover conf parameters that need no DataNode restart to make changes >

[jira] [Commented] (HDFS-4937) ReplicationMonitor can infinite-loop in BlockPlacementPolicyDefault#chooseRandom()

2015-10-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982818#comment-14982818 ] Hudson commented on HDFS-4937: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #619 (See

[jira] [Commented] (HDFS-9320) libhdfspp should not use sizeof for stream parsing

2015-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982719#comment-14982719 ] Hadoop QA commented on HDFS-9320: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-4937) ReplicationMonitor can infinite-loop in BlockPlacementPolicyDefault#chooseRandom()

2015-10-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982791#comment-14982791 ] Hudson commented on HDFS-4937: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2493 (See

  1   2   >