[jira] [Commented] (HDFS-8331) Erasure Coding: Create FileStatus isErasureCoded() method

2016-10-13 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572238#comment-15572238 ] Wei-Chiu Chuang commented on HDFS-8331: --- [~rakesh_r] I filed HADOOP-13715 without knowing you had

[jira] [Commented] (HDFS-10935) TestFileChecksum tests are failing after HDFS-10460 (Mac only?)

2016-10-13 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572290#comment-15572290 ] Wei-Chiu Chuang commented on HDFS-10935: I increase heap size of the surefire plugin to 10240mb.

[jira] [Commented] (HDFS-10935) TestFileChecksum tests are failing after HDFS-10460 (Mac only?)

2016-10-13 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572244#comment-15572244 ] Wei-Chiu Chuang commented on HDFS-10935: Hi Sammi, I ran the tests on Mac in IntelliJ and in

[jira] [Commented] (HDFS-10935) TestFileChecksum tests are failing after HDFS-10460 (Mac only?)

2016-10-13 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572291#comment-15572291 ] Wei-Chiu Chuang commented on HDFS-10935: But I had no problem running other tests. :( >

[jira] [Commented] (HDFS-10921) TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode

2016-10-13 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572447#comment-15572447 ] Eric Badger commented on HDFS-10921: [~xkrogen], [~shahrs87], I still haven't figured out how to make

[jira] [Updated] (HDFS-10921) TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode

2016-10-13 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated HDFS-10921: --- Attachment: HDFS-10921.003.patch Attaching a patch that simply adds the @Before annotation to start

[jira] [Commented] (HDFS-10949) DiskBalancer: deprecate TestDiskBalancer#setVolumeCapacity

2016-10-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572642#comment-15572642 ] Hudson commented on HDFS-10949: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10603 (See

[jira] [Commented] (HDFS-10637) Modifications to remove the assumption that FsVolumes are backed by java.io.File.

2016-10-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572700#comment-15572700 ] Arpit Agarwal commented on HDFS-10637: -- Thanks for the response [~virajith]. No use case from me -

[jira] [Updated] (HDFS-10558) DiskBalancer: Print the full path to plan file

2016-10-13 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10558: - Status: Patch Available (was: Open) > DiskBalancer: Print the full path to plan file >

[jira] [Updated] (HDFS-10558) DiskBalancer: Print the full path to plan file

2016-10-13 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10558: - Status: Open (was: Patch Available) > DiskBalancer: Print the full path to plan file >

[jira] [Commented] (HDFS-10921) TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode

2016-10-13 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572459#comment-15572459 ] Erik Krogen commented on HDFS-10921: Sounds reasonable to me. Fixing the test failure should be

[jira] [Commented] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

2016-10-13 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572514#comment-15572514 ] Zhe Zhang commented on HDFS-10999: -- Thanks for the thoughts [~aw]. EC policies are configured per file

[jira] [Updated] (HDFS-10986) DFSAdmin should log detailed error message if any

2016-10-13 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-10986: Attachment: HDFS-10986-branch-2.8.004.patch Uploading the branch-2.8 patch for two

[jira] [Commented] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

2016-10-13 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572492#comment-15572492 ] Allen Wittenauer commented on HDFS-10999: - Given that the fsck output is the *only* way to get

[jira] [Commented] (HDFS-10986) DFSAdmin should log detailed error message if any

2016-10-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572511#comment-15572511 ] Hudson commented on HDFS-10986: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10602 (See

[jira] [Commented] (HDFS-10637) Modifications to remove the assumption that FsVolumes are backed by java.io.File.

2016-10-13 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572582#comment-15572582 ] Virajith Jalaparti commented on HDFS-10637: --- Hi [~arpitagarwal], We currently do not have a plan

[jira] [Updated] (HDFS-10949) DiskBalancer: deprecate TestDiskBalancer#setVolumeCapacity

2016-10-13 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10949: Resolution: Fixed Hadoop Flags: Reviewed Target Version/s: 3.0.0-alpha2

[jira] [Comment Edited] (HDFS-10921) TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode

2016-10-13 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572550#comment-15572550 ] Erik Krogen edited comment on HDFS-10921 at 10/13/16 5:09 PM: -- Should we

[jira] [Commented] (HDFS-10921) TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode

2016-10-13 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572550#comment-15572550 ] Erik Krogen commented on HDFS-10921: Should we still change {{restartNameNodes}} to

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-10-13 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572595#comment-15572595 ] Konstantin Shvachko commented on HDFS-10301: Plan to commit this tonight, if there are no

[jira] [Commented] (HDFS-10921) TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode

2016-10-13 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572453#comment-15572453 ] Rushabh S Shah commented on HDFS-10921: --- bq. Should we fix up the test so that it restarts the

[jira] [Commented] (HDFS-10558) DiskBalancer: Print the full path to plan file

2016-10-13 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572644#comment-15572644 ] Anu Engineer commented on HDFS-10558: - I am +1 on this patch, had one clarification question and if

[jira] [Commented] (HDFS-10949) DiskBalancer: deprecate TestDiskBalancer#setVolumeCapacity

2016-10-13 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572589#comment-15572589 ] Anu Engineer commented on HDFS-10949: - +1, I will commit this shortly. > DiskBalancer: deprecate

[jira] [Updated] (HDFS-10949) DiskBalancer: deprecate TestDiskBalancer#setVolumeCapacity

2016-10-13 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10949: Fix Version/s: 3.0.0-alpha2 > DiskBalancer: deprecate TestDiskBalancer#setVolumeCapacity >

[jira] [Updated] (HDFS-10990) TestPendingInvalidateBlock should wait for IBRs

2016-10-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10990: --- Resolution: Fixed Fix Version/s: 3.0.0-alpha2 2.8.0 Status:

[jira] [Updated] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-10-13 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10301: - Attachment: (was: HDFS-10301.015.patch) > BlockReport retransmissions may

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-10-13 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572936#comment-15572936 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- Updated the patch. The conflict was due to a

[jira] [Reopened] (HDFS-10990) TestPendingInvalidateBlock should wait for IBRs

2016-10-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reopened HDFS-10990: Thanks for the catch Kihwal. I've reverted this from the three branches. > TestPendingInvalidateBlock

[jira] [Updated] (HDFS-10990) TestPendingInvalidateBlock should wait for IBRs

2016-10-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10990: --- Fix Version/s: (was: 3.0.0-alpha2) (was: 2.8.0) >

[jira] [Commented] (HDFS-10872) Add MutableRate metrics for FSNamesystemLock operations

2016-10-13 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572775#comment-15572775 ] Zhe Zhang commented on HDFS-10872: -- Thanks Erik for the patch! The structure looks good overall. A few

[jira] [Updated] (HDFS-11004) Ozone : move Chunk IO and container protocol calls to hdfs-client

2016-10-13 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11004: -- Attachment: HDFS-11004-HDFS-7240.001.patch > Ozone : move Chunk IO and container protocol calls to

[jira] [Updated] (HDFS-11004) Ozone : move Chunk IO and container protocol calls to hdfs-client

2016-10-13 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11004: -- Status: Patch Available (was: Open) > Ozone : move Chunk IO and container protocol calls to

[jira] [Updated] (HDFS-10735) Distcp using webhdfs on secure HA clusters fails with StandbyException

2016-10-13 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony updated HDFS-10735: Description: A distcp running on HADOOP 2.7.2 cluster , copying from HADOOP 2.4.1 cluster fails.

[jira] [Resolved] (HDFS-9453) Fix protobuf runtime warnings

2016-10-13 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer resolved HDFS-9453. --- Resolution: Duplicate Assignee: (was: James Clampffer) Dupe of HDFS-10595 > Fix

[jira] [Commented] (HDFS-10990) TestPendingInvalidateBlock should wait for IBRs

2016-10-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572860#comment-15572860 ] Hudson commented on HDFS-10990: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10605 (See

[jira] [Commented] (HDFS-10912) Ozone:SCM: Add chill mode support to NodeManager.

2016-10-13 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572947#comment-15572947 ] Xiaoyu Yao commented on HDFS-10912: --- [~anu], thanks for the update. The test failure in

[jira] [Created] (HDFS-11004) Ozone : move Chunk IO and container protocol calls to hdfs-client

2016-10-13 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11004: - Summary: Ozone : move Chunk IO and container protocol calls to hdfs-client Key: HDFS-11004 URL: https://issues.apache.org/jira/browse/HDFS-11004 Project: Hadoop HDFS

[jira] [Commented] (HDFS-10987) Make Decommission less expensive when lot of blocks present.

2016-10-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572902#comment-15572902 ] Hudson commented on HDFS-10987: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10606 (See

[jira] [Updated] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-10-13 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10301: - Attachment: (was: HDFS-10301.016.patch) > BlockReport retransmissions may

[jira] [Updated] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-10-13 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10301: - Attachment: HDFS-10301.015.patch > BlockReport retransmissions may lead to

[jira] [Commented] (HDFS-10990) TestPendingInvalidateBlock should wait for IBRs

2016-10-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572980#comment-15572980 ] Kihwal Lee commented on HDFS-10990: --- It looks like branch-2 build is failing after this. >

[jira] [Updated] (HDFS-10987) Make Decommission less expensive when lot of blocks present.

2016-10-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10987: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

2016-10-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572797#comment-15572797 ] Andrew Wang commented on HDFS-10999: We tried to draw an equivalence between the durability of EC and

[jira] [Commented] (HDFS-10921) TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode

2016-10-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572801#comment-15572801 ] Hadoop QA commented on HDFS-10921: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10986) DFSAdmin should log detailed error message if any

2016-10-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572820#comment-15572820 ] Hadoop QA commented on HDFS-10986: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-10-13 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10301: - Attachment: HDFS-10301.016.patch > BlockReport retransmissions may lead to

[jira] [Updated] (HDFS-10990) TestPendingInvalidateBlock should wait for IBRs

2016-10-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10990: --- Affects Version/s: 2.8.0 3.0.0-alpha1 Target Version/s: 2.8.0,

[jira] [Commented] (HDFS-10987) Make Decommission less expensive when lot of blocks present.

2016-10-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572825#comment-15572825 ] Andrew Wang commented on HDFS-10987: Yea LGTM too, thanks all! > Make Decommission less expensive

[jira] [Updated] (HDFS-10987) Make Decommission less expensive when lot of blocks present.

2016-10-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10987: -- Fix Version/s: 3.0.0-alpha2 > Make Decommission less expensive when lot of blocks present. >

[jira] [Commented] (HDFS-10967) Add configuration for BlockPlacementPolicy to avoid near-full DataNodes

2016-10-13 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573008#comment-15573008 ] Konstantin Shvachko commented on HDFS-10967: Sounds like HDFS-8131 already takes care of this

[jira] [Commented] (HDFS-10912) Ozone:SCM: Add chill mode support to NodeManager.

2016-10-13 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573010#comment-15573010 ] Anu Engineer commented on HDFS-10912: - let me check if this happening in trunk too, so I know if I

[jira] [Updated] (HDFS-10990) TestPendingInvalidateBlock should wait for IBRs

2016-10-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10990: --- Attachment: HDFS-10990.004.patch Doing a little googling, I think this might be related to JDK8 vs.

[jira] [Assigned] (HDFS-10996) Ability to specify per-file EC policy at create time

2016-10-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reassigned HDFS-10996: -- Assignee: SammiChen More than welcome Sammi, assigning to you. > Ability to specify per-file

[jira] [Updated] (HDFS-10990) TestPendingInvalidateBlock should wait for IBRs

2016-10-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10990: --- Status: Patch Available (was: Reopened) > TestPendingInvalidateBlock should wait for IBRs >

[jira] [Updated] (HDFS-10993) rename may fail without a clear message indicating the failure reason.

2016-10-13 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10993: -- Priority: Minor (was: Major) > rename may fail without a clear message indicating the failure reason.

[jira] [Updated] (HDFS-10993) rename may fail without a clear message indicating the failure reason.

2016-10-13 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10993: -- Issue Type: Improvement (was: Bug) > rename may fail without a clear message indicating the failure

[jira] [Updated] (HDFS-10409) libhdfs++: Something is holding connection_state_lock in RpcConnectionImpl destructor

2016-10-13 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10409: --- Attachment: HDFS-10409.HDFS-8707.001.patch Forgot about this.. Uploading to get a new CI run.

[jira] [Commented] (HDFS-10986) DFSAdmin should log detailed error message if any

2016-10-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573305#comment-15573305 ] Mingliang Liu commented on HDFS-10986: -- Thank you for taking care of this, [~brahmareddy]! >

[jira] [Commented] (HDFS-10993) rename may fail without a clear message indicating the failure reason.

2016-10-13 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573378#comment-15573378 ] John Zhuge commented on HDFS-10993: --- This is a deprecated method. The other non-deprecated method does

[jira] [Commented] (HDFS-10912) Ozone:SCM: Add chill mode support to NodeManager.

2016-10-13 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573398#comment-15573398 ] Anu Engineer commented on HDFS-10912: - Filed HDFS-11005 to track this test failure. > Ozone:SCM: Add

[jira] [Created] (HDFS-11005) Ozone: TestBlockPoolManager fails in ozone branch.

2016-10-13 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-11005: --- Summary: Ozone: TestBlockPoolManager fails in ozone branch. Key: HDFS-11005 URL: https://issues.apache.org/jira/browse/HDFS-11005 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-11004) Ozone : move Chunk IO and container protocol calls to hdfs-client

2016-10-13 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11004: -- Attachment: HDFS-11004-HDFS-7240.002.patch fix checkstyle and javadoc in v002 patch, findbugs are all

[jira] [Commented] (HDFS-10409) libhdfs++: Something is holding connection_state_lock in RpcConnectionImpl destructor

2016-10-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573439#comment-15573439 ] Hadoop QA commented on HDFS-10409: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10912) Ozone:SCM: Add chill mode support to NodeManager.

2016-10-13 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573438#comment-15573438 ] Xiaoyu Yao commented on HDFS-10912: --- +1 for v05 patch. Thanks Anu filing the ticket for the test issue

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-10-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573170#comment-15573170 ] Hadoop QA commented on HDFS-10301: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11004) Ozone : move Chunk IO and container protocol calls to hdfs-client

2016-10-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573199#comment-15573199 ] Hadoop QA commented on HDFS-11004: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10993) rename may fail without a clear message indicating the failure reason

2016-10-13 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10993: -- Summary: rename may fail without a clear message indicating the failure reason (was: rename may fail

[jira] [Updated] (HDFS-10921) TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode

2016-10-13 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated HDFS-10921: --- Attachment: HDFS-10921.004.patch bq. Should we still change restartNameNodes to restartNameNode(true)

[jira] [Commented] (HDFS-10990) TestPendingInvalidateBlock should wait for IBRs

2016-10-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573122#comment-15573122 ] Hudson commented on HDFS-10990: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10607 (See

[jira] [Commented] (HDFS-10960) TestDataNodeHotSwapVolumes#testRemoveVolumeBeingWritten fails at disk error verification after volume remove

2016-10-13 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573338#comment-15573338 ] Lei (Eddy) Xu commented on HDFS-10960: -- Hi, [~manojg] The patch fails to build on the newest trunk.

[jira] [Commented] (HDFS-10638) Modifications to remove the assumption that StorageLocation is associated with java.io.File in Datanode.

2016-10-13 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573217#comment-15573217 ] Lei (Eddy) Xu commented on HDFS-10638: -- Hi, [~virajith] Thanks for addressing my comments. {code}

[jira] [Commented] (HDFS-10409) libhdfs++: Something is holding connection_state_lock in RpcConnectionImpl destructor

2016-10-13 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573267#comment-15573267 ] Xiaowei Zhu commented on HDFS-10409: +1 on 001.patch. Adding MEMCHECKED_CLASS can be helpful. >

[jira] [Updated] (HDFS-10993) Rename may fail without a clear message indicating the failure reason

2016-10-13 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10993: -- Summary: Rename may fail without a clear message indicating the failure reason (was: rename may fail

[jira] [Updated] (HDFS-10906) Add unit tests for Trash with HDFS encryption zones

2016-10-13 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-10906: -- Attachment: HDFS-10906.002.patch Thank you [~xyao] for reviewing the patch. I have addressed

[jira] [Commented] (HDFS-10990) TestPendingInvalidateBlock should wait for IBRs

2016-10-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573482#comment-15573482 ] Hadoop QA commented on HDFS-10990: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10912) Ozone:SCM: Add chill mode support to NodeManager.

2016-10-13 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10912: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-11004) Ozone : move Chunk IO and container protocol calls to hdfs-client

2016-10-13 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573539#comment-15573539 ] Anu Engineer commented on HDFS-11004: - +1, I will commit this shortly. > Ozone : move Chunk IO and

[jira] [Created] (HDFS-11006) Ozone: support setting chunk size in streaming API

2016-10-13 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-11006: --- Summary: Ozone: support setting chunk size in streaming API Key: HDFS-11006 URL: https://issues.apache.org/jira/browse/HDFS-11006 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-11004) Ozone : move Chunk IO and container protocol calls to hdfs-client

2016-10-13 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11004: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Created] (HDFS-11007) AliyunOSSInputStream#read() should update read bytes stat correctly

2016-10-13 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-11007: Summary: AliyunOSSInputStream#read() should update read bytes stat correctly Key: HDFS-11007 URL: https://issues.apache.org/jira/browse/HDFS-11007 Project: Hadoop

[jira] [Commented] (HDFS-10629) Federation Router

2016-10-13 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573632#comment-15573632 ] Inigo Goiri commented on HDFS-10629: [~jakace], in {{RouterRpcClient#invokeSingle(final ExtendedBlock

[jira] [Commented] (HDFS-10906) Add unit tests for Trash with HDFS encryption zones

2016-10-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573648#comment-15573648 ] Hadoop QA commented on HDFS-10906: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-11004) Ozone : move Chunk IO and container protocol calls to hdfs-client

2016-10-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573666#comment-15573666 ] Hadoop QA commented on HDFS-11004: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11007) AliyunOSSInputStream#read() should update read bytes stat correctly

2016-10-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11007: - Attachment: HDFS-11007.000.patch I reviewed (sorry for coming late) other places that update the

[jira] [Updated] (HDFS-11007) AliyunOSSInputStream#read() should update read bytes stat correctly

2016-10-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11007: - Status: Patch Available (was: Open) > AliyunOSSInputStream#read() should update read bytes stat

[jira] [Updated] (HDFS-10883) `getTrashRoot`'s behavior is not consistent in DFS after enabling EZ.

2016-10-13 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-10883: -- Attachment: HDFS-10883.004.patch > `getTrashRoot`'s behavior is not consistent in DFS after enabling

[jira] [Commented] (HDFS-10883) `getTrashRoot`'s behavior is not consistent in DFS after enabling EZ.

2016-10-13 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15574158#comment-15574158 ] Yuanbo Liu commented on HDFS-10883: --- [~andrew.wang] Thanks for your review, upload v4 patch to address

[jira] [Updated] (HDFS-10986) DFSAdmin should log detailed error message if any

2016-10-13 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-10986: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Updated] (HDFS-10986) DFSAdmin should log detailed error message if any

2016-10-13 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-10986: Attachment: HDFS-10986.004.patch Attaching the committed patch to trunk and

[jira] [Updated] (HDFS-10885) [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on

2016-10-13 Thread Wei Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Zhou updated HDFS-10885: Attachment: HDFS-10800-HDFS-10885-00.patch Add a configure option "dfs.namenode.sps.enabled" to control

[jira] [Created] (HDFS-11011) Add unit test for HDFS command 'dfsadmin -set/clearSpaceQuota'

2016-10-13 Thread Xiaobing Zhou (JIRA)
Xiaobing Zhou created HDFS-11011: Summary: Add unit test for HDFS command 'dfsadmin -set/clearSpaceQuota' Key: HDFS-11011 URL: https://issues.apache.org/jira/browse/HDFS-11011 Project: Hadoop HDFS

[jira] [Updated] (HDFS-11011) Add unit test for HDFS command 'dfsadmin -set/clearSpaceQuota'

2016-10-13 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11011: - Description: This proposes adding a bunch of unit tests for command 'dfsadmin setSpaceQuota' and

[jira] [Commented] (HDFS-11011) Add unit test for HDFS command 'dfsadmin -set/clearSpaceQuota'

2016-10-13 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15574256#comment-15574256 ] Xiaobing Zhou commented on HDFS-11011: -- v000 patch is posted, please kindly review it, thanks. > Add

[jira] [Updated] (HDFS-11011) Add unit test for HDFS command 'dfsadmin -set/clearSpaceQuota'

2016-10-13 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11011: - Attachment: HDFS-11011.000.patch > Add unit test for HDFS command 'dfsadmin -set/clearSpaceQuota'

[jira] [Updated] (HDFS-11011) Add unit test for HDFS command 'dfsadmin -set/clearSpaceQuota'

2016-10-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11011: - Status: Patch Available (was: Open) > Add unit test for HDFS command 'dfsadmin

[jira] [Commented] (HDFS-11008) Add unit test for parsing "-source" parameter in Balancer tool

2016-10-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15574262#comment-15574262 ] Mingliang Liu commented on HDFS-11008: -- Testing failures are not related. > Add unit test for

[jira] [Resolved] (HDFS-8331) Erasure Coding: Create FileStatus isErasureCoded() method

2016-10-13 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R resolved HDFS-8331. Resolution: Duplicate > Erasure Coding: Create FileStatus isErasureCoded() method >

[jira] [Commented] (HDFS-8331) Erasure Coding: Create FileStatus isErasureCoded() method

2016-10-13 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15574049#comment-15574049 ] Rakesh R commented on HDFS-8331: Thanks [~jojochuang] for taking the {{#isErasureCoded()}} implementation

[jira] [Commented] (HDFS-11010) Update to Protobuf 3 in trunk

2016-10-13 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15574069#comment-15574069 ] Anu Engineer commented on HDFS-11010: - It is *supposed* to be wire compatible with the current

[jira] [Commented] (HDFS-10990) TestPendingInvalidateBlock should wait for IBRs

2016-10-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15574082#comment-15574082 ] Hadoop QA commented on HDFS-10990: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

  1   2   >