[jira] [Updated] (HDFS-11665) HttpFSServerWebServer$deprecateEnv may leak secret

2017-04-17 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-11665: -- Status: Patch Available (was: Open) > HttpFSServerWebServer$deprecateEnv may leak secret >

[jira] [Updated] (HDFS-11665) HttpFSServerWebServer$deprecateEnv may leak secret

2017-04-17 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-11665: -- Attachment: HDFS-11665.001.patch Patch 001 * Do not print env var value and property value Testing

[jira] [Commented] (HDFS-11504) Ozone: SCM: Add AllocateBlock/DeleteBlock/GetBlock APIs

2017-04-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15972152#comment-15972152 ] Hadoop QA commented on HDFS-11504: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-11665) HttpFSServerWebServer$deprecateEnv may leak secret

2017-04-17 Thread John Zhuge (JIRA)
John Zhuge created HDFS-11665: - Summary: HttpFSServerWebServer$deprecateEnv may leak secret Key: HDFS-11665 URL: https://issues.apache.org/jira/browse/HDFS-11665 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-11664) Invalidati blocks cannot invoke because of replication work slowly while cluster is almost full

2017-04-17 Thread DENG FEI (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DENG FEI updated HDFS-11664: Description: Currently invalideBlock is executed after replication, when 'dfs remaining' is not much left

[jira] [Updated] (HDFS-11504) Ozone: SCM: Add AllocateBlock/DeleteBlock/GetBlock APIs

2017-04-17 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11504: -- Attachment: HDFS-11504-HDFS-7240.004.patch Fix the checkstyle and findbugs issue. > Ozone: SCM: Add

[jira] [Commented] (HDFS-11649) Ozone: SCM: CLI: Add shell code placeholder classes

2017-04-17 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15972059#comment-15972059 ] Mukul Kumar Singh commented on HDFS-11649: -- [~vagarychen], the patch looks good. Some minor

[jira] [Updated] (HDFS-11664) Invalidati blocks cannot invoke because of replication work slowly while cluster is almost full

2017-04-17 Thread DENG FEI (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DENG FEI updated HDFS-11664: Summary: Invalidati blocks cannot invoke because of replication work slowly while cluster is almost full

[jira] [Created] (HDFS-11664) Invalidati blocks cannot invoke because of replication work slowly while cluster storage is almost full

2017-04-17 Thread DENG FEI (JIRA)
DENG FEI created HDFS-11664: --- Summary: Invalidati blocks cannot invoke because of replication work slowly while cluster storage is almost full Key: HDFS-11664 URL: https://issues.apache.org/jira/browse/HDFS-11664

[jira] [Commented] (HDFS-11634) Optimize BlockIterator when interating starts in the middle.

2017-04-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15972027#comment-15972027 ] Hadoop QA commented on HDFS-11634: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11504) Ozone: SCM: Add AllocateBlock/DeleteBlock/GetBlock APIs

2017-04-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15972010#comment-15972010 ] Hadoop QA commented on HDFS-11504: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11658) Ozone: SCM daemon is unable to be started via CLI

2017-04-17 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15972008#comment-15972008 ] Weiwei Yang commented on HDFS-11658: Thanks [~anu]! > Ozone: SCM daemon is unable to be started via

[jira] [Updated] (HDFS-11658) Ozone: SCM daemon is unable to be started via CLI

2017-04-17 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11658: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Commented] (HDFS-11658) Ozone: SCM daemon is unable to be started via CLI

2017-04-17 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15972001#comment-15972001 ] Anu Engineer commented on HDFS-11658: - I will commit this shortly. > Ozone: SCM daemon is unable to

[jira] [Commented] (HDFS-11658) Ozone: SCM daemon is unable to be started via CLI

2017-04-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971999#comment-15971999 ] Hadoop QA commented on HDFS-11658: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11649) Ozone: SCM: CLI: Add shell code placeholder classes

2017-04-17 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971993#comment-15971993 ] Weiwei Yang commented on HDFS-11649: Thanks [~vagarychen] for the updates, +1 for the v6 patch. It

[jira] [Commented] (HDFS-11334) [SPS]: NN switch and rescheduling movements can lead to have more than one coordinator for same file blocks

2017-04-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971956#comment-15971956 ] Hadoop QA commented on HDFS-11334: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11658) Ozone: SCM daemon is unable to be started via CLI

2017-04-17 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971955#comment-15971955 ] Anu Engineer commented on HDFS-11658: - +1, pending jenkins. Thanks for fixing this. > Ozone: SCM

[jira] [Updated] (HDFS-11581) Ozone: Support force delete a container

2017-04-17 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11581: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Updated] (HDFS-11658) Ozone: SCM daemon is unable to be started via CLI

2017-04-17 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11658: --- Status: Patch Available (was: Open) > Ozone: SCM daemon is unable to be started via CLI >

[jira] [Commented] (HDFS-11658) Ozone: SCM daemon is unable to be started via CLI

2017-04-17 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971950#comment-15971950 ] Weiwei Yang commented on HDFS-11658: Attached a simple patch to get this fixed. Tested on a pseudo

[jira] [Updated] (HDFS-11658) Ozone: SCM daemon is unable to be started via CLI

2017-04-17 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11658: --- Attachment: HDFS-11658-HDFS-7240.001.patch > Ozone: SCM daemon is unable to be started via CLI >

[jira] [Commented] (HDFS-11659) TestDataNodeHotSwapVolumes.testRemoveVolumeBeingWritten fail due to no DataNode available for pipeline recovery.

2017-04-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971919#comment-15971919 ] Hadoop QA commented on HDFS-11659: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11634) Optimize BlockIterator when interating starts in the middle.

2017-04-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971909#comment-15971909 ] Hudson commented on HDFS-11634: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11597 (See

[jira] [Updated] (HDFS-11504) Ozone: SCM: Add AllocateBlock/DeleteBlock/GetBlock APIs

2017-04-17 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11504: -- Attachment: HDFS-11504-HDFS-7240.003.patch > Ozone: SCM: Add AllocateBlock/DeleteBlock/GetBlock APIs >

[jira] [Comment Edited] (HDFS-11504) Ozone: SCM: Add AllocateBlock/DeleteBlock/GetBlock APIs

2017-04-17 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971870#comment-15971870 ] Xiaoyu Yao edited comment on HDFS-11504 at 4/18/17 12:11 AM: - Thanks [~anu]

[jira] [Commented] (HDFS-11504) Ozone: SCM: Add AllocateBlock/DeleteBlock/GetBlock APIs

2017-04-17 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971870#comment-15971870 ] Xiaoyu Yao commented on HDFS-11504: --- bq. Something to think about , should we create a

[jira] [Commented] (HDFS-11652) Improve ECSchema and ErasureCodingPolicy toString, hashCode, equals

2017-04-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971869#comment-15971869 ] Hudson commented on HDFS-11652: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11596 (See

[jira] [Updated] (HDFS-11634) Optimize BlockIterator when interating starts in the middle.

2017-04-17 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-11634: --- Attachment: HDFS-11634-branch-2.7.006.patch HDFS-11634.006.patch

[jira] [Updated] (HDFS-11615) FSNamesystemLock metrics can be inaccurate due to millisecond precision

2017-04-17 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-11615: - Resolution: Fixed Fix Version/s: 2.8.1 3.0.0-alpha3 2.7.4

[jira] [Commented] (HDFS-11649) Ozone: SCM: CLI: Add shell code placeholder classes

2017-04-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971844#comment-15971844 ] Hadoop QA commented on HDFS-11649: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11615) FSNamesystemLock metrics can be inaccurate due to millisecond precision

2017-04-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971828#comment-15971828 ] Hudson commented on HDFS-11615: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11595 (See

[jira] [Updated] (HDFS-11652) Improve ECSchema and ErasureCodingPolicy toString, hashCode, equals

2017-04-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11652: --- Resolution: Fixed Fix Version/s: 3.0.0-alpha3 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-11615) FSNamesystemLock metrics can be inaccurate due to millisecond precision

2017-04-17 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-11615: - Hadoop Flags: Reviewed Thanks Erik. I finally got my trunk build fixed. I verified output from

[jira] [Commented] (HDFS-11572) [SPS]: SPS should clean Xattrs when no blocks required to satisfy for a file

2017-04-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971791#comment-15971791 ] Hadoop QA commented on HDFS-11572: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11631) Block Storage : allow cblock server to be started from hdfs commandline

2017-04-17 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11631: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Commented] (HDFS-11631) Block Storage : allow cblock server to be started from hdfs commandline

2017-04-17 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971768#comment-15971768 ] Anu Engineer commented on HDFS-11631: - [~vagarychen] makes sense. +1 I will commit this shortly. >

[jira] [Commented] (HDFS-11530) Use HDFS specific network topology to choose datanode in BlockPlacementPolicyDefault

2017-04-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971764#comment-15971764 ] Arpit Agarwal commented on HDFS-11530: -- Thanks for updating the patch [~linyiqun]. A few more

[jira] [Commented] (HDFS-11660) TestFsDatasetCache#testPageRounder fails intermittently with AssertionError

2017-04-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971755#comment-15971755 ] Hadoop QA commented on HDFS-11660: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-11631) Block Storage : allow cblock server to be started from hdfs commandline

2017-04-17 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971750#comment-15971750 ] Chen Liang commented on HDFS-11631: --- Thanks [~anu] for reviewing the patch! But the change in this JIRA

[jira] [Updated] (HDFS-11649) Ozone: SCM: CLI: Add shell code placeholder classes

2017-04-17 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11649: -- Attachment: HDFS-11649-HDFS-7240.006.patch Post v006 patch to address the warnings, also fix a bug in

[jira] [Comment Edited] (HDFS-11663) [READ] Fix NullPointerException in ProvidedBlocksBuilder

2017-04-17 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971731#comment-15971731 ] Virajith Jalaparti edited comment on HDFS-11663 at 4/17/17 10:09 PM: -

[jira] [Comment Edited] (HDFS-11663) [READ] Fix NullPointerException in ProvidedBlocksBuilder

2017-04-17 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971731#comment-15971731 ] Virajith Jalaparti edited comment on HDFS-11663 at 4/17/17 10:09 PM: -

[jira] [Updated] (HDFS-11663) [READ] Fix NullPointerException in ProvidedBlocksBuilder

2017-04-17 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11663: -- Attachment: HDFS-11663-HDFS-9806.001.patch Attaching a patch to fix this issue. >

[jira] [Updated] (HDFS-11663) [READ] Fix NullPointerException in ProvidedBlocksBuilder

2017-04-17 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11663: -- Description: When there are no Datanodes with PROVIDED storage,

[jira] [Created] (HDFS-11663) [READ] Fix NullPointerException in ProvidedBlocksBuilder

2017-04-17 Thread Virajith Jalaparti (JIRA)
Virajith Jalaparti created HDFS-11663: - Summary: [READ] Fix NullPointerException in ProvidedBlocksBuilder Key: HDFS-11663 URL: https://issues.apache.org/jira/browse/HDFS-11663 Project: Hadoop HDFS

[jira] [Updated] (HDFS-11653) [READ] ProvidedReplica should return an InputStream that is bounded by its length

2017-04-17 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11653: -- Attachment: HDFS-11653-HDFS-9806.001.patch > [READ] ProvidedReplica should return an

[jira] [Updated] (HDFS-11653) [READ] ProvidedReplica should return an InputStream that is bounded by its length

2017-04-17 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11653: -- Status: Open (was: Patch Available) > [READ] ProvidedReplica should return an

[jira] [Updated] (HDFS-11653) [READ] ProvidedReplica should return an InputStream that is bounded by its length

2017-04-17 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11653: -- Attachment: (was: HDFS-11653-HDFS-9806.001.patch) > [READ] ProvidedReplica should

[jira] [Created] (HDFS-11662) TestJobEndNotifier.testNotificationTimeout fails intermittently

2017-04-17 Thread Eric Badger (JIRA)
Eric Badger created HDFS-11662: -- Summary: TestJobEndNotifier.testNotificationTimeout fails intermittently Key: HDFS-11662 URL: https://issues.apache.org/jira/browse/HDFS-11662 Project: Hadoop HDFS

[jira] [Commented] (HDFS-11067) DFS#listStatusIterator(..) should throw FileNotFoundException if the directory deleted before fetching next batch of entries

2017-04-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971688#comment-15971688 ] Hadoop QA commented on HDFS-11067: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11649) Ozone: SCM: CLI: Add shell code placeholder classes

2017-04-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971683#comment-15971683 ] Hadoop QA commented on HDFS-11649: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11581) Ozone: Support force delete a container

2017-04-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971677#comment-15971677 ] Hadoop QA commented on HDFS-11581: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11643) Balancer fencing fails when writing erasure coded lock file

2017-04-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11643: --- Priority: Blocker (was: Critical) Bumping to blocker for visibility. Looks like the patch needs a

[jira] [Updated] (HDFS-11659) TestDataNodeHotSwapVolumes.testRemoveVolumeBeingWritten fail due to no DataNode available for pipeline recovery.

2017-04-17 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-11659: - Target Version/s: 3.0.0-alpha2, 2.9.0 (was: 2.9.0, 3.0.0-alpha2) Status: Patch

[jira] [Updated] (HDFS-11659) TestDataNodeHotSwapVolumes.testRemoveVolumeBeingWritten fail due to no DataNode available for pipeline recovery.

2017-04-17 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-11659: - Attachment: HDFS-11659.000.patch Update the test to add a new datanode after the volume being

[jira] [Updated] (HDFS-11644) DFSStripedOutputStream should not implement Syncable

2017-04-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11644: --- Priority: Blocker (was: Major) Bumping this to a blocker for visibility. Important for API

[jira] [Created] (HDFS-11661) GetContentSummary uses excessive amounts of memory

2017-04-17 Thread Nathan Roberts (JIRA)
Nathan Roberts created HDFS-11661: - Summary: GetContentSummary uses excessive amounts of memory Key: HDFS-11661 URL: https://issues.apache.org/jira/browse/HDFS-11661 Project: Hadoop HDFS

[jira] [Commented] (HDFS-6962) ACL inheritance conflicts with umaskmode

2017-04-17 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971653#comment-15971653 ] John Zhuge commented on HDFS-6962: -- Thanks [~cnauroth] for the clarification. Sounds like a good plan

[jira] [Updated] (HDFS-11660) TestFsDataset#testPageRounder fails intermittently with AssertionError

2017-04-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11660: --- Attachment: HDFS-11660.001.patch Mockito mocking isn't threadsafe, so I think this happens when we

[jira] [Updated] (HDFS-11660) TestFsDatasetCache#testPageRounder fails intermittently with AssertionError

2017-04-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11660: --- Status: Patch Available (was: Open) > TestFsDatasetCache#testPageRounder fails intermittently with

[jira] [Updated] (HDFS-11660) TestFsDatasetCache#testPageRounder fails intermittently with AssertionError

2017-04-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11660: --- Summary: TestFsDatasetCache#testPageRounder fails intermittently with AssertionError (was:

[jira] [Created] (HDFS-11660) TestFsDataset#testPageRounder fails intermittently with AssertionError

2017-04-17 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-11660: -- Summary: TestFsDataset#testPageRounder fails intermittently with AssertionError Key: HDFS-11660 URL: https://issues.apache.org/jira/browse/HDFS-11660 Project: Hadoop

[jira] [Updated] (HDFS-11659) TestDataNodeHotSwapVolumes.testRemoveVolumeBeingWritten fail due to no DataNode available for pipeline recovery.

2017-04-17 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-11659: - Summary: TestDataNodeHotSwapVolumes.testRemoveVolumeBeingWritten fail due to no DataNode

[jira] [Created] (HDFS-11659) TestDataNodeHotSwapVolumes.testRemoveVolumeBeingWritten fail due to no

2017-04-17 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HDFS-11659: Summary: TestDataNodeHotSwapVolumes.testRemoveVolumeBeingWritten fail due to no Key: HDFS-11659 URL: https://issues.apache.org/jira/browse/HDFS-11659 Project:

[jira] [Commented] (HDFS-11631) Block Storage : allow cblock server to be started from hdfs commandline

2017-04-17 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971595#comment-15971595 ] Anu Engineer commented on HDFS-11631: - [~vagarychen] Looks pretty good, but could we please add a test

[jira] [Commented] (HDFS-6962) ACL inheritance conflicts with umaskmode

2017-04-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971587#comment-15971587 ] Arpit Agarwal commented on HDFS-6962: - Thank you for the quick clarification [~jzhuge] and [~cnauroth].

[jira] [Updated] (HDFS-11657) Ozone: Add unit test for storage container metrics

2017-04-17 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11657: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Updated] (HDFS-11631) Block Storage : allow cblock server to be started from hdfs commandline

2017-04-17 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11631: -- Summary: Block Storage : allow cblock server to be started from hdfs commandline (was: Block Storage :

[jira] [Updated] (HDFS-11649) Ozone: SCM: CLI: Add shell code placeholder classes

2017-04-17 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11649: -- Attachment: HDFS-11649-HDFS-7240.005.patch Thanks [~cheersyang] for the comment! Post v005 patch which:

[jira] [Commented] (HDFS-11652) Improve ECSchema and ErasureCodingPolicy toString, hashCode, equals

2017-04-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971572#comment-15971572 ] Hadoop QA commented on HDFS-11652: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-11657) Ozone: Add unit test for storage container metrics

2017-04-17 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971546#comment-15971546 ] Anu Engineer commented on HDFS-11657: - +1, I will commit this shortly. > Ozone: Add unit test for

[jira] [Commented] (HDFS-11581) Ozone: Support force delete a container

2017-04-17 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971544#comment-15971544 ] Anu Engineer commented on HDFS-11581: - I have submitted this patch to pre-commit again.

[jira] [Commented] (HDFS-11581) Ozone: Support force delete a container

2017-04-17 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971539#comment-15971539 ] Anu Engineer commented on HDFS-11581: - [~cheersyang] Thanks for the comment. HDFS-7240 is fixed now.

[jira] [Updated] (HDFS-11470) Ozone: SCM: CLI: Design SCM Command line interface

2017-04-17 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11470: Resolution: Fixed Status: Resolved (was: Patch Available) > Ozone: SCM: CLI: Design SCM

[jira] [Commented] (HDFS-11658) Ozone: SCM daemon is unable to be started via CLI

2017-04-17 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971524#comment-15971524 ] Anu Engineer commented on HDFS-11658: - Thanks for finding this. > Ozone: SCM daemon is unable to be

[jira] [Commented] (HDFS-11470) Ozone: SCM: CLI: Design SCM Command line interface

2017-04-17 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971525#comment-15971525 ] Anu Engineer commented on HDFS-11470: - Thank you all for comments. I am going to resolve this JIRA

[jira] [Updated] (HDFS-11652) Improve ECSchema and ErasureCodingPolicy toString, hashCode, equals

2017-04-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11652: --- Attachment: HDFS-11652.004.patch Thanks for reviewing Wei-Chiu and Rakesh! New patch attached. >

[jira] [Updated] (HDFS-11067) DFS#listStatusIterator(..) should throw FileNotFoundException if the directory deleted before fetching next batch of entries

2017-04-17 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-11067: - Attachment: HDFS-11067-04.patch Updated the patch with extra assertions as mentioned by

[jira] [Commented] (HDFS-6962) ACL inheritance conflicts with umaskmode

2017-04-17 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971465#comment-15971465 ] Chris Nauroth commented on HDFS-6962: - Yes, agreed with John. That might then lead to the question of

[jira] [Commented] (HDFS-6962) ACL inheritance conflicts with umaskmode

2017-04-17 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971449#comment-15971449 ] John Zhuge commented on HDFS-6962: -- [~arpitagarwal] Yes, you are right. > ACL inheritance conflicts with

[jira] [Commented] (HDFS-6962) ACL inheritance conflicts with umaskmode

2017-04-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971416#comment-15971416 ] Arpit Agarwal commented on HDFS-6962: - Hi [~jzhuge], could you help me understand the compatibility

[jira] [Commented] (HDFS-10996) Ability to specify per-file EC policy at create time

2017-04-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971231#comment-15971231 ] Hudson commented on HDFS-10996: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11591 (See

[jira] [Commented] (HDFS-11645) DataXceiver thread should log the actual error when getting InvalidMagicNumberException

2017-04-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971229#comment-15971229 ] Hudson commented on HDFS-11645: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11591 (See

[jira] [Commented] (HDFS-11558) BPServiceActor thread name is too long

2017-04-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971221#comment-15971221 ] Hudson commented on HDFS-11558: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11591 (See

[jira] [Commented] (HDFS-11648) Lazy construct the IIP pathname

2017-04-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971228#comment-15971228 ] Hudson commented on HDFS-11648: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11591 (See

[jira] [Commented] (HDFS-11163) Mover should move the file blocks to default storage once policy is unset

2017-04-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971223#comment-15971223 ] Hudson commented on HDFS-11163: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11591 (See

[jira] [Commented] (HDFS-11565) Use compact identifiers for built-in ECPolicies in HdfsFileStatus

2017-04-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971230#comment-15971230 ] Hudson commented on HDFS-11565: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11591 (See

[jira] [Commented] (HDFS-11630) TestThrottledAsyncCheckerTimeout fails intermittently in Jenkins builds

2017-04-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971222#comment-15971222 ] Hudson commented on HDFS-11630: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11591 (See

[jira] [Commented] (HDFS-11637) Fix javac warning caused by the deprecated key used in TestDFSClientRetries#testFailuresArePerOperation

2017-04-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971215#comment-15971215 ] Hudson commented on HDFS-11637: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11591 (See

[jira] [Commented] (HDFS-11131) TestThrottledAsyncChecker#testCancellation is flaky

2017-04-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971188#comment-15971188 ] Hudson commented on HDFS-11131: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11591 (See

[jira] [Commented] (HDFS-11302) Improve Logging for SSLHostnameVerifier

2017-04-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971187#comment-15971187 ] Hudson commented on HDFS-11302: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11591 (See

[jira] [Commented] (HDFS-11623) Move system erasure coding policies into hadoop-hdfs-client

2017-04-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971202#comment-15971202 ] Hudson commented on HDFS-11623: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11591 (See

[jira] [Commented] (HDFS-11633) FSImage failover disables all erasure coding policies

2017-04-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971201#comment-15971201 ] Hudson commented on HDFS-11633: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11591 (See

[jira] [Commented] (HDFS-11362) StorageDirectory should initialize a non-null default StorageDirType

2017-04-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971191#comment-15971191 ] Hudson commented on HDFS-11362: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11591 (See

[jira] [Commented] (HDFS-11608) HDFS write crashed with block size greater than 2 GB

2017-04-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971192#comment-15971192 ] Hudson commented on HDFS-11608: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11591 (See

[jira] [Commented] (HDFS-11628) Clarify the behavior of HDFS Mover in documentation

2017-04-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971183#comment-15971183 ] Hudson commented on HDFS-11628: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11591 (See

[jira] [Commented] (HDFS-11538) Move ClientProtocol HA proxies into hadoop-hdfs-client

2017-04-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971177#comment-15971177 ] Hudson commented on HDFS-11538: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11591 (See

[jira] [Commented] (HDFS-9651) All web UIs should include a robots.txt file

2017-04-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971175#comment-15971175 ] Hudson commented on HDFS-9651: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11591 (See

[jira] [Commented] (HDFS-11515) -du throws ConcurrentModificationException

2017-04-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971165#comment-15971165 ] Hudson commented on HDFS-11515: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11591 (See

  1   2   >