[jira] [Updated] (HDFS-12725) BlockPlacementPolicyRackFaultTolerant still fails with racks with very few nodes

2017-10-31 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12725: - Attachment: HDFS-12725.04.patch Patch 4 to fix the checkstyles that's relevant. Method with 7+ parameters

[jira] [Updated] (HDFS-12482) Provide a configuration to adjust the weight of EC recovery tasks to adjust the speed of recovery

2017-10-31 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12482: - Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available)

[jira] [Updated] (HDFS-12682) ECAdmin -listPolicies will always show SystemErasureCodingPolicies state as DISABLED

2017-10-31 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12682: - Attachment: HDFS-12682.07.patch Patch 7 to fix checkstyle. Test failures look unrelated. > ECAdmin

[jira] [Commented] (HDFS-12682) ECAdmin -listPolicies will always show SystemErasureCodingPolicies state as DISABLED

2017-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16233559#comment-16233559 ] Hadoop QA commented on HDFS-12682: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12714) Hadoop 3 missing fix for HDFS-5169

2017-10-31 Thread Joe McDonnell (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16233549#comment-16233549 ] Joe McDonnell commented on HDFS-12714: -- [~jzhuge] The test case that spurred the creation of this

[jira] [Commented] (HDFS-12714) Hadoop 3 missing fix for HDFS-5169

2017-10-31 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227809#comment-16227809 ] John Zhuge commented on HDFS-12714: --- +1 LGTM I will commit once the testing done is clarified. >

[jira] [Commented] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

2017-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227805#comment-16227805 ] Hadoop QA commented on HDFS-12681: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12682) ECAdmin -listPolicies will always show SystemErasureCodingPolicies state as DISABLED

2017-10-31 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227786#comment-16227786 ] Xiao Chen commented on HDFS-12682: -- Thanks Eddy! If there is no objections I'd like to commit this in 24

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-31 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Status: Open (was: Patch Available) > [READ] Merge BlockFormatProvider and

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-31 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Attachment: HDFS-11902-HDFS-9806.012.patch > [READ] Merge BlockFormatProvider and

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-31 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Status: Patch Available (was: Open) > [READ] Merge BlockFormatProvider and

[jira] [Issue Comment Deleted] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-31 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Comment: was deleted (was: The failed test cases are unrelated to the patch, so are the

[jira] [Commented] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-31 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227772#comment-16227772 ] Virajith Jalaparti commented on HDFS-11902: --- The failed test cases are unrelated to the patch,

[jira] [Commented] (HDFS-12549) Ozone: OzoneClient: Support for REST protocol

2017-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227727#comment-16227727 ] Hadoop QA commented on HDFS-12549: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12474) Ozone: SCM: Handling container report with key count and container usage.

2017-10-31 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227716#comment-16227716 ] Nanda kumar commented on HDFS-12474: Follow up jiras * HDFS-12751 - Ozone: SCM: update container

[jira] [Created] (HDFS-12752) Ozone: SCM: Make container report processing asynchronous

2017-10-31 Thread Nanda kumar (JIRA)
Nanda kumar created HDFS-12752: -- Summary: Ozone: SCM: Make container report processing asynchronous Key: HDFS-12752 URL: https://issues.apache.org/jira/browse/HDFS-12752 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9240) Use Builder pattern for BlockLocation constructors

2017-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227707#comment-16227707 ] Hadoop QA commented on HDFS-9240: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-12751) Ozone: SCM: update container allocated size to container db for all the open containers in ContainerStateManager#close

2017-10-31 Thread Nanda kumar (JIRA)
Nanda kumar created HDFS-12751: -- Summary: Ozone: SCM: update container allocated size to container db for all the open containers in ContainerStateManager#close Key: HDFS-12751 URL:

[jira] [Commented] (HDFS-12474) Ozone: SCM: Handling container report with key count and container usage.

2017-10-31 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227704#comment-16227704 ] Nanda kumar commented on HDFS-12474: Thanks [~linyiqun] & [~xyao] for the review. Uploaded patch v001

[jira] [Updated] (HDFS-12474) Ozone: SCM: Handling container report with key count and container usage.

2017-10-31 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDFS-12474: --- Attachment: HDFS-12474-HDFS-7240.001.patch > Ozone: SCM: Handling container report with key count and

[jira] [Commented] (HDFS-12667) KMSClientProvider#ValueQueue does synchronous fetch of edeks in background async thread.

2017-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227682#comment-16227682 ] Hadoop QA commented on HDFS-12667: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-12737) Thousands of sockets lingering in TIME_WAIT state due to frequent file open operations

2017-10-31 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227678#comment-16227678 ] Jitendra Nath Pandey commented on HDFS-12737: - BlockTokenSelector uses only Token-Kind to

[jira] [Updated] (HDFS-12750) Ozone: Fix TestStorageContainerManager#testBlockDeletionTransactions

2017-10-31 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-12750: -- Status: Patch Available (was: Open) > Ozone: Fix

[jira] [Updated] (HDFS-12697) Ozone services must stay disabled in secure setup for alpha

2017-10-31 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-12697: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Commented] (HDFS-11807) libhdfs++: Get minidfscluster tests running under valgrind

2017-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227650#comment-16227650 ] Hadoop QA commented on HDFS-11807: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12750) Ozone: Fix TestStorageContainerManager#testBlockDeletionTransactions

2017-10-31 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-12750: -- Attachment: HDFS-12750-HDFS-7240.001.patch > Ozone: Fix

[jira] [Updated] (HDFS-12750) Ozone: Fix TestStorageContainerManager#testBlockDeletionTransactions

2017-10-31 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-12750: -- Summary: Ozone: Fix TestStorageContainerManager#testBlockDeletionTransactions (was: Ozone: Stabilize

[jira] [Commented] (HDFS-12697) Ozone services must stay disabled in secure setup for alpha

2017-10-31 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227635#comment-16227635 ] Xiaoyu Yao commented on HDFS-12697: --- +1, I will commit it shortly. > Ozone services must stay disabled

[jira] [Commented] (HDFS-12682) ECAdmin -listPolicies will always show SystemErasureCodingPolicies state as DISABLED

2017-10-31 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227627#comment-16227627 ] Lei (Eddy) Xu commented on HDFS-12682: -- +1. Thanks Xiao. > ECAdmin -listPolicies will always show

[jira] [Commented] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227604#comment-16227604 ] Hadoop QA commented on HDFS-11902: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12705) WebHdfsFileSystem exceptions should retain the caused by exception

2017-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227600#comment-16227600 ] Hadoop QA commented on HDFS-12705: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12699) TestMountTable fails with Java 7

2017-10-31 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227572#comment-16227572 ] Íñigo Goiri commented on HDFS-12699: [~andrew.wang] added 2.9.0 and 3.0.0. Not sure if there is some

[jira] [Updated] (HDFS-12699) TestMountTable fails with Java 7

2017-10-31 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12699: --- Fix Version/s: 3.0.0 2.9.0 > TestMountTable fails with Java 7 >

[jira] [Updated] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

2017-10-31 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12681: - Target Version/s: 3.1.0 (was: 3.0.0) > Fold HdfsLocatedFileStatus into HdfsFileStatus >

[jira] [Commented] (HDFS-7878) API - expose a unique file identifier

2017-10-31 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227560#comment-16227560 ] Chris Douglas commented on HDFS-7878: - Reverted from 3.0.0, will target 3.1.0. > API - expose a unique

[jira] [Updated] (HDFS-7878) API - expose a unique file identifier

2017-10-31 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-7878: Fix Version/s: (was: 3.0.0) 3.1.0 > API - expose a unique file identifier >

[jira] [Commented] (HDFS-12697) Ozone services must stay disabled in secure setup for alpha

2017-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227543#comment-16227543 ] Hadoop QA commented on HDFS-12697: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

2017-10-31 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227540#comment-16227540 ] Chris Douglas commented on HDFS-12681: -- bq. In the interest of keeping the branch releasable, could

[jira] [Commented] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227517#comment-16227517 ] Andrew Wang commented on HDFS-12681: Thanks for bringing this up Chris. In the interest of keeping the

[jira] [Updated] (HDFS-12667) KMSClientProvider#ValueQueue does synchronous fetch of edeks in background async thread.

2017-10-31 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-12667: -- Status: Patch Available (was: Open) > KMSClientProvider#ValueQueue does synchronous fetch of

[jira] [Updated] (HDFS-12667) KMSClientProvider#ValueQueue does synchronous fetch of edeks in background async thread.

2017-10-31 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-12667: -- Attachment: HDFS-12667-002.patch bq. IMO we should throw as an IOE to tell the caller "failed

[jira] [Commented] (HDFS-12498) Journal Syncer is not started in Federated + HA cluster

2017-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227493#comment-16227493 ] Hadoop QA commented on HDFS-12498: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

2017-10-31 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227471#comment-16227471 ] Chris Douglas edited comment on HDFS-12681 at 10/31/17 8:32 PM: Rebase on

[jira] [Updated] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

2017-10-31 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12681: - Attachment: HDFS-12681.10.patch Rebase patch > Fold HdfsLocatedFileStatus into HdfsFileStatus >

[jira] [Updated] (HDFS-12682) ECAdmin -listPolicies will always show SystemErasureCodingPolicies state as DISABLED

2017-10-31 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12682: - Attachment: HDFS-12682.06.patch Patch 6 to address Sammi's comment about toStringWithState, good catch!

[jira] [Updated] (HDFS-12667) KMSClientProvider#ValueQueue does synchronous fetch of edeks in background async thread.

2017-10-31 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-12667: -- Status: Open (was: Patch Available) > KMSClientProvider#ValueQueue does synchronous fetch of

[jira] [Comment Edited] (HDFS-12219) Javadoc for FSNamesystem#getMaxObjects is incorrect

2017-10-31 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227459#comment-16227459 ] Erik Krogen edited comment on HDFS-12219 at 10/31/17 8:25 PM: -- Hey

[jira] [Commented] (HDFS-12219) Javadoc for FSNamesystem#getMaxObjects is incorrect

2017-10-31 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227459#comment-16227459 ] Erik Krogen commented on HDFS-12219: Hey [~ajisakaa], I am not a committer, care to put this into

[jira] [Updated] (HDFS-12219) Javadoc for FSNamesystem#getMaxObjects is incorrect

2017-10-31 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-12219: --- Target Version/s: 3.1.0 > Javadoc for FSNamesystem#getMaxObjects is incorrect >

[jira] [Commented] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

2017-10-31 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227458#comment-16227458 ] Chris Douglas commented on HDFS-12681: -- [~andrew.wang] Since the RC for 3.0.0 is planned for this

[jira] [Commented] (HDFS-12747) Lease monitor may infinitely loop on the same lease

2017-10-31 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227445#comment-16227445 ] Daryn Sharp commented on HDFS-12747: It involves decomming. HDFS-11499 attempted a partial fix the

[jira] [Assigned] (HDFS-12747) Lease monitor may infinitely loop on the same lease

2017-10-31 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp reassigned HDFS-12747: -- Assignee: Daryn Sharp > Lease monitor may infinitely loop on the same lease >

[jira] [Commented] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

2017-10-31 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227443#comment-16227443 ] Wei Yan commented on HDFS-11384: Gotcha, thanks for the explaination, [~shv] > Add option for balancer to

[jira] [Commented] (HDFS-12396) Webhdfs file system should get delegation token from kms provider.

2017-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227442#comment-16227442 ] Hadoop QA commented on HDFS-12396: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12486) GetConf to get journalnodeslist

2017-10-31 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12486: - Release Note: Adds a getconf command option to list the journal nodes. Usage: hdfs getconf

[jira] [Commented] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227427#comment-16227427 ] Andrew Wang commented on HDFS-11096: Sean, given that we've run HDFS rolling upgrades successfully, do

[jira] [Updated] (HDFS-12607) [READ] Even one dead datanode with PROVIDED storage results in ProvidedStorageInfo being marked as FAILED

2017-10-31 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12607: -- Status: Patch Available (was: Open) > [READ] Even one dead datanode with PROVIDED

[jira] [Updated] (HDFS-12607) [READ] Even one dead datanode with PROVIDED storage results in ProvidedStorageInfo being marked as FAILED

2017-10-31 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12607: -- Status: Open (was: Patch Available) > [READ] Even one dead datanode with PROVIDED

[jira] [Commented] (HDFS-12699) TestMountTable fails with Java 7

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227422#comment-16227422 ] Andrew Wang commented on HDFS-12699: Inigo, do you mind setting appropriate fix versions for this

[jira] [Commented] (HDFS-12485) expunge may fail to remove trash from encryption zone

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227404#comment-16227404 ] Andrew Wang commented on HDFS-12485: I think the branch-3.0 backport was missed, I backported it. >

[jira] [Commented] (HDFS-12749) DN may not send block report to NN after NN restart

2017-10-31 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227402#comment-16227402 ] Kihwal Lee commented on HDFS-12749: --- The rpc calls are timing out because the NN is not able to serve

[jira] [Updated] (HDFS-12495) TestPendingInvalidateBlock#testPendingDeleteUnknownBlocks fails intermittently

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12495: --- Fix Version/s: (was: 3.0.0) > TestPendingInvalidateBlock#testPendingDeleteUnknownBlocks fails

[jira] [Updated] (HDFS-12523) Thread pools in ErasureCodingWorker do not shutdown

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12523: --- Fix Version/s: (was: 3.0.0) > Thread pools in ErasureCodingWorker do not shutdown >

[jira] [Updated] (HDFS-12750) Ozone: Stabilize Ozone unit tests

2017-10-31 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-12750: -- Description: Some of the newly added ozone tests need to shutdown the MiniOzoneCluster so that the

[jira] [Commented] (HDFS-12544) SnapshotDiff - support diff generation on any snapshot root descendant directory

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227399#comment-16227399 ] Andrew Wang commented on HDFS-12544: I think the branch-3.0 backport was missed, I backported it. >

[jira] [Updated] (HDFS-12750) Ozone: Stabilize Ozone unit tests

2017-10-31 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-12750: -- Summary: Ozone: Stabilize Ozone unit tests (was: Ozone: Fix

[jira] [Commented] (HDFS-12573) Divide the total block metrics into replica and ec

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227397#comment-16227397 ] Andrew Wang commented on HDFS-12573: I think the branch-3.0 backport was missed, I backported it. >

[jira] [Commented] (HDFS-12614) FSPermissionChecker#getINodeAttrs() throws NPE when INodeAttributesProvider configured

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227395#comment-16227395 ] Andrew Wang commented on HDFS-12614: I think the branch-3.0 backport was missed, I backported it. >

[jira] [Commented] (HDFS-12619) Do not catch and throw unchecked exceptions if IBRs fail to process

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227394#comment-16227394 ] Andrew Wang commented on HDFS-12619: I think the branch-3.0 commit was missed, I backported it. > Do

[jira] [Commented] (HDFS-12622) Fix enumerate in HDFSErasureCoding.md

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227392#comment-16227392 ] Andrew Wang commented on HDFS-12622: I think the branch-3.0 commit was missed, I backported it. > Fix

[jira] [Updated] (HDFS-12549) Ozone: OzoneClient: Support for REST protocol

2017-10-31 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDFS-12549: --- Attachment: HDFS-12549-HDFS-7240.003.patch Patch upload after rebase. > Ozone: OzoneClient: Support

[jira] [Created] (HDFS-12750) Ozone: Fix TestStorageContainerManager#testBlockDeletionTransactions

2017-10-31 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-12750: - Summary: Ozone: Fix TestStorageContainerManager#testBlockDeletionTransactions Key: HDFS-12750 URL: https://issues.apache.org/jira/browse/HDFS-12750 Project: Hadoop HDFS

[jira] [Updated] (HDFS-12705) WebHdfsFileSystem exceptions should retain the caused by exception

2017-10-31 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-12705: -- Status: Patch Available (was: Open) > WebHdfsFileSystem exceptions should retain the caused by

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-31 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Attachment: HDFS-11902-HDFS-9806.011.patch Patch v011 fixes a missing java doc. Will

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-31 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Status: Patch Available (was: Open) > [READ] Merge BlockFormatProvider and

[jira] [Comment Edited] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-31 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227303#comment-16227303 ] Virajith Jalaparti edited comment on HDFS-11902 at 10/31/17 6:42 PM: -

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-31 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Status: Open (was: Patch Available) > [READ] Merge BlockFormatProvider and

[jira] [Commented] (HDFS-12697) Ozone services must stay disabled in secure setup for alpha

2017-10-31 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227269#comment-16227269 ] Bharat Viswanadham commented on HDFS-12697: --- [~xyao] Thank You for review. Attached patch v04 to

[jira] [Updated] (HDFS-12697) Ozone services must stay disabled in secure setup for alpha

2017-10-31 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12697: -- Attachment: HDFS-12697-HDFS-7240.04.patch > Ozone services must stay disabled in secure

[jira] [Commented] (HDFS-12682) ECAdmin -listPolicies will always show SystemErasureCodingPolicies state as DISABLED

2017-10-31 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227240#comment-16227240 ] Xiao Chen commented on HDFS-12682: -- Thanks for the review Sammi. I also thought about whether we need to

[jira] [Commented] (HDFS-12499) dfs.namenode.shared.edits.dir property is currently namenode specific key

2017-10-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227236#comment-16227236 ] Hudson commented on HDFS-12499: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13170 (See

[jira] [Commented] (HDFS-12499) dfs.namenode.shared.edits.dir property is currently namenode specific key

2017-10-31 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227215#comment-16227215 ] Arpit Agarwal commented on HDFS-12499: -- Also, thanks for the quick response! >

[jira] [Commented] (HDFS-12499) dfs.namenode.shared.edits.dir property is currently namenode specific key

2017-10-31 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227206#comment-16227206 ] Arpit Agarwal commented on HDFS-12499: -- Sounds fine, I am okay with holding off forking branch-3 for

[jira] [Commented] (HDFS-11467) Support ErasureCoding section in OIV XML/ReverseXML

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227202#comment-16227202 ] Andrew Wang commented on HDFS-11467: Hey folks, are we planning to close on this in the next few days?

[jira] [Commented] (HDFS-12499) dfs.namenode.shared.edits.dir property is currently namenode specific key

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227197#comment-16227197 ] Andrew Wang commented on HDFS-12499: I've reverted this from trunk and branch-3.0. Apologies for the

[jira] [Updated] (HDFS-12499) dfs.namenode.shared.edits.dir property is currently namenode specific key

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12499: --- Fix Version/s: (was: 3.0.0) > dfs.namenode.shared.edits.dir property is currently namenode

[jira] [Reopened] (HDFS-12499) dfs.namenode.shared.edits.dir property is currently namenode specific key

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reopened HDFS-12499: > dfs.namenode.shared.edits.dir property is currently namenode specific key >

[jira] [Commented] (HDFS-12499) dfs.namenode.shared.edits.dir property is currently namenode specific key

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227185#comment-16227185 ] Andrew Wang commented on HDFS-12499: Sorry, I was off yesterday. I just checked, and Cloudera Manager

[jira] [Commented] (HDFS-12699) TestMountTable fails with Java 7

2017-10-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227182#comment-16227182 ] Hudson commented on HDFS-12699: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13169 (See

[jira] [Updated] (HDFS-9240) Use Builder pattern for BlockLocation constructors

2017-10-31 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-9240: - Status: Patch Available (was: Open) > Use Builder pattern for BlockLocation constructors

[jira] [Updated] (HDFS-9240) Use Builder pattern for BlockLocation constructors

2017-10-31 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-9240: - Status: Open (was: Patch Available) > Use Builder pattern for BlockLocation constructors

[jira] [Updated] (HDFS-12699) TestMountTable fails with Java 7

2017-10-31 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12699: --- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) >

[jira] [Commented] (HDFS-12219) Javadoc for FSNamesystem#getMaxObjects is incorrect

2017-10-31 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227147#comment-16227147 ] Akira Ajisaka commented on HDFS-12219: -- LGTM, +1 > Javadoc for FSNamesystem#getMaxObjects is

[jira] [Updated] (HDFS-12499) dfs.namenode.shared.edits.dir property is currently namenode specific key

2017-10-31 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12499: - Resolution: Fixed Hadoop Flags: Incompatible change,Reviewed (was: Incompatible

[jira] [Commented] (HDFS-7878) API - expose a unique file identifier

2017-10-31 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227160#comment-16227160 ] Sergey Shelukhin commented on HDFS-7878: Thank you for all the work getting this in! I thought it

[jira] [Commented] (HDFS-12699) TestMountTable fails with Java 7

2017-10-31 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227152#comment-16227152 ] Íñigo Goiri commented on HDFS-12699: Thanks [~ajisakaa]. Committed into branch-2, branch-3.0 and

[jira] [Commented] (HDFS-7878) API - expose a unique file identifier

2017-10-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227128#comment-16227128 ] Hudson commented on HDFS-7878: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13168 (See

[jira] [Comment Edited] (HDFS-7878) API - expose a unique file identifier

2017-10-31 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227113#comment-16227113 ] Chris Douglas edited comment on HDFS-7878 at 10/31/17 5:02 PM: --- I committed

[jira] [Updated] (HDFS-7878) API - expose a unique file identifier

2017-10-31 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-7878: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 Status: Resolved

[jira] [Assigned] (HDFS-7878) API - expose a unique file identifier

2017-10-31 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas reassigned HDFS-7878: --- Assignee: Chris Douglas (was: Sergey Shelukhin) > API - expose a unique file identifier >

  1   2   >