[jira] [Commented] (HDFS-12525) Ozone: OzoneClient: Verify bucket/volume name in create calls

2017-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181371#comment-16181371 ] Hadoop QA commented on HDFS-12525: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12425) Ozone: OzoneFileSystem: OzoneFileystem read/write/create/open/getFileInfo APIs

2017-09-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181399#comment-16181399 ] Xiaoyu Yao commented on HDFS-12425: --- Patch v6 looks good to me. +1. [~msingh], can you elaborate the

[jira] [Created] (HDFS-12552) Use slf4j instead of log4j in FSNamesystem

2017-09-26 Thread Ajay Kumar (JIRA)
Ajay Kumar created HDFS-12552: - Summary: Use slf4j instead of log4j in FSNamesystem Key: HDFS-12552 URL: https://issues.apache.org/jira/browse/HDFS-12552 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-11858) JN httpServerUri should be set to hostname when using Default Http Address

2017-09-26 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-11858: -- Status: Patch Available (was: Open) > JN httpServerUri should be set to hostname when using

[jira] [Updated] (HDFS-12469) Ozone: Create docker-compose definition to easily test real clusters

2017-09-26 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-12469: Attachment: HDFS-12469-HDFS-7240.001.patch Uploaded the right patch (and deleted the previous, as

[jira] [Updated] (HDFS-12551) Ozone: Documentation: Add Ozone overview documentation.

2017-09-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12551: Status: Patch Available (was: Open) > Ozone: Documentation: Add Ozone overview documentation. >

[jira] [Commented] (HDFS-12551) Ozone: Documentation: Add Ozone overview documentation.

2017-09-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181330#comment-16181330 ] Anu Engineer commented on HDFS-12551: - I have attached a PDF file that shows the rendering to make it

[jira] [Updated] (HDFS-12551) Ozone: Documentation: Add Ozone overview documentation.

2017-09-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12551: Labels: ozoneDoc (was: ) > Ozone: Documentation: Add Ozone overview documentation. >

[jira] [Comment Edited] (HDFS-12551) Ozone: Documentation: Add Ozone overview documentation.

2017-09-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181330#comment-16181330 ] Anu Engineer edited comment on HDFS-12551 at 9/26/17 7:12 PM: -- I have

[jira] [Updated] (HDFS-12017) Ozone: Container: Move IPC port to 98xx range

2017-09-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12017: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Target

[jira] [Commented] (HDFS-12551) Ozone: Documentation: Add Ozone overview documentation.

2017-09-26 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181400#comment-16181400 ] Shashikant Banerjee commented on HDFS-12551: It gives a really good overview of Ozone. +1 for

[jira] [Commented] (HDFS-12551) Ozone: Documentation: Add Ozone overview documentation.

2017-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181466#comment-16181466 ] Hadoop QA commented on HDFS-12551: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12498) Journal Syncer is not started in Federated + HA cluster

2017-09-26 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12498: -- Attachment: HDFS-12498.03.patch > Journal Syncer is not started in Federated + HA

[jira] [Updated] (HDFS-12498) Journal Syncer is not started in Federated + HA cluster

2017-09-26 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12498: -- Attachment: (was: HDFS-12498.03.patch) > Journal Syncer is not started in Federated

[jira] [Commented] (HDFS-12386) Add fsserver defaults call to WebhdfsFileSystem.

2017-09-26 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181252#comment-16181252 ] Daryn Sharp commented on HDFS-12386: +1. Will commit shortly. > Add fsserver defaults call to

[jira] [Updated] (HDFS-12545) Autotune NameNode RPC handler threads according to number of datanodes in cluster

2017-09-26 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12545: -- Description: Autotune NameNode RPC handler threads according to number of datanodes in cluster.

[jira] [Commented] (HDFS-12464) Ozone: More detailed documentation about the ozone components

2017-09-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181331#comment-16181331 ] Anu Engineer commented on HDFS-12464: - [~elek] Thanks for providing this patch. I really appreciate

[jira] [Updated] (HDFS-12469) Ozone: Create docker-compose definition to easily test real clusters

2017-09-26 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-12469: Attachment: (was: HDFS-12477-HDFS-7240.000.patch) > Ozone: Create docker-compose definition to

[jira] [Commented] (HDFS-12545) Autotune NameNode RPC handler threads according to number of datanodes in cluster

2017-09-26 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181305#comment-16181305 ] Ajay Kumar commented on HDFS-12545: --- [~msingh] I think we should address both of those properties

[jira] [Commented] (HDFS-12425) Ozone: OzoneFileSystem: OzoneFileystem read/write/create/open/getFileInfo APIs

2017-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181375#comment-16181375 ] Hadoop QA commented on HDFS-12425: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10391) Always enable NameNode service RPC port

2017-09-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181408#comment-16181408 ] Arpit Agarwal commented on HDFS-10391: -- bq. So let me ask: What scenario leads you to believe a

[jira] [Updated] (HDFS-12498) Journal Syncer is not started in Federated + HA cluster

2017-09-26 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12498: -- Status: In Progress (was: Patch Available) > Journal Syncer is not started in

[jira] [Comment Edited] (HDFS-12545) Autotune NameNode RPC handler threads according to number of datanodes in cluster

2017-09-26 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181305#comment-16181305 ] Ajay Kumar edited comment on HDFS-12545 at 9/26/17 6:47 PM: [~msingh] I think

[jira] [Updated] (HDFS-12551) Ozone: Documentation: Add Ozone overview documentation.

2017-09-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12551: Attachment: Apache Hadoop 3.1.0-SNAPSHOT –OzoneOverview.pdf > Ozone: Documentation: Add Ozone

[jira] [Updated] (HDFS-12551) Ozone: Documentation: Add Ozone overview documentation.

2017-09-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12551: Attachment: (was: HDFS-12551-HDFS-7240.001.patch) > Ozone: Documentation: Add Ozone overview

[jira] [Updated] (HDFS-12551) Ozone: Documentation: Add Ozone overview documentation.

2017-09-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12551: Attachment: HDFS-12551-HDFS-7240.001.patch > Ozone: Documentation: Add Ozone overview

[jira] [Updated] (HDFS-12551) Ozone: Documentation: Add Ozone overview documentation.

2017-09-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12551: Attachment: HDFS-12551-HDFS-7240.001.patch > Ozone: Documentation: Add Ozone overview

[jira] [Commented] (HDFS-12420) Add an option to disallow 'namenode format -force'

2017-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181510#comment-16181510 ] Hadoop QA commented on HDFS-12420: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12420) Add an option to disallow 'namenode format -force'

2017-09-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181247#comment-16181247 ] Arpit Agarwal commented on HDFS-12420: -- +1 pending Jenkins for the v11 patch. Will hold off

[jira] [Commented] (HDFS-12543) Ozone : allow create key without specifying size

2017-09-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181244#comment-16181244 ] Chen Liang commented on HDFS-12543: --- v001 patch mistakenly included some unrelated changes, will fix in

[jira] [Created] (HDFS-12551) Ozone: Documentation: Add Ozone overview documentation.

2017-09-26 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-12551: --- Summary: Ozone: Documentation: Add Ozone overview documentation. Key: HDFS-12551 URL: https://issues.apache.org/jira/browse/HDFS-12551 Project: Hadoop HDFS

[jira] [Commented] (HDFS-12386) Add fsserver defaults call to WebhdfsFileSystem.

2017-09-26 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181235#comment-16181235 ] Rushabh S Shah commented on HDFS-12386: --- For all the test failures in branch-2, I created HDFS-12548

[jira] [Commented] (HDFS-12533) NNThroughputBenchmark threads get stuck on UGI.getCurrentUser()

2017-09-26 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181275#comment-16181275 ] Erik Krogen commented on HDFS-12533: Hm yes, HADOOP-9747 should definitely help the issue >

[jira] [Commented] (HDFS-12386) Add fsserver defaults call to WebhdfsFileSystem.

2017-09-26 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181445#comment-16181445 ] Rushabh S Shah commented on HDFS-12386: --- Thanks [~daryn] for your patient reviews !! > Add fsserver

[jira] [Updated] (HDFS-12543) Ozone : allow create key without specifying size

2017-09-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12543: -- Attachment: HDFS-12543-HDFS-7240.002.patch Post v002 patch to fix the checkstyle and findbug warnings.

[jira] [Updated] (HDFS-12552) Use slf4j instead of log4j in FSNamesystem

2017-09-26 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12552: -- Attachment: HDFS-12552.01.patch > Use slf4j instead of log4j in FSNamesystem >

[jira] [Commented] (HDFS-12469) Ozone: Create docker-compose definition to easily test real clusters

2017-09-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181704#comment-16181704 ] Anu Engineer commented on HDFS-12469: - [~elek] Thank you for getting this done. It is a pleasure to

[jira] [Commented] (HDFS-12498) Journal Syncer is not started in Federated + HA cluster

2017-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181511#comment-16181511 ] Hadoop QA commented on HDFS-12498: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12386) Add fsserver defaults call to WebhdfsFileSystem.

2017-09-26 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-12386: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.1.0 2.8.3

[jira] [Commented] (HDFS-12543) Ozone : allow create key without specifying size

2017-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181606#comment-16181606 ] Hadoop QA commented on HDFS-12543: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

2017-09-26 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181721#comment-16181721 ] Sean Mackrory commented on HDFS-7878: - {quote}Neither API has been part of a release, yet. {quote} But

[jira] [Comment Edited] (HDFS-7878) API - expose an unique file identifier

2017-09-26 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181634#comment-16181634 ] Sean Mackrory edited comment on HDFS-7878 at 9/26/17 9:41 PM: -- Looks like this

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

2017-09-26 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181641#comment-16181641 ] Chris Douglas commented on HDFS-7878: - bq. The following is already annotated as Public and Stable in

[jira] [Commented] (HDFS-10702) Add a Client API and Proxy Provider to enable stale read from Standby

2017-09-26 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181648#comment-16181648 ] Sean Mackrory commented on HDFS-10702: -- I was just chatting with [~yzhangal] about this feature and

[jira] [Commented] (HDFS-12552) Use slf4j instead of log4j in FSNamesystem

2017-09-26 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181705#comment-16181705 ] Ajay Kumar commented on HDFS-12552: --- Cleared some of the warnings in test classes using

[jira] [Updated] (HDFS-12552) Use slf4j instead of log4j in FSNamesystem

2017-09-26 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12552: -- Status: Patch Available (was: Open) > Use slf4j instead of log4j in FSNamesystem >

[jira] [Commented] (HDFS-12469) Ozone: Create docker-compose definition to easily test real clusters

2017-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181544#comment-16181544 ] Hadoop QA commented on HDFS-12469: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12386) Add fsserver defaults call to WebhdfsFileSystem.

2017-09-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181568#comment-16181568 ] Hudson commented on HDFS-12386: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12983 (See

[jira] [Commented] (HDFS-12469) Ozone: Create docker-compose definition to easily test real clusters

2017-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181583#comment-16181583 ] Hadoop QA commented on HDFS-12469: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12464) Ozone: More detailed documentation about the ozone components

2017-09-26 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181540#comment-16181540 ] Elek, Marton commented on HDFS-12464: - Yes, that's Architectural overview was also a missing point. I

[jira] [Commented] (HDFS-11858) JN httpServerUri should be set to hostname when using Default Http Address

2017-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181719#comment-16181719 ] Hadoop QA commented on HDFS-11858: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

2017-09-26 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181634#comment-16181634 ] Sean Mackrory commented on HDFS-7878: - Looks like this patch is violating some of compatibility

[jira] [Updated] (HDFS-12411) Ozone: Add container usage information to DN container report

2017-09-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-12411: -- Attachment: HDFS-12411-HDFS-7240.001.patch Attach an initial patch. > Ozone: Add container usage

[jira] [Updated] (HDFS-7527) TestDecommission.testIncludeByRegistrationName fails occassionally in trunk

2017-09-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7527: -- Labels: flaky-test (was: ) > TestDecommission.testIncludeByRegistrationName fails occassionally in

[jira] [Updated] (HDFS-11045) TestDirectoryScanner#testThrottling fails: Throttle is too permissive

2017-09-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11045: --- Labels: flaky-test (was: ) > TestDirectoryScanner#testThrottling fails: Throttle is too permissive >

[jira] [Updated] (HDFS-6681) TestRBWBlockInvalidation#testBlockInvalidationWhenRBWReplicaMissedInDN is flaky and sometimes gets stuck in infinite loops

2017-09-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6681: -- Labels: BB2015-05-TBR flaky-test (was: BB2015-05-TBR) >

[jira] [Updated] (HDFS-10618) TestPendingReconstruction#testPendingAndInvalidate is flaky due to race condition

2017-09-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10618: --- Labels: flaky-test (was: ) > TestPendingReconstruction#testPendingAndInvalidate is flaky due to race

[jira] [Updated] (HDFS-11052) TestPersistBlocks#TestRestartDfsWithFlush flaky failure

2017-09-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11052: --- Labels: flaky-test unit-test (was: unit-test) > TestPersistBlocks#TestRestartDfsWithFlush flaky

[jira] [Updated] (HDFS-6308) TestDistributedFileSystem#testGetFileBlockStorageLocationsError is flaky

2017-09-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6308: -- Labels: flaky-test (was: ) > TestDistributedFileSystem#testGetFileBlockStorageLocationsError is flaky >

[jira] [Updated] (HDFS-11107) TestStartup#testStorageBlockContentsStaleAfterNNRestart flaky failure

2017-09-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11107: --- Labels: flaky-test unit-test (was: unit-test) >

[jira] [Updated] (HDFS-12509) Ozone: Revert files not related to ozone change in HDFS-7240 branch

2017-09-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12509: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-12454) Ozone : the sample ozone-site.xml in OzoneGettingStarted does not work

2017-09-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181823#comment-16181823 ] Anu Engineer commented on HDFS-12454: - +1, I will commit this shortly. [~vagarychen] Can you please

[jira] [Commented] (HDFS-12511) Ozone: Add tags to config

2017-09-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181836#comment-16181836 ] Anu Engineer commented on HDFS-12511: - [~ajayydv] Could you please rebase this patch to the latest top

[jira] [Commented] (HDFS-6681) TestRBWBlockInvalidation#testBlockInvalidationWhenRBWReplicaMissedInDN is flaky and sometimes gets stuck in infinite loops

2017-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181844#comment-16181844 ] Hadoop QA commented on HDFS-6681: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12469) Ozone: Create docker-compose definition to easily test real clusters

2017-09-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181846#comment-16181846 ] Anu Engineer commented on HDFS-12469: - +1, I understand why we are not mapping the port since the

[jira] [Commented] (HDFS-12425) Ozone: OzoneFileSystem: OzoneFileystem read/write/create/open/getFileInfo APIs

2017-09-26 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181879#comment-16181879 ] Mukul Kumar Singh commented on HDFS-12425: -- Thanks for the review [~xyao], the difference between

[jira] [Updated] (HDFS-12411) Ozone: Add container usage information to DN container report

2017-09-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-12411: -- Attachment: HDFS-12411-HDFS-7240.002.patch Rebase the patch to latest HDFS-7240. > Ozone: Add

[jira] [Commented] (HDFS-12425) Ozone: OzoneFileSystem: OzoneFileystem read/write/create/open/getFileInfo APIs

2017-09-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181887#comment-16181887 ] Xiaoyu Yao commented on HDFS-12425: --- Thanks for the update, [~msingh], I will commit the patch soon. >

[jira] [Updated] (HDFS-12553) Add nameServiceId to QJournalProtocol

2017-09-26 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12553: -- Attachment: HDFS-12553.02.patch > Add nameServiceId to QJournalProtocol >

[jira] [Created] (HDFS-12555) HDFS federation should support configure secondary directory

2017-09-26 Thread luoge123 (JIRA)
luoge123 created HDFS-12555: --- Summary: HDFS federation should support configure secondary directory Key: HDFS-12555 URL: https://issues.apache.org/jira/browse/HDFS-12555 Project: Hadoop HDFS

[jira] [Commented] (HDFS-12513) Ozone: Create UI page to show Ozone configs by tags

2017-09-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181741#comment-16181741 ] Anu Engineer commented on HDFS-12513: - [~cheersyang] We would love to take it trunk at some point in

[jira] [Updated] (HDFS-12511) Ozone: Add tags to config

2017-09-26 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12511: -- Attachment: HDFS-12511-HDFS-7240.01.patch > Ozone: Add tags to config > - > >

[jira] [Commented] (HDFS-12387) Ozone: Support Ratis as a first class replication mechanism

2017-09-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181762#comment-16181762 ] Xiaoyu Yao commented on HDFS-12387: --- bq. The code does not regress from the current state, since we

[jira] [Updated] (HDFS-10961) Flaky test TestSnapshotFileLength.testSnapshotfileLength

2017-09-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10961: --- Labels: flaky-test (was: ) > Flaky test TestSnapshotFileLength.testSnapshotfileLength >

[jira] [Updated] (HDFS-12122) TestEditLogTailer is flaky

2017-09-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12122: --- Labels: flaky-test (was: ) > TestEditLogTailer is flaky > -- > >

[jira] [Updated] (HDFS-11584) Fix flaky test TestErasureCodeBenchmarkThroughput.testECReadWrite - failed creating new block streams

2017-09-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11584: --- Labels: flaky-test (was: ) > Fix flaky test TestErasureCodeBenchmarkThroughput.testECReadWrite -

[jira] [Commented] (HDFS-7527) TestDecommission.testIncludeByRegistrationName fails occassionally in trunk

2017-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181807#comment-16181807 ] Hadoop QA commented on HDFS-7527: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10618) TestPendingReconstruction#testPendingAndInvalidate is flaky due to race condition

2017-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181803#comment-16181803 ] Hadoop QA commented on HDFS-10618: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11045) TestDirectoryScanner#testThrottling fails: Throttle is too permissive

2017-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181802#comment-16181802 ] Hadoop QA commented on HDFS-11045: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12511) Ozone: Add tags to config

2017-09-26 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12511: -- Attachment: (was: HDFS-12511-HDFS-7240.01.patch) > Ozone: Add tags to config >

[jira] [Updated] (HDFS-12511) Ozone: Add tags to config

2017-09-26 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12511: -- Attachment: HDFS-12511-HDFS-7240.01.patch Added test case to check ozone tags in deafult config >

[jira] [Updated] (HDFS-12511) Ozone: Add tags to config

2017-09-26 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12511: -- Attachment: HDFS-12511-HDFS-7240.01.patch > Ozone: Add tags to config > - > >

[jira] [Updated] (HDFS-12454) Ozone : the sample ozone-site.xml in OzoneGettingStarted does not work

2017-09-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12454: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Target

[jira] [Created] (HDFS-12554) Ozone: Fix TestDatanodeStateMachine#testDatanodeStateMachineWithInvalidConfiguration

2017-09-26 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-12554: - Summary: Ozone: Fix TestDatanodeStateMachine#testDatanodeStateMachineWithInvalidConfiguration Key: HDFS-12554 URL: https://issues.apache.org/jira/browse/HDFS-12554

[jira] [Commented] (HDFS-12513) Ozone: Create UI page to show Ozone configs by tags

2017-09-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181906#comment-16181906 ] Weiwei Yang commented on HDFS-12513: Thanks [~anu] and [~ajayydv], I agree this is helpful. I am

[jira] [Updated] (HDFS-12511) Ozone: Add tags to config

2017-09-26 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12511: -- Attachment: HDFS-12511-HDFS-7240.02.patch patch with > Ozone: Add tags to config >

[jira] [Updated] (HDFS-12511) Ozone: Add tags to config

2017-09-26 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12511: -- Status: Patch Available (was: Open) updated patch for latest branch. > Ozone: Add tags to config >

[jira] [Issue Comment Deleted] (HDFS-12511) Ozone: Add tags to config

2017-09-26 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12511: -- Comment: was deleted (was: patch with ) > Ozone: Add tags to config > - > >

[jira] [Updated] (HDFS-12553) Add nameServiceId to QJournalProtocol

2017-09-26 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12553: -- Attachment: (was: HDFS-12553.02.patch) > Add nameServiceId to QJournalProtocol >

[jira] [Updated] (HDFS-12553) Add nameServiceId to QJournalProtocol

2017-09-26 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12553: -- Attachment: HDFS-12553.02.patch > Add nameServiceId to QJournalProtocol >

[jira] [Assigned] (HDFS-12554) Ozone: Fix TestDatanodeStateMachine#testDatanodeStateMachineWithInvalidConfiguration

2017-09-26 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar reassigned HDFS-12554: - Assignee: Ajay Kumar > Ozone: Fix >

[jira] [Comment Edited] (HDFS-12513) Ozone: Create UI page to show Ozone configs by tags

2017-09-26 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181735#comment-16181735 ] Ajay Kumar edited comment on HDFS-12513 at 9/26/17 11:21 PM: - [~cheersyang],

[jira] [Updated] (HDFS-12511) Ozone: Add tags to config

2017-09-26 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12511: -- Attachment: (was: HDFS-12511.01.patch) > Ozone: Add tags to config > - > >

[jira] [Commented] (HDFS-12291) [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir

2017-09-26 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181791#comment-16181791 ] Uma Maheswara Rao G commented on HDFS-12291: Latest patch looks good to me. If no other

[jira] [Commented] (HDFS-6308) TestDistributedFileSystem#testGetFileBlockStorageLocationsError is flaky

2017-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181801#comment-16181801 ] Hadoop QA commented on HDFS-6308: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12511) Ozone: Add tags to config

2017-09-26 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12511: -- Attachment: (was: HDFS-12511-HDFS-7240.01.patch) > Ozone: Add tags to config >

[jira] [Updated] (HDFS-12511) Ozone: Add tags to config

2017-09-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12511: Status: Open (was: Patch Available) > Ozone: Add tags to config > - > >

[jira] [Updated] (HDFS-12425) Ozone: OzoneFileSystem: read/write/create/open/getFileInfo APIs

2017-09-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-12425: -- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-12509) Ozone: Revert files not related to ozone change in HDFS-7240 branch

2017-09-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181734#comment-16181734 ] Anu Engineer commented on HDFS-12509: - [~msingh] was kind enough to explain to me off-line about a

[jira] [Updated] (HDFS-5912) TestDistributedFileSystem#testGetFileBlockStorageLocationsBatching is flaky

2017-09-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-5912: -- Labels: flaky-test (was: ) > TestDistributedFileSystem#testGetFileBlockStorageLocationsBatching is

  1   2   >