[jira] [Commented] (HDFS-12274) Ozone: Corona: move corona from test to tools package

2017-08-09 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121058#comment-16121058 ] Nandakumar commented on HDFS-12274: --- Thanks [~cheersyang] for the suggestion, fixed it in patch v003. >

[jira] [Updated] (HDFS-12274) Ozone: Corona: move corona from test to tools package

2017-08-09 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-12274: -- Attachment: HDFS-12274-HDFS-7240.003.patch > Ozone: Corona: move corona from test to tools package >

[jira] [Commented] (HDFS-12054) FSNamesystem#addECPolicies should call checkNameNodeSafeMode() to ensure Namenode is not in safemode

2017-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121002#comment-16121002 ] Hadoop QA commented on HDFS-12054: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12054) FSNamesystem#addECPolicies should call checkNameNodeSafeMode() to ensure Namenode is not in safemode

2017-08-09 Thread lufei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lufei updated HDFS-12054: - Attachment: HDFS-12054.002.patch > FSNamesystem#addECPolicies should call checkNameNodeSafeMode() to ensure >

[jira] [Updated] (HDFS-12066) When Namenode is in safemode,may not allowed to remove an user's erasure coding policy

2017-08-09 Thread lufei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lufei updated HDFS-12066: - Attachment: (was: HDFS-12054.002.patch) > When Namenode is in safemode,may not allowed to remove an user's

[jira] [Commented] (HDFS-12066) When Namenode is in safemode,may not allowed to remove an user's erasure coding policy

2017-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120998#comment-16120998 ] Hadoop QA commented on HDFS-12066: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12066) When Namenode is in safemode,may not allowed to remove an user's erasure coding policy

2017-08-09 Thread lufei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lufei updated HDFS-12066: - Attachment: HDFS-12054.002.patch > When Namenode is in safemode,may not allowed to remove an user's erasure >

[jira] [Commented] (HDFS-6489) DFS Used space is not correct computed on frequent append operations

2017-08-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120964#comment-16120964 ] Weiwei Yang commented on HDFS-6489: --- I am un-assigning myself from this ticket, [~raviprak] do you want

[jira] [Assigned] (HDFS-6489) DFS Used space is not correct computed on frequent append operations

2017-08-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned HDFS-6489: - Assignee: (was: Weiwei Yang) > DFS Used space is not correct computed on frequent append

[jira] [Commented] (HDFS-12274) Ozone: Corona: move corona from test to tools package

2017-08-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120908#comment-16120908 ] Weiwei Yang commented on HDFS-12274: The patch looks good to me, only one thing, following code

[jira] [Commented] (HDFS-12281) Ozone: Ozone-default.xml has 3 properties that do not match the default Config value

2017-08-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120906#comment-16120906 ] Weiwei Yang commented on HDFS-12281: Hi [~ajayydv] thanks for working on this, I am OK with the first

[jira] [Commented] (HDFS-12202) Provide new set of FileSystem API to bypass external attribute provider

2017-08-09 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120861#comment-16120861 ] Chris Douglas commented on HDFS-12202: -- bq. I wish there is a solution that we can avoid modifying

[jira] [Commented] (HDFS-12159) Ozone: SCM: Add create replication pipeline RPC

2017-08-09 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120838#comment-16120838 ] Anu Engineer commented on HDFS-12159: - [~szetszwo] Can you please take a look at the changes made to

[jira] [Comment Edited] (HDFS-12159) Ozone: SCM: Add create replication pipeline RPC

2017-08-09 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120836#comment-16120836 ] Anu Engineer edited comment on HDFS-12159 at 8/9/17 11:38 PM: -- This patch

[jira] [Updated] (HDFS-12159) Ozone: SCM: Add create replication pipeline RPC

2017-08-09 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12159: Attachment: createFlow.png This PNG explains the create workflow with Ratis or pluggable pipeline

[jira] [Updated] (HDFS-12159) Ozone: SCM: Add create replication pipeline RPC

2017-08-09 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12159: Attachment: HDFS-12159-HDFS-7240.003.patch This patch brings in Apache Ratis as a first class

[jira] [Commented] (HDFS-12000) Ozone: Container : Add key versioning support-1

2017-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120823#comment-16120823 ] Hadoop QA commented on HDFS-12000: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12278) LeaseManager operations are inefficient in 2.8.

2017-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120808#comment-16120808 ] Hadoop QA commented on HDFS-12278: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12281) Ozone: Ozone-default.xml has 3 properties that do not match the default Config value

2017-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120776#comment-16120776 ] Hadoop QA commented on HDFS-12281: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12285) Better handling of namenode ip address change

2017-08-09 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-12285: --- Description: RPC client layer provides functionality to detect ip address change: {noformat} Client.java

[jira] [Assigned] (HDFS-12102) VolumeScanner throttle dropped (fast scan enabled) when there is a corrupt block

2017-08-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reassigned HDFS-12102: Assignee: Ashwin Ramesh > VolumeScanner throttle dropped (fast scan enabled) when there is

[jira] [Created] (HDFS-12285) Better handling of namenode ip address change

2017-08-09 Thread Ming Ma (JIRA)
Ming Ma created HDFS-12285: -- Summary: Better handling of namenode ip address change Key: HDFS-12285 URL: https://issues.apache.org/jira/browse/HDFS-12285 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-12278) LeaseManager operations are inefficient in 2.8.

2017-08-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120729#comment-16120729 ] Hudson commented on HDFS-12278: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12156 (See

[jira] [Commented] (HDFS-12278) LeaseManager operations are inefficient in 2.8.

2017-08-09 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120726#comment-16120726 ] Rushabh S Shah commented on HDFS-12278: --- Thanks [~kihwal] for the review and commit ! Thanks

[jira] [Updated] (HDFS-12278) LeaseManager operations are inefficient in 2.8.

2017-08-09 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-12278: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.2 3.0.0-beta1

[jira] [Comment Edited] (HDFS-12278) LeaseManager operations are inefficient in 2.8.

2017-08-09 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120702#comment-16120702 ] Rushabh S Shah edited comment on HDFS-12278 at 8/9/17 9:46 PM: --- bq. but how

[jira] [Commented] (HDFS-12278) LeaseManager operations are inefficient in 2.8.

2017-08-09 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120702#comment-16120702 ] Rushabh S Shah commented on HDFS-12278: --- bq. but how did you benchmark TreeSet and PriorityQueue

[jira] [Commented] (HDFS-12278) LeaseManager operations are inefficient in 2.8.

2017-08-09 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120700#comment-16120700 ] Kihwal Lee commented on HDFS-12278: --- +1 looks good. > LeaseManager operations are inefficient in 2.8. >

[jira] [Commented] (HDFS-12278) LeaseManager operations are inefficient in 2.8.

2017-08-09 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120686#comment-16120686 ] Ravi Prakash commented on HDFS-12278: - Hi Rushabh! Slightly on a tangent, but how did you benchmark

[jira] [Updated] (HDFS-12000) Ozone: Container : Add key versioning support-1

2017-08-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12000: -- Attachment: HDFS-12000-HDFS-7240.003.patch > Ozone: Container : Add key versioning support-1 >

[jira] [Commented] (HDFS-12281) Ozone: Ozone-default.xml has 3 properties that do not match the default Config value

2017-08-09 Thread Ajay Yadav (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120650#comment-16120650 ] Ajay Yadav commented on HDFS-12281: --- [~anu],[~xyao] plz review the patch. > Ozone: Ozone-default.xml

[jira] [Updated] (HDFS-12281) Ozone: Ozone-default.xml has 3 properties that do not match the default Config value

2017-08-09 Thread Ajay Yadav (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Yadav updated HDFS-12281: -- Status: Patch Available (was: Open) > Ozone: Ozone-default.xml has 3 properties that do not match the

[jira] [Updated] (HDFS-12281) Ozone: Ozone-default.xml has 3 properties that do not match the default Config value

2017-08-09 Thread Ajay Yadav (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Yadav updated HDFS-12281: -- Description: #XML Property: ozone.handler.type Value -   local ## Config Name:  

[jira] [Updated] (HDFS-12281) Ozone: Ozone-default.xml has 3 properties that do not match the default Config value

2017-08-09 Thread Ajay Yadav (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Yadav updated HDFS-12281: -- Attachment: HDFS-12281-HDFS-7240.01.patch > Ozone: Ozone-default.xml has 3 properties that do not match

[jira] [Updated] (HDFS-12281) Ozone: Ozone-default.xml has 3 properties that do not match the default Config value

2017-08-09 Thread Ajay Yadav (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Yadav updated HDFS-12281: -- Description: # XML Property: ozone.handler.type Value -   local ## Config Name:  

[jira] [Updated] (HDFS-12281) Ozone: Ozone-default.xml has 3 properties that do not match the default Config value

2017-08-09 Thread Ajay Yadav (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Yadav updated HDFS-12281: -- Description: # XML Property: ozone.handler.type Value:local ## Config Name:  

[jira] [Updated] (HDFS-12281) Ozone: Ozone-default.xml has 3 properties that do not match the default Config value

2017-08-09 Thread Ajay Yadav (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Yadav updated HDFS-12281: -- Description: # XML Property: ozone.handler.type Value:local #* Config Name:  

[jira] [Updated] (HDFS-12281) Ozone: Ozone-default.xml has 3 properties that do not match the default Config value

2017-08-09 Thread Ajay Yadav (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Yadav updated HDFS-12281: -- Description: # XML Property: ozone.handler.type Value:local ## Config Name:  

[jira] [Updated] (HDFS-12278) LeaseManager operations are inefficient in 2.8.

2017-08-09 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-12278: -- Attachment: HDFS-12278-branch-2.8.001.patch Attaching a branch-2.8 patch. Imports conflict with

[jira] [Commented] (HDFS-12278) LeaseManager operations are inefficient in 2.8.

2017-08-09 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120620#comment-16120620 ] Rushabh S Shah commented on HDFS-12278: --- {{TestDFSStripedOutputStreamWithFailure150}} and

[jira] [Commented] (HDFS-5040) Audit log for admin commands/ logging output of all DFS admin commands

2017-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120541#comment-16120541 ] Hadoop QA commented on HDFS-5040: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12000) Ozone: Container : Add key versioning support-1

2017-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120528#comment-16120528 ] Hadoop QA commented on HDFS-12000: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12278) LeaseManager operations are inefficient in 2.8.

2017-08-09 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-12278: -- Summary: LeaseManager operations are inefficient in 2.8. (was: LeaseManager#removeLease

[jira] [Commented] (HDFS-12278) LeaseManager#removeLease operation is inefficient in 2.8.

2017-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120518#comment-16120518 ] Hadoop QA commented on HDFS-12278: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-7240) Object store in HDFS

2017-08-09 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120502#comment-16120502 ] Elek, Marton commented on HDFS-7240: Yeah, but it seems for the registration I need an {{@apache.org}}

[jira] [Commented] (HDFS-7240) Object store in HDFS

2017-08-09 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120438#comment-16120438 ] Anu Engineer commented on HDFS-7240: [~elek] Nope, all are welcome. > Object store in HDFS >

[jira] [Commented] (HDFS-7240) Object store in HDFS

2017-08-09 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120436#comment-16120436 ] Elek, Marton commented on HDFS-7240: Is this chat for commiters only? > Object store in HDFS >

[jira] [Commented] (HDFS-12278) LeaseManager#removeLease operation is inefficient in 2.8.

2017-08-09 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120418#comment-16120418 ] Daryn Sharp commented on HDFS-12278: I benched the remove/update/add between the priority queue and

[jira] [Commented] (HDFS-12238) Ozone: Add valid trace ID check in sendCommandAsync

2017-08-09 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120410#comment-16120410 ] Anu Engineer commented on HDFS-12238: - Thanks [~vagarychen] for the comments. bq.

[jira] [Commented] (HDFS-12273) Federation UI

2017-08-09 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120389#comment-16120389 ] Ravi Prakash commented on HDFS-12273: - I can try to take a look but honestly I'm sorry it won't have

[jira] [Updated] (HDFS-5040) Audit log for admin commands/ logging output of all DFS admin commands

2017-08-09 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-5040: -- Attachment: HDFS-5040.006.patch Fixing minor checkstyle warnings. Findbug warnings are unrelated and so

[jira] [Commented] (HDFS-12238) Ozone: Add valid trace ID check in sendCommandAsync

2017-08-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120369#comment-16120369 ] Chen Liang commented on HDFS-12238: --- Actually, I guess it is probably because some places in the code

[jira] [Commented] (HDFS-12238) Ozone: Add valid trace ID check in sendCommandAsync

2017-08-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120364#comment-16120364 ] Chen Liang commented on HDFS-12238: --- Hi [~ajayydv], I only checked {{TestBufferManager}} and

[jira] [Updated] (HDFS-12284) Router support for Kerberos authentication and delegation tokens

2017-08-09 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-12284: - Summary: Router support for Kerberos authentication and delegation tokens (was: Router support for

[jira] [Created] (HDFS-12284) Router support for Kerberos and delegation tokens

2017-08-09 Thread Zhe Zhang (JIRA)
Zhe Zhang created HDFS-12284: Summary: Router support for Kerberos and delegation tokens Key: HDFS-12284 URL: https://issues.apache.org/jira/browse/HDFS-12284 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-12000) Ozone: Container : Add key versioning support-1

2017-08-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12000: -- Attachment: HDFS-12000-HDFS-7240.002.patch Post v002 patch to fix findbugs, checkstyle and license

[jira] [Commented] (HDFS-5040) Audit log for admin commands/ logging output of all DFS admin commands

2017-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120336#comment-16120336 ] Hadoop QA commented on HDFS-5040: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12278) LeaseManager#removeLease operation is inefficient in 2.8.

2017-08-09 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-12278: -- Status: Patch Available (was: Open) > LeaseManager#removeLease operation is inefficient in

[jira] [Updated] (HDFS-12278) LeaseManager#removeLease operation is inefficient in 2.8.

2017-08-09 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-12278: -- Attachment: HDFS-12278.patch Very small change. Switched back to TreeSet from Priority Queue.

[jira] [Commented] (HDFS-12254) Upgrade JUnit from 4 to 5 in hadoop-hdfs

2017-08-09 Thread Ajay Yadav (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120316#comment-16120316 ] Ajay Yadav commented on HDFS-12254: --- hi [~ajisakaa] , As i understand , we can do it in two ways. # 1.

[jira] [Commented] (HDFS-12202) Provide new set of FileSystem API to bypass external attribute provider

2017-08-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120313#comment-16120313 ] Yongjun Zhang commented on HDFS-12202: -- Thanks for the feedback [~asuresh] [~manojg] and

[jira] [Commented] (HDFS-12221) Replace xcerces in XmlEditsVisitor

2017-08-09 Thread Ajay Yadav (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120268#comment-16120268 ] Ajay Yadav commented on HDFS-12221: --- [~andrew.wang], [~eddyxu] Added updated binary file to resolve the

[jira] [Updated] (HDFS-12221) Replace xcerces in XmlEditsVisitor

2017-08-09 Thread Ajay Yadav (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Yadav updated HDFS-12221: -- Attachment: editsStored HDFS-12221.05.patch > Replace xcerces in XmlEditsVisitor >

[jira] [Commented] (HDFS-12266) Ozone : add debug cli to hdfs script

2017-08-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120255#comment-16120255 ] Chen Liang commented on HDFS-12266: --- Thanks [~elek] for the catch! I totally missed it...done what you

[jira] [Commented] (HDFS-12217) HDFS snapshots doesn't capture all open files when one of the open files is deleted

2017-08-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120243#comment-16120243 ] Yongjun Zhang commented on HDFS-12217: -- Hi [~manojg] and [~jojochuang], Thanks for continuing to

[jira] [Commented] (HDFS-10285) Storage Policy Satisfier in Namenode

2017-08-09 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120227#comment-16120227 ] Anoop Sam John commented on HDFS-10285: --- HBase can get benefited from this feature. The scenario is

[jira] [Commented] (HDFS-12278) LeaseManager#removeLease operation is inefficient in 2.8.

2017-08-09 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120217#comment-16120217 ] Daryn Sharp commented on HDFS-12278: For context regarding the impact of the change to a priority

[jira] [Updated] (HDFS-5040) Audit log for admin commands/ logging output of all DFS admin commands

2017-08-09 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-5040: -- Attachment: HDFS-5040.005.patch bq. Add fail assertion for exception cases. you can use

[jira] [Commented] (HDFS-12274) Ozone: Corona: move corona from test to tools package

2017-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120112#comment-16120112 ] Hadoop QA commented on HDFS-12274: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12157) Do fsyncDirectory(..) outside of FSDataset lock

2017-08-09 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-12157: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.5 2.8.2

[jira] [Commented] (HDFS-12157) Do fsyncDirectory(..) outside of FSDataset lock

2017-08-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119984#comment-16119984 ] Hudson commented on HDFS-12157: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12153 (See

[jira] [Commented] (HDFS-12268) Ozone: Add metrics for pending storage container requests

2017-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119941#comment-16119941 ] Hadoop QA commented on HDFS-12268: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12274) Ozone: Corona: move corona from test to tools package

2017-08-09 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-12274: -- Attachment: HDFS-12274-HDFS-7240.002.patch Patch v002 with checkstyle fix. > Ozone: Corona: move

[jira] [Commented] (HDFS-12157) Do fsyncDirectory(..) outside of FSDataset lock

2017-08-09 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119932#comment-16119932 ] Kihwal Lee commented on HDFS-12157: --- +1 LGTM. > Do fsyncDirectory(..) outside of FSDataset lock >

[jira] [Commented] (HDFS-12274) Ozone: Corona: move corona from test to tools package

2017-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119912#comment-16119912 ] Hadoop QA commented on HDFS-12274: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12117) HttpFS does not seem to support SNAPSHOT related methods for WebHDFS REST Interface

2017-08-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119801#comment-16119801 ] Hudson commented on HDFS-12117: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12151 (See

[jira] [Commented] (HDFS-6489) DFS Used space is not correct computed on frequent append operations

2017-08-09 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119797#comment-16119797 ] Brahma Reddy Battula commented on HDFS-6489: bq.Even with this, dfsUsed and numblocks counting

[jira] [Commented] (HDFS-12274) Ozone: Corona: move corona from test to tools package

2017-08-09 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119761#comment-16119761 ] Nandakumar commented on HDFS-12274: --- Thanks [~cheersyang] for the review. Uploaded patch v001 with

[jira] [Updated] (HDFS-12274) Ozone: Corona: move corona from test to tools package

2017-08-09 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-12274: -- Attachment: HDFS-12274-HDFS-7240.001.patch > Ozone: Corona: move corona from test to tools package >

[jira] [Commented] (HDFS-12214) [SPS]: Fix review comments of StoragePolicySatisfier feature

2017-08-09 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119730#comment-16119730 ] Rakesh R commented on HDFS-12214: - bq. 5) can we update statistics ..?

[jira] [Commented] (HDFS-12228) [SPS]: Add storage policy satisfier related metrics

2017-08-09 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119729#comment-16119729 ] Rakesh R commented on HDFS-12228: - Adding one more comment here, this has to be taken care during

[jira] [Comment Edited] (HDFS-12266) Ozone : add debug cli to hdfs script

2017-08-09 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119721#comment-16119721 ] Elek, Marton edited comment on HDFS-12266 at 8/9/17 10:59 AM: -- Oh, I found

[jira] [Commented] (HDFS-12266) Ozone : add debug cli to hdfs script

2017-08-09 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119721#comment-16119721 ] Elek, Marton commented on HDFS-12266: - Oh, I found it, there was a typo in the commit of HDFS-11836:

[jira] [Commented] (HDFS-12266) Ozone : add debug cli to hdfs script

2017-08-09 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119696#comment-16119696 ] Elek, Marton commented on HDFS-12266: - I think it is a duplicate of HDFS-11836 and one of them could

[jira] [Commented] (HDFS-12221) Replace xcerces in XmlEditsVisitor

2017-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119674#comment-16119674 ] Hadoop QA commented on HDFS-12221: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12283) Ozone: DeleteKey-5: Implement SCM DeletedBlockLog

2017-08-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119670#comment-16119670 ] Weiwei Yang commented on HDFS-12283: +[~anu] and [~xyao] in the loop, feel free to comment please. :)

[jira] [Assigned] (HDFS-12283) Ozone: DeleteKey-5: Implement SCM DeletedBlockLog

2017-08-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned HDFS-12283: -- Assignee: Yuanbo Liu (was: Weiwei Yang) > Ozone: DeleteKey-5: Implement SCM DeletedBlockLog >

[jira] [Comment Edited] (HDFS-12283) Ozone: DeleteKey-5: Implement SCM DeletedBlockLog

2017-08-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119663#comment-16119663 ] Weiwei Yang edited comment on HDFS-12283 at 8/9/17 10:10 AM: - Some more

[jira] [Comment Edited] (HDFS-12283) Ozone: DeleteKey-5: Implement SCM DeletedBlockLog

2017-08-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119663#comment-16119663 ] Weiwei Yang edited comment on HDFS-12283 at 8/9/17 10:09 AM: - Some more

[jira] [Comment Edited] (HDFS-12283) Ozone: DeleteKey-5: Implement SCM DeletedBlockLog

2017-08-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119663#comment-16119663 ] Weiwei Yang edited comment on HDFS-12283 at 8/9/17 10:09 AM: - Some more

[jira] [Commented] (HDFS-12283) Ozone: DeleteKey-5: Implement SCM DeletedBlockLog

2017-08-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119663#comment-16119663 ] Weiwei Yang commented on HDFS-12283: Some more thoughts. Each key value pair in the log is {code} {

[jira] [Created] (HDFS-12283) Ozone: DeleteKey-5: Implement SCM DeletedBlockLog

2017-08-09 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12283: -- Summary: Ozone: DeleteKey-5: Implement SCM DeletedBlockLog Key: HDFS-12283 URL: https://issues.apache.org/jira/browse/HDFS-12283 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-12268) Ozone: Add metrics for pending storage container requests

2017-08-09 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12268: - Attachment: HDFS-12268-HDFS-7240.002.patch Thanks [~anu] for the review! bq. Do you think we can maintain

[jira] [Comment Edited] (HDFS-12157) Do fsyncDirectory(..) outside of FSDataset lock

2017-08-09 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119602#comment-16119602 ] Brahma Reddy Battula edited comment on HDFS-12157 at 8/9/17 9:09 AM: -

[jira] [Comment Edited] (HDFS-12157) Do fsyncDirectory(..) outside of FSDataset lock

2017-08-09 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119602#comment-16119602 ] Brahma Reddy Battula edited comment on HDFS-12157 at 8/9/17 9:03 AM: -

[jira] [Commented] (HDFS-12157) Do fsyncDirectory(..) outside of FSDataset lock

2017-08-09 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119602#comment-16119602 ] Brahma Reddy Battula commented on HDFS-12157: - will hold for commit till [~kihwal] review

[jira] [Commented] (HDFS-12214) [SPS]: Fix review comments of StoragePolicySatisfier feature

2017-08-09 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119596#comment-16119596 ] Brahma Reddy Battula commented on HDFS-12214: - [~rakeshr] thanks for updating the patch.

[jira] [Commented] (HDFS-12066) When Namenode is in safemode,may not allowed to remove an user's erasure coding policy

2017-08-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119592#comment-16119592 ] Wei-Chiu Chuang commented on HDFS-12066: Looks good to me. Would it be feasible to add tests in

[jira] [Commented] (HDFS-12054) FSNamesystem#addECPolicies should call checkNameNodeSafeMode() to ensure Namenode is not in safemode

2017-08-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119590#comment-16119590 ] Wei-Chiu Chuang commented on HDFS-12054: Looks good to me. Would it be feasible to add tests in

[jira] [Commented] (HDFS-12250) Reduce usage of FsPermissionExtension in HDFS unit tests

2017-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119551#comment-16119551 ] Hadoop QA commented on HDFS-12250: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

  1   2   >