[jira] [Updated] (HDFS-11185) Ozone: Fix disabled tests

2017-06-08 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11185: Attachment: HDFS-11185-HDFS-7240.001.patch * Removed these 3 tests. * Removed the

[jira] [Updated] (HDFS-11185) Ozone: Fix disabled tests

2017-06-08 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11185: Status: Patch Available (was: Open) > Ozone: Fix disabled tests > - > >

[jira] [Commented] (HDFS-10480) Add an admin command to list currently open files

2017-06-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043906#comment-16043906 ] Hadoop QA commented on HDFS-10480: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11955) Ozone: Set proper parameter default values for listBuckets http request

2017-06-08 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043882#comment-16043882 ] Anu Engineer commented on HDFS-11955: - yes, it will be set to zero by default. You are right we need

[jira] [Commented] (HDFS-11955) Ozone: Set proper parameter default values for listBuckets http request

2017-06-08 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043881#comment-16043881 ] Weiwei Yang commented on HDFS-11955: Hi [~anu] Thanks for the quick response. I haven't tested this

[jira] [Commented] (HDFS-10999) Introduce separate stats for Replicated and Erasure Coded Blocks apart from the current Aggregated stats

2017-06-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043860#comment-16043860 ] Hadoop QA commented on HDFS-10999: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11782) Ozone: KSM: Add listKey

2017-06-08 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043859#comment-16043859 ] Anu Engineer commented on HDFS-11782: - [~linyiqun] if you are not actively working on this patch, can

[jira] [Commented] (HDFS-11955) Ozone: Set proper parameter default values for listBuckets http request

2017-06-08 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043855#comment-16043855 ] Anu Engineer commented on HDFS-11955: - I think we add defaults on the Rest handler on the server side

[jira] [Commented] (HDFS-11947) When constructing a thread name, BPOfferService may print a bogus warning message

2017-06-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043854#comment-16043854 ] Hadoop QA commented on HDFS-11947: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-11955) Ozone: Set proper parameter default values for listBuckets http request

2017-06-08 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-11955: -- Summary: Ozone: Set proper parameter default values for listBuckets http request Key: HDFS-11955 URL: https://issues.apache.org/jira/browse/HDFS-11955 Project: Hadoop

[jira] [Commented] (HDFS-11952) Ozone: Fix TestContainerSQLCli#testConvertContainerDB

2017-06-08 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043815#comment-16043815 ] Weiwei Yang commented on HDFS-11952: Thanks [~xyao] > Ozone: Fix

[jira] [Updated] (HDFS-10480) Add an admin command to list currently open files

2017-06-08 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-10480: -- Attachment: HDFS-10480.07.patch Thanks for the review comments [~andrew.wang]. Attached

[jira] [Comment Edited] (HDFS-10480) Add an admin command to list currently open files

2017-06-08 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043800#comment-16043800 ] Manoj Govindassamy edited comment on HDFS-10480 at 6/9/17 1:53 AM: ---

[jira] [Commented] (HDFS-11947) When constructing a thread name, BPOfferService may print a bogus warning message

2017-06-08 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043770#comment-16043770 ] Weiwei Yang commented on HDFS-11947: Hi [~hanishakoneru] That makes sense, thanks. I've fixed that in

[jira] [Updated] (HDFS-11947) When constructing a thread name, BPOfferService may print a bogus warning message

2017-06-08 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11947: --- Attachment: HDFS-11947.003.patch > When constructing a thread name, BPOfferService may print a bogus

[jira] [Updated] (HDFS-10999) Introduce separate stats for Replicated and Erasure Coded Blocks apart from the current Aggregated stats

2017-06-08 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-10999: -- Attachment: HDFS-10999.04.patch Thanks [~tasanuma0829] and [~andrew.wang] for the

[jira] [Updated] (HDFS-11943) Warn log frequently print to screen in doEncode function on AbstractNativeRawEncoder class

2017-06-08 Thread liaoyuxiangqin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liaoyuxiangqin updated HDFS-11943: -- Status: Patch Available (was: Open) > Warn log frequently print to screen in doEncode function

[jira] [Updated] (HDFS-11943) Warn log frequently print to screen in doEncode function on AbstractNativeRawEncoder class

2017-06-08 Thread liaoyuxiangqin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liaoyuxiangqin updated HDFS-11943: -- Status: Open (was: Patch Available) > Warn log frequently print to screen in doEncode function

[jira] [Commented] (HDFS-11804) KMS client needs retry logic

2017-06-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043596#comment-16043596 ] Hadoop QA commented on HDFS-11804: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11804) KMS client needs retry logic

2017-06-08 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043586#comment-16043586 ] Xiao Chen commented on HDFS-11804: -- Thanks [~shahrs87] for revving. I have some comments below: - Not

[jira] [Updated] (HDFS-11669) [SPS]: Add option in "setStoragePolicy" command to satisfy the policy.

2017-06-08 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11669: --- Status: Open (was: Patch Available) > [SPS]: Add option in "setStoragePolicy"

[jira] [Commented] (HDFS-11670) [SPS]: Add storagepolicy command to check the status of storage policy Satisfier

2017-06-08 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043536#comment-16043536 ] Uma Maheswara Rao G commented on HDFS-11670: HI [~surendrasingh], Thank you for updating the

[jira] [Commented] (HDFS-11945) Internal lease recovery may not be retried for a long time

2017-06-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043523#comment-16043523 ] Hudson commented on HDFS-11945: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11846 (See

[jira] [Updated] (HDFS-11945) Internal lease recovery may not be retried for a long time

2017-06-08 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11945: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.2

[jira] [Commented] (HDFS-11851) getGlobalJNIEnv() may deadlock if exception is thrown

2017-06-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043495#comment-16043495 ] Hudson commented on HDFS-11851: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11845 (See

[jira] [Updated] (HDFS-11851) getGlobalJNIEnv() may deadlock if exception is thrown

2017-06-08 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-11851: -- Resolution: Fixed Fix Version/s: 3.0.0-alpha4 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-06-08 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043450#comment-16043450 ] Andrew Wang commented on HDFS-11907: I would appreciate some diligence investigating the root cause of

[jira] [Commented] (HDFS-9807) Add an optional StorageID to writes

2017-06-08 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043443#comment-16043443 ] Chris Douglas commented on HDFS-9807: - bq. What is the expected behavior here? Not that. :) Looking

[jira] [Comment Edited] (HDFS-11861) ipc.Client.Connection#sendRpcRequest should log request name

2017-06-08 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043312#comment-16043312 ] John Zhuge edited comment on HDFS-11861 at 6/8/17 9:04 PM: --- Any IPC call without

[jira] [Updated] (HDFS-11954) WritableRpcEngine.Invocation#toString NPE on null parameters

2017-06-08 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-11954: -- Summary: WritableRpcEngine.Invocation#toString NPE on null parameters (was:

[jira] [Commented] (HDFS-11954) WritableRpcEngine.Invocation#toString should handle null parameters

2017-06-08 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043424#comment-16043424 ] John Zhuge commented on HDFS-11954: --- On branch-2,

[jira] [Commented] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-06-08 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043410#comment-16043410 ] Chen Liang commented on HDFS-11907: --- Thanks [~arpitagarwal] and [~andrew.wang] for the follow-up. Are

[jira] [Updated] (HDFS-11804) KMS client needs retry logic

2017-06-08 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-11804: -- Attachment: HDFS-11804-trunk-4.patch Uploading a new patch addressing all the comments and

[jira] [Commented] (HDFS-11941) Move dfsadmin triggerBlockReport and metaSave to debugadmin

2017-06-08 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043402#comment-16043402 ] Andrew Wang commented on HDFS-11941: Thanks for the comments Allen, Kihwal. Sounds like we shouldn't

[jira] [Updated] (HDFS-11804) KMS client needs retry logic

2017-06-08 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-11804: -- Status: Patch Available (was: Open) > KMS client needs retry logic >

[jira] [Updated] (HDFS-11954) WritableRpcEngine.Invocation#toString should handle null parameters

2017-06-08 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-11954: -- Target Version/s: 2.9.0, 2.8.2 (was: 2.9.0, 3.0.0-alpha4, 2.8.2) >

[jira] [Commented] (HDFS-11954) WritableRpcEngine.Invocation#toString should handle null parameters

2017-06-08 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043400#comment-16043400 ] John Zhuge commented on HDFS-11954: --- WriteableRPCEngine is deprecated in trunk, so won't fix in trunk.

[jira] [Commented] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-06-08 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043365#comment-16043365 ] Andrew Wang commented on HDFS-11907: I'm overall ambivalent to the {{df}} frequency, but I'd rather

[jira] [Updated] (HDFS-11953) Remove Guava v21 usage from HDFS-7240

2017-06-08 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11953: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Target

[jira] [Comment Edited] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-06-08 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043335#comment-16043335 ] Arpit Agarwal edited comment on HDFS-11907 at 6/8/17 8:10 PM: -- Hi

[jira] [Commented] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-06-08 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043335#comment-16043335 ] Arpit Agarwal commented on HDFS-11907: -- Hi [~andrew.wang], you are right that it's expected to be a

[jira] [Commented] (HDFS-11953) Remove Guava v21 usage from HDFS-7240

2017-06-08 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043326#comment-16043326 ] Xiaoyu Yao commented on HDFS-11953: --- There is a javac warning on Guava HostAndPort#getHostText(). I plan

[jira] [Commented] (HDFS-11861) ipc.Client.Connection#sendRpcRequest should log request name

2017-06-08 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043312#comment-16043312 ] John Zhuge commented on HDFS-11861: --- Any IPC call without parameter will leave {{parameters}} as null,

[jira] [Created] (HDFS-11954) WritableRpcEngine.Invocation#toString should handle null parameters

2017-06-08 Thread John Zhuge (JIRA)
John Zhuge created HDFS-11954: - Summary: WritableRpcEngine.Invocation#toString should handle null parameters Key: HDFS-11954 URL: https://issues.apache.org/jira/browse/HDFS-11954 Project: Hadoop HDFS

[jira] [Commented] (HDFS-11953) Remove Guava v21 usage from HDFS-7240

2017-06-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043285#comment-16043285 ] Hadoop QA commented on HDFS-11953: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11945) Internal lease recovery may not be retried for a long time

2017-06-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043281#comment-16043281 ] Hadoop QA commented on HDFS-11945: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11804) KMS client needs retry logic

2017-06-08 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-11804: -- Status: Open (was: Patch Available) Cancelling the patch to address [~daryn]'s comments. >

[jira] [Commented] (HDFS-11885) createEncryptionZone should not block on initializing EDEK cache

2017-06-08 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043213#comment-16043213 ] Xiao Chen commented on HDFS-11885: -- Thanks Daryn, good question. My understanding is mostly from

[jira] [Commented] (HDFS-11947) When constructing a thread name, BPOfferService may print a bogus warning message

2017-06-08 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043207#comment-16043207 ] Hanisha Koneru commented on HDFS-11947: --- In the following code, we are calling

[jira] [Commented] (HDFS-11736) OIV tests should not write outside 'target' directory.

2017-06-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043177#comment-16043177 ] Hadoop QA commented on HDFS-11736: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11885) createEncryptionZone should not block on initializing EDEK cache

2017-06-08 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043154#comment-16043154 ] Daryn Sharp commented on HDFS-11885: Question. Is this warmup code really necessary? Is there a

[jira] [Commented] (HDFS-11941) Move dfsadmin triggerBlockReport and metaSave to debugadmin

2017-06-08 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043165#comment-16043165 ] Kihwal Lee commented on HDFS-11941: --- {{recoverLease}} is not necessarily an admin command. It can be

[jira] [Commented] (HDFS-11950) Disable libhdfs zerocopy test on Mac

2017-06-08 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043162#comment-16043162 ] John Zhuge commented on HDFS-11950: --- The zerocopy unit test passes on Centos. Ok to convert this JIRA to

[jira] [Commented] (HDFS-11861) ipc.Client.Connection#sendRpcRequest should log request name

2017-06-08 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043127#comment-16043127 ] John Zhuge commented on HDFS-11861: --- Thanks for the report [~ebadger]. Reproduced the test failure on

[jira] [Commented] (HDFS-11953) Remove Guava v21 usage from HDFS-7240

2017-06-08 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043117#comment-16043117 ] Anu Engineer commented on HDFS-11953: - +1, this code is not called by anyone yet. So please go ahead

[jira] [Commented] (HDFS-11804) KMS client needs retry logic

2017-06-08 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043108#comment-16043108 ] Daryn Sharp commented on HDFS-11804: General issues: * Attempts are not actually attempts, but retries

[jira] [Commented] (HDFS-11797) BlockManager#createLocatedBlocks() can throw ArrayIndexOutofBoundsException when corrupt replicas are inconsistent

2017-06-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043089#comment-16043089 ] Wei-Chiu Chuang commented on HDFS-11797: Thanks Kuhu and Jing. Quickly reviewed the patch, it

[jira] [Updated] (HDFS-11945) Internal lease recovery may not be retried for a long time

2017-06-08 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-11945: -- Attachment: HDFS-11945.trunk.v2.patch HDFS-11945.branch-2.v2.patch Attaching updated

[jira] [Updated] (HDFS-11952) Ozone: Fix TestContainerSQLCli#testConvertContainerDB

2017-06-08 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11952: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Updated] (HDFS-11952) Ozone: Fix TestContainerSQLCli#testConvertContainerDB

2017-06-08 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11952: -- Summary: Ozone: Fix TestContainerSQLCli#testConvertContainerDB (was: Ozone: Fix regression

[jira] [Updated] (HDFS-11953) Remove Guava v21 usage from HDFS-7240

2017-06-08 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11953: -- Status: Patch Available (was: Open) > Remove Guava v21 usage from HDFS-7240 >

[jira] [Updated] (HDFS-11953) Remove Guava v21 usage from HDFS-7240

2017-06-08 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11953: -- Attachment: HDFS-11953-HDFS-7240.001.patch > Remove Guava v21 usage from HDFS-7240 >

[jira] [Updated] (HDFS-11953) Remove Guava v21 usage from HDFS-7240

2017-06-08 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11953: -- Description: Due to HADOOP-14386, Guava on trunk has been reverted back from v21 to v11.0.2. There are

[jira] [Created] (HDFS-11953) Remove Guava v21 usage from HDFS-7240

2017-06-08 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-11953: - Summary: Remove Guava v21 usage from HDFS-7240 Key: HDFS-11953 URL: https://issues.apache.org/jira/browse/HDFS-11953 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-11861) ipc.Client.Connection#sendRpcRequest should log request name

2017-06-08 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043021#comment-16043021 ] Xiao Chen commented on HDFS-11861: -- Thanks for the report [~ebadger]. [~jzhuge], would you be able to

[jira] [Commented] (HDFS-11952) Ozone: Fix regression TestContainerSQLCli#testConvertContainerDB

2017-06-08 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043014#comment-16043014 ] Xiaoyu Yao commented on HDFS-11952: --- Thanks [~cheersyang] for reporting the issue and posting the fix.

[jira] [Updated] (HDFS-11743) Revert the incompatible fsck reporting output in HDFS-7933 from branch-2.7

2017-06-08 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-11743: - Labels: (was: release-blocker) > Revert the incompatible fsck reporting output in HDFS-7933 from

[jira] [Commented] (HDFS-11797) BlockManager#createLocatedBlocks() can throw ArrayIndexOutofBoundsException when corrupt replicas are inconsistent

2017-06-08 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042960#comment-16042960 ] Daryn Sharp commented on HDFS-11797: A few months ago I knew at least one way the datastructures would

[jira] [Updated] (HDFS-11736) OIV tests should not write outside 'target' directory.

2017-06-08 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11736: - Target Version/s: 2.9.0, 2.7.4, 3.0.0-alpha4, 2.8.2 (was: 2.7.4) Update target versions since this

[jira] [Updated] (HDFS-11736) OIV tests should not write outside 'target' directory.

2017-06-08 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11736: - Status: Patch Available (was: Open) > OIV tests should not write outside 'target' directory. >

[jira] [Commented] (HDFS-11736) OIV tests should not write outside 'target' directory.

2017-06-08 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042943#comment-16042943 ] Yiqun Lin commented on HDFS-11736: -- Thanks [~shv] for reporting this. Good catch. It will be nice to fix

[jira] [Updated] (HDFS-11736) OIV tests should not write outside 'target' directory.

2017-06-08 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11736: - Attachment: HDFS-11736.001.patch > OIV tests should not write outside 'target' directory. >

[jira] [Assigned] (HDFS-11736) OIV tests should not write outside 'target' directory.

2017-06-08 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin reassigned HDFS-11736: Assignee: Yiqun Lin > OIV tests should not write outside 'target' directory. >

[jira] [Commented] (HDFS-11729) Improve NNStorageRetentionManager failure handling.

2017-06-08 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042904#comment-16042904 ] Weiwei Yang commented on HDFS-11729: This approach doesn't work, it seems we can't let retention

[jira] [Commented] (HDFS-11952) Ozone: Fix regression TestContainerSQLCli#testConvertContainerDB

2017-06-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042861#comment-16042861 ] Hadoop QA commented on HDFS-11952: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11861) ipc.Client.Connection#sendRpcRequest should log request name

2017-06-08 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042837#comment-16042837 ] Eric Badger commented on HDFS-11861: [~jzhuge], [~xiaochen], this commit has broken the following

[jira] [Commented] (HDFS-11941) Move dfsadmin triggerBlockReport and metaSave to debugadmin

2017-06-08 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042828#comment-16042828 ] Allen Wittenauer commented on HDFS-11941: - metasave is absolutely critical when the on-disk copy

[jira] [Commented] (HDFS-11947) When constructing a thread name, BPOfferService may print a bogus warning message

2017-06-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042829#comment-16042829 ] Hadoop QA commented on HDFS-11947: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11950) Disable libhdfs zerocopy test on Mac

2017-06-08 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042799#comment-16042799 ] Allen Wittenauer commented on HDFS-11950: - Does zerocopy actually work anywhere else other than

[jira] [Commented] (HDFS-11952) Ozone: Fix regression TestContainerSQLCli#testConvertContainerDB

2017-06-08 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042732#comment-16042732 ] Weiwei Yang commented on HDFS-11952: This regression seems to be caused by the changes to

[jira] [Commented] (HDFS-11797) BlockManager#createLocatedBlocks() can throw ArrayIndexOutofBoundsException when corrupt replicas are inconsistent

2017-06-08 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042731#comment-16042731 ] Kuhu Shukla commented on HDFS-11797: The symptoms match exactly. Thanks [~jingzhao]. Will wait for

[jira] [Updated] (HDFS-11952) Ozone: Fix regression TestContainerSQLCli#testConvertContainerDB

2017-06-08 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11952: --- Attachment: HDFS-11952-HDFS-7240.001.patch > Ozone: Fix regression

[jira] [Updated] (HDFS-11952) Ozone: Fix regression TestContainerSQLCli#testConvertContainerDB

2017-06-08 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11952: --- Status: Patch Available (was: Open) > Ozone: Fix regression

[jira] [Created] (HDFS-11952) Ozone: Fix regression TestContainerSQLCli#testConvertContainerDB

2017-06-08 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-11952: -- Summary: Ozone: Fix regression TestContainerSQLCli#testConvertContainerDB Key: HDFS-11952 URL: https://issues.apache.org/jira/browse/HDFS-11952 Project: Hadoop HDFS

[jira] [Commented] (HDFS-11947) When constructing a thread name, BPOfferService may print a bogus warning message

2017-06-08 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042651#comment-16042651 ] Weiwei Yang commented on HDFS-11947: Thanks [~szetszwo]. Uploaded v2 patch to fix checkstyle issues.

[jira] [Updated] (HDFS-11947) When constructing a thread name, BPOfferService may print a bogus warning message

2017-06-08 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11947: --- Attachment: HDFS-11947.002.patch > When constructing a thread name, BPOfferService may print a bogus

[jira] [Commented] (HDFS-11947) When constructing a thread name, BPOfferService may print a bogus warning message

2017-06-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042554#comment-16042554 ] Hadoop QA commented on HDFS-11947: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11729) Improve NNStorageRetentionManager failure handling.

2017-06-08 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11729: --- Status: In Progress (was: Patch Available) > Improve NNStorageRetentionManager failure handling. >

[jira] [Updated] (HDFS-11947) When constructing a thread name, BPOfferService may print a bogus warning message

2017-06-08 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-11947: --- Hadoop Flags: Reviewed +1 patch looks good. Thanks for the quick response! > When

[jira] [Comment Edited] (HDFS-11951) Ozone: Handle potential inconsistent states while listing keys

2017-06-08 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042506#comment-16042506 ] Weiwei Yang edited comment on HDFS-11951 at 6/8/17 10:13 AM: - Hi [~linyiqun]

[jira] [Commented] (HDFS-11951) Ozone: Handle potential inconsistent states while listing keys

2017-06-08 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042506#comment-16042506 ] Weiwei Yang commented on HDFS-11951: Hi [~linyiqun] I think if it all happens on server side, this

[jira] [Commented] (HDFS-11951) Ozone: Handle potential inconsistent states while listing keys

2017-06-08 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042478#comment-16042478 ] Yiqun Lin commented on HDFS-11951: -- [~cheersyang], I am thinking this corner case will not be happen

[jira] [Comment Edited] (HDFS-11951) Ozone: Handle potential inconsistent states while listing keys

2017-06-08 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042478#comment-16042478 ] Yiqun Lin edited comment on HDFS-11951 at 6/8/17 9:54 AM: -- [~cheersyang], I am

[jira] [Commented] (HDFS-11779) Ozone: KSM: add listBuckets

2017-06-08 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042475#comment-16042475 ] Weiwei Yang commented on HDFS-11779: Committed to the feature branch. Thanks [~anu], [~xyao],

[jira] [Updated] (HDFS-11779) Ozone: KSM: add listBuckets

2017-06-08 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11779: --- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) >

[jira] [Updated] (HDFS-11779) Ozone: KSM: add listBuckets

2017-06-08 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11779: --- Target Version/s: HDFS-7240 Fix Version/s: HDFS-7240 > Ozone: KSM: add listBuckets >

[jira] [Updated] (HDFS-11947) When constructing a thread name, BPOfferService may print a bogus warning message

2017-06-08 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11947: --- Status: Patch Available (was: Open) > When constructing a thread name, BPOfferService may print a

[jira] [Comment Edited] (HDFS-11947) When constructing a thread name, BPOfferService may print a bogus warning message

2017-06-08 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042460#comment-16042460 ] Weiwei Yang edited comment on HDFS-11947 at 6/8/17 9:35 AM: I could easily

[jira] [Updated] (HDFS-11947) When constructing a thread name, BPOfferService may print a bogus warning message

2017-06-08 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11947: --- Attachment: HDFS-11947.001.patch > When constructing a thread name, BPOfferService may print a bogus

[jira] [Commented] (HDFS-11947) When constructing a thread name, BPOfferService may print a bogus warning message

2017-06-08 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042460#comment-16042460 ] Weiwei Yang commented on HDFS-11947: I could easily reproduce this {code} Configuration conf = new

  1   2   >