[jira] [Commented] (HDFS-11851) getGlobalJNIEnv() may deadlock if exception is thrown

2017-05-25 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025830#comment-16025830 ] John Zhuge commented on HDFS-11851: --- Thanks for adding the unit test. Discovered the patch didn't

[jira] [Commented] (HDFS-11772) Ozone: KSM: Add getVolumeInfo

2017-05-25 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025827#comment-16025827 ] Xiaoyu Yao commented on HDFS-11772: --- This one has been partially implemented in setVolumeProperty. This

[jira] [Commented] (HDFS-6984) In Hadoop 3, make FileStatus serialize itself via protobuf

2017-05-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025822#comment-16025822 ] Hadoop QA commented on HDFS-6984: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11780) Ozone: KSM : Add putKey

2017-05-25 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11780: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Target

[jira] [Commented] (HDFS-11856) Ability to re-add Upgrading Nodes (remote) to pipeline for future pipeline updates

2017-05-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025806#comment-16025806 ] Hadoop QA commented on HDFS-11856: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11780) Ozone: KSM : Add putKey

2017-05-25 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025803#comment-16025803 ] Xiaoyu Yao commented on HDFS-11780: --- I opened HDFS-11888 to track the fix for setting containerCreation

[jira] [Created] (HDFS-11888) Ozone: SCM: allocateBlcok does not set the creationFlag correctly when the open container pool size is greater than 1

2017-05-25 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-11888: - Summary: Ozone: SCM: allocateBlcok does not set the creationFlag correctly when the open container pool size is greater than 1 Key: HDFS-11888 URL:

[jira] [Commented] (HDFS-11780) Ozone: KSM : Add putKey

2017-05-25 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025794#comment-16025794 ] Xiaoyu Yao commented on HDFS-11780: --- Thanks [~vagarychen] for the update. The patch v8 looks good to me.

[jira] [Updated] (HDFS-11856) Ability to re-add Upgrading Nodes (remote) to pipeline for future pipeline updates

2017-05-25 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-11856: - Attachment: HDFS-11856-branch-2.8-02.patch patch for branch-2.8 > Ability to re-add Upgrading

[jira] [Updated] (HDFS-11856) Ability to re-add Upgrading Nodes (remote) to pipeline for future pipeline updates

2017-05-25 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-11856: - Attachment: HDFS-11856-branch-2-02.patch Attaching patch for branch-2. Others will attach soon.

[jira] [Commented] (HDFS-11741) Long running balancer may fail due to expired DataEncryptionKey

2017-05-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025781#comment-16025781 ] Hadoop QA commented on HDFS-11741: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (HDFS-11421) Make WebHDFS' ACLs RegEx configurable

2017-05-25 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen resolved HDFS-11421. -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Committed to branch-2, thanks

[jira] [Commented] (HDFS-11421) Make WebHDFS' ACLs RegEx configurable

2017-05-25 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025776#comment-16025776 ] Xiao Chen commented on HDFS-11421: -- As you said and another >80 char regex string. Committing shortly. >

[jira] [Updated] (HDFS-11779) Ozone: KSM: add listBuckets

2017-05-25 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11779: --- Attachment: HDFS-11779-HDFS-7240.004.patch Some minor fixes to v3 patch. > Ozone: KSM: add

[jira] [Commented] (HDFS-11779) Ozone: KSM: add listBuckets

2017-05-25 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025774#comment-16025774 ] Weiwei Yang commented on HDFS-11779: Hi [~linyiqun] Thank you for reviewing the patch, looking

[jira] [Commented] (HDFS-11883) [SPS] : Handle NPE in BlockStorageMovementTracker when dropSPSWork() called

2017-05-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025758#comment-16025758 ] Hadoop QA commented on HDFS-11883: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11383) String duplication in org.apache.hadoop.fs.BlockLocation

2017-05-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025757#comment-16025757 ] Hadoop QA commented on HDFS-11383: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11779) Ozone: KSM: add listBuckets

2017-05-25 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11779: --- Attachment: HDFS-11779-HDFS-7240.003.patch > Ozone: KSM: add listBuckets >

[jira] [Commented] (HDFS-11883) [SPS] : Handle NPE in BlockStorageMovementTracker when dropSPSWork() called

2017-05-25 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025729#comment-16025729 ] Surendra Singh Lilhore commented on HDFS-11883: --- Corrected patch name for HDFS-10285

[jira] [Updated] (HDFS-11883) [SPS] : Handle NPE in BlockStorageMovementTracker when dropSPSWork() called

2017-05-25 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-11883: -- Attachment: HDFS-11883-HDFS-10285.001.patch > [SPS] : Handle NPE in

[jira] [Created] (HDFS-11887) XceiverClientManager should close XceiverClient on eviction from cache

2017-05-25 Thread Mukul Kumar Singh (JIRA)
Mukul Kumar Singh created HDFS-11887: Summary: XceiverClientManager should close XceiverClient on eviction from cache Key: HDFS-11887 URL: https://issues.apache.org/jira/browse/HDFS-11887

[jira] [Updated] (HDFS-6984) In Hadoop 3, make FileStatus serialize itself via protobuf

2017-05-25 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-6984: Attachment: HDFS-6984.012.patch * Added more tests * Removed {{FlaggedFileStatus}} class to preserve

[jira] [Commented] (HDFS-11779) Ozone: KSM: add listBuckets

2017-05-25 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025689#comment-16025689 ] Yiqun Lin commented on HDFS-11779: -- Thanks [~cheersyang] for working on this. I just take a quick look

[jira] [Commented] (HDFS-11780) Ozone: KSM : Add putKey

2017-05-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025650#comment-16025650 ] Hadoop QA commented on HDFS-11780: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11780) Ozone: KSM : Add putKey

2017-05-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025626#comment-16025626 ] Hadoop QA commented on HDFS-11780: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-11741) Long running balancer may fail due to expired DataEncryptionKey

2017-05-25 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025607#comment-16025607 ] Wei-Chiu Chuang edited comment on HDFS-11741 at 5/26/17 12:34 AM: --

[jira] [Updated] (HDFS-11741) Long running balancer may fail due to expired DataEncryptionKey

2017-05-25 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11741: --- Attachment: HDFS-11741.005.patch Attached rev 005 patch. I removed the change in Dispatcher,

[jira] [Commented] (HDFS-11383) String duplication in org.apache.hadoop.fs.BlockLocation

2017-05-25 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025591#comment-16025591 ] Misha Dmitriev commented on HDFS-11383: --- Here is an excerpt from another jxray report, obtained from

[jira] [Commented] (HDFS-11741) Long running balancer may fail due to expired DataEncryptionKey

2017-05-25 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025577#comment-16025577 ] Wei-Chiu Chuang commented on HDFS-11741: !block keys.png! Assuming a block key is generated at

[jira] [Updated] (HDFS-11741) Long running balancer may fail due to expired DataEncryptionKey

2017-05-25 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11741: --- Attachment: block keys.png > Long running balancer may fail due to expired DataEncryptionKey

[jira] [Updated] (HDFS-11383) String duplication in org.apache.hadoop.fs.BlockLocation

2017-05-25 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misha Dmitriev updated HDFS-11383: -- Status: Patch Available (was: In Progress) > String duplication in

[jira] [Updated] (HDFS-11383) String duplication in org.apache.hadoop.fs.BlockLocation

2017-05-25 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misha Dmitriev updated HDFS-11383: -- Attachment: HDFS-11383.02.patch > String duplication in org.apache.hadoop.fs.BlockLocation >

[jira] [Updated] (HDFS-11383) String duplication in org.apache.hadoop.fs.BlockLocation

2017-05-25 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misha Dmitriev updated HDFS-11383: -- Status: In Progress (was: Patch Available) > String duplication in

[jira] [Updated] (HDFS-11886) Ozone : improve error handling for putkey operation

2017-05-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11886: -- Summary: Ozone : improve error handling for putkey operation (was: Ozone : improving error handling

[jira] [Commented] (HDFS-11421) Make WebHDFS' ACLs RegEx configurable

2017-05-25 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025565#comment-16025565 ] Harsh J commented on HDFS-11421: The patch looks good to me. Were the style changes done out of checkstyle

[jira] [Updated] (HDFS-11780) Ozone: KSM : Add putKey

2017-05-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11780: -- Attachment: HDFS-11780-HDFS-7240.008.patch Thanks [~xyao] for the comments! post v008 patch. Also filed

[jira] [Updated] (HDFS-11886) Ozone : improving error handling for putkey operation

2017-05-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11886: -- Description: Ozone's putKey operations involve a couple steps: 1. KSM calls allocateBlock to SCM,

[jira] [Commented] (HDFS-11865) Ozone: Do not initialize Ratis cluster during datanode startup

2017-05-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025546#comment-16025546 ] Hadoop QA commented on HDFS-11865: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11817) A faulty node can cause a lease leak and NPE on accessing data

2017-05-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025525#comment-16025525 ] Hudson commented on HDFS-11817: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11785 (See

[jira] [Created] (HDFS-11886) Ozone : improving error handling for putkey operation

2017-05-25 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11886: - Summary: Ozone : improving error handling for putkey operation Key: HDFS-11886 URL: https://issues.apache.org/jira/browse/HDFS-11886 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-11879) Fix JN sync interval in case of exception

2017-05-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025500#comment-16025500 ] Hudson commented on HDFS-11879: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11784 (See

[jira] [Updated] (HDFS-11817) A faulty node can cause a lease leak and NPE on accessing data

2017-05-25 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-11817: -- Attachment: HDFS-11817.v2.branch-2.8.patch Attaching what's committed to 2.8 as reference. The

[jira] [Commented] (HDFS-11780) Ozone: KSM : Add putKey

2017-05-25 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025498#comment-16025498 ] Xiaoyu Yao commented on HDFS-11780: --- Thanks [~vagarychen] for the update. The patch v6 looks pretty good

[jira] [Updated] (HDFS-11817) A faulty node can cause a lease leak and NPE on accessing data

2017-05-25 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-11817: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.2

[jira] [Commented] (HDFS-11851) getGlobalJNIEnv() may deadlock if exception is thrown

2017-05-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025493#comment-16025493 ] Hadoop QA commented on HDFS-11851: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11780) Ozone: KSM : Add putKey

2017-05-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11780: -- Attachment: HDFS-11780-HDFS-7240.007.patch Earlier patches were passing the wrong first argument to

[jira] [Commented] (HDFS-11817) A faulty node can cause a lease leak and NPE on accessing data

2017-05-25 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025471#comment-16025471 ] Daryn Sharp commented on HDFS-11817: +1 I would be nice if this recovery code was cleaned up someday,

[jira] [Commented] (HDFS-11779) Ozone: KSM: add listBuckets

2017-05-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025461#comment-16025461 ] Hadoop QA commented on HDFS-11779: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11865) Ozone: Do not initialize Ratis cluster during datanode startup

2017-05-25 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025422#comment-16025422 ] Xiaoyu Yao commented on HDFS-11865: --- Thanks [~szetszwo] for the update. +1 for the latest patch pending

[jira] [Updated] (HDFS-11865) Ozone: Do not initialize Ratis cluster during datanode startup

2017-05-25 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-11865: --- Attachment: HDFS-11865-HDFS-7240.20170525.patch Thanks Xiaoyu. Here is a new patch:

[jira] [Updated] (HDFS-11879) Fix JN sync interval in case of exception

2017-05-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11879: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3

[jira] [Commented] (HDFS-11879) Fix JN sync interval in case of exception

2017-05-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025374#comment-16025374 ] Hadoop QA commented on HDFS-11879: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11851) getGlobalJNIEnv() may deadlock if exception is thrown

2017-05-25 Thread Sailesh Mukil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025367#comment-16025367 ] Sailesh Mukil commented on HDFS-11851: -- [~jzhuge] Thanks. I've just submitted a patch that does that.

[jira] [Updated] (HDFS-11851) getGlobalJNIEnv() may deadlock if exception is thrown

2017-05-25 Thread Sailesh Mukil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sailesh Mukil updated HDFS-11851: - Attachment: HDFS-11851.002.patch > getGlobalJNIEnv() may deadlock if exception is thrown >

[jira] [Updated] (HDFS-11851) getGlobalJNIEnv() may deadlock if exception is thrown

2017-05-25 Thread Sailesh Mukil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sailesh Mukil updated HDFS-11851: - Status: Patch Available (was: Open) > getGlobalJNIEnv() may deadlock if exception is thrown >

[jira] [Updated] (HDFS-11851) getGlobalJNIEnv() may deadlock if exception is thrown

2017-05-25 Thread Sailesh Mukil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sailesh Mukil updated HDFS-11851: - Status: Open (was: Patch Available) > getGlobalJNIEnv() may deadlock if exception is thrown >

[jira] [Commented] (HDFS-11879) Fix JN sync interval in case of exception

2017-05-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025344#comment-16025344 ] Arpit Agarwal commented on HDFS-11879: -- +1 pending Jenkins. > Fix JN sync interval in case of

[jira] [Commented] (HDFS-11780) Ozone: KSM : Add putKey

2017-05-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025324#comment-16025324 ] Hadoop QA commented on HDFS-11780: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11682) TestBalancer#testBalancerWithStripedFile is flaky

2017-05-25 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025306#comment-16025306 ] Lei (Eddy) Xu commented on HDFS-11682: -- [~manojg], I should make it clearer, the problem is that

[jira] [Commented] (HDFS-11851) getGlobalJNIEnv() may deadlock if exception is thrown

2017-05-25 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025291#comment-16025291 ] John Zhuge commented on HDFS-11851: --- Sounds good. Simple unit tests to ensure {{printExceptionAndFree}}

[jira] [Updated] (HDFS-11780) Ozone: KSM : Add putKey

2017-05-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11780: -- Attachment: HDFS-11780-HDFS-7240.006.patch Post v006 patch fixing spacing in the .proto file > Ozone:

[jira] [Updated] (HDFS-11780) Ozone: KSM : Add putKey

2017-05-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11780: -- Attachment: (was: HDFS-11780-HDFS-7240.005.patch) > Ozone: KSM : Add putKey >

[jira] [Updated] (HDFS-11780) Ozone: KSM : Add putKey

2017-05-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11780: -- Attachment: HDFS-11780-HDFS-7240.005.patch > Ozone: KSM : Add putKey > --- > >

[jira] [Commented] (HDFS-11779) Ozone: KSM: add listBuckets

2017-05-25 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025265#comment-16025265 ] Weiwei Yang commented on HDFS-11779: V2 patch attached, addressed [~nandakumar131]'s comments and

[jira] [Updated] (HDFS-11780) Ozone: KSM : Add putKey

2017-05-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11780: -- Attachment: HDFS-11780-HDFS-7240.005.patch Update v005 patch based on the comments from Weiwei. >

[jira] [Updated] (HDFS-11779) Ozone: KSM: add listBuckets

2017-05-25 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11779: --- Attachment: HDFS-11779-HDFS-7240.002.patch > Ozone: KSM: add listBuckets >

[jira] [Commented] (HDFS-11780) Ozone: KSM : Add putKey

2017-05-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025228#comment-16025228 ] Chen Liang commented on HDFS-11780: --- Thanks [~cheersyang] for the comments! bq. why KsmKeyBlock has

[jira] [Commented] (HDFS-11659) TestDataNodeHotSwapVolumes.testRemoveVolumeBeingWritten fail due to no DataNode available for pipeline recovery.

2017-05-25 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025208#comment-16025208 ] Wei-Chiu Chuang commented on HDFS-11659: Discussed with [~eddyxu], the concurrent write may be

[jira] [Commented] (HDFS-11682) TestBalancer#testBalancerWithStripedFile is flaky

2017-05-25 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025201#comment-16025201 ] Manoj Govindassamy commented on HDFS-11682: --- [~eddyxu], {noformat} static void

[jira] [Commented] (HDFS-11878) Fix journal missing log httpServerUrl address in JournalNodeSyncer

2017-05-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025193#comment-16025193 ] Hudson commented on HDFS-11878: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11783 (See

[jira] [Commented] (HDFS-11856) Ability to re-add Upgrading Nodes (remote) to pipeline for future pipeline updates

2017-05-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025194#comment-16025194 ] Hudson commented on HDFS-11856: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11783 (See

[jira] [Commented] (HDFS-11779) Ozone: KSM: add listBuckets

2017-05-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025170#comment-16025170 ] Hadoop QA commented on HDFS-11779: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11780) Ozone: KSM : Add putKey

2017-05-25 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025165#comment-16025165 ] Weiwei Yang commented on HDFS-11780: Hi [~vagarychen] Apart from [~xyao]'s comment, I am wondering

[jira] [Commented] (HDFS-11883) [SPS] : Handle NPE in BlockStorageMovementTracker when dropSPSWork() called

2017-05-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025163#comment-16025163 ] Hadoop QA commented on HDFS-11883: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11779) Ozone: KSM: add listBuckets

2017-05-25 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025152#comment-16025152 ] Nandakumar commented on HDFS-11779: --- Thanks [~cheersyang] for the quick update. The problem is that we

[jira] [Updated] (HDFS-11879) Fix JN sync interval in case of exception

2017-05-25 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-11879: -- Status: Patch Available (was: Open) > Fix JN sync interval in case of exception >

[jira] [Updated] (HDFS-11879) Fix JN sync interval in case of exception

2017-05-25 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-11879: -- Attachment: HDFS-11879.001.patch > Fix JN sync interval in case of exception >

[jira] [Commented] (HDFS-11779) Ozone: KSM: add listBuckets

2017-05-25 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025138#comment-16025138 ] Weiwei Yang commented on HDFS-11779: Hi [~nandakumar131] Thanks for reviewing this. I agree with your

[jira] [Commented] (HDFS-11856) Ability to re-add Upgrading Nodes (remote) to pipeline for future pipeline updates

2017-05-25 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025137#comment-16025137 ] Kihwal Lee commented on HDFS-11856: --- Please provide patch for branch-2 and others. > Ability to re-add

[jira] [Commented] (HDFS-11878) Fix journal missing log httpServerUrl address in JournalNodeSyncer

2017-05-25 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025136#comment-16025136 ] Hanisha Koneru commented on HDFS-11878: --- Thanks for committing the patch, [~arpitagarwal] > Fix

[jira] [Issue Comment Deleted] (HDFS-11488) Fix failure of TestDataNodeVolumeFailureReporting#testVolFailureStatsPreservedOnNNRestart

2017-05-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11488: - Comment: was deleted (was: SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11682 (See

[jira] [Issue Comment Deleted] (HDFS-11488) Fix failure of TestDataNodeVolumeFailureReporting#testVolFailureStatsPreservedOnNNRestart

2017-05-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11488: - Comment: was deleted (was: SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11681 (See

[jira] [Commented] (HDFS-11856) Ability to re-add Upgrading Nodes (remote) to pipeline for future pipeline updates

2017-05-25 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025132#comment-16025132 ] Kihwal Lee commented on HDFS-11856: --- +1 the patch looks good. > Ability to re-add Upgrading Nodes

[jira] [Commented] (HDFS-11776) Ozone: KSM: add SetBucketProperty

2017-05-25 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025120#comment-16025120 ] Weiwei Yang commented on HDFS-11776: Hi [~nandakumar131] I too agree with [~vagarychen]'s comment,

[jira] [Commented] (HDFS-11779) Ozone: KSM: add listBuckets

2017-05-25 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025121#comment-16025121 ] Nandakumar commented on HDFS-11779: --- Thanks [~cheersyang] for working on this. Please find my comments

[jira] [Updated] (HDFS-11780) Ozone: KSM : Add putKey

2017-05-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11780: -- Attachment: HDFS-11780-HDFS-7240.004.patch Thanks [~xyao] for the comments as well as the offline

[jira] [Updated] (HDFS-11878) Fix journal missing log httpServerUrl address in JournalNodeSyncer

2017-05-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11878: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3

[jira] [Created] (HDFS-11885) createEncryptionZone should not block on initializing EDEK cache

2017-05-25 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-11885: -- Summary: createEncryptionZone should not block on initializing EDEK cache Key: HDFS-11885 URL: https://issues.apache.org/jira/browse/HDFS-11885 Project: Hadoop HDFS

[jira] [Updated] (HDFS-11883) [SPS] : Handle NPE in BlockStorageMovementTracker when dropSPSWork() called

2017-05-25 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-11883: -- Status: Patch Available (was: Open) > [SPS] : Handle NPE in

[jira] [Updated] (HDFS-11883) [SPS] : Handle NPE in BlockStorageMovementTracker when dropSPSWork() called

2017-05-25 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-11883: -- Attachment: HDFS-11883.001.patch Attached initial patch.. Please review... >

[jira] [Commented] (HDFS-11852) Under-repicated block never completes because of failure in commitBlockSynchronization()

2017-05-25 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025029#comment-16025029 ] Ravi Prakash commented on HDFS-11852: - Thank you for the pointer Kihwal! In our case, the only

[jira] [Commented] (HDFS-11779) Ozone: KSM: add listBuckets

2017-05-25 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16024972#comment-16024972 ] Weiwei Yang commented on HDFS-11779: V1 patch attached, please kindly review. Some notes for reviewers

[jira] [Updated] (HDFS-11779) Ozone: KSM: add listBuckets

2017-05-25 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11779: --- Status: Patch Available (was: Open) > Ozone: KSM: add listBuckets > --- > >

[jira] [Updated] (HDFS-11779) Ozone: KSM: add listBuckets

2017-05-25 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11779: --- Attachment: HDFS-11779-HDFS-7240.001.patch > Ozone: KSM: add listBuckets >

[jira] [Updated] (HDFS-11779) Ozone: KSM: add listBuckets

2017-05-25 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11779: --- Attachment: (was: HDFS-11779-HDFS-7240.001.patch) > Ozone: KSM: add listBuckets >

[jira] [Updated] (HDFS-11868) Backport HDFS-8674 to branch 2.7

2017-05-25 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11868: --- Status: In Progress (was: Patch Available) > Backport HDFS-8674 to branch 2.7 >

[jira] [Updated] (HDFS-11868) Backport HDFS-8674 to branch 2.7

2017-05-25 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11868: --- Status: Patch Available (was: In Progress) > Backport HDFS-8674 to branch 2.7 >

[jira] [Updated] (HDFS-11779) Ozone: KSM: add listBuckets

2017-05-25 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11779: --- Attachment: HDFS-11779-HDFS-7240.001.patch > Ozone: KSM: add listBuckets >

[jira] [Created] (HDFS-11884) libhdfs++: Make use of socket wrappers consistent

2017-05-25 Thread James Clampffer (JIRA)
James Clampffer created HDFS-11884: -- Summary: libhdfs++: Make use of socket wrappers consistent Key: HDFS-11884 URL: https://issues.apache.org/jira/browse/HDFS-11884 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-11852) Under-repicated block never completes because of failure in commitBlockSynchronization()

2017-05-25 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HDFS-11852. --- Resolution: Duplicate > Under-repicated block never completes because of failure in >

  1   2   >