[jira] [Commented] (HDFS-10757) KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used

2016-08-17 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425923#comment-15425923 ] Xiao Chen commented on HDFS-10757: -- Thanks for the comments. I'm open to changes on how the cache is

[jira] [Commented] (HDFS-3745) fsck prints that it's using KSSL even when it's in fact using SPNEGO for authentication

2016-08-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425878#comment-15425878 ] Hadoop QA commented on HDFS-3745: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-8312) Trash does not descent into child directories to check for permissions

2016-08-17 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-8312: -- Attachment: HDFS-8312-004.patch > Trash does not descent into child directories to check for permissions

[jira] [Commented] (HDFS-8312) Trash does not descent into child directories to check for permissions

2016-08-17 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425874#comment-15425874 ] Weiwei Yang commented on HDFS-8312: --- You are correct, I just found that after I enable trash in

[jira] [Commented] (HDFS-8312) Trash does not descent into child directories to check for permissions

2016-08-17 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425863#comment-15425863 ] Eric Yang commented on HDFS-8312: - TestDFSPermission test case seems to be failing. WeiWei could you take

[jira] [Commented] (HDFS-10769) BlockIdManager.clear doesn't reset the counter for blockGroupIdGenerator

2016-08-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425852#comment-15425852 ] Hadoop QA commented on HDFS-10769: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8520) Patch for PPC64 block size

2016-08-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425851#comment-15425851 ] Hadoop QA commented on HDFS-8520: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10645) Make block report size as a metric and add this metric to datanode web ui

2016-08-17 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425827#comment-15425827 ] Yuanbo Liu commented on HDFS-10645: --- [~ajisakaa] Thanks for your review. I've tested the failures

[jira] [Commented] (HDFS-10549) Correctly revoke file leases when closing files

2016-08-17 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425809#comment-15425809 ] Yiqun Lin commented on HDFS-10549: -- Thanks a lot for the commit, Xiao! > Correctly revoke file leases

[jira] [Updated] (HDFS-10769) BlockIdManager.clear doesn't reset the counter for blockGroupIdGenerator

2016-08-17 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10769: - Status: Patch Available (was: Open) > BlockIdManager.clear doesn't reset the counter for

[jira] [Updated] (HDFS-10769) BlockIdManager.clear doesn't reset the counter for blockGroupIdGenerator

2016-08-17 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10769: - Attachment: HDFS-10769.001.patch > BlockIdManager.clear doesn't reset the counter for

[jira] [Commented] (HDFS-10769) BlockIdManager.clear doesn't reset the counter for blockGroupIdGenerator

2016-08-17 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425783#comment-15425783 ] Yiqun Lin commented on HDFS-10769: -- Thanks [~ehiggs] for reporting this. I think this is a bug for here.

[jira] [Commented] (HDFS-10285) Storage Policy Satisfier in Namenode

2016-08-17 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425781#comment-15425781 ] Uma Maheswara Rao G commented on HDFS-10285: I have created a branch for this. Let's use

[jira] [Assigned] (HDFS-10769) BlockIdManager.clear doesn't reset the counter for blockGroupIdGenerator

2016-08-17 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin reassigned HDFS-10769: Assignee: Yiqun Lin > BlockIdManager.clear doesn't reset the counter for blockGroupIdGenerator >

[jira] [Commented] (HDFS-9500) datanodesSoftwareVersions map may counting wrong when rolling upgrade

2016-08-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425757#comment-15425757 ] Hadoop QA commented on HDFS-9500: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10495) Block should be marked as missing if the all the replicas are on Decommissioned nodes.

2016-08-17 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-10495: --- Target Version/s: 2.8.0, 2.6.5, 2.7.4 (was: 2.8.0, 2.7.3, 2.6.5) 2.7.3 is

[jira] [Updated] (HDFS-8870) Lease is leaked on write failure

2016-08-17 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-8870: -- Target Version/s: 2.6.5, 2.7.4 (was: 2.7.3, 2.6.5) 2.7.3 is under release

[jira] [Updated] (HDFS-9500) datanodesSoftwareVersions map may counting wrong when rolling upgrade

2016-08-17 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-9500: -- Target Version/s: 2.6.5, 2.7.4 (was: 2.7.3, 2.6.5) 2.7.3 is under release

[jira] [Updated] (HDFS-9678) Standby NN sometimes does not clear needRollbackFsImage

2016-08-17 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-9678: -- Target Version/s: 2.7.4 (was: 2.7.3) 2.7.3 is under release process, changing

[jira] [Updated] (HDFS-8520) Patch for PPC64 block size

2016-08-17 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-8520: -- Target Version/s: 2.7.4 (was: 2.7.3) 2.7.3 is under release process, changing

[jira] [Updated] (HDFS-9038) DFS reserved space is erroneously counted towards non-DFS used.

2016-08-17 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-9038: -- Target Version/s: 2.7.4 (was: 2.7.3) 2.7.3 is under release process, changing

[jira] [Updated] (HDFS-3745) fsck prints that it's using KSSL even when it's in fact using SPNEGO for authentication

2016-08-17 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-3745: -- Target Version/s: 2.7.4 (was: 2.7.3) 2.7.3 is under release process, changing

[jira] [Updated] (HDFS-10348) Namenode report bad block method doesn't check whether the block belongs to datanode before adding it to corrupt replicas map.

2016-08-17 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-10348: --- Target Version/s: 2.7.4 (was: 2.7.3) 2.7.3 is under release process,

[jira] [Updated] (HDFS-10627) Volume Scanner mark a block as "suspect" even if the block sender encounters 'Broken pipe' or 'Connection reset by peer' exception

2016-08-17 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-10627: --- Target Version/s: 2.7.4 (was: 2.7.3) 2.7.3 is under release process,

[jira] [Updated] (HDFS-10326) Disable setting tcp socket send/receive buffers for write pipelines

2016-08-17 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-10326: --- Target Version/s: 2.7.4 (was: 2.7.3) 2.7.3 is under release process,

[jira] [Updated] (HDFS-8869) Don't mark storages as failed before first block report

2016-08-17 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-8869: -- Target Version/s: 2.7.4 (was: 2.7.3) 2.7.3 is under release process, changing

[jira] [Updated] (HDFS-8675) IBRs from dead DNs go into infinite loop

2016-08-17 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-8675: -- Target Version/s: 2.7.4 (was: 2.7.3) 2.7.3 is under release process, changing

[jira] [Updated] (HDFS-9666) Enable hdfs-client to read even remote SSD/RAM prior to local disk replica to improve random read

2016-08-17 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-9666: -- Target Version/s: 2.7.4 (was: 2.7.3) 2.7.3 is under release process, changing

[jira] [Updated] (HDFS-10477) Stop decommission a rack of DataNodes caused NameNode fail over to standby

2016-08-17 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-10477: --- Target Version/s: 2.7.4 (was: 2.7.3) 2.7.3 is under release process,

[jira] [Updated] (HDFS-8307) Spurious DNS Queries from hdfs shell

2016-08-17 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-8307: -- Target Version/s: 2.7.4 (was: 2.7.3) 2.7.3 is under release process, changing

[jira] [Commented] (HDFS-10745) Directly resolve paths into INodesInPath

2016-08-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425688#comment-15425688 ] Hadoop QA commented on HDFS-10745: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2016-08-17 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425624#comment-15425624 ] Zhe Zhang commented on HDFS-7859: - Thanks [~xinwei] for the update! Patch LGTM overall. A few comments: #

[jira] [Commented] (HDFS-10773) BlockSender should not synchronize on the dataset object

2016-08-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425606#comment-15425606 ] Hudson commented on HDFS-10773: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10296 (See

[jira] [Commented] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-17 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425602#comment-15425602 ] Chen Liang commented on HDFS-10682: --- Thanks [~arpitagarwal]! Somehow Jenkins ran on the patch v6 a

[jira] [Commented] (HDFS-9462) DiskBalancer: Add Scan Command

2016-08-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425605#comment-15425605 ] Hadoop QA commented on HDFS-9462: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10773) BlockSender should not synchronize on the dataset object

2016-08-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10773: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425591#comment-15425591 ] Hadoop QA commented on HDFS-10682: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10682: - Resolution: Fixed Fix Version/s: (was: 3.0.0-alpha2) 2.8.0

[jira] [Commented] (HDFS-10549) Correctly revoke file leases when closing files

2016-08-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425580#comment-15425580 ] Hudson commented on HDFS-10549: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10295 (See

[jira] [Updated] (HDFS-10549) Correctly revoke file leases when closing files

2016-08-17 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10549: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2 2.8.0

[jira] [Commented] (HDFS-10763) Open files can leak permanently due to inconsistent lease update

2016-08-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425542#comment-15425542 ] Hadoop QA commented on HDFS-10763: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425539#comment-15425539 ] Hadoop QA commented on HDFS-10682: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Comment Edited] (HDFS-9462) DiskBalancer: Add Scan Command

2016-08-17 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425511#comment-15425511 ] Anu Engineer edited comment on HDFS-9462 at 8/17/16 10:32 PM: -- Can you please

[jira] [Commented] (HDFS-10773) BlockSender should not synchronize on the dataset object

2016-08-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425512#comment-15425512 ] Hadoop QA commented on HDFS-10773: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9462) DiskBalancer: Add Scan Command

2016-08-17 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425511#comment-15425511 ] Anu Engineer commented on HDFS-9462: Can you please add some tests for this patch please ? >

[jira] [Commented] (HDFS-10549) Correctly revoke file leases when closing files

2016-08-17 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425501#comment-15425501 ] Xiao Chen commented on HDFS-10549: -- Test failure look unrelated an passed locally. +1, committing this

[jira] [Updated] (HDFS-10549) Correctly revoke file lease when closing files

2016-08-17 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10549: - Summary: Correctly revoke file lease when closing files (was: Memory leak if exception happens when

[jira] [Updated] (HDFS-10549) Correctly revoke file leases when closing files

2016-08-17 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10549: - Summary: Correctly revoke file leases when closing files (was: Correctly revoke file lease when closing

[jira] [Updated] (HDFS-10745) Directly resolve paths into INodesInPath

2016-08-17 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10745: --- Attachment: HDFS-10745.branch-2.patch Trivial conflicts involved EC and indentation. No functional

[jira] [Updated] (HDFS-9530) ReservedSpace is not cleared for abandoned Blocks

2016-08-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9530: Component/s: datanode > ReservedSpace is not cleared for abandoned Blocks >

[jira] [Updated] (HDFS-9530) ReservedSpace is not cleared for abandoned Blocks

2016-08-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9530: Target Version/s: (was: 2.7.3) Fix Version/s: 2.6.5 2.8.0 I've pushed

[jira] [Updated] (HDFS-9530) ReservedSpace is not cleared for abandoned Blocks

2016-08-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9530: Affects Version/s: (was: 2.7.1) (was: 2.6.0) > ReservedSpace is not

[jira] [Updated] (HDFS-9462) DiskBalancer: Add Scan Command

2016-08-17 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9462: Attachment: HDFS-9462-HDFS-10576.001.patch Posted patch v001 consolidating HDFS-10514. >

[jira] [Comment Edited] (HDFS-10514) Augment QueryDiskBalancerPlan to return storage id/type of source/dest volumes

2016-08-17 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425466#comment-15425466 ] Xiaobing Zhou edited comment on HDFS-10514 at 8/17/16 9:59 PM: --- Marked this

[jira] [Updated] (HDFS-10514) Augment QueryDiskBalancerPlan to return storage id/type of source/dest volumes

2016-08-17 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10514: - Resolution: Duplicate Status: Resolved (was: Patch Available) Marked this as duplicate

[jira] [Created] (HDFS-10774) Reflective XSS and HTML injection vulnerability

2016-08-17 Thread Will Harmon (JIRA)
Will Harmon created HDFS-10774: -- Summary: Reflective XSS and HTML injection vulnerability Key: HDFS-10774 URL: https://issues.apache.org/jira/browse/HDFS-10774 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-9530) ReservedSpace is not cleared for abandoned Blocks

2016-08-17 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-9530: -- Resolution: Fixed Status: Resolved (was: Patch Available) bq. Reopening

[jira] [Commented] (HDFS-10745) Directly resolve paths into INodesInPath

2016-08-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425403#comment-15425403 ] Hudson commented on HDFS-10745: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10293 (See

[jira] [Commented] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425387#comment-15425387 ] Arpit Agarwal commented on HDFS-10682: -- +1 for the branch-2 v6 patch, pending Jenkins. Thanks

[jira] [Commented] (HDFS-10745) Directly resolve paths into INodesInPath

2016-08-17 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425382#comment-15425382 ] Kihwal Lee commented on HDFS-10745: --- Committed to trunk, but need a patch for branch-2. > Directly

[jira] [Commented] (HDFS-10773) BlockSender should not synchronize on the dataset object

2016-08-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425381#comment-15425381 ] Arpit Agarwal commented on HDFS-10773: -- +1 pending Jenkins. Thanks for the quick fix [~vagarychen].

[jira] [Work started] (HDFS-10773) BlockSender should not synchronize on the dataset object

2016-08-17 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-10773 started by Chen Liang. - > BlockSender should not synchronize on the dataset object >

[jira] [Updated] (HDFS-10773) BlockSender should not synchronize on the dataset object

2016-08-17 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10773: -- Attachment: HDFS-10773.001.patch > BlockSender should not synchronize on the dataset object >

[jira] [Updated] (HDFS-10773) BlockSender should not synchronize on the dataset object

2016-08-17 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10773: -- Status: Patch Available (was: In Progress) > BlockSender should not synchronize on the dataset object

[jira] [Commented] (HDFS-10745) Directly resolve paths into INodesInPath

2016-08-17 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425359#comment-15425359 ] Kihwal Lee commented on HDFS-10745: --- +1 lgtm > Directly resolve paths into INodesInPath >

[jira] [Updated] (HDFS-9395) Make HDFS audit logging consistant

2016-08-17 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-9395: -- Target Version/s: (was: 2.7.3) > Make HDFS audit logging consistant >

[jira] [Updated] (HDFS-10679) libhdfs++: Implement parallel find with wildcards tool

2016-08-17 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein updated HDFS-10679: - Attachment: HDFS-10679.HDFS-8707.011.patch Improved readability, simplified some of the logic. >

[jira] [Updated] (HDFS-9395) Make HDFS audit logging consistant

2016-08-17 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-9395: -- Fix Version/s: (was: 2.7.3) 3.0.0-alpha1 Just reverted

[jira] [Commented] (HDFS-8402) Fsck exit codes are not reliable

2016-08-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425311#comment-15425311 ] Hadoop QA commented on HDFS-8402: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-17 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425294#comment-15425294 ] Chen Liang commented on HDFS-10682: --- Good point! Just uploaded an updated patch. > Replace

[jira] [Updated] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-17 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10682: -- Attachment: HDFS-10682-branch-2.006.patch > Replace FsDatasetImpl object lock with a separate lock

[jira] [Commented] (HDFS-10763) Open files can leak permanently due to inconsistent lease update

2016-08-17 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425291#comment-15425291 ] Kihwal Lee commented on HDFS-10763: --- Removed an aborted jenkins run. > Open files can leak permanently

[jira] [Issue Comment Deleted] (HDFS-10763) Open files can leak permanently due to inconsistent lease update

2016-08-17 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10763: -- Comment: was deleted (was: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime

[jira] [Commented] (HDFS-10763) Open files can leak permanently due to inconsistent lease update

2016-08-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425289#comment-15425289 ] Hadoop QA commented on HDFS-10763: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-8402) Fsck exit codes are not reliable

2016-08-17 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-8402: -- Target Version/s: (was: 2.7.3) Dropping 2.7.x target-version till the above

[jira] [Commented] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425271#comment-15425271 ] Arpit Agarwal commented on HDFS-10682: -- Thanks for the updated patch. Can you please include the

[jira] [Commented] (HDFS-10754) libhdfs++: Create tools directory and implement hdfs_cat and hdfs_chgrp

2016-08-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425267#comment-15425267 ] Hadoop QA commented on HDFS-10754: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-17 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425266#comment-15425266 ] Chen Liang commented on HDFS-10682: --- Thanks [~arpitagarwal] for pointing out! Will fix these. > Replace

[jira] [Updated] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-17 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10682: -- Attachment: HDFS-10682-branch-2.005.patch > Replace FsDatasetImpl object lock with a separate lock

[jira] [Updated] (HDFS-10763) Open files can leak permanently due to inconsistent lease update

2016-08-17 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10763: -- Status: Patch Available (was: Reopened) > Open files can leak permanently due to inconsistent lease

[jira] [Assigned] (HDFS-10773) BlockSender should not synchronize on the dataset object

2016-08-17 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang reassigned HDFS-10773: - Assignee: Chen Liang > BlockSender should not synchronize on the dataset object >

[jira] [Commented] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425242#comment-15425242 ] Arpit Agarwal commented on HDFS-10682: -- Filed HDFS-10773. > Replace FsDatasetImpl object lock with a

[jira] [Created] (HDFS-10773) BlockSender should not synchronize on the dataset object

2016-08-17 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-10773: Summary: BlockSender should not synchronize on the dataset object Key: HDFS-10773 URL: https://issues.apache.org/jira/browse/HDFS-10773 Project: Hadoop HDFS

[jira] [Commented] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425237#comment-15425237 ] Arpit Agarwal commented on HDFS-10682: -- Hi [~vagarychen], thanks for the branch-2 patch. Couple of

[jira] [Updated] (HDFS-10754) libhdfs++: Create tools directory and implement hdfs_cat and hdfs_chgrp

2016-08-17 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein updated HDFS-10754: - Attachment: HDFS-10754.HDFS-8707.002.patch Moved to the file system. > libhdfs++: Create tools

[jira] [Comment Edited] (HDFS-10757) KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used

2016-08-17 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15423519#comment-15423519 ] Xiaoyu Yao edited comment on HDFS-10757 at 8/17/16 7:02 PM: Thanks

[jira] [Comment Edited] (HDFS-10757) KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used

2016-08-17 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15423519#comment-15423519 ] Xiaoyu Yao edited comment on HDFS-10757 at 8/17/16 6:49 PM: Thanks

[jira] [Updated] (HDFS-10766) Exceptions thrown by requestShortCircuitFdsForRead can be lost

2016-08-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10766: - Summary: Exceptions thrown by requestShortCircuitFdsForRead can be lost (was: Allow ) >

[jira] [Updated] (HDFS-10766) Allow

2016-08-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10766: - Summary: Allow(was: Request short circuit access failed) > Allow > --- > >

[jira] [Commented] (HDFS-10766) Request short circuit access failed

2016-08-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425111#comment-15425111 ] Arpit Agarwal commented on HDFS-10766: -- Thank you for the clarification. I see what you are trying to

[jira] [Commented] (HDFS-10763) Open files can leak permanently due to inconsistent lease update

2016-08-17 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425099#comment-15425099 ] Kihwal Lee commented on HDFS-10763: --- As pointed out by [~zhz], {{TestOpenFilesWithSnapshot}} fails in

[jira] [Updated] (HDFS-10763) Open files can leak permanently due to inconsistent lease update

2016-08-17 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10763: -- Attachment: HDFS-10763.branch-2.7.supplement.patch Attaching a supplemental patch for branch-2.7. This

[jira] [Reopened] (HDFS-10763) Open files can leak permanently due to inconsistent lease update

2016-08-17 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee reopened HDFS-10763: --- Reopening to fix branch-2.7. Apparently we can't simply eliminate open file leak. A deleted file in a

[jira] [Commented] (HDFS-6708) StorageType should be encoded in the block token

2016-08-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425016#comment-15425016 ] Arpit Agarwal commented on HDFS-6708: - Hi [~PieterReuse], no I haven't. I've unassigned this in case

[jira] [Updated] (HDFS-6708) StorageType should be encoded in the block token

2016-08-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6708: Assignee: (was: Arpit Agarwal) > StorageType should be encoded in the block token >

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2016-08-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15424991#comment-15424991 ] Hadoop QA commented on HDFS-7859: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-10771) Error while reading block java.io.IOException: Need xx bytes, but only yy bytes available

2016-08-17 Thread Andrian Jardan (JIRA)
Andrian Jardan created HDFS-10771: - Summary: Error while reading block java.io.IOException: Need xx bytes, but only yy bytes available Key: HDFS-10771 URL: https://issues.apache.org/jira/browse/HDFS-10771

[jira] [Updated] (HDFS-10772) Reduce byte/string conversions for get listing

2016-08-17 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10772: --- Attachment: HDFS-10772.patch > Reduce byte/string conversions for get listing >

[jira] [Created] (HDFS-10772) Reduce byte/string conversions for get listing

2016-08-17 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-10772: -- Summary: Reduce byte/string conversions for get listing Key: HDFS-10772 URL: https://issues.apache.org/jira/browse/HDFS-10772 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-7567) Potential null dereference in FSEditLogLoader#applyEditLogOp()

2016-08-17 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15424817#comment-15424817 ] Ted Yu commented on HDFS-7567: -- Thanks for the link, [~jojochuang] > Potential null dereference in

  1   2   >