[jira] [Updated] (HDFS-8476) quota can't limit the file which put before setting the storage policy

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8476: -- Priority: Major (was: Minor) Component/s: (was: HDFS) namenod

[jira] [Commented] (HDFS-8476) quota can't limit the file which put before setting the storage policy

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15025698#comment-15025698 ] Tsz Wo Nicholas Sze commented on HDFS-8476: --- [~tongshiquan], do you still see thi

[jira] [Updated] (HDFS-8292) Move conditional in fmt_time from dfs-dust.js to status.html

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8292: -- Component/s: (was: HDFS) namenode > Move conditional in fmt_time fro

[jira] [Assigned] (HDFS-8707) Implement an async pure c++ HDFS client

2015-11-24 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou reassigned HDFS-8707: --- Assignee: Xiaobing Zhou (was: Haohui Mai) > Implement an async pure c++ HDFS client > ---

[jira] [Updated] (HDFS-8277) Safemode enter fails when Standby NameNode is down

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8277: -- Priority: Major (was: Minor) Component/s: (was: HDFS) > Safemode enter fails

[jira] [Updated] (HDFS-8244) HDFS Custom Storage Tier Policies

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8244: -- Component/s: (was: HDFS) > HDFS Custom Storage Tier Policies > --

[jira] [Resolved] (HDFS-8244) HDFS Custom Storage Tier Policies

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-8244. --- Resolution: Duplicate Resolving. > HDFS Custom Storage Tier Policies > ---

[jira] [Updated] (HDFS-8211) DataNode UUID is always null in the JMX counter

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8211: -- Component/s: (was: HDFS) datanode > DataNode UUID is always null in

[jira] [Commented] (HDFS-9357) NN UI renders icons of decommissioned DN incorrectly

2015-11-24 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15025681#comment-15025681 ] Kuhu Shukla commented on HDFS-9357: --- [~wheat9], [~surendrasingh], I think it would be a g

[jira] [Updated] (HDFS-9416) Respect OpenSSL and protobuf definitions in maven configuration when building libhdfspp

2015-11-24 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9416: Resolution: Not A Problem Status: Resolved (was: Patch Available) Closed this since the buil

[jira] [Updated] (HDFS-8177) When the dfs -appendToFile - / is used concurrently in different process simultaneously pointing to the same hadoop file. It produces a exception stating

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8177: -- Component/s: (was: HDFS) > When the dfs -appendToFile - / is used concurrently in >

[jira] [Updated] (HDFS-9429) Tests in TestDFSAdminWithHA intermittently fail with EOFException

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9429: -- Component/s: (was: HDFS) test > Tests in TestDFSAdminWithHA intermit

[jira] [Updated] (HDFS-8159) [HDFS-Quota] Verification is not done while setting dir namequota and size

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8159: -- Component/s: (was: HDFS) > [HDFS-Quota] Verification is not done while setting dir na

[jira] [Updated] (HDFS-9404) Findbugs issue reported in BlockRecoveryWorker$RecoveryTaskContiguous.recover()

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9404: -- Component/s: (was: HDFS) datanode > Findbugs issue reported in > Bl

[jira] [Updated] (HDFS-9361) Default block placement policy causes TestReplaceDataNodeOnFailure to fail intermittently

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9361: -- Component/s: (was: HDFS) namenode > Default block placement policy c

[jira] [Commented] (HDFS-8335) FSNamesystem should construct FSPermissionChecker only if permission is enabled

2015-11-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15025666#comment-15025666 ] Hudson commented on HDFS-8335: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2659 (See [htt

[jira] [Commented] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-11-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15025665#comment-15025665 ] Hudson commented on HDFS-8855: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2659 (See [htt

[jira] [Updated] (HDFS-9463) The 'decommissioned' and 'decommissionedAndDead' icons do not show up alongside relevant Datanodes on the NN-UI

2015-11-24 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9463: -- Resolution: Duplicate Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) Fix

[jira] [Updated] (HDFS-8807) dfs.datanode.data.dir does not handle spaces between storageType and URI correctly

2015-11-24 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-8807: --- Attachment: HDFS-8807.002.patch Fix removing space from lic. header > dfs.datanode.data.dir does not h

[jira] [Updated] (HDFS-9351) checkNNStartup() need to be called when fsck calls FSNamesystem.getSnapshottableDirs()

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9351: -- Component/s: (was: HDFS) namenode > checkNNStartup() need to be call

[jira] [Updated] (HDFS-9463) The 'decommissioned' and 'decommissionedAndDead' icons do not show up alongside relevant Datanodes on the NN-UI

2015-11-24 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9463: -- Attachment: Screen Shot 2015-11-24 at 3.23.00 PM.png This is a screenshot exhibiting the problem. > The

[jira] [Updated] (HDFS-9463) The 'decommissioned' and 'decommissionedAndDead' icons do not show up alongside relevant Datanodes on the NN-UI

2015-11-24 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9463: -- Status: Patch Available (was: Open) > The 'decommissioned' and 'decommissionedAndDead' icons do not show

[jira] [Updated] (HDFS-9339) Extend full test of KMS ACLs

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9339: -- Component/s: (was: HDFS) test > Extend full test of KMS ACLs > -

[jira] [Updated] (HDFS-9463) The 'decommissioned' and 'decommissionedAndDead' icons do not show up alongside relevant Datanodes on the NN-UI

2015-11-24 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9463: -- Attachment: HDFS-9463-1.patch This patch fixes the typos responsible for this behavior. I was able to che

[jira] [Updated] (HDFS-9321) Expose extra dispatcher parameters

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9321: -- Component/s: (was: HDFS) > Expose extra dispatcher parameters > -

[jira] [Updated] (HDFS-9359) Test libhdfs++ with existing libhdfs tests

2015-11-24 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9359: -- Resolution: Fixed Status: Resolved (was: Patch Available) Note: Until HDFS-9452 is resol

[jira] [Commented] (HDFS-9321) Expose extra dispatcher parameters

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15025641#comment-15025641 ] Tsz Wo Nicholas Sze commented on HDFS-9321: --- > To balance our cluster faster ...

[jira] [Commented] (HDFS-9359) Test libhdfs++ with existing libhdfs tests

2015-11-24 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15025635#comment-15025635 ] James Clampffer commented on HDFS-9359: --- I just committed this. Thanks Stephen! > T

[jira] [Updated] (HDFS-9294) DFSClient deadlock when close file and failed to renew lease

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9294: -- Component/s: (was: HDFS) > DFSClient deadlock when close file and failed to renew le

[jira] [Created] (HDFS-9463) The 'decommissioned' and 'decommissionedAndDead' icons do not show up alongside relevant Datanodes on the NN-UI

2015-11-24 Thread Kuhu Shukla (JIRA)
Kuhu Shukla created HDFS-9463: - Summary: The 'decommissioned' and 'decommissionedAndDead' icons do not show up alongside relevant Datanodes on the NN-UI Key: HDFS-9463 URL: https://issues.apache.org/jira/browse/HDFS-9

[jira] [Commented] (HDFS-9294) DFSClient deadlock when close file and failed to renew lease

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15025631#comment-15025631 ] Tsz Wo Nicholas Sze commented on HDFS-9294: --- > ... and it seems not solved at Had

[jira] [Updated] (HDFS-9462) DiskBalancer: Add Query Command

2015-11-24 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9462: Description: This is to propose being able to query all the nodes that we send various plans to. In

[jira] [Commented] (HDFS-9294) DFSClient deadlock when close file and failed to renew lease

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15025624#comment-15025624 ] Tsz Wo Nicholas Sze commented on HDFS-9294: --- Thanks for reporting the bug. Are y

[jira] [Updated] (HDFS-9462) DiskBalancer: Add Query Command

2015-11-24 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9462: Description: This is to propose being able to query all the nodes that we send various plans to. In

[jira] [Updated] (HDFS-9438) TestPipelinesFailover assumes Linux ifconfig

2015-11-24 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-9438: - Attachment: HDFS-9438-hdfs-9438.004.patch The method has "debug" section and the test section. What we actu

[jira] [Updated] (HDFS-9286) HttpFs does not parse ACL syntax correctly for operation REMOVEACLENTRIES

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9286: -- Component/s: (was: HDFS) fs > HttpFs does not parse ACL syntax corre

[jira] [Updated] (HDFS-9273) ACLs on root directory may be lost after NN restart

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9273: -- Component/s: (was: HDFS) namenode > ACLs on root directory may be lo

[jira] [Created] (HDFS-9462) DiskBalancer: Add Query Command

2015-11-24 Thread Xiaobing Zhou (JIRA)
Xiaobing Zhou created HDFS-9462: --- Summary: DiskBalancer: Add Query Command Key: HDFS-9462 URL: https://issues.apache.org/jira/browse/HDFS-9462 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-9250) Add Precondition check to LocatedBlock#addCachedLoc

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9250: -- Component/s: (was: HDFS) namenode > Add Precondition check to Locate

[jira] [Updated] (HDFS-9251) Refactor TestWriteToReplica and TestFsDatasetImpl to avoid explicitly creating Files in tests code.

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9251: -- Component/s: (was: HDFS) test > Refactor TestWriteToReplica and Test

[jira] [Updated] (HDFS-9461) DiskBalancer: Add Report Command

2015-11-24 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9461: Description: It's quite helpful to do: 1) report node information for the top X of DataNodes that wil

[jira] [Updated] (HDFS-9236) Missing sanity check for block size during block recovery

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9236: -- Component/s: (was: HDFS) datanode > Missing sanity check for block s

[jira] [Updated] (HDFS-9461) DiskBalancer: Add Report Command

2015-11-24 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9461: Component/s: (was: HDFS) > DiskBalancer: Add Report Command > >

[jira] [Updated] (HDFS-9230) Report space overhead of unfinalized upgrade/rollingUpgrade

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9230: -- Component/s: (was: HDFS) namenode > Report space overhead of unfinal

[jira] [Updated] (HDFS-9461) DiskBalancer: Add Report Command

2015-11-24 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9461: Affects Version/s: 2.8.0 > DiskBalancer: Add Report Command > > >

[jira] [Updated] (HDFS-9461) DiskBalancer: Add Report Command

2015-11-24 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9461: Component/s: balancer & mover > DiskBalancer: Add Report Command > >

[jira] [Created] (HDFS-9461) DiskBalancer: Add Report Command

2015-11-24 Thread Xiaobing Zhou (JIRA)
Xiaobing Zhou created HDFS-9461: --- Summary: DiskBalancer: Add Report Command Key: HDFS-9461 URL: https://issues.apache.org/jira/browse/HDFS-9461 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Resolved] (HDFS-9434) Recommission a datanode with 500k blocks may pause NN for 30 seconds

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-9434. --- Resolution: Fixed Sangjin, thanks for the review. I have committed the branch-2.6 patc

[jira] [Updated] (HDFS-9226) MiniDFSCluster leaks dependency Mockito via DataNodeTestUtils

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9226: -- Component/s: (was: HDFS) > MiniDFSCluster leaks dependency Mockito via DataNodeTestUt

[jira] [Updated] (HDFS-9188) Make block corruption related tests FsDataset-agnostic.

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9188: -- Component/s: (was: HDFS) > Make block corruption related tests FsDataset-agnostic. >

[jira] [Updated] (HDFS-9164) hdfs-nfs connector fails on O_TRUNC

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9164: -- Component/s: (was: HDFS) nfs > hdfs-nfs connector fails on O_TRUNC >

[jira] [Updated] (HDFS-9146) HDFS forward seek() within a block shouldn't spawn new TCP Peer/RemoteBlockReader

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9146: -- Component/s: (was: HDFS) hdfs-client > HDFS forward seek() within a

[jira] [Updated] (HDFS-9368) Implement reads with implicit offset state in libhdfs++

2015-11-24 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9368: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Implement reads with implici

[jira] [Updated] (HDFS-9100) HDFS Balancer does not respect dfs.client.use.datanode.hostname

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9100: -- Component/s: (was: HDFS) > HDFS Balancer does not respect dfs.client.use.datanode.hos

[jira] [Updated] (HDFS-9001) DFSUtil.getNsServiceRpcUris() can return too many entries in a non-HA, non-federated cluster

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9001: -- Component/s: (was: HDFS) > DFSUtil.getNsServiceRpcUris() can return too many entries

[jira] [Commented] (HDFS-8807) dfs.datanode.data.dir does not handle spaces between storageType and URI correctly

2015-11-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15025575#comment-15025575 ] Hadoop QA commented on HDFS-8807: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9434) Recommission a datanode with 500k blocks may pause NN for 30 seconds

2015-11-24 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15025576#comment-15025576 ] Sangjin Lee commented on HDFS-9434: --- +1. LGTM. > Recommission a datanode with 500k block

[jira] [Commented] (HDFS-9368) Implement reads with implicit offset state in libhdfs++

2015-11-24 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15025577#comment-15025577 ] James Clampffer commented on HDFS-9368: --- Committed this earlier today. > Implement r

[jira] [Updated] (HDFS-9064) NN old UI (block_info_xml) not available in 2.7.x

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9064: -- Component/s: (was: HDFS) namenode > NN old UI (block_info_xml) not a

[jira] [Updated] (HDFS-9434) Recommission a datanode with 500k blocks may pause NN for 30 seconds

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9434: -- Attachment: h9434_20151116_branch-2.6.patch h9434_20151116_branch-2.6.patch: for 2.6. >

[jira] [Reopened] (HDFS-9370) TestDataNodeUGIProvider fails intermittently due to non-deterministic cache expiry.

2015-11-24 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth reopened HDFS-9370: - > TestDataNodeUGIProvider fails intermittently due to non-deterministic cache > expiry. >

[jira] [Resolved] (HDFS-9370) TestDataNodeUGIProvider fails intermittently due to non-deterministic cache expiry.

2015-11-24 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-9370. - Resolution: Duplicate > TestDataNodeUGIProvider fails intermittently due to non-deterministic cache

[jira] [Reopened] (HDFS-9434) Recommission a datanode with 500k blocks may pause NN for 30 seconds

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze reopened HDFS-9434: --- Reopen for backporting to branch-2.6 > Recommission a datanode with 500k blocks may pause

[jira] [Commented] (HDFS-9434) Recommission a datanode with 500k blocks may pause NN for 30 seconds

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15025537#comment-15025537 ] Tsz Wo Nicholas Sze commented on HDFS-9434: --- > This broke the 2.6 build. ... Re

[jira] [Commented] (HDFS-5165) Remove the TotalFiles metrics

2015-11-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15025536#comment-15025536 ] Hudson commented on HDFS-5165: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1449 (See [https://

[jira] [Commented] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-11-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15025530#comment-15025530 ] Hudson commented on HDFS-8855: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #717 (See

[jira] [Commented] (HDFS-9434) Recommission a datanode with 500k blocks may pause NN for 30 seconds

2015-11-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15025532#comment-15025532 ] Hudson commented on HDFS-9434: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #717 (See

[jira] [Commented] (HDFS-8335) FSNamesystem should construct FSPermissionChecker only if permission is enabled

2015-11-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15025531#comment-15025531 ] Hudson commented on HDFS-8335: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #717 (See

[jira] [Commented] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-11-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15025511#comment-15025511 ] Hudson commented on HDFS-8855: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #727 (See [htt

[jira] [Commented] (HDFS-8335) FSNamesystem should construct FSPermissionChecker only if permission is enabled

2015-11-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15025512#comment-15025512 ] Hudson commented on HDFS-8335: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #727 (See [htt

[jira] [Commented] (HDFS-5165) Remove the TotalFiles metrics

2015-11-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15025514#comment-15025514 ] Hudson commented on HDFS-5165: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #727 (See [htt

[jira] [Commented] (HDFS-9434) Recommission a datanode with 500k blocks may pause NN for 30 seconds

2015-11-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15025513#comment-15025513 ] Hudson commented on HDFS-9434: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #727 (See [htt

[jira] [Commented] (HDFS-9429) Tests in TestDFSAdminWithHA intermittently fail with EOFException

2015-11-24 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15025509#comment-15025509 ] Wei-Chiu Chuang commented on HDFS-9429: --- Hi [~xiaochen] thanks for finding this issue

[jira] [Commented] (HDFS-9436) Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes by default

2015-11-24 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15025506#comment-15025506 ] Konstantin Shvachko commented on HDFS-9436: --- Hey Mingliang, I thought you will in

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

2015-11-24 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15025502#comment-15025502 ] Andrew Wang commented on HDFS-8791: --- I think this is fine for rolling upgrade, it doesn't

[jira] [Commented] (HDFS-8031) Follow-on work for erasure coding phase I (striping layout)

2015-11-24 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15025497#comment-15025497 ] Andrew Wang commented on HDFS-8031: --- Nice result [~demongaorui] (y) > Follow-on work for

[jira] [Updated] (HDFS-8512) storage type inside LocatedBlock object is not fully exposed for GETFILESTATUS

2015-11-24 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8512: - Attachment: HDFS-8512.01.patch Thanks [~szetszwo] for the review. Rebase the patch to trunk. > storage typ

[jira] [Commented] (HDFS-8807) dfs.datanode.data.dir does not handle spaces between storageType and URI correctly

2015-11-24 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15025454#comment-15025454 ] Anu Engineer commented on HDFS-8807: sure thing, looks like my editor auto fixed the sp

[jira] [Commented] (HDFS-9434) Recommission a datanode with 500k blocks may pause NN for 30 seconds

2015-11-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15025449#comment-15025449 ] Hudson commented on HDFS-9434: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2658 (See [htt

[jira] [Commented] (HDFS-5165) Remove the TotalFiles metrics

2015-11-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15025450#comment-15025450 ] Hudson commented on HDFS-5165: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2658 (See [htt

[jira] [Commented] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-11-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15025443#comment-15025443 ] Hudson commented on HDFS-8855: -- FAILURE: Integrated in Hadoop-trunk-Commit #8880 (See [https:

[jira] [Commented] (HDFS-9434) Recommission a datanode with 500k blocks may pause NN for 30 seconds

2015-11-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15025445#comment-15025445 ] Hudson commented on HDFS-9434: -- FAILURE: Integrated in Hadoop-trunk-Commit #8880 (See [https:

[jira] [Commented] (HDFS-8335) FSNamesystem should construct FSPermissionChecker only if permission is enabled

2015-11-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15025444#comment-15025444 ] Hudson commented on HDFS-8335: -- FAILURE: Integrated in Hadoop-trunk-Commit #8880 (See [https:

[jira] [Commented] (HDFS-9451) TestFsPermission#testDeprecatedUmask is broken

2015-11-24 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15025440#comment-15025440 ] Haohui Mai commented on HDFS-9451: -- +1 pending jenkins > TestFsPermission#testDeprecatedU

[jira] [Commented] (HDFS-9451) TestFsPermission#testDeprecatedUmask is broken

2015-11-24 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15025433#comment-15025433 ] Chang Li commented on HDFS-9451: Thanks for update! lgtm, +1(non binding) > TestFsPermissi

[jira] [Commented] (HDFS-9438) TestPipelinesFailover assumes Linux ifconfig

2015-11-24 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15025434#comment-15025434 ] Yongjun Zhang commented on HDFS-9438: - HI [~jzhuge], Thanks for working on this issue.

[jira] [Commented] (HDFS-9434) Recommission a datanode with 500k blocks may pause NN for 30 seconds

2015-11-24 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15025431#comment-15025431 ] Sangjin Lee commented on HDFS-9434: --- [~szetszwo], could you post a patch that fixes the b

[jira] [Updated] (HDFS-9449) DiskBalancer : Add connectors

2015-11-24 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9449: --- Attachment: HDFS-9449-HDFS-1312.001.patch Attaching the renamed patch with right branch. > DiskBalance

[jira] [Updated] (HDFS-8987) Erasure coding: MapReduce job failed when I set the / folder to the EC zone

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8987: -- Component/s: (was: HDFS) erasure-coding > Erasure coding: MapReduce

[jira] [Updated] (HDFS-9449) DiskBalancer : Add connectors

2015-11-24 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9449: --- Status: Patch Available (was: Open) > DiskBalancer : Add connectors > - >

[jira] [Updated] (HDFS-8335) FSNamesystem should construct FSPermissionChecker only if permission is enabled

2015-11-24 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8335: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved (was:

[jira] [Updated] (HDFS-9449) DiskBalancer : Add connectors

2015-11-24 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9449: --- Attachment: (was: HDFS-9449.001.patch) > DiskBalancer : Add connectors > --

[jira] [Updated] (HDFS-8969) Clean up findbugs warnings for HDFS-8823 and HDFS-8932

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8969: -- Component/s: (was: HDFS) namenode > Clean up findbugs warnings for H

[jira] [Commented] (HDFS-9434) Recommission a datanode with 500k blocks may pause NN for 30 seconds

2015-11-24 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15025422#comment-15025422 ] Jason Lowe commented on HDFS-9434: -- This broke the 2.6 build. The patch is assuming SLF4J

[jira] [Commented] (HDFS-8807) dfs.datanode.data.dir does not handle spaces between storageType and URI correctly

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15025418#comment-15025418 ] Tsz Wo Nicholas Sze commented on HDFS-8807: --- {code} - * http://www.apache.org

[jira] [Updated] (HDFS-9459) hadoop-hdfs-native-client fails test build on Windows after transition to ctest.

2015-11-24 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9459: - Status: Patch Available (was: Open) > hadoop-hdfs-native-client fails test build on Windows after transiti

[jira] [Commented] (HDFS-9459) hadoop-hdfs-native-client fails test build on Windows after transition to ctest.

2015-11-24 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15025408#comment-15025408 ] Haohui Mai commented on HDFS-9459: -- +1 pending jenkins > hadoop-hdfs-native-client fails

[jira] [Updated] (HDFS-9451) TestFsPermission#testDeprecatedUmask is broken

2015-11-24 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9451: -- Attachment: HDFS-9451.004.patch Thanks for the reviews and suggestions! Rev04 removes all usage o

[jira] [Updated] (HDFS-8335) FSNamesystem should construct FSPermissionChecker only if permission is enabled

2015-11-24 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8335: - Summary: FSNamesystem should construct FSPermissionChecker only if permission is enabled (was: FSNamesyste

[jira] [Commented] (HDFS-8335) FSNamesystem/FSDirStatAndListingOp getFileInfo and getListingInt construct FSPermissionChecker regardless of isPermissionEnabled()

2015-11-24 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15025401#comment-15025401 ] Haohui Mai commented on HDFS-8335: -- +1. Committing it shortly. > FSNamesystem/FSDirStatAn

<    1   2   3   4   >