[jira] [Commented] (HDFS-9451) TestFsPermission#testDeprecatedUmask is broken

2015-11-24 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025183#comment-15025183 ] Haohui Mai commented on HDFS-9451: -- The issue is trivial enough thus I see little values of having

[jira] [Updated] (HDFS-8318) resolved

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8318: -- Component/s: (was: HDFS) > resolved > > > Key: HDFS-8318 >

[jira] [Commented] (HDFS-8246) Get HDFS file name based on block pool id and block id

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025185#comment-15025185 ] Tsz Wo Nicholas Sze commented on HDFS-8246: --- Changed Resolution from "Auto Closed" to "Won't

[jira] [Updated] (HDFS-8337) Accessing httpfs via webhdfs doesn't work from a jar with kerberos

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8337: -- Component/s: (was: HDFS) (was: hdfs-client) > Accessing httpfs

[jira] [Commented] (HDFS-9434) Recommission a datanode with 500k blocks may pause NN for 30 seconds

2015-11-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025532#comment-15025532 ] Hudson commented on HDFS-9434: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #717 (See

[jira] [Commented] (HDFS-8335) FSNamesystem should construct FSPermissionChecker only if permission is enabled

2015-11-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025531#comment-15025531 ] Hudson commented on HDFS-8335: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #717 (See

[jira] [Commented] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-11-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025530#comment-15025530 ] Hudson commented on HDFS-8855: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #717 (See

[jira] [Commented] (HDFS-9368) Implement reads with implicit offset state in libhdfs++

2015-11-24 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025577#comment-15025577 ] James Clampffer commented on HDFS-9368: --- Committed this earlier today. > Implement reads with

[jira] [Commented] (HDFS-9434) Recommission a datanode with 500k blocks may pause NN for 30 seconds

2015-11-24 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025576#comment-15025576 ] Sangjin Lee commented on HDFS-9434: --- +1. LGTM. > Recommission a datanode with 500k blocks may pause NN

[jira] [Commented] (HDFS-8807) dfs.datanode.data.dir does not handle spaces between storageType and URI correctly

2015-11-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025575#comment-15025575 ] Hadoop QA commented on HDFS-8807: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9368) Implement reads with implicit offset state in libhdfs++

2015-11-24 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9368: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Implement reads with

[jira] [Updated] (HDFS-9001) DFSUtil.getNsServiceRpcUris() can return too many entries in a non-HA, non-federated cluster

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9001: -- Component/s: (was: HDFS) > DFSUtil.getNsServiceRpcUris() can return too many entries

[jira] [Updated] (HDFS-9100) HDFS Balancer does not respect dfs.client.use.datanode.hostname

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9100: -- Component/s: (was: HDFS) > HDFS Balancer does not respect

[jira] [Updated] (HDFS-8211) DataNode UUID is always null in the JMX counter

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8211: -- Component/s: (was: HDFS) datanode > DataNode UUID is always null in

[jira] [Commented] (HDFS-9357) NN UI renders icons of decommissioned DN incorrectly

2015-11-24 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025681#comment-15025681 ] Kuhu Shukla commented on HDFS-9357: --- [~wheat9], [~surendrasingh], I think it would be a good cherry pick

[jira] [Updated] (HDFS-9416) Respect OpenSSL and protobuf definitions in maven configuration when building libhdfspp

2015-11-24 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9416: Resolution: Not A Problem Status: Resolved (was: Patch Available) Closed this since the

[jira] [Updated] (HDFS-8476) quota can't limit the file which put before setting the storage policy

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8476: -- Priority: Major (was: Minor) Component/s: (was: HDFS)

[jira] [Updated] (HDFS-8582) Support getting a list of reconfigurable config properties and do not generate spurious reconfig warnings

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8582: -- Release Note: Add a new option "properties" to the "dfsadmin -reconfig" command to get a

[jira] [Updated] (HDFS-8633) Fix setting of dfs.datanode.readahead.bytes in hdfs-default.xml to match DFSConfigKeys

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8633: -- Component/s: (was: HDFS) datanode > Fix setting of

[jira] [Commented] (HDFS-8610) if set several dirs which belongs to one disk in "dfs.datanode.data.dir", NN calculate capacity wrong

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025724#comment-15025724 ] Tsz Wo Nicholas Sze commented on HDFS-8610: --- > ... set several dirs which belongs to one disk in

[jira] [Updated] (HDFS-8610) if set several dirs which belongs to one disk in "dfs.datanode.data.dir", NN calculate capacity wrong

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8610: -- Component/s: (was: HDFS) datanode > if set several dirs which

[jira] [Created] (HDFS-9464) Documentation needs to be exposed

2015-11-24 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created HDFS-9464: -- Summary: Documentation needs to be exposed Key: HDFS-9464 URL: https://issues.apache.org/jira/browse/HDFS-9464 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-9433) DFS getEZForPath API on a non-existent file should throw FileNotFoundException

2015-11-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15024023#comment-15024023 ] Hudson commented on HDFS-9433: -- ABORTED: Integrated in Hadoop-Hdfs-trunk-Java8 #635 (See

[jira] [Commented] (HDFS-9438) TestPipelinesFailover assumes Linux ifconfig

2015-11-24 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15024038#comment-15024038 ] Wei-Chiu Chuang commented on HDFS-9438: --- If the OS is Solaris, the command for ShellCommandExecutor

[jira] [Updated] (HDFS-6101) TestReplaceDatanodeOnFailure fails occasionally

2015-11-24 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-6101: -- Attachment: HDFS-6101.007.patch Thanks [~walter.k.su] for the detailed review. I think the

[jira] [Created] (HDFS-9455) Invalid Argument Error thrown in case of filesystem operation failure

2015-11-24 Thread Archana T (JIRA)
Archana T created HDFS-9455: --- Summary: Invalid Argument Error thrown in case of filesystem operation failure Key: HDFS-9455 URL: https://issues.apache.org/jira/browse/HDFS-9455 Project: Hadoop HDFS

[jira] [Updated] (HDFS-9455) In distcp, Invalid Argument Error thrown in case of filesystem operation failure

2015-11-24 Thread Archana T (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Archana T updated HDFS-9455: Summary: In distcp, Invalid Argument Error thrown in case of filesystem operation failure (was: Invalid

[jira] [Commented] (HDFS-6101) TestReplaceDatanodeOnFailure fails occasionally

2015-11-24 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15024264#comment-15024264 ] Walter Su commented on HDFS-6101: - LGTM. +1 pending jenkins. > TestReplaceDatanodeOnFailure fails

[jira] [Commented] (HDFS-9433) DFS getEZForPath API on a non-existent file should throw FileNotFoundException

2015-11-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15024209#comment-15024209 ] Hudson commented on HDFS-9433: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2573 (See

[jira] [Work started] (HDFS-7661) Support read when a EC file is being written

2015-11-24 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-7661 started by GAO Rui. - > Support read when a EC file is being written > >

[jira] [Commented] (HDFS-9451) TestFsPermission#testDeprecatedUmask is broken

2015-11-24 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15024266#comment-15024266 ] Tsuyoshi Ozawa commented on HDFS-9451: -- Targeting this to 3.0.0 since HADOOP-12294 is only for 3.0.0.

[jira] [Updated] (HDFS-9451) TestFsPermission#testDeprecatedUmask is broken

2015-11-24 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa updated HDFS-9451: - Target Version/s: 3.0.0 > TestFsPermission#testDeprecatedUmask is broken >

[jira] [Updated] (HDFS-7661) Support read when a EC file is being written

2015-11-24 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GAO Rui updated HDFS-7661: -- Attachment: HDFS-7661-unitTest-wip-trunk.patch Hi [~szetszwo], I have witten a unitTest to illustrate the goal

[jira] [Commented] (HDFS-5165) Remove the TotalFiles metrics

2015-11-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15024217#comment-15024217 ] Hadoop QA commented on HDFS-5165: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9441) Do not construct path string when choosing block placement targets

2015-11-24 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15024587#comment-15024587 ] Kihwal Lee commented on HDFS-9441: -- I understand the purpose and that it may minimize breakages in short

[jira] [Updated] (HDFS-7163) WebHdfsFileSystem should retry reads according to the configured retry policy.

2015-11-24 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated HDFS-7163: - Attachment: (was: HDFS-7163.004.patch) > WebHdfsFileSystem should retry reads according to the

[jira] [Updated] (HDFS-7163) WebHdfsFileSystem should retry reads according to the configured retry policy.

2015-11-24 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated HDFS-7163: - Attachment: HDFS-7163.004.patch Removed and reattached HDFS-7163.004.patch in hopes of re-launching the

[jira] [Commented] (HDFS-9452) libhdfs++ Fix memory stomp in OpenFileForRead.

2015-11-24 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15024662#comment-15024662 ] James Clampffer commented on HDFS-9452: --- Good point Bob, I'll get another patch up soon that does

[jira] [Commented] (HDFS-6101) TestReplaceDatanodeOnFailure fails occasionally

2015-11-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15024312#comment-15024312 ] Hadoop QA commented on HDFS-6101: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9452) libhdfs++ Fix memory stomp in OpenFileForRead.

2015-11-24 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15024409#comment-15024409 ] Bob Hansen commented on HDFS-9452: -- Might I suggest (as we're going to be writing a whole bunch of these

[jira] [Commented] (HDFS-9451) TestFsPermission#testDeprecatedUmask is broken

2015-11-24 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15024273#comment-15024273 ] Tsuyoshi Ozawa commented on HDFS-9451: -- LGTM, pending for Jenkins. >

[jira] [Updated] (HDFS-8031) Follow-on work for erasure coding phase I (striping layout)

2015-11-24 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GAO Rui updated HDFS-8031: -- Attachment: HDFSErasureCodingSystemTestReport-20151106.pdf Hi! We have conducted system test for Erasure Coding

[jira] [Updated] (HDFS-9263) tests are using /test/build/data; breaking Jenkins

2015-11-24 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-9263: - Status: Patch Available (was: Open) > tests are using /test/build/data; breaking Jenkins >

[jira] [Updated] (HDFS-9263) tests are using /test/build/data; breaking Jenkins

2015-11-24 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-9263: - Status: Open (was: Patch Available) > tests are using /test/build/data; breaking Jenkins >

[jira] [Commented] (HDFS-9451) TestFsPermission#testDeprecatedUmask is broken

2015-11-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15024352#comment-15024352 ] Hadoop QA commented on HDFS-9451: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9314) Improve BlockPlacementPolicyDefault's picking of excess replicas

2015-11-24 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15024385#comment-15024385 ] Junping Du commented on HDFS-9314: -- Let's keep BlockPlacementPolicyWithNodeGroup#pickupReplicaSet there,

[jira] [Commented] (HDFS-9423) Fix intermittent failure of TestEditLogTailer

2015-11-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15024508#comment-15024508 ] Hudson commented on HDFS-9423: -- ABORTED: Integrated in Hadoop-Hdfs-trunk-Java8 #636 (See

[jira] [Updated] (HDFS-9438) TestPipelinesFailover assumes Linux ifconfig

2015-11-24 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-9438: - Attachment: HDFS-9438-hdfs-9438.003.patch > TestPipelinesFailover assumes Linux ifconfig >

[jira] [Commented] (HDFS-9438) TestPipelinesFailover assumes Linux ifconfig

2015-11-24 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15024708#comment-15024708 ] John Zhuge commented on HDFS-9438: -- Thanks Wei-Chiu for catching this problem. And I will refrain from

[jira] [Created] (HDFS-9456) BlockPlacementPolicyWithNodeGroup should override verifyBlockPlacement() from BlockPlacementPolicyDefault.

2015-11-24 Thread Junping Du (JIRA)
Junping Du created HDFS-9456: Summary: BlockPlacementPolicyWithNodeGroup should override verifyBlockPlacement() from BlockPlacementPolicyDefault. Key: HDFS-9456 URL: https://issues.apache.org/jira/browse/HDFS-9456

[jira] [Commented] (HDFS-9314) Improve BlockPlacementPolicyDefault's picking of excess replicas

2015-11-24 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15024715#comment-15024715 ] Junping Du commented on HDFS-9314: -- Filed HDFS-9456. > Improve BlockPlacementPolicyDefault's picking of

<    1   2   3   4