[jira] [Commented] (HDFS-3107) HDFS truncate

2015-04-28 Thread Neeta Garimella (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518741#comment-14518741 ] Neeta Garimella commented on HDFS-3107: --- Thanks Yi. I will get the latest. > HDFS tr

[jira] [Commented] (HDFS-8283) DataStreamer cleanup and some minor improvement

2015-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518736#comment-14518736 ] Hadoop QA commented on HDFS-8283: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8277) Safemode enter fails when Standby NameNode is down

2015-04-28 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-8277: --- Issue Type: Improvement (was: Bug) > Safemode enter fails when Standby NameNode is dow

[jira] [Commented] (HDFS-8275) Erasure Coding: Implement batched listing of enrasure coding zones

2015-04-28 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518723#comment-14518723 ] Rakesh R commented on HDFS-8275: OK, thanks [~hitliuyi] for pointing out this. Since I have

[jira] [Commented] (HDFS-7758) Retire FsDatasetSpi#getVolumes() and use FsDatasetSpi#getVolumeRefs() instead

2015-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518706#comment-14518706 ] Hadoop QA commented on HDFS-7758: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Resolved] (HDFS-8275) Erasure Coding: Implement batched listing of enrasure coding zones

2015-04-28 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu resolved HDFS-8275. -- Resolution: Duplicate Hi Rakesh, this JIRA is duplicated with HDFS-8087. > Erasure Coding: Implement batched lis

[jira] [Assigned] (HDFS-8277) Safemode enter fails when Standby NameNode is down

2015-04-28 Thread surendra singh lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] surendra singh lilhore reassigned HDFS-8277: Assignee: surendra singh lilhore > Safemode enter fails when Standby NameNod

[jira] [Commented] (HDFS-8277) Safemode enter fails when Standby NameNode is down

2015-04-28 Thread surendra singh lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518688#comment-14518688 ] surendra singh lilhore commented on HDFS-8277: -- I would like to work on this.

[jira] [Commented] (HDFS-8240) During hdfs client is writing small file, missing block showed in namenode web when ha switch

2015-04-28 Thread Ricky Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518687#comment-14518687 ] Ricky Yang commented on HDFS-8240: -- Allen, This scenario appear many times ,why do y

[jira] [Updated] (HDFS-7281) Missing block is marked as corrupted block

2015-04-28 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-7281: -- Attachment: HDFS-7281-5.patch [~yzhangal], good catch. I have updated the patch and the release notes. > Missing

[jira] [Updated] (HDFS-7281) Missing block is marked as corrupted block

2015-04-28 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-7281: -- Release Note: The patch improves the reporting around missing blocks and corrupted blocks. 1. A block is missin

[jira] [Commented] (HDFS-8272) Erasure Coding: simplify the retry logic in DFSStripedInputStream

2015-04-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518671#comment-14518671 ] Zhe Zhang commented on HDFS-8272: - Thanks Jing for updating the patch! {{blockSeekTo}} look

[jira] [Commented] (HDFS-3107) HDFS truncate

2015-04-28 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518648#comment-14518648 ] Yi Liu commented on HDFS-3107: -- Hi Neeta, please checkout the latest trunk or if you get Hadoo

[jira] [Commented] (HDFS-7348) Erasure Coding: striped block recovery

2015-04-28 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518630#comment-14518630 ] Yi Liu commented on HDFS-7348: -- Thanks [~zhz] for the review! The comments are helpful. {quot

[jira] [Commented] (HDFS-7980) Incremental BlockReport will dramatically slow down the startup of a namenode

2015-04-28 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518628#comment-14518628 ] Walter Su commented on HDFS-7980: - 004 patch fixes failed test. By the way: 1. If a block e

[jira] [Commented] (HDFS-8248) Store INodeId instead of the INodeFile object in BlockInfoContiguous

2015-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518615#comment-14518615 ] Hadoop QA commented on HDFS-8248: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-7980) Incremental BlockReport will dramatically slow down the startup of a namenode

2015-04-28 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-7980: Attachment: HDFS-7980.004.patch > Incremental BlockReport will dramatically slow down the startup of a namen

[jira] [Commented] (HDFS-8213) DFSClient should use hdfs.client.htrace HTrace configuration prefix rather than hadoop.htrace

2015-04-28 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518598#comment-14518598 ] Masatake Iwasaki commented on HDFS-8213: Thanks for the update, [~cmccabe]. I'm +1(

[jira] [Commented] (HDFS-8280) Code Cleanup in DFSInputStream

2015-04-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518595#comment-14518595 ] Hudson commented on HDFS-8280: -- FAILURE: Integrated in Hadoop-trunk-Commit #7697 (See [https:

[jira] [Commented] (HDFS-8273) FSNamesystem#Delete() should not call logSync() when holding the lock

2015-04-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518596#comment-14518596 ] Hudson commented on HDFS-8273: -- FAILURE: Integrated in Hadoop-trunk-Commit #7697 (See [https:

[jira] [Created] (HDFS-8284) Add usage of tracing originated in DFSClient to doc

2015-04-28 Thread Masatake Iwasaki (JIRA)
Masatake Iwasaki created HDFS-8284: -- Summary: Add usage of tracing originated in DFSClient to doc Key: HDFS-8284 URL: https://issues.apache.org/jira/browse/HDFS-8284 Project: Hadoop HDFS Iss

[jira] [Commented] (HDFS-3107) HDFS truncate

2015-04-28 Thread Neeta Garimella (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518572#comment-14518572 ] Neeta Garimella commented on HDFS-3107: --- Could someone comment on why truncate is not

[jira] [Commented] (HDFS-8213) DFSClient should use hdfs.client.htrace HTrace configuration prefix rather than hadoop.htrace

2015-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518570#comment-14518570 ] Hadoop QA commented on HDFS-8213: - (!) The patch artifact directory on has been removed! T

[jira] [Commented] (HDFS-7397) The conf key "dfs.client.read.shortcircuit.streams.cache.size" is misleading

2015-04-28 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518554#comment-14518554 ] Brahma Reddy Battula commented on HDFS-7397: Testcase failures are unrelated to

[jira] [Commented] (HDFS-8201) Add an end to end test for stripping file writing and reading

2015-04-28 Thread Xinwei Qin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518545#comment-14518545 ] Xinwei Qin commented on HDFS-8201: --- [~zhz] I have noticed that JIRA. I think your sugges

[jira] [Commented] (HDFS-8214) Secondary NN Web UI shows wrong date for Last Checkpoint

2015-04-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518528#comment-14518528 ] Andrew Wang commented on HDFS-8214: --- +1 LGTM, thanks Charles. I rekicked Jenkins, should

[jira] [Updated] (HDFS-8280) Code Cleanup in DFSInputStream

2015-04-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8280: - Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) I've comm

[jira] [Commented] (HDFS-8273) FSNamesystem#Delete() should not call logSync() when holding the lock

2015-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518503#comment-14518503 ] Hadoop QA commented on HDFS-8273: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8280) Code Cleanup in DFSInputStream

2015-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518498#comment-14518498 ] Hadoop QA commented on HDFS-8280: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8273) FSNamesystem#Delete() should not call logSync() when holding the lock

2015-04-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8273: - Resolution: Fixed Fix Version/s: 2.7.1 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Updated] (HDFS-8273) FSNamesystem#Delete() should not call logSync() when holding the lock

2015-04-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8273: - Summary: FSNamesystem#Delete() should not call logSync() when holding the lock (was: logSync() is called i

[jira] [Commented] (HDFS-8273) logSync() is called inside of write lock for delete op

2015-04-28 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518492#comment-14518492 ] Jing Zhao commented on HDFS-8273: - +1 for the latest patch. Thanks for the fix, Haohui! >

[jira] [Commented] (HDFS-7397) The conf key "dfs.client.read.shortcircuit.streams.cache.size" is misleading

2015-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518487#comment-14518487 ] Hadoop QA commented on HDFS-7397: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8269) getBlockLocations() does not resolve the .reserved path and generates incorrect edit logs when updating the atime

2015-04-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8269: - Attachment: HDFS-8269.003.patch > getBlockLocations() does not resolve the .reserved path and generates >

[jira] [Commented] (HDFS-7995) Implement chmod in the HDFS Web UI

2015-04-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518482#comment-14518482 ] Haohui Mai commented on HDFS-7995: -- Sorry for the late reply. Thanks for the work. {code}

[jira] [Commented] (HDFS-8273) logSync() is called inside of write lock for delete op

2015-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518468#comment-14518468 ] Hadoop QA commented on HDFS-8273: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-7678) Erasure coding: DFSInputStream with decode functionality

2015-04-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518465#comment-14518465 ] Zhe Zhang commented on HDFS-7678: - Thanks Andrew for the review; it's very helpful. Some qu

[jira] [Commented] (HDFS-7770) Need document for storage type label of data node storage locations under dfs.data.dir

2015-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518454#comment-14518454 ] Hadoop QA commented on HDFS-7770: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8283) DataStreamer cleanup and some minor improvement

2015-04-28 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8283: -- Status: Patch Available (was: Open) > DataStreamer cleanup and some minor improvement >

[jira] [Updated] (HDFS-8283) DataStreamer cleanup and some minor improvement

2015-04-28 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8283: -- Attachment: h8283_20150428.patch h8283_20150428.patch: 1st patch. > DataStreamer cleanup

[jira] [Created] (HDFS-8283) DataStreamer cleanup and some minor improvement

2015-04-28 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-8283: - Summary: DataStreamer cleanup and some minor improvement Key: HDFS-8283 URL: https://issues.apache.org/jira/browse/HDFS-8283 Project: Hadoop HDFS I

[jira] [Commented] (HDFS-8273) logSync() is called inside of write lock for delete op

2015-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518444#comment-14518444 ] Hadoop QA commented on HDFS-8273: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-7758) Retire FsDatasetSpi#getVolumes() and use FsDatasetSpi#getVolumeRefs() instead

2015-04-28 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-7758: Attachment: HDFS-7758.006.patch Thanks for looking into this, [~cmccabe]. Upload a rebased patch. >

[jira] [Commented] (HDFS-7995) Implement chmod in the HDFS Web UI

2015-04-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518425#comment-14518425 ] Haohui Mai commented on HDFS-7995: -- I think the code requires some more clean up on unused

[jira] [Commented] (HDFS-8269) getBlockLocations() does not resolve the .reserved path and generates incorrect edit logs when updating the atime

2015-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518424#comment-14518424 ] Hadoop QA commented on HDFS-8269: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-7995) Implement chmod in the HDFS Web UI

2015-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518419#comment-14518419 ] Hadoop QA commented on HDFS-7995: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

2015-04-28 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7847: --- Attachment: HDFS-7847.004.patch .004 is rebased onto trunk. > Modify NNThroughputBenchmark to be able

[jira] [Commented] (HDFS-7678) Erasure coding: DFSInputStream with decode functionality

2015-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518415#comment-14518415 ] Hadoop QA commented on HDFS-7678: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-7678) Erasure coding: DFSInputStream with decode functionality

2015-04-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518401#comment-14518401 ] Andrew Wang commented on HDFS-7678: --- Thanks for the patch Zhe, some nice functionality he

[jira] [Commented] (HDFS-7758) Retire FsDatasetSpi#getVolumes() and use FsDatasetSpi#getVolumeRefs() instead

2015-04-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518394#comment-14518394 ] Colin Patrick McCabe commented on HDFS-7758: can you rebase the patch on trunk?

[jira] [Commented] (HDFS-8213) DFSClient should use hdfs.client.htrace HTrace configuration prefix rather than hadoop.htrace

2015-04-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518389#comment-14518389 ] Colin Patrick McCabe commented on HDFS-8213: Thanks for the review, [~iwasakims

[jira] [Updated] (HDFS-8213) DFSClient should use hdfs.client.htrace HTrace configuration prefix rather than hadoop.htrace

2015-04-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8213: --- Attachment: HDFS-8213.002.patch > DFSClient should use hdfs.client.htrace HTrace config

[jira] [Commented] (HDFS-7281) Missing block is marked as corrupted block

2015-04-28 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518376#comment-14518376 ] Yongjun Zhang commented on HDFS-7281: - Hi [~mingma], I think we can get this fix to tr

[jira] [Commented] (HDFS-7995) Implement chmod in the HDFS Web UI

2015-04-28 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518370#comment-14518370 ] Allen Wittenauer commented on HDFS-7995: +1 lgtm > Implement chmod in the HDFS We

[jira] [Commented] (HDFS-7348) Erasure Coding: striped block recovery

2015-04-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518362#comment-14518362 ] Zhe Zhang commented on HDFS-7348: - Please find detailed comments below: Logics: # Since re

[jira] [Commented] (HDFS-8056) Decommissioned dead nodes should continue to be counted as dead after NN restart

2015-04-28 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518357#comment-14518357 ] Ming Ma commented on HDFS-8056: --- [~andrew.wang] and others, appreciate any input you might ha

[jira] [Created] (HDFS-8282) Erasure coding: move striped reading logic to StripedBlockUtil

2015-04-28 Thread Zhe Zhang (JIRA)
Zhe Zhang created HDFS-8282: --- Summary: Erasure coding: move striped reading logic to StripedBlockUtil Key: HDFS-8282 URL: https://issues.apache.org/jira/browse/HDFS-8282 Project: Hadoop HDFS Issue

[jira] [Work started] (HDFS-8282) Erasure coding: move striped reading logic to StripedBlockUtil

2015-04-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-8282 started by Zhe Zhang. --- > Erasure coding: move striped reading logic to StripedBlockUtil > -

[jira] [Updated] (HDFS-8272) Erasure Coding: simplify the retry logic in DFSStripedInputStream

2015-04-28 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8272: Attachment: h8272-HDFS-7285.001.patch Thanks again for the review, Zhe! Update the patch to address your comm

[jira] [Commented] (HDFS-7687) Change fsck to support EC files

2015-04-28 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518265#comment-14518265 ] Tsz Wo Nicholas Sze commented on HDFS-7687: --- Both JIRAs are merged to the branch

[jira] [Commented] (HDFS-7348) Erasure Coding: striped block recovery

2015-04-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518240#comment-14518240 ] Zhe Zhang commented on HDFS-7348: - A quick comment first: A the DN level I don't think we

[jira] [Commented] (HDFS-7348) Erasure Coding: striped block recovery

2015-04-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518215#comment-14518215 ] Zhe Zhang commented on HDFS-7348: - Great work Yi! I'm reviewing HADOOP-11847; hope we can g

[jira] [Updated] (HDFS-7995) Implement chmod in the HDFS Web UI

2015-04-28 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-7995: --- Attachment: HDFS-7995.02.patch Thanks for the review Allen. I've fixed the alignment. For regexp / recu

[jira] [Commented] (HDFS-8213) DFSClient should use hdfs.client.htrace HTrace configuration prefix rather than hadoop.htrace

2015-04-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518196#comment-14518196 ] Colin Patrick McCabe commented on HDFS-8213: bq. In SpanReceiverHost#getInstanc

[jira] [Updated] (HDFS-8248) Store INodeId instead of the INodeFile object in BlockInfoContiguous

2015-04-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8248: - Attachment: HDFS-8248.003.patch > Store INodeId instead of the INodeFile object in BlockInfoContiguous > --

[jira] [Created] (HDFS-8281) Erasure Coding: implement parallel stateful reading for striped layout

2015-04-28 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-8281: --- Summary: Erasure Coding: implement parallel stateful reading for striped layout Key: HDFS-8281 URL: https://issues.apache.org/jira/browse/HDFS-8281 Project: Hadoop HDFS

[jira] [Updated] (HDFS-8280) Code Cleanup in DFSInputStream

2015-04-28 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8280: -- Hadoop Flags: Reviewed +1 patch looks good. > Code Cleanup in DFSInputStream > -

[jira] [Commented] (HDFS-7348) Erasure Coding: striped block recovery

2015-04-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518145#comment-14518145 ] Zhe Zhang commented on HDFS-7348: - We might be able to share some decoding code. > Erasure

[jira] [Commented] (HDFS-8272) Erasure Coding: simplify the retry logic in DFSStripedInputStream

2015-04-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518138#comment-14518138 ] Zhe Zhang commented on HDFS-8272: - Thanks for taking care of HDFS-8280. > Erasure Coding:

[jira] [Commented] (HDFS-8272) Erasure Coding: simplify the retry logic in DFSStripedInputStream

2015-04-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518134#comment-14518134 ] Zhe Zhang commented on HDFS-8272: - Continuing the my review: The {{DFSInputStream}} change

[jira] [Commented] (HDFS-8248) Store INodeId instead of the INodeFile object in BlockInfoContiguous

2015-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518129#comment-14518129 ] Hadoop QA commented on HDFS-8248: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8280) Code Cleanup in DFSInputStream

2015-04-28 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8280: Status: Patch Available (was: Open) > Code Cleanup in DFSInputStream > -- > >

[jira] [Commented] (HDFS-8272) Erasure Coding: simplify the retry logic in DFSStripedInputStream

2015-04-28 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518097#comment-14518097 ] Jing Zhao commented on HDFS-8272: - Thanks for the review, Zhe! Sure, I just separate the re

[jira] [Commented] (HDFS-7397) The conf key "dfs.client.read.shortcircuit.streams.cache.size" is misleading

2015-04-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518093#comment-14518093 ] Colin Patrick McCabe commented on HDFS-7397: +1 for v2 > The conf key "dfs.cli

[jira] [Updated] (HDFS-8280) Code Cleanup in DFSInputStream

2015-04-28 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8280: Attachment: HDFS-8280.000.patch > Code Cleanup in DFSInputStream > -- > >

[jira] [Updated] (HDFS-8273) logSync() is called inside of write lock for delete op

2015-04-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8273: - Attachment: (was: HDFS-8273.001.patch) > logSync() is called inside of write lock for delete op > -

[jira] [Updated] (HDFS-8273) logSync() is called inside of write lock for delete op

2015-04-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8273: - Attachment: HDFS-8273.001.patch > logSync() is called inside of write lock for delete op >

[jira] [Updated] (HDFS-8273) logSync() is called inside of write lock for delete op

2015-04-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8273: - Attachment: (was: HDFS-8273.001.patch) > logSync() is called inside of write lock for delete op > -

[jira] [Updated] (HDFS-7770) Need document for storage type label of data node storage locations under dfs.data.dir

2015-04-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7770: - Attachment: HDFS-7770.02.patch Patch v01 applied on my local machine without problem. Rebase the patch anyw

[jira] [Commented] (HDFS-8279) Document how to specify storage types

2015-04-28 Thread Lars Francke (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518049#comment-14518049 ] Lars Francke commented on HDFS-8279: Thanks [~xyao], I missed that in my research. And

[jira] [Updated] (HDFS-8273) logSync() is called inside of write lock for delete op

2015-04-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8273: - Attachment: HDFS-8273.001.patch > logSync() is called inside of write lock for delete op >

[jira] [Created] (HDFS-8280) Code Cleanup in DFSInputStream

2015-04-28 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-8280: --- Summary: Code Cleanup in DFSInputStream Key: HDFS-8280 URL: https://issues.apache.org/jira/browse/HDFS-8280 Project: Hadoop HDFS Issue Type: Improvement Re

[jira] [Resolved] (HDFS-8279) Document how to specify storage types

2015-04-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-8279. - Resolution: Duplicate Thanks for the link to HDFS-7770 [~xyao]. I'll help you get that reviewed and

[jira] [Assigned] (HDFS-8279) Document how to specify storage types

2015-04-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reassigned HDFS-8279: --- Assignee: Arpit Agarwal > Document how to specify storage types >

[jira] [Commented] (HDFS-8279) Document how to specify storage types

2015-04-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518036#comment-14518036 ] Xiaoyu Yao commented on HDFS-8279: -- Hi [~feistner], this looks like a dup of HDFS-7770.

[jira] [Commented] (HDFS-8246) Get HDFS file name based on block pool id and block id

2015-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518034#comment-14518034 ] Hadoop QA commented on HDFS-8246: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-5000) DataNode configuration should allow specifying storage type

2015-04-28 Thread Lars Francke (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518031#comment-14518031 ] Lars Francke commented on HDFS-5000: Thanks [~arpitagarwal]! I've created HDFS-8279 to

[jira] [Created] (HDFS-8279) Document how to specify storage types

2015-04-28 Thread Lars Francke (JIRA)
Lars Francke created HDFS-8279: -- Summary: Document how to specify storage types Key: HDFS-8279 URL: https://issues.apache.org/jira/browse/HDFS-8279 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Updated] (HDFS-8273) logSync() is called inside of write lock for delete op

2015-04-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8273: - Attachment: HDFS-8273.001.patch > logSync() is called inside of write lock for delete op >

[jira] [Commented] (HDFS-8272) Erasure Coding: simplify the retry logic in DFSStripedInputStream

2015-04-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518015#comment-14518015 ] Zhe Zhang commented on HDFS-8272: - Nice work Jing! It's a great idea to optimize / simplify

[jira] [Commented] (HDFS-5000) DataNode configuration should allow specifying storage type

2015-04-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518014#comment-14518014 ] Arpit Agarwal commented on HDFS-5000: - Hi [~lars_francke], I'm sorry this information w

[jira] [Resolved] (HDFS-8235) Erasure Coding: Create DFSStripedInputStream in DFSClient#open

2015-04-28 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-8235. - Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed The .3 patch looks good to me

[jira] [Updated] (HDFS-8269) getBlockLocations() does not resolve the .reserved path and generates incorrect edit logs when updating the atime

2015-04-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8269: - Attachment: HDFS-8269.002.patch > getBlockLocations() does not resolve the .reserved path and generates >

[jira] [Assigned] (HDFS-8278) HDFS Balancer should consider remaining storage % when checking for under-utilized machines

2015-04-28 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze reassigned HDFS-8278: - Assignee: Tsz Wo Nicholas Sze > HDFS Balancer should consider remaining storage %

[jira] [Updated] (HDFS-8235) Erasure Coding: Create DFSStripedInputStream in DFSClient#open

2015-04-28 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8235: Summary: Erasure Coding: Create DFSStripedInputStream in DFSClient#open (was: Create DFSStripedInputStream i

[jira] [Commented] (HDFS-5000) DataNode configuration should allow specifying storage type

2015-04-28 Thread Lars Francke (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14517999#comment-14517999 ] Lars Francke commented on HDFS-5000: I know this is an old issue but has this been docu

[jira] [Updated] (HDFS-8278) HDFS Balancer should consider remaining storage % when checking for under-utilized machines

2015-04-28 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HDFS-8278: -- Description: DFS balancer mistakenly identifies a node with very little storage space remaining as an "underutil

[jira] [Created] (HDFS-8278) HDFS Balancer should consider remaining storage % when checking for under-utilized machines

2015-04-28 Thread Gopal V (JIRA)
Gopal V created HDFS-8278: - Summary: HDFS Balancer should consider remaining storage % when checking for under-utilized machines Key: HDFS-8278 URL: https://issues.apache.org/jira/browse/HDFS-8278 Project: Ha

[jira] [Commented] (HDFS-7980) Incremental BlockReport will dramatically slow down the startup of a namenode

2015-04-28 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14517984#comment-14517984 ] Tsz Wo Nicholas Sze commented on HDFS-7980: --- The failure of TestHASafeMode.testBl

[jira] [Updated] (HDFS-8119) resolved

2015-04-28 Thread ankush (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ankush updated HDFS-8119: - Description: resolved (was: how to set the default permission with HDFS. want to configure default permissions for

  1   2   >