[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319716#comment-14319716 ] Hadoop QA commented on HDFS-7648: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7793) Refactor DFSOutputStream separating DataStreamer out

[ https://issues.apache.org/jira/browse/HDFS-7793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319704#comment-14319704 ] Jing Zhao commented on HDFS-7793: - bq. is the final plan still to move DataStreamer out as

[jira] [Commented] (HDFS-7793) Refactor DFSOutputStream separating DataStreamer out

[ https://issues.apache.org/jira/browse/HDFS-7793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319696#comment-14319696 ] Zhe Zhang commented on HDFS-7793: - [~jingzhao] That was fast :) Just to clarify, is the fin

[jira] [Commented] (HDFS-7729) Add logic to DFSOutputStream to support writing a file in striping layout

[ https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319692#comment-14319692 ] Zhe Zhang commented on HDFS-7729: - [~libo-intel] Thank you for taking on the refactor task!

[jira] [Commented] (HDFS-7784) load fsimage in parallel

[ https://issues.apache.org/jira/browse/HDFS-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319684#comment-14319684 ] Walter Su commented on HDFS-7784: - I'll upload performance test results in 4 hours. > load

[jira] [Updated] (HDFS-7784) load fsimage in parallel

[ https://issues.apache.org/jira/browse/HDFS-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-7784: Attachment: HDFS-7784.001.patch compatible with the old fsimage file. > load fsimage in parallel > -

[jira] [Updated] (HDFS-7784) load fsimage in parallel

[ https://issues.apache.org/jira/browse/HDFS-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-7784: Target Version/s: 3.0.0 Status: Patch Available (was: Open) > load fsimage in parallel > -

[jira] [Updated] (HDFS-7410) Support CreateFlags with append() to support hsync() for appending streams

[ https://issues.apache.org/jira/browse/HDFS-7410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7410: Attachment: HDFS-7410-003.patch Updated the patch after HDFS-3689 is in. In the latest patch, FileSys

[jira] [Commented] (HDFS-7793) Refactor DFSOutputStream separating DataStreamer out

[ https://issues.apache.org/jira/browse/HDFS-7793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319634#comment-14319634 ] Li Bo commented on HDFS-7793: - Great! Thanks for helping me and I will go on working on your pa

[jira] [Updated] (HDFS-7793) Refactor DFSOutputStream separating DataStreamer out

[ https://issues.apache.org/jira/browse/HDFS-7793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7793: Attachment: HDFS-7793.000.patch Thanks for working on this, Bo! I also spent some time on this and got a ve

[jira] [Commented] (HDFS-7686) Re-add rapid rescan of possibly corrupt block feature to the block scanner

[ https://issues.apache.org/jira/browse/HDFS-7686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319622#comment-14319622 ] Hadoop QA commented on HDFS-7686: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7703) Support favouredNodes for the append for new blocks

[ https://issues.apache.org/jira/browse/HDFS-7703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7703: Attachment: HDFS-7703-003.patch Attaching the committed patch with trailing spaces removed and format

[jira] [Commented] (HDFS-3689) Add support for variable length block

[ https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319623#comment-14319623 ] Vinayakumar B commented on HDFS-3689: - Thanks [~jingzhao]. > Add support for variable

[jira] [Commented] (HDFS-7703) Support favouredNodes for the append for new blocks

[ https://issues.apache.org/jira/browse/HDFS-7703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319621#comment-14319621 ] Vinayakumar B commented on HDFS-7703: - Merged to branch-2 as well. > Support favouredN

[jira] [Updated] (HDFS-7703) Support favouredNodes for the append for new blocks

[ https://issues.apache.org/jira/browse/HDFS-7703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7703: Fix Version/s: (was: 3.0.0) 2.7.0 > Support favouredNodes for the append for n

[jira] [Updated] (HDFS-7759) Provide existence-of-a-second-file implementation for pinning blocks on Datanode

[ https://issues.apache.org/jira/browse/HDFS-7759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-7759: --- Attachment: HDFS-7759.patch I'll add more unit test and check the logic for upgrade and finalizeUpgrade

[jira] [Commented] (HDFS-7668) Convert site documentation from apt to markdown

[ https://issues.apache.org/jira/browse/HDFS-7668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319589#comment-14319589 ] Hadoop QA commented on HDFS-7668: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7009) Active NN and standby NN have different live nodes

[ https://issues.apache.org/jira/browse/HDFS-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319549#comment-14319549 ] Ming Ma commented on HDFS-7009: --- Thanks, [~arpitagarwal]. The patch seems to be useful even a

[jira] [Commented] (HDFS-7729) Add logic to DFSOutputStream to support writing a file in striping layout

[ https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319546#comment-14319546 ] Li Bo commented on HDFS-7729: - Thanks [~zhz] , [~drankye], [~jingzhao], [~umamaheswararao] ,[~s

[jira] [Updated] (HDFS-7648) Verify the datanode directory layout

[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-7648: --- Status: Patch Available (was: Open) > Verify the datanode directory layout > -

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319541#comment-14319541 ] Rakesh R commented on HDFS-7648: bq. If there are a bunch of files in the wrong location, w

[jira] [Commented] (HDFS-7729) Add logic to DFSOutputStream to support writing a file in striping layout

[ https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319537#comment-14319537 ] Li Bo commented on HDFS-7729: - At first my idea is using a block writer to receive bytes and wr

[jira] [Updated] (HDFS-7648) Verify the datanode directory layout

[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-7648: --- Attachment: HDFS-7648-3.patch > Verify the datanode directory layout > > >

[jira] [Updated] (HDFS-7793) Refactor DFSOutputStream separating DataStreamer out

[ https://issues.apache.org/jira/browse/HDFS-7793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-7793: Description: As proposed by [~jingzhao], [~szetszwo] and discussed with [~zhz] in HDFS-7729, it would be grea

[jira] [Commented] (HDFS-7729) Add logic to DFSOutputStream to support writing a file in striping layout

[ https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319530#comment-14319530 ] Kai Zheng commented on HDFS-7729: - I opened HDFS-7793 for the refactoring. Thanks all ! >

[jira] [Updated] (HDFS-7793) Refactor DFSOutputStream separating DataStreamer out

[ https://issues.apache.org/jira/browse/HDFS-7793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-7793: Summary: Refactor DFSOutputStream separating DataStreamer out (was: Refactor DFSOutputStream seperating Data

[jira] [Created] (HDFS-7793) Refactor DFSOutputStream seperating DataStreamer out

Kai Zheng created HDFS-7793: --- Summary: Refactor DFSOutputStream seperating DataStreamer out Key: HDFS-7793 URL: https://issues.apache.org/jira/browse/HDFS-7793 Project: Hadoop HDFS Issue Type: Impr

[jira] [Commented] (HDFS-7009) Active NN and standby NN have different live nodes

[ https://issues.apache.org/jira/browse/HDFS-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319522#comment-14319522 ] Hadoop QA commented on HDFS-7009: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7729) Add logic to DFSOutputStream to support writing a file in striping layout

[ https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319523#comment-14319523 ] Kai Zheng commented on HDFS-7729: - Hi [~umamaheswararao], Good idea. Let me proceed to fil

[jira] [Commented] (HDFS-7729) Add logic to DFSOutputStream to support writing a file in striping layout

[ https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319517#comment-14319517 ] Uma Maheswara Rao G commented on HDFS-7729: --- Great thoughts! I think here my sugg

[jira] [Commented] (HDFS-7009) Active NN and standby NN have different live nodes

[ https://issues.apache.org/jira/browse/HDFS-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319516#comment-14319516 ] Arpit Agarwal commented on HDFS-7009: - Hi [~mingma], thanks for reporting this issue an

[jira] [Commented] (HDFS-6133) Make Balancer support exclude specified path

[ https://issues.apache.org/jira/browse/HDFS-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319503#comment-14319503 ] Yongjun Zhang commented on HDFS-6133: - Another factor is how many blocks a file have, s

[jira] [Commented] (HDFS-7668) Convert site documentation from apt to markdown

[ https://issues.apache.org/jira/browse/HDFS-7668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319487#comment-14319487 ] Hudson commented on HDFS-7668: -- SUCCESS: Integrated in Hadoop-trunk-Commit #7100 (See [https:

[jira] [Commented] (HDFS-7713) Improve the HDFS Web UI browser to allow creating dirs

[ https://issues.apache.org/jira/browse/HDFS-7713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319479#comment-14319479 ] Hadoop QA commented on HDFS-7713: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6133) Make Balancer support exclude specified path

[ https://issues.apache.org/jira/browse/HDFS-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319477#comment-14319477 ] zhaoyunjiong commented on HDFS-6133: {quote} Is there use scenario that one want to spe

[jira] [Created] (HDFS-7792) Add links to FaultInjectFramework and SLGUserGuide to site index

Masatake Iwasaki created HDFS-7792: -- Summary: Add links to FaultInjectFramework and SLGUserGuide to site index Key: HDFS-7792 URL: https://issues.apache.org/jira/browse/HDFS-7792 Project: Hadoop HDFS

[jira] [Commented] (HDFS-7780) Update use of Iterator to Iterable

[ https://issues.apache.org/jira/browse/HDFS-7780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319472#comment-14319472 ] Akira AJISAKA commented on HDFS-7780: - Thanks [~rchiang] for the report and the patch.

[jira] [Commented] (HDFS-7686) Re-add rapid rescan of possibly corrupt block feature to the block scanner

[ https://issues.apache.org/jira/browse/HDFS-7686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319470#comment-14319470 ] Colin Patrick McCabe commented on HDFS-7686: Jenkins continues to be very weird

[jira] [Commented] (HDFS-7729) Add logic to DFSOutputStream to support writing a file in striping layout

[ https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319468#comment-14319468 ] Kai Zheng commented on HDFS-7729: - Thanks [~jingzhao] and [~szetszwo] for the great thought

[jira] [Updated] (HDFS-7668) Convert site documentation from apt to markdown

[ https://issues.apache.org/jira/browse/HDFS-7668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7668: --- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available

[jira] [Created] (HDFS-7791) dfs count -v should be added to quota documentation

Allen Wittenauer created HDFS-7791: -- Summary: dfs count -v should be added to quota documentation Key: HDFS-7791 URL: https://issues.apache.org/jira/browse/HDFS-7791 Project: Hadoop HDFS Iss

[jira] [Commented] (HDFS-7668) Convert site documentation from apt to markdown

[ https://issues.apache.org/jira/browse/HDFS-7668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319443#comment-14319443 ] Masatake Iwasaki commented on HDFS-7668: You can see the built doc at http://iwasak

[jira] [Updated] (HDFS-316) Balancer should run for a configurable # of iterations

[ https://issues.apache.org/jira/browse/HDFS-316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-316: - Fix Version/s: (was: 3.0.0) 2.7.0 Merged to branch-2. > Balancer sho

[jira] [Updated] (HDFS-7668) Convert site documentation from apt to markdown

[ https://issues.apache.org/jira/browse/HDFS-7668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7668: --- Assignee: Masatake Iwasaki > Convert site documentation from apt to markdown >

[jira] [Commented] (HDFS-7790) Do not create optional fields in DFSInputStream unless they are needed

[ https://issues.apache.org/jira/browse/HDFS-7790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319423#comment-14319423 ] Hudson commented on HDFS-7790: -- FAILURE: Integrated in Hadoop-trunk-Commit #7098 (See [https:

[jira] [Commented] (HDFS-7684) The host:port settings of the daemons should be trimmed before use

[ https://issues.apache.org/jira/browse/HDFS-7684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319424#comment-14319424 ] Hudson commented on HDFS-7684: -- FAILURE: Integrated in Hadoop-trunk-Commit #7098 (See [https:

[jira] [Updated] (HDFS-7790) Do not create optional fields in DFSInputStream unless they are needed

[ https://issues.apache.org/jira/browse/HDFS-7790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7790: --- Resolution: Fixed Fix Version/s: 2.7.0 Status: Resolved (was: Patch A

[jira] [Updated] (HDFS-7668) Convert site documentation from apt to markdown

[ https://issues.apache.org/jira/browse/HDFS-7668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-7668: --- Attachment: HDFS-7668-01.patch I attached updated patch including the fixes as: * Overall: fi

[jira] [Commented] (HDFS-7711) Fix various typos in ClusterSetup.md

[ https://issues.apache.org/jira/browse/HDFS-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319415#comment-14319415 ] Brahma Reddy Battula commented on HDFS-7711: Thanks [~wheat9] !! > Fix various

[jira] [Updated] (HDFS-7684) The host:port settings of the daemons should be trimmed before use

[ https://issues.apache.org/jira/browse/HDFS-7684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-7684: Resolution: Fixed Fix Version/s: 2.7.0 Status: Resolved (was: Patch Available) Com

[jira] [Commented] (HDFS-1148) Convert FSDataset to ReadWriteLock

[ https://issues.apache.org/jira/browse/HDFS-1148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319397#comment-14319397 ] Yong Zhang commented on HDFS-1148: -- Hi everyone, what is the status for this improvement?

[jira] [Updated] (HDFS-7369) Erasure coding: distribute block recovery work to DataNode

[ https://issues.apache.org/jira/browse/HDFS-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7369: Attachment: HDFS-7369-000-part2.patch This is a very rough patch for step #2 in the JIRA description. > Era

[jira] [Updated] (HDFS-7684) The host:port settings of the daemons should be trimmed before use

[ https://issues.apache.org/jira/browse/HDFS-7684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-7684: Component/s: (was: namenode) Issue Type: Improvement (was: Bug) Summary: The host:po

synchronized or readwritelock in on datanode

Hi guys, Too many concurrent read and write on our hdfs cluster, we face input and output stream are abnormal and block lost (it is on disk but not in block report). We find many synchronized in FsDatasetImpl on many method, is it better to use readwritelock? Thanks Yong

[jira] [Commented] (HDFS-7684) The host:port settings of dfs.namenode.secondary.http-address should be trimmed before use

[ https://issues.apache.org/jira/browse/HDFS-7684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319386#comment-14319386 ] Akira AJISAKA commented on HDFS-7684: - +1. Thanks [~anu] for the contribution, and than

[jira] [Commented] (HDFS-7684) The host:port settings of dfs.namenode.secondary.http-address should be trimmed before use

[ https://issues.apache.org/jira/browse/HDFS-7684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319377#comment-14319377 ] Hadoop QA commented on HDFS-7684: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7711) Fix various typos in ClusterSetup.md

[ https://issues.apache.org/jira/browse/HDFS-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319285#comment-14319285 ] Hudson commented on HDFS-7711: -- SUCCESS: Integrated in Hadoop-trunk-Commit #7095 (See [https:

[jira] [Comment Edited] (HDFS-5796) The file system browser in the namenode UI requires SPNEGO.

[ https://issues.apache.org/jira/browse/HDFS-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319269#comment-14319269 ] Haohui Mai edited comment on HDFS-5796 at 2/13/15 12:04 AM: bq.

[jira] [Commented] (HDFS-5796) The file system browser in the namenode UI requires SPNEGO.

[ https://issues.apache.org/jira/browse/HDFS-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319269#comment-14319269 ] Haohui Mai commented on HDFS-5796: -- bq. That is incorrect. Permissions are checked as dr.w

[jira] [Comment Edited] (HDFS-7711) Fix various typos in ClusterSetup.md

[ https://issues.apache.org/jira/browse/HDFS-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319240#comment-14319240 ] Haohui Mai edited comment on HDFS-7711 at 2/12/15 11:40 PM: I'v

[jira] [Updated] (HDFS-7711) Fix various typos in ClusterSetup.md

[ https://issues.apache.org/jira/browse/HDFS-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7711: - Resolution: Fixed Fix Version/s: 3.0.0 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Updated] (HDFS-7711) Fix various typos in ClusterSetup.md

[ https://issues.apache.org/jira/browse/HDFS-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7711: - Summary: Fix various typos in ClusterSetup.md (was: [ HDFS DOC ] Various Typos in ClusterSetup.html and i

[jira] [Commented] (HDFS-7711) [ HDFS DOC ] Various Typos in ClusterSetup.html and improvements

[ https://issues.apache.org/jira/browse/HDFS-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319233#comment-14319233 ] Haohui Mai commented on HDFS-7711: -- +1. I'm committing this. > [ HDFS DOC ] Various Typos

[jira] [Commented] (HDFS-7711) [ HDFS DOC ] Various Typos in ClusterSetup.html and improvements

[ https://issues.apache.org/jira/browse/HDFS-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319225#comment-14319225 ] Hadoop QA commented on HDFS-7711: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7713) Improve the HDFS Web UI browser to allow creating dirs

[ https://issues.apache.org/jira/browse/HDFS-7713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-7713: --- Attachment: HDFS-7713.04.patch Thanks for the suggestion Haohui! Here's a patch where I've tried to fix

[jira] [Commented] (HDFS-7713) Improve the HDFS Web UI browser to allow creating dirs

[ https://issues.apache.org/jira/browse/HDFS-7713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319212#comment-14319212 ] Hadoop QA commented on HDFS-7713: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Comment Edited] (HDFS-7784) load fsimage in parallel

[ https://issues.apache.org/jira/browse/HDFS-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319115#comment-14319115 ] Haohui Mai edited comment on HDFS-7784 at 2/12/15 10:32 PM: I'v

[jira] [Commented] (HDFS-7729) Add logic to DFSOutputStream to support writing a file in striping layout

[ https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319136#comment-14319136 ] Zhe Zhang commented on HDFS-7729: - Thanks [~jingzhao] and [~szetszwo] for the in-depth thou

[jira] [Commented] (HDFS-7790) Do not create optional fields in DFSInputStream unless they are needed

[ https://issues.apache.org/jira/browse/HDFS-7790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319122#comment-14319122 ] Aaron T. Myers commented on HDFS-7790: -- Patch looks good to me, and I'm confident that

[jira] [Commented] (HDFS-7789) DFsck should resolve the path to support cross-FS symlinks

[ https://issues.apache.org/jira/browse/HDFS-7789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319121#comment-14319121 ] Gera Shegalov commented on HDFS-7789: - TestPipelinesFailover failure is tracked by HDFS

[jira] [Commented] (HDFS-7789) DFsck should resolve the path to support cross-FS symlinks

[ https://issues.apache.org/jira/browse/HDFS-7789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319119#comment-14319119 ] Hadoop QA commented on HDFS-7789: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7784) load fsimage in parallel

[ https://issues.apache.org/jira/browse/HDFS-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319115#comment-14319115 ] Haohui Mai commented on HDFS-7784: -- I've done some experiments in HDFS-5698. Parallelism d

[jira] [Resolved] (HDFS-7083) TestDecommission#testIncludeByRegistrationName sometimes fails

[ https://issues.apache.org/jira/browse/HDFS-7083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-7083. Resolution: Duplicate > TestDecommission#testIncludeByRegistrationName sometimes fail

[jira] [Commented] (HDFS-7713) Improve the HDFS Web UI browser to allow creating dirs

[ https://issues.apache.org/jira/browse/HDFS-7713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319100#comment-14319100 ] Haohui Mai commented on HDFS-7713: -- Looks like the indentation is off in many places. And

[jira] [Comment Edited] (HDFS-7083) TestDecommission#testIncludeByRegistrationName sometimes fails

[ https://issues.apache.org/jira/browse/HDFS-7083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319103#comment-14319103 ] Colin Patrick McCabe edited comment on HDFS-7083 at 2/12/15 10:12 PM: ---

[jira] [Commented] (HDFS-7083) TestDecommission#testIncludeByRegistrationName sometimes fails

[ https://issues.apache.org/jira/browse/HDFS-7083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319103#comment-14319103 ] Colin Patrick McCabe commented on HDFS-7083: Ted, this is a duplicate of HDFS-7

[jira] [Reopened] (HDFS-7083) TestDecommission#testIncludeByRegistrationName sometimes fails

[ https://issues.apache.org/jira/browse/HDFS-7083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe reopened HDFS-7083: > TestDecommission#testIncludeByRegistrationName sometimes fails > --

[jira] [Commented] (HDFS-7784) load fsimage in parallel

[ https://issues.apache.org/jira/browse/HDFS-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319097#comment-14319097 ] Colin Patrick McCabe commented on HDFS-7784: Hi Walter, this is an interesting

[jira] [Updated] (HDFS-7684) The host:port settings of dfs.namenode.secondary.http-address should be trimmed before use

[ https://issues.apache.org/jira/browse/HDFS-7684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7684: Target Version/s: 2.7.0 Hadoop Flags: Reviewed +1 for patch v004, pending Jenkins run. Akira

[jira] [Commented] (HDFS-7686) Re-add rapid rescan of possibly corrupt block feature to the block scanner

[ https://issues.apache.org/jira/browse/HDFS-7686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319074#comment-14319074 ] Hadoop QA commented on HDFS-7686: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-7773) Additional metrics in HDFS to be accessed via jmx.

[ https://issues.apache.org/jira/browse/HDFS-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7773: Summary: Additional metrics in HDFS to be accessed via jmx. (was: Improved HDFS dashboard) > Additi

[jira] [Commented] (HDFS-7764) DirectoryScanner should cancel the future tasks when #compileReport throws exception

[ https://issues.apache.org/jira/browse/HDFS-7764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319069#comment-14319069 ] Colin Patrick McCabe commented on HDFS-7764: Can you explain why we would want

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319067#comment-14319067 ] Tsz Wo Nicholas Sze commented on HDFS-7648: --- I see Colin that point that before w

[jira] [Commented] (HDFS-7758) Retire FsDatasetSpi#getVolumes() and use FsDatasetSpi#getVolumeRefs() instead

[ https://issues.apache.org/jira/browse/HDFS-7758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319063#comment-14319063 ] Colin Patrick McCabe commented on HDFS-7758: Thanks for taking this on, Eddy.

[jira] [Commented] (HDFS-7790) Do not create optional fields in DFSInputStream unless they are needed

[ https://issues.apache.org/jira/browse/HDFS-7790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319062#comment-14319062 ] Hadoop QA commented on HDFS-7790: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7684) The host:port settings of dfs.namenode.secondary.http-address should be trimmed before use

[ https://issues.apache.org/jira/browse/HDFS-7684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319042#comment-14319042 ] Anu Engineer commented on HDFS-7684: Addressed comments from [~cnauroth] and [~ajisaka

[jira] [Updated] (HDFS-7684) The host:port settings of dfs.namenode.secondary.http-address should be trimmed before use

[ https://issues.apache.org/jira/browse/HDFS-7684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-7684: --- Attachment: HDFS-7684.004.patch > The host:port settings of dfs.namenode.secondary.http-address should

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319033#comment-14319033 ] Colin Patrick McCabe commented on HDFS-7648: bq. should the block report includ

[jira] [Commented] (HDFS-7729) Add logic to DFSOutputStream to support writing a file in striping layout

[ https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319034#comment-14319034 ] Jing Zhao commented on HDFS-7729: - My main concern is that whether we can/should now define

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319028#comment-14319028 ] Tsz Wo Nicholas Sze commented on HDFS-7648: --- [~cmccabe], I means these questions:

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319015#comment-14319015 ] Colin Patrick McCabe commented on HDFS-7648: Hi [~szetszwo], since you suggeste

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319000#comment-14319000 ] Tsz Wo Nicholas Sze commented on HDFS-7648: --- [~cmccabe], in case that you missed

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14318996#comment-14318996 ] Colin Patrick McCabe commented on HDFS-7648: If there are a bunch of files in t

[jira] [Updated] (HDFS-7686) Re-add rapid rescan of possibly corrupt block feature to the block scanner

[ https://issues.apache.org/jira/browse/HDFS-7686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7686: --- Attachment: HDFS-7686.004.patch > Re-add rapid rescan of possibly corrupt block feature

[jira] [Commented] (HDFS-7430) Rewrite the BlockScanner to use O(1) memory and use multiple threads

[ https://issues.apache.org/jira/browse/HDFS-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14318984#comment-14318984 ] Colin Patrick McCabe commented on HDFS-7430: Once HDFS-7686 is committed (shoul

[jira] [Commented] (HDFS-7496) Fix FsVolume removal race conditions on the DataNode by reference-counting the volume instances

[ https://issues.apache.org/jira/browse/HDFS-7496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14318982#comment-14318982 ] Colin Patrick McCabe commented on HDFS-7496: Good find, [~cnauroth]! > Fix FsV

[jira] [Commented] (HDFS-6994) libhdfs3 - A native C/C++ HDFS client

[ https://issues.apache.org/jira/browse/HDFS-6994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14318978#comment-14318978 ] Colin Patrick McCabe commented on HDFS-6994: bq. As the existing native code in

[jira] [Updated] (HDFS-7720) Quota by Storage Type API, tools and ClientNameNode Protocol changes

[ https://issues.apache.org/jira/browse/HDFS-7720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7720: Fix Version/s: (was: 3.0.0) 2.7.0 > Quota by Storage Type API, tools and Clien

[jira] [Commented] (HDFS-7684) The host:port settings of dfs.namenode.secondary.http-address should be trimmed before use

[ https://issues.apache.org/jira/browse/HDFS-7684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14318961#comment-14318961 ] Akira AJISAKA commented on HDFS-7684: - bq. Trimming in NetUtils might be a valuable add

[jira] [Updated] (HDFS-7723) Quota By Storage Type namenode implemenation

[ https://issues.apache.org/jira/browse/HDFS-7723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7723: - Affects Version/s: (was: 3.0.0) > Quota By Storage Type namenode implemenation > --

  1   2   3   >