[jira] [Commented] (HDFS-7929) inotify unable fetch pre-upgrade edit log segments once upgrade starts

[ https://issues.apache.org/jira/browse/HDFS-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14560184#comment-14560184 ] Colin Patrick McCabe commented on HDFS-7929: The time needed to copy over the

[jira] [Commented] (HDFS-8479) Erasure coding: fix striping related logic in FSDirWriteFileOp to sync with HDFS-8421

[ https://issues.apache.org/jira/browse/HDFS-8479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14560236#comment-14560236 ] Hadoop QA commented on HDFS-8479: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Work started] (HDFS-8482) Merge BlockInfo from HDFS-7285 branch to trunk

[ https://issues.apache.org/jira/browse/HDFS-8482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-8482 started by Zhe Zhang. --- Merge BlockInfo from HDFS-7285 branch to trunk

[jira] [Commented] (HDFS-8453) Erasure coding: properly assign start offset for internal blocks in a block group

[ https://issues.apache.org/jira/browse/HDFS-8453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14560258#comment-14560258 ] Walter Su commented on HDFS-8453: - I didn't see any difference between

[jira] [Commented] (HDFS-8481) Erasure coding: remove workarounds for codec calculation

[ https://issues.apache.org/jira/browse/HDFS-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14560267#comment-14560267 ] Kai Zheng commented on HDFS-8481: - Thanks Zhe for the follow-on. Would this take care of

[jira] [Commented] (HDFS-8429) The DomainSocketWatcher thread should not block other threads if it dies

[ https://issues.apache.org/jira/browse/HDFS-8429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14560303#comment-14560303 ] zhouyingchao commented on HDFS-8429: Colin, thank you for pointing out this issue.

[jira] [Commented] (HDFS-8481) Erasure coding: remove workarounds for codec calculation

[ https://issues.apache.org/jira/browse/HDFS-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14560318#comment-14560318 ] Zhe Zhang commented on HDFS-8481: - Yes this aims to take care of both client and DN sides.

[jira] [Updated] (HDFS-8467) [HDFS-Quota]Quota is getting updated after storage policy is modified even before mover command is executed.

[ https://issues.apache.org/jira/browse/HDFS-8467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8467: - Labels: QBST (was: ) [HDFS-Quota]Quota is getting updated after storage policy is modified even before

[jira] [Resolved] (HDFS-8465) Mover is success even when space exceeds storage quota.

[ https://issues.apache.org/jira/browse/HDFS-8465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDFS-8465. -- Resolution: Not A Problem Thanks [~szetszwo] for providing the context information about Mover.

[jira] [Updated] (HDFS-8465) Mover is success even when space exceeds storage quota.

[ https://issues.apache.org/jira/browse/HDFS-8465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8465: - Labels: QBST (was: ) Mover is success even when space exceeds storage quota.

[jira] [Updated] (HDFS-7609) startup used too much time to load edits

[ https://issues.apache.org/jira/browse/HDFS-7609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-7609: -- Attachment: HDFS-7609-2.patch [~jingzhao] you are right. It is possible that nn starts the transition right

[jira] [Updated] (HDFS-8482) Merge BlockInfo from HDFS-7285 branch to trunk

[ https://issues.apache.org/jira/browse/HDFS-8482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8482: Affects Version/s: 2.7.0 Merge BlockInfo from HDFS-7285 branch to trunk

[jira] [Commented] (HDFS-8306) Generate ACL and Xattr outputs in OIV XML outputs

[ https://issues.apache.org/jira/browse/HDFS-8306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14560315#comment-14560315 ] Hadoop QA commented on HDFS-8306: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8062) Remove hard-coded values in favor of EC schema

[ https://issues.apache.org/jira/browse/HDFS-8062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14560150#comment-14560150 ] Kai Sasaki commented on HDFS-8062: -- [~drankye] Thank you for reviewing! Because HDFS-7285

[jira] [Resolved] (HDFS-8467) [HDFS-Quota]Quota is getting updated after storage policy is modified even before mover command is executed.

[ https://issues.apache.org/jira/browse/HDFS-8467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDFS-8467. -- Resolution: Not A Problem I'm resolving this issue as by design. Let me know if you think it

[jira] [Created] (HDFS-8482) Merge BlockInfo from HDFS-7285 branch to trunk

Zhe Zhang created HDFS-8482: --- Summary: Merge BlockInfo from HDFS-7285 branch to trunk Key: HDFS-8482 URL: https://issues.apache.org/jira/browse/HDFS-8482 Project: Hadoop HDFS Issue Type: New

[jira] [Commented] (HDFS-8407) libhdfs hdfsListDirectory() API has different behavior than documentation

[ https://issues.apache.org/jira/browse/HDFS-8407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14560270#comment-14560270 ] Masatake Iwasaki commented on HDFS-8407: The test failures seem not to be related

[jira] [Updated] (HDFS-8429) The DomainSocketWatcher thread should not block other threads if it dies

[ https://issues.apache.org/jira/browse/HDFS-8429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-8429: --- Attachment: HDFS-8429-003.patch Tested cases include TestParallelShortCircuitLegacyRead,

[jira] [Commented] (HDFS-7609) startup used too much time to load edits

[ https://issues.apache.org/jira/browse/HDFS-7609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14560362#comment-14560362 ] Hadoop QA commented on HDFS-7609: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8409) HDFS client RPC call throws java.lang.IllegalStateException

[ https://issues.apache.org/jira/browse/HDFS-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14560345#comment-14560345 ] Hadoop QA commented on HDFS-8409: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8475) Exception in createBlockOutputStream java.io.EOFException: Premature EOF: no length prefix available

[ https://issues.apache.org/jira/browse/HDFS-8475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14560374#comment-14560374 ] nijel commented on HDFS-8475: - hi [~Vinod08] Looks like you have only one valid datanode

[jira] [Created] (HDFS-8483) Erasure coding: test DataNode reporting bad/corrupted blocks which belongs to a striped block.

Takanobu Asanuma created HDFS-8483: -- Summary: Erasure coding: test DataNode reporting bad/corrupted blocks which belongs to a striped block. Key: HDFS-8483 URL: https://issues.apache.org/jira/browse/HDFS-8483

[jira] [Updated] (HDFS-8483) Erasure coding: test DataNode reporting bad/corrupted blocks which belongs to a striped block.

[ https://issues.apache.org/jira/browse/HDFS-8483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-8483: --- Issue Type: Sub-task (was: Test) Parent: HDFS-7285 Erasure coding: test DataNode

[jira] [Commented] (HDFS-8429) The DomainSocketWatcher thread should not block other threads if it dies

[ https://issues.apache.org/jira/browse/HDFS-8429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14560341#comment-14560341 ] Hadoop QA commented on HDFS-8429: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8475) Exception in createBlockOutputStream java.io.EOFException: Premature EOF: no length prefix available

[ https://issues.apache.org/jira/browse/HDFS-8475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14560451#comment-14560451 ] Vinod Valecha commented on HDFS-8475: - Hi nijel, Thanks for replying. Can you pls tell

[jira] [Commented] (HDFS-8465) Mover is success even when space exceeds storage quota.

[ https://issues.apache.org/jira/browse/HDFS-8465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14558739#comment-14558739 ] surendra singh lilhore commented on HDFS-8465: -- Thansks [~xyao] and

[jira] [Commented] (HDFS-8399) Erasure Coding: BlockManager is unnecessarily computing recovery work for the deleted blocks

[ https://issues.apache.org/jira/browse/HDFS-8399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14558732#comment-14558732 ] Yi Liu commented on HDFS-8399: -- Hi [~rakeshr], I just noticed your comments, sorry for late

[jira] [Commented] (HDFS-8453) Erasure coding: properly assign start offset for internal blocks in a block group

[ https://issues.apache.org/jira/browse/HDFS-8453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14558786#comment-14558786 ] Hadoop QA commented on HDFS-8453: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Assigned] (HDFS-4977) Change Checkpoint Size of web ui of SecondaryNameNode

[ https://issues.apache.org/jira/browse/HDFS-4977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kanaka kumar avvaru reassigned HDFS-4977: - Assignee: kanaka kumar avvaru Change Checkpoint Size of web ui of

[jira] [Updated] (HDFS-5931) Potential bugs and improvements for exception handlers

[ https://issues.apache.org/jira/browse/HDFS-5931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kanaka kumar avvaru updated HDFS-5931: -- Status: Open (was: Patch Available) Will update the patch for QA reported errors.

[jira] [Commented] (HDFS-4977) Change Checkpoint Size of web ui of SecondaryNameNode

[ https://issues.apache.org/jira/browse/HDFS-4977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14558877#comment-14558877 ] kanaka kumar avvaru commented on HDFS-4977: --- [~ sinchii] , I am planning handle

[jira] [Assigned] (HDFS-5931) Potential bugs and improvements for exception handlers

[ https://issues.apache.org/jira/browse/HDFS-5931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kanaka kumar avvaru reassigned HDFS-5931: - Assignee: kanaka kumar avvaru Potential bugs and improvements for exception

[jira] [Commented] (HDFS-8475) Exception in createBlockOutputStream java.io.EOFException: Premature EOF: no length prefix available

[ https://issues.apache.org/jira/browse/HDFS-8475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14558897#comment-14558897 ] Vinod Valecha commented on HDFS-8475: - Hi Team, Any Idea when this will be assigned to

[jira] [Commented] (HDFS-5033) Bad error message for fs -put/copyFromLocal if user doesn't have permissions to read the source

[ https://issues.apache.org/jira/browse/HDFS-5033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14558854#comment-14558854 ] Akira AJISAKA commented on HDFS-5033: - Thanks [~d4rr3ll] for taking this issue. First

[jira] [Assigned] (HDFS-8476) quota can't limit the file which put before setting the storage policy

[ https://issues.apache.org/jira/browse/HDFS-8476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kanaka kumar avvaru reassigned HDFS-8476: - Assignee: kanaka kumar avvaru quota can't limit the file which put before

[jira] [Created] (HDFS-8476) quota can't limit the file which put before setting the storage policy

tongshiquan created HDFS-8476: - Summary: quota can't limit the file which put before setting the storage policy Key: HDFS-8476 URL: https://issues.apache.org/jira/browse/HDFS-8476 Project: Hadoop HDFS

[jira] [Updated] (HDFS-8476) quota can't limit the file which put before setting the storage policy

[ https://issues.apache.org/jira/browse/HDFS-8476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tongshiquan updated HDFS-8476: -- Description: test steps: 1. hdfs dfs -mkdir /HOT 2. hdfs dfs -put 1G.txt /HOT/file1 3. hdfs dfsadmin

[jira] [Updated] (HDFS-8443) Document dfs.namenode.service.handler.count in hdfs-site.xml

[ https://issues.apache.org/jira/browse/HDFS-8443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-8443: - Attachment: HDFS-8443.3.patch Thanks [~ajisakaa] for reviewing. Updated the patch as per the comments.

[jira] [Commented] (HDFS-8319) Erasure Coding: support decoding for stateful read

[ https://issues.apache.org/jira/browse/HDFS-8319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14558978#comment-14558978 ] Walter Su commented on HDFS-8319: - 1. {code} int len = (int) (rangeEndInBlockGroup -

[jira] [Updated] (HDFS-8234) DistributedFileSystem and Globber should apply PathFilter early

[ https://issues.apache.org/jira/browse/HDFS-8234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-8234: - Attachment: HDFS-8234.2.patch Attached an updated patch fixing the checkstyle comments. Please review.

[jira] [Updated] (HDFS-8385) Remove unused entities (variables,methods and configurations)

[ https://issues.apache.org/jira/browse/HDFS-8385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-8385: - Attachment: HDFS-8385.2.patch Attached an updated patch. Please review. Remove unused entities

[jira] [Commented] (HDFS-8319) Erasure Coding: support decoding for stateful read

[ https://issues.apache.org/jira/browse/HDFS-8319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14559029#comment-14559029 ] Walter Su commented on HDFS-8319: - 9. Pread create block reader at

[jira] [Created] (HDFS-8477) Missing ZKFC config keys can be added to hdfs-default.xml and HDFSHighAvailabilityWithQJM.md

kanaka kumar avvaru created HDFS-8477: - Summary: Missing ZKFC config keys can be added to hdfs-default.xml and HDFSHighAvailabilityWithQJM.md Key: HDFS-8477 URL:

[jira] [Commented] (HDFS-8385) Remove unused entities (variables,methods and configurations)

[ https://issues.apache.org/jira/browse/HDFS-8385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14559034#comment-14559034 ] Hadoop QA commented on HDFS-8385: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8453) Erasure coding: properly assign start offset for internal blocks in a block group

[ https://issues.apache.org/jira/browse/HDFS-8453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8453: Description: {code} void actualGetFromOneDataNode(final DNAddrPair datanode, ... LocatedBlock

[jira] [Commented] (HDFS-8453) Erasure coding: properly assign start offset for internal blocks in a block group

[ https://issues.apache.org/jira/browse/HDFS-8453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14559096#comment-14559096 ] Walter Su commented on HDFS-8453: - {code} + bg.getStartOffset(), bg.isCorrupt(),

[jira] [Commented] (HDFS-8322) Display warning if hadoop fs -ls is showing the local filesystem

[ https://issues.apache.org/jira/browse/HDFS-8322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14559517#comment-14559517 ] Allen Wittenauer commented on HDFS-8322: Frankly, this seems like unnecessary

[jira] [Commented] (HDFS-8478) Improve Solaris support in HDFS

[ https://issues.apache.org/jira/browse/HDFS-8478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14559595#comment-14559595 ] Alan Burlison commented on HDFS-8478: - Solaris-related changes to HADOOP and HDFS are

[jira] [Commented] (HDFS-8478) Improve Solaris support in HDFS

[ https://issues.apache.org/jira/browse/HDFS-8478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14559597#comment-14559597 ] Alan Burlison commented on HDFS-8478: - Solaris-related changes to HADOOP and YARN are

[jira] [Commented] (HDFS-8319) Erasure Coding: support decoding for stateful read

[ https://issues.apache.org/jira/browse/HDFS-8319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14559508#comment-14559508 ] Jing Zhao commented on HDFS-8319: - Thanks for the review, [~walter.k.su]. Replied your

[jira] [Created] (HDFS-8478) Improve Solaris support in HDFS

Alan Burlison created HDFS-8478: --- Summary: Improve Solaris support in HDFS Key: HDFS-8478 URL: https://issues.apache.org/jira/browse/HDFS-8478 Project: Hadoop HDFS Issue Type: New Feature

[jira] [Commented] (HDFS-8078) HDFS client gets errors trying to to connect to IPv6 DataNode

[ https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14559776#comment-14559776 ] Nate Edel commented on HDFS-8078: - Right now this was the only Java-code patch needed to

[jira] [Commented] (HDFS-7991) Allow users to skip checkpoint when stopping NameNode

[ https://issues.apache.org/jira/browse/HDFS-7991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14559813#comment-14559813 ] Jing Zhao commented on HDFS-7991: - We can use this jira just to remove the original

[jira] [Reopened] (HDFS-8322) Display warning if hadoop fs -ls is showing the local filesystem

[ https://issues.apache.org/jira/browse/HDFS-8322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu reopened HDFS-8322: - Re-open to put warnings behind an optional configuration. Display warning if hadoop fs -ls is

[jira] [Commented] (HDFS-8407) libhdfs hdfsListDirectory() API has different behavior than documentation

[ https://issues.apache.org/jira/browse/HDFS-8407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14559753#comment-14559753 ] Colin Patrick McCabe commented on HDFS-8407: +1 pending jenkins. Thanks,

[jira] [Updated] (HDFS-8407) libhdfs hdfsListDirectory() API has different behavior than documentation

[ https://issues.apache.org/jira/browse/HDFS-8407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8407: --- Target Version/s: 2.8.0 Status: Patch Available (was: Open) libhdfs

[jira] [Commented] (HDFS-8429) Death of watcherThread making other local read blocked

[ https://issues.apache.org/jira/browse/HDFS-8429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14559778#comment-14559778 ] Colin Patrick McCabe commented on HDFS-8429: One thing that I am concerned

[jira] [Updated] (HDFS-8429) The DomainSocketWatcher thread should not block other threads if it dies

[ https://issues.apache.org/jira/browse/HDFS-8429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8429: --- Summary: The DomainSocketWatcher thread should not block other threads if it dies

[jira] [Commented] (HDFS-8078) HDFS client gets errors trying to to connect to IPv6 DataNode

[ https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14559707#comment-14559707 ] Colin Patrick McCabe commented on HDFS-8078: Thanks, [~nkedel]. I understand

[jira] [Created] (HDFS-8479) Erasure coding: fix striping related logic in FSDirWriteFileOp to sync with HDFS-8421

Zhe Zhang created HDFS-8479: --- Summary: Erasure coding: fix striping related logic in FSDirWriteFileOp to sync with HDFS-8421 Key: HDFS-8479 URL: https://issues.apache.org/jira/browse/HDFS-8479 Project:

[jira] [Commented] (HDFS-8344) NameNode doesn't recover lease for files with missing blocks

[ https://issues.apache.org/jira/browse/HDFS-8344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14559641#comment-14559641 ] Ravi Prakash commented on HDFS-8344: It also seems that hsync simply waits for the

[jira] [Commented] (HDFS-8306) Generate ACL and Xattr outputs in OIV XML outputs

[ https://issues.apache.org/jira/browse/HDFS-8306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14559838#comment-14559838 ] Hadoop QA commented on HDFS-8306: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8479) Erasure coding: fix striping related logic in FSDirWriteFileOp to sync with HDFS-8421

[ https://issues.apache.org/jira/browse/HDFS-8479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8479: Attachment: HDFS-8479-HDFS-7285.0.patch Erasure coding: fix striping related logic in FSDirWriteFileOp to

[jira] [Updated] (HDFS-8322) Display warning if hadoop fs -ls is showing the local filesystem

[ https://issues.apache.org/jira/browse/HDFS-8322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-8322: Attachment: HDFS-8322.001.patch Updated the patch to add an optional configuration, to disable

[jira] [Commented] (HDFS-8453) Erasure coding: properly assign start offset for internal blocks in a block group

[ https://issues.apache.org/jira/browse/HDFS-8453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14559872#comment-14559872 ] Zhe Zhang commented on HDFS-8453: - Thanks Walter for the review. Sorry about the confusion.

[jira] [Updated] (HDFS-8479) Erasure coding: fix striping related logic in FSDirWriteFileOp to sync with HDFS-8421

[ https://issues.apache.org/jira/browse/HDFS-8479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8479: Status: Patch Available (was: Open) The patch is actually simpler than I expected. Through all EC patches

[jira] [Commented] (HDFS-6022) Moving deadNodes from being thread local. Improving dead datanode handling in DFSClient

[ https://issues.apache.org/jira/browse/HDFS-6022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14559892#comment-14559892 ] Colin Patrick McCabe commented on HDFS-6022: Hi [~iwasakims], feel free to take

[jira] [Commented] (HDFS-8443) Document dfs.namenode.service.handler.count in hdfs-site.xml

[ https://issues.apache.org/jira/browse/HDFS-8443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14559207#comment-14559207 ] Hadoop QA commented on HDFS-8443: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8234) DistributedFileSystem and Globber should apply PathFilter early

[ https://issues.apache.org/jira/browse/HDFS-8234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14559232#comment-14559232 ] Hadoop QA commented on HDFS-8234: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8401) Memfs - a layered file system for in-memory storage in HDFS

[ https://issues.apache.org/jira/browse/HDFS-8401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14560011#comment-14560011 ] Arpit Agarwal commented on HDFS-8401: - bq. I'm not sure I see the advantage of having a

[jira] [Updated] (HDFS-8480) Fix performance and timeout issues in HDFS-7929: use hard-links instead of copying edit logs

[ https://issues.apache.org/jira/browse/HDFS-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8480: Summary: Fix performance and timeout issues in HDFS-7929: use hard-links instead of copying edit logs (was:

[jira] [Commented] (HDFS-8479) Erasure coding: fix striping related logic in FSDirWriteFileOp to sync with HDFS-8421

[ https://issues.apache.org/jira/browse/HDFS-8479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14560097#comment-14560097 ] Jing Zhao commented on HDFS-8479: - Looks like the failure is caused by HADOOP-11847. I will

[jira] [Updated] (HDFS-8476) quota can't limit the file which put before setting the storage policy

[ https://issues.apache.org/jira/browse/HDFS-8476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8476: - Labels: QBST (was: ) quota can't limit the file which put before setting the storage policy

[jira] [Updated] (HDFS-8409) HDFS client RPC call throws java.lang.IllegalStateException

[ https://issues.apache.org/jira/browse/HDFS-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-8409: -- Attachment: HDFS-8409.003.patch Fix whitespace. The failed test is not related to my change and it passes

[jira] [Commented] (HDFS-8479) Erasure coding: fix striping related logic in FSDirWriteFileOp to sync with HDFS-8421

[ https://issues.apache.org/jira/browse/HDFS-8479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14560068#comment-14560068 ] Zhe Zhang commented on HDFS-8479: - Thanks Jing for the review! Erasure coding: fix

[jira] [Updated] (HDFS-8479) Erasure coding: fix striping related logic in FSDirWriteFileOp to sync with HDFS-8421

[ https://issues.apache.org/jira/browse/HDFS-8479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8479: Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed Status: Resolved

[jira] [Commented] (HDFS-8479) Erasure coding: fix striping related logic in FSDirWriteFileOp to sync with HDFS-8421

[ https://issues.apache.org/jira/browse/HDFS-8479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14560114#comment-14560114 ] Jing Zhao commented on HDFS-8479: - Maybe we can open a new jira to include this change and

[jira] [Commented] (HDFS-7984) webhdfs:// needs to support provided delegation tokens

[ https://issues.apache.org/jira/browse/HDFS-7984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14560039#comment-14560039 ] Anthony Hsu commented on HDFS-7984: --- Actually, it seems that WebHdfsFileSystem *does* use

[jira] [Updated] (HDFS-8306) Generate ACL and Xattr outputs in OIV XML outputs

[ https://issues.apache.org/jira/browse/HDFS-8306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-8306: Attachment: HDFS-8306.debug1.patch Change {{PrintStream}} to utf8 as well. Generate ACL and Xattr

[jira] [Commented] (HDFS-8479) Erasure coding: fix striping related logic in FSDirWriteFileOp to sync with HDFS-8421

[ https://issues.apache.org/jira/browse/HDFS-8479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14560103#comment-14560103 ] Zhe Zhang commented on HDFS-8479: - Thanks Jing. I was about the include the following

[jira] [Created] (HDFS-8481) Erasure coding: remove workarounds for codec calculation

Zhe Zhang created HDFS-8481: --- Summary: Erasure coding: remove workarounds for codec calculation Key: HDFS-8481 URL: https://issues.apache.org/jira/browse/HDFS-8481 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-8479) Erasure coding: fix striping related logic in FSDirWriteFileOp to sync with HDFS-8421

[ https://issues.apache.org/jira/browse/HDFS-8479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14560067#comment-14560067 ] Jing Zhao commented on HDFS-8479: - Thanks for the merge, Zhe! The patch looks pretty good

[jira] [Created] (HDFS-8480) Fixing performance and timeout issues in HDFS-7929: use hard-links instead of copying edit logs

Zhe Zhang created HDFS-8480: --- Summary: Fixing performance and timeout issues in HDFS-7929: use hard-links instead of copying edit logs Key: HDFS-8480 URL: https://issues.apache.org/jira/browse/HDFS-8480

[jira] [Commented] (HDFS-8479) Erasure coding: fix striping related logic in FSDirWriteFileOp to sync with HDFS-8421

[ https://issues.apache.org/jira/browse/HDFS-8479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14560084#comment-14560084 ] Jing Zhao commented on HDFS-8479: - BTW, while running tests after the merge, I got this

[jira] [Commented] (HDFS-8479) Erasure coding: fix striping related logic in FSDirWriteFileOp to sync with HDFS-8421

[ https://issues.apache.org/jira/browse/HDFS-8479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14560120#comment-14560120 ] Zhe Zhang commented on HDFS-8479: - Good idea Jing. I just filed HDFS-8481 --- Zhe Zhang

[jira] [Commented] (HDFS-8476) quota can't limit the file which put before setting the storage policy

[ https://issues.apache.org/jira/browse/HDFS-8476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14560140#comment-14560140 ] Xiaoyu Yao commented on HDFS-8476: -- [~tongshiquan], thanks for reporting the issue. I

[jira] [Updated] (HDFS-8306) Generate ACL and Xattr outputs in OIV XML outputs

[ https://issues.apache.org/jira/browse/HDFS-8306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-8306: Attachment: HDFS-8306.debug0.patch Still can not reproduce the error on both OSX and Linux machines.

[jira] [Commented] (HDFS-8322) Display warning if hadoop fs -ls is showing the local filesystem

[ https://issues.apache.org/jira/browse/HDFS-8322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14559469#comment-14559469 ] Lei (Eddy) Xu commented on HDFS-8322: - Hey, [~aw]. We'd still like to have this