[jira] [Updated] (HDFS-8669) Erasure Coding: handle missing internal block locations in DFSStripedInputStream

[ https://issues.apache.org/jira/browse/HDFS-8669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8669: Attachment: HDFS-8669-HDFS-7285.001.patch LGTM. +1. Upload patch for Jing Zhao to trigger Jenkins. Erasure

[jira] [Commented] (HDFS-8734) Erasure Coding: fix one cell need two packets

[ https://issues.apache.org/jira/browse/HDFS-8734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14624398#comment-14624398 ] Hadoop QA commented on HDFS-8734: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8578: Attachment: HDFS-8578-05.patch Attached the patch with checkstyle,whitespace and test failures On

[jira] [Comment Edited] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14624473#comment-14624473 ] Vinayakumar B edited comment on HDFS-8578 at 7/13/15 10:03 AM:

[jira] [Commented] (HDFS-8742) Inotify: Support event for OP_TRUNCATE

[ https://issues.apache.org/jira/browse/HDFS-8742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14624588#comment-14624588 ] Surendra Singh Lilhore commented on HDFS-8742: -- Thanks [~ajisakaa] for

[jira] [Commented] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14624420#comment-14624420 ] Kai Sasaki commented on HDFS-8287: -- [~walter.k.su] Thank you so much for clarifying. I can

[jira] [Updated] (HDFS-8669) Erasure Coding: handle missing internal block locations in DFSStripedInputStream

[ https://issues.apache.org/jira/browse/HDFS-8669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8669: Status: Patch Available (was: Open) Erasure Coding: handle missing internal block locations in

[jira] [Updated] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8578: Attachment: HDFS-8578-05.patch Fixed checkstyle and whitespace warnings. Please review. On

[jira] [Commented] (HDFS-8742) Inotify: Support event for OP_TRUNCATE

[ https://issues.apache.org/jira/browse/HDFS-8742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14624412#comment-14624412 ] Akira AJISAKA commented on HDFS-8742: - Thanks [~surendrasingh] for creating the patch.

[jira] [Updated] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8578: Attachment: (was: HDFS-8578-05.patch) On upgrade, Datanode should process all storage/data dirs

[jira] [Commented] (HDFS-8702) Erasure coding: update BlockManager.blockHasEnoughRacks(..) logic for striped block

[ https://issues.apache.org/jira/browse/HDFS-8702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14624559#comment-14624559 ] Hadoop QA commented on HDFS-8702: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8742) Inotify: Support event for OP_TRUNCATE

[ https://issues.apache.org/jira/browse/HDFS-8742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-8742: - Attachment: HDFS-8742-001.patch Inotify: Support event for OP_TRUNCATE

[jira] [Commented] (HDFS-8669) Erasure Coding: handle missing internal block locations in DFSStripedInputStream

[ https://issues.apache.org/jira/browse/HDFS-8669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14624549#comment-14624549 ] Hadoop QA commented on HDFS-8669: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8702) Erasure coding: update BlockManager.blockHasEnoughRacks(..) logic for striped block

[ https://issues.apache.org/jira/browse/HDFS-8702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14624600#comment-14624600 ] Walter Su commented on HDFS-8702: - Upload a wrong file by accident? Could you upload again?

[jira] [Commented] (HDFS-8728) Erasure coding: revisit and simplify BlockInfoStriped and INodeFile

[ https://issues.apache.org/jira/browse/HDFS-8728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625742#comment-14625742 ] Andrew Wang commented on HDFS-8728: --- Hi Zhe, I took a look at patch #3 and a few other

[jira] [Commented] (HDFS-8702) Erasure coding: update BlockManager.blockHasEnoughRacks(..) logic for striped block

[ https://issues.apache.org/jira/browse/HDFS-8702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625774#comment-14625774 ] Hadoop QA commented on HDFS-8702: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8728) Erasure coding: revisit and simplify BlockInfoStriped and INodeFile

[ https://issues.apache.org/jira/browse/HDFS-8728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625862#comment-14625862 ] Zhe Zhang commented on HDFS-8728: - Thanks [~szetszwo] for raising the discussion. We have

[jira] [Commented] (HDFS-8702) Erasure coding: update BlockManager.blockHasEnoughRacks(..) logic for striped block

[ https://issues.apache.org/jira/browse/HDFS-8702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625762#comment-14625762 ] Kai Sasaki commented on HDFS-8702: -- [~walter.k.su] Thank you so much for reviewing. In

[jira] [Commented] (HDFS-8728) Erasure coding: revisit and simplify BlockInfoStriped and INodeFile

[ https://issues.apache.org/jira/browse/HDFS-8728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625761#comment-14625761 ] Hadoop QA commented on HDFS-8728: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8734) Erasure Coding: fix one cell need two packets

[ https://issues.apache.org/jira/browse/HDFS-8734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625852#comment-14625852 ] Li Bo commented on HDFS-8734: - Thanks for Walter's effort on this jira. Please see my review as

[jira] [Commented] (HDFS-8058) Erasure coding: use BlockInfo[] for both striped and contiguous blocks in INodeFile

[ https://issues.apache.org/jira/browse/HDFS-8058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14624677#comment-14624677 ] Walter Su commented on HDFS-8058: - Since FileWithStripedBlocksFeature is gone, my previous

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14624646#comment-14624646 ] Hadoop QA commented on HDFS-8578: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8750) FIleSystem does not honor Configuration.getClassLoader() while loading FileSystem implementations

[ https://issues.apache.org/jira/browse/HDFS-8750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14624639#comment-14624639 ] kanaka kumar avvaru commented on HDFS-8750: --- OK seems reasonable to try first

[jira] [Updated] (HDFS-7314) When the DFSClient lease cannot be renewed, abort open-for-write files rather than the entire DFSClient

[ https://issues.apache.org/jira/browse/HDFS-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-7314: -- Attachment: HDFS-7314-9.patch Thanks [~cmccabe]. Here is the update patch with your suggestion. I will open a

[jira] [Assigned] (HDFS-8767) RawLocalFileSystem.listStatus() returns null for UNIX pipefile

[ https://issues.apache.org/jira/browse/HDFS-8767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kanaka kumar avvaru reassigned HDFS-8767: - Assignee: kanaka kumar avvaru RawLocalFileSystem.listStatus() returns null for

[jira] [Commented] (HDFS-8702) Erasure coding: update BlockManager.blockHasEnoughRacks(..) logic for striped block

[ https://issues.apache.org/jira/browse/HDFS-8702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625688#comment-14625688 ] Kai Sasaki commented on HDFS-8702: -- Oh, I re-uploaded patch to make sure. Thanks!

[jira] [Commented] (HDFS-8058) Erasure coding: use BlockInfo[] for both striped and contiguous blocks in INodeFile

[ https://issues.apache.org/jira/browse/HDFS-8058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625697#comment-14625697 ] Yi Liu commented on HDFS-8058: -- Thanks Zhe for the patch and Jing for the review. I agree with

[jira] [Commented] (HDFS-8058) Erasure coding: use BlockInfo[] for both striped and contiguous blocks in INodeFile

[ https://issues.apache.org/jira/browse/HDFS-8058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625711#comment-14625711 ] Hadoop QA commented on HDFS-8058: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8702) Erasure coding: update BlockManager.blockHasEnoughRacks(..) logic for striped block

[ https://issues.apache.org/jira/browse/HDFS-8702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625718#comment-14625718 ] Walter Su commented on HDFS-8702: - bq. We should continue use the passed-in parameter

[jira] [Resolved] (HDFS-4746) ClassCastException in BlockManager.addStoredBlock() due to that blockReceived came after file was closed.

[ https://issues.apache.org/jira/browse/HDFS-4746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko resolved HDFS-4746. --- Resolution: Won't Fix Resolving as won't fix for 2.0 and 2.2. For subsequent versions

[jira] [Updated] (HDFS-8728) Erasure coding: revisit and simplify BlockInfoStriped and INodeFile

[ https://issues.apache.org/jira/browse/HDFS-8728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8728: Attachment: HDFS-8728-HDFS-7285.01.patch Forgot that the .00 patch requires HDFS-8058 patch. Uploading .01

[jira] [Updated] (HDFS-8669) Erasure Coding: handle missing internal block locations in DFSStripedInputStream

[ https://issues.apache.org/jira/browse/HDFS-8669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8669: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7285 Status: Resolved

[jira] [Reopened] (HDFS-8652) Track BlockInfo instead of Block in CorruptReplicasMap

[ https://issues.apache.org/jira/browse/HDFS-8652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao reopened HDFS-8652: - Track BlockInfo instead of Block in CorruptReplicasMap

[jira] [Resolved] (HDFS-8652) Track BlockInfo instead of Block in CorruptReplicasMap

[ https://issues.apache.org/jira/browse/HDFS-8652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-8652. - Resolution: Invalid Hadoop Flags: (was: Reviewed) Track BlockInfo instead of Block in

[jira] [Updated] (HDFS-8677) Ozone: Introduce KeyValueContainerDatasetSpi

[ https://issues.apache.org/jira/browse/HDFS-8677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8677: Attachment: HDFS-8677-HDFS-7240.05.patch Fix javadoc warnings. Ozone: Introduce

[jira] [Updated] (HDFS-8750) FIleSystem does not honor Configuration.getClassLoader() while loading FileSystem implementations

[ https://issues.apache.org/jira/browse/HDFS-8750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Himanshu updated HDFS-8750: --- Attachment: HDFS-8750.002.patch FIleSystem does not honor Configuration.getClassLoader() while loading

[jira] [Commented] (HDFS-8728) Erasure coding: revisit and simplify BlockInfoStriped and INodeFile

[ https://issues.apache.org/jira/browse/HDFS-8728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625132#comment-14625132 ] Hadoop QA commented on HDFS-8728: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-7314) When the DFSClient lease cannot be renewed, abort open-for-write files rather than the entire DFSClient

[ https://issues.apache.org/jira/browse/HDFS-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7314: --- Summary: When the DFSClient lease cannot be renewed, abort open-for-write files rather

[jira] [Commented] (HDFS-7483) Display information per tier on the Namenode UI

[ https://issues.apache.org/jira/browse/HDFS-7483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625202#comment-14625202 ] Hadoop QA commented on HDFS-7483: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8750) FIleSystem does not honor Configuration.getClassLoader() while loading FileSystem implementations

[ https://issues.apache.org/jira/browse/HDFS-8750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625136#comment-14625136 ] Himanshu commented on HDFS-8750: Thanks Kanaka. I updated the patch to actually become

[jira] [Assigned] (HDFS-8750) FIleSystem does not honor Configuration.getClassLoader() while loading FileSystem implementations

[ https://issues.apache.org/jira/browse/HDFS-8750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Himanshu reassigned HDFS-8750: -- Assignee: Himanshu (was: kanaka kumar avvaru) FIleSystem does not honor

[jira] [Updated] (HDFS-8652) Track BlockInfo instead of Block in CorruptReplicasMap

[ https://issues.apache.org/jira/browse/HDFS-8652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8652: Fix Version/s: (was: 2.8.0) Track BlockInfo instead of Block in CorruptReplicasMap

[jira] [Updated] (HDFS-8728) Erasure coding: revisit and simplify BlockInfoStriped and INodeFile

[ https://issues.apache.org/jira/browse/HDFS-8728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8728: Attachment: HDFS-8728-HDFS-7285.00.patch Updating {{HDFS-8728-HDFS-7285.00.patch}} which changes branch code

[jira] [Created] (HDFS-8765) Implement local block reader in libhdfspp

James Clampffer created HDFS-8765: - Summary: Implement local block reader in libhdfspp Key: HDFS-8765 URL: https://issues.apache.org/jira/browse/HDFS-8765 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-8764) Generate Hadoop RPC stubs from protobuf definitions

Haohui Mai created HDFS-8764: Summary: Generate Hadoop RPC stubs from protobuf definitions Key: HDFS-8764 URL: https://issues.apache.org/jira/browse/HDFS-8764 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-8742) Inotify: Support event for OP_TRUNCATE

[ https://issues.apache.org/jira/browse/HDFS-8742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14624882#comment-14624882 ] Hadoop QA commented on HDFS-8742: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-7483) Display information per tier on the Namenode UI

[ https://issues.apache.org/jira/browse/HDFS-7483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony updated HDFS-7483: --- Attachment: HDFS-7483-002.patch Display information per tier on the Namenode UI

[jira] [Updated] (HDFS-7483) Display information per tier on the Namenode UI

[ https://issues.apache.org/jira/browse/HDFS-7483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony updated HDFS-7483: --- Attachment: (was: HDFS-7483-002.patch) Display information per tier on the Namenode UI

[jira] [Commented] (HDFS-8669) Erasure Coding: handle missing internal block locations in DFSStripedInputStream

[ https://issues.apache.org/jira/browse/HDFS-8669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14624863#comment-14624863 ] Hadoop QA commented on HDFS-8669: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-7608) hdfs dfsclient newConnectedPeer has no write timeout

[ https://issues.apache.org/jira/browse/HDFS-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7608: --- Status: Patch Available (was: Open) hdfs dfsclient newConnectedPeer has no write

[jira] [Updated] (HDFS-8717) OzoneHandler : Add common bucket objects

[ https://issues.apache.org/jira/browse/HDFS-8717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-8717: --- Attachment: hdfs-8717-HDFS-7240.002.patch * Fix release audit warnings OzoneHandler : Add common

[jira] [Commented] (HDFS-8758) Implement the continuation library for libhdfspp

[ https://issues.apache.org/jira/browse/HDFS-8758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625282#comment-14625282 ] James Clampffer commented on HDFS-8758: --- Do we plan to support sockets and streams

[jira] [Commented] (HDFS-8356) Document missing properties in hdfs-default.xml

[ https://issues.apache.org/jira/browse/HDFS-8356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625319#comment-14625319 ] Ray Chiang commented on HDFS-8356: -- RE: Pre-patch findbugs Fixed in MAPREDUCE-6421 RE:

[jira] [Commented] (HDFS-8356) Document missing properties in hdfs-default.xml

[ https://issues.apache.org/jira/browse/HDFS-8356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625318#comment-14625318 ] Ray Chiang commented on HDFS-8356: -- RE: Pre-patch findbugs Fixed in MAPREDUCE-6421 RE:

[jira] [Commented] (HDFS-8759) Implement remote block reader in libhdfspp

[ https://issues.apache.org/jira/browse/HDFS-8759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625299#comment-14625299 ] James Clampffer commented on HDFS-8759: --- I think it would be worth adding some

[jira] [Created] (HDFS-8766) Implement a libhdfs(3) compatible API

James Clampffer created HDFS-8766: - Summary: Implement a libhdfs(3) compatible API Key: HDFS-8766 URL: https://issues.apache.org/jira/browse/HDFS-8766 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-8356) Document missing properties in hdfs-default.xml

[ https://issues.apache.org/jira/browse/HDFS-8356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625324#comment-14625324 ] Ray Chiang commented on HDFS-8356: -- Ugh, ignore last comments. Wrote to wrong JIRA.

[jira] [Commented] (HDFS-8058) Erasure coding: use BlockInfo[] for both striped and contiguous blocks in INodeFile

[ https://issues.apache.org/jira/browse/HDFS-8058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625523#comment-14625523 ] Zhe Zhang commented on HDFS-8058: - As a follow-on, we should make the ordering of

[jira] [Commented] (HDFS-8613) Add option to list up allowed hosts that can do any operation to NameNode.

[ https://issues.apache.org/jira/browse/HDFS-8613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625534#comment-14625534 ] Tsz Wo Nicholas Sze commented on HDFS-8613: --- We has service-level authorization

[jira] [Commented] (HDFS-7608) hdfs dfsclient newConnectedPeer has no write timeout

[ https://issues.apache.org/jira/browse/HDFS-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1462#comment-1462 ] Chris Nauroth commented on HDFS-7608: - Ah, of course! This is not block write timeout.

[jira] [Updated] (HDFS-8058) Erasure coding: use BlockInfo[] for both striped and contiguous blocks in INodeFile

[ https://issues.apache.org/jira/browse/HDFS-8058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8058: Attachment: HDFS-8058-HDFS-7285.006.patch Thanks Jing very much for the helpful review! Uploading new patch

[jira] [Commented] (HDFS-8677) Ozone: Introduce KeyValueContainerDatasetSpi

[ https://issues.apache.org/jira/browse/HDFS-8677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625535#comment-14625535 ] Hadoop QA commented on HDFS-8677: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-7483) Display information per tier on the Namenode UI

[ https://issues.apache.org/jira/browse/HDFS-7483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625536#comment-14625536 ] Arpit Agarwal commented on HDFS-7483: - +1 from me for the -002 patch. It looks like

[jira] [Updated] (HDFS-8677) Ozone: Introduce KeyValueContainerDatasetSpi

[ https://issues.apache.org/jira/browse/HDFS-8677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8677: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Created] (HDFS-8767) RawLocalFileSystem.listStatus() returns null for UNIX pipefile

Haohui Mai created HDFS-8767: Summary: RawLocalFileSystem.listStatus() returns null for UNIX pipefile Key: HDFS-8767 URL: https://issues.apache.org/jira/browse/HDFS-8767 Project: Hadoop HDFS

[jira] [Commented] (HDFS-8758) Implement the continuation library for libhdfspp

[ https://issues.apache.org/jira/browse/HDFS-8758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625390#comment-14625390 ] Haohui Mai commented on HDFS-8758: -- There will be SASL / SSL streams therefore the stream

[jira] [Updated] (HDFS-8541) Mover should exit with NO_MOVE_PROGRESS if there is no move progress

[ https://issues.apache.org/jira/browse/HDFS-8541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8541: -- Hadoop Flags: Reviewed +1 patch looks good. Mover should exit with NO_MOVE_PROGRESS if

[jira] [Commented] (HDFS-7314) When the DFSClient lease cannot be renewed, abort open-for-write files rather than the entire DFSClient

[ https://issues.apache.org/jira/browse/HDFS-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625375#comment-14625375 ] Colin Patrick McCabe commented on HDFS-7314: Thanks for picking this up again,

[jira] [Commented] (HDFS-8759) Implement remote block reader in libhdfspp

[ https://issues.apache.org/jira/browse/HDFS-8759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625395#comment-14625395 ] Haohui Mai commented on HDFS-8759: -- bq. Some comments explaining what the methods and

[jira] [Commented] (HDFS-8058) Erasure coding: use BlockInfo[] for both striped and contiguous blocks in INodeFile

[ https://issues.apache.org/jira/browse/HDFS-8058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625453#comment-14625453 ] Jing Zhao commented on HDFS-8058: - Thanks for updating the patch, Zhe. The new patch looks

[jira] [Commented] (HDFS-8143) HDFS Mover tool should exit after some retry when failed to move blocks.

[ https://issues.apache.org/jira/browse/HDFS-8143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625491#comment-14625491 ] Hudson commented on HDFS-8143: -- FAILURE: Integrated in Hadoop-trunk-Commit #8158 (See

[jira] [Commented] (HDFS-8728) Erasure coding: revisit and simplify BlockInfoStriped and INodeFile

[ https://issues.apache.org/jira/browse/HDFS-8728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625494#comment-14625494 ] Hadoop QA commented on HDFS-8728: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8541) Mover should exit with NO_MOVE_PROGRESS if there is no move progress

[ https://issues.apache.org/jira/browse/HDFS-8541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625490#comment-14625490 ] Hudson commented on HDFS-8541: -- FAILURE: Integrated in Hadoop-trunk-Commit #8158 (See

[jira] [Updated] (HDFS-8541) Mover should exit with NO_MOVE_PROGRESS if there is no move progress

[ https://issues.apache.org/jira/browse/HDFS-8541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8541: -- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-8058) Erasure coding: use BlockInfo[] for both striped and contiguous blocks in INodeFile

[ https://issues.apache.org/jira/browse/HDFS-8058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625622#comment-14625622 ] Jing Zhao commented on HDFS-8058: - The difference between {{IS_STRIPED}} and

[jira] [Commented] (HDFS-8758) Implement the continuation library for libhdfspp

[ https://issues.apache.org/jira/browse/HDFS-8758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625611#comment-14625611 ] Jing Zhao commented on HDFS-8758: - The continuation/pipeline definition looks pretty good

[jira] [Commented] (HDFS-8728) Erasure coding: revisit and simplify BlockInfoStriped and INodeFile

[ https://issues.apache.org/jira/browse/HDFS-8728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625588#comment-14625588 ] Tsz Wo Nicholas Sze commented on HDFS-8728: --- What are the advantages of the new

[jira] [Updated] (HDFS-8702) Erasure coding: update BlockManager.blockHasEnoughRacks(..) logic for striped block

[ https://issues.apache.org/jira/browse/HDFS-8702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated HDFS-8702: - Attachment: HDFS-8702-HDFS-7285.02.patch Erasure coding: update BlockManager.blockHasEnoughRacks(..)

[jira] [Commented] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14624262#comment-14624262 ] Walter Su commented on HDFS-8287: - bq. one (the fastest streamer) of the parity streamers

[jira] [Commented] (HDFS-8763) Incremental blockreport order may replicate unnecessary block

[ https://issues.apache.org/jira/browse/HDFS-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14624285#comment-14624285 ] Walter Su commented on HDFS-8763: - Hi, [~jiangyu1211]! Are most of the files/blocks very

[jira] [Created] (HDFS-8763) Incremental blockreport order may replicate unnecessary block

jiangyu created HDFS-8763: - Summary: Incremental blockreport order may replicate unnecessary block Key: HDFS-8763 URL: https://issues.apache.org/jira/browse/HDFS-8763 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-8763) Incremental blockreport order may replicate unnecessary block

[ https://issues.apache.org/jira/browse/HDFS-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14624303#comment-14624303 ] jiangyu commented on HDFS-8763: --- Hi, [~walter.k.su] , that is true, most of the blocks are

[jira] [Commented] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14624323#comment-14624323 ] Kai Sasaki commented on HDFS-8287: -- [~walter.k.su] Thank you for advice! Even if encode()

[jira] [Commented] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14624344#comment-14624344 ] Walter Su commented on HDFS-8287: - When writes stripe_0: streamer for datablocks #0~#5

[jira] [Updated] (HDFS-8702) Erasure coding: update BlockManager.blockHasEnoughRacks(..) logic for striped block

[ https://issues.apache.org/jira/browse/HDFS-8702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated HDFS-8702: - Attachment: HDFS-8702-HDFS-7285.01.patch Erasure coding: update BlockManager.blockHasEnoughRacks(..)

[jira] [Commented] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14624356#comment-14624356 ] Walter Su commented on HDFS-8287: - The normal file: client read from local disk, then