[jira] [Commented] (HDFS-8722) Optimize datanode writes for small writes and flushes

[ https://issues.apache.org/jira/browse/HDFS-8722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620533#comment-14620533 ] Kihwal Lee commented on HDFS-8722: -- The latest patch restores the small write/hflush

[jira] [Commented] (HDFS-8726) Move protobuf files that define the client-sever protocols to hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-8726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620595#comment-14620595 ] Hudson commented on HDFS-8726: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2178 (See

[jira] [Commented] (HDFS-8642) Make TestFileTruncate more reliable

[ https://issues.apache.org/jira/browse/HDFS-8642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620599#comment-14620599 ] Hudson commented on HDFS-8642: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2178 (See

[jira] [Commented] (HDFS-2956) calling fetchdt without a --renewer argument throws NPE

[ https://issues.apache.org/jira/browse/HDFS-2956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620619#comment-14620619 ] Vinayakumar B commented on HDFS-2956: - Findbugs is not actually there. trunk test

[jira] [Commented] (HDFS-8642) Make TestFileTruncate more reliable

[ https://issues.apache.org/jira/browse/HDFS-8642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620705#comment-14620705 ] Hudson commented on HDFS-8642: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2197 (See

[jira] [Commented] (HDFS-8726) Move protobuf files that define the client-sever protocols to hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-8726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620701#comment-14620701 ] Hudson commented on HDFS-8726: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2197 (See

[jira] [Commented] (HDFS-8743) Update document for hdfs fetchdt

[ https://issues.apache.org/jira/browse/HDFS-8743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620614#comment-14620614 ] Brahma Reddy Battula commented on HDFS-8743: [~ajisakaa] dupe of HDFS-8628,,

[jira] [Commented] (HDFS-8726) Move protobuf files that define the client-sever protocols to hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-8726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620576#comment-14620576 ] Hudson commented on HDFS-8726: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #239 (See

[jira] [Commented] (HDFS-8642) Make TestFileTruncate more reliable

[ https://issues.apache.org/jira/browse/HDFS-8642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620580#comment-14620580 ] Hudson commented on HDFS-8642: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #239 (See

[jira] [Commented] (HDFS-8642) Make TestFileTruncate more reliable

[ https://issues.apache.org/jira/browse/HDFS-8642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620682#comment-14620682 ] Hudson commented on HDFS-8642: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #249 (See

[jira] [Commented] (HDFS-8726) Move protobuf files that define the client-sever protocols to hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-8726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620678#comment-14620678 ] Hudson commented on HDFS-8726: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #249 (See

[jira] [Updated] (HDFS-8745) Use Doxygen to generate documents for libhdfspp

[ https://issues.apache.org/jira/browse/HDFS-8745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8745: - Summary: Use Doxygen to generate documents for libhdfspp (was: Use Doxygen to generate documents) Use

[jira] [Commented] (HDFS-8723) Integrate the build infrastructure with hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-8723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620852#comment-14620852 ] Alan Burlison commented on HDFS-8723: - Ah OK, thanks. Note I recently made some fairly

[jira] [Commented] (HDFS-8723) Integrate the build infrastructure with hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-8723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620832#comment-14620832 ] Alan Burlison commented on HDFS-8723: - Why is this adding an empty CMakeLists.txt to a

[jira] [Commented] (HDFS-8723) Integrate the build infrastructure with hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-8723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620840#comment-14620840 ] Haohui Mai commented on HDFS-8723: -- The empty CMakeLists.txt is a placeholder which

[jira] [Created] (HDFS-8745) Use Doxygen to generate documents

Haohui Mai created HDFS-8745: Summary: Use Doxygen to generate documents Key: HDFS-8745 URL: https://issues.apache.org/jira/browse/HDFS-8745 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-8745) Use Doxygen to generate documents for libhdfspp

[ https://issues.apache.org/jira/browse/HDFS-8745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620881#comment-14620881 ] Allen Wittenauer commented on HDFS-8745: This should probably be a full blown JIRA

[jira] [Commented] (HDFS-8745) Use Doxygen to generate documents for libhdfspp

[ https://issues.apache.org/jira/browse/HDFS-8745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620885#comment-14620885 ] Allen Wittenauer commented on HDFS-8745: Also: why? We just moved almost all of

[jira] [Updated] (HDFS-8563) Erasure Coding: fsck handles file smaller than a full stripe

[ https://issues.apache.org/jira/browse/HDFS-8563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8563: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7285 Status: Resolved

[jira] [Commented] (HDFS-8732) Erasure Coding: Fail to read a file with corrupted blocks

[ https://issues.apache.org/jira/browse/HDFS-8732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621060#comment-14621060 ] Jing Zhao commented on HDFS-8732: - HDFS-8669 can fix this I think. Erasure Coding: Fail

[jira] [Commented] (HDFS-8679) Move DatasetSpi to new package

[ https://issues.apache.org/jira/browse/HDFS-8679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620952#comment-14620952 ] Arpit Agarwal commented on HDFS-8679: - Hi [~anu], thanks for taking a look. Yes the

[jira] [Commented] (HDFS-8679) Move DatasetSpi to new package

[ https://issues.apache.org/jira/browse/HDFS-8679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620955#comment-14620955 ] Anu Engineer commented on HDFS-8679: [~arpitagarwal] Thanks for the explanation. +1

[jira] [Commented] (HDFS-8497) ErasureCodingWorker fails to do decode work

[ https://issues.apache.org/jira/browse/HDFS-8497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621012#comment-14621012 ] Jing Zhao commented on HDFS-8497: - Looks like we can resolve this jira now?

[jira] [Resolved] (HDFS-8497) ErasureCodingWorker fails to do decode work

[ https://issues.apache.org/jira/browse/HDFS-8497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HDFS-8497. - Resolution: Duplicate Thanks for the comment Jing. Closing this as a duplicate of HDFS-8328.

[jira] [Commented] (HDFS-8679) Move DatasetSpi to new package

[ https://issues.apache.org/jira/browse/HDFS-8679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620926#comment-14620926 ] Anu Engineer commented on HDFS-8679: one question : in {{FsDatasetFactory#newInstance}}

[jira] [Commented] (HDFS-8732) Erasure Coding: Fail to read a file with corrupted blocks

[ https://issues.apache.org/jira/browse/HDFS-8732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621593#comment-14621593 ] Xinwei Qin commented on HDFS-8732: --- Yes, [~jingzhao], the test passed with patch in

[jira] [Resolved] (HDFS-8732) Erasure Coding: Fail to read a file with corrupted blocks

[ https://issues.apache.org/jira/browse/HDFS-8732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinwei Qin resolved HDFS-8732. --- Resolution: Fixed Erasure Coding: Fail to read a file with corrupted blocks

[jira] [Resolved] (HDFS-8743) Update document for hdfs fetchdt

[ https://issues.apache.org/jira/browse/HDFS-8743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA resolved HDFS-8743. - Resolution: Duplicate Update document for hdfs fetchdt

[jira] [Commented] (HDFS-8702) Erasure coding: update BlockManager.blockHasEnoughRacks(..) logic for striped block

[ https://issues.apache.org/jira/browse/HDFS-8702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621736#comment-14621736 ] Hadoop QA commented on HDFS-8702: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8677) Ozone: Introduce KeyValueContainerDatasetSpi

[ https://issues.apache.org/jira/browse/HDFS-8677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8677: Status: Patch Available (was: Open) Ozone: Introduce KeyValueContainerDatasetSpi

[jira] [Updated] (HDFS-8677) Ozone: Introduce KeyValueContainerDatasetSpi

[ https://issues.apache.org/jira/browse/HDFS-8677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8677: Attachment: HDFS-8677-HDFS-7240.01.patch Ozone: Introduce KeyValueContainerDatasetSpi

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621783#comment-14621783 ] Vinayakumar B commented on HDFS-8578: - Thanks [~raju.bairishetti] for posting the

[jira] [Commented] (HDFS-8749) Fix findbugs warning in BlockManager.java

[ https://issues.apache.org/jira/browse/HDFS-8749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621787#comment-14621787 ] Hadoop QA commented on HDFS-8749: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8388) Time and Date format need to be in sync in Namenode UI page

[ https://issues.apache.org/jira/browse/HDFS-8388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621700#comment-14621700 ] Surendra Singh Lilhore commented on HDFS-8388: -- Thanks [~ajisakaa] for

[jira] [Updated] (HDFS-8677) Ozone: Introduce KeyValueContainerDatasetSpi

[ https://issues.apache.org/jira/browse/HDFS-8677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8677: Summary: Ozone: Introduce KeyValueContainerDatasetSpi (was: Ozone: Introduce

[jira] [Updated] (HDFS-8749) Fix findbugs warning in BlockManager.java

[ https://issues.apache.org/jira/browse/HDFS-8749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-8749: Attachment: findbugs.png Attaching the screenshot of {{mvn findbugs:gui}}. Fix findbugs warning in

[jira] [Commented] (HDFS-2956) calling fetchdt without a --renewer argument throws NPE

[ https://issues.apache.org/jira/browse/HDFS-2956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621570#comment-14621570 ] Akira AJISAKA commented on HDFS-2956: - bq. Findbugs is not actually there. Not related

[jira] [Updated] (HDFS-8749) Fix findbugs warning in BlockManager.java

[ https://issues.apache.org/jira/browse/HDFS-8749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-8749: Affects Version/s: 2.8.0 Labels: newbie (was: ) Fix findbugs warning in

[jira] [Updated] (HDFS-8749) Fix findbugs warning in BlockManager.java

[ https://issues.apache.org/jira/browse/HDFS-8749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-8749: Target Version/s: 2.8.0 Status: Patch Available (was: Open) +1 pending Jenkins.

[jira] [Created] (HDFS-8750) FIleSystem does not honor Configuration.getClassLoader() while loading FileSystem implementations

Himanshu created HDFS-8750: -- Summary: FIleSystem does not honor Configuration.getClassLoader() while loading FileSystem implementations Key: HDFS-8750 URL: https://issues.apache.org/jira/browse/HDFS-8750

[jira] [Updated] (HDFS-8677) Ozone: Introduce KeyValueContainerDatasetSpi

[ https://issues.apache.org/jira/browse/HDFS-8677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8677: Description: KeyValueContainerDatasetSpi will be a new interface for Ozone containers, just as

[jira] [Created] (HDFS-8749) Fix findbugs warning in BlockManager.java

Akira AJISAKA created HDFS-8749: --- Summary: Fix findbugs warning in BlockManager.java Key: HDFS-8749 URL: https://issues.apache.org/jira/browse/HDFS-8749 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-8749) Fix findbugs warning in BlockManager.java

[ https://issues.apache.org/jira/browse/HDFS-8749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621565#comment-14621565 ] Akira AJISAKA commented on HDFS-8749: - It was fixed as a part of HDFS-8652 but it was

[jira] [Commented] (HDFS-8058) Erasure coding: use BlockInfo[] for both striped and contiguous blocks in INodeFile

[ https://issues.apache.org/jira/browse/HDFS-8058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621575#comment-14621575 ] Hadoop QA commented on HDFS-8058: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621577#comment-14621577 ] Tsz Wo Nicholas Sze commented on HDFS-8287: --- When a stripping cell is full, the

[jira] [Commented] (HDFS-8388) Time and Date format need to be in sync in Namenode UI page

[ https://issues.apache.org/jira/browse/HDFS-8388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621647#comment-14621647 ] Akira AJISAKA commented on HDFS-8388: - One comment from me. bq. The applied patch

[jira] [Commented] (HDFS-2956) calling fetchdt without a --renewer argument throws NPE

[ https://issues.apache.org/jira/browse/HDFS-2956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621588#comment-14621588 ] Akira AJISAKA commented on HDFS-2956: - Thanks [~vinayrpet] for creating the patch for

[jira] [Commented] (HDFS-8743) Update document for hdfs fetchdt

[ https://issues.apache.org/jira/browse/HDFS-8743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621597#comment-14621597 ] Akira AJISAKA commented on HDFS-8743: - Thanks [~brahmareddy] for the comment. I'll

[jira] [Commented] (HDFS-8628) Update missing command option for fetchdt

[ https://issues.apache.org/jira/browse/HDFS-8628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621625#comment-14621625 ] Akira AJISAKA commented on HDFS-8628: - Hi [~vinayrpet], can I backport this to

[jira] [Reopened] (HDFS-8732) Erasure Coding: Fail to read a file with corrupted blocks

[ https://issues.apache.org/jira/browse/HDFS-8732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinwei Qin reopened HDFS-8732: --- Erasure Coding: Fail to read a file with corrupted blocks

[jira] [Resolved] (HDFS-8732) Erasure Coding: Fail to read a file with corrupted blocks

[ https://issues.apache.org/jira/browse/HDFS-8732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinwei Qin resolved HDFS-8732. --- Resolution: Duplicate Erasure Coding: Fail to read a file with corrupted blocks

[jira] [Commented] (HDFS-8749) Fix findbugs warning in BlockManager.java

[ https://issues.apache.org/jira/browse/HDFS-8749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621613#comment-14621613 ] Brahma Reddy Battula commented on HDFS-8749: [~ajisakaa] attached the patch

[jira] [Assigned] (HDFS-8749) Fix findbugs warning in BlockManager.java

[ https://issues.apache.org/jira/browse/HDFS-8749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula reassigned HDFS-8749: -- Assignee: Brahma Reddy Battula Fix findbugs warning in BlockManager.java

[jira] [Updated] (HDFS-8749) Fix findbugs warning in BlockManager.java

[ https://issues.apache.org/jira/browse/HDFS-8749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-8749: --- Attachment: HDFS-8749.patch Fix findbugs warning in BlockManager.java

[jira] [Updated] (HDFS-8744) Erasure Coding: the number of chunks in packet is not updated when writing parity data

[ https://issues.apache.org/jira/browse/HDFS-8744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-8744: Attachment: HDFS-8744-HDFS-7285-002.patch update patch according to Jing's review Erasure Coding: the number of

[jira] [Updated] (HDFS-8388) Time and Date format need to be in sync in Namenode UI page

[ https://issues.apache.org/jira/browse/HDFS-8388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-8388: - Attachment: HDFS-8388-002.patch Time and Date format need to be in sync in

[jira] [Updated] (HDFS-8744) Erasure Coding: the number of chunks in packet is not updated when writing parity data

[ https://issues.apache.org/jira/browse/HDFS-8744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-8744: Description: The member {{numChunks}} in {{DFSPacket}} is always zero if this packet contains parity data. The

[jira] [Updated] (HDFS-8744) Erasure Coding: the number of chunks in packet is not updated when writing parity data

[ https://issues.apache.org/jira/browse/HDFS-8744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-8744: Description: The member {{numChunks}} in {{DFSPacket}} is always zero if this packet contains parity data. The

[jira] [Updated] (HDFS-6833) DirectoryScanner should not register a deleting block with memory of DataNode

[ https://issues.apache.org/jira/browse/HDFS-6833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-6833: - Assignee: Shinichi Yamashita (was: jiangyu) DirectoryScanner should not register a deleting block with memory of

[jira] [Updated] (HDFS-8744) Erasure Coding: the number of chunks in packet is not updated when writing parity data

[ https://issues.apache.org/jira/browse/HDFS-8744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-8744: Status: Patch Available (was: Open) Erasure Coding: the number of chunks in packet is not updated when writing

[jira] [Commented] (HDFS-8642) Make TestFileTruncate more reliable

[ https://issues.apache.org/jira/browse/HDFS-8642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620313#comment-14620313 ] Hudson commented on HDFS-8642: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #251 (See

[jira] [Commented] (HDFS-8726) Move protobuf files that define the client-sever protocols to hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-8726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620309#comment-14620309 ] Hudson commented on HDFS-8726: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #251 (See

[jira] [Commented] (HDFS-8712) Remove public and abstract modifiers in FsVolumeSpi and FsDatasetSpi

[ https://issues.apache.org/jira/browse/HDFS-8712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620314#comment-14620314 ] Hudson commented on HDFS-8712: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #251 (See

[jira] [Updated] (HDFS-8729) Fix testTruncateWithDataNodesRestartImmediately occasionally failed

[ https://issues.apache.org/jira/browse/HDFS-8729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8729: Attachment: HDFS-8729.02.patch bq. In my test looks like the reason of the timeout is a race scenario in the

[jira] [Commented] (HDFS-2956) calling fetchdt without a --renewer argument throws NPE

[ https://issues.apache.org/jira/browse/HDFS-2956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620058#comment-14620058 ] Hadoop QA commented on HDFS-2956: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8058) Erasure coding: use BlockInfo[] for both striped and contiguous blocks in INodeFile

[ https://issues.apache.org/jira/browse/HDFS-8058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14619991#comment-14619991 ] Hadoop QA commented on HDFS-8058: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-2956) calling fetchdt without a --renewer argument throws NPE

[ https://issues.apache.org/jira/browse/HDFS-2956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-2956: Attachment: HDFS-2956-02.patch IMO, Without renewer, non-renewable delegationToken should be able to

[jira] [Updated] (HDFS-8719) Erasure Coding: client generates too many small packets when writing parity data

[ https://issues.apache.org/jira/browse/HDFS-8719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8719: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7285 Status: Resolved

[jira] [Created] (HDFS-8744) Erasure Coding: the number of chunks in packet is not updated when writing parity data

Li Bo created HDFS-8744: --- Summary: Erasure Coding: the number of chunks in packet is not updated when writing parity data Key: HDFS-8744 URL: https://issues.apache.org/jira/browse/HDFS-8744 Project: Hadoop

[jira] [Commented] (HDFS-2956) calling fetchdt without a --renewer argument throws NPE

[ https://issues.apache.org/jira/browse/HDFS-2956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620140#comment-14620140 ] Akira AJISAKA commented on HDFS-2956: - Thanks [~vinayrpet] for the clarification and

[jira] [Created] (HDFS-8742) Inotify: Support event for OP_TRUNCATE

Surendra Singh Lilhore created HDFS-8742: Summary: Inotify: Support event for OP_TRUNCATE Key: HDFS-8742 URL: https://issues.apache.org/jira/browse/HDFS-8742 Project: Hadoop HDFS

[jira] [Commented] (HDFS-8719) Erasure Coding: client generates too many small packets when writing parity data

[ https://issues.apache.org/jira/browse/HDFS-8719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620019#comment-14620019 ] Hadoop QA commented on HDFS-8719: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8323) Bump GenerationStamp for write faliure in DFSStripedOutputStream

[ https://issues.apache.org/jira/browse/HDFS-8323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620030#comment-14620030 ] Tsz Wo Nicholas Sze commented on HDFS-8323: --- Good catch! It does look like that

[jira] [Commented] (HDFS-8719) Erasure Coding: client generates too many small packets when writing parity data

[ https://issues.apache.org/jira/browse/HDFS-8719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620073#comment-14620073 ] Walter Su commented on HDFS-8719: - bq. Do we also need to update the current writeChunk

[jira] [Created] (HDFS-8743) Update document for hdfs fetchdt

Akira AJISAKA created HDFS-8743: --- Summary: Update document for hdfs fetchdt Key: HDFS-8743 URL: https://issues.apache.org/jira/browse/HDFS-8743 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Updated] (HDFS-2956) calling fetchdt without a --renewer argument throws NPE

[ https://issues.apache.org/jira/browse/HDFS-2956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-2956: Attachment: HDFS-2956.03.patch Last patch was generated from branch-2. Now attaching the patch for

[jira] [Assigned] (HDFS-8743) Update document for hdfs fetchdt

[ https://issues.apache.org/jira/browse/HDFS-8743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula reassigned HDFS-8743: -- Assignee: Brahma Reddy Battula Update document for hdfs fetchdt

[jira] [Commented] (HDFS-8719) Erasure Coding: client generates too many small packets when writing parity data

[ https://issues.apache.org/jira/browse/HDFS-8719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620109#comment-14620109 ] Li Bo commented on HDFS-8719: - Thanks [~jingzhao] and [~walter.k.su]! Erasure Coding: client

[jira] [Updated] (HDFS-8744) Erasure Coding: the number of chunks in packet is not updated when writing parity data

[ https://issues.apache.org/jira/browse/HDFS-8744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-8744: Attachment: HDFS-8744-HDFS-7285-001.patch Erasure Coding: the number of chunks in packet is not updated when

[jira] [Assigned] (HDFS-6833) DirectoryScanner should not register a deleting block with memory of DataNode

[ https://issues.apache.org/jira/browse/HDFS-6833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiangyu reassigned HDFS-6833: - Assignee: jiangyu (was: Shinichi Yamashita) DirectoryScanner should not register a deleting block with

[jira] [Commented] (HDFS-8744) Erasure Coding: the number of chunks in packet is not updated when writing parity data

[ https://issues.apache.org/jira/browse/HDFS-8744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620428#comment-14620428 ] Hadoop QA commented on HDFS-8744: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-2956) calling fetchdt without a --renewer argument throws NPE

[ https://issues.apache.org/jira/browse/HDFS-2956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620346#comment-14620346 ] Hadoop QA commented on HDFS-2956: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8742) Inotify: Support event for OP_TRUNCATE

[ https://issues.apache.org/jira/browse/HDFS-8742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-8742: - Fix Version/s: (was: 2.6.0) Inotify: Support event for OP_TRUNCATE

[jira] [Commented] (HDFS-8712) Remove public and abstract modifiers in FsVolumeSpi and FsDatasetSpi

[ https://issues.apache.org/jira/browse/HDFS-8712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620356#comment-14620356 ] Hudson commented on HDFS-8712: -- FAILURE: Integrated in Hadoop-Yarn-trunk #981 (See

[jira] [Commented] (HDFS-8642) Make TestFileTruncate more reliable

[ https://issues.apache.org/jira/browse/HDFS-8642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620355#comment-14620355 ] Hudson commented on HDFS-8642: -- FAILURE: Integrated in Hadoop-Yarn-trunk #981 (See

[jira] [Commented] (HDFS-8726) Move protobuf files that define the client-sever protocols to hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-8726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620351#comment-14620351 ] Hudson commented on HDFS-8726: -- FAILURE: Integrated in Hadoop-Yarn-trunk #981 (See

[jira] [Updated] (HDFS-2956) calling fetchdt without a --renewer argument throws NPE

[ https://issues.apache.org/jira/browse/HDFS-2956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-2956: Attachment: HDFS-2956.branch-2.03.patch Attaching the branch-2 patch. Since DelegationTokenFetcher

[jira] [Commented] (HDFS-8729) Fix testTruncateWithDataNodesRestartImmediately occasionally failed

[ https://issues.apache.org/jira/browse/HDFS-8729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620219#comment-14620219 ] Hadoop QA commented on HDFS-8729: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8729) Fix testTruncateWithDataNodesRestartImmediately occasionally failed

[ https://issues.apache.org/jira/browse/HDFS-8729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620257#comment-14620257 ] Walter Su commented on HDFS-8729: - Findbugs is broken recently. The time out test not

[jira] [Commented] (HDFS-2956) calling fetchdt without a --renewer argument throws NPE

[ https://issues.apache.org/jira/browse/HDFS-2956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620451#comment-14620451 ] Hadoop QA commented on HDFS-2956: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8728) Erasure coding: revisit and simplify BlockInfoStriped and INodeFile

[ https://issues.apache.org/jira/browse/HDFS-8728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620505#comment-14620505 ] Walter Su commented on HDFS-8728: - On first look, 2, 3, 4 is good. And FSEditLogLoader.java

[jira] [Resolved] (HDFS-2554) Add separate metrics for missing blocks with desired replication level 1

[ https://issues.apache.org/jira/browse/HDFS-2554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-2554. --- Resolution: Duplicate I think we handled this over in HDFS-7165, which has been committed. Add

[jira] [Commented] (HDFS-8484) Erasure coding: Two contiguous blocks occupy IDs belong to same striped group

[ https://issues.apache.org/jira/browse/HDFS-8484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621212#comment-14621212 ] Jing Zhao commented on HDFS-8484: - Good catch! +1. I will commit it shortly. Erasure

[jira] [Resolved] (HDFS-8484) Erasure coding: Two contiguous blocks occupy IDs belong to same striped group

[ https://issues.apache.org/jira/browse/HDFS-8484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-8484. - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7285 I've committed this to the

[jira] [Updated] (HDFS-8679) Move DatasetSpi to new package

[ https://issues.apache.org/jira/browse/HDFS-8679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8679: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Target

[jira] [Commented] (HDFS-8745) Use Doxygen to generate documents for libhdfspp

[ https://issues.apache.org/jira/browse/HDFS-8745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621236#comment-14621236 ] Haohui Mai commented on HDFS-8745: -- This is for native c++ code where the code needs to be

[jira] [Updated] (HDFS-8745) Use Doxygen to generate documents for libhdfspp

[ https://issues.apache.org/jira/browse/HDFS-8745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8745: - Attachment: HDFS-8745.000.patch Use Doxygen to generate documents for libhdfspp

[jira] [Commented] (HDFS-8729) Fix testTruncateWithDataNodesRestartImmediately occasionally failed

[ https://issues.apache.org/jira/browse/HDFS-8729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621250#comment-14621250 ] Hudson commented on HDFS-8729: -- FAILURE: Integrated in Hadoop-trunk-Commit #8142 (See

[jira] [Created] (HDFS-8746) Reduce the latency of streaming reads by re-using DN connections

Bob Hansen created HDFS-8746: Summary: Reduce the latency of streaming reads by re-using DN connections Key: HDFS-8746 URL: https://issues.apache.org/jira/browse/HDFS-8746 Project: Hadoop HDFS

[jira] [Updated] (HDFS-8729) Fix testTruncateWithDataNodesRestartImmediately occasionally failed

[ https://issues.apache.org/jira/browse/HDFS-8729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8729: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved (was:

  1   2   >