[jira] [Commented] (HDFS-8937) Fix the exception when set replication to Erasure Coding files

[ https://issues.apache.org/jira/browse/HDFS-8937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14715319#comment-14715319 ] Jing Zhao commented on HDFS-8937: - The MR issue is also found by [~demongaorui]. To put a

[jira] [Commented] (HDFS-8959) Provide an iterator-based API for listing all the snapshottable directories

[ https://issues.apache.org/jira/browse/HDFS-8959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14715360#comment-14715360 ] Hadoop QA commented on HDFS-8959: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-2896) The 2NN incorrectly daemonizes

[ https://issues.apache.org/jira/browse/HDFS-2896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14715439#comment-14715439 ] Daniel Templeton commented on HDFS-2896: The comment in the 2NN that the checkpoint

[jira] [Commented] (HDFS-8865) Improve quota initialization performance

[ https://issues.apache.org/jira/browse/HDFS-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14715267#comment-14715267 ] Kihwal Lee commented on HDFS-8865: -- - The checkstyle warning is against DFSConfigKeys. -

[jira] [Commented] (HDFS-2390) dfsadmin -setBalancerBandwidth doesnot validate -ve value

[ https://issues.apache.org/jira/browse/HDFS-2390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14715284#comment-14715284 ] Hadoop QA commented on HDFS-2390: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8950) NameNode refresh doesn't remove DataNodes

[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-8950: --- Attachment: HDFS-8950.003.patch New patch that includes changes to

[jira] [Commented] (HDFS-13) filenames with ':' colon throws java.lang.IllegalArgumentException

[ https://issues.apache.org/jira/browse/HDFS-13?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14715329#comment-14715329 ] Mayurkumar Patel commented on HDFS-13: -- Not sure weather this is issue only with colons,

[jira] [Created] (HDFS-8960) DFS client says no more good datanodes being available to try on a single drive failure

Benoit Sigoure created HDFS-8960: Summary: DFS client says no more good datanodes being available to try on a single drive failure Key: HDFS-8960 URL: https://issues.apache.org/jira/browse/HDFS-8960

[jira] [Commented] (HDFS-8937) Fix the exception when set replication to Erasure Coding files

[ https://issues.apache.org/jira/browse/HDFS-8937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14715294#comment-14715294 ] Jing Zhao commented on HDFS-8937: - I agree with Zhe that setting replication on a file with

[jira] [Commented] (HDFS-2390) dfsadmin -setBalancerBandwidth doesnot validate -ve value

[ https://issues.apache.org/jira/browse/HDFS-2390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14715272#comment-14715272 ] Hadoop QA commented on HDFS-2390: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-2390) dfsadmin -setBalancerBandwidth doesnot validate -ve value

[ https://issues.apache.org/jira/browse/HDFS-2390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14715262#comment-14715262 ] Hadoop QA commented on HDFS-2390: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8958) Clean up the checkstyle warinings about NameNodeMXBean

[ https://issues.apache.org/jira/browse/HDFS-8958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14715281#comment-14715281 ] Hadoop QA commented on HDFS-8958: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8937) Fix the exception when set replication to Erasure Coding files

[ https://issues.apache.org/jira/browse/HDFS-8937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14715315#comment-14715315 ] Zhe Zhang commented on HDFS-8937: - Thanks Jing for pointing out the MR job issue. I agree

[jira] [Commented] (HDFS-8704) Erasure Coding: client fails to write large file when one datanode fails

[ https://issues.apache.org/jira/browse/HDFS-8704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14712581#comment-14712581 ] Li Bo commented on HDFS-8704: - Thanks Zhe’s review. The handle of multiple block groups for

[jira] [Commented] (HDFS-8909) Erasure coding: update BlockInfoContiguousUC and BlockInfoStripedUC to use BlockUnderConstructionFeature

[ https://issues.apache.org/jira/browse/HDFS-8909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14712563#comment-14712563 ] Walter Su commented on HDFS-8909: - TestWriteStripedFileWithFailure, TestFileTruncate are

[jira] [Commented] (HDFS-8771) If IPCLoggerChannel#purgeLogsOlderThan takes too long, Namenode could not send another RPC calls to Journalnodes

[ https://issues.apache.org/jira/browse/HDFS-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14712613#comment-14712613 ] kanaka kumar avvaru commented on HDFS-8771: --- Find bugs test case failures are

[jira] [Commented] (HDFS-2390) dfsadmin -setBalancerBandwidth doesnot validate -ve value

[ https://issues.apache.org/jira/browse/HDFS-2390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14714205#comment-14714205 ] Harsh J commented on HDFS-2390: --- bq. +assertEquals(Bandwidth should be a non-negative

[jira] [Commented] (HDFS-8929) Add a metric to expose the timestamp of the last journal

[ https://issues.apache.org/jira/browse/HDFS-8929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14714478#comment-14714478 ] Hadoop QA commented on HDFS-8929: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8885) ByteRangeInputStream used in webhdfs does not override available()

[ https://issues.apache.org/jira/browse/HDFS-8885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14715163#comment-14715163 ] Chris Nauroth commented on HDFS-8885: - bq. ...{{getInputStream()}} is called in the

[jira] [Commented] (HDFS-8940) Support for large-scale multi-tenant inotify service

[ https://issues.apache.org/jira/browse/HDFS-8940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14714412#comment-14714412 ] Surendra Singh Lilhore commented on HDFS-8940: -- Thanks [~mingma] for design

[jira] [Commented] (HDFS-8946) Improve choosing datanode storage for block placement

[ https://issues.apache.org/jira/browse/HDFS-8946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14715156#comment-14715156 ] Hadoop QA commented on HDFS-8946: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8943) Read apis in ByteRangeInputStream does not read all the bytes specified when chunked transfer-encoding is used in the server

[ https://issues.apache.org/jira/browse/HDFS-8943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14715225#comment-14715225 ] Chris Nauroth commented on HDFS-8943: - Quick update: we've explained the situation to

[jira] [Created] (HDFS-8963) Fix findbugs warnings introduced in HDFS-8900

Haohui Mai created HDFS-8963: Summary: Fix findbugs warnings introduced in HDFS-8900 Key: HDFS-8963 URL: https://issues.apache.org/jira/browse/HDFS-8963 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-8964) Provide max TxId when validating in-progress edit log files

Zhe Zhang created HDFS-8964: --- Summary: Provide max TxId when validating in-progress edit log files Key: HDFS-8964 URL: https://issues.apache.org/jira/browse/HDFS-8964 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-8940) Support for large-scale multi-tenant inotify service

[ https://issues.apache.org/jira/browse/HDFS-8940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14715532#comment-14715532 ] Colin Patrick McCabe commented on HDFS-8940: One thing that I'm curious about

[jira] [Commented] (HDFS-8951) Move the shortcircuit package to hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-8951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14715580#comment-14715580 ] Hudson commented on HDFS-8951: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #311 (See

[jira] [Commented] (HDFS-8865) Improve quota initialization performance

[ https://issues.apache.org/jira/browse/HDFS-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14715624#comment-14715624 ] Hadoop QA commented on HDFS-8865: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8960) DFS client says no more good datanodes being available to try on a single drive failure

[ https://issues.apache.org/jira/browse/HDFS-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14715622#comment-14715622 ] Yongjun Zhang commented on HDFS-8960: - Yes, agree that we need to look further why a

[jira] [Updated] (HDFS-8962) Fix checkstyle and whitespace issues in HDFS-8803

[ https://issues.apache.org/jira/browse/HDFS-8962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8962: Summary: Fix checkstyle and whitespace issues in HDFS-8803 (was: Fix findbugs and checkstyle issues

[jira] [Updated] (HDFS-8951) Move the shortcircuit package to hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-8951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8951: - Summary: Move the shortcircuit package to hdfs-client (was: Move shortcircuit to hdfs-client) Move the

[jira] [Updated] (HDFS-8964) Provide max TxId when validating in-progress edit log files

[ https://issues.apache.org/jira/browse/HDFS-8964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8964: Description: NN/JN validates in-progress edit log files in multiple scenarios, via

[jira] [Updated] (HDFS-8925) Move BlockReader to hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8925: Status: Patch Available (was: Open) The v0 patch: * Moves the {{BlockReader}} and

[jira] [Commented] (HDFS-8960) DFS client says no more good datanodes being available to try on a single drive failure

[ https://issues.apache.org/jira/browse/HDFS-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14715635#comment-14715635 ] Benoit Sigoure commented on HDFS-8960: -- I looked at the GC logs and don't see anything

[jira] [Commented] (HDFS-8950) NameNode refresh doesn't remove DataNodes

[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14715631#comment-14715631 ] Colin Patrick McCabe commented on HDFS-8950: Looks good overall. {code} 1288

[jira] [Work started] (HDFS-2070) A lack of auto-test for FsShell getmerge in hdfs

[ https://issues.apache.org/jira/browse/HDFS-2070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-2070 started by Daniel Templeton. -- A lack of auto-test for FsShell getmerge in hdfs

[jira] [Updated] (HDFS-8248) Store INodeId instead of the INodeFile object in BlockInfoContiguous

[ https://issues.apache.org/jira/browse/HDFS-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8248: - Attachment: HDFS-8248.008.patch Store INodeId instead of the INodeFile object in BlockInfoContiguous

[jira] [Created] (HDFS-8961) Investigate lock issue in o.a.h.hdfs.shortcircuit.DfsClientShmManager.EndpointShmManager

Haohui Mai created HDFS-8961: Summary: Investigate lock issue in o.a.h.hdfs.shortcircuit.DfsClientShmManager.EndpointShmManager Key: HDFS-8961 URL: https://issues.apache.org/jira/browse/HDFS-8961

[jira] [Commented] (HDFS-8833) Erasure coding: store EC schema and cell size in INodeFile and eliminate notion of EC zones

[ https://issues.apache.org/jira/browse/HDFS-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14715589#comment-14715589 ] Zhe Zhang commented on HDFS-8833: - Thanks for the thoughts Walter. bq. As for

[jira] [Commented] (HDFS-8777) Erasure Coding: add tests for taking snapshots on EC files

[ https://issues.apache.org/jira/browse/HDFS-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14715599#comment-14715599 ] Zhe Zhang commented on HDFS-8777: - Thanks for the work Rakesh. With HDFS-8854 we should use

[jira] [Commented] (HDFS-8950) NameNode refresh doesn't remove DataNodes

[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14715642#comment-14715642 ] Daniel Templeton commented on HDFS-8950: Thanks! On the last point, I was erring

[jira] [Updated] (HDFS-8965) Harden edit log reading code against out of memory errors

[ https://issues.apache.org/jira/browse/HDFS-8965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8965: --- Attachment: HDFS-8965.001.patch The testFuzzSequences unit test fails without this

[jira] [Updated] (HDFS-8965) Harden edit log reading code against out of memory errors

[ https://issues.apache.org/jira/browse/HDFS-8965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8965: --- Affects Version/s: 2.0.0-alpha Status: Patch Available (was: Open)

[jira] [Updated] (HDFS-8962) Fix checkstyle and whitespace issues in HDFS-8803

[ https://issues.apache.org/jira/browse/HDFS-8962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8962: Description: This jira tracks the effort of fixing whitespace and checkstyle issues after moving

[jira] [Commented] (HDFS-8951) Move shortcircuit to hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-8951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14715488#comment-14715488 ] Haohui Mai commented on HDFS-8951: -- +1. I'll commit it shortly. Move shortcircuit to

[jira] [Updated] (HDFS-8962) Fix findbugs and checkstyle issues in DfsClientConf

[ https://issues.apache.org/jira/browse/HDFS-8962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8962: Flags: Patch Target Version/s: 2.8.0 Hadoop Flags: (was: Reviewed)

[jira] [Created] (HDFS-8962) Fix findbugs and checkstyle issues in DfsClientConf

Mingliang Liu created HDFS-8962: --- Summary: Fix findbugs and checkstyle issues in DfsClientConf Key: HDFS-8962 URL: https://issues.apache.org/jira/browse/HDFS-8962 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-8962) Fix findbugs and checkstyle issues in DfsClientConf

[ https://issues.apache.org/jira/browse/HDFS-8962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8962: Description: This jira tracks the effort of fixing findbugs warning and checkstyle issues for

[jira] [Updated] (HDFS-8962) Fix findbugs and checkstyle issues in HDFS-8803

[ https://issues.apache.org/jira/browse/HDFS-8962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8962: Summary: Fix findbugs and checkstyle issues in HDFS-8803 (was: Fix findbugs and checkstyle issues

[jira] [Updated] (HDFS-8951) Move the shortcircuit package to hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-8951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8951: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-8950) NameNode refresh doesn't remove DataNodes

[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14715593#comment-14715593 ] Hadoop QA commented on HDFS-8950: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8925) Move BlockReader to hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8925: Attachment: HDFS-8925.000.patch Move BlockReader to hdfs-client ---

[jira] [Assigned] (HDFS-2070) A lack of auto-test for FsShell getmerge in hdfs

[ https://issues.apache.org/jira/browse/HDFS-2070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton reassigned HDFS-2070: -- Assignee: Daniel Templeton A lack of auto-test for FsShell getmerge in hdfs

[jira] [Commented] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14715690#comment-14715690 ] Zhe Zhang commented on HDFS-8287: - Great work here! The idea is very interesting and

[jira] [Updated] (HDFS-8962) Fix checkstyle and whitespace issues in HDFS-8803

[ https://issues.apache.org/jira/browse/HDFS-8962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8962: Attachment: HDFS-8962.000.patch Fix checkstyle and whitespace issues in HDFS-8803

[jira] [Commented] (HDFS-8838) Tolerate datanode failures in DFSStripedOutputStream when the data length is small

[ https://issues.apache.org/jira/browse/HDFS-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14712894#comment-14712894 ] Walter Su commented on HDFS-8838: - Hi, [~jingzhao]. The last patch includes HDFS-8896 and

[jira] [Commented] (HDFS-8581) count cmd calculate wrong when huge files exist in one folder

[ https://issues.apache.org/jira/browse/HDFS-8581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14712751#comment-14712751 ] Hadoop QA commented on HDFS-8581: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8885) ByteRangeInputStream used in webhdfs does not override available()

[ https://issues.apache.org/jira/browse/HDFS-8885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14712866#comment-14712866 ] Shradha Revankar commented on HDFS-8885: Hi [~cnauroth], Thank you for reviewing

[jira] [Commented] (HDFS-1148) Convert FSDataset to ReadWriteLock

[ https://issues.apache.org/jira/browse/HDFS-1148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14712727#comment-14712727 ] Yong Zhang commented on HDFS-1148: -- Failed unit tests: hadoop.hdfs.TestFileStatus is not

[jira] [Commented] (HDFS-8956) Not able to start Datanode

[ https://issues.apache.org/jira/browse/HDFS-8956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14712734#comment-14712734 ] Brahma Reddy Battula commented on HDFS-8956: [~sreelakshmi.raj...@gmail.com]

[jira] [Commented] (HDFS-8945) Update the description about replica placement in HDFS Architecture documentation

[ https://issues.apache.org/jira/browse/HDFS-8945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14712854#comment-14712854 ] Masatake Iwasaki commented on HDFS-8945: Thanks for the comments, [~andrew.wang]!

[jira] [Commented] (HDFS-8897) Loadbalancer always exits with : java.io.IOException: Another Balancer is running.. Exiting ...

[ https://issues.apache.org/jira/browse/HDFS-8897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14712690#comment-14712690 ] LINTE commented on HDFS-8897: - [~xuchenCN], I don't have the time to do it right now. At the

[jira] [Commented] (HDFS-8853) Erasure Coding: Provide ECSchema validation when creating ECZone

[ https://issues.apache.org/jira/browse/HDFS-8853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14712775#comment-14712775 ] Hadoop QA commented on HDFS-8853: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8945) Update the description about replica placement in HDFS Architecture documentation

[ https://issues.apache.org/jira/browse/HDFS-8945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14712887#comment-14712887 ] Masatake Iwasaki commented on HDFS-8945: Hmm.. Storage policies wins because rack

[jira] [Commented] (HDFS-8945) Update the description about replica placement in HDFS Architecture documentation

[ https://issues.apache.org/jira/browse/HDFS-8945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14712888#comment-14712888 ] Masatake Iwasaki commented on HDFS-8945: I'm updating the patch based on the

[jira] [Updated] (HDFS-8957) Consolidate client striping input stream codes for stateful read and positional read

[ https://issues.apache.org/jira/browse/HDFS-8957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8957: Description: Currently we have different implementations for client striping read, having both

[jira] [Updated] (HDFS-8957) Consolidate client striping input stream codes for stateful read and positional read

[ https://issues.apache.org/jira/browse/HDFS-8957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8957: Attachment: HDFS-8957-v1.patch Uploaded the initial patch. Will provide formal one when its deps are

[jira] [Commented] (HDFS-8838) Tolerate datanode failures in DFSStripedOutputStream when the data length is small

[ https://issues.apache.org/jira/browse/HDFS-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14712869#comment-14712869 ] Hadoop QA commented on HDFS-8838: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8929) Add a metric to expose the timestamp of the last journal

[ https://issues.apache.org/jira/browse/HDFS-8929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14712919#comment-14712919 ] Brahma Reddy Battula commented on HDFS-8929: [~surendrasingh] thanks for

[jira] [Created] (HDFS-8958) Clean up the checkstyle warinings about NameNodeMXBean

Surendra Singh Lilhore created HDFS-8958: Summary: Clean up the checkstyle warinings about NameNodeMXBean Key: HDFS-8958 URL: https://issues.apache.org/jira/browse/HDFS-8958 Project: Hadoop

[jira] [Updated] (HDFS-8946) Improve choosing datanode storage for block placement

[ https://issues.apache.org/jira/browse/HDFS-8946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8946: - Attachment: HDFS-8946.001.patch Improve choosing datanode storage for block placement

[jira] [Updated] (HDFS-2390) dfsadmin -setBalancerBandwidth doesnot validate -ve value

[ https://issues.apache.org/jira/browse/HDFS-2390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gautam Gopalakrishnan updated HDFS-2390: Status: Open (was: Patch Available) dfsadmin -setBalancerBandwidth doesnot

[jira] [Updated] (HDFS-8958) Clean up the checkstyle warinings about NameNodeMXBean

[ https://issues.apache.org/jira/browse/HDFS-8958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-8958: - Status: Patch Available (was: Open) Clean up the checkstyle warinings about

[jira] [Updated] (HDFS-2390) dfsadmin -setBalancerBandwidth doesnot validate -ve value

[ https://issues.apache.org/jira/browse/HDFS-2390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gautam Gopalakrishnan updated HDFS-2390: Status: Open (was: Patch Available) dfsadmin -setBalancerBandwidth doesnot

[jira] [Updated] (HDFS-2390) dfsadmin -setBalancerBandwidth doesnot validate -ve value

[ https://issues.apache.org/jira/browse/HDFS-2390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gautam Gopalakrishnan updated HDFS-2390: Status: Patch Available (was: Open) dfsadmin -setBalancerBandwidth doesnot

[jira] [Updated] (HDFS-2390) dfsadmin -setBalancerBandwidth doesnot validate -ve value

[ https://issues.apache.org/jira/browse/HDFS-2390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gautam Gopalakrishnan updated HDFS-2390: Attachment: HDFS-2390-2.patch dfsadmin -setBalancerBandwidth doesnot validate -ve

[jira] [Updated] (HDFS-2390) dfsadmin -setBalancerBandwidth doesnot validate -ve value

[ https://issues.apache.org/jira/browse/HDFS-2390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gautam Gopalakrishnan updated HDFS-2390: Status: Patch Available (was: Open) dfsadmin -setBalancerBandwidth doesnot

[jira] [Updated] (HDFS-8958) Clean up the checkstyle warinings about NameNodeMXBean

[ https://issues.apache.org/jira/browse/HDFS-8958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-8958: - Attachment: HDFS-8958-001.patch Attached patch, Please review... Clean up the

[jira] [Commented] (HDFS-8833) Erasure coding: store EC schema and cell size in INodeFile and eliminate notion of EC zones

[ https://issues.apache.org/jira/browse/HDFS-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14713580#comment-14713580 ] Walter Su commented on HDFS-8833: - bq. Rename isStriped to erasureCodingPolicy in INodeFile

[jira] [Commented] (HDFS-8833) Erasure coding: store EC schema and cell size in INodeFile and eliminate notion of EC zones

[ https://issues.apache.org/jira/browse/HDFS-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14713583#comment-14713583 ] Walter Su commented on HDFS-8833: - If we have a conversion tool from contiguous -from-(to)

[jira] [Created] (HDFS-8959) Provide an iterator-based API for listing all the snapshottable directories

Rakesh R created HDFS-8959: -- Summary: Provide an iterator-based API for listing all the snapshottable directories Key: HDFS-8959 URL: https://issues.apache.org/jira/browse/HDFS-8959 Project: Hadoop HDFS

[jira] [Updated] (HDFS-8946) Improve choosing datanode storage for block placement

[ https://issues.apache.org/jira/browse/HDFS-8946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8946: - Status: Patch Available (was: Open) Improve choosing datanode storage for block placement

[jira] [Updated] (HDFS-2390) dfsadmin -setBalancerBandwidth doesnot validate -ve value

[ https://issues.apache.org/jira/browse/HDFS-2390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gautam Gopalakrishnan updated HDFS-2390: Attachment: HDFS-2390-3.patch dfsadmin -setBalancerBandwidth doesnot validate -ve

[jira] [Updated] (HDFS-8704) Erasure Coding: client fails to write large file when one datanode fails

[ https://issues.apache.org/jira/browse/HDFS-8704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-8704: Description: I test current code on a 5-node cluster using RS(3,2). When a datanode is corrupt, client succeeds to

[jira] [Created] (HDFS-8957) Consolidate client striping input stream codes for stateful read and positional read

Kai Zheng created HDFS-8957: --- Summary: Consolidate client striping input stream codes for stateful read and positional read Key: HDFS-8957 URL: https://issues.apache.org/jira/browse/HDFS-8957 Project:

[jira] [Commented] (HDFS-8956) Not able to start Datanode

[ https://issues.apache.org/jira/browse/HDFS-8956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14712785#comment-14712785 ] Ajith S commented on HDFS-8956: --- I suggest may be you can check your DN address rather than

[jira] [Commented] (HDFS-8946) Improve choosing datanode storage for block placement

[ https://issues.apache.org/jira/browse/HDFS-8946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14713409#comment-14713409 ] Yi Liu commented on HDFS-8946: -- # Add {{chooseStorage4Block}} to choose a good storage of

[jira] [Commented] (HDFS-8959) Provide an iterator-based API for listing all the snapshottable directories

[ https://issues.apache.org/jira/browse/HDFS-8959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14713415#comment-14713415 ] Rakesh R commented on HDFS-8959: I'm attaching patch. Here I've exposed

[jira] [Commented] (HDFS-8888) Support volumes in HDFS

[ https://issues.apache.org/jira/browse/HDFS-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14713425#comment-14713425 ] Walter Su commented on HDFS-: - I can't wait to take a look at detailed design. Right

[jira] [Updated] (HDFS-8959) Provide an iterator-based API for listing all the snapshottable directories

[ https://issues.apache.org/jira/browse/HDFS-8959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8959: --- Issue Type: Improvement (was: Bug) Provide an iterator-based API for listing all the snapshottable

[jira] [Updated] (HDFS-8959) Provide an iterator-based API for listing all the snapshottable directories

[ https://issues.apache.org/jira/browse/HDFS-8959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8959: --- Target Version/s: 2.8.0 Status: Patch Available (was: Open) Provide an iterator-based API for

[jira] [Commented] (HDFS-8950) NameNode refresh doesn't remove DataNodes

[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14713414#comment-14713414 ] Daniel Templeton commented on HDFS-8950: No idea why TestAuditLogs and

[jira] [Updated] (HDFS-2390) dfsadmin -setBalancerBandwidth doesnot validate -ve value

[ https://issues.apache.org/jira/browse/HDFS-2390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gautam Gopalakrishnan updated HDFS-2390: Affects Version/s: (was: 0.20.205.0) 2.7.1

[jira] [Updated] (HDFS-2390) dfsadmin -setBalancerBandwidth doesnot validate -ve value

[ https://issues.apache.org/jira/browse/HDFS-2390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gautam Gopalakrishnan updated HDFS-2390: Attachment: HDFS-2390-1.patch dfsadmin -setBalancerBandwidth doesnot validate -ve

[jira] [Assigned] (HDFS-2390) dfsadmin -setBalancerBandwidth doesnot validate -ve value

[ https://issues.apache.org/jira/browse/HDFS-2390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gautam Gopalakrishnan reassigned HDFS-2390: --- Assignee: Gautam Gopalakrishnan dfsadmin -setBalancerBandwidth doesnot

[jira] [Commented] (HDFS-8833) Erasure coding: store EC schema and cell size in INodeFile and eliminate notion of EC zones

[ https://issues.apache.org/jira/browse/HDFS-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14713603#comment-14713603 ] Walter Su commented on HDFS-8833: - revision: 1st quote is from Zhe Zhang. 2nd quote is from

[jira] [Updated] (HDFS-8929) Add a metric to expose the timestamp of the last journal

[ https://issues.apache.org/jira/browse/HDFS-8929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-8929: - Attachment: HDFS-8929-002.patch Thanks [~brahmareddy] for review.. Attached

[jira] [Updated] (HDFS-8959) Provide an iterator-based API for listing all the snapshottable directories

[ https://issues.apache.org/jira/browse/HDFS-8959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8959: --- Attachment: HDFS-8959-00.patch Provide an iterator-based API for listing all the snapshottable directories

[jira] [Commented] (HDFS-8959) Provide an iterator-based API for listing all the snapshottable directories

[ https://issues.apache.org/jira/browse/HDFS-8959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14713449#comment-14713449 ] Hadoop QA commented on HDFS-8959: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8829) DataNode sets SO_RCVBUF explicitly is disabling tcp auto-tuning

[ https://issues.apache.org/jira/browse/HDFS-8829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14715734#comment-14715734 ] Colin Patrick McCabe commented on HDFS-8829: I understand that the

[jira] [Commented] (HDFS-8951) Move the shortcircuit package to hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-8951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14715737#comment-14715737 ] Hudson commented on HDFS-8951: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1039 (See

  1   2   3   >