[jira] [Commented] (HDFS-9557) Reduce object allocation in PB conversion

[ https://issues.apache.org/jira/browse/HDFS-9557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15066881#comment-15066881 ] Colin Patrick McCabe commented on HDFS-9557: Thanks, [~daryn]. > Reduce object allocation in

[jira] [Comment Edited] (HDFS-8562) HDFS Performance is impacted by FileInputStream Finalizer

[ https://issues.apache.org/jira/browse/HDFS-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15066822#comment-15066822 ] Colin Patrick McCabe edited comment on HDFS-8562 at 12/21/15 6:13 PM: --

[jira] [Updated] (HDFS-9569) Log the name of the fsimage being loaded for better supportability

[ https://issues.apache.org/jira/browse/HDFS-9569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9569: Attachment: HDFS-9569.005.patch Thanks [~cnauroth]. I added the additional check thinking it was a

[jira] [Commented] (HDFS-8461) Erasure coding: fix priority level of UnderReplicatedBlocks for striped block

[ https://issues.apache.org/jira/browse/HDFS-8461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15066839#comment-15066839 ] Zhe Zhang commented on HDFS-8461: - I agree, to match multiple EC policies we need to change that assertion.

[jira] [Commented] (HDFS-9569) Log the name of the fsimage being loaded for better supportability

[ https://issues.apache.org/jira/browse/HDFS-9569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15066838#comment-15066838 ] Chris Nauroth commented on HDFS-9569: - +1 for patch v005, pending Jenkins. Thank you! > Log the name

[jira] [Created] (HDFS-9587) Modify tests that initialize MiniDFSNNTopology with hard-coded ports to use ServerSocketUtil#getPorts

Xiao Chen created HDFS-9587: --- Summary: Modify tests that initialize MiniDFSNNTopology with hard-coded ports to use ServerSocketUtil#getPorts Key: HDFS-9587 URL: https://issues.apache.org/jira/browse/HDFS-9587

[jira] [Commented] (HDFS-7784) load fsimage in parallel

[ https://issues.apache.org/jira/browse/HDFS-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067073#comment-15067073 ] Kihwal Lee commented on HDFS-7784: -- bq. protobuf seems to generate a lot of garbage during startup,

[jira] [Created] (HDFS-9588) DiskBalancer : Add submitDiskbalancer RPC

Anu Engineer created HDFS-9588: -- Summary: DiskBalancer : Add submitDiskbalancer RPC Key: HDFS-9588 URL: https://issues.apache.org/jira/browse/HDFS-9588 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-9584) NPE in distcp when ssl configuration file does not exist in class path.

[ https://issues.apache.org/jira/browse/HDFS-9584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-9584: - Status: Patch Available (was: Open) > NPE in distcp when ssl configuration file

[jira] [Commented] (HDFS-9034) "StorageTypeStats" Metric should not count failed storage.

[ https://issues.apache.org/jira/browse/HDFS-9034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15066868#comment-15066868 ] Benoy Antony commented on HDFS-9034: Thanks for the clarification, Surendra. The patch looks good .

[jira] [Commented] (HDFS-7784) load fsimage in parallel

[ https://issues.apache.org/jira/browse/HDFS-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15066949#comment-15066949 ] Colin Patrick McCabe commented on HDFS-7784: Thanks, [~kihwal]. Unfortunately, that's what

[jira] [Commented] (HDFS-9584) NPE in distcp when ssl configuration file does not exist in class path.

[ https://issues.apache.org/jira/browse/HDFS-9584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15066913#comment-15066913 ] Xiaoyu Yao commented on HDFS-9584: -- Thanks [~surendrasingh] for working on this. Patch LGTM. +1 pending

[jira] [Commented] (HDFS-9580) TestComputeInvalidateWork#testDatanodeReRegistration failed due to unexpected number of invalidate blocks.

[ https://issues.apache.org/jira/browse/HDFS-9580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067010#comment-15067010 ] Zhe Zhang commented on HDFS-9580: - Thanks Wei-Chiu, good analysis. +1 on the patch pending Jenkins. >

[jira] [Commented] (HDFS-8562) HDFS Performance is impacted by FileInputStream Finalizer

[ https://issues.apache.org/jira/browse/HDFS-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15066822#comment-15066822 ] Colin Patrick McCabe commented on HDFS-8562: Hi [~drankye], Thanks for looking at this. 003a

[jira] [Updated] (HDFS-9580) TestComputeInvalidateWork#testDatanodeReRegistration failed due to unexpected number of invalidate blocks.

[ https://issues.apache.org/jira/browse/HDFS-9580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9580: -- Status: Patch Available (was: Open) > TestComputeInvalidateWork#testDatanodeReRegistration

[jira] [Commented] (HDFS-9589) Block files which have been hardlinked should be duplicated before the DataNode appends to the them

[ https://issues.apache.org/jira/browse/HDFS-9589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067158#comment-15067158 ] Colin Patrick McCabe commented on HDFS-9589: Thanks to [~eddyxu] and [~twu] for pointing out

[jira] [Commented] (HDFS-7553) fix the TestDFSUpgradeWithHA due to BindException

[ https://issues.apache.org/jira/browse/HDFS-7553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067230#comment-15067230 ] Xiao Chen commented on HDFS-7553: - Hi [~cnauroth], Thanks for reviewing! I agree that joining the

[jira] [Commented] (HDFS-8999) Namenode need not wait for {{blockReceived}} for the last block before completing a file.

[ https://issues.apache.org/jira/browse/HDFS-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067293#comment-15067293 ] Jitendra Nath Pandey commented on HDFS-8999: The clients do know the data pipeline and so does

[jira] [Commented] (HDFS-7553) fix the TestDFSUpgradeWithHA due to BindException

[ https://issues.apache.org/jira/browse/HDFS-7553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067355#comment-15067355 ] Chris Nauroth commented on HDFS-7553: - I think patch v03 is the right idea. Here are a few comments. #

[jira] [Commented] (HDFS-9589) Block files which have been hardlinked should be duplicated before the DataNode appends to the them

[ https://issues.apache.org/jira/browse/HDFS-9589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067346#comment-15067346 ] Hadoop QA commented on HDFS-9589: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9589) Block files which have been hardlinked should be duplicated before the DataNode appends to the them

[ https://issues.apache.org/jira/browse/HDFS-9589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9589: --- Status: Patch Available (was: Open) > Block files which have been hardlinked should

[jira] [Updated] (HDFS-9589) Block files which have been hardlinked should be duplicated before the DataNode appends to the them

[ https://issues.apache.org/jira/browse/HDFS-9589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9589: --- Attachment: HDFS-9589.001.patch > Block files which have been hardlinked should be

[jira] [Commented] (HDFS-9589) Block files which have been hardlinked should be duplicated before the DataNode appends to the them

[ https://issues.apache.org/jira/browse/HDFS-9589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067248#comment-15067248 ] Lei (Eddy) Xu commented on HDFS-9589: - +1. The changes are most brought from what deleted from

[jira] [Commented] (HDFS-9458) TestBackupNode always binds to port 50070, which can cause bind failures.

[ https://issues.apache.org/jira/browse/HDFS-9458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067374#comment-15067374 ] Hadoop QA commented on HDFS-9458: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9588) DiskBalancer : Add submitDiskbalancer RPC

[ https://issues.apache.org/jira/browse/HDFS-9588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9588: --- Attachment: HDFS-9588-HDFS-1312.001.patch To be submitted after HDFS-9502, posting the patch for ease

[jira] [Commented] (HDFS-9586) listCorruptFileBlocks should not output files that all replications are decommissioning

[ https://issues.apache.org/jira/browse/HDFS-9586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067124#comment-15067124 ] Rushabh S Shah commented on HDFS-9586: -- FSNameSystem#listCorruptFileBlocks gets the list of corrupt

[jira] [Created] (HDFS-9590) NPE in Storage#unlock

Xiao Chen created HDFS-9590: --- Summary: NPE in Storage#unlock Key: HDFS-9590 URL: https://issues.apache.org/jira/browse/HDFS-9590 Project: Hadoop HDFS Issue Type: Bug Reporter: Xiao

[jira] [Commented] (HDFS-9590) NPE in Storage#unlock

[ https://issues.apache.org/jira/browse/HDFS-9590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067196#comment-15067196 ] Xiao Chen commented on HDFS-9590: - This was observed in the following unit test failure of

[jira] [Commented] (HDFS-7553) fix the TestDFSUpgradeWithHA due to BindException

[ https://issues.apache.org/jira/browse/HDFS-7553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067195#comment-15067195 ] Chris Nauroth commented on HDFS-7553: - [~xiaochen], thank you for picking this up. Seeing the change

[jira] [Created] (HDFS-9591) FSImage.loadEdits threw NullPointerException

Wei-Chiu Chuang created HDFS-9591: - Summary: FSImage.loadEdits threw NullPointerException Key: HDFS-9591 URL: https://issues.apache.org/jira/browse/HDFS-9591 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-9590) NPE in Storage#unlock

[ https://issues.apache.org/jira/browse/HDFS-9590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067239#comment-15067239 ] Mingliang Liu commented on HDFS-9590: - # Do you mean {{Storage$StorageDirectory#unlock()}}? There is no

[jira] [Commented] (HDFS-7553) fix the TestDFSUpgradeWithHA due to BindException

[ https://issues.apache.org/jira/browse/HDFS-7553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067251#comment-15067251 ] Xiao Chen commented on HDFS-7553: - Attached patch 3 to reflex the above discussion. I verified again with

[jira] [Commented] (HDFS-9590) NPE in Storage$StorageDirectory#unlock()

[ https://issues.apache.org/jira/browse/HDFS-9590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067310#comment-15067310 ] Xiao Chen commented on HDFS-9590: - I take it back. So the locking itself looks to be exclusive - should

[jira] [Commented] (HDFS-9458) TestBackupNode always binds to port 50070, which can cause bind failures.

[ https://issues.apache.org/jira/browse/HDFS-9458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067114#comment-15067114 ] Chris Nauroth commented on HDFS-9458: - [~xiaochen], thank you for the patch. I think we still need to

[jira] [Created] (HDFS-9589) Block files which have been hardlinked should be duplicated before the DataNode appends to the them

Colin Patrick McCabe created HDFS-9589: -- Summary: Block files which have been hardlinked should be duplicated before the DataNode appends to the them Key: HDFS-9589 URL:

[jira] [Updated] (HDFS-9458) TestBackupNode always binds to port 50070, which can cause bind failures.

[ https://issues.apache.org/jira/browse/HDFS-9458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9458: Attachment: HDFS-9458.002.patch > TestBackupNode always binds to port 50070, which can cause bind failures.

[jira] [Commented] (HDFS-9494) Parallel optimization of DFSStripedOutputStream#flushAllInternals( )

[ https://issues.apache.org/jira/browse/HDFS-9494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067213#comment-15067213 ] Tsz Wo Nicholas Sze commented on HDFS-9494: --- Sure, we may keep the log message. > Parallel

[jira] [Comment Edited] (HDFS-9494) Parallel optimization of DFSStripedOutputStream#flushAllInternals( )

[ https://issues.apache.org/jira/browse/HDFS-9494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067217#comment-15067217 ] Tsz Wo Nicholas Sze edited comment on HDFS-9494 at 12/21/15 11:05 PM: --

[jira] [Commented] (HDFS-8562) HDFS Performance is impacted by FileInputStream Finalizer

[ https://issues.apache.org/jira/browse/HDFS-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067282#comment-15067282 ] Kai Zheng commented on HDFS-8562: - Thanks Colin for the comments and further thoughts. They sound great to

[jira] [Commented] (HDFS-9580) TestComputeInvalidateWork#testDatanodeReRegistration failed due to unexpected number of invalidate blocks.

[ https://issues.apache.org/jira/browse/HDFS-9580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067281#comment-15067281 ] Wei-Chiu Chuang commented on HDFS-9580: --- Test failures look unrelated. >

[jira] [Commented] (HDFS-9094) Add command line option to ask NameNode reload configuration.

[ https://issues.apache.org/jira/browse/HDFS-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067309#comment-15067309 ] Xiaobing Zhou commented on HDFS-9094: - Patch V002 is based on HDFS-9414 by reusing Reconfiguration

[jira] [Updated] (HDFS-9094) Add command line option to ask NameNode reload configuration.

[ https://issues.apache.org/jira/browse/HDFS-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9094: Attachment: HDFS-9094-HDFS-9000.002.patch > Add command line option to ask NameNode reload

[jira] [Commented] (HDFS-9580) TestComputeInvalidateWork#testDatanodeReRegistration failed due to unexpected number of invalidate blocks.

[ https://issues.apache.org/jira/browse/HDFS-9580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067202#comment-15067202 ] Hadoop QA commented on HDFS-9580: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-7553) fix the TestDFSUpgradeWithHA due to BindException

[ https://issues.apache.org/jira/browse/HDFS-7553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-7553: Attachment: HDFS-7553.03.patch > fix the TestDFSUpgradeWithHA due to BindException >

[jira] [Commented] (HDFS-9574) Reduce client failures during datanode restart

[ https://issues.apache.org/jira/browse/HDFS-9574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067299#comment-15067299 ] Hadoop QA commented on HDFS-9574: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9094) Add command line option to ask NameNode reload configuration.

[ https://issues.apache.org/jira/browse/HDFS-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9094: Attachment: HDFS-9094-HDFS-9000.003.patch V003 fixed some minor issues. > Add command line option

[jira] [Commented] (HDFS-9458) TestBackupNode always binds to port 50070, which can cause bind failures.

[ https://issues.apache.org/jira/browse/HDFS-9458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067176#comment-15067176 ] Xiao Chen commented on HDFS-9458: - Thanks [~cnauroth] for the comments! Attached patch 2. bq. I think we

[jira] [Updated] (HDFS-9590) NPE in Storage$StorageDirectory#unlock()

[ https://issues.apache.org/jira/browse/HDFS-9590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9590: Summary: NPE in Storage$StorageDirectory#unlock() (was: NPE in Storage#unlock) > NPE in

[jira] [Commented] (HDFS-9590) NPE in Storage#unlock

[ https://issues.apache.org/jira/browse/HDFS-9590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067266#comment-15067266 ] Xiao Chen commented on HDFS-9590: - Thanks [~liuml07] for the comments. bq. Do you mean

[jira] [Commented] (HDFS-9590) NPE in Storage$StorageDirectory#unlock()

[ https://issues.apache.org/jira/browse/HDFS-9590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067286#comment-15067286 ] Mingliang Liu commented on HDFS-9590: - {quote} 2 threads are calling unlock() {quote} Oh, I thought it

[jira] [Commented] (HDFS-9458) TestBackupNode always binds to port 50070, which can cause bind failures.

[ https://issues.apache.org/jira/browse/HDFS-9458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067203#comment-15067203 ] Chris Nauroth commented on HDFS-9458: - [~xiaochen], thank you for clarifying. Patch v002 looks good to

[jira] [Commented] (HDFS-9494) Parallel optimization of DFSStripedOutputStream#flushAllInternals( )

[ https://issues.apache.org/jira/browse/HDFS-9494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067217#comment-15067217 ] Tsz Wo Nicholas Sze commented on HDFS-9494: --- Actually, checkStreamers is not thread safe so that

[jira] [Commented] (HDFS-9494) Parallel optimization of DFSStripedOutputStream#flushAllInternals( )

[ https://issues.apache.org/jira/browse/HDFS-9494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067363#comment-15067363 ] GAO Rui commented on HDFS-9494: --- Thanks Nicholas. I have considered {{checkStreamers()}} issue before too.

[jira] [Commented] (HDFS-9034) "StorageTypeStats" Metric should not count failed storage.

[ https://issues.apache.org/jira/browse/HDFS-9034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15066254#comment-15066254 ] Surendra Singh Lilhore commented on HDFS-9034: -- bq. stats.subtract(node) will be called, but

[jira] [Commented] (HDFS-9505) HDFS Architecture documentation needs to be refreshed.

[ https://issues.apache.org/jira/browse/HDFS-9505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15066800#comment-15066800 ] Masatake Iwasaki commented on HDFS-9505: Thanks, [~ajisakaa]! > HDFS Architecture documentation

[jira] [Commented] (HDFS-9582) TestLeaseRecoveryStriped file missing Apache License header and not well formatted

[ https://issues.apache.org/jira/browse/HDFS-9582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15066803#comment-15066803 ] Zhe Zhang commented on HDFS-9582: - Thanks for the catch Uma. I committed an oder version of the patch. >

[jira] [Commented] (HDFS-9173) Erasure Coding: Lease recovery for striped file

[ https://issues.apache.org/jira/browse/HDFS-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15066805#comment-15066805 ] Zhe Zhang commented on HDFS-9173: - Thanks for the good catch Akira. I committed 09 patch by mistake. I

[jira] [Commented] (HDFS-9494) Parallel optimization of DFSStripedOutputStream#flushAllInternals( )

[ https://issues.apache.org/jira/browse/HDFS-9494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15066214#comment-15066214 ] GAO Rui commented on HDFS-9494: --- [~szetszwo], great catch! Sorry, I ignored that handleStreamerFailure

[jira] [Updated] (HDFS-9586) listCorruptFileBlocks should not output files that all replications are decommissioning

[ https://issues.apache.org/jira/browse/HDFS-9586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HDFS-9586: Attachment: patch > listCorruptFileBlocks should not output files that all replications are >

[jira] [Updated] (HDFS-9586) listCorruptFileBlocks should not output files that all replications are decommissioning

[ https://issues.apache.org/jira/browse/HDFS-9586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HDFS-9586: Attachment: (was: patch) > listCorruptFileBlocks should not output files that all replications are >

[jira] [Updated] (HDFS-9586) listCorruptFileBlocks should not output files that all replications are decommissioning

[ https://issues.apache.org/jira/browse/HDFS-9586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HDFS-9586: Status: Patch Available (was: Open) > listCorruptFileBlocks should not output files that all replications

[jira] [Updated] (HDFS-9586) listCorruptFileBlocks should not output files that all replications are decommissioning

[ https://issues.apache.org/jira/browse/HDFS-9586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HDFS-9586: Attachment: 9586-v1.patch > listCorruptFileBlocks should not output files that all replications are >

[jira] [Created] (HDFS-9586) listCorruptFileBlocks should not output files that all replications are decommissioning

Phil Yang created HDFS-9586: --- Summary: listCorruptFileBlocks should not output files that all replications are decommissioning Key: HDFS-9586 URL: https://issues.apache.org/jira/browse/HDFS-9586 Project:

[jira] [Commented] (HDFS-9574) Reduce client failures during datanode restart

[ https://issues.apache.org/jira/browse/HDFS-9574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15066489#comment-15066489 ] Kihwal Lee commented on HDFS-9574: -- This precommit (#13934) and #13935 for HDFS-7163 ran on H9 at the same

[jira] [Updated] (HDFS-9105) separate replication config for client to create a file or set replication

[ https://issues.apache.org/jira/browse/HDFS-9105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated HDFS-9105: --- Attachment: HDFS-9105.2.2.patch .2.2 fix checkstyle > separate replication config for client to create a file

[jira] [Commented] (HDFS-7553) fix the TestDFSUpgradeWithHA due to BindException

[ https://issues.apache.org/jira/browse/HDFS-7553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067414#comment-15067414 ] Hadoop QA commented on HDFS-7553: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9094) Add command line option to ask NameNode reload configuration.

[ https://issues.apache.org/jira/browse/HDFS-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067475#comment-15067475 ] Hadoop QA commented on HDFS-9094: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9094) Add command line option to ask NameNode reload configuration.

[ https://issues.apache.org/jira/browse/HDFS-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067485#comment-15067485 ] Hadoop QA commented on HDFS-9094: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-7553) fix the TestDFSUpgradeWithHA due to BindException

[ https://issues.apache.org/jira/browse/HDFS-7553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067550#comment-15067550 ] Hadoop QA commented on HDFS-7553: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8658) Improve retry attempt log in DFSOutputStream#completeFile with current attempt number

[ https://issues.apache.org/jira/browse/HDFS-8658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067586#comment-15067586 ] Kanaka Kumar Avvaru commented on HDFS-8658: --- [~ajisakaa], Please have a look at updated patch >

[jira] [Commented] (HDFS-8430) Erasure coding: update DFSClient.getFileChecksum() logic for stripe files

[ https://issues.apache.org/jira/browse/HDFS-8430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067638#comment-15067638 ] Tsz Wo Nicholas Sze commented on HDFS-8430: --- [~walter.k.su], are you working on this? This

[jira] [Updated] (HDFS-7553) fix the TestDFSUpgradeWithHA due to BindException

[ https://issues.apache.org/jira/browse/HDFS-7553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-7553: Attachment: (was: HDFS-7553.04.patch) > fix the TestDFSUpgradeWithHA due to BindException >

[jira] [Commented] (HDFS-9458) TestBackupNode always binds to port 50070, which can cause bind failures.

[ https://issues.apache.org/jira/browse/HDFS-9458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067452#comment-15067452 ] Xiao Chen commented on HDFS-9458: - Thank you [~cnauroth]! The failed tests look unrelated to this patch. >

[jira] [Updated] (HDFS-7553) fix the TestDFSUpgradeWithHA due to BindException

[ https://issues.apache.org/jira/browse/HDFS-7553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-7553: Attachment: HDFS-7553.05.patch > fix the TestDFSUpgradeWithHA due to BindException >

[jira] [Commented] (HDFS-9580) TestComputeInvalidateWork#testDatanodeReRegistration failed due to unexpected number of invalidate blocks.

[ https://issues.apache.org/jira/browse/HDFS-9580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067635#comment-15067635 ] Hudson commented on HDFS-9580: -- FAILURE: Integrated in Hadoop-trunk-Commit #9011 (See

[jira] [Updated] (HDFS-9575) Use byte array for internal block indices in a striped block

[ https://issues.apache.org/jira/browse/HDFS-9575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9575: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-9586) listCorruptFileBlocks should not output files that all replications are decommissioning

[ https://issues.apache.org/jira/browse/HDFS-9586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067495#comment-15067495 ] Phil Yang commented on HDFS-9586: - {quote} So all the blocks that go into QUEUE_WITH_CORRUPT_BLOCKS already

[jira] [Commented] (HDFS-8477) describe dfs.ha.zkfc.port in hdfs-default.xml

[ https://issues.apache.org/jira/browse/HDFS-8477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067583#comment-15067583 ] Kanaka Kumar Avvaru commented on HDFS-8477: --- Thanks for review and commit [~andrew.wang] >

[jira] [Updated] (HDFS-9580) TestComputeInvalidateWork#testDatanodeReRegistration failed due to unexpected number of invalidate blocks.

[ https://issues.apache.org/jira/browse/HDFS-9580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9580: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 Status: Resolved (was:

[jira] [Commented] (HDFS-9569) Log the name of the fsimage being loaded for better supportability

[ https://issues.apache.org/jira/browse/HDFS-9569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067431#comment-15067431 ] Yongjun Zhang commented on HDFS-9569: - Thanks [~cnauroth]! > Log the name of the fsimage being loaded

[jira] [Commented] (HDFS-9588) DiskBalancer : Add submitDiskbalancer RPC

[ https://issues.apache.org/jira/browse/HDFS-9588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067446#comment-15067446 ] Mingliang Liu commented on HDFS-9588: - Thanks for working on this. {code} message

[jira] [Updated] (HDFS-9584) NPE in distcp when ssl configuration file does not exist in class path.

[ https://issues.apache.org/jira/browse/HDFS-9584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-9584: - Status: Open (was: Patch Available) > NPE in distcp when ssl configuration file

[jira] [Updated] (HDFS-9584) NPE in distcp when ssl configuration file does not exist in class path.

[ https://issues.apache.org/jira/browse/HDFS-9584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-9584: - Status: Patch Available (was: Open) Thanks [~xyao] for review.. Resubmitting the

[jira] [Updated] (HDFS-7553) fix the TestDFSUpgradeWithHA due to BindException

[ https://issues.apache.org/jira/browse/HDFS-7553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-7553: Attachment: HDFS-7553.04.patch > fix the TestDFSUpgradeWithHA due to BindException >

[jira] [Updated] (HDFS-7553) fix the TestDFSUpgradeWithHA due to BindException

[ https://issues.apache.org/jira/browse/HDFS-7553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-7553: Attachment: HDFS-7553.04.patch Thanks Chris. Both comments make sense to me, and patch 4 reflexes them. I

[jira] [Commented] (HDFS-9575) Use byte array for internal block indices in a striped block

[ https://issues.apache.org/jira/browse/HDFS-9575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067627#comment-15067627 ] Tsz Wo Nicholas Sze commented on HDFS-9575: --- The failed tests do not seem related to the patch.

[jira] [Commented] (HDFS-7553) fix the TestDFSUpgradeWithHA due to BindException

[ https://issues.apache.org/jira/browse/HDFS-7553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067559#comment-15067559 ] Xiao Chen commented on HDFS-7553: - Patch 5 fixed test failures. Specifically, patch 4 set {{nameNode}} to

[jira] [Commented] (HDFS-9494) Parallel optimization of DFSStripedOutputStream#flushAllInternals( )

[ https://issues.apache.org/jira/browse/HDFS-9494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067615#comment-15067615 ] Tsz Wo Nicholas Sze commented on HDFS-9494: --- > ... read streamers and failedStreamers ... Since

[jira] [Commented] (HDFS-9575) Use byte array for internal block indices in a striped block

[ https://issues.apache.org/jira/browse/HDFS-9575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067647#comment-15067647 ] Hudson commented on HDFS-9575: -- FAILURE: Integrated in Hadoop-trunk-Commit #9012 (See

[jira] [Commented] (HDFS-8999) Namenode need not wait for {{blockReceived}} for the last block before completing a file.

[ https://issues.apache.org/jira/browse/HDFS-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067675#comment-15067675 ] Tsz Wo Nicholas Sze commented on HDFS-8999: --- > 4. Race condition between client and FBR

[jira] [Created] (HDFS-9584) NPE in distcp when ssl configuration file does not exist in class path.

Surendra Singh Lilhore created HDFS-9584: Summary: NPE in distcp when ssl configuration file does not exist in class path. Key: HDFS-9584 URL: https://issues.apache.org/jira/browse/HDFS-9584

[jira] [Updated] (HDFS-8562) HDFS Performance is impacted by FileInputStream Finalizer

[ https://issues.apache.org/jira/browse/HDFS-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8562: Attachment: HDFS-8562.003a.patch Uploaded a version based on Colin's previous patch to address the issues as

[jira] [Commented] (HDFS-9494) Parallel optimization of DFSStripedOutputStream#flushAllInternals( )

[ https://issues.apache.org/jira/browse/HDFS-9494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15066224#comment-15066224 ] GAO Rui commented on HDFS-9494: --- Additionally, I think we might encounter other thread related

[jira] [Commented] (HDFS-9494) Parallel optimization of DFSStripedOutputStream#flushAllInternals( )

[ https://issues.apache.org/jira/browse/HDFS-9494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15066196#comment-15066196 ] Tsz Wo Nicholas Sze commented on HDFS-9494: --- [~rakeshr], thanks for catching the bug. For the

[jira] [Commented] (HDFS-8562) HDFS Performance is impacted by FileInputStream Finalizer

[ https://issues.apache.org/jira/browse/HDFS-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15066341#comment-15066341 ] Kai Zheng commented on HDFS-8562: - Put it on Jenkins and see if it works or not for all the related tests.

[jira] [Commented] (HDFS-8999) Namenode need not wait for {{blockReceived}} for the last block before completing a file.

[ https://issues.apache.org/jira/browse/HDFS-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067679#comment-15067679 ] Tsz Wo Nicholas Sze commented on HDFS-8999: --- > ... we may change the code to allow closing a file

[jira] [Commented] (HDFS-7553) fix the TestDFSUpgradeWithHA due to BindException

[ https://issues.apache.org/jira/browse/HDFS-7553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067688#comment-15067688 ] Hadoop QA commented on HDFS-7553: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9505) HDFS Architecture documentation needs to be refreshed.

[ https://issues.apache.org/jira/browse/HDFS-9505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-9505: Resolution: Fixed Fix Version/s: 2.7.3 2.8.0 Status: Resolved

[jira] [Updated] (HDFS-9505) HDFS Architecture documentation needs to be refreshed.

[ https://issues.apache.org/jira/browse/HDFS-9505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-9505: Priority: Major (was: Minor) Hadoop Flags: Reviewed Issue Type: Bug (was:

[jira] [Commented] (HDFS-9505) HDFS Architecture documentation needs to be refreshed.

[ https://issues.apache.org/jira/browse/HDFS-9505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15066411#comment-15066411 ] Hudson commented on HDFS-9505: -- FAILURE: Integrated in Hadoop-trunk-Commit #9007 (See

  1   2   >