[jira] [Commented] (HDFS-9261) Erasure Coding: Skip encoding the data cells if all the parity data streamers are failed for the current block group

[ https://issues.apache.org/jira/browse/HDFS-9261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975896#comment-14975896 ] Rakesh R commented on HDFS-9261: Thanks [~umamaheswararao] for the advice.

[jira] [Updated] (HDFS-8410) Add computation time metrics to datanode for ECWorker

[ https://issues.apache.org/jira/browse/HDFS-8410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-8410: Attachment: HDFS-8410-002.patch > Add computation time metrics to datanode for ECWorker >

[jira] [Updated] (HDFS-9261) Erasure Coding: Skip encoding the data cells if all the parity data streamers are failed for the current block group

[ https://issues.apache.org/jira/browse/HDFS-9261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-9261: --- Attachment: HDFS-9261-01.patch > Erasure Coding: Skip encoding the data cells if all the parity data streamers

[jira] [Updated] (HDFS-8410) Add computation time metrics to datanode for ECWorker

[ https://issues.apache.org/jira/browse/HDFS-8410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-8410: Summary: Add computation time metrics to datanode for ECWorker (was: Add time count metrics to datanode for

[jira] [Commented] (HDFS-9261) Erasure Coding: Skip encoding the data cells if all the parity data streamers are failed for the current block group

[ https://issues.apache.org/jira/browse/HDFS-9261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975911#comment-14975911 ] Hadoop QA commented on HDFS-9261: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-8410) Add computation time metrics to datanode for ECWorker

[ https://issues.apache.org/jira/browse/HDFS-8410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976021#comment-14976021 ] Li Bo commented on HDFS-8410: - Patch 002 reduces metrics number grom 3 to 2. The time metrics make user know

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975804#comment-14975804 ] Hadoop QA commented on HDFS-9260: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9313) Possible NullPointerException in BlockManager if no excess replica can be chosen

[ https://issues.apache.org/jira/browse/HDFS-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975815#comment-14975815 ] Hadoop QA commented on HDFS-9313: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-7896) HDFS Slow disk detection

[ https://issues.apache.org/jira/browse/HDFS-7896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975816#comment-14975816 ] Brahma Reddy Battula commented on HDFS-7896: A slow disk checker script should be well

[jira] [Commented] (HDFS-9305) Delayed heartbeat processing causes storm of subsequent heartbeats

[ https://issues.apache.org/jira/browse/HDFS-9305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975860#comment-14975860 ] Hudson commented on HDFS-9305: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #541 (See

[jira] [Commented] (HDFS-9291) Fix TestInterDatanodeProtocol to be FsDataset-agnostic.

[ https://issues.apache.org/jira/browse/HDFS-9291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975855#comment-14975855 ] Hudson commented on HDFS-9291: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #541 (See

[jira] [Commented] (HDFS-8945) Update the description about replica placement in HDFS Architecture documentation

[ https://issues.apache.org/jira/browse/HDFS-8945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975861#comment-14975861 ] Hudson commented on HDFS-8945: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #541 (See

[jira] [Commented] (HDFS-9292) Make TestFileConcorruption independent to underlying FsDataset Implementation.

[ https://issues.apache.org/jira/browse/HDFS-9292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975854#comment-14975854 ] Hudson commented on HDFS-9292: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #541 (See

[jira] [Commented] (HDFS-9284) fsck command should not print exception trace when file not found

[ https://issues.apache.org/jira/browse/HDFS-9284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975863#comment-14975863 ] Hudson commented on HDFS-9284: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #541 (See

[jira] [Commented] (HDFS-8256) "-storagepolicies , -blockId ,-replicaDetails " options are missed out in usage and from documentation

[ https://issues.apache.org/jira/browse/HDFS-8256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975925#comment-14975925 ] Akira AJISAKA commented on HDFS-8256: - fsck -blockId (HDFS-6663) and -storagepolicies (HDFS-7467)

[jira] [Commented] (HDFS-9289) check genStamp when complete file

[ https://issues.apache.org/jira/browse/HDFS-9289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975837#comment-14975837 ] Walter Su commented on HDFS-9289: - The patch hides a potential bigger bug. We should find it out and

[jira] [Commented] (HDFS-9168) Move client side unit test to hadoop-hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-9168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975843#comment-14975843 ] Hadoop QA commented on HDFS-9168: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9276) Failed to Update HDFS Delegation Token for long running application in HA mode

[ https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976025#comment-14976025 ] Hadoop QA commented on HDFS-9276: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-9276) Failed to Update HDFS Delegation Token for long running application in HA mode

[ https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liangliang Gu updated HDFS-9276: Attachment: HDFS-9276.05.patch > Failed to Update HDFS Delegation Token for long running application

[jira] [Commented] (HDFS-9315) Update excess storage type list properly when del hint is picked

[ https://issues.apache.org/jira/browse/HDFS-9315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976138#comment-14976138 ] Hadoop QA commented on HDFS-9315: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Created] (HDFS-9317) Document fsck -blockId and -storagepolicy options in branch-2.7

Akira AJISAKA created HDFS-9317: --- Summary: Document fsck -blockId and -storagepolicy options in branch-2.7 Key: HDFS-9317 URL: https://issues.apache.org/jira/browse/HDFS-9317 Project: Hadoop HDFS

[jira] [Updated] (HDFS-8108) Fsck should provide the info on mandatory option to be used along with "-blocks , -locations and -racks"

[ https://issues.apache.org/jira/browse/HDFS-8108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-8108: Component/s: documentation > Fsck should provide the info on mandatory option to be used along with

[jira] [Updated] (HDFS-9317) Document fsck -blockId and -storagepolicy options in branch-2.7

[ https://issues.apache.org/jira/browse/HDFS-9317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-9317: Attachment: HDFS-9317-branch-2.7.00.patch Attaching a patch for branch-2.7. > Document fsck

[jira] [Updated] (HDFS-9317) Document fsck -blockId and -storagepolicy options in branch-2.7

[ https://issues.apache.org/jira/browse/HDFS-9317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-9317: Status: Patch Available (was: Open) > Document fsck -blockId and -storagepolicy options in

[jira] [Updated] (HDFS-8529) Add blocks count metrics to datanode for ECWorker

[ https://issues.apache.org/jira/browse/HDFS-8529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-8529: Attachment: HDFS-8529-002.patch > Add blocks count metrics to datanode for ECWorker >

[jira] [Created] (HDFS-9316) BytesRead counter not incremented in WebhdfsFileSystem

Shradha Revankar created HDFS-9316: -- Summary: BytesRead counter not incremented in WebhdfsFileSystem Key: HDFS-9316 URL: https://issues.apache.org/jira/browse/HDFS-9316 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9317) Document fsck -blockId and -storagepolicy options in branch-2.7

[ https://issues.apache.org/jira/browse/HDFS-9317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976206#comment-14976206 ] Akira AJISAKA commented on HDFS-9317: - These options are documented in trunk and branch-2 by HDFS-8256,

[jira] [Commented] (HDFS-9261) Erasure Coding: Skip encoding the data cells if all the parity data streamers are failed for the current block group

[ https://issues.apache.org/jira/browse/HDFS-9261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976115#comment-14976115 ] Hadoop QA commented on HDFS-9261: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9129) Move the safemode block count into BlockManager

[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976176#comment-14976176 ] Hadoop QA commented on HDFS-9129: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9309) Tests that use KeyStoreUtil must call KeyStoreUtil.cleanupSSLConfig()

[ https://issues.apache.org/jira/browse/HDFS-9309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975787#comment-14975787 ] Hadoop QA commented on HDFS-9309: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9311) Support optional offload of NameNode HA service health checks to a separate RPC server.

[ https://issues.apache.org/jira/browse/HDFS-9311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975788#comment-14975788 ] Hadoop QA commented on HDFS-9311: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9276) Failed to Update HDFS Delegation Token for long running application in HA mode

[ https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976266#comment-14976266 ] Hadoop QA commented on HDFS-9276: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-9261) Erasure Coding: Skip encoding the data cells if all the parity data streamers are failed for the current block group

[ https://issues.apache.org/jira/browse/HDFS-9261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-9261: --- Attachment: HDFS-9261-02.patch Attached new patch fixing checkstyle issue. > Erasure Coding: Skip encoding

[jira] [Commented] (HDFS-9317) Document fsck -blockId and -storagepolicy options in branch-2.7

[ https://issues.apache.org/jira/browse/HDFS-9317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976222#comment-14976222 ] Brahma Reddy Battula commented on HDFS-9317: [~ajisakaa] thanks for reporting and uploading the

[jira] [Commented] (HDFS-9317) Document fsck -blockId and -storagepolicy options in branch-2.7

[ https://issues.apache.org/jira/browse/HDFS-9317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976232#comment-14976232 ] Hadoop QA commented on HDFS-9317: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9275) Fix TestRecoverStripedFile

[ https://issues.apache.org/jira/browse/HDFS-9275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976233#comment-14976233 ] Yi Liu commented on HDFS-9275: -- Walter, sorry I forgot this JIRA :-) For continuous block, if n replicas are

[jira] [Commented] (HDFS-9275) Fix TestRecoverStripedFile

[ https://issues.apache.org/jira/browse/HDFS-9275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976289#comment-14976289 ] Kai Zheng commented on HDFS-9275: - Thanks Walter for the JIRA and working on this. Would you give the

[jira] [Commented] (HDFS-9259) Make SO_SNDBUF size configurable at DFSClient side for hdfs write scenario

[ https://issues.apache.org/jira/browse/HDFS-9259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976578#comment-14976578 ] Hadoop QA commented on HDFS-9259: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-7725) Incorrect "nodes in service" metrics caused all writes to fail

[ https://issues.apache.org/jira/browse/HDFS-7725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976626#comment-14976626 ] Kihwal Lee commented on HDFS-7725: -- Cherry-picked it to branch-2.7. > Incorrect "nodes in service"

[jira] [Updated] (HDFS-9259) Make SO_SNDBUF size configurable at DFSClient side for hdfs write scenario

[ https://issues.apache.org/jira/browse/HDFS-9259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9259: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved (was:

[jira] [Updated] (HDFS-7725) Incorrect "nodes in service" metrics caused all writes to fail

[ https://issues.apache.org/jira/browse/HDFS-7725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-7725: - Labels: 2.7.2-candidate (was: ) > Incorrect "nodes in service" metrics caused all writes to fail >

[jira] [Commented] (HDFS-7725) Incorrect "nodes in service" metrics caused all writes to fail

[ https://issues.apache.org/jira/browse/HDFS-7725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976523#comment-14976523 ] Kuhu Shukla commented on HDFS-7725: --- This issue manifested on 2.6 as prior to HDFS-7374 ( with count

[jira] [Updated] (HDFS-9303) Balancer slowly with too many small file blocks

[ https://issues.apache.org/jira/browse/HDFS-9303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-9303: Attachment: HDFS-9303.002.patch pull the recently code and add a new param #blockBytesNum.There is a little

[jira] [Updated] (HDFS-7984) webhdfs:// needs to support provided delegation tokens

[ https://issues.apache.org/jira/browse/HDFS-7984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HeeSoo Kim updated HDFS-7984: - Attachment: HDFS-7984.003.patch > webhdfs:// needs to support provided delegation tokens >

[jira] [Commented] (HDFS-9303) Balancer slowly with too many small file blocks

[ https://issues.apache.org/jira/browse/HDFS-9303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976548#comment-14976548 ] Lin Yiqun commented on HDFS-9303: - There is a little differece with HDFS-8824,you can see my latest patch.

[jira] [Commented] (HDFS-9303) Balancer slowly with too many small file blocks

[ https://issues.apache.org/jira/browse/HDFS-9303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976549#comment-14976549 ] Lin Yiqun commented on HDFS-9303: - There is a little differece with HDFS-8824,you can see my latest patch.

[jira] [Commented] (HDFS-9303) Balancer slowly with too many small file blocks

[ https://issues.apache.org/jira/browse/HDFS-9303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976547#comment-14976547 ] Lin Yiqun commented on HDFS-9303: - There is a little differece with HDFS-8824,you can see my latest patch.

[jira] [Commented] (HDFS-8950) NameNode refresh doesn't remove DataNodes that are no longer in the allowed list

[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976605#comment-14976605 ] Kihwal Lee commented on HDFS-8950: -- This has been a source of a lot of confusion lately. Should be fixed

[jira] [Commented] (HDFS-8950) NameNode refresh doesn't remove DataNodes that are no longer in the allowed list

[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976612#comment-14976612 ] Kihwal Lee commented on HDFS-8950: -- I tried to cherry-pick it, but {{TestDatanodeManager}} needs the

[jira] [Updated] (HDFS-8950) NameNode refresh doesn't remove DataNodes that are no longer in the allowed list

[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-8950: - Labels: 2.7.2-candidate (was: ) > NameNode refresh doesn't remove DataNodes that are no longer in the

[jira] [Updated] (HDFS-8950) NameNode refresh doesn't remove DataNodes that are no longer in the allowed list

[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-8950: - Attachment: HDFS-8950.branch-2.7.patch Attaching the patch for branch-2.7. Essentially the same patch

[jira] [Updated] (HDFS-9302) WebHDFS throws NullPointerException if newLength is not provided

[ https://issues.apache.org/jira/browse/HDFS-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jagadesh Kiran N updated HDFS-9302: --- Attachment: HDFS-9302_00.patch Attached the patch [~hitliuyi] ,please review > WebHDFS

[jira] [Updated] (HDFS-9302) WebHDFS throws NullPointerException if newLength is not provided

[ https://issues.apache.org/jira/browse/HDFS-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jagadesh Kiran N updated HDFS-9302: --- Status: Patch Available (was: Open) > WebHDFS throws NullPointerException if newLength is not

[jira] [Updated] (HDFS-7725) Incorrect "nodes in service" metrics caused all writes to fail

[ https://issues.apache.org/jira/browse/HDFS-7725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-7725: - Fix Version/s: (was: 2.8.0) 2.7.2 3.0.0 > Incorrect "nodes in

[jira] [Updated] (HDFS-9279) Decomissioned capacity should not be considered for configured/used capacity

[ https://issues.apache.org/jira/browse/HDFS-9279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9279: - Target Version/s: 2.8.0 > Decomissioned capacity should not be considered for configured/used capacity >

[jira] [Commented] (HDFS-9313) Possible NullPointerException in BlockManager if no excess replica can be chosen

[ https://issues.apache.org/jira/browse/HDFS-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976685#comment-14976685 ] Hadoop QA commented on HDFS-9313: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Resolved] (HDFS-6327) Clean up FSDirectory

[ https://issues.apache.org/jira/browse/HDFS-6327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HDFS-6327. -- Resolution: Fixed Closing this jira as all the subtasks have been completed. > Clean up FSDirectory >

[jira] [Commented] (HDFS-9289) check genStamp when complete file

[ https://issues.apache.org/jira/browse/HDFS-9289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976815#comment-14976815 ] Chang Li commented on HDFS-9289: [~zhz], I don't have the log show the file was completed with an old GS.

[jira] [Commented] (HDFS-9313) Possible NullPointerException in BlockManager if no excess replica can be chosen

[ https://issues.apache.org/jira/browse/HDFS-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976853#comment-14976853 ] Ming Ma commented on HDFS-9313: --- Thanks [~zhz]. If it continues, given no state has changed or no alternative

[jira] [Updated] (HDFS-9299) Give ReplicationMonitor a readable thread name

[ https://issues.apache.org/jira/browse/HDFS-9299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9299: --- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-9302) WebHDFS throws NullPointerException if newLength is not provided

[ https://issues.apache.org/jira/browse/HDFS-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976756#comment-14976756 ] Hadoop QA commented on HDFS-9302: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Staffan Friberg updated HDFS-9260: -- Attachment: HDFS-9260.009.patch Fix for timed out test

[jira] [Commented] (HDFS-9303) Balancer slowly with too many small file blocks

[ https://issues.apache.org/jira/browse/HDFS-9303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976915#comment-14976915 ] Hadoop QA commented on HDFS-9303: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9168) Move client side unit test to hadoop-hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-9168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976841#comment-14976841 ] Jing Zhao commented on HDFS-9168: - Patch looks good to me. One nit is that we can use this chance to fix

[jira] [Updated] (HDFS-9168) Move client side unit test to hadoop-hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-9168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9168: - Attachment: HDFS-9168.004.patch > Move client side unit test to hadoop-hdfs-client >

[jira] [Commented] (HDFS-9168) Move client side unit test to hadoop-hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-9168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976858#comment-14976858 ] Haohui Mai commented on HDFS-9168: -- Thanks Jing for the reviews. Uploaded the v4 patch to address the

[jira] [Commented] (HDFS-9311) Support optional offload of NameNode HA service health checks to a separate RPC server.

[ https://issues.apache.org/jira/browse/HDFS-9311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976877#comment-14976877 ] Jitendra Nath Pandey commented on HDFS-9311: [~cnauroth], thanks for creating a separate jira

[jira] [Commented] (HDFS-9259) Make SO_SNDBUF size configurable at DFSClient side for hdfs write scenario

[ https://issues.apache.org/jira/browse/HDFS-9259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976942#comment-14976942 ] Hudson commented on HDFS-9259: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #543 (See

[jira] [Commented] (HDFS-9289) check genStamp when complete file

[ https://issues.apache.org/jira/browse/HDFS-9289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976735#comment-14976735 ] Zhe Zhang commented on HDFS-9289: - bq. the client after updatepipeline with the new gen stamp it later

[jira] [Commented] (HDFS-9313) Possible NullPointerException in BlockManager if no excess replica can be chosen

[ https://issues.apache.org/jira/browse/HDFS-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976794#comment-14976794 ] Zhe Zhang commented on HDFS-9313: - Thanks Ming for the fix. I haven't dived into full details of the two

[jira] [Commented] (HDFS-9259) Make SO_SNDBUF size configurable at DFSClient side for hdfs write scenario

[ https://issues.apache.org/jira/browse/HDFS-9259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976871#comment-14976871 ] Hudson commented on HDFS-9259: -- FAILURE: Integrated in Hadoop-trunk-Commit #8715 (See

[jira] [Updated] (HDFS-9279) Decomissioned capacity should not be considered for configured/used capacity

[ https://issues.apache.org/jira/browse/HDFS-9279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9279: -- Attachment: HDFS-9279-v4.patch Updated patch that keeps the XceiverCount update as-is. Changed the Unit

[jira] [Commented] (HDFS-9289) check genStamp when complete file

[ https://issues.apache.org/jira/browse/HDFS-9289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976925#comment-14976925 ] Zhe Zhang commented on HDFS-9289: - The fact that all 3 DNs have old GS doesn't mean the client also has an

[jira] [Updated] (HDFS-9307) fuseConnect should be private to fuse_connect.c

[ https://issues.apache.org/jira/browse/HDFS-9307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9307: --- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-9307) fuseConnect should be private to fuse_connect.c

[ https://issues.apache.org/jira/browse/HDFS-9307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976939#comment-14976939 ] Colin Patrick McCabe commented on HDFS-9307: +1. Thanks, [~liuml07]. > fuseConnect should be

[jira] [Commented] (HDFS-9259) Make SO_SNDBUF size configurable at DFSClient side for hdfs write scenario

[ https://issues.apache.org/jira/browse/HDFS-9259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14977044#comment-14977044 ] Hudson commented on HDFS-9259: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #604 (See

[jira] [Commented] (HDFS-9307) fuseConnect should be private to fuse_connect.c

[ https://issues.apache.org/jira/browse/HDFS-9307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14977072#comment-14977072 ] Mingliang Liu commented on HDFS-9307: - Thank you [~cmccabe] for your reporting this jira, reviewing and

[jira] [Commented] (HDFS-9289) check genStamp when complete file

[ https://issues.apache.org/jira/browse/HDFS-9289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14977156#comment-14977156 ] Chang Li commented on HDFS-9289: [~zhz], yes, the above log is from the same cluster as the first log I

[jira] [Commented] (HDFS-9259) Make SO_SNDBUF size configurable at DFSClient side for hdfs write scenario

[ https://issues.apache.org/jira/browse/HDFS-9259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14977012#comment-14977012 ] Hudson commented on HDFS-9259: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #1327 (See

[jira] [Commented] (HDFS-9299) Give ReplicationMonitor a readable thread name

[ https://issues.apache.org/jira/browse/HDFS-9299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14977092#comment-14977092 ] Hudson commented on HDFS-9299: -- SUCCESS: Integrated in Hadoop-trunk-Commit #8716 (See

[jira] [Commented] (HDFS-9307) fuseConnect should be private to fuse_connect.c

[ https://issues.apache.org/jira/browse/HDFS-9307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14977087#comment-14977087 ] Hudson commented on HDFS-9307: -- SUCCESS: Integrated in Hadoop-trunk-Commit #8716 (See

[jira] [Updated] (HDFS-7163) WebHdfsFileSystem should retry reads according to the configured retry policy.

[ https://issues.apache.org/jira/browse/HDFS-7163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated HDFS-7163: - Description: In the current implementation of WebHdfsFileSystem, opens are retried according to the

[jira] [Updated] (HDFS-7163) WebHdfsFileSystem should retry reads according to the configured retry policy.

[ https://issues.apache.org/jira/browse/HDFS-7163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated HDFS-7163: - Attachment: HDFS-7163.001.patch > WebHdfsFileSystem should retry reads according to the configured retry

[jira] [Updated] (HDFS-9311) Support optional offload of NameNode HA service health checks to a separate RPC server.

[ https://issues.apache.org/jira/browse/HDFS-9311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9311: Attachment: HDFS-9311.002.patch [~jnp], thank you for the review. I agree. The handler ratio was a

[jira] [Commented] (HDFS-9259) Make SO_SNDBUF size configurable at DFSClient side for hdfs write scenario

[ https://issues.apache.org/jira/browse/HDFS-9259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14977037#comment-14977037 ] Hudson commented on HDFS-9259: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #591 (See

[jira] [Commented] (HDFS-9164) hdfs-nfs connector fails on O_TRUNC

[ https://issues.apache.org/jira/browse/HDFS-9164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14977067#comment-14977067 ] Mingliang Liu commented on HDFS-9164: - You may need to "Submit Patch" to trigger Jenkins build. >

[jira] [Commented] (HDFS-9255) Consolidate block recovery related implementation into a single class

[ https://issues.apache.org/jira/browse/HDFS-9255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14977111#comment-14977111 ] Zhe Zhang commented on HDFS-9255: - Thanks Walter for the update. +1 on the latest patch (listing a few nits

[jira] [Updated] (HDFS-9289) check genStamp when complete file

[ https://issues.apache.org/jira/browse/HDFS-9289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated HDFS-9289: --- Attachment: HDFS-9289.3.patch .3 patch set block in DataStreamer to volatile > check genStamp when complete

[jira] [Commented] (HDFS-9229) Expose size of NameNode directory as a metric

[ https://issues.apache.org/jira/browse/HDFS-9229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976995#comment-14976995 ] Zhe Zhang commented on HDFS-9229: - Great work Surendra! The patch looks good overall. A few comments: # We

[jira] [Created] (HDFS-9318) considerLoad factor can be improved

Kuhu Shukla created HDFS-9318: - Summary: considerLoad factor can be improved Key: HDFS-9318 URL: https://issues.apache.org/jira/browse/HDFS-9318 Project: Hadoop HDFS Issue Type: Bug Affects

[jira] [Commented] (HDFS-9083) Replication violates block placement policy.

[ https://issues.apache.org/jira/browse/HDFS-9083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14977073#comment-14977073 ] Jing Zhao commented on HDFS-9083: - The patch looks good to me. [~mingma] and [~brahmareddy], do you also

[jira] [Updated] (HDFS-9312) Fix TestReplication to be FsDataset-agnostic.

[ https://issues.apache.org/jira/browse/HDFS-9312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9312: Affects Version/s: 2.7.1 Target Version/s: 3.0.0, 2.8.0 Status: Patch Available

[jira] [Commented] (HDFS-9267) TestDiskError should get stored replicas through FsDatasetTestUtils.

[ https://issues.apache.org/jira/browse/HDFS-9267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976993#comment-14976993 ] Lei (Eddy) Xu commented on HDFS-9267: - [~cmccabe] thanks a lot for the suggestions. bq. Do you think

[jira] [Updated] (HDFS-9164) hdfs-nfs connector fails on O_TRUNC

[ https://issues.apache.org/jira/browse/HDFS-9164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Constantine Peresypkin updated HDFS-9164: - Assignee: Constantine Peresypkin Status: Patch Available (was: Open) >

[jira] [Updated] (HDFS-9311) Support optional offload of NameNode HA service health checks to a separate RPC server.

[ https://issues.apache.org/jira/browse/HDFS-9311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9311: Attachment: HDFS-9311.003.patch I'm attaching patch v003. The only difference compared to v002 is

[jira] [Commented] (HDFS-9307) fuseConnect should be private to fuse_connect.c

[ https://issues.apache.org/jira/browse/HDFS-9307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14977311#comment-14977311 ] Hudson commented on HDFS-9307: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2535 (See

[jira] [Commented] (HDFS-9299) Give ReplicationMonitor a readable thread name

[ https://issues.apache.org/jira/browse/HDFS-9299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14977317#comment-14977317 ] Hudson commented on HDFS-9299: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2535 (See

[jira] [Commented] (HDFS-9311) Support optional offload of NameNode HA service health checks to a separate RPC server.

[ https://issues.apache.org/jira/browse/HDFS-9311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14977194#comment-14977194 ] Jitendra Nath Pandey commented on HDFS-9311: +1 > Support optional offload of NameNode HA

[jira] [Commented] (HDFS-9312) Fix TestReplication to be FsDataset-agnostic.

[ https://issues.apache.org/jira/browse/HDFS-9312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14977230#comment-14977230 ] Zhe Zhang commented on HDFS-9312: - Thanks for the work Eddy. The patch LGTM overall. The only issue I see

[jira] [Commented] (HDFS-9279) Decomissioned capacity should not be considered for configured/used capacity

[ https://issues.apache.org/jira/browse/HDFS-9279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14977236#comment-14977236 ] Hadoop QA commented on HDFS-9279: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

  1   2   >