[jira] [Resolved] (HDFS-17554) OIV: Print the storage policy name in OIV delimited output
[ https://issues.apache.org/jira/browse/HDFS-17554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hualong Zhang resolved HDFS-17554. -- Resolution: Not A Problem > OIV: Print the storage policy name in OIV delimited output > -- > > Key: HDFS-17554 > URL: https://issues.apache.org/jira/browse/HDFS-17554 > Project: Hadoop HDFS > Issue Type: Improvement > Components: tools >Affects Versions: 3.5.0 >Reporter: Hualong Zhang >Assignee: Hualong Zhang >Priority: Major > > Refer to adding the storage policy name to the OIV output instead of the > erasure coding policy. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-17554) OIV: Print the storage policy name in OIV delimited output
Hualong Zhang created HDFS-17554: Summary: OIV: Print the storage policy name in OIV delimited output Key: HDFS-17554 URL: https://issues.apache.org/jira/browse/HDFS-17554 Project: Hadoop HDFS Issue Type: Improvement Components: tools Affects Versions: 3.5.0 Reporter: Hualong Zhang Assignee: Hualong Zhang Refer to adding the storage policy name to the OIV output instead of the erasure coding policy. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-17525) Router web interfaces missing X-FRAME-OPTIONS security configurations
Hualong Zhang created HDFS-17525: Summary: Router web interfaces missing X-FRAME-OPTIONS security configurations Key: HDFS-17525 URL: https://issues.apache.org/jira/browse/HDFS-17525 Project: Hadoop HDFS Issue Type: Improvement Components: router Affects Versions: 3.4.0 Reporter: Hualong Zhang Assignee: Hualong Zhang Router web interfaces are missing X-FRAME-OPTIONS security configurations, we should complete them. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-17367) Add PercentUsed for Different StorageTypes in JMX
Hualong Zhang created HDFS-17367: Summary: Add PercentUsed for Different StorageTypes in JMX Key: HDFS-17367 URL: https://issues.apache.org/jira/browse/HDFS-17367 Project: Hadoop HDFS Issue Type: Improvement Components: namenode Affects Versions: 3.5.0 Reporter: Hualong Zhang Assignee: Hualong Zhang Currently, the NameNode only displays PercentUsed for the entire cluster. We plan to add corresponding PercentUsed metrics for different StorageTypes. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-17284) Fix int overflow in calculating numEcReplicatedTasks and numReplicationTasks during block recovery
Hualong Zhang created HDFS-17284: Summary: Fix int overflow in calculating numEcReplicatedTasks and numReplicationTasks during block recovery Key: HDFS-17284 URL: https://issues.apache.org/jira/browse/HDFS-17284 Project: Hadoop HDFS Issue Type: Bug Components: namenode Reporter: Hualong Zhang Assignee: Hualong Zhang Fix int overflow in calculating numEcReplicatedTasks and numReplicationTasks during block recovery -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-17180) HttpFS Add Support getTrashRoots API
Hualong Zhang created HDFS-17180: Summary: HttpFS Add Support getTrashRoots API Key: HDFS-17180 URL: https://issues.apache.org/jira/browse/HDFS-17180 Project: Hadoop HDFS Issue Type: Improvement Components: webhdfs Affects Versions: 3.4.0 Reporter: Hualong Zhang Assignee: Hualong Zhang We should ensure that WebHDFS remains synchronized with HttpFS, as the former has already implemented the *getTrashRoots* interface. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-17168) Support getTrashRoots API in WebHDFS
Hualong Zhang created HDFS-17168: Summary: Support getTrashRoots API in WebHDFS Key: HDFS-17168 URL: https://issues.apache.org/jira/browse/HDFS-17168 Project: Hadoop HDFS Issue Type: Improvement Components: webhdfs Affects Versions: 3.4.0 Reporter: Hualong Zhang Assignee: Hualong Zhang Attachments: image-2023-08-26-23-13-42-426.png WebHDFS should support getTrashRoots: !image-2023-08-26-23-13-42-426.png|width=686,height=204! -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-17146) Use the dfsadmin -reconfig command to initiate reconfiguration on all decommissioning datanodes.
Hualong Zhang created HDFS-17146: Summary: Use the dfsadmin -reconfig command to initiate reconfiguration on all decommissioning datanodes. Key: HDFS-17146 URL: https://issues.apache.org/jira/browse/HDFS-17146 Project: Hadoop HDFS Issue Type: Improvement Components: hdfs Affects Versions: 3.4.0 Reporter: Hualong Zhang Assignee: Hualong Zhang If the *DFSAdmin* command could have the ability to perform bulk operations across all decommissioned datanodes, that would be highly advantageous. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-17122) Rectify the table length discrepancy in the DataNode UI.
Hualong Zhang created HDFS-17122: Summary: Rectify the table length discrepancy in the DataNode UI. Key: HDFS-17122 URL: https://issues.apache.org/jira/browse/HDFS-17122 Project: Hadoop HDFS Issue Type: Bug Affects Versions: 3.4.0 Reporter: Hualong Zhang Assignee: Hualong Zhang Attachments: image-2023-07-25-18-12-10-582.png !image-2023-07-25-18-12-10-582.png|width=580,height=231! -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-17115) HttpFS Add Support getErasureCodeCodecs API
Hualong Zhang created HDFS-17115:
Summary: HttpFS Add Support getErasureCodeCodecs API
Key: HDFS-17115
URL: https://issues.apache.org/jira/browse/HDFS-17115
Project: Hadoop HDFS
Issue Type: Improvement
Components: httpfs
Affects Versions: 3.4.0
Reporter: Hualong Zhang
Assignee: Hualong Zhang
We should ensure that *WebHDFS* remains synchronized with {*}HttpFS{*}, as the
former has already implemented the *getErasureCodeCodecs* interface.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-17083) Support getErasureCodeCodecs API in WebHDFS
Hualong Zhang created HDFS-17083: Summary: Support getErasureCodeCodecs API in WebHDFS Key: HDFS-17083 URL: https://issues.apache.org/jira/browse/HDFS-17083 Project: Hadoop HDFS Issue Type: Improvement Components: webhdfs Affects Versions: 3.4.0 Reporter: Hualong Zhang Assignee: Hualong Zhang Attachments: image-2023-07-12-22-52-15-954.png WebHDFS should support getErasureCodeCodecs: !image-2023-07-12-22-52-15-954.png|width=643,height=169! -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-17052) Erasure coding reconstruction failed when num of storageType rack NOT enough
Hualong Zhang created HDFS-17052: Summary: Erasure coding reconstruction failed when num of storageType rack NOT enough Key: HDFS-17052 URL: https://issues.apache.org/jira/browse/HDFS-17052 Project: Hadoop HDFS Issue Type: Bug Components: ec Affects Versions: 3.3.4 Reporter: Hualong Zhang Assignee: Hualong Zhang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-17043) HttpFS implementation for getAllErasureCodingPolicies
Hualong Zhang created HDFS-17043: Summary: HttpFS implementation for getAllErasureCodingPolicies Key: HDFS-17043 URL: https://issues.apache.org/jira/browse/HDFS-17043 Project: Hadoop HDFS Issue Type: Improvement Components: httpfs Affects Versions: 3.4.0 Reporter: Hualong Zhang Assignee: Hualong Zhang HttpFS should support getAllErasureCodingPolicies API In order to be able to retrieve all Erasure Coding Policies.. WebHdfs implementation available on HDFS-17029. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-17029) Support getECPolices API in WebHDFS
Hualong Zhang created HDFS-17029: Summary: Support getECPolices API in WebHDFS Key: HDFS-17029 URL: https://issues.apache.org/jira/browse/HDFS-17029 Project: Hadoop HDFS Issue Type: Improvement Components: webhdfs Affects Versions: 3.4.0 Reporter: Hualong Zhang Assignee: Hualong Zhang Attachments: image-2023-05-29-23-55-09-224.png WebHDFS should support getEcPolicies: !image-2023-05-29-23-55-09-224.png! -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-17014) HttpFS Add Support getStatus API
Hualong Zhang created HDFS-17014:
Summary: HttpFS Add Support getStatus API
Key: HDFS-17014
URL: https://issues.apache.org/jira/browse/HDFS-17014
Project: Hadoop HDFS
Issue Type: Improvement
Components: webhdfs
Affects Versions: 3.4.0
Reporter: Hualong Zhang
Assignee: Hualong Zhang
We should ensure that *WebHDFS* remains synchronized with {*}HttpFS{*}, as the
former has already implemented the *getStatus* interface.
WebHDFS:
HTTPFS:
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-17001) Support getStatus API in WebHDFS
Hualong Zhang created HDFS-17001: Summary: Support getStatus API in WebHDFS Key: HDFS-17001 URL: https://issues.apache.org/jira/browse/HDFS-17001 Project: Hadoop HDFS Issue Type: Improvement Components: webhdfs Affects Versions: 3.4.0 Reporter: Hualong Zhang Assignee: Hualong Zhang Attachments: image-2023-05-08-14-34-51-873.png WebHDFS should support getStatus: !image-2023-05-08-14-34-51-873.png! -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-16990) HttpFS: Add Support getFileLinkStatus API
Hualong Zhang created HDFS-16990: Summary: HttpFS: Add Support getFileLinkStatus API Key: HDFS-16990 URL: https://issues.apache.org/jira/browse/HDFS-16990 Project: Hadoop HDFS Issue Type: Improvement Components: httpfs Affects Versions: 3.4.0 Reporter: Hualong Zhang Assignee: Hualong Zhang HttpFS should implement the *getFileLinkStatus* API already implemented in WebHDFS. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-16981) Support getFileLinkStatus API in WebHDFS
Hualong Zhang created HDFS-16981: Summary: Support getFileLinkStatus API in WebHDFS Key: HDFS-16981 URL: https://issues.apache.org/jira/browse/HDFS-16981 Project: Hadoop HDFS Issue Type: Improvement Components: webhdfs Affects Versions: 3.4.0 Reporter: Hualong Zhang Attachments: image-2023-04-13-23-41-51-380.png WebHDFS should support getFileLinkStatus: !image-2023-04-13-23-41-51-380.png! -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-16952) Add description of GETSERVERDEFAULTS to WebHDFS doc
Hualong Zhang created HDFS-16952: Summary: Add description of GETSERVERDEFAULTS to WebHDFS doc Key: HDFS-16952 URL: https://issues.apache.org/jira/browse/HDFS-16952 Project: Hadoop HDFS Issue Type: Improvement Components: webhdfs Affects Versions: 3.4.0 Reporter: Hualong Zhang Add description of GETSERVERDEFAULTS to WebHDFS doc -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-16951) Add description of GETSERVERDEFAULTS to WebHDFS doc
Hualong Zhang created HDFS-16951: Summary: Add description of GETSERVERDEFAULTS to WebHDFS doc Key: HDFS-16951 URL: https://issues.apache.org/jira/browse/HDFS-16951 Project: Hadoop HDFS Issue Type: Improvement Components: webhdfs Affects Versions: 3.4.0 Reporter: Hualong Zhang Add description of GETSERVERDEFAULTS to WebHDFS doc -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-16916) Improve the use of JUnit Test in DFSClient
Hualong Zhang created HDFS-16916: Summary: Improve the use of JUnit Test in DFSClient Key: HDFS-16916 URL: https://issues.apache.org/jira/browse/HDFS-16916 Project: Hadoop HDFS Issue Type: Improvement Components: dfsclient Affects Versions: 3.4.0 Reporter: Hualong Zhang Improve the use of JUnit Test in DFSClient -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-16893) Standardize the usage of DFSClient debug log
Hualong Zhang created HDFS-16893: Summary: Standardize the usage of DFSClient debug log Key: HDFS-16893 URL: https://issues.apache.org/jira/browse/HDFS-16893 Project: Hadoop HDFS Issue Type: Improvement Components: dfsclient Reporter: Hualong Zhang Fix For: 3.4.0 Standardize the usage of SLF4J in debug log in DFSClient -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-16292) The DFS Input Stream is waiting to be read
Hualong Zhang created HDFS-16292: Summary: The DFS Input Stream is waiting to be read Key: HDFS-16292 URL: https://issues.apache.org/jira/browse/HDFS-16292 Project: Hadoop HDFS Issue Type: Improvement Components: datanode Affects Versions: 2.5.2 Reporter: Hualong Zhang Attachments: image-2021-11-01-18-36-54-329.png The input stream has been waiting.The problem seems to be that BlockReaderPeer#peer does not set ReadTimeout and WriteTimeout.We can solve this problem by setting the timeout in BlockReaderFactory#nextTcpPeer Jstack as follows !image-2021-11-01-18-36-54-329.png! -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-16243) The available disk space is less than the reserved space, and no log message is displayed
Hualong Zhang created HDFS-16243: Summary: The available disk space is less than the reserved space, and no log message is displayed Key: HDFS-16243 URL: https://issues.apache.org/jira/browse/HDFS-16243 Project: Hadoop HDFS Issue Type: Improvement Components: datanode Affects Versions: 2.7.2 Reporter: Hualong Zhang When I submitted a task to the hadoop test cluster, it appeared "could only be replicated to 0 nodes instead of minReplication (=1)" I checked the namenode and datanode logs and did not find any error logs. It was not until the use of dfsadmin -report that the available capacity was 0 and I realized that it may be a configuration problem. Checking the configuration found that the value of the "dfs.datanode.du.reserved" configuration is greater than the available disk space of HDFS, which caused this problem It seems that there should be some warnings or errors in the log. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
