virajjasani opened a new pull request, #4264:
URL: https://github.com/apache/hadoop/pull/4264
### Description of PR
DFSAdmin provides option to initiate or query the status of reconfiguration
operation on only specific host based on host:port provided by user. It would
be good to provide an ability to initiate such operations in bulk, on all live
datanodes.
### How was this patch tested?
Dev cluster and UT.
Sample outputs:
```
$ bin/hdfs dfsadmin -reconfig datanode livenodes start
2022-05-04 22:17:44,695 WARN util.NativeCodeLoader: Unable to load
native-hadoop library for your platform... using builtin-java classes where
applicable
Started reconfiguration task on node [host1:port1].
Started reconfiguration task on node [host2:port2].
Started reconfiguration task on node [host3:port3].
Started reconfiguration task on node [host4:port4].
Started reconfiguration task on node [host5:port5].
Starting of reconfiguration task successful on 5 nodes, failed on 0 nodes.
$ bin/hdfs dfsadmin -reconfig datanode livenodes status
2022-05-04 21:57:36,506 WARN util.NativeCodeLoader: Unable to load
native-hadoop library for your platform... using builtin-java classes where
applicable
Reconfiguring status for node [host1:port1]: started at Wed May 04 21:57:04
PDT 2022 and finished at Wed May 04 21:57:04 PDT 2022.
SUCCESS: Changed property dfs.datanode.peer.stats.enabled
From: "false"
To: "true"
Reconfiguring status for node [host2:port2]: started at Wed May 04 21:57:06
PDT 2022 and finished at Wed May 04 21:57:06 PDT 2022.
FAILED: Change property dfs.datanode.peer.stats.enabled
From: "false"
To: "true"
Reconfiguring status for node [host3:port3]: started at Wed May 04 21:57:08
PDT 2022 and finished at Wed May 04 21:57:08 PDT 2022.
FAILED: Change property dfs.datanode.peer.stats.enabled
From: "false"
To: "true"
Reconfiguring status for node [host4:port4]: started at Wed May 04 21:57:10
PDT 2022 and finished at Wed May 04 21:57:10 PDT 2022.
FAILED: Change property dfs.datanode.peer.stats.enabled
From: "false"
To: "true"
Reconfiguring status for node [host5:port5]: started at Wed May 04 21:57:12
PDT 2022 and finished at Wed May 04 21:57:12 PDT 2022.
FAILED: Change property dfs.datanode.peer.stats.enabled
From: "false"
To: "true"
Retrieval of reconfiguration status successful on 5 nodes, failed on 0 nodes.
```
### For code changes:
- [X] Does the title or this PR starts with the corresponding JIRA issue id
(e.g. 'HADOOP-17799. Your PR title ...')?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]