sreejasahithi commented on code in PR #9582: URL: https://github.com/apache/ozone/pull/9582#discussion_r2660221907
########## hadoop-hdds/docs/content/feature/Reconfigurability.md: ########## @@ -23,93 +23,173 @@ summary: Dynamic reloading configuration. limitations under the License. --> -Ozone supports dynamic loading of certain properties without restarting the service. -If a property is reconfigurable, you can modify it in the configuration file (`ozone-site.xml`) and then invoke the command to flush it to memory. +Ozone supports dynamic reloading of certain configuration properties without restarting services. This enables operators to tune cluster behavior, adjust limits, and update settings in production without service disruption. + +## Overview + +When a property is marked as reconfigurable, you can: +1. Modify the property value in the configuration file (`ozone-site.xml`) +2. Invoke the reconfig command to apply the changes to the running service + +The reconfiguration is performed asynchronously, and you can check the status to verify completion. + +## Command Reference -command: ```shell -ozone admin reconfig --service=[OM|SCM|DATANODE] --address=<ip:port> start|status|properties +ozone admin reconfig --service=[OM|SCM|DATANODE] --address=<ip:port> <operation> ``` -The meaning of command options: -- **--service**: The node type of the server specified with --address -- **--address**: RPC address for one server -- Three operations are provided: - - **start**: Execute the reconfig operation asynchronously - - **status**: Check reconfig status - - **properties**: List reconfigurable properties - -## Retrieve the reconfigurable properties list -To retrieve all the reconfigurable properties list for a specific component in Ozone, -you can use the command: `ozone admin reconfig --service=[OM|SCM|DATANODE] --address=<ip:port> properties`. -This command will list all the properties that can be dynamically reconfigured at runtime for specific component.<br> - -> For example, get the Ozone OM reconfigurable properties list. -> ->$ `ozone admin reconfig --service=OM --address=hadoop1:9862 properties`<br> -OM: Node [hadoop1:9862] Reconfigurable properties:<br> +### Options + +| Option | Description | +|--------|-------------| +| `--service` | The service type: `OM`, `SCM`, or `DATANODE` | +| `--address` | RPC address of the target server (e.g., `hadoop1:9862`) | +| `--in-service-datanodes` | (DataNode only) Apply to all IN_SERVICE datanodes | + +### Operations + +| Operation | Description | +|-----------|-------------| +| `start` | Execute reconfiguration asynchronously | +| `status` | Check the status of a reconfiguration task | +| `properties` | List all reconfigurable properties for the service | + +## Reconfigurable Properties Reference + +### Ozone Manager (OM) + +| Property | Default | Description | +|----------|---------|-------------| +| `ozone.administrators` | - | Comma-separated list of Ozone administrators | +| `ozone.om.server.list.max.size` | `1000` | Maximum server-side response size for list operations | +| `ozone.om.volume.listall.allowed` | `true` | Allow all users to list all volumes | +| `ozone.om.follower.read.local.lease.enabled` | `false` | Enable local lease for follower read optimization | +| `ozone.om.follower.read.local.lease.lag.limit` | `10000` | Maximum log lag for follower reads | +| `ozone.om.follower.read.local.lease.time.ms` | `5000` | Lease time in milliseconds for follower reads | + +### Storage Container Manager (SCM) + +| Property | Default | Description | +|----------|---------|-------------| +| `ozone.administrators` | - | Comma-separated list of Ozone administrators | +| `hdds.scm.block.deletion.per-interval.max` | `500000` | Maximum blocks SCM processes per deletion interval | +| `hdds.scm.replication.thread.interval` | `300s` | Interval for the replication monitor thread | +| `hdds.scm.replication.under.replicated.interval` | `30s` | Frequency to check the under-replicated queue | +| `hdds.scm.replication.over.replicated.interval` | `30s` | Frequency to check the over-replicated queue | +| `hdds.scm.replication.event.timeout` | `12m` | Timeout for replication/deletion commands | +| `hdds.scm.replication.event.timeout.datanode.offset` | `6m` | Offset subtracted from event timeout for datanode deadline | +| `hdds.scm.replication.maintenance.replica.minimum` | `2` | Minimum replicas required for node maintenance | +| `hdds.scm.replication.maintenance.remaining.redundancy` | `1` | Remaining redundancy required for maintenance (EC) | +| `hdds.scm.replication.datanode.replication.limit` | `20` | Max replication commands queued per datanode | +| `hdds.scm.replication.datanode.reconstruction.weight` | `3` | Weight multiplier for reconstruction commands | +| `hdds.scm.replication.datanode.delete.container.limit` | `40` | Max delete container commands queued per datanode | +| `hdds.scm.replication.inflight.limit.factor` | `0.75` | Factor to scale cluster-wide replication limit | +| `hdds.scm.replication.container.sample.limit` | `100` | Number of containers sampled per state for debugging | +| `ozone.scm.ec.pipeline.minimum` | `5` | Minimum EC pipelines to keep open | +| `ozone.scm.ec.pipeline.per.volume.factor` | `1` | Factor for calculating EC pipelines based on volumes | + +### DataNode Review Comment: There are some more properties that are missing here for DN, ``` hdds.datanode.block.delete.threads.max ozone.block.deleting.service.workers ozone.block.deleting.service.interval ozone.block.deleting.service.timeout hdds.datanode.replication.streams.limit ``` ########## hadoop-hdds/docs/content/feature/Reconfigurability.md: ########## @@ -23,93 +23,173 @@ summary: Dynamic reloading configuration. limitations under the License. --> -Ozone supports dynamic loading of certain properties without restarting the service. -If a property is reconfigurable, you can modify it in the configuration file (`ozone-site.xml`) and then invoke the command to flush it to memory. +Ozone supports dynamic reloading of certain configuration properties without restarting services. This enables operators to tune cluster behavior, adjust limits, and update settings in production without service disruption. + +## Overview + +When a property is marked as reconfigurable, you can: +1. Modify the property value in the configuration file (`ozone-site.xml`) +2. Invoke the reconfig command to apply the changes to the running service + +The reconfiguration is performed asynchronously, and you can check the status to verify completion. + +## Command Reference -command: ```shell -ozone admin reconfig --service=[OM|SCM|DATANODE] --address=<ip:port> start|status|properties +ozone admin reconfig --service=[OM|SCM|DATANODE] --address=<ip:port> <operation> ``` -The meaning of command options: -- **--service**: The node type of the server specified with --address -- **--address**: RPC address for one server -- Three operations are provided: - - **start**: Execute the reconfig operation asynchronously - - **status**: Check reconfig status - - **properties**: List reconfigurable properties - -## Retrieve the reconfigurable properties list -To retrieve all the reconfigurable properties list for a specific component in Ozone, -you can use the command: `ozone admin reconfig --service=[OM|SCM|DATANODE] --address=<ip:port> properties`. -This command will list all the properties that can be dynamically reconfigured at runtime for specific component.<br> - -> For example, get the Ozone OM reconfigurable properties list. -> ->$ `ozone admin reconfig --service=OM --address=hadoop1:9862 properties`<br> -OM: Node [hadoop1:9862] Reconfigurable properties:<br> +### Options + +| Option | Description | +|--------|-------------| +| `--service` | The service type: `OM`, `SCM`, or `DATANODE` | +| `--address` | RPC address of the target server (e.g., `hadoop1:9862`) | +| `--in-service-datanodes` | (DataNode only) Apply to all IN_SERVICE datanodes | + +### Operations + +| Operation | Description | +|-----------|-------------| +| `start` | Execute reconfiguration asynchronously | +| `status` | Check the status of a reconfiguration task | +| `properties` | List all reconfigurable properties for the service | + +## Reconfigurable Properties Reference + +### Ozone Manager (OM) + +| Property | Default | Description | +|----------|---------|-------------| +| `ozone.administrators` | - | Comma-separated list of Ozone administrators | +| `ozone.om.server.list.max.size` | `1000` | Maximum server-side response size for list operations | +| `ozone.om.volume.listall.allowed` | `true` | Allow all users to list all volumes | +| `ozone.om.follower.read.local.lease.enabled` | `false` | Enable local lease for follower read optimization | +| `ozone.om.follower.read.local.lease.lag.limit` | `10000` | Maximum log lag for follower reads | +| `ozone.om.follower.read.local.lease.time.ms` | `5000` | Lease time in milliseconds for follower reads | + +### Storage Container Manager (SCM) Review Comment: here `ozone.readonly.administrators` should also be added. ########## hadoop-hdds/docs/content/feature/Reconfigurability.md: ########## @@ -23,93 +23,173 @@ summary: Dynamic reloading configuration. limitations under the License. --> -Ozone supports dynamic loading of certain properties without restarting the service. -If a property is reconfigurable, you can modify it in the configuration file (`ozone-site.xml`) and then invoke the command to flush it to memory. +Ozone supports dynamic reloading of certain configuration properties without restarting services. This enables operators to tune cluster behavior, adjust limits, and update settings in production without service disruption. + +## Overview + +When a property is marked as reconfigurable, you can: +1. Modify the property value in the configuration file (`ozone-site.xml`) +2. Invoke the reconfig command to apply the changes to the running service + +The reconfiguration is performed asynchronously, and you can check the status to verify completion. + +## Command Reference -command: ```shell -ozone admin reconfig --service=[OM|SCM|DATANODE] --address=<ip:port> start|status|properties +ozone admin reconfig --service=[OM|SCM|DATANODE] --address=<ip:port> <operation> ``` -The meaning of command options: -- **--service**: The node type of the server specified with --address -- **--address**: RPC address for one server -- Three operations are provided: - - **start**: Execute the reconfig operation asynchronously - - **status**: Check reconfig status - - **properties**: List reconfigurable properties - -## Retrieve the reconfigurable properties list -To retrieve all the reconfigurable properties list for a specific component in Ozone, -you can use the command: `ozone admin reconfig --service=[OM|SCM|DATANODE] --address=<ip:port> properties`. -This command will list all the properties that can be dynamically reconfigured at runtime for specific component.<br> - -> For example, get the Ozone OM reconfigurable properties list. -> ->$ `ozone admin reconfig --service=OM --address=hadoop1:9862 properties`<br> -OM: Node [hadoop1:9862] Reconfigurable properties:<br> +### Options + +| Option | Description | +|--------|-------------| +| `--service` | The service type: `OM`, `SCM`, or `DATANODE` | +| `--address` | RPC address of the target server (e.g., `hadoop1:9862`) | +| `--in-service-datanodes` | (DataNode only) Apply to all IN_SERVICE datanodes | + +### Operations + +| Operation | Description | +|-----------|-------------| +| `start` | Execute reconfiguration asynchronously | +| `status` | Check the status of a reconfiguration task | +| `properties` | List all reconfigurable properties for the service | + +## Reconfigurable Properties Reference + +### Ozone Manager (OM) Review Comment: There are some more properties that are missing here for OM, ``` ozone.readonly.administrators ozone.key.deleting.limit.per.task ozone.directory.deleting.service.interval ozone.thread.number.dir.deletion ozone.snapshot.filtering.service.interval ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
