jojochuang commented on code in PR #9582: URL: https://github.com/apache/ozone/pull/9582#discussion_r2677664676
########## hadoop-hdds/docs/content/feature/Reconfigurability.md: ########## @@ -23,93 +23,184 @@ summary: Dynamic reloading configuration. limitations under the License. --> -Ozone supports dynamic loading of certain properties without restarting the service. -If a property is reconfigurable, you can modify it in the configuration file (`ozone-site.xml`) and then invoke the command to flush it to memory. +Ozone supports dynamic reloading of certain configuration properties without restarting services. This enables operators to tune cluster behavior, adjust limits, and update settings in production without service disruption. + +## Overview + +When a property is marked as reconfigurable, you can: +1. Modify the property value in the configuration file (`ozone-site.xml`) +2. Invoke the reconfig command to apply the changes to the running service + +The reconfiguration is performed asynchronously, and you can check the status to verify completion. + +## Command Reference -command: ```shell -ozone admin reconfig --service=[OM|SCM|DATANODE] --address=<ip:port> start|status|properties +ozone admin reconfig --service=[OM|SCM|DATANODE] --address=<ip:port|hostname:port> <operation> ``` -The meaning of command options: -- **--service**: The node type of the server specified with --address -- **--address**: RPC address for one server -- Three operations are provided: - - **start**: Execute the reconfig operation asynchronously - - **status**: Check reconfig status - - **properties**: List reconfigurable properties - -## Retrieve the reconfigurable properties list -To retrieve all the reconfigurable properties list for a specific component in Ozone, -you can use the command: `ozone admin reconfig --service=[OM|SCM|DATANODE] --address=<ip:port> properties`. -This command will list all the properties that can be dynamically reconfigured at runtime for specific component.<br> - -> For example, get the Ozone OM reconfigurable properties list. -> ->$ `ozone admin reconfig --service=OM --address=hadoop1:9862 properties`<br> -OM: Node [hadoop1:9862] Reconfigurable properties:<br> +### Options + +| Option | Description | +|--------|-------------| +| `--service` | The service type: `OM`, `SCM`, or `DATANODE` | +| `--address` | RPC address of the target server (e.g., `hadoop1:9862` or `192.168.1.10:9862`). Required unless `--in-service-datanodes` is specified. | +| `--in-service-datanodes` | (DataNode only) Apply to all IN_SERVICE datanodes | + +### Operations + +| Operation | Description | +|-----------|-------------| +| `start` | Execute reconfiguration asynchronously | +| `status` | Check the status of a reconfiguration task | +| `properties` | List all reconfigurable properties for the service | + +## Reconfigurable Properties Reference + +### Ozone Manager (OM) + +| Property | Default | Description | +|----------|---------|-------------| +| `ozone.administrators` | - | Comma-separated list of Ozone administrators | +| `ozone.readonly.administrators` | - | Comma-separated list of read-only administrators | +| `ozone.om.server.list.max.size` | `1000` | Maximum server-side response size for list operations | +| `ozone.om.volume.listall.allowed` | `true` | Allow all users to list all volumes | +| `ozone.om.follower.read.local.lease.enabled` | `false` | Enable local lease for follower read optimization | Review Comment: this ########## hadoop-hdds/docs/content/feature/Reconfigurability.md: ########## @@ -23,93 +23,184 @@ summary: Dynamic reloading configuration. limitations under the License. --> -Ozone supports dynamic loading of certain properties without restarting the service. -If a property is reconfigurable, you can modify it in the configuration file (`ozone-site.xml`) and then invoke the command to flush it to memory. +Ozone supports dynamic reloading of certain configuration properties without restarting services. This enables operators to tune cluster behavior, adjust limits, and update settings in production without service disruption. + +## Overview + +When a property is marked as reconfigurable, you can: +1. Modify the property value in the configuration file (`ozone-site.xml`) +2. Invoke the reconfig command to apply the changes to the running service + +The reconfiguration is performed asynchronously, and you can check the status to verify completion. + +## Command Reference -command: ```shell -ozone admin reconfig --service=[OM|SCM|DATANODE] --address=<ip:port> start|status|properties +ozone admin reconfig --service=[OM|SCM|DATANODE] --address=<ip:port|hostname:port> <operation> ``` -The meaning of command options: -- **--service**: The node type of the server specified with --address -- **--address**: RPC address for one server -- Three operations are provided: - - **start**: Execute the reconfig operation asynchronously - - **status**: Check reconfig status - - **properties**: List reconfigurable properties - -## Retrieve the reconfigurable properties list -To retrieve all the reconfigurable properties list for a specific component in Ozone, -you can use the command: `ozone admin reconfig --service=[OM|SCM|DATANODE] --address=<ip:port> properties`. -This command will list all the properties that can be dynamically reconfigured at runtime for specific component.<br> - -> For example, get the Ozone OM reconfigurable properties list. -> ->$ `ozone admin reconfig --service=OM --address=hadoop1:9862 properties`<br> -OM: Node [hadoop1:9862] Reconfigurable properties:<br> +### Options + +| Option | Description | +|--------|-------------| +| `--service` | The service type: `OM`, `SCM`, or `DATANODE` | +| `--address` | RPC address of the target server (e.g., `hadoop1:9862` or `192.168.1.10:9862`). Required unless `--in-service-datanodes` is specified. | +| `--in-service-datanodes` | (DataNode only) Apply to all IN_SERVICE datanodes | + +### Operations + +| Operation | Description | +|-----------|-------------| +| `start` | Execute reconfiguration asynchronously | +| `status` | Check the status of a reconfiguration task | +| `properties` | List all reconfigurable properties for the service | + +## Reconfigurable Properties Reference + +### Ozone Manager (OM) + +| Property | Default | Description | +|----------|---------|-------------| +| `ozone.administrators` | - | Comma-separated list of Ozone administrators | +| `ozone.readonly.administrators` | - | Comma-separated list of read-only administrators | +| `ozone.om.server.list.max.size` | `1000` | Maximum server-side response size for list operations | +| `ozone.om.volume.listall.allowed` | `true` | Allow all users to list all volumes | +| `ozone.om.follower.read.local.lease.enabled` | `false` | Enable local lease for follower read optimization | +| `ozone.om.follower.read.local.lease.lag.limit` | `10000` | Maximum log lag for follower reads | +| `ozone.om.follower.read.local.lease.time.ms` | `5000` | Lease time in milliseconds for follower reads | +| `ozone.key.deleting.limit.per.task` | `50000` | Maximum keys to delete per task | +| `ozone.directory.deleting.service.interval` | `60s` | Directory deletion service run interval | +| `ozone.thread.number.dir.deletion` | `10` | Number of threads for directory deletion | +| `ozone.snapshot.filtering.service.interval` | `60s` | Snapshot SST filtering service run interval | + +### Storage Container Manager (SCM) + +| Property | Default | Description | +|----------|---------|-------------| +| `ozone.administrators` | - | Comma-separated list of Ozone administrators | +| `ozone.readonly.administrators` | - | Comma-separated list of read-only administrators | +| `hdds.scm.block.deletion.per-interval.max` | `500000` | Maximum blocks SCM processes per deletion interval | +| `hdds.scm.replication.thread.interval` | `300s` | Interval for the replication monitor thread | +| `hdds.scm.replication.under.replicated.interval` | `30s` | Frequency to check the under-replicated queue | +| `hdds.scm.replication.over.replicated.interval` | `30s` | Frequency to check the over-replicated queue | +| `hdds.scm.replication.event.timeout` | `12m` | Timeout for replication/deletion commands | +| `hdds.scm.replication.event.timeout.datanode.offset` | `6m` | Offset subtracted from event timeout for datanode deadline | +| `hdds.scm.replication.maintenance.replica.minimum` | `2` | Minimum replicas required for node maintenance | +| `hdds.scm.replication.maintenance.remaining.redundancy` | `1` | Remaining redundancy required for maintenance (EC) | +| `hdds.scm.replication.datanode.replication.limit` | `20` | Max replication commands queued per datanode | +| `hdds.scm.replication.datanode.reconstruction.weight` | `3` | Weight multiplier for reconstruction commands | +| `hdds.scm.replication.datanode.delete.container.limit` | `40` | Max delete container commands queued per datanode | +| `hdds.scm.replication.inflight.limit.factor` | `0.75` | Factor to scale cluster-wide replication limit | +| `hdds.scm.replication.container.sample.limit` | `100` | Number of containers sampled per state for debugging | Review Comment: this ########## hadoop-hdds/docs/content/feature/Reconfigurability.md: ########## @@ -23,93 +23,184 @@ summary: Dynamic reloading configuration. limitations under the License. --> -Ozone supports dynamic loading of certain properties without restarting the service. -If a property is reconfigurable, you can modify it in the configuration file (`ozone-site.xml`) and then invoke the command to flush it to memory. +Ozone supports dynamic reloading of certain configuration properties without restarting services. This enables operators to tune cluster behavior, adjust limits, and update settings in production without service disruption. + +## Overview + +When a property is marked as reconfigurable, you can: +1. Modify the property value in the configuration file (`ozone-site.xml`) +2. Invoke the reconfig command to apply the changes to the running service + +The reconfiguration is performed asynchronously, and you can check the status to verify completion. + +## Command Reference -command: ```shell -ozone admin reconfig --service=[OM|SCM|DATANODE] --address=<ip:port> start|status|properties +ozone admin reconfig --service=[OM|SCM|DATANODE] --address=<ip:port|hostname:port> <operation> ``` -The meaning of command options: -- **--service**: The node type of the server specified with --address -- **--address**: RPC address for one server -- Three operations are provided: - - **start**: Execute the reconfig operation asynchronously - - **status**: Check reconfig status - - **properties**: List reconfigurable properties - -## Retrieve the reconfigurable properties list -To retrieve all the reconfigurable properties list for a specific component in Ozone, -you can use the command: `ozone admin reconfig --service=[OM|SCM|DATANODE] --address=<ip:port> properties`. -This command will list all the properties that can be dynamically reconfigured at runtime for specific component.<br> - -> For example, get the Ozone OM reconfigurable properties list. -> ->$ `ozone admin reconfig --service=OM --address=hadoop1:9862 properties`<br> -OM: Node [hadoop1:9862] Reconfigurable properties:<br> +### Options + +| Option | Description | +|--------|-------------| +| `--service` | The service type: `OM`, `SCM`, or `DATANODE` | +| `--address` | RPC address of the target server (e.g., `hadoop1:9862` or `192.168.1.10:9862`). Required unless `--in-service-datanodes` is specified. | +| `--in-service-datanodes` | (DataNode only) Apply to all IN_SERVICE datanodes | + +### Operations + +| Operation | Description | +|-----------|-------------| +| `start` | Execute reconfiguration asynchronously | +| `status` | Check the status of a reconfiguration task | +| `properties` | List all reconfigurable properties for the service | + +## Reconfigurable Properties Reference + +### Ozone Manager (OM) + +| Property | Default | Description | +|----------|---------|-------------| +| `ozone.administrators` | - | Comma-separated list of Ozone administrators | +| `ozone.readonly.administrators` | - | Comma-separated list of read-only administrators | +| `ozone.om.server.list.max.size` | `1000` | Maximum server-side response size for list operations | +| `ozone.om.volume.listall.allowed` | `true` | Allow all users to list all volumes | +| `ozone.om.follower.read.local.lease.enabled` | `false` | Enable local lease for follower read optimization | +| `ozone.om.follower.read.local.lease.lag.limit` | `10000` | Maximum log lag for follower reads | +| `ozone.om.follower.read.local.lease.time.ms` | `5000` | Lease time in milliseconds for follower reads | +| `ozone.key.deleting.limit.per.task` | `50000` | Maximum keys to delete per task | +| `ozone.directory.deleting.service.interval` | `60s` | Directory deletion service run interval | +| `ozone.thread.number.dir.deletion` | `10` | Number of threads for directory deletion | +| `ozone.snapshot.filtering.service.interval` | `60s` | Snapshot SST filtering service run interval | + +### Storage Container Manager (SCM) + +| Property | Default | Description | +|----------|---------|-------------| +| `ozone.administrators` | - | Comma-separated list of Ozone administrators | +| `ozone.readonly.administrators` | - | Comma-separated list of read-only administrators | +| `hdds.scm.block.deletion.per-interval.max` | `500000` | Maximum blocks SCM processes per deletion interval | +| `hdds.scm.replication.thread.interval` | `300s` | Interval for the replication monitor thread | +| `hdds.scm.replication.under.replicated.interval` | `30s` | Frequency to check the under-replicated queue | +| `hdds.scm.replication.over.replicated.interval` | `30s` | Frequency to check the over-replicated queue | +| `hdds.scm.replication.event.timeout` | `12m` | Timeout for replication/deletion commands | +| `hdds.scm.replication.event.timeout.datanode.offset` | `6m` | Offset subtracted from event timeout for datanode deadline | +| `hdds.scm.replication.maintenance.replica.minimum` | `2` | Minimum replicas required for node maintenance | +| `hdds.scm.replication.maintenance.remaining.redundancy` | `1` | Remaining redundancy required for maintenance (EC) | +| `hdds.scm.replication.datanode.replication.limit` | `20` | Max replication commands queued per datanode | +| `hdds.scm.replication.datanode.reconstruction.weight` | `3` | Weight multiplier for reconstruction commands | +| `hdds.scm.replication.datanode.delete.container.limit` | `40` | Max delete container commands queued per datanode | +| `hdds.scm.replication.inflight.limit.factor` | `0.75` | Factor to scale cluster-wide replication limit | +| `hdds.scm.replication.container.sample.limit` | `100` | Number of containers sampled per state for debugging | Review Comment: added a few days ago in the https://issues.apache.org/jira/browse/HDDS-5713 disk balancer branch. ########## hadoop-hdds/docs/content/feature/Reconfigurability.md: ########## @@ -23,93 +23,184 @@ summary: Dynamic reloading configuration. limitations under the License. --> -Ozone supports dynamic loading of certain properties without restarting the service. -If a property is reconfigurable, you can modify it in the configuration file (`ozone-site.xml`) and then invoke the command to flush it to memory. +Ozone supports dynamic reloading of certain configuration properties without restarting services. This enables operators to tune cluster behavior, adjust limits, and update settings in production without service disruption. + +## Overview + +When a property is marked as reconfigurable, you can: +1. Modify the property value in the configuration file (`ozone-site.xml`) +2. Invoke the reconfig command to apply the changes to the running service + +The reconfiguration is performed asynchronously, and you can check the status to verify completion. + +## Command Reference -command: ```shell -ozone admin reconfig --service=[OM|SCM|DATANODE] --address=<ip:port> start|status|properties +ozone admin reconfig --service=[OM|SCM|DATANODE] --address=<ip:port|hostname:port> <operation> ``` -The meaning of command options: -- **--service**: The node type of the server specified with --address -- **--address**: RPC address for one server -- Three operations are provided: - - **start**: Execute the reconfig operation asynchronously - - **status**: Check reconfig status - - **properties**: List reconfigurable properties - -## Retrieve the reconfigurable properties list -To retrieve all the reconfigurable properties list for a specific component in Ozone, -you can use the command: `ozone admin reconfig --service=[OM|SCM|DATANODE] --address=<ip:port> properties`. -This command will list all the properties that can be dynamically reconfigured at runtime for specific component.<br> - -> For example, get the Ozone OM reconfigurable properties list. -> ->$ `ozone admin reconfig --service=OM --address=hadoop1:9862 properties`<br> -OM: Node [hadoop1:9862] Reconfigurable properties:<br> +### Options + +| Option | Description | +|--------|-------------| +| `--service` | The service type: `OM`, `SCM`, or `DATANODE` | +| `--address` | RPC address of the target server (e.g., `hadoop1:9862` or `192.168.1.10:9862`). Required unless `--in-service-datanodes` is specified. | +| `--in-service-datanodes` | (DataNode only) Apply to all IN_SERVICE datanodes | + +### Operations + +| Operation | Description | +|-----------|-------------| +| `start` | Execute reconfiguration asynchronously | +| `status` | Check the status of a reconfiguration task | +| `properties` | List all reconfigurable properties for the service | + +## Reconfigurable Properties Reference + +### Ozone Manager (OM) + +| Property | Default | Description | +|----------|---------|-------------| +| `ozone.administrators` | - | Comma-separated list of Ozone administrators | +| `ozone.readonly.administrators` | - | Comma-separated list of read-only administrators | +| `ozone.om.server.list.max.size` | `1000` | Maximum server-side response size for list operations | +| `ozone.om.volume.listall.allowed` | `true` | Allow all users to list all volumes | +| `ozone.om.follower.read.local.lease.enabled` | `false` | Enable local lease for follower read optimization | Review Comment: added recently by HDDS-13954 ########## hadoop-hdds/docs/content/feature/Reconfigurability.md: ########## @@ -23,93 +23,184 @@ summary: Dynamic reloading configuration. limitations under the License. --> -Ozone supports dynamic loading of certain properties without restarting the service. -If a property is reconfigurable, you can modify it in the configuration file (`ozone-site.xml`) and then invoke the command to flush it to memory. +Ozone supports dynamic reloading of certain configuration properties without restarting services. This enables operators to tune cluster behavior, adjust limits, and update settings in production without service disruption. + +## Overview + +When a property is marked as reconfigurable, you can: +1. Modify the property value in the configuration file (`ozone-site.xml`) +2. Invoke the reconfig command to apply the changes to the running service + +The reconfiguration is performed asynchronously, and you can check the status to verify completion. + +## Command Reference -command: ```shell -ozone admin reconfig --service=[OM|SCM|DATANODE] --address=<ip:port> start|status|properties +ozone admin reconfig --service=[OM|SCM|DATANODE] --address=<ip:port|hostname:port> <operation> ``` -The meaning of command options: -- **--service**: The node type of the server specified with --address -- **--address**: RPC address for one server -- Three operations are provided: - - **start**: Execute the reconfig operation asynchronously - - **status**: Check reconfig status - - **properties**: List reconfigurable properties - -## Retrieve the reconfigurable properties list -To retrieve all the reconfigurable properties list for a specific component in Ozone, -you can use the command: `ozone admin reconfig --service=[OM|SCM|DATANODE] --address=<ip:port> properties`. -This command will list all the properties that can be dynamically reconfigured at runtime for specific component.<br> - -> For example, get the Ozone OM reconfigurable properties list. -> ->$ `ozone admin reconfig --service=OM --address=hadoop1:9862 properties`<br> -OM: Node [hadoop1:9862] Reconfigurable properties:<br> +### Options + +| Option | Description | +|--------|-------------| +| `--service` | The service type: `OM`, `SCM`, or `DATANODE` | +| `--address` | RPC address of the target server (e.g., `hadoop1:9862` or `192.168.1.10:9862`). Required unless `--in-service-datanodes` is specified. | +| `--in-service-datanodes` | (DataNode only) Apply to all IN_SERVICE datanodes | + +### Operations + +| Operation | Description | +|-----------|-------------| +| `start` | Execute reconfiguration asynchronously | +| `status` | Check the status of a reconfiguration task | +| `properties` | List all reconfigurable properties for the service | + +## Reconfigurable Properties Reference + +### Ozone Manager (OM) + +| Property | Default | Description | +|----------|---------|-------------| +| `ozone.administrators` | - | Comma-separated list of Ozone administrators | +| `ozone.readonly.administrators` | - | Comma-separated list of read-only administrators | +| `ozone.om.server.list.max.size` | `1000` | Maximum server-side response size for list operations | +| `ozone.om.volume.listall.allowed` | `true` | Allow all users to list all volumes | +| `ozone.om.follower.read.local.lease.enabled` | `false` | Enable local lease for follower read optimization | +| `ozone.om.follower.read.local.lease.lag.limit` | `10000` | Maximum log lag for follower reads | Review Comment: added recently by HDDS-13954 ########## hadoop-hdds/docs/content/feature/Reconfigurability.md: ########## @@ -23,93 +23,184 @@ summary: Dynamic reloading configuration. limitations under the License. --> -Ozone supports dynamic loading of certain properties without restarting the service. -If a property is reconfigurable, you can modify it in the configuration file (`ozone-site.xml`) and then invoke the command to flush it to memory. +Ozone supports dynamic reloading of certain configuration properties without restarting services. This enables operators to tune cluster behavior, adjust limits, and update settings in production without service disruption. + +## Overview + +When a property is marked as reconfigurable, you can: +1. Modify the property value in the configuration file (`ozone-site.xml`) +2. Invoke the reconfig command to apply the changes to the running service + +The reconfiguration is performed asynchronously, and you can check the status to verify completion. + +## Command Reference -command: ```shell -ozone admin reconfig --service=[OM|SCM|DATANODE] --address=<ip:port> start|status|properties +ozone admin reconfig --service=[OM|SCM|DATANODE] --address=<ip:port|hostname:port> <operation> ``` -The meaning of command options: -- **--service**: The node type of the server specified with --address -- **--address**: RPC address for one server -- Three operations are provided: - - **start**: Execute the reconfig operation asynchronously - - **status**: Check reconfig status - - **properties**: List reconfigurable properties - -## Retrieve the reconfigurable properties list -To retrieve all the reconfigurable properties list for a specific component in Ozone, -you can use the command: `ozone admin reconfig --service=[OM|SCM|DATANODE] --address=<ip:port> properties`. -This command will list all the properties that can be dynamically reconfigured at runtime for specific component.<br> - -> For example, get the Ozone OM reconfigurable properties list. -> ->$ `ozone admin reconfig --service=OM --address=hadoop1:9862 properties`<br> -OM: Node [hadoop1:9862] Reconfigurable properties:<br> +### Options + +| Option | Description | +|--------|-------------| +| `--service` | The service type: `OM`, `SCM`, or `DATANODE` | +| `--address` | RPC address of the target server (e.g., `hadoop1:9862` or `192.168.1.10:9862`). Required unless `--in-service-datanodes` is specified. | +| `--in-service-datanodes` | (DataNode only) Apply to all IN_SERVICE datanodes | + +### Operations + +| Operation | Description | +|-----------|-------------| +| `start` | Execute reconfiguration asynchronously | +| `status` | Check the status of a reconfiguration task | +| `properties` | List all reconfigurable properties for the service | + +## Reconfigurable Properties Reference + +### Ozone Manager (OM) + +| Property | Default | Description | +|----------|---------|-------------| +| `ozone.administrators` | - | Comma-separated list of Ozone administrators | +| `ozone.readonly.administrators` | - | Comma-separated list of read-only administrators | +| `ozone.om.server.list.max.size` | `1000` | Maximum server-side response size for list operations | +| `ozone.om.volume.listall.allowed` | `true` | Allow all users to list all volumes | +| `ozone.om.follower.read.local.lease.enabled` | `false` | Enable local lease for follower read optimization | +| `ozone.om.follower.read.local.lease.lag.limit` | `10000` | Maximum log lag for follower reads | Review Comment: this -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
