[
https://issues.apache.org/jira/browse/HBASE-27523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhengsicheng updated HBASE-27523:
---------------------------------
Description:
# Background:
During bulk load HFile copy, the server performance is affected to prevent the
bandwidth of the server from being full. We can design a throttler to limit the
speed of copy and thus limit the bandwidth used by copy
# Function:
2.1 Dynamically Updating Traffic Limiting Configurations
2.2 Node copy HFile Traffic Limiting
2.3 Synchronous copy HFile of the Active and Standby Clusters is unlimited
# Mode of Use:
hbase.regionserver.bulkload.node.bandwidth is greater than 0 open unit Byte/sec
Update the limit value with update_all_config or update_config 'node'
# Effect:
// Begin 5M/sec
<property>
<name>hbase.regionserver.bulkload.node.bandwidth</name>
<value>5242880</value>
<source>hbase-site.xml</source>
</property>
// After update_all_config to 10M/sec
<property>
<name>hbase.regionserver.bulkload.node.bandwidth</name>
<value>5242880</value>
<source>hbase-site.xml</source>
</property>
!image-2023-02-02-13-10-06-619.png!
was:
# Background:
During bulk load HFile copy, the server performance is affected to prevent the
bandwidth of the server from being full. We can design a throttler to limit the
speed of copy and thus limit the bandwidth used by copy
# Function:
2.1 Dynamically Updating Traffic Limiting Configurations
2.2 Node copy HFile Traffic Limiting
2.3 Synchronous copy HFile of the Active and Standby Clusters is unlimited
# Mode of Use:
hbase.regionserver.bulkload.node.bandwidth is greater than 0 open unit Byte/sec
Update the limit value with update_all_config or update_config 'node'
# Effect:
// Begin 5M/sec
<property>
<name>hbase.regionserver.bulkload.node.bandwidth</name>
<value>5242880</value>
<source>hbase-site.xml</source>
</property>
// After update_all_config to 10M/sec
<property>
<name>hbase.regionserver.bulkload.node.bandwidth</name>
<value>5242880</value>
<source>hbase-site.xml</source>
</property>
!image-2023-02-02-11-08-58-479.png!
> Add BulkLoad bandwidth throttling
> ---------------------------------
>
> Key: HBASE-27523
> URL: https://issues.apache.org/jira/browse/HBASE-27523
> Project: HBase
> Issue Type: Task
> Reporter: zhengsicheng
> Assignee: zhengsicheng
> Priority: Minor
> Attachments: image-2023-02-02-13-10-06-619.png
>
>
> # Background:
> During bulk load HFile copy, the server performance is affected to prevent
> the bandwidth of the server from being full. We can design a throttler to
> limit the speed of copy and thus limit the bandwidth used by copy
> # Function:
> 2.1 Dynamically Updating Traffic Limiting Configurations
> 2.2 Node copy HFile Traffic Limiting
> 2.3 Synchronous copy HFile of the Active and Standby Clusters is unlimited
> # Mode of Use:
> hbase.regionserver.bulkload.node.bandwidth is greater than 0 open unit
> Byte/sec
> Update the limit value with update_all_config or update_config 'node'
> # Effect:
> // Begin 5M/sec
> <property>
> <name>hbase.regionserver.bulkload.node.bandwidth</name>
> <value>5242880</value>
> <source>hbase-site.xml</source>
> </property>
> // After update_all_config to 10M/sec
> <property>
> <name>hbase.regionserver.bulkload.node.bandwidth</name>
> <value>5242880</value>
> <source>hbase-site.xml</source>
> </property>
> !image-2023-02-02-13-10-06-619.png!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)