[GitHub] [shardingsphere] RaigorJiang opened a new pull request #14692: [DistSQL] Enhanced support for sharding scaling.

Tue, 11 Jan 2022 03:20:49 -0800 


RaigorJiang opened a new pull request #14692:
URL: https://github.com/apache/shardingsphere/pull/14692


   For #14661, 
   support minimal, complete and manual configurations when create sharding 
scaling.
   
   Changes proposed in this pull request:
   - add new scaling configuration definition in DistSQL
   - add test cases for parser
   - add test cases for updater
   
   ### Example
   #### Minimal
   - DistSQL
   ```sql
   CREATE SHARDING SCALING scaling_name(
   COMPLETION_DETECTOR(TYPE(NAME=IDLE, 
PROPERTIES("incremental-task-idle-minute-threshold"=30))),
   DATA_CONSISTENCY_CHECKER(TYPE(NAME=DATA_MATCH, 
PROPERTIES("chunk-size"=1000)))
   );
   ```
   - MetaData
   
![image](https://user-images.githubusercontent.com/5668787/148933042-82dbac91-8084-405f-8be0-d0b529423fce.png)
   
   #### Complete
   - DistSQL
   ```sql
   CREATE SHARDING SCALING scaling_name(
   INPUT(
     WORKER_THREAD=40,
     BATCH_SIZE=1000,
     RATE_LIMITER(TYPE(NAME=QPS, PROPERTIES("qps"=50)))
   ),
   OUTPUT(
     WORKER_THREAD=40,
     BATCH_SIZE=1000,
     RATE_LIMITER(TYPE(NAME=TPS, PROPERTIES("tps"=2000)))
   ),
   STREAM_CHANNEL(TYPE(NAME=MEMORY, PROPERTIES("block-queue-size"=10000))),
   COMPLETION_DETECTOR(TYPE(NAME=IDLE, 
PROPERTIES("incremental-task-idle-minute-threshold"=30))),
   DATA_CONSISTENCY_CHECKER(TYPE(NAME=DATA_MATCH, 
PROPERTIES("chunk-size"=1000)))
   );
   ```
   - MetaData
   
![image](https://user-images.githubusercontent.com/5668787/148933176-a536ef1e-c4bc-4fad-b7d5-0bfa673057bb.png)
   
   #### Manual
   - DistSQL
   ```sql
   CREATE SHARDING SCALING scaling_name(
   INPUT(
     WORKER_THREAD=40,
     BATCH_SIZE=1000,
     RATE_LIMITER(TYPE(NAME=QPS, PROPERTIES("qps"=50)))
   ),
   OUTPUT(
     WORKER_THREAD=40,
     BATCH_SIZE=1000,
     RATE_LIMITER(TYPE(NAME=TPS, PROPERTIES("tps"=2000)))
   ),
   STREAM_CHANNEL(TYPE(NAME=MEMORY, PROPERTIES("block-queue-size"=10000)))
   );
   ```
   - MetaData
   
![image](https://user-images.githubusercontent.com/5668787/148933263-d2e2382c-4646-4def-bc0b-02641cd5e791.png)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to