[GitHub] [incubator-seatunnel] EricJoy2048 commented on issue #2274: [ST-Engine][Checkpoint] The design of Checkpoint

[GitBox]

EricJoy2048 commented on issue #2274:
URL: 
https://github.com/apache/incubator-seatunnel/issues/2274#issuecomment-1197744571

   > > <img alt="image" width="835" 
src="https://user-images.githubusercontent.com/32193458/181148775-705332e2-d997-4a50-9cd9-aa904be3af3d.png";>
   > > Can it be like this?
   > > <img alt="image" width="881" 
src="https://user-images.githubusercontent.com/32193458/181149570-4180f833-d399-4ac0-88d9-7c6428aed989.png";>
   > 
   > No, it's different. The above writer has multiple input subtasks, which is 
to reduce the resource usage on the sink side;
   
   From this design https://github.com/apache/incubator-seatunnel/issues/2261 
we can know. Now, we only support `Source` and `PartitionTransform` operator to 
set parallelism, The parallelism of other connectors is equal to the sum of the 
parallelism of its upstream operators. So, in this case the parallelism of the 
sink operator is 3(One source have 2 parallelism and another one have 1 
parallelism) not 2. Then, we have 3 source subtask and 3 sink subtask, I think 
it can replace to tow pipeline.
   
   Or, do we have any other more suitable design for parallelism? 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org