zhangshenghang opened a new issue, #10463:
URL: https://github.com/apache/seatunnel/issues/10463

   ### Search before asking
   
   - [x] I had searched in the 
[feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22)
 and found no similar feature requirement.
   
   
   ### Description
   
   ## Background
   Currently, when a job is running, it is difficult to quickly determine 
"where it is slowing down/where there is congestion/whether it is being held 
back by downstream processes". Troubleshooting often relies only on logs or 
experience.
   
   ## What needs to be achieved
   Provide real-time operation indicators and trends on the job running page to 
visually display three types of information:
   1) Whether the link is being slowed down by downstream processes (whether 
upstream sending often needs to wait)
   2) Whether the intermediate buffer is congested (whether it is nearly full, 
whether it is repeatedly full)
   3) Whether operators in each stage are slowing down (busyness/idleness of 
reading/processing/writing and time consumption per unit of data)
   
   ## Which indicators to look at
   
   Link side: Proportion of downstream waiting time; Buffer occupancy 
(occupancy ratio + occupancy/capacity); Auxiliary information such as waiting 
duration
   Node side:
   Source: Reading ratio, idle ratio
   Transform: Busy ratio, average processing time (per record), input 
volume/output volume
   Sink: Busy ratio, average writing time (per record), writing volume, and 
time consumption of submission-related stages
   
   ### Usage Scenario
   
   _No response_
   
   ### Related issues
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [x] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [x] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to