Hello,

Is there a reason why a type of data skew score (probably just a percentage) is 
not shown on the Flink Dashboard / UI?

Currently users have to click on each operator and check how much data each 
subtask is processing to tell if there is skew. This is not efficient, 
especially cumbersome and also error prone for big job graphs.

It would be useful to have this shown on the operator. Possibly also a warning 
message at the top or somewhere “more meta” if a significant amount of skew is 
detected (so that users don’t have to zoom in on each and every operator to 
check the skew score).

I’d be happy to create a ticket for it, if there are no objections?

Kind regards,
Emre

Reply via email to