Re: [PR] [FLINK-36270][Connectors/DynamoDB] Assign only children splits of a split when it is marked as finished [flink-connector-aws]

Fri, 13 Sep 2024 02:55:59 -0700 


gguptp commented on PR #164:
URL: 
https://github.com/apache/flink-connector-aws/pull/164#issuecomment-2348537801

   > Add some pictures for the performance bottleneck!
   > ### We see the checkpoints taking a long time to complete
   > 
   > 
![image](https://private-user-images.githubusercontent.com/35062175/367238974-5ad6b70f-d46c-4cb1-beb3-1ea1dc52b78c.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjYyMjEwMzMsIm5iZiI6MTcyNjIyMDczMywicGF0aCI6Ii8zNTA2MjE3NS8zNjcyMzg5NzQtNWFkNmI3MGYtZDQ2Yy00Y2IxLWJlYjMtMWVhMWRjNTJiNzhjLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA5MTMlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwOTEzVDA5NDUzM1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWU3ZTZjNzYzMGRjZDgwY2NmNTk5NmNiZTkzYzViZTliYmJjMDhjNjQxNjE4YmIwODFhNTQzMWM4M2Y0NTliZDQmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.E4OvH7JjRuO_QntXNrJTQ4XYoUlM96TGN5-h0LGsmVU)
   > ### We see that the time is spent on "Start Delay"
   > 
   > 
![image](https://private-user-images.githubusercontent.com/35062175/367239202-4a813286-7874-435a-845c-53d4658d43ac.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjYyMjEwMzMsIm5iZiI6MTcyNjIyMDczMywicGF0aCI6Ii8zNTA2MjE3NS8zNjcyMzkyMDItNGE4MTMyODYtNzg3NC00MzVhLTg0NWMtNTNkNDY1OGQ0M2FjLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA5MTMlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwOTEzVDA5NDUzM1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPThmMjYwMDgwMzllNTg3NTgzYjI3MTFjN2YzMzJmMjM2NGQ5NDUyNDMxMzgzMDI2MzA0YmM3M2MwNjRkNDA5MjQmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0._H29iWVbqPk7n7wk96_fH4u8J1msKVZJl3rVfdckb78)
   > ### We also see new checkpoints being stuck in an "unacknowledged" state
   > 
   > 
![image](https://private-user-images.githubusercontent.com/35062175/367239332-1412df54-1584-4ac5-830a-635dccc9ce5d.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjYyMjEwMzMsIm5iZiI6MTcyNjIyMDczMywicGF0aCI6Ii8zNTA2MjE3NS8zNjcyMzkzMzItMTQxMmRmNTQtMTU4NC00YWM1LTgzMGEtNjM1ZGNjYzljZTVkLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA5MTMlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwOTEzVDA5NDUzM1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTFkZDg0MzhiYWZiNWYzNGI0MzMzMmNhOWEwNWU3YjgzY2U4MDY0MDQ0ZDU2ZGQ4ZDFlMWMyODk3ZTg1OTlmNDAmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.LSKIyCQejEsDjPBEmu9liWg0LhBPgiJozn08Csjtevk)
   
   Updated the PR overview


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to