gosonzhang opened a new issue, #8758: URL: https://github.com/apache/inlong/issues/8758
### Description In the running environment, there are the following problems that need to optimize the metadata management of DataProxy: 1. When DataProxy synchronizes metadata from Manager, it may take too long to pull data. We add a pull time consumption alarm setting to remind when encountering such an abnormal situation during use; 2. When DataProxy synchronizes metadata from the Manager and loads data from the metadata, it may be out of sync. We need to improve to avoid the situation where the metadata that is dropped to the file has not had time to load and take effect; 3. For the metadata synchronized by DataProxy, if the topic configuration is deleted but the message has already entered the channel from the source and is waiting to be sent, this part of the data should continue to be sent instead of being discarded. ### InLong Component InLong DataProxy ### Are you willing to submit PR? - [X] Yes, I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@inlong.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
