gosonzhang opened a new issue, #7098:
URL: https://github.com/apache/inlong/issues/7098

   ### Description
   
   We use MonitorIndex to output the minute-level indicator data of production 
and consumption, and output the records to log files for collection and 
processing by third-party tools.
   
   In actual use, we found that after the collected indicator data is 
aggregated, these records do not have a clear distinction, so that when the 
data is aggregated, multiple fields need to be associated to distinguish 
whether it is a duplicate record, so we need to add additional A unique UUID 
field value enables fast deduplication during data processing. We plan to 
ensure that the data of a specified node is unique by adding a field: log 
output time + output record sequence ID.
   
   ### InLong Component
   
   Other for not specified component
   
   ### Are you willing to submit PR?
   
   - [X] Yes, I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to