gosonzhang opened a new issue, #7053:
URL: https://github.com/apache/inlong/issues/7053

   ### Description
   
   When the system is running, we encounter a problem: how to obtain the 
time-consuming data from the first report to the last node when it is received?
   
   The currently existing dt is the time when the data is generated, and it is 
in seconds, which is not very suitable. Besides, there are no other fields to 
meet this requirement. Here, we plan to add a time field to the message based 
on this requirement. Data reporting time
   This field is added by the Agent or SDK with the current time and checked by 
DataProxy. If not exist, it is added by DataProxy with the time when the 
message is received. When the user is consumed from MQ to data, the time 
consumption in the entire pipeline can be obtained by taking this field.
   
   A total of 3 modules are involved, which are to be divided into 3 sub-issues 
for processing
   
   ### InLong Component
   
   InLong Agent, InLong DataProxy, InLong SDK, InLong Sort
   
   ### Are you willing to submit PR?
   
   - [X] Yes, I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to