cqutwangyu opened a new issue, #6421: URL: https://github.com/apache/seatunnel/issues/6421
### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement. ### Description 在我的使用场景中，会在集群模式下部署多个SeatunnelServer，然后启动上百个SeatunnelClient。 他们的任务是从source读取消息，通过transform处理后，发送到sink。 在这个过程中，有大量的数据被处理，但不能完全保证所有数据都能处理成功，所以我需要记录每一条数据的状态。 我的设想如下： 1.SourceReader记录原始数据，并记录transform处理的结果（success or error）。 2.SinkWriter记录transform处理后的输出数据，并记录是否发送成功（success or failure）。 --- In my use case, I deploy multiple seatunnelServers in cluster mode and then start hundreds of seatUnnelClients. Their job is to read messages from the source, process them through transform, and send them to the sink. During this process, a lot of data is being processed, but there is no guarantee that all of it will be processed successfully, so I need to keep track of the status of each piece of data. My vision is as follows: 1.SourceReader logs the raw data and records the result of the transform process (success or error). 2.SinkWriter logs the output of the transform and notes whether it was a success or failure. ### Usage Scenario 1.当Seatunnel任务中出现数据处理异常时，可以通过表记录来审查错误并解决故障。 2.当下游处理数据出现问题时，可以通过表记录来查询Seatunnel任务处理过程是否正确。 --- 1.When the data is processed in the unnel task, it can review errors and solve faults by recording. 2.When the problem of the current processing data appears, it can be used to query whether the unnel task processing is correct. ### Related issues pass ### Are you willing to submit a PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
