yunqingmoswu opened a new issue, #6212:
URL: https://github.com/apache/inlong/issues/6212

   ### Description
   
   Support multiple sink for DorisLoadNode.
   In this scenario, we agree that the upstream data stream is binary data in a 
certain format such as 'canal-json' or 'debezium', 
   and the main processing steps as follows:
   1. Deserialize the binary data by the format specified with 
'sink.multiple.format'
   2. Dynamic extract the database and table from it used with 
'sink.multiple.database-pattern' and 'sink.multiple.table-pattern'
   3. Convert the deserialized data to the json data that is used for Doris 
StreamLoad
   4. Use StreamLoad load data to Doris used with the database and table that 
is extracted earlier.
   
   ### Use case
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [X] Yes, I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to