hf200012 commented on issue #3018: URL: https://github.com/apache/incubator-seatunnel/issues/3018#issuecomment-1333494690
Doris's source suggests looking at our official implementation of spark/flink The source implementation in the connector is currently the most efficient implementation method. Get the execution plan through fe and directly connect to be to read data concurrently. The small data volume of jdbc is okay, but the efficiency of large data volume is too low Before the sink method, we submitted code based on stream load. Our official spark / flink connector, including contributions to datax doriswriter, is also implemented based on stream load code. This is also our recommended method. Writing a single record in jdbc will cause The problem of writing failures due to too many versions, it is recommended to use stream load to import in micro-batch mode -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
