LiangchangZ opened a new pull request #1332: Doris sink for Spark Structured Streaming URL: https://github.com/apache/incubator-doris/pull/1332 Doris Sink is a type of Structured Streaming sink with exactly-once fault-tolerance guarantees. It now supports two mode: Broker LOAD & Mini LOAD. Broker LOAD: the data will write files on hdfs and Doris use hdfs broker to load the files in. Suitable for the scenario that the data of each batch is larger than 1GB. Mini LOAD: the data will send to Doris by HTTP PUT request. Suitable for the scenario that the data of each batch is less than 1GB (Advice mode) . We will support the third mode Streaming LOAD recently which has higher performance than the two mode reminded above. Note: Doris is also named Palo in Baidu
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
