EricJoy2048 commented on code in PR #2625: URL: https://github.com/apache/incubator-seatunnel/pull/2625#discussion_r962149113
########## docs/en/connector-v2/sink/Clickhouse.md: ########## @@ -4,7 +4,15 @@ ## Description -Used to write data to Clickhouse. Supports Batch and Streaming mode. +Used to write data to Clickhouse. + +## Key features + Review Comment: done ########## docs/en/concept/connector-v2-features.md: ########## @@ -0,0 +1,46 @@ +# Intro to connector V2 features + +## Source Connector Features + +### exactly-once + +If each piece of data in the data source will only be sent downstream by the source once, we think this source connector supports exactly once. + +In SeaTunnel, we can save the read **Split** and its **offset**(The position of the read data in split at that time, +such as line number, byte size, offset, etc) as **StateSnapshot** when checkpoint. If the task restarted, we will get the last **StateSnapshot** +and then locate the **Split** and **offset** read last time and continue to send data downstream. + +For example `File`, `Kafka`. + +### schema projection + +If the source connector supports selective reading of certain columns or supports the data format read through `schema` params, we think it supports schema projection. Review Comment: done -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
