EricJoy2048 commented on code in PR #6161:
URL: https://github.com/apache/seatunnel/pull/6161#discussion_r1447021406
##########
docs/en/connector-v2/source/Doris.md:
##########
@@ -0,0 +1,172 @@
+# Doris
+
+> Doris source connector
+
+## Support Those Engines
+
+> Spark<br/>
+> Flink<br/>
+> SeaTunnel Zeta<br/>
+
+## Key features
+
+- [x] [batch](../../concept/connector-v2-features.md)
+- [ ] [stream](../../concept/connector-v2-features.md)
+- [ ] [exactly-once](../../concept/connector-v2-features.md)
+- [x] [schema projection](../../concept/connector-v2-features.md)
+- [x] [parallelism](../../concept/connector-v2-features.md)
+- [x] [support user-defined split](../../concept/connector-v2-features.md)
+
+## Description
+
+Used to read data from Doris.
+Doris Source will send a SQL to FE, FE will parse it into an execution plan,
send it to BE, and BE will
+directly return the data
+
+## Supported DataSource Info
+
+| Datasource | Supported versions | Driver | Url | Maven |
+|------------|--------------------------------------|--------|-----|-------|
+| Doris | Only Doris2.0 or later is supported. | - | - | - |
+
+## Database Dependency
+
+> Please download the support list corresponding to 'Maven' and copy it to the
'$SEATNUNNEL_HOME/plugins/jdbc/lib/'
+> working directory<br/>
+
+## Data Type Mapping
+
+| Doris Data type |
SeaTunnel Data type
|
+|--------------------------------------|-----------------------------------------------------------------------------------------------------------------------------------------------------|
+| INT | INT
|
+| TINYINT | TINYINT
|
+| SMALLINT | SMALLINT
|
+| BIGINT | BIGINT
|
+| LARGEINT | STRING
|
+| BOOLEAN | BOOLEAN
|
+| DECIMAL | DECIMAL((Get the designated column's
specified column size)+1,<br/>(Gets the designated column's number of digits to
right of the decimal point.))) |
+| FLOAT | FLOAT
|
+| DOUBLE | DOUBLE
|
+| CHAR<br/>VARCHAR<br/>STRING<br/>TEXT | STRING
|
+| DATE | DATE
|
+| DATETIME<br/>DATETIME(p) | TIMESTAMP
|
+| ARRAY | ARRAY
|
+
+## Source Options
+
+| Name | Type | Required | Default |
Description
|
+|----------------------------------|--------|----------|------------|-----------------------------------------------------------------------------------------------------|
+| fenodes | string | yes | - | FE
address, the format is `"fe_host:fe_http_port"`
|
+| username | string | yes | - | User
username
|
+| password | string | yes | - | User
password
|
+| database | string | yes | - | The name
of Doris database
|
+| table | string | yes | - | The name
of Doris table
|
+| schema | config | yes | - | The
schema of the doris that you want to generate
|
+| query-port | string | no | 9030 | Doris
QueryPort
|
+| doris.filter.query | string | no | - | Data
filtering in doris. the format is "field = value".
|
+| doris.batch.size | int | no | 1024 | The
maximum value that can be obtained by reading Doris BE once.
|
+| doris.request.query.timeout.s | int | no | 3600 | Timeout
period of Doris scan data, expressed in seconds.
|
+| doris.exec.mem.limit | long | no | 2147483648 | Maximum
memory that can be used by a single be scan request. The default memory is 2G
(2147483648). |
+| doris.request.retries | int | no | 3 | Number
of retries to send requests to Doris FE.
|
+| doris.request.read.timeout.ms | int | no | 30000 |
|
+| doris.request.connect.timeout.ms | int | no | 30000 |
|
+
+### Tips
+
+> It is not recommended to modify advanced parameters at will
+
+## Task Example
+
+> This is an example of reading a Doris table and writing to Console.
+
+```
+env {
+ execution.parallelism = 2
+ job.mode = "BATCH"
+}
+source{
+ Doris {
+ fenodes = "doris_e2e:8030"
+ username = root
+ password = ""
+ database = "e2e_source"
+ table = "doris_e2e_table"
+ schema {
Review Comment:
We already have doris catalog, so I think we use catalog to get the fileds
an data type. If we need let user config the fields they want to read, we can
add a option `read_columns` to do this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
