This is an automated email from the ASF dual-hosted git repository. kxiao pushed a commit to branch branch-2.0 in repository https://gitbox.apache.org/repos/asf/doris.git
commit cfd44a5cb97f89ca00bae9e74d9db4d812e056c0 Author: HHoflittlefish777 <[email protected]> AuthorDate: Thu Sep 14 11:48:06 2023 +0800 [typo](doc) fix error description about load_to_single_tablet (#24270) * fix error description about load_to_single_tablet * fix review --- .../Load/BROKER-LOAD.md | 2 +- .../Load/CREATE-ROUTINE-LOAD.md | 2 +- .../Load/STREAM-LOAD.md | 48 ++++------------------ .../Load/BROKER-LOAD.md | 2 +- .../Load/CREATE-ROUTINE-LOAD.md | 2 +- .../Load/STREAM-LOAD.md | 27 +----------- 6 files changed, 14 insertions(+), 69 deletions(-) diff --git a/docs/en/docs/sql-manual/sql-reference/Data-Manipulation-Statements/Load/BROKER-LOAD.md b/docs/en/docs/sql-manual/sql-reference/Data-Manipulation-Statements/Load/BROKER-LOAD.md index a54b7c815e1..a8f3c3cdb63 100644 --- a/docs/en/docs/sql-manual/sql-reference/Data-Manipulation-Statements/Load/BROKER-LOAD.md +++ b/docs/en/docs/sql-manual/sql-reference/Data-Manipulation-Statements/Load/BROKER-LOAD.md @@ -198,7 +198,7 @@ WITH BROKER broker_name - `load_to_single_tablet` - Boolean type, True means that one task can only load data to one tablet in the corresponding partition at a time. The default value is false. The number of tasks for the job depends on the overall concurrency. This parameter can only be set when loading data into the OLAP table with random partition. + Boolean type, True means that one task can only load data to one tablet in the corresponding partition at a time. The default value is false. The number of tasks for the job depends on the overall concurrency. This parameter can only be set when loading data into the OLAP table with random bucketing. - <version since="dev" type="inline"> priority </version> diff --git a/docs/en/docs/sql-manual/sql-reference/Data-Manipulation-Statements/Load/CREATE-ROUTINE-LOAD.md b/docs/en/docs/sql-manual/sql-reference/Data-Manipulation-Statements/Load/CREATE-ROUTINE-LOAD.md index b6db9a64914..9e2b703d648 100644 --- a/docs/en/docs/sql-manual/sql-reference/Data-Manipulation-Statements/Load/CREATE-ROUTINE-LOAD.md +++ b/docs/en/docs/sql-manual/sql-reference/Data-Manipulation-Statements/Load/CREATE-ROUTINE-LOAD.md @@ -247,7 +247,7 @@ FROM data_source [data_source_properties] Integer, Used to set the default parallelism for sending batch, if the value for parallelism exceed `max_send_batch_parallelism_per_job` in BE config, then the coordinator BE will use the value of `max_send_batch_parallelism_per_job`. 11. `load_to_single_tablet` - Boolean type, True means that one task can only load data to one tablet in the corresponding partition at a time. The default value is false. This parameter can only be set when loading data into the OLAP table with random partition. + Boolean type, True means that one task can only load data to one tablet in the corresponding partition at a time. The default value is false. This parameter can only be set when loading data into the OLAP table with random bucketing. 12. `partial_columns` Boolean type, True means that use partial column update, the default value is false, this parameter is only allowed to be set when the table model is Unique and Merge on Write is used. Multi-table does not support this parameter. diff --git a/docs/en/docs/sql-manual/sql-reference/Data-Manipulation-Statements/Load/STREAM-LOAD.md b/docs/en/docs/sql-manual/sql-reference/Data-Manipulation-Statements/Load/STREAM-LOAD.md index 3682010c06e..1a3582c0e9e 100644 --- a/docs/en/docs/sql-manual/sql-reference/Data-Manipulation-Statements/Load/STREAM-LOAD.md +++ b/docs/en/docs/sql-manual/sql-reference/Data-Manipulation-Statements/Load/STREAM-LOAD.md @@ -145,45 +145,15 @@ separated by commas. The system will use the order specified by user. in case above, data should be ended with __DORIS_SEQUENCE_COL__. ``` -23. load_to_single_tablet: Boolean type, True means that one task can only load data to one tablet in the corresponding partition at a time. The default value is false. This parameter can only be set when loading data into the OLAP table with random partition. - - RETURN VALUES - After the import is complete, the related content of this import will be returned in Json format. Currently includes the following fields - Status: Import the last status. - Success: Indicates that the import is successful and the data is already visible; - Publish Timeout: Indicates that the import job has been successfully committed, but is not immediately visible for some reason. The user can consider the import to be successful and not have to retry the import - Label Already Exists: Indicates that the Label has been occupied by other jobs. It may be imported successfully or it may be being imported. - The user needs to determine the subsequent operation through the get label state command - Others: The import failed, the user can specify the Label to retry the job - Message: Detailed description of the import status. On failure, the specific failure reason is returned. - NumberTotalRows: The total number of rows read from the data stream - NumberLoadedRows: The number of data rows imported this time, only valid in Success - NumberFilteredRows: The number of rows filtered out by this import, that is, the number of rows with unqualified data quality - NumberUnselectedRows: This import, the number of rows filtered out by the where condition - LoadBytes: The size of the source file data imported this time - LoadTimeMs: The time taken for this import - BeginTxnTimeMs: The time it takes to request Fe to start a transaction, in milliseconds. - StreamLoadPutTimeMs: The time it takes to request Fe to obtain the execution plan for importing data, in milliseconds. - ReadDataTimeMs: Time spent reading data, in milliseconds. - WriteDataTimeMs: The time taken to perform the write data operation, in milliseconds. - CommitAndPublishTimeMs: The time it takes to submit a request to Fe and publish the transaction, in milliseconds. - ErrorURL: The specific content of the filtered data, only the first 1000 items are retained - -ERRORS: - Import error details can be viewed with the following statement: - ```` - SHOW LOAD WARNINGS ON 'url' - ```` - where url is the url given by ErrorURL. - -24. compress_type - - Specify compress type file. Only support compressed csv file now. Support gz, lzo, bz2, lz4, lzop, deflate. - -25. trim_double_quotes: Boolean type, The default value is false. True means that the outermost double quotes of each field in the csv file are trimmed. - -26. skip_lines: <version since="dev" type="inline"> Integer type, the default value is 0. It will skip some lines in the head of csv file. It will be disabled when format is `csv_with_names` or `csv_with_names_and_types`. </version> -27. comment: <version since="1.2.3" type="inline"> String type, the default value is "". </version> +24. load_to_single_tablet: Boolean type, True means that one task can only load data to one tablet in the corresponding partition at a time. The default value is false. This parameter can only be set when loading data into the OLAP table with random bucketing. + +25. compress_type: Specify compress type file. Only support compressed csv file now. Support gz, lzo, bz2, lz4, lzop, deflate. + +26. trim_double_quotes: Boolean type, The default value is false. True means that the outermost double quotes of each field in the csv file are trimmed. + +27. skip_lines: <version since="dev" type="inline"> Integer type, the default value is 0. It will skip some lines in the head of csv file. It will be disabled when format is `csv_with_names` or `csv_with_names_and_types`. </version> + +28. comment: <version since="1.2.3" type="inline"> String type, the default value is "". </version> ### Example diff --git a/docs/zh-CN/docs/sql-manual/sql-reference/Data-Manipulation-Statements/Load/BROKER-LOAD.md b/docs/zh-CN/docs/sql-manual/sql-reference/Data-Manipulation-Statements/Load/BROKER-LOAD.md index 907f7cdf67d..2b7de2f605f 100644 --- a/docs/zh-CN/docs/sql-manual/sql-reference/Data-Manipulation-Statements/Load/BROKER-LOAD.md +++ b/docs/zh-CN/docs/sql-manual/sql-reference/Data-Manipulation-Statements/Load/BROKER-LOAD.md @@ -197,7 +197,7 @@ WITH BROKER broker_name - `load_to_single_tablet` - 布尔类型，为true表示支持一个任务只导入数据到对应分区的一个tablet，默认值为false，作业的任务数取决于整体并发度。该参数只允许在对带有random分区的olap表导数的时候设置。 + 布尔类型，为true表示支持一个任务只导入数据到对应分区的一个tablet，默认值为false，作业的任务数取决于整体并发度。该参数只允许在对带有random分桶的olap表导数的时候设置。 - <version since="dev" type="inline"> priority </version> diff --git a/docs/zh-CN/docs/sql-manual/sql-reference/Data-Manipulation-Statements/Load/CREATE-ROUTINE-LOAD.md b/docs/zh-CN/docs/sql-manual/sql-reference/Data-Manipulation-Statements/Load/CREATE-ROUTINE-LOAD.md index 08542c3eb62..459de971563 100644 --- a/docs/zh-CN/docs/sql-manual/sql-reference/Data-Manipulation-Statements/Load/CREATE-ROUTINE-LOAD.md +++ b/docs/zh-CN/docs/sql-manual/sql-reference/Data-Manipulation-Statements/Load/CREATE-ROUTINE-LOAD.md @@ -246,7 +246,7 @@ FROM data_source [data_source_properties] 11. `load_to_single_tablet` - 布尔类型，为 true 表示支持一个任务只导入数据到对应分区的一个 tablet，默认值为 false，该参数只允许在对带有 random 分区的 olap 表导数的时候设置。 + 布尔类型，为 true 表示支持一个任务只导入数据到对应分区的一个 tablet，默认值为 false，该参数只允许在对带有 random 分桶的 olap 表导数的时候设置。 12. `partial_columns` 布尔类型，为 true 表示使用部分列更新，默认值为 false，该参数只允许在表模型为 Unique 且采用 Merge on Write 时设置。一流多表不支持此参数。 diff --git a/docs/zh-CN/docs/sql-manual/sql-reference/Data-Manipulation-Statements/Load/STREAM-LOAD.md b/docs/zh-CN/docs/sql-manual/sql-reference/Data-Manipulation-Statements/Load/STREAM-LOAD.md index cb522e9051e..188a44f0c31 100644 --- a/docs/zh-CN/docs/sql-manual/sql-reference/Data-Manipulation-Statements/Load/STREAM-LOAD.md +++ b/docs/zh-CN/docs/sql-manual/sql-reference/Data-Manipulation-Statements/Load/STREAM-LOAD.md @@ -141,32 +141,7 @@ curl --location-trusted -u user:passwd [-H ""...] -T data.file -XPUT http://fe_h 系统会使用用户指定的数据导入数据。在上述用例中，导入数据中最后一列数据为__DORIS_SEQUENCE_COL__。 ``` -23. load_to_single_tablet: 布尔类型，为true表示支持一个任务只导入数据到对应分区的一个 tablet，默认值为 false，该参数只允许在对带有 random 分区的 olap 表导数的时候设置。 - - RETURN VALUES - 导入完成后，会以Json格式返回这次导入的相关内容。当前包括以下字段 - Status: 导入最后的状态。 - Success：表示导入成功，数据已经可见； - Publish Timeout：表述导入作业已经成功Commit，但是由于某种原因并不能立即可见。用户可以视作已经成功不必重试导入 - Label Already Exists: 表明该Label已经被其他作业占用，可能是导入成功，也可能是正在导入。 - 用户需要通过get label state命令来确定后续的操作 - 其他：此次导入失败，用户可以指定Label重试此次作业 - Message: 导入状态详细的说明。失败时会返回具体的失败原因。 - NumberTotalRows: 从数据流中读取到的总行数 - NumberLoadedRows: 此次导入的数据行数，只有在Success时有效 - NumberFilteredRows: 此次导入过滤掉的行数，即数据质量不合格的行数 - NumberUnselectedRows: 此次导入，通过 where 条件被过滤掉的行数 - LoadBytes: 此次导入的源文件数据量大小 - LoadTimeMs: 此次导入所用的时间 - BeginTxnTimeMs: 向Fe请求开始一个事务所花费的时间，单位毫秒。 - StreamLoadPutTimeMs: 向Fe请求获取导入数据执行计划所花费的时间，单位毫秒。 - ReadDataTimeMs: 读取数据所花费的时间，单位毫秒。 - WriteDataTimeMs: 执行写入数据操作所花费的时间，单位毫秒。 - CommitAndPublishTimeMs: 向Fe请求提交并且发布事务所花费的时间，单位毫秒。 - ErrorURL: 被过滤数据的具体内容，仅保留前1000条 - -ERRORS: - 可以通过以下语句查看导入错误详细信息： +24. load_to_single_tablet: 布尔类型，为true表示支持一个任务只导入数据到对应分区的一个 tablet，默认值为 false，该参数只允许在对带有 random 分桶的 olap 表导数的时候设置。 ``` SHOW LOAD WARNINGS ON 'url' --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
