Hi Matt, Thanks for your recommendation.
Regards,
Thomas
At 2021-11-03 07:30:30, "Matt Casters" <matt.cast...@neotechnology.com.INVALID>
wrote:
>>> It is recommended to use DataX doriswriter plug-in
>
>While I'm no longer involved in Kettle we have a number of bulk loaders in
>Apache Hop and would be happy to work with you in figuring out how to
>quickly load data into Doris.
>
>Op di 2 nov. 2021 09:49 schreef 陈明雨 <morning...@163.com>:
>
>> We haven't adapted Kettle yet, and the specific implementation of Kettle
>> is to load data line by line by using insert.
>> This is not an acceptable way for Doris. Doris needs to load data in
>> batches.
>>
>> It is recommended to use DataX doriswriter plug-in, or mysql odbc external
>> table for mysql data synchronization or load.
>>
>>
>>
>>
>> --
>>
>> 此致！Best Regards
>> 陈明雨 Mingyu Chen
>>
>> Email:
>> morning...@163.com;
>> morningman....@gmail.com
>>
>>
>>
>>
>>
>> At 2021-10-31 11:29:09, "Thomas Cai" <thomas...@126.com> wrote:
>> >Dear All,
>> >
>> >
>> >I tried to load data from MySQL to Doris by using Kettle tool and found
>> there was a limitation of 500 records. It means the job was successful if
>> ETL records were less than 500. And the job failed when the records were
>> more than 500, but the 500 records had still been loaded into Doris.
>> >
>> >
>> >Does anyone meet the same situation by using Kettle before? Or there is
>> any Doris variance setting to fix the issue? Thanks.
>> >
>> >
>> >Best Regards,
>> >Thomas
>>
