Hi, thanks for your question.
1. I tested it, and flink cdc imports the doris aggregation model. In the case
of join and groupby, data can be written and updated normally.
2. The flink-doris-connector version 1.0.3 is based on batch-based streamload,
which is controlled by parameters such as sink.batch.size.
Thanks && Regards,
di.wu
------------------ ???????? ------------------
??????:
"dev"
<[email protected]>;
????????: 2022??5??27??(??????) ????10:34
??????: "[email protected]"<[email protected]>;
????: Flink mysql cdc to doris??schema join ????????doris????????
??????:
??????????mysql flink cdc to doris??,
??????????, ??flink??schema????join, group by????????????????, doris
flink connector??????????????doris????????,
????????????(sum)??????????.(flink1.13.6 doris1.0.0 rc03, connector??????????)
??????????????????, ??flink??????schema join group
by????????????(flink??????20??????????), flink??????????, ????????,
????update_time??????????, update_count????????sum????,
insert??????????96????????????????mo_num????????.
Doris ??????????:
{
tenant_code AGGREGATE KEY,
mo_num REPLACE,
update_time MAX,
update_count SUM default 1
}
????????:
code
mo_num
xxxx
update_time
update_count
000032
123
????????????
2022-05-19 19:00:28
96
????:
1. ????????????????? ????????????????????????????,
??????????????, ????????????????????sum???????????
2. ????????????????, ?????????
?????????????????????????????????????????