??????????ds????kafka??????hudi????????????????????

[CalvinKirs]

hi, for better communication, please use English. Thx


Best Wishes??
CalvinKirs


??2021??05??25?? 14:41??????????<869441...@qq.com> ??????
DS??????????&nbsp;
&nbsp; &nbsp; 
????????dolphinscheduler????????????????????ds????????????ds????????????????????????????????????????
&nbsp; &nbsp; 
????????????????ds??????????????????????????????kafka??????????hudi????????Task??????????????????????????ds????????????????????????????
&nbsp; &nbsp; 
1.kafka??????hudi????????????????????????????????????????????????????????????????datax????????????????????????????kafka????????????????????kafka??????????????????????kafka??????????????
&nbsp; &nbsp; &nbsp;switch (dbType) {
case HIVE:
dataxSubTask = new HiveSubTask(taskExecutionContext, logger);
break;
case KAFKA:
dataxSubTask = new KafkaSubTask(taskExecutionContext, logger);
break;
default:
dataxSubTask = new CommonSubTask(taskExecutionContext, logger);
break;
}

&nbsp; &nbsp; 
2.kafka??????hudi????????????????????spark????????????????????????????????sparkTask??????????????????????????????????????hudi??????????
&nbsp; &nbsp; 
??????????????????????????????????????????????????????????????????????????????hudi??????????????????????ds??????
&nbsp; &nbsp; &nbsp;&nbsp;