wenhemin opened a new issue #1856: [Feature] Add ETL function node URL: https://github.com/apache/incubator-dolphinscheduler/issues/1856 I extended the ETL node on DS, Implement the function of executing SQL for data synchronization. Synchronize data through Datax middleware, DS need not be coupled to Datax. I can contribute code if needed by the community. Implementation ideas: 1.Add ETL nodes in DS 2.Generate Datax json file based on configuration parameters 3.Datax python script called by shell script task to start process Problems with the current implementation: 1.Datax does not support multi-table synchronization, a task can only synchronize one table 2.Low resource utilization, each ETL task needs to start a JVM process
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
