https://github.com/apache/incubator-dolphinscheduler/issues/2102
Although the datax plugin has not been officially released, I had read the
relevant source code and found that it only supports a few reading and writing
methods in the figure, which cannot cover my current needs. if it is possible
to add the function of a custom datax configuration ?
I will describe my ideas for implementing this feature.
As shown below, I want to add a tab page , one page is the current content ,
and the other page is a text box for custom json configuration. At the same
time, a check of the json format is required.
????datax????????????????????????????????????????????????????????????4????????????????????????????????????????????????????json????????????????????????????????????????????????????datax????????????????????????????????????
tab
??????????????????????????????????????????????????????????json????????????????json????????????????????????????????
????????
????????processDefinitionJson??tasks????????params??????????????customConfig??????0??1????????????????customConfig????0??????????????????????????????????????????
{"tasks":[{"params": {"customConfig":0, "targetTable":"test",
"postStatements":[ "delete from test" ], "jobSpeedByte":0,
"jobSpeedRecord":1000, "dtType":"MYSQL", "datasource":1,
"dsType":"MYSQL", "datatarget":2, "sql":"select 1 as test from dual",
"preStatements":[ "delete from test" ] } },{...}]}
??customConfig??1??????????json????????????json??????????????????????????????????????
{"tasks":[{"params":{ { "customConfig":1,
"json":"{"job":{"setting":{"speed":{"byte":1048576},"errorLimit":{"record":0,"percentage":0.02}},"content":[{"reader":{"name":"rdbmsreader","parameter":{"username":"xxx","password":"xxx","column":["id","name"],"splitPk":"pk","connection":[{"querySql":["SELECT
* from
dual"],"jdbcUrl":["jdbc:dm://ip:port/database"]}],"fetchSize":1024,"where":"1 =
1"}},"writer":{"name":"streamwriter","parameter":{"print":true}}}]}}" } }}]
},{...}}
????????????????????????
https://github.com/apache/incubator-dolphinscheduler/issues/2102
