Hi developers,

Currently, the transform[1] code is bound to the single engine and cannot
be shared to other engine using.

I propose that we create `transform-v2` module to unify transform
implement, like source and sink, it is decoupled from the engine and can
run on different engines.

Furthermore,  we can use the `translation`[2] module to integrate transform
to seatunnel, flink, spark engine execute.

In order to ensure seatunnel's positioning as a data integration platform
and not introduce work beyond the plan, the `transform-v2` will only
support UDF level data conversion, and And unsupported sql
transform(because st-engine unsupported sql parse & analysis).


If you have any suggestions or concerns, you are very welcome to comment in
this email thread or in issue #2678 [3]


[1]
https://github.com/apache/incubator-seatunnel/tree/dev/seatunnel-transforms
[2]
https://github.com/apache/incubator-seatunnel/tree/dev/seatunnel-translation
[3] https://github.com/apache/incubator-seatunnel/issues/2678

Reply via email to