xbkaishui commented on issue #720:
URL:
https://github.com/apache/incubator-seatunnel/issues/720#issuecomment-1003360659
> The roadmap 2.0 is excellent 👍.
>
> I want to add a new feature to roadmap, it is very important for data
integration. We use flume long long ago, but it's not friendly for us to write
the agent file. Then we use flinksql replace the flume, it have provided great
convenience to insert、etl data, etc.
>
> project weakness
> flume 1) need to learn how to write agent file 2) can not work with
resource manager like yarn, k8s
> sqoop 1) don't have rich connectors 2) based on mapreduce
> ### flinksql
> * has rich connectors, cdc
> * friendly for us, we can use sql grammar easily, like `+`, `-`, etc
> * easy to work with resource manager, yarn, k8s
>
> This point of this feature is introduce a new workflow template, show you
the workflow demo.
>
> **The origin workflow**
>
> ```
> env {
> execution.parallelism = 1
> }
>
> source {
> FakeSourceStream {
> result_table_name = "fake"
> field_name = "name,age"
> }
> }
>
> transform {
> sql {
> sql = "select name,age from fake"
> }
> }
>
> sink {
> ConsoleSink {}
> }
> ```
>
> **The feature workflow**
>
> ```
> CREATE TABLE fake_source (
> name string,
> age int
> ) with (
> 'connector.type' = 'fakestream',
> 'format.type' = 'json'
> );
>
> CREATE TABLE print_sink (
> name string,
> age int
> ) with (
> 'connector.type' = 'print',
> );
>
> INSERT INTO print_sink
> SELECT * FROM fake_source;
> ```
that's awesome, sql is common language for use.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
