dockerzhang commented on code in PR #8055: URL: https://github.com/apache/inlong/pull/8055#discussion_r1198606543
########## inlong-sort/README.md: ########## @@ -1,55 +1,44 @@ # Description -# Overview - -InLong-Sort is used to extract data from different source systems, then transforms the data and finally loads the data -into diffrent storage systems. -InLong-Sort is simply a Flink Application, and relys on InLong-Manager to manage meta data(such as the source -informations and storage informations). - -# Features - -## Supported Extract Node - -- Pulsar -- MySQL -- Kafka -- MongoDB -- PostgreSQL -- HDFS - -## Supported Transform - -- String Split -- String Regular Replace -- String Regular Replace First Matched Value -- Data Filter -- Data Distinct -- Regular Join - -## Supported Load Node - -- Hive -- Kafka -- HBase -- ClickHouse -- Iceberg -- Hudi -- PostgreSQL -- HDFS -- TDSQL Postgres -- Redis - -## Future Plans - -### More kinds of Extract Node - -Oracle, SqlServer, and etc. - -### More kinds of Transform - -Time window aggregation, Content extraction, Type conversion, Time format conversion, and etc. - -### More kinds of Load Node - -Elasticsearch, and etc. \ No newline at end of file +## Overview +InLong Sort is used to extract data from different source systems, then transforms the data and finally loads the data into different storage systems. + +InLong Sort can be used together with the Manager to manage metadata, or it can run independently in the Flink environment. + +## Features +### Supports a variety of data nodes + +| Type | Service | +|--------------|--------------------------------------------| +| Extract Node | Pulsar | +| | MySQL | +| | Kafka | +| | MongoDB | +| | PostgreSQL | +| Transform | String Split | +| | String Regular Replace | +| | String Regular Replace First Matched Value | +| | Data Filter | +| | Data Distinct | +| | Regular Join | +| Load Node | Hive | +| | Kafka | +| | HBase | +| | ClickHouse | +| | Iceberg | +| | PostgreSQL | +| | HDFS | +| | TDSQL Postgres | +| | Hudi | + +## Build + Review Comment: ```suggestion ``` ########## inlong-sort/README.md: ########## @@ -1,55 +1,44 @@ # Description -# Overview - -InLong-Sort is used to extract data from different source systems, then transforms the data and finally loads the data -into diffrent storage systems. -InLong-Sort is simply a Flink Application, and relys on InLong-Manager to manage meta data(such as the source -informations and storage informations). - -# Features - -## Supported Extract Node - -- Pulsar -- MySQL -- Kafka -- MongoDB -- PostgreSQL -- HDFS - -## Supported Transform - -- String Split -- String Regular Replace -- String Regular Replace First Matched Value -- Data Filter -- Data Distinct -- Regular Join - -## Supported Load Node - -- Hive -- Kafka -- HBase -- ClickHouse -- Iceberg -- Hudi -- PostgreSQL -- HDFS -- TDSQL Postgres -- Redis - -## Future Plans - -### More kinds of Extract Node - -Oracle, SqlServer, and etc. - -### More kinds of Transform - -Time window aggregation, Content extraction, Type conversion, Time format conversion, and etc. - -### More kinds of Load Node - -Elasticsearch, and etc. \ No newline at end of file +## Overview +InLong Sort is used to extract data from different source systems, then transforms the data and finally loads the data into different storage systems. + +InLong Sort can be used together with the Manager to manage metadata, or it can run independently in the Flink environment. + +## Features +### Supports a variety of data nodes + +| Type | Service | +|--------------|--------------------------------------------| +| Extract Node | Pulsar | +| | MySQL | +| | Kafka | +| | MongoDB | +| | PostgreSQL | +| Transform | String Split | +| | String Regular Replace | +| | String Regular Replace First Matched Value | +| | Data Filter | +| | Data Distinct | +| | Regular Join | +| Load Node | Hive | +| | Kafka | +| | HBase | +| | ClickHouse | +| | Iceberg | +| | PostgreSQL | +| | HDFS | +| | TDSQL Postgres | +| | Hudi | + +## Build + +### For Apache Flink 1.13 (default) +````shell + mvn clean install -DskipTests +```` Review Comment: ```suggestion ```` ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
