EMsnap commented on code in PR #905: URL: https://github.com/apache/inlong-website/pull/905#discussion_r1430873600
########## docs/quick_start/data_sync/mysql_iceberg_example.md: ########## @@ -0,0 +1,116 @@ +--- +title: MySQL to Iceberg Example +sidebar_position: 3 +--- + +Here we use an example to introduce how to use Apache InLong creating `MySQL -> Iceberg` full database migration. + +## Deployment +### Install InLong + +Before we begin, we need to install InLong. Here we provide two ways: +- [Docker Deployment](deployment/docker.md) (Recommended) +- [Bare Metal Deployment](deployment/bare_metal.md) + +### Add Connectors +Download the [connectors](https://inlong.apache.org/downloads/) corresponding to Flink 1.13, and after decompression, place `sort-connector-iceberg-[version]-SNAPSHOT.jar` in `/inlong-sort/connectors/` directory. + +### Install Iceberg +Please refer to the [Installation Tutorial](https://iceberg.apache.org/hive-quickstart) on the Apache Iceberg official website. + +## Cluster Initialize +When all containers are successfully started, you can access the InLong dashboard address http://localhost, and use the following default account to log in. +``` +User: admin +Password: inlong +``` + +### Create Cluster Tag +Click [Clusters] -> [ClusterTags] -> [Create] on the page to specify the cluster label name and responsible person. + + +:::caution +`default_cluster` is the default ClusterTags reported by each component. If you decide to use a different name, make sure to update the corresponding tag configuration accordingly. +::: + +### Register Pulsar Cluster +Click [Clusters] -> [Cluster] -> [Create] on the page to register Pulsar Cluster. + + +:::note +The ClusterTags selects the newly created `default_cluster`, the Pulsar cluster deployed by docker: + +Service URL is `pulsar://pulsar:6650`, Admin URL is `http://pulsar:8080`. +::: + +### Register Iceberg DataNodes +Click [DataNodes] -> [Create] on the page to register Iceberg DataNodes. + + +## Create Task +### Create Data Streams Group +Click [Synchronization] → [Create] on the page and input the Group ID, Stream ID and Full database migration: + + +### Create Data Source +In the data source, click [New] → [MySQL] to configure the source name, address, databases and tables information. + + +:::note +- If the read mode is `Full amount + Incremental`, the existing data in the source table will also be collected, but the `Incremental` mode will not. +- The table white list format is `<dbName>.<tableName>` and supports regular expressions. +::: + +### Create Data Sink +In the data sink, click [New] → [Iceberg] to configure the sink name and created Iceberg data node. +We can choose the data sink to have the same database table name as the data source, or customize it. Review Comment: please add a description on the customize rule -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
