dockerzhang commented on code in PR #839: URL: https://github.com/apache/inlong-website/pull/839#discussion_r1299662023
########## docs/quick_start/clickHouse_example.md: ########## @@ -0,0 +1,96 @@ +--- +title: ClickHouse Example +sidebar_position: 2 +--- + +Here we use an example to introduce how to use Apache InLong creating MySQL -> Kafka -> ClickHouse data access. Review Comment: MySQL -> Kafka -> ClickHouse data access -> `MySQL -> Kafka -> ClickHouse` data ingestion ########## docs/quick_start/clickHouse_example.md: ########## @@ -0,0 +1,96 @@ +--- +title: ClickHouse Example +sidebar_position: 2 +--- + +Here we use an example to introduce how to use Apache InLong creating MySQL -> Kafka -> ClickHouse data access. + +## Deployment +### Install InLong + +Before we begin, we need to install InLong. Here we provide two ways: +1. Install InLong with Docker by according to the [instructions here](deployment/docker.md).(Recommanded) +2. Install InLong binary according to the [instructions here](deployment/bare_metal.md). + +### Install ClickHouse +```shell +docker run -d --rm --net=host --name clickhouse -e CLICKHOUSE_USER=admin -e CLICKHOUSE_PASSWORD=inlong -e CLICKHOUSE_DEFAULT_ACCESS_MANAGEMENT=1 clickhouse/clickhouse-server:22.8 +``` + +### Install Kafka +```shell +# Prepare zookeeper for Kafka +docker run -d --name zookeeper -p 2181:2181 -t wurstmeister/zookeeper +# Install Kafka +docker run -d --name kafka -p 9092:9092 -e KAFKA_BROKER_ID=0 -e KAFKA_ZOOKEEPER_CONNECT=zookeeper:2181 --link zookeeper -e KAFKA_ADVERTISED_LISTENERS=PLAINTEXT://kafka:9092 -e KAFKA_LISTENERS=PLAINTEXT://0.0.0.0:9092 -t wurstmeister/kafka +``` + +## Cluster Initialize +When all containers are successfully started, you can access the Inlong dashboard address http://localhost, and use the following default account to log in: +``` +User: admin +Password: inlong +``` + +### Create Cluster Tag +Click [Clusters]->[ClusterTags]->[Create] on the page to specify the cluster label name and person in charge: + + +:::caution +Since each component reports the ClusterTags as `default_cluster` by default, do not use other names. +::: + +### Register Kafka Cluster +Click [Clusters]->[Create] on the page to register Kafka Cluster: + + +### Register Clickhouse DataNodes +Click [DataNodes]->[Create] on the page to register ClickHouse DataNodes. + + +## Create Task +### Create Data Streams Group +Click [Ingestion]->[Create], inpit ID and select Kafka MQ Type + + +### Create Data Stream +Click [Next]->[Create], config data stream + + +### Create Data Source +Click [Sources create]->[MySQL], config data source informations. + + +### Create Data Sink +Click [Sinks create]->[ClickHouse], input Name, DbName, TableName and select created ck DataNode and so on, then click [save]. + + + +### Approve Data Stream +Click [Approval]->[MyApproval]->[Detail]->[Select Cluster tag]->[Ok] + + +Back to [Ingestion] page, wait for [configuration success] + + +## Test Data +### Send Data + +Add 1001 datas to MySQL + +### Verify Data +Check data in [Audit] page + + +then enter ClickHouse container, check data in table + + +## Questions +### Task Configuration Failed +Generally, the MQ or Flink group configuration is incorrect. You can view the error information on the page, or enter the Manager container to view detailed logs. + + Review Comment: too many empty lines. ########## docs/quick_start/clickHouse_example.md: ########## @@ -0,0 +1,96 @@ +--- +title: ClickHouse Example +sidebar_position: 2 +--- + +Here we use an example to introduce how to use Apache InLong creating MySQL -> Kafka -> ClickHouse data access. + +## Deployment +### Install InLong + +Before we begin, we need to install InLong. Here we provide two ways: +1. Install InLong with Docker by according to the [instructions here](deployment/docker.md).(Recommanded) +2. Install InLong binary according to the [instructions here](deployment/bare_metal.md). + +### Install ClickHouse +```shell +docker run -d --rm --net=host --name clickhouse -e CLICKHOUSE_USER=admin -e CLICKHOUSE_PASSWORD=inlong -e CLICKHOUSE_DEFAULT_ACCESS_MANAGEMENT=1 clickhouse/clickhouse-server:22.8 +``` + +### Install Kafka +```shell +# Prepare zookeeper for Kafka +docker run -d --name zookeeper -p 2181:2181 -t wurstmeister/zookeeper +# Install Kafka +docker run -d --name kafka -p 9092:9092 -e KAFKA_BROKER_ID=0 -e KAFKA_ZOOKEEPER_CONNECT=zookeeper:2181 --link zookeeper -e KAFKA_ADVERTISED_LISTENERS=PLAINTEXT://kafka:9092 -e KAFKA_LISTENERS=PLAINTEXT://0.0.0.0:9092 -t wurstmeister/kafka +``` + +## Cluster Initialize +When all containers are successfully started, you can access the Inlong dashboard address http://localhost, and use the following default account to log in: +``` +User: admin +Password: inlong +``` + +### Create Cluster Tag +Click [Clusters]->[ClusterTags]->[Create] on the page to specify the cluster label name and person in charge: + + +:::caution +Since each component reports the ClusterTags as `default_cluster` by default, do not use other names. +::: + +### Register Kafka Cluster +Click [Clusters]->[Create] on the page to register Kafka Cluster: + + +### Register Clickhouse DataNodes +Click [DataNodes]->[Create] on the page to register ClickHouse DataNodes. Review Comment: end with ":" ? ########## docs/quick_start/clickHouse_example.md: ########## @@ -0,0 +1,96 @@ +--- +title: ClickHouse Example +sidebar_position: 2 +--- + +Here we use an example to introduce how to use Apache InLong creating MySQL -> Kafka -> ClickHouse data access. + +## Deployment +### Install InLong + +Before we begin, we need to install InLong. Here we provide two ways: +1. Install InLong with Docker by according to the [instructions here](deployment/docker.md).(Recommanded) +2. Install InLong binary according to the [instructions here](deployment/bare_metal.md). + +### Install ClickHouse +```shell +docker run -d --rm --net=host --name clickhouse -e CLICKHOUSE_USER=admin -e CLICKHOUSE_PASSWORD=inlong -e CLICKHOUSE_DEFAULT_ACCESS_MANAGEMENT=1 clickhouse/clickhouse-server:22.8 +``` + +### Install Kafka +```shell +# Prepare zookeeper for Kafka +docker run -d --name zookeeper -p 2181:2181 -t wurstmeister/zookeeper +# Install Kafka +docker run -d --name kafka -p 9092:9092 -e KAFKA_BROKER_ID=0 -e KAFKA_ZOOKEEPER_CONNECT=zookeeper:2181 --link zookeeper -e KAFKA_ADVERTISED_LISTENERS=PLAINTEXT://kafka:9092 -e KAFKA_LISTENERS=PLAINTEXT://0.0.0.0:9092 -t wurstmeister/kafka +``` + +## Cluster Initialize +When all containers are successfully started, you can access the Inlong dashboard address http://localhost, and use the following default account to log in: +``` +User: admin +Password: inlong +``` + +### Create Cluster Tag +Click [Clusters]->[ClusterTags]->[Create] on the page to specify the cluster label name and person in charge: + + +:::caution +Since each component reports the ClusterTags as `default_cluster` by default, do not use other names. +::: + +### Register Kafka Cluster +Click [Clusters]->[Create] on the page to register Kafka Cluster: + + +### Register Clickhouse DataNodes +Click [DataNodes]->[Create] on the page to register ClickHouse DataNodes. + + +## Create Task +### Create Data Streams Group +Click [Ingestion]->[Create], inpit ID and select Kafka MQ Type Review Comment: ditto -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
