Re: [PR] [pipeline-connector][paimon] add paimon pipeline data sink connector. [flink-cdc]

2024-04-23 Thread via GitHub
PatrickRen merged PR #2916: URL: https://github.com/apache/flink-cdc/pull/2916 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] [pipeline-connector][paimon] add paimon pipeline data sink connector. [flink-cdc]

2024-04-14 Thread via GitHub
lvyanquan commented on PR #2916: URL: https://github.com/apache/flink-cdc/pull/2916#issuecomment-2054304285 Thanks @yuxiqian for those comments, I've addressed it and resubmitted. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [PR] [pipeline-connector][paimon] add paimon pipeline data sink connector. [flink-cdc]

2024-04-14 Thread via GitHub
lvyanquan commented on code in PR #2916: URL: https://github.com/apache/flink-cdc/pull/2916#discussion_r1565075579 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-paimon/src/main/java/org/apache/flink/cdc/connectors/paimon/sink/v2/PaimonCommitter.java:

Re: [PR] [pipeline-connector][paimon] add paimon pipeline data sink connector. [flink-cdc]

2024-04-14 Thread via GitHub
lvyanquan commented on code in PR #2916: URL: https://github.com/apache/flink-cdc/pull/2916#discussion_r1565069967 ##

Re: [PR] [pipeline-connector][paimon] add paimon pipeline data sink connector. [flink-cdc]

2024-04-14 Thread via GitHub
lvyanquan commented on code in PR #2916: URL: https://github.com/apache/flink-cdc/pull/2916#discussion_r1565072387 ## docs/content/pipelines/paimon-pipeline(ZH).md: ## @@ -0,0 +1,209 @@ +# Paimon Pipeline 连接器 + +Paimon Pipeline 连接器可以用作 Pipeline 的 *Data

Re: [PR] [pipeline-connector][paimon] add paimon pipeline data sink connector. [flink-cdc]

2024-04-14 Thread via GitHub
yuxiqian commented on code in PR #2916: URL: https://github.com/apache/flink-cdc/pull/2916#discussion_r1565028345 ## docs/content/pipelines/paimon-pipeline(ZH).md: ## @@ -0,0 +1,209 @@ +# Paimon Pipeline 连接器 + +Paimon Pipeline 连接器可以用作 Pipeline 的 *Data

Re: [PR] [pipeline-connector][paimon] add paimon pipeline data sink connector. [flink-cdc]

2024-04-14 Thread via GitHub
lvyanquan commented on code in PR #2916: URL: https://github.com/apache/flink-cdc/pull/2916#discussion_r1564775105 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-paimon/src/main/java/org/apache/flink/cdc/connectors/paimon/sink/v2/TableSchemaInfo.java:

Re: [PR] [pipeline-connector][paimon] add paimon pipeline data sink connector. [flink-cdc]

2024-04-14 Thread via GitHub
lvyanquan commented on code in PR #2916: URL: https://github.com/apache/flink-cdc/pull/2916#discussion_r1564773416 ##

Re: [PR] [pipeline-connector][paimon] add paimon pipeline data sink connector. [flink-cdc]

2024-04-14 Thread via GitHub
yuxiqian commented on code in PR #2916: URL: https://github.com/apache/flink-cdc/pull/2916#discussion_r1564742486 ## docs/content/pipelines/paimon-pipeline.md: ## @@ -0,0 +1,209 @@ +# Paimon Pipeline Connector + +The Paimon Pipeline connector can be used as the *Data Sink* of

Re: [PR] [pipeline-connector][paimon] add paimon pipeline data sink connector. [flink-cdc]

2024-04-14 Thread via GitHub
lvyanquan commented on code in PR #2916: URL: https://github.com/apache/flink-cdc/pull/2916#discussion_r1564741797 ## docs/content/pipelines/paimon-pipeline.md: ## @@ -0,0 +1,209 @@ +# Paimon Pipeline Connector + +The Paimon Pipeline connector can be used as the *Data Sink* of

Re: [PR] [pipeline-connector][paimon] add paimon pipeline data sink connector. [flink-cdc]

2024-04-14 Thread via GitHub
lvyanquan commented on code in PR #2916: URL: https://github.com/apache/flink-cdc/pull/2916#discussion_r1564741417 ## docs/content/pipelines/paimon-pipeline(ZH).md: ## @@ -0,0 +1,209 @@ +# Paimon Pipeline 连接器 + +Paimon Pipeline 连接器可以用作 Pipeline 的 *Data

Re: [PR] [pipeline-connector][paimon] add paimon pipeline data sink connector. [flink-cdc]

2024-04-10 Thread via GitHub
melin commented on PR #2916: URL: https://github.com/apache/flink-cdc/pull/2916#issuecomment-2046629679 Does kafka header set constant values? For example, if data from multiple data centers is written to the same kafka topic, add a region key to the kafka header. -- This is an

Re: [PR] [pipeline-connector][paimon] add paimon pipeline data sink connector. [flink-cdc]

2024-04-07 Thread via GitHub
yuxiqian commented on code in PR #2916: URL: https://github.com/apache/flink-cdc/pull/2916#discussion_r1549282669 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-paimon/src/main/java/org/apache/flink/cdc/connectors/paimon/sink/PaimonDataSinkFactory.java:

Re: [PR] [pipeline-connector][paimon] add paimon pipeline data sink connector. [flink-cdc]

2024-04-07 Thread via GitHub
yuxiqian commented on code in PR #2916: URL: https://github.com/apache/flink-cdc/pull/2916#discussion_r1554819937 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-paimon/src/main/java/org/apache/flink/cdc/connectors/paimon/sink/v2/PaimonWriterHelper.java:

Re: [PR] [pipeline-connector][paimon] add paimon pipeline data sink connector. [flink-cdc]

2024-04-07 Thread via GitHub
yuxiqian commented on code in PR #2916: URL: https://github.com/apache/flink-cdc/pull/2916#discussion_r1549225693 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-paimon/src/main/java/org/apache/flink/cdc/connectors/paimon/sink/v2/PaimonWriter.java:

Re: [PR] [pipeline-connector][paimon] add paimon pipeline data sink connector. [flink-cdc]

2024-03-31 Thread via GitHub
lvyanquan commented on PR #2916: URL: https://github.com/apache/flink-cdc/pull/2916#issuecomment-2029160857 > paimon latest version is 0.7,we should update paimon version from 0.6 to 0.7 Done and rebased to master. -- This is an automated message from the Apache Git Service. To

Re: [PR] [pipeline-connector][paimon] add paimon pipeline data sink connector. [flink-cdc]

2024-03-28 Thread via GitHub
PatrickRen commented on PR #2916: URL: https://github.com/apache/flink-cdc/pull/2916#issuecomment-2024788681 > paimon latest version is 0.7,we should update paimon version from 0.6 to 0.7 @lvyanquan Could you take a look at this one? I prefer to catch up with the latest version as

Re: [PR] [pipeline-connector][paimon] add paimon pipeline data sink connector. [flink-cdc]

2024-03-27 Thread via GitHub
yanghuaiGit commented on PR #2916: URL: https://github.com/apache/flink-cdc/pull/2916#issuecomment-2024335047 paimon latest version is 0.7,we should update paimon version from 0.6 to 0.7 -- This is an automated message from the Apache Git Service. To respond to the message, please log on