[jira] [Created] (FLINK-35684) Add missing option for DataSource and DataSink
LvYanquan created FLINK-35684: - Summary: Add missing option for DataSource and DataSink Key: FLINK-35684 URL: https://issues.apache.org/jira/browse/FLINK-35684 Project: Flink Issue Type: Improvement Components: Flink CDC Affects Versions: cdc-3.2.0 Reporter: LvYanquan Fix For: cdc-3.2.0 As https://issues.apache.org/jira/browse/FLINK-35121 add verification for requireOptions and optionalOptions, we found that some DataSource and DataSink miss these options. We need to add those options to pass this verification. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-35627) Avoid conflict when pipeline job that used Paimon as sink restart.
LvYanquan created FLINK-35627: - Summary: Avoid conflict when pipeline job that used Paimon as sink restart. Key: FLINK-35627 URL: https://issues.apache.org/jira/browse/FLINK-35627 Project: Flink Issue Type: Improvement Components: Flink CDC Affects Versions: cdc-3.1.0 Reporter: LvYanquan Fix For: cdc-3.2.0 When use Paimon as pipeline sink, if one job failed and restarted, the following job will continue fail over because there are some conflict files being uncommitted. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-35589) Support MemorySize type in FlinkCDC ConfigOptions
LvYanquan created FLINK-35589: - Summary: Support MemorySize type in FlinkCDC ConfigOptions Key: FLINK-35589 URL: https://issues.apache.org/jira/browse/FLINK-35589 Project: Flink Issue Type: Improvement Components: Flink CDC Affects Versions: cdc-3.2.0 Reporter: LvYanquan Fix For: cdc-3.2.0 This allow user to set MemorySize config type like Flink. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (FLINK-35237) Allow Sink to Choose HashFunction in PrePartitionOperator
[
https://issues.apache.org/jira/browse/FLINK-35237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854655#comment-17854655
]
LvYanquan commented on FLINK-35237:
---
I've met the same demand in Paimon Sink, and I agree that this is a reasonable
requirement, and this change is acceptable to me.
> Allow Sink to Choose HashFunction in PrePartitionOperator
> -
>
> Key: FLINK-35237
> URL: https://issues.apache.org/jira/browse/FLINK-35237
> Project: Flink
> Issue Type: Improvement
> Components: Flink CDC
>Reporter: zhangdingxin
>Priority: Major
> Fix For: cdc-3.2.0
>
>
> The {{PrePartitionOperator}} in its current implementation only supports a
> fixed {{HashFunction}}
> ({{{}org.apache.flink.cdc.runtime.partitioning.PrePartitionOperator.HashFunction{}}}).
> This limits the ability of Sink implementations to customize the
> partitioning logic for {{{}DataChangeEvent{}}}s. For example, in the case of
> partitioned tables, it would be advantageous to allow hashing based on
> partition keys, hashing according to table names, or using the database
> engine's internal primary key hash functions (such as with MaxCompute
> DataSink).
> When users require such custom partitioning logic, they are compelled to
> implement their PartitionOperator, which undermines the utility of
> {{{}PrePartitionOperator{}}}.
> To address this limitation, it would be highly desirable to enable the
> {{PrePartitionOperator}} to support user-specified custom
> {{{}HashFunction{}}}s (Function). A possible
> solution could involve a mechanism analogous to the {{DataSink}} interface,
> allowing the specification of a {{HashFunctionProvider}} class path in the
> configuration file. This enhancement would greatly facilitate users in
> tailoring partition strategies to meet their specific application needs.
> In this case, I want to create new class {{HashFunctionProvider}} and
> {{{}HashFunction{}}}:
> {code:java}
> public interface HashFunctionProvider {
> HashFunction getHashFunction(Schema schema);
> }
> public interface HashFunction extends Function {
> Integer apply(DataChangeEvent event);
> } {code}
> add {{getHashFunctionProvider}} method to {{DataSink}}
>
> {code:java}
> public interface DataSink {
> /** Get the {@link EventSinkProvider} for writing changed data to
> external systems. */
> EventSinkProvider getEventSinkProvider();
> /** Get the {@link MetadataApplier} for applying metadata changes to
> external systems. */
> MetadataApplier getMetadataApplier();
> default HashFunctionProvider getHashFunctionProvider() {
> return new DefaultHashFunctionProvider();
> }
> } {code}
> and re-implement {{PrePartitionOperator}} {{recreateHashFunction}} method.
> {code:java}
> private HashFunction recreateHashFunction(TableId tableId) {
> return
> hashFunctionProvider.getHashFunction(loadLatestSchemaFromRegistry(tableId));
> } {code}
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Created] (FLINK-35586) Detected conflict when using Paimon as pipeline sink with parallelism > 1
LvYanquan created FLINK-35586:
-
Summary: Detected conflict when using Paimon as pipeline sink with
parallelism > 1
Key: FLINK-35586
URL: https://issues.apache.org/jira/browse/FLINK-35586
Project: Flink
Issue Type: Improvement
Components: Flink CDC
Affects Versions: cdc-3.1.0
Reporter: LvYanquan
Fix For: cdc-3.2.0
When submit FlinkCDC pipeline job using yaml like:
{code:java}
source:
type: mysql
name: MySQL Source
hostname: 127.0.0.1
port: 3306
username: root
password: 123456
tables: inventory.t1
sink:
type: paimon
name: Paimon Sink
catalog.properties.metastore: filesystem
catalog.properties.warehouse: /mypath
pipeline:
name: MySQL to Paimon Pipeline
parallelism: 2 {code}
I met the following error message:
{code:java}
Caused by: java.lang.RuntimeException: LSM conflicts detected! Give up
committing. Conflict files are:, bucket 0, level 5, file
data-6bcac56a-2df2-4c85-97f2-2db91f6d8099-0.orc, bucket 0, level 5, file
data-351fd27d-4a65-4354-9ce9-c153ba715569-0.orc {code}
And this will cause the task to constantly restart.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Updated] (FLINK-35430) ZoneId is not passed to DebeziumJsonSerializationSchema
[ https://issues.apache.org/jira/browse/FLINK-35430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LvYanquan updated FLINK-35430: -- Fix Version/s: cdc-3.1.1 (was: cdc-3.2.0) > ZoneId is not passed to DebeziumJsonSerializationSchema > --- > > Key: FLINK-35430 > URL: https://issues.apache.org/jira/browse/FLINK-35430 > Project: Flink > Issue Type: Improvement > Components: Flink CDC >Affects Versions: cdc-3.1.1 >Reporter: LvYanquan >Priority: Not a Priority > Labels: pull-request-available > Fix For: cdc-3.1.1 > > > ZoneId is used to convert TIMESTAMP_WITH_LOCAL_TIME_ZONE type to specific > time zone, but DebeziumJsonSerializationSchema does not used the user-defined > zoneid. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (FLINK-35430) ZoneId is not passed to DebeziumJsonSerializationSchema
[ https://issues.apache.org/jira/browse/FLINK-35430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LvYanquan updated FLINK-35430: -- Affects Version/s: cdc-3.1.1 (was: cdc-3.2.0) > ZoneId is not passed to DebeziumJsonSerializationSchema > --- > > Key: FLINK-35430 > URL: https://issues.apache.org/jira/browse/FLINK-35430 > Project: Flink > Issue Type: Improvement > Components: Flink CDC >Affects Versions: cdc-3.1.1 >Reporter: LvYanquan >Priority: Not a Priority > Labels: pull-request-available > Fix For: cdc-3.2.0 > > > ZoneId is used to convert TIMESTAMP_WITH_LOCAL_TIME_ZONE type to specific > time zone, but DebeziumJsonSerializationSchema does not used the user-defined > zoneid. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (FLINK-35325) Paimon connector miss the position of AddColumnEvent
[ https://issues.apache.org/jira/browse/FLINK-35325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LvYanquan updated FLINK-35325: -- Affects Version/s: cdc-3.1.1 (was: cdc-3.2.0) > Paimon connector miss the position of AddColumnEvent > > > Key: FLINK-35325 > URL: https://issues.apache.org/jira/browse/FLINK-35325 > Project: Flink > Issue Type: Improvement > Components: Flink CDC >Affects Versions: cdc-3.1.1 >Reporter: LvYanquan >Priority: Minor > Labels: pull-request-available > Fix For: cdc-3.1.1 > > > Currently, new columns are always added in the last position, however some > newly add columns had a specific before and after relationship with other > column. > Source code: > [https://github.com/apache/flink-cdc/blob/fa6e7ea51258dcd90f06036196618224156df367/flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-paimon/src/main/java/org/apache/flink/cdc/connectors/paimon/sink/PaimonMetadataApplier.java#L137] -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (FLINK-35325) Paimon connector miss the position of AddColumnEvent
[ https://issues.apache.org/jira/browse/FLINK-35325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LvYanquan updated FLINK-35325: -- Fix Version/s: cdc-3.1.1 (was: cdc-3.2.0) > Paimon connector miss the position of AddColumnEvent > > > Key: FLINK-35325 > URL: https://issues.apache.org/jira/browse/FLINK-35325 > Project: Flink > Issue Type: Improvement > Components: Flink CDC >Affects Versions: cdc-3.2.0 >Reporter: LvYanquan >Priority: Minor > Labels: pull-request-available > Fix For: cdc-3.1.1 > > > Currently, new columns are always added in the last position, however some > newly add columns had a specific before and after relationship with other > column. > Source code: > [https://github.com/apache/flink-cdc/blob/fa6e7ea51258dcd90f06036196618224156df367/flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-paimon/src/main/java/org/apache/flink/cdc/connectors/paimon/sink/PaimonMetadataApplier.java#L137] -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-35444) Paimon Pipeline Connector support changing column names to lowercase for Hive metastore
LvYanquan created FLINK-35444: - Summary: Paimon Pipeline Connector support changing column names to lowercase for Hive metastore Key: FLINK-35444 URL: https://issues.apache.org/jira/browse/FLINK-35444 Project: Flink Issue Type: Improvement Components: Flink CDC Affects Versions: cdc-3.2.0 Reporter: LvYanquan Fix For: cdc-3.2.0 Hive metastore Require column names to be lowercase, but field names from upstream tables may not meet the requirements. We can add a parameter configuration in sink to convert all column names to lowercase. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-35442) Kafka Pipeline Sink may distribute the same key to different partitions after modify parallelism
LvYanquan created FLINK-35442: - Summary: Kafka Pipeline Sink may distribute the same key to different partitions after modify parallelism Key: FLINK-35442 URL: https://issues.apache.org/jira/browse/FLINK-35442 Project: Flink Issue Type: Improvement Components: Flink CDC Affects Versions: cdc-3.2.0 Reporter: LvYanquan Fix For: cdc-3.2.0 Currently, Kafka Pipeline Sink partition events by parallelInstanceId % partitions.length，this is because the previous partition operator has already shuffled events by key. However, If the parallelism of the task is modified and restarted, data with the same key before and after the task may be in different partitions. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-35430) ZoneId is not passed to DebeziumJsonSerializationSchema
LvYanquan created FLINK-35430: - Summary: ZoneId is not passed to DebeziumJsonSerializationSchema Key: FLINK-35430 URL: https://issues.apache.org/jira/browse/FLINK-35430 Project: Flink Issue Type: Improvement Components: Flink CDC Affects Versions: cdc-3.2.0 Reporter: LvYanquan Fix For: cdc-3.2.0 ZoneId is used to convert TIMESTAMP_WITH_LOCAL_TIME_ZONE type to specific time zone, but DebeziumJsonSerializationSchema does not used the user-defined zoneid. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (FLINK-35421) Schema Operator blocking forever when Akka Rpc timeout
[ https://issues.apache.org/jira/browse/FLINK-35421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17848788#comment-17848788 ] LvYanquan commented on FLINK-35421: --- Thanks for pointing out this issue. I am willing to fix it. > Schema Operator blocking forever when Akka Rpc timeout > -- > > Key: FLINK-35421 > URL: https://issues.apache.org/jira/browse/FLINK-35421 > Project: Flink > Issue Type: Bug > Components: Flink CDC >Reporter: hk__lrzy >Priority: Major > > When SchemaOperator restart and there have no checkpoint before, > SchemaOperator will not send `RefreshPendingListsRequest` to coordinator, and > if coordinator have pending schema events and SchemaOperator will block > forever. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (FLINK-35391) Bump dependency of Paimon Pipeline connector to 0.8.0
[ https://issues.apache.org/jira/browse/FLINK-35391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17847748#comment-17847748 ] LvYanquan commented on FLINK-35391: --- Thanks for taking this, please go ahead, I am willing to help review. > Bump dependency of Paimon Pipeline connector to 0.8.0 > - > > Key: FLINK-35391 > URL: https://issues.apache.org/jira/browse/FLINK-35391 > Project: Flink > Issue Type: Improvement > Components: Flink CDC >Affects Versions: cdc-3.2.0 >Reporter: LvYanquan >Priority: Major > Fix For: cdc-3.2.0 > > > Apache Paimon has [released > 0.8|https://paimon.apache.org/releases/release-0.8/] recently, We can update > dependencies to use new features. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (FLINK-35391) Bump dependency of Paimon Pipeline connector to 0.8.0
[ https://issues.apache.org/jira/browse/FLINK-35391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LvYanquan updated FLINK-35391: -- Description: Apache Paimon has [released 0.8|https://paimon.apache.org/releases/release-0.8/] recently, We can update dependencies to use new features. (was: Apache Paimon has released 0.8 recently, We can update dependencies to use new features. ) > Bump dependency of Paimon Pipeline connector to 0.8.0 > - > > Key: FLINK-35391 > URL: https://issues.apache.org/jira/browse/FLINK-35391 > Project: Flink > Issue Type: Improvement > Components: Flink CDC >Affects Versions: cdc-3.2.0 >Reporter: LvYanquan >Priority: Major > Fix For: cdc-3.2.0 > > > Apache Paimon has [released > 0.8|https://paimon.apache.org/releases/release-0.8/] recently, We can update > dependencies to use new features. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-35391) Bump dependency of Paimon Pipeline connector to 0.8.0
LvYanquan created FLINK-35391: - Summary: Bump dependency of Paimon Pipeline connector to 0.8.0 Key: FLINK-35391 URL: https://issues.apache.org/jira/browse/FLINK-35391 Project: Flink Issue Type: Improvement Components: Flink CDC Affects Versions: cdc-3.2.0 Reporter: LvYanquan Fix For: cdc-3.2.0 Apache Paimon has released 0.8 recently, We can update dependencies to use new features. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (FLINK-34614) Add e2e test for Flink CDC pipeline job.
[ https://issues.apache.org/jira/browse/FLINK-34614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17847138#comment-17847138 ] LvYanquan commented on FLINK-34614: --- done in pull-request https://github.com/apache/flink-cdc/pull/2997. > Add e2e test for Flink CDC pipeline job. > > > Key: FLINK-34614 > URL: https://issues.apache.org/jira/browse/FLINK-34614 > Project: Flink > Issue Type: Improvement > Components: Flink CDC >Affects Versions: cdc-3.1.0 >Reporter: LvYanquan >Priority: Major > Fix For: cdc-3.1.0 > > > Add e2e test for Flink CDC pipeline job. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-35325) Paimon connector miss the position of AddColumnEvent
LvYanquan created FLINK-35325: - Summary: Paimon connector miss the position of AddColumnEvent Key: FLINK-35325 URL: https://issues.apache.org/jira/browse/FLINK-35325 Project: Flink Issue Type: Improvement Components: Flink CDC Affects Versions: cdc-3.2.0 Reporter: LvYanquan Fix For: cdc-3.2.0 Currently, new columns are always added in the last position, however some newly add columns had a specific before and after relationship with other column. Source code: [https://github.com/apache/flink-cdc/blob/fa6e7ea51258dcd90f06036196618224156df367/flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-paimon/src/main/java/org/apache/flink/cdc/connectors/paimon/sink/PaimonMetadataApplier.java#L137] -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (FLINK-35303) Support logical deletion of data
[ https://issues.apache.org/jira/browse/FLINK-35303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844224#comment-17844224 ] LvYanquan commented on FLINK-35303: --- Currently, we can add a metadata column from row_kind [https://nightlies.apache.org/flink/flink-cdc-docs-release-3.0/docs/connectors/legacy-flink-cdc-sources/mysql-cdc/#available-metadata] to represent that. However, for a delete event, we will still delete this record in the downstream, we need to change the RowKind of those events to Insert to achieve the demand. > Support logical deletion of data > - > > Key: FLINK-35303 > URL: https://issues.apache.org/jira/browse/FLINK-35303 > Project: Flink > Issue Type: New Feature > Components: Flink CDC >Reporter: melin >Priority: Major > > delete event is logical deletion. Add a field to the table. For example: > is_delete, the default is false, if it is a delete event, is_delete is set to > true。 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-35235) Fix missing dependencies in the uber jar
LvYanquan created FLINK-35235: - Summary: Fix missing dependencies in the uber jar Key: FLINK-35235 URL: https://issues.apache.org/jira/browse/FLINK-35235 Project: Flink Issue Type: Improvement Components: Flink CDC Affects Versions: 3.1.0 Reporter: LvYanquan Fix For: 3.1.0 Attachments: image-2024-04-25-15-17-20-987.png, image-2024-04-25-15-17-34-717.png Some class of Kafka were not included in fat jar. !image-2024-04-25-15-17-34-717.png! -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-35213) A potential inconsistent table structure issue
LvYanquan created FLINK-35213: - Summary: A potential inconsistent table structure issue Key: FLINK-35213 URL: https://issues.apache.org/jira/browse/FLINK-35213 Project: Flink Issue Type: Improvement Components: Flink CDC Affects Versions: 3.1.0 Reporter: LvYanquan Currently, DataSinkWriterOperator will [request CreateTableEvent|https://github.com/apache/flink-cdc/blob/313726b09690e82aa56fb5b42e89b535d24dadd7/flink-cdc-runtime/src/main/java/org/apache/flink/cdc/runtime/operators/sink/DataSinkWriterOperator.java#L149] from SchemaRegistry when restarted. However, If a SchemeChangeEvent is received during this process, SchemaOperator will 1. [request SchemaRegistry|https://github.com/apache/flink-cdc/blob/313726b09690e82aa56fb5b42e89b535d24dadd7/flink-cdc-runtime/src/main/java/org/apache/flink/cdc/runtime/operators/schema/SchemaOperator.java#L252] to update the schema, 2. and then send FlushEvent. As the network situation is quite complex, SchemaRegistry may update the schema first, and then send a CreateTableEvent with the new schema, which is incompatible with DatachangeEvent. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (FLINK-34752) "legacy-flink-cdc-sources" Page of TIDB for Flink CDC Chinese Documentation.
[ https://issues.apache.org/jira/browse/FLINK-34752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17837975#comment-17837975 ] LvYanquan commented on FLINK-34752: --- [~siriusfan] Thanks for taking this, I don't have the authority to assign, but you can go ahead and submit a PR. > "legacy-flink-cdc-sources" Page of TIDB for Flink CDC Chinese Documentation. > > > Key: FLINK-34752 > URL: https://issues.apache.org/jira/browse/FLINK-34752 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation, Flink CDC >Affects Versions: cdc-3.1.0 >Reporter: LvYanquan >Priority: Minor > Fix For: cdc-3.1.0 > > > Translate legacy-flink-cdc-sources pages of > https://github.com/apache/flink-cdc/blob/master/docs/content/docs/connectors/legacy-flink-cdc-sources/tidb-cdc.md > into Chinese. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-34770) Unify download links of legacy connector to fat jar
LvYanquan created FLINK-34770: - Summary: Unify download links of legacy connector to fat jar Key: FLINK-34770 URL: https://issues.apache.org/jira/browse/FLINK-34770 Project: Flink Issue Type: Sub-task Components: chinese-translation, Documentation, Flink CDC Affects Versions: cdc-3.1.0 Reporter: LvYanquan Fix For: cdc-3.1.0 Some links will lead to download fat jar, but some links will lead to download thin jar, and some are invalid. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (FLINK-34740) "legacy-flink-cdc-sources" Pages for Flink CDC Chinese Documentation existed in 2.x version.
[ https://issues.apache.org/jira/browse/FLINK-34740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828660#comment-17828660 ] LvYanquan commented on FLINK-34740: --- Sorry for [~loserwang1024], I didn't notice that you had comment on this and have already completed a code. I've raised a pr to solve it and You can claim other unfinished subtasks. > "legacy-flink-cdc-sources" Pages for Flink CDC Chinese Documentation existed > in 2.x version. > > > Key: FLINK-34740 > URL: https://issues.apache.org/jira/browse/FLINK-34740 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation, Flink CDC >Affects Versions: cdc-3.1.0 >Reporter: LvYanquan >Priority: Minor > Labels: pull-request-available > Fix For: cdc-3.1.0 > > > Translate legacy-flink-cdc-sources pages of > [https://github.com/apache/flink-cdc/tree/master/docs/content/docs/connectors/legacy-flink-cdc-sources] > into Chinese. > This includes legacy MySQL\MongoDB\Oceanbase source. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (FLINK-34748) "legacy-flink-cdc-sources" Page of Oracle for Flink CDC Chinese Documentation.
[ https://issues.apache.org/jira/browse/FLINK-34748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LvYanquan updated FLINK-34748: -- Description: Translate legacy-flink-cdc-sources pages of https://github.com/apache/flink-cdc/blob/master/docs/content/docs/connectors/legacy-flink-cdc-sources/oracle-cdc.md into Chinese. (was: Translate legacy-flink-cdc-sources pages of [https://github.com/apache/flink-cdc/blob/master/docs/content/docs/connectors/legacy-flink-cdc-sources/oracle-cdc.md |https://github.com/apache/flink-cdc/blob/master/docs/content/docs/connectors/legacy-flink-cdc-sources/db2-cdc.md]into Chinese.) > "legacy-flink-cdc-sources" Page of Oracle for Flink CDC Chinese Documentation. > -- > > Key: FLINK-34748 > URL: https://issues.apache.org/jira/browse/FLINK-34748 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation, Flink CDC >Affects Versions: cdc-3.1.0 >Reporter: LvYanquan >Priority: Minor > Fix For: cdc-3.1.0 > > > Translate legacy-flink-cdc-sources pages of > https://github.com/apache/flink-cdc/blob/master/docs/content/docs/connectors/legacy-flink-cdc-sources/oracle-cdc.md > into Chinese. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (FLINK-34750) "legacy-flink-cdc-sources" Page of Postgresql for Flink CDC Chinese Documentation.
[ https://issues.apache.org/jira/browse/FLINK-34750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LvYanquan updated FLINK-34750: -- Description: Translate legacy-flink-cdc-sources pages of https://github.com/apache/flink-cdc/blob/master/docs/content/docs/connectors/legacy-flink-cdc-sources/postgres-cdc.md into Chinese. (was: Translate legacy-flink-cdc-sources pages of https://github.com/apache/flink-cdc/blob/master/docs/content/docs/connectors/legacy-flink-cdc-sources/postgres-cdc.md[ |https://github.com/apache/flink-cdc/blob/master/docs/content/docs/connectors/legacy-flink-cdc-sources/db2-cdc.md]into Chinese.) > "legacy-flink-cdc-sources" Page of Postgresql for Flink CDC Chinese > Documentation. > -- > > Key: FLINK-34750 > URL: https://issues.apache.org/jira/browse/FLINK-34750 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation, Flink CDC >Affects Versions: cdc-3.1.0 >Reporter: LvYanquan >Priority: Minor > Fix For: cdc-3.1.0 > > > Translate legacy-flink-cdc-sources pages of > https://github.com/apache/flink-cdc/blob/master/docs/content/docs/connectors/legacy-flink-cdc-sources/postgres-cdc.md > into Chinese. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (FLINK-34750) "legacy-flink-cdc-sources" Page of Postgresql for Flink CDC Chinese Documentation.
[ https://issues.apache.org/jira/browse/FLINK-34750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LvYanquan updated FLINK-34750: -- Description: Translate legacy-flink-cdc-sources pages of https://github.com/apache/flink-cdc/blob/master/docs/content/docs/connectors/legacy-flink-cdc-sources/postgres-cdc.md[ |https://github.com/apache/flink-cdc/blob/master/docs/content/docs/connectors/legacy-flink-cdc-sources/db2-cdc.md]into Chinese. (was: Translate legacy-flink-cdc-sources pages of [https://github.com/apache/flink-cdc/blob/master/docs/content/docs/connectors/legacy-flink-cdc-sources/postgres-cdc.md |https://github.com/apache/flink-cdc/blob/master/docs/content/docs/connectors/legacy-flink-cdc-sources/db2-cdc.md]into Chinese.) > "legacy-flink-cdc-sources" Page of Postgresql for Flink CDC Chinese > Documentation. > -- > > Key: FLINK-34750 > URL: https://issues.apache.org/jira/browse/FLINK-34750 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation, Flink CDC >Affects Versions: cdc-3.1.0 >Reporter: LvYanquan >Priority: Minor > Fix For: cdc-3.1.0 > > > Translate legacy-flink-cdc-sources pages of > https://github.com/apache/flink-cdc/blob/master/docs/content/docs/connectors/legacy-flink-cdc-sources/postgres-cdc.md[ > > |https://github.com/apache/flink-cdc/blob/master/docs/content/docs/connectors/legacy-flink-cdc-sources/db2-cdc.md]into > Chinese. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (FLINK-34752) "legacy-flink-cdc-sources" Page of TIDB for Flink CDC Chinese Documentation.
[ https://issues.apache.org/jira/browse/FLINK-34752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LvYanquan updated FLINK-34752: -- Description: Translate legacy-flink-cdc-sources pages of https://github.com/apache/flink-cdc/blob/master/docs/content/docs/connectors/legacy-flink-cdc-sources/tidb-cdc.md into Chinese. (was: Translate legacy-flink-cdc-sources pages of [https://github.com/apache/flink-cdc/blob/master/docs/content/docs/connectors/legacy-flink-cdc-sources/tidb-cdc.md |https://github.com/apache/flink-cdc/blob/master/docs/content/docs/connectors/legacy-flink-cdc-sources/db2-cdc.md]into Chinese.) > "legacy-flink-cdc-sources" Page of TIDB for Flink CDC Chinese Documentation. > > > Key: FLINK-34752 > URL: https://issues.apache.org/jira/browse/FLINK-34752 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation, Flink CDC >Affects Versions: 3.1.0 >Reporter: LvYanquan >Priority: Minor > Fix For: 3.1.0 > > > Translate legacy-flink-cdc-sources pages of > https://github.com/apache/flink-cdc/blob/master/docs/content/docs/connectors/legacy-flink-cdc-sources/tidb-cdc.md > into Chinese. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-34752) "legacy-flink-cdc-sources" Page of TIDB for Flink CDC Chinese Documentation.
LvYanquan created FLINK-34752: - Summary: "legacy-flink-cdc-sources" Page of TIDB for Flink CDC Chinese Documentation. Key: FLINK-34752 URL: https://issues.apache.org/jira/browse/FLINK-34752 Project: Flink Issue Type: Sub-task Components: chinese-translation, Documentation, Flink CDC Affects Versions: 3.1.0 Reporter: LvYanquan Fix For: 3.1.0 Translate legacy-flink-cdc-sources pages of [https://github.com/apache/flink-cdc/blob/master/docs/content/docs/connectors/legacy-flink-cdc-sources/tidb-cdc.md |https://github.com/apache/flink-cdc/blob/master/docs/content/docs/connectors/legacy-flink-cdc-sources/db2-cdc.md]into Chinese. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (FLINK-34750) "legacy-flink-cdc-sources" Page of Postgresql for Flink CDC Chinese Documentation.
[ https://issues.apache.org/jira/browse/FLINK-34750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LvYanquan updated FLINK-34750: -- Summary: "legacy-flink-cdc-sources" Page of Postgresql for Flink CDC Chinese Documentation. (was: "legacy-flink-cdc-sources" Page of DB2 for Flink CDC Chinese Documentation.) > "legacy-flink-cdc-sources" Page of Postgresql for Flink CDC Chinese > Documentation. > -- > > Key: FLINK-34750 > URL: https://issues.apache.org/jira/browse/FLINK-34750 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation, Flink CDC >Affects Versions: cdc-3.1.0 >Reporter: LvYanquan >Priority: Minor > Fix For: cdc-3.1.0 > > > Translate legacy-flink-cdc-sources pages of > [https://github.com/apache/flink-cdc/blob/master/docs/content/docs/connectors/legacy-flink-cdc-sources/postgres-cdc.md > > |https://github.com/apache/flink-cdc/blob/master/docs/content/docs/connectors/legacy-flink-cdc-sources/db2-cdc.md]into > Chinese. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-34750) "legacy-flink-cdc-sources" Page of DB2 for Flink CDC Chinese Documentation.
LvYanquan created FLINK-34750: - Summary: "legacy-flink-cdc-sources" Page of DB2 for Flink CDC Chinese Documentation. Key: FLINK-34750 URL: https://issues.apache.org/jira/browse/FLINK-34750 Project: Flink Issue Type: Sub-task Components: chinese-translation, Documentation, Flink CDC Affects Versions: cdc-3.1.0 Reporter: LvYanquan Fix For: cdc-3.1.0 Translate legacy-flink-cdc-sources pages of [https://github.com/apache/flink-cdc/blob/master/docs/content/docs/connectors/legacy-flink-cdc-sources/postgres-cdc.md |https://github.com/apache/flink-cdc/blob/master/docs/content/docs/connectors/legacy-flink-cdc-sources/db2-cdc.md]into Chinese. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-34749) "legacy-flink-cdc-sources" Page of SQLServer for Flink CDC Chinese Documentation.
LvYanquan created FLINK-34749: - Summary: "legacy-flink-cdc-sources" Page of SQLServer for Flink CDC Chinese Documentation. Key: FLINK-34749 URL: https://issues.apache.org/jira/browse/FLINK-34749 Project: Flink Issue Type: Sub-task Components: chinese-translation, Documentation, Flink CDC Affects Versions: cdc-3.1.0 Reporter: LvYanquan Fix For: cdc-3.1.0 Translate legacy-flink-cdc-sources pages of [https://github.com/apache/flink-cdc/blob/master/docs/content/docs/connectors/legacy-flink-cdc-sources/sqlserver-cdc.md |https://github.com/apache/flink-cdc/blob/master/docs/content/docs/connectors/legacy-flink-cdc-sources/db2-cdc.md]into Chinese. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-34748) "legacy-flink-cdc-sources" Page of Oracle for Flink CDC Chinese Documentation.
LvYanquan created FLINK-34748: - Summary: "legacy-flink-cdc-sources" Page of Oracle for Flink CDC Chinese Documentation. Key: FLINK-34748 URL: https://issues.apache.org/jira/browse/FLINK-34748 Project: Flink Issue Type: Sub-task Components: chinese-translation, Documentation, Flink CDC Affects Versions: cdc-3.1.0 Reporter: LvYanquan Fix For: cdc-3.1.0 Translate legacy-flink-cdc-sources pages of [https://github.com/apache/flink-cdc/blob/master/docs/content/docs/connectors/legacy-flink-cdc-sources/oracle-cdc.md |https://github.com/apache/flink-cdc/blob/master/docs/content/docs/connectors/legacy-flink-cdc-sources/db2-cdc.md]into Chinese. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-34747) "legacy-flink-cdc-sources" Page of DB2 for Flink CDC Chinese Documentation.
LvYanquan created FLINK-34747: - Summary: "legacy-flink-cdc-sources" Page of DB2 for Flink CDC Chinese Documentation. Key: FLINK-34747 URL: https://issues.apache.org/jira/browse/FLINK-34747 Project: Flink Issue Type: Sub-task Components: chinese-translation, Documentation, Flink CDC Affects Versions: cdc-3.1.0 Reporter: LvYanquan Fix For: cdc-3.1.0 Translate legacy-flink-cdc-sources pages of [https://github.com/apache/flink-cdc/blob/master/docs/content/docs/connectors/legacy-flink-cdc-sources/db2-cdc.md |https://github.com/apache/flink-cdc/blob/master/docs/content/docs/connectors/legacy-flink-cdc-sources/db2-cdc.md]into Chinese. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (FLINK-34740) "legacy-flink-cdc-sources" Pages for Flink CDC Chinese Documentation existed in 2.x version.
[ https://issues.apache.org/jira/browse/FLINK-34740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LvYanquan updated FLINK-34740: -- Description: Translate legacy-flink-cdc-sources pages of [https://github.com/apache/flink-cdc/tree/master/docs/content/docs/connectors/legacy-flink-cdc-sources] into Chinese. This includes legacy MySQL\MongoDB\Oceanbase source. was:Translate legacy-flink-cdc-sources pages of [https://github.com/apache/flink-cdc/tree/master/docs/content/docs/connectors/legacy-flink-cdc-sources] into Chinese. > "legacy-flink-cdc-sources" Pages for Flink CDC Chinese Documentation existed > in 2.x version. > > > Key: FLINK-34740 > URL: https://issues.apache.org/jira/browse/FLINK-34740 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation, Flink CDC >Affects Versions: cdc-3.1.0 >Reporter: LvYanquan >Priority: Minor > Fix For: cdc-3.1.0 > > > Translate legacy-flink-cdc-sources pages of > [https://github.com/apache/flink-cdc/tree/master/docs/content/docs/connectors/legacy-flink-cdc-sources] > into Chinese. > This includes legacy MySQL\MongoDB\Oceanbase source. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (FLINK-34740) "legacy-flink-cdc-sources" Pages for Flink CDC Chinese Documentation existed in 2.x version.
[ https://issues.apache.org/jira/browse/FLINK-34740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LvYanquan updated FLINK-34740: -- Summary: "legacy-flink-cdc-sources" Pages for Flink CDC Chinese Documentation existed in 2.x version. (was: "legacy-flink-cdc-sources" Pages for Flink CDC Chinese Documentation) > "legacy-flink-cdc-sources" Pages for Flink CDC Chinese Documentation existed > in 2.x version. > > > Key: FLINK-34740 > URL: https://issues.apache.org/jira/browse/FLINK-34740 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation, Flink CDC >Affects Versions: cdc-3.1.0 >Reporter: LvYanquan >Priority: Minor > Fix For: cdc-3.1.0 > > > Translate legacy-flink-cdc-sources pages of > [https://github.com/apache/flink-cdc/tree/master/docs/content/docs/connectors/legacy-flink-cdc-sources] > into Chinese. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (FLINK-34729) "Core Concept" Pages for Flink CDC Chinese Documentation
[ https://issues.apache.org/jira/browse/FLINK-34729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828566#comment-17828566 ] LvYanquan commented on FLINK-34729: --- I am willing to do this. > "Core Concept" Pages for Flink CDC Chinese Documentation > > > Key: FLINK-34729 > URL: https://issues.apache.org/jira/browse/FLINK-34729 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation, Flink CDC >Reporter: LvYanquan >Priority: Minor > > Translate [Core > Concept|https://github.com/apache/flink-cdc/tree/master/docs/content/docs/core-concept] > Pages into Chinese. > Include data-pipeline/data-source/data-sink/route/transform/table-id. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (FLINK-34735) "Developer Guide - Understanding Flink CDC API" Page for Flink CDC Chinese Documentation
[ https://issues.apache.org/jira/browse/FLINK-34735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828567#comment-17828567 ] LvYanquan commented on FLINK-34735: --- I am willing to do this. > "Developer Guide - Understanding Flink CDC API" Page for Flink CDC Chinese > Documentation > > > Key: FLINK-34735 > URL: https://issues.apache.org/jira/browse/FLINK-34735 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation, Flink CDC >Affects Versions: 3.1.0 >Reporter: LvYanquan >Priority: Minor > Fix For: 3.1.0 > > > Translate > [https://github.com/apache/flink-cdc/blob/master/docs/content/docs/developer-guide/understand-flink-cdc-api.md] > into Chinese. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-34742) Translate "FAQ" Page for Flink CDC Chinese Documentation
LvYanquan created FLINK-34742: - Summary: Translate "FAQ" Page for Flink CDC Chinese Documentation Key: FLINK-34742 URL: https://issues.apache.org/jira/browse/FLINK-34742 Project: Flink Issue Type: Sub-task Components: chinese-translation, Documentation, Flink CDC Affects Versions: cdc-3.1.0 Reporter: LvYanquan Fix For: cdc-3.1.0 Translate [https://github.com/apache/flink-cdc/blob/master/docs/content/docs/faq/faq.md] page into Chinese. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-34741) "get-started" Page for Flink CDC Chinese Documentation
LvYanquan created FLINK-34741: - Summary: "get-started" Page for Flink CDC Chinese Documentation Key: FLINK-34741 URL: https://issues.apache.org/jira/browse/FLINK-34741 Project: Flink Issue Type: Sub-task Components: chinese-translation, Documentation, Flink CDC Affects Versions: cdc-3.1.0 Reporter: LvYanquan Fix For: cdc-3.1.0 Translate [https://github.com/apache/flink-cdc/tree/master/docs/content/docs/get-started] pages into Chinese. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-34740) "legacy-flink-cdc-sources" Pages for Flink CDC Chinese Documentation
LvYanquan created FLINK-34740: - Summary: "legacy-flink-cdc-sources" Pages for Flink CDC Chinese Documentation Key: FLINK-34740 URL: https://issues.apache.org/jira/browse/FLINK-34740 Project: Flink Issue Type: Sub-task Components: chinese-translation, Documentation, Flink CDC Affects Versions: cdc-3.1.0 Reporter: LvYanquan Fix For: cdc-3.1.0 Translate legacy-flink-cdc-sources pages of [https://github.com/apache/flink-cdc/tree/master/docs/content/docs/connectors/legacy-flink-cdc-sources] into Chinese. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-34739) "Connectors" Page for Flink CDC Chinese Documentation
LvYanquan created FLINK-34739: - Summary: "Connectors" Page for Flink CDC Chinese Documentation Key: FLINK-34739 URL: https://issues.apache.org/jira/browse/FLINK-34739 Project: Flink Issue Type: Sub-task Components: chinese-translation, Documentation, Flink CDC Affects Versions: cdc-3.1.0 Reporter: LvYanquan Fix For: cdc-3.1.0 Translate pipeline connector pages [https://github.com/apache/flink-cdc/tree/master/docs/content/docs/connectors] into Chinese. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-34738) "Deployment - YARN" Page for Flink CDC Chinese Documentation
LvYanquan created FLINK-34738: - Summary: "Deployment - YARN" Page for Flink CDC Chinese Documentation Key: FLINK-34738 URL: https://issues.apache.org/jira/browse/FLINK-34738 Project: Flink Issue Type: Sub-task Components: chinese-translation, Documentation, Flink CDC Affects Versions: 3.1.0 Reporter: LvYanquan Fix For: 3.1.0 Translate [https://github.com/apache/flink-cdc/blob/master/docs/content/docs/deployment/yarn.md] into Chinese. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-34737) "Deployment - Kubernetes" Page for Flink CDC Chinese Documentation
LvYanquan created FLINK-34737: - Summary: "Deployment - Kubernetes" Page for Flink CDC Chinese Documentation Key: FLINK-34737 URL: https://issues.apache.org/jira/browse/FLINK-34737 Project: Flink Issue Type: Sub-task Components: chinese-translation, Documentation, Flink CDC Affects Versions: 3.1.0 Reporter: LvYanquan Fix For: 3.1.0 Translate [https://github.com/apache/flink-cdc/blob/master/docs/content/docs/deployment/kubernetes.md] into Chinese. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-34736) "Deployment - Standalone" Page for Flink CDC Chinese Documentation
LvYanquan created FLINK-34736: - Summary: "Deployment - Standalone" Page for Flink CDC Chinese Documentation Key: FLINK-34736 URL: https://issues.apache.org/jira/browse/FLINK-34736 Project: Flink Issue Type: Sub-task Components: chinese-translation, Documentation, Flink CDC Affects Versions: 3.1.0 Reporter: LvYanquan Fix For: 3.1.0 Translate [https://github.com/apache/flink-cdc/blob/master/docs/content/docs/deployment/standalone.md] into Chinese. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-34735) "Developer Guide - Understanding Flink CDC API" Page for Flink CDC Chinese Documentation
LvYanquan created FLINK-34735: - Summary: "Developer Guide - Understanding Flink CDC API" Page for Flink CDC Chinese Documentation Key: FLINK-34735 URL: https://issues.apache.org/jira/browse/FLINK-34735 Project: Flink Issue Type: Sub-task Components: chinese-translation, Documentation, Flink CDC Affects Versions: 3.1.0 Reporter: LvYanquan Fix For: 3.1.0 Translate [https://github.com/apache/flink-cdc/blob/master/docs/content/docs/developer-guide/understand-flink-cdc-api.md] into Chinese. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (FLINK-34734) Translate directory and page titles of Flink CDC docs to Chinese
[ https://issues.apache.org/jira/browse/FLINK-34734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828242#comment-17828242 ] LvYanquan commented on FLINK-34734: --- [~leonard] Sure, I would like to do it. > Translate directory and page titles of Flink CDC docs to Chinese > > > Key: FLINK-34734 > URL: https://issues.apache.org/jira/browse/FLINK-34734 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation, Flink CDC >Affects Versions: 3.1.0 >Reporter: LvYanquan >Priority: Major > Fix For: 3.1.0 > > > The titles is used to build directory and document names. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-34734) Update the titles for Chinese Documents.
LvYanquan created FLINK-34734: - Summary: Update the titles for Chinese Documents. Key: FLINK-34734 URL: https://issues.apache.org/jira/browse/FLINK-34734 Project: Flink Issue Type: Sub-task Components: chinese-translation, Documentation, Flink CDC Affects Versions: 3.1.0 Reporter: LvYanquan Fix For: 3.1.0 The titles is used to build directory and document names. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (FLINK-34729) "Core Concept" Pages for Flink CDC Chinese Documentation
[ https://issues.apache.org/jira/browse/FLINK-34729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LvYanquan updated FLINK-34729: -- Description: Translate [Core Concept|https://github.com/apache/flink-cdc/tree/master/docs/content/docs/core-concept] Pages into Chinese. Include data-pipeline/data-source/data-sink/route/transform/table-id. was:Translate "Core Concept" Pages into Chinese. > "Core Concept" Pages for Flink CDC Chinese Documentation > > > Key: FLINK-34729 > URL: https://issues.apache.org/jira/browse/FLINK-34729 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation, Flink CDC >Reporter: LvYanquan >Priority: Minor > > Translate [Core > Concept|https://github.com/apache/flink-cdc/tree/master/docs/content/docs/core-concept] > Pages into Chinese. > Include data-pipeline/data-source/data-sink/route/transform/table-id. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (FLINK-34730) Translate pages of Flink CDC docs to Chinese
[ https://issues.apache.org/jira/browse/FLINK-34730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LvYanquan updated FLINK-34730: -- Description: As https://issues.apache.org/jira/browse/FLINK-34677 introduced new structure of Document for Flink CDC, it's also necessary to update the Chinese Document for better user experience. We need to translate the pages under content into Chinese, and update the titles. was:Translate "Deployment" Page into Chinese. > Translate pages of Flink CDC docs to Chinese > > > Key: FLINK-34730 > URL: https://issues.apache.org/jira/browse/FLINK-34730 > Project: Flink > Issue Type: Improvement > Components: chinese-translation, Documentation, Flink CDC >Reporter: LvYanquan >Priority: Minor > Fix For: 3.1.0 > > > As https://issues.apache.org/jira/browse/FLINK-34677 introduced new structure > of Document for Flink CDC, it's also necessary to update the Chinese Document > for better user experience. > We need to translate the pages under content into Chinese, and update the > titles. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (FLINK-34729) "Core Concept" Pages for Flink CDC Chinese Documentation
[ https://issues.apache.org/jira/browse/FLINK-34729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LvYanquan updated FLINK-34729: -- Parent: FLINK-34730 Issue Type: Sub-task (was: Improvement) > "Core Concept" Pages for Flink CDC Chinese Documentation > > > Key: FLINK-34729 > URL: https://issues.apache.org/jira/browse/FLINK-34729 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation, Flink CDC >Reporter: LvYanquan >Priority: Minor > > Translate "Core Concept" Pages into Chinese. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (FLINK-34729) "Core Concept" Pages for Flink CDC Chinese Documentation
[ https://issues.apache.org/jira/browse/FLINK-34729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LvYanquan updated FLINK-34729: -- Parent: (was: FLINK-34677) Issue Type: Improvement (was: Sub-task) > "Core Concept" Pages for Flink CDC Chinese Documentation > > > Key: FLINK-34729 > URL: https://issues.apache.org/jira/browse/FLINK-34729 > Project: Flink > Issue Type: Improvement > Components: chinese-translation, Documentation, Flink CDC >Reporter: LvYanquan >Priority: Minor > > Translate "Core Concept" Pages into Chinese. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-34730) "Deployment" Page for Flink CDC Chinese Documentation
LvYanquan created FLINK-34730: - Summary: "Deployment" Page for Flink CDC Chinese Documentation Key: FLINK-34730 URL: https://issues.apache.org/jira/browse/FLINK-34730 Project: Flink Issue Type: Sub-task Components: chinese-translation, Documentation, Flink CDC Reporter: LvYanquan Translate "Deployment" Page into Chinese. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-34729) "Core Concept" Pages for Flink CDC Chinese Documentation
LvYanquan created FLINK-34729: - Summary: "Core Concept" Pages for Flink CDC Chinese Documentation Key: FLINK-34729 URL: https://issues.apache.org/jira/browse/FLINK-34729 Project: Flink Issue Type: Sub-task Components: chinese-translation, Documentation, Flink CDC Reporter: LvYanquan Translate "Core Concept" Pages into Chinese. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (FLINK-34685) "Deployment - Kubernetes" Page for Flink CDC Documentation
[ https://issues.apache.org/jira/browse/FLINK-34685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828147#comment-17828147 ] LvYanquan commented on FLINK-34685: --- I am willing to take this. > "Deployment - Kubernetes" Page for Flink CDC Documentation > -- > > Key: FLINK-34685 > URL: https://issues.apache.org/jira/browse/FLINK-34685 > Project: Flink > Issue Type: Sub-task > Components: Documentation, Flink CDC >Affects Versions: cdc-3.1.0 >Reporter: Qingsheng Ren >Assignee: Hongshun Wang >Priority: Major > Fix For: cdc-3.1.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (FLINK-34681) "Deployment - Standalone" Page for Flink CDC Documentation
[ https://issues.apache.org/jira/browse/FLINK-34681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17827421#comment-17827421 ] LvYanquan commented on FLINK-34681: --- I am willing to take this. > "Deployment - Standalone" Page for Flink CDC Documentation > -- > > Key: FLINK-34681 > URL: https://issues.apache.org/jira/browse/FLINK-34681 > Project: Flink > Issue Type: Sub-task > Components: Documentation, Flink CDC >Affects Versions: cdc-3.1.0 >Reporter: Qingsheng Ren >Priority: Major > Fix For: cdc-3.1.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (FLINK-34691) failed to convert time type when using mysql to doris pipeline.
[ https://issues.apache.org/jira/browse/FLINK-34691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LvYanquan closed FLINK-34691. - Resolution: Invalid > failed to convert time type when using mysql to doris pipeline. > --- > > Key: FLINK-34691 > URL: https://issues.apache.org/jira/browse/FLINK-34691 > Project: Flink > Issue Type: Bug > Components: Flink CDC >Reporter: LvYanquan >Priority: Major > Labels: github-import > Fix For: cdc-3.1.0, pre-apache > > > currently, we will get `reason: Flink doesn't support converting type TIME(0) > to Doris type yet.` error. > Imported from GitHub > Url: https://github.com/lvyanquan/flink-cdc/issues/1 > Created by: [lvyanquan|https://github.com/lvyanquan] > Labels: > Created at: Fri Mar 15 12:54:09 CST 2024 > State: open -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (FLINK-34691) failed to convert time type when using mysql to doris pipeline.
[ https://issues.apache.org/jira/browse/FLINK-34691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LvYanquan updated FLINK-34691: -- Fix Version/s: cdc-3.1.0 > failed to convert time type when using mysql to doris pipeline. > --- > > Key: FLINK-34691 > URL: https://issues.apache.org/jira/browse/FLINK-34691 > Project: Flink > Issue Type: Bug > Components: Flink CDC >Reporter: LvYanquan >Priority: Major > Labels: github-import > Fix For: pre-apache, cdc-3.1.0 > > > currently, we will get `reason: Flink doesn't support converting type TIME(0) > to Doris type yet.` error. > Imported from GitHub > Url: https://github.com/lvyanquan/flink-cdc/issues/1 > Created by: [lvyanquan|https://github.com/lvyanquan] > Labels: > Created at: Fri Mar 15 12:54:09 CST 2024 > State: open -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-34691) failed to convert time type when using mysql to doris pipeline.
LvYanquan created FLINK-34691: - Summary: failed to convert time type when using mysql to doris pipeline. Key: FLINK-34691 URL: https://issues.apache.org/jira/browse/FLINK-34691 Project: Flink Issue Type: Bug Components: Flink CDC Reporter: LvYanquan Fix For: pre-apache currently, we will get `reason: Flink doesn't support converting type TIME(0) to Doris type yet.` error. Imported from GitHub Url: https://github.com/lvyanquan/flink-cdc/issues/1 Created by: [lvyanquan|https://github.com/lvyanquan] Labels: Created at: Fri Mar 15 12:54:09 CST 2024 State: open -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (FLINK-34679) "Core Concept" Pages for Flink CDC Documentation
[ https://issues.apache.org/jira/browse/FLINK-34679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17827332#comment-17827332 ] LvYanquan commented on FLINK-34679: --- I'm willing to take this. > "Core Concept" Pages for Flink CDC Documentation > > > Key: FLINK-34679 > URL: https://issues.apache.org/jira/browse/FLINK-34679 > Project: Flink > Issue Type: Sub-task > Components: Documentation, Flink CDC >Affects Versions: cdc-3.1.0 >Reporter: Qingsheng Ren >Priority: Major > Fix For: cdc-3.1.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-34671) Update the content of README.md in FlinkCDC project
LvYanquan created FLINK-34671: - Summary: Update the content of README.md in FlinkCDC project Key: FLINK-34671 URL: https://issues.apache.org/jira/browse/FLINK-34671 Project: Flink Issue Type: Improvement Components: Flink CDC Affects Versions: cdc-3.1.0 Reporter: LvYanquan Fix For: cdc-3.1.0 As we have updated the doc site of FlinkCDC, we should modify the content of README.md to update those links and add some more accurate description. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Comment Edited] (FLINK-34648) Avoid RPC time when apply SchemaChangeEvent to external system
[ https://issues.apache.org/jira/browse/FLINK-34648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17825538#comment-17825538 ] LvYanquan edited comment on FLINK-34648 at 3/12/24 7:07 AM: Enumerator will not restart but add splits back. See the picture in the attachment. was (Author: JIRAUSER304414): Enumerator will not restart but add splits back. > Avoid RPC time when apply SchemaChangeEvent to external system > -- > > Key: FLINK-34648 > URL: https://issues.apache.org/jira/browse/FLINK-34648 > Project: Flink > Issue Type: Improvement > Components: Flink CDC >Affects Versions: cdc-3.1.0 >Reporter: LvYanquan >Priority: Major > Labels: pull-request-available > Fix For: cdc-3.1.0 > > Attachments: 截屏2024-03-12 14.55.09.png > > > When SchemaOperator receive SchemaChangeEvent, it will send request to > SchemaRegistry and wait for applying this SchemaChangeEvent to external > system synchronously. > However, if this process take too long time, it will cause RPC > TimeoutException, and During the process of task recovery, there may be other > errors like `AddColumnEvent is already existed`. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (FLINK-34648) Avoid RPC time when apply SchemaChangeEvent to external system
[ https://issues.apache.org/jira/browse/FLINK-34648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LvYanquan updated FLINK-34648: -- Attachment: 截屏2024-03-12 14.55.09.png > Avoid RPC time when apply SchemaChangeEvent to external system > -- > > Key: FLINK-34648 > URL: https://issues.apache.org/jira/browse/FLINK-34648 > Project: Flink > Issue Type: Improvement > Components: Flink CDC >Affects Versions: cdc-3.1.0 >Reporter: LvYanquan >Priority: Major > Fix For: cdc-3.1.0 > > Attachments: 截屏2024-03-12 14.55.09.png > > > When SchemaOperator receive SchemaChangeEvent, it will send request to > SchemaRegistry and wait for applying this SchemaChangeEvent to external > system synchronously. > However, if this process take too long time, it will cause RPC > TimeoutException, and During the process of task recovery, there may be other > errors like `AddColumnEvent is already existed`. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (FLINK-34648) Avoid RPC time when apply SchemaChangeEvent to external system
[ https://issues.apache.org/jira/browse/FLINK-34648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17825538#comment-17825538 ] LvYanquan commented on FLINK-34648: --- Enumerator will not restart but add splits back. > Avoid RPC time when apply SchemaChangeEvent to external system > -- > > Key: FLINK-34648 > URL: https://issues.apache.org/jira/browse/FLINK-34648 > Project: Flink > Issue Type: Improvement > Components: Flink CDC >Affects Versions: cdc-3.1.0 >Reporter: LvYanquan >Priority: Major > Fix For: cdc-3.1.0 > > > When SchemaOperator receive SchemaChangeEvent, it will send request to > SchemaRegistry and wait for applying this SchemaChangeEvent to external > system synchronously. > However, if this process take too long time, it will cause RPC > TimeoutException, and During the process of task recovery, there may be other > errors like `AddColumnEvent is already existed`. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-34648) Avoid RPC time when apply SchemaChangeEvent to external system
LvYanquan created FLINK-34648: - Summary: Avoid RPC time when apply SchemaChangeEvent to external system Key: FLINK-34648 URL: https://issues.apache.org/jira/browse/FLINK-34648 Project: Flink Issue Type: Improvement Components: Flink CDC Affects Versions: cdc-3.1.0 Reporter: LvYanquan Fix For: cdc-3.1.0 When SchemaOperator receive SchemaChangeEvent, it will send request to SchemaRegistry and wait for applying this SchemaChangeEvent to external system synchronously. However, if this process take too long time, it will cause RPC TimeoutException, and During the process of task recovery, there may be other errors like `AddColumnEvent is already existed`. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-34638) Support default value of table column.
LvYanquan created FLINK-34638: - Summary: Support default value of table column. Key: FLINK-34638 URL: https://issues.apache.org/jira/browse/FLINK-34638 Project: Flink Issue Type: Improvement Components: Flink CDC Affects Versions: cdc-3.1.0 Reporter: LvYanquan Fix For: cdc-3.1.0 Support default value of table column of literal constant. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (FLINK-34585) [JUnit5 Migration] Module: Flink CDC
[ https://issues.apache.org/jira/browse/FLINK-34585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17825121#comment-17825121 ] LvYanquan commented on FLINK-34585: --- I am willing to take this. > [JUnit5 Migration] Module: Flink CDC > > > Key: FLINK-34585 > URL: https://issues.apache.org/jira/browse/FLINK-34585 > Project: Flink > Issue Type: Sub-task > Components: Flink CDC >Reporter: Hang Ruan >Priority: Major > > Most tests in Flink CDC are still using Junit 4. We need to use Junit 5 > instead. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-34614) Add e2e test for Flink CDC pipeline job.
LvYanquan created FLINK-34614: - Summary: Add e2e test for Flink CDC pipeline job. Key: FLINK-34614 URL: https://issues.apache.org/jira/browse/FLINK-34614 Project: Flink Issue Type: Improvement Components: Flink CDC Affects Versions: cdc-3.1.0 Reporter: LvYanquan Fix For: cdc-3.1.0 Add e2e test for Flink CDC pipeline job. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-34613) allow specifing a savepoint file to restart using cli script.
LvYanquan created FLINK-34613: - Summary: allow specifing a savepoint file to restart using cli script. Key: FLINK-34613 URL: https://issues.apache.org/jira/browse/FLINK-34613 Project: Flink Issue Type: Improvement Components: Flink CDC Affects Versions: cdc-3.1.0 Reporter: LvYanquan Fix For: cdc-3.1.0 Allow user to specify a savepoint file with `-s` option to restart like Flink cli [https://nightlies.apache.org/flink/flink-docs-master/docs/deployment/cli/#starting-a-job-from-a-savepoint] does. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (FLINK-34595) Fix ClassNotFoundException: com.ververica.cdc.common.utils.StringUtils
[ https://issues.apache.org/jira/browse/FLINK-34595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LvYanquan updated FLINK-34595: -- Description: In [this pr|[https://github.com/apache/flink-cdc/pull/2986/files#diff-cec13810c47e9465e4f2a72507f655b86f41579768b9924fe024aabc60b31d17R21|https://github.com/apache/flink-cdc/pull/2986/files#diff-cec13810c47e9465e4f2a72507f655b86f41579768b9924fe024aabc60b31d17R21[]], we introduced org.apache.flink.cdc.common.utils.StringUtils class of flink-cdc-common module in flink-connector-mysql-cdc module. However, the sub module flink-sql-connector-mysql-cdc doesn't include flink-cdc-common module when packaging, so we can't find this class in sql jar.. was: In this pr https://github.com/apache/flink-cdc/pull/2986/files#diff-cec13810c47e9465e4f2a72507f655b86f41579768b9924fe024aabc60b31d17R21[,|https://github.com/apache/flink-cdc/pull/2986,] we introduced org.apache.flink.cdc.common.utils.StringUtils class of flink-cdc-common module in flink-connector-mysql-cdc module. However, the sub module flink-sql-connector-mysql-cdc doesn't include flink-cdc-common module when packaging, so we can't find this class in sql jar.. > Fix ClassNotFoundException: com.ververica.cdc.common.utils.StringUtils > -- > > Key: FLINK-34595 > URL: https://issues.apache.org/jira/browse/FLINK-34595 > Project: Flink > Issue Type: Bug > Components: Flink CDC >Reporter: LvYanquan >Priority: Major > Fix For: cdc-3.1.0 > > > In [this > pr|[https://github.com/apache/flink-cdc/pull/2986/files#diff-cec13810c47e9465e4f2a72507f655b86f41579768b9924fe024aabc60b31d17R21|https://github.com/apache/flink-cdc/pull/2986/files#diff-cec13810c47e9465e4f2a72507f655b86f41579768b9924fe024aabc60b31d17R21[]], > we introduced > org.apache.flink.cdc.common.utils.StringUtils class of flink-cdc-common > module in flink-connector-mysql-cdc module. > However, the sub module flink-sql-connector-mysql-cdc doesn't include > flink-cdc-common module when packaging, so we can't find this class in sql > jar.. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-34595) Fix ClassNotFoundException: com.ververica.cdc.common.utils.StringUtils
LvYanquan created FLINK-34595: - Summary: Fix ClassNotFoundException: com.ververica.cdc.common.utils.StringUtils Key: FLINK-34595 URL: https://issues.apache.org/jira/browse/FLINK-34595 Project: Flink Issue Type: Bug Components: Flink CDC Reporter: LvYanquan Fix For: cdc-3.1.0 In this pr https://github.com/apache/flink-cdc/pull/2986/files#diff-cec13810c47e9465e4f2a72507f655b86f41579768b9924fe024aabc60b31d17R21[,|https://github.com/apache/flink-cdc/pull/2986,] we introduced org.apache.flink.cdc.common.utils.StringUtils class of flink-cdc-common module in flink-connector-mysql-cdc module. However, the sub module flink-sql-connector-mysql-cdc doesn't include flink-cdc-common module when packaging, so we can't find this class in sql jar.. -- This message was sent by Atlassian Jira (v8.20.10#820010)
