[jira] [Updated] (FLINK-34962) flink-connector-pulsa starts failed due to incorrect use of Pulsar API: LookupService. getPartitionedTopicMetadata

2024-04-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-34962: --- Labels: easyfix pull-request-available (was: easyfix) > flink-connector-pulsa starts

[jira] [Updated] (FLINK-35055) Flink CDC connector release contains dependency with incompatible licenses

2024-04-08 Thread Xiqian YU (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiqian YU updated FLINK-35055: -- Summary: Flink CDC connector release contains dependency with incompatible licenses (was: Flink CDC

[jira] [Updated] (FLINK-34997) PyFlink YARN per-job on Docker test failed on azure

2024-04-08 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-34997: --- Description: {code} Apr 03 03:12:37

Re: [PR] [minor][cdc][docs] Optimize styles of the Flink CDC website docs home… [flink-cdc]

2024-04-08 Thread via GitHub
Laffery commented on PR #3208: URL: https://github.com/apache/flink-cdc/pull/3208#issuecomment-2044144359 > @Laffery Please add `/` before `fig`. And ci will pass. Thanks for your kind tips, I've finished and hope you review and trigger the CI again  -- This is an automated

[jira] [Created] (FLINK-35056) when initial sqlserver table that

2024-04-08 Thread yandufeng (Jira)
yandufeng created FLINK-35056: - Summary: when initial sqlserver table that Key: FLINK-35056 URL: https://issues.apache.org/jira/browse/FLINK-35056 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-35057) Bump org.apache.commons:commons-compress from 1.25.0 to 1.26.1 for Flink jdbc connector

2024-04-08 Thread Sergey Nuyanzin (Jira)
Sergey Nuyanzin created FLINK-35057: --- Summary: Bump org.apache.commons:commons-compress from 1.25.0 to 1.26.1 for Flink jdbc connector Key: FLINK-35057 URL: https://issues.apache.org/jira/browse/FLINK-35057

Re: [PR] [FLINK-34986][Runtime/State] Basic framework of async execution for state [flink]

2024-04-08 Thread via GitHub
Zakelly commented on PR #24614: URL: https://github.com/apache/flink/pull/24614#issuecomment-2044191108 Rebased master. Extracting `StateRequestType` with more detailed enum entry definition. -- This is an automated message from the Apache Git Service. To respond to the message, please

Re: [PR] [FLINK-34962] Remove unnecessary call Pulsar API: LookupService.getPrtitionedTopicMetadata [flink-connector-pulsar]

2024-04-08 Thread via GitHub
boring-cyborg[bot] commented on PR #86: URL: https://github.com/apache/flink-connector-pulsar/pull/86#issuecomment-2044005954 Thanks for opening this pull request! Please check out our contributing guidelines. (https://flink.apache.org/contributing/how-to-contribute.html) -- This is

[PR] [FLINK-34962] Remove unnecessary call Pulsar API: LookupService.getPrtitionedTopicMetadata [flink-connector-pulsar]

2024-04-08 Thread via GitHub
shibd opened a new pull request, #86: URL: https://github.com/apache/flink-connector-pulsar/pull/86 ## Purpose of the change https://issues.apache.org/jira/browse/FLINK-34962 ## Brief change log - Remove unnecessary call Pulsar API: LookupService.getPrtitionedTopicMetadata

[jira] [Comment Edited] (FLINK-35023) YARNApplicationITCase failed on Azure

2024-04-08 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835138#comment-17835138 ] Weijie Guo edited comment on FLINK-35023 at 4/9/24 4:13 AM: Thanks

[jira] [Commented] (FLINK-35023) YARNApplicationITCase failed on Azure

2024-04-08 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835137#comment-17835137 ] Weijie Guo commented on FLINK-35023: jdk17:

[jira] [Commented] (FLINK-35023) YARNApplicationITCase failed on Azure

2024-04-08 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835138#comment-17835138 ] Weijie Guo commented on FLINK-35023: > Apparently this might be automatic in more recent Hadoop

Re: [PR] [FLINK-34986][Runtime/State] Basic framework of async execution for state [flink]

2024-04-08 Thread via GitHub
jiexray commented on code in PR #24614: URL: https://github.com/apache/flink/pull/24614#discussion_r1556755468 ## flink-runtime/src/main/java/org/apache/flink/runtime/asyncprocessing/AsyncExecutionController.java: ## @@ -0,0 +1,144 @@ +/* + * Licensed to the Apache Software

[jira] [Commented] (FLINK-35035) Reduce job pause time when cluster resources are expanded in adaptive mode

2024-04-08 Thread yuanfenghu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835106#comment-17835106 ] yuanfenghu commented on FLINK-35035: [~bgeng777]  Thank you for your comment. As you understand, I

[jira] [Commented] (FLINK-35041) IncrementalRemoteKeyedStateHandleTest.testSharedStateReRegistration failed

2024-04-08 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835129#comment-17835129 ] Weijie Guo commented on FLINK-35041:

[jira] [Updated] (FLINK-34997) PyFlink YARN per-job on Docker test failed on azure

2024-04-08 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-34997: --- Description: {code} Apr 03 03:12:37

Re: [PR] [FLINK-34986][Runtime/State] Basic framework of async execution for state [flink]

2024-04-08 Thread via GitHub
masteryhx commented on code in PR #24614: URL: https://github.com/apache/flink/pull/24614#discussion_r1556830946 ## flink-runtime/src/main/java/org/apache/flink/runtime/asyncprocessing/AsyncExecutionController.java: ## @@ -0,0 +1,138 @@ +/* + * Licensed to the Apache Software

[PR] [FLINK-35055][cdc] Exclude connector dependencies with questionable licenses from fat jar packages [flink-cdc]

2024-04-08 Thread via GitHub
yuxiqian opened a new pull request, #3212: URL: https://github.com/apache/flink-cdc/pull/3212 This resolves [FLINK-35055](https://issues.apache.org/jira/browse/FLINK-35055). Currently, Flink CDC connector releases both slim and fat jars. Apart from CDC itself, all of its

[jira] [Updated] (FLINK-35055) Flink CDC connector release contains dependency with incompatible licenses

2024-04-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35055: --- Labels: pull-request-available (was: ) > Flink CDC connector release contains dependency

[jira] [Updated] (FLINK-34099) CheckpointIntervalDuringBacklogITCase.testNoCheckpointDuringBacklog is unstable on AZP

2024-04-08 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-34099: --- Affects Version/s: 1.20.0 > CheckpointIntervalDuringBacklogITCase.testNoCheckpointDuringBacklog is

[jira] [Updated] (FLINK-34099) CheckpointIntervalDuringBacklogITCase.testNoCheckpointDuringBacklog is unstable on AZP

2024-04-08 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-34099: --- Component/s: Build System / CI >

Re: [PR] [FLINK-35044][state] Init flink-statebackend-forst module [flink]

2024-04-08 Thread via GitHub
ljz2051 commented on code in PR #24631: URL: https://github.com/apache/flink/pull/24631#discussion_r1556933308 ## flink-state-backends/flink-statebackend-forst/pom.xml: ## @@ -0,0 +1,92 @@ + + +http://maven.apache.org/POM/4.0.0; +

Re: [PR] [FLINK-34986][Runtime/State] Basic framework of async execution for state [flink]

2024-04-08 Thread via GitHub
Zakelly commented on code in PR #24614: URL: https://github.com/apache/flink/pull/24614#discussion_r1556939595 ## flink-runtime/src/main/java/org/apache/flink/runtime/asyncprocessing/AsyncExecutionController.java: ## @@ -0,0 +1,144 @@ +/* + * Licensed to the Apache Software

[jira] [Commented] (FLINK-35008) Bump org.apache.commons:commons-compress from 1.25.0 to 1.26.0 for Flink Kafka connector

2024-04-08 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835149#comment-17835149 ] Sergey Nuyanzin commented on FLINK-35008: - I think it would make sense to go with 1.26.1 I

Re: [PR] [FLINK-34555][table] Migrate JoinConditionTypeCoerceRule to java. [flink]

2024-04-08 Thread via GitHub
liuyongvs commented on PR #24420: URL: https://github.com/apache/flink/pull/24420#issuecomment-2044020112 > @liuyongvs the ci still fails could you please have a look here? @snuyanzin The error occurs because the word "implicit" was mistakenly written as "Implicit", which leads to a

[jira] [Updated] (FLINK-35040) The performance of serializerHeavyString regresses since April 3

2024-04-08 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan updated FLINK-35040: Description: The performance of serializerHeavyString regresses since April 3, and had not yet recovered

Re: [PR] [FLINK-25537][JUnit5 Migration] Module: flink-core with,Package: Configuration [flink]

2024-04-08 Thread via GitHub
GOODBOY008 commented on PR #24612: URL: https://github.com/apache/flink/pull/24612#issuecomment-2044061547 @Jiabao-Sun @1996fanrui PTAL -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] [FLINK-25537][JUnit5 Migration] Module: flink-core with,Package: types [flink]

2024-04-08 Thread via GitHub
GOODBOY008 commented on PR #24613: URL: https://github.com/apache/flink/pull/24613#issuecomment-2044061806 @Jiabao-Sun @1996fanrui PTAL -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Created] (FLINK-35054) Migrate TemporalJoinRewriteWithUniqueKeyRule

2024-04-08 Thread Jacky Lau (Jira)
Jacky Lau created FLINK-35054: - Summary: Migrate TemporalJoinRewriteWithUniqueKeyRule Key: FLINK-35054 URL: https://issues.apache.org/jira/browse/FLINK-35054 Project: Flink Issue Type: Sub-task

[jira] [Commented] (FLINK-34273) git fetch fails

2024-04-08 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835131#comment-17835131 ] Weijie Guo commented on FLINK-34273:

[jira] [Commented] (FLINK-35008) Bump org.apache.commons:commons-compress from 1.25.0 to 1.26.0 for Flink Kafka connector

2024-04-08 Thread Jiabao Sun (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835156#comment-17835156 ] Jiabao Sun commented on FLINK-35008: I agree with Sergey's opinion. In version 1.26.0, the

Re: [PR] [FLINK-35044][state] Init flink-statebackend-forst module [flink]

2024-04-08 Thread via GitHub
masteryhx commented on code in PR #24631: URL: https://github.com/apache/flink/pull/24631#discussion_r1556741472 ## flink-state-backends/flink-statebackend-forst/pom.xml: ## @@ -0,0 +1,92 @@ + + +http://maven.apache.org/POM/4.0.0; +

Re: [PR] [FLINK-35044][state] Init flink-statebackend-forst module [flink]

2024-04-08 Thread via GitHub

[jira] [Comment Edited] (FLINK-35035) Reduce job pause time when cluster resources are expanded in adaptive mode

2024-04-08 Thread yuanfenghu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835106#comment-17835106 ] yuanfenghu edited comment on FLINK-35035 at 4/9/24 2:22 AM: [~bgeng777] 

[jira] [Commented] (FLINK-35037) Optimize uniqueKeys and upsertKeys inference of windows with ROW_NUMBER

2024-04-08 Thread yisha zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835139#comment-17835139 ] yisha zhou commented on FLINK-35037: Hi [~libenchao] , could you please assign this task to me? I've

[jira] [Commented] (FLINK-35051) Weird priorities when processing unaligned checkpoints

2024-04-08 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835142#comment-17835142 ] Peter Vary commented on FLINK-35051: FLINK-34704 is one of the ways this issue materializes > Weird

Re: [PR] [FLINK-34986][Runtime/State] Basic framework of async execution for state [flink]

2024-04-08 Thread via GitHub
Zakelly commented on code in PR #24614: URL: https://github.com/apache/flink/pull/24614#discussion_r1556936793 ## flink-runtime/src/main/java/org/apache/flink/runtime/asyncprocessing/AsyncExecutionController.java: ## @@ -0,0 +1,144 @@ +/* + * Licensed to the Apache Software

Re: [PR] [FLINK-34123][core][type] Introduce built-in serialization support for map and lists [flink]

2024-04-08 Thread via GitHub
reswqa commented on code in PR #24634: URL: https://github.com/apache/flink/pull/24634#discussion_r1556930144 ## docs/content/docs/dev/datastream/fault-tolerance/serialization/types_serialization.md: ## @@ -37,15 +37,16 @@ Flink places some restrictions on the type of elements

Re: [PR] [FLINK-34986][Runtime/State] Basic framework of async execution for state [flink]

2024-04-08 Thread via GitHub
Zakelly commented on code in PR #24614: URL: https://github.com/apache/flink/pull/24614#discussion_r1556936013 ## flink-runtime/src/main/java/org/apache/flink/runtime/asyncprocessing/AsyncExecutionController.java: ## @@ -0,0 +1,144 @@ +/* + * Licensed to the Apache Software

[jira] [Created] (FLINK-35058) Encountered change event for table db.table whose schema isn't known to this connector

2024-04-08 Thread MOBIN (Jira)
MOBIN created FLINK-35058: - Summary: Encountered change event for table db.table whose schema isn't known to this connector Key: FLINK-35058 URL: https://issues.apache.org/jira/browse/FLINK-35058 Project:

[jira] [Updated] (FLINK-35056) when initial sqlserver table that's primary key is datetime type, it org.apache.flink.table.api.ValidationException: Timestamp precision must be between 0 and 9 (both i

2024-04-08 Thread yandufeng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yandufeng updated FLINK-35056: -- Affects Version/s: 2.0.0 Description: when initial sqlserver table that's primary key is

[jira] [Created] (FLINK-35055) Flink CDC connector release contains jar with incompatible licenses

2024-04-08 Thread Xiqian YU (Jira)
Xiqian YU created FLINK-35055: - Summary: Flink CDC connector release contains jar with incompatible licenses Key: FLINK-35055 URL: https://issues.apache.org/jira/browse/FLINK-35055 Project: Flink

[jira] [Commented] (FLINK-34099) CheckpointIntervalDuringBacklogITCase.testNoCheckpointDuringBacklog is unstable on AZP

2024-04-08 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835130#comment-17835130 ] Weijie Guo commented on FLINK-34099:

Re: [PR] [FLINK-34986][Runtime/State] Basic framework of async execution for state [flink]

2024-04-08 Thread via GitHub
masteryhx commented on code in PR #24614: URL: https://github.com/apache/flink/pull/24614#discussion_r1556826447 ## flink-runtime/src/main/java/org/apache/flink/runtime/asyncprocessing/StateExecutor.java: ## @@ -0,0 +1,36 @@ +/* + * Licensed to the Apache Software Foundation

[jira] [Assigned] (FLINK-35055) Flink CDC connector release contains dependency with incompatible licenses

2024-04-08 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qingsheng Ren reassigned FLINK-35055: - Assignee: Xiqian YU > Flink CDC connector release contains dependency with

[jira] [Updated] (FLINK-35055) Flink CDC connector release contains dependency with incompatible licenses

2024-04-08 Thread Xiqian YU (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiqian YU updated FLINK-35055: -- Description: Currently, Flink CDC connector releases both slim and fat jars. Apart from CDC itself,

Re: [PR] [FLINK-33459][Connector/JDBC] Support the new source that keeps the same functionality as the original JDBC input format [flink-connector-jdbc]

2024-04-08 Thread via GitHub
RocMarshal commented on PR #78: URL: https://github.com/apache/flink-connector-jdbc/pull/78#issuecomment-2042712930 Thanks everybody related for the pr. :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[PR] [FLINK-34961] Use dedicated CI name for JDBC connector to differentiate it in infra-reports [flink-connector-jdbc]

2024-04-08 Thread via GitHub
snuyanzin opened a new pull request, #112: URL: https://github.com/apache/flink-connector-jdbc/pull/112 The PR will allow to differentiate between jdbc connector statistics and others with name ci -- This is an automated message from the Apache Git Service. To respond to the

[jira] [Updated] (FLINK-34944) Use Incremental Source Framework in Flink CDC OceanBase Source Connector

2024-04-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-34944: --- Labels: pull-request-available (was: ) > Use Incremental Source Framework in Flink CDC

[PR] [FLINK-34944] Use Incremental Source Framework in Flink CDC OceanBase Source Connector [flink-cdc]

2024-04-08 Thread via GitHub
whhe opened a new pull request, #3211: URL: https://github.com/apache/flink-cdc/pull/3211 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

Re: [PR] [FLINK-34896][table] Migrate CorrelateSortToRankRule to java [flink]

2024-04-08 Thread via GitHub
RyanSkraba commented on code in PR #24545: URL: https://github.com/apache/flink/pull/24545#discussion_r1555815225 ## flink-table/flink-table-planner/src/main/java/org/apache/flink/table/planner/plan/rules/logical/CorrelateSortToRankRule.java: ## @@ -0,0 +1,256 @@ +/* + *

[PR] [FLINK-34123][core][type] Introduce built-in serialization support for map and lists [flink]

2024-04-08 Thread via GitHub
X-czh opened a new pull request, #24634: URL: https://github.com/apache/flink/pull/24634 ## What is the purpose of the change Introduce built-in serialization support for map and lists, which falls back to Kyro previously. ## Brief change log Introduce built-in

[PR] [FLINK-34961] Use dedicated CI name for Kafka connector to differentiate it in infra-reports [flink-connector-kafka]

2024-04-08 Thread via GitHub
snuyanzin opened a new pull request, #92: URL: https://github.com/apache/flink-connector-kafka/pull/92 The PR will allow to differentiate between Kafka connector statistics and others with name ci -- This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Updated] (FLINK-34123) Introduce built-in serializers for common composited data types

2024-04-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-34123: --- Labels: pull-request-available (was: ) > Introduce built-in serializers for common

Re: [PR] [FLINK-34123][core][type] Introduce built-in serialization support for map and lists [flink]

2024-04-08 Thread via GitHub
flinkbot commented on PR #24634: URL: https://github.com/apache/flink/pull/24634#issuecomment-2042769387 ## CI report: * c93a19e5bcb3657bd30bf47ceff989e19bc80a53 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-35053) TIMESTAMP with TIME ZONE not supported by JDBC connector for Postgres

2024-04-08 Thread Pietro (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pietro updated FLINK-35053: --- Attachment: Timestamp.png TimestampData.png > TIMESTAMP with TIME ZONE not supported by

[jira] [Updated] (FLINK-35053) TIMESTAMP with TIME ZONE not supported by JDBC connector for Postgres

2024-04-08 Thread Pietro (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pietro updated FLINK-35053: --- Description: !createExternalConverter.png! The JDBC sink for Postgres does not support {{{}TIMESTAMP WITH

[jira] [Updated] (FLINK-35051) Weird priorities when processing unaligned checkpoints

2024-04-08 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-35051: --- Description: While looking through the code I noticed that `StreamTask` is processing

Re: [PR] [FLINK-33545][Connectors/Kafka] KafkaSink implementation can cause dataloss during broker issue when not using EXACTLY_ONCE if there's any batching [flink-connector-kafka]

2024-04-08 Thread via GitHub
mas-chen commented on code in PR #70: URL: https://github.com/apache/flink-connector-kafka/pull/70#discussion_r1556262703 ## flink-connector-kafka/src/main/java/org/apache/flink/connector/kafka/sink/FlinkKafkaInternalProducer.java: ## @@ -396,8 +408,27 @@ public String

[jira] [Updated] (FLINK-35053) TIMESTAMP with TIME ZONE not supported by JDBC connector for Postgres

2024-04-08 Thread Pietro (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pietro updated FLINK-35053: --- Description: The JDBC sink for Postgres does not support {{{}TIMESTAMP WITH TIME ZONE{}}}, nor

[jira] [Commented] (FLINK-34450) TwoInputStreamTaskTest.testWatermarkAndWatermarkStatusForwarding failed

2024-04-08 Thread Robert Metzger (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835010#comment-17835010 ] Robert Metzger commented on FLINK-34450: I was not able to reproduce the issue with a single

[jira] [Updated] (FLINK-35051) Weird priorities when processing unaligned checkpoints

2024-04-08 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-35051: --- Affects Version/s: 1.16.3 > Weird priorities when processing unaligned checkpoints >

[jira] [Updated] (FLINK-35051) Weird priorities when processing unaligned checkpoints

2024-04-08 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-35051: --- Description: While looking through the code I noticed that `StreamTask` is processing

Re: [PR] [FLINK-33545][Connectors/Kafka] KafkaSink implementation can cause dataloss during broker issue when not using EXACTLY_ONCE if there's any batching [flink-connector-kafka]

2024-04-08 Thread via GitHub
mas-chen commented on code in PR #70: URL: https://github.com/apache/flink-connector-kafka/pull/70#discussion_r1556263478 ## flink-connector-kafka/src/main/java/org/apache/flink/connector/kafka/sink/FlinkKafkaInternalProducer.java: ## @@ -396,8 +408,27 @@ public String

[jira] [Updated] (FLINK-35053) TIMESTAMP with TIME ZONE not supported by JDBC connector for Postgres

2024-04-08 Thread Pietro (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pietro updated FLINK-35053: --- Description: The JDBC sink for Postgres does not support {{{}TIMESTAMP WITH TIME ZONE{}}}, nor

[jira] [Updated] (FLINK-35053) TIMESTAMP with TIME ZONE not supported by JDBC connector for Postgres

2024-04-08 Thread Pietro (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pietro updated FLINK-35053: --- Attachment: (was: image-2024-04-08-18-05-09-213.png) > TIMESTAMP with TIME ZONE not supported by JDBC

[jira] [Updated] (FLINK-35053) TIMESTAMP with TIME ZONE not supported by JDBC connector for Postgres

2024-04-08 Thread Pietro (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pietro updated FLINK-35053: --- Attachment: (was: image-2024-04-08-18-05-00-820.png) > TIMESTAMP with TIME ZONE not supported by JDBC

[jira] [Updated] (FLINK-35053) TIMESTAMP with TIME ZONE not supported by JDBC connector for Postgres

2024-04-08 Thread Pietro (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pietro updated FLINK-35053: --- Description: The JDBC sink for Postgres does not support {{{}TIMESTAMP WITH TIME ZONE{}}}, nor

[jira] [Updated] (FLINK-35053) TIMESTAMP with TIME ZONE not supported by JDBC connector for Postgres

2024-04-08 Thread Pietro (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pietro updated FLINK-35053: --- Description: The JDBC sink for Postgres does not support {{{}TIMESTAMP WITH TIME ZONE{}}}, nor

[jira] [Updated] (FLINK-35053) TIMESTAMP with TIME ZONE not supported by JDBC connector for Postgres

2024-04-08 Thread Pietro (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pietro updated FLINK-35053: --- Attachment: createExternalConverter.png > TIMESTAMP with TIME ZONE not supported by JDBC connector for

[jira] [Updated] (FLINK-35053) TIMESTAMP with TIME ZONE not supported by JDBC connector for Postgres

2024-04-08 Thread Pietro (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pietro updated FLINK-35053: --- Description: The JDBC sink for Postgres does not support {{{}TIMESTAMP WITH TIME ZONE{}}}, nor

[jira] [Updated] (FLINK-35053) TIMESTAMP with TIME ZONE not supported by JDBC connector for Postgres

2024-04-08 Thread Pietro (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pietro updated FLINK-35053: --- Description: The JDBC sink for Postgres does not support {{{}TIMESTAMP WITH TIME ZONE{}}}, nor

[jira] [Commented] (FLINK-35023) YARNApplicationITCase failed on Azure

2024-04-08 Thread Ryan Skraba (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835002#comment-17835002 ] Ryan Skraba commented on FLINK-35023: - Ooops -- there's is already a {{surefire.module.config}} in

Re: [PR] [FLINK-34444] Initial implementation of JM operator metric rest api [flink]

2024-04-08 Thread via GitHub
mas-chen commented on code in PR #24564: URL: https://github.com/apache/flink/pull/24564#discussion_r1556248651 ## docs/static/generated/rest_v1_dispatcher.yml: ## @@ -1089,6 +1089,37 @@ paths: application/json: schema: $ref:

Re: [PR] [FLINK-34444] Initial implementation of JM operator metric rest api [flink]

2024-04-08 Thread via GitHub
mas-chen commented on code in PR #24564: URL: https://github.com/apache/flink/pull/24564#discussion_r1556250658 ## flink-core/src/main/java/org/apache/flink/configuration/MetricOptions.java: ## @@ -277,11 +277,12 @@ public static Configuration forReporter(Configuration

Re: [PR] [FLINK-33545][Connectors/Kafka] KafkaSink implementation can cause dataloss during broker issue when not using EXACTLY_ONCE if there's any batching [flink-connector-kafka]

2024-04-08 Thread via GitHub
mas-chen commented on code in PR #70: URL: https://github.com/apache/flink-connector-kafka/pull/70#discussion_r1556268256 ## flink-connector-kafka/src/main/java/org/apache/flink/connector/kafka/sink/FlinkKafkaInternalProducer.java: ## @@ -86,6 +93,11 @@ public void flush() {

Re: [PR] [FLINK-33545][Connectors/Kafka] KafkaSink implementation can cause dataloss during broker issue when not using EXACTLY_ONCE if there's any batching [flink-connector-kafka]

2024-04-08 Thread via GitHub
mas-chen commented on PR #70: URL: https://github.com/apache/flink-connector-kafka/pull/70#issuecomment-2043431836 @hhktseng were you able to test that this change mitigates your original issue? Is there a way to repro in the tests? -- This is an automated message from the Apache Git

Re: [PR] [FLINK-34986][Runtime/State] Basic framework of async execution for state [flink]

2024-04-08 Thread via GitHub
Zakelly commented on PR #24614: URL: https://github.com/apache/flink/pull/24614#issuecomment-2041936516 @masteryhx Thanks for your comments! Applied some suggestions, PTAL thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Commented] (FLINK-32513) Job in BATCH mode with a significant number of transformations freezes on method StreamGraphGenerator.existsUnboundedSource()

2024-04-08 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834798#comment-17834798 ] Zhu Zhu commented on FLINK-32513: - {{Transformation}} is not a public interface, it is an @Internal

[jira] [Created] (FLINK-35043) Release beta version of ForSt

2024-04-08 Thread Hangxiang Yu (Jira)
Hangxiang Yu created FLINK-35043: Summary: Release beta version of ForSt Key: FLINK-35043 URL: https://issues.apache.org/jira/browse/FLINK-35043 Project: Flink Issue Type: Sub-task

[jira] [Comment Edited] (FLINK-32513) Job in BATCH mode with a significant number of transformations freezes on method StreamGraphGenerator.existsUnboundedSource()

2024-04-08 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834798#comment-17834798 ] Zhu Zhu edited comment on FLINK-32513 at 4/8/24 6:27 AM: - {{Transformation}} is

Re: [PR] [cdc-cli][cdc-composer] Applying 'flink-config' for pipeline yaml [flink-cdc]

2024-04-08 Thread via GitHub
joyCurry30 commented on code in PR #3187: URL: https://github.com/apache/flink-cdc/pull/3187#discussion_r1555283731 ## flink-cdc-cli/src/test/resources/definitions/pipeline-definition-full.yaml: ## @@ -53,3 +53,8 @@ pipeline: name: source-database-sync-pipe parallelism: 4

Re: [PR] [cdc-cli][cdc-composer] Applying 'flink-config' for pipeline yaml [flink-cdc]

2024-04-08 Thread via GitHub
joyCurry30 commented on code in PR #3187: URL: https://github.com/apache/flink-cdc/pull/3187#discussion_r1555283731 ## flink-cdc-cli/src/test/resources/definitions/pipeline-definition-full.yaml: ## @@ -53,3 +53,8 @@ pipeline: name: source-database-sync-pipe parallelism: 4

[jira] [Created] (FLINK-35047) Introduce ForStStateBackend

2024-04-08 Thread Hangxiang Yu (Jira)
Hangxiang Yu created FLINK-35047: Summary: Introduce ForStStateBackend Key: FLINK-35047 URL: https://issues.apache.org/jira/browse/FLINK-35047 Project: Flink Issue Type: Sub-task

Re: [PR] [FLINK-34996][Connectors/Kafka] Use UserCodeCL to instantiate Deserializer [flink-connector-kafka]

2024-04-08 Thread via GitHub
morazow commented on PR #89: URL: https://github.com/apache/flink-connector-kafka/pull/89#issuecomment-2041992850 Thanks @hugogu for the PR! I have added some comments, please have a look. Do you know why the CI is failing? -- This is an automated message from the Apache Git

[jira] [Updated] (FLINK-35047) Introduce ForStStateBackend to manage ForSt

2024-04-08 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu updated FLINK-35047: - Description: A ForStStateBackend is introduced to leverage ForSt as state store for Flink.

Re: [PR] [FLINK-34250] add config docs for formats [flink]

2024-04-08 Thread via GitHub
PatrickRen commented on code in PR #24265: URL: https://github.com/apache/flink/pull/24265#discussion_r1555343914 ## docs/content/docs/deployment/config.md: ## @@ -479,6 +479,26 @@ Flink does not use Pekko for data transport. {{< generated/akka_configuration >}} +### Flink

Re: [PR] [FLINK-34986][Runtime/State] Basic framework of async execution for state [flink]

2024-04-08 Thread via GitHub
masteryhx commented on code in PR #24614: URL: https://github.com/apache/flink/pull/24614#discussion_r1555343181 ## flink-runtime/src/main/java/org/apache/flink/runtime/asyncprocessing/KeyAccountingUnit.java: ## @@ -0,0 +1,67 @@ +/* + * Licensed to the Apache Software

[jira] [Commented] (FLINK-34250) Add formats options to docs

2024-04-08 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834818#comment-17834818 ] Qingsheng Ren commented on FLINK-34250: --- [~ZhenqiuHuang] There are already pages for formats and

[jira] [Updated] (FLINK-35044) Introduce statebackend-forst module

2024-04-08 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu updated FLINK-35044: - Component/s: Runtime / State Backends > Introduce statebackend-forst module >

[jira] [Created] (FLINK-35044) Introduce statebackend-forst module

2024-04-08 Thread Hangxiang Yu (Jira)
Hangxiang Yu created FLINK-35044: Summary: Introduce statebackend-forst module Key: FLINK-35044 URL: https://issues.apache.org/jira/browse/FLINK-35044 Project: Flink Issue Type: Sub-task

Re: [PR] [FLINK-34996][Connectors/Kafka] Use UserCodeCL to instantiate Deserializer [flink-connector-kafka]

2024-04-08 Thread via GitHub
morazow commented on code in PR #89: URL: https://github.com/apache/flink-connector-kafka/pull/89#discussion_r1555308164 ## flink-connector-kafka/src/test/java/org/apache/flink/connector/kafka/sink/KafkaSerializerWrapperTest.java: ## @@ -0,0 +1,63 @@ +package

[jira] [Updated] (FLINK-35044) Introduce statebackend-forst module

2024-04-08 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu updated FLINK-35044: - Description: A simple work to introduce a new module, then  > Introduce statebackend-forst

[jira] [Updated] (FLINK-35045) Introduce ForStFileSystem to support reading and writing with ByteBuffer

2024-04-08 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu updated FLINK-35045: - Description: As described in FLIP-427, ForStFileSystem is introduced to support reading and

[jira] [Updated] (FLINK-35023) YARNApplicationITCase failed on Azure

2024-04-08 Thread Ryan Skraba (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Skraba updated FLINK-35023: Attachment: jobmanager.log > YARNApplicationITCase failed on Azure >

[jira] [Updated] (FLINK-35047) Introduce ForStStateBackend to manage ForSt

2024-04-08 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu updated FLINK-35047: - Summary: Introduce ForStStateBackend to manage ForSt (was: Introduce ForStStateBackend) >

[jira] [Created] (FLINK-35049) Implement Async State API for ForStStateBackend

2024-04-08 Thread Hangxiang Yu (Jira)
Hangxiang Yu created FLINK-35049: Summary: Implement Async State API for ForStStateBackend Key: FLINK-35049 URL: https://issues.apache.org/jira/browse/FLINK-35049 Project: Flink Issue Type:

Re: [PR] [FLINK-34986][Runtime/State] Basic framework of async execution for state [flink]

2024-04-08 Thread via GitHub
masteryhx commented on code in PR #24614: URL: https://github.com/apache/flink/pull/24614#discussion_r1555340649 ## flink-runtime/src/main/java/org/apache/flink/runtime/asyncprocessing/StateRequest.java: ## @@ -0,0 +1,99 @@ +/* + * Licensed to the Apache Software Foundation

[jira] [Commented] (FLINK-35009) Change on getTransitivePredecessors breaks connectors

2024-04-08 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834815#comment-17834815 ] Martijn Visser commented on FLINK-35009: [~zhuzh] From a quick glance, it indeed looks like

[jira] [Created] (FLINK-35045) Introduce ForStFileSystem to support reading and writing with ByteBuffer

2024-04-08 Thread Hangxiang Yu (Jira)
Hangxiang Yu created FLINK-35045: Summary: Introduce ForStFileSystem to support reading and writing with ByteBuffer Key: FLINK-35045 URL: https://issues.apache.org/jira/browse/FLINK-35045 Project:

  1   2   3   >