[jira] [Updated] (FLINK-35026) Introduce async-state configurations

2024-04-07 Thread Yanfei Lei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanfei Lei updated FLINK-35026: --- Component/s: Runtime / Configuration Runtime / Task > Introduce async-state

[jira] [Commented] (FLINK-35010) Bump org.apache.commons:commons-compress from 1.24.0 to 1.26.0 for Flink Mongodb connector

2024-04-07 Thread Zhongqiang Gong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834610#comment-17834610 ] Zhongqiang Gong commented on FLINK-35010: - +1 , It's better to bump commons-compress version to

[jira] [Updated] (FLINK-24939) Complete 'SHOW CREATE CATALOG' syntax

2024-04-07 Thread Yubin Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yubin Li updated FLINK-24939: - Summary: Complete 'SHOW CREATE CATALOG' syntax (was: Support 'SHOW CREATE CATALOG' syntax) > Complete

[jira] [Created] (FLINK-35031) Event timer firing under async execution model

2024-04-07 Thread Yanfei Lei (Jira)
Yanfei Lei created FLINK-35031: -- Summary: Event timer firing under async execution model Key: FLINK-35031 URL: https://issues.apache.org/jira/browse/FLINK-35031 Project: Flink Issue Type:

Re: [PR] [FLINK-34970] Translate architecture documents into Chinese [flink-kubernetes-operator]

2024-04-07 Thread via GitHub
1996fanrui commented on code in PR #809: URL: https://github.com/apache/flink-kubernetes-operator/pull/809#discussion_r1554829325 ## docs/content.zh/docs/concepts/architecture.md: ## @@ -24,57 +24,65 @@ specific language governing permissions and limitations under the

[jira] [Updated] (FLINK-35034) codegen compile error raised when use kafka connector and protobuf format

2024-04-07 Thread yufeng.sun (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yufeng.sun updated FLINK-35034: --- Attachment: flinksql.txt logfile.txt protofile.txt > codegen

[jira] [Created] (FLINK-35035) Reduce job pause time when cluster resources are expanded in adaptive mode

2024-04-07 Thread yuanfenghu (Jira)
yuanfenghu created FLINK-35035: -- Summary: Reduce job pause time when cluster resources are expanded in adaptive mode Key: FLINK-35035 URL: https://issues.apache.org/jira/browse/FLINK-35035 Project:

Re: [PR] [FLINK-34970] Translate architecture documents into Chinese [flink-kubernetes-operator]

2024-04-07 Thread via GitHub
1996fanrui commented on PR #809: URL: https://github.com/apache/flink-kubernetes-operator/pull/809#issuecomment-2041350690 Also, it's better to update the PR description. We can update these items or remove them if you think they are unneeded, thanks~ -- This is an automated message

[jira] [Created] (FLINK-35036) Flink CDC Job cancel with savepoint failed

2024-04-07 Thread Fly365 (Jira)
Fly365 created FLINK-35036: -- Summary: Flink CDC Job cancel with savepoint failed Key: FLINK-35036 URL: https://issues.apache.org/jira/browse/FLINK-35036 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-35028) Processing timer firing under async execution model

2024-04-07 Thread Yanfei Lei (Jira)
Yanfei Lei created FLINK-35028: -- Summary: Processing timer firing under async execution model Key: FLINK-35028 URL: https://issues.apache.org/jira/browse/FLINK-35028 Project: Flink Issue Type:

[jira] [Updated] (FLINK-35026) Introduce async execution configurations

2024-04-07 Thread Yanfei Lei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanfei Lei updated FLINK-35026: --- Summary: Introduce async execution configurations (was: Introduce async-state configurations) >

[jira] [Commented] (FLINK-32070) FLIP-306 Unified File Merging Mechanism for Checkpoints

2024-04-07 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834636#comment-17834636 ] xiaogang zhou commented on FLINK-32070: --- [~Zakelly] yes, sounds good, Let me take a look  >

[jira] [Created] (FLINK-35029) Store timer in JVM heap when async execution enabled

2024-04-07 Thread Yanfei Lei (Jira)
Yanfei Lei created FLINK-35029: -- Summary: Store timer in JVM heap when async execution enabled Key: FLINK-35029 URL: https://issues.apache.org/jira/browse/FLINK-35029 Project: Flink Issue Type:

[jira] [Updated] (FLINK-35034) codegen compile error raised when use kafka connector and protobuf format

2024-04-07 Thread yufeng.sun (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yufeng.sun updated FLINK-35034: --- Description: The following error messages and stack were encountered When i using Flink SQL with

[jira] [Updated] (FLINK-35035) Reduce job pause time when cluster resources are expanded in adaptive mode

2024-04-07 Thread yuanfenghu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuanfenghu updated FLINK-35035: --- Description: When 'jobmanager.scheduler = adaptive' , job graph changes triggered by cluster

Re: [PR] [FLINK-34952][cdc-composer][sink] Flink CDC pipeline supports SinkFunction [flink-cdc]

2024-04-07 Thread via GitHub
PatrickRen commented on code in PR #3204: URL: https://github.com/apache/flink-cdc/pull/3204#discussion_r1554855153 ##

Re: [PR] [hotfix] Fix YARN ContainerId.getId Deprecated Used. [flink]

2024-04-07 Thread via GitHub
slfan1989 commented on PR #24601: URL: https://github.com/apache/flink/pull/24601#issuecomment-2041389025 @1996fanrui Thank you very much for reviewing the code! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] [FLINK-34952][cdc-composer][sink] Flink CDC pipeline supports SinkFunction [flink-cdc]

2024-04-07 Thread via GitHub
loserwang1024 commented on code in PR #3204: URL: https://github.com/apache/flink-cdc/pull/3204#discussion_r1554863395 ##

[jira] [Updated] (FLINK-34915) Complete `DESCRIBE CATALOG` syntax

2024-04-07 Thread Yubin Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yubin Li updated FLINK-34915: - Summary: Complete `DESCRIBE CATALOG` syntax (was: Support `DESCRIBE CATALOG` syntax) > Complete

[jira] [Updated] (FLINK-24939) Support 'SHOW CREATE CATALOG' syntax

2024-04-07 Thread Yubin Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yubin Li updated FLINK-24939: - Summary: Support 'SHOW CREATE CATALOG' syntax (was: Complete 'SHOW CREATE CATALOG' syntax) > Support

[jira] [Commented] (FLINK-32070) FLIP-306 Unified File Merging Mechanism for Checkpoints

2024-04-07 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834620#comment-17834620 ] Zakelly Lan commented on FLINK-32070: - [~zhoujira86] The checkpointing part (without restoration

Re: [PR] [pipeline-connector][paimon] add paimon pipeline data sink connector. [flink-cdc]

2024-04-07 Thread via GitHub
yuxiqian commented on code in PR #2916: URL: https://github.com/apache/flink-cdc/pull/2916#discussion_r1549282669 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-paimon/src/main/java/org/apache/flink/cdc/connectors/paimon/sink/PaimonDataSinkFactory.java:

[jira] [Updated] (FLINK-35034) codegen compile error raised when use kafka connector and protobuf format

2024-04-07 Thread yufeng.sun (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yufeng.sun updated FLINK-35034: --- Description: The following error messages and stack were encountered When i using Flink SQL with

Re: [PR] [FLINK-34712][release] Generate reference data for state migration tests based on release-1.19.0 [flink]

2024-04-07 Thread via GitHub
lincoln-lil merged PR #24594: URL: https://github.com/apache/flink/pull/24594 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (FLINK-35023) YARNApplicationITCase failed on Azure

2024-04-07 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834639#comment-17834639 ] Weijie Guo commented on FLINK-35023:

[jira] [Comment Edited] (FLINK-35023) YARNApplicationITCase failed on Azure

2024-04-07 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834639#comment-17834639 ] Weijie Guo edited comment on FLINK-35023 at 4/7/24 9:24 AM: jdk17:

[jira] [Comment Edited] (FLINK-32070) FLIP-306 Unified File Merging Mechanism for Checkpoints

2024-04-07 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834609#comment-17834609 ] xiaogang zhou edited comment on FLINK-32070 at 4/7/24 6:36 AM: --- Is there

Re: [PR] [FLINK-35006] Use try with-resource for StandaloneAutoscalerExecutor [flink-kubernetes-operator]

2024-04-07 Thread via GitHub
1996fanrui commented on code in PR #811: URL: https://github.com/apache/flink-kubernetes-operator/pull/811#discussion_r1554828200 ## flink-autoscaler-standalone/src/main/java/org/apache/flink/autoscaler/standalone/StandaloneAutoscalerEntrypoint.java: ## @@ -60,9 +60,11 @@

[jira] [Created] (FLINK-35030) Introduce Epoch Manager for watermark under async execution

2024-04-07 Thread Yanfei Lei (Jira)
Yanfei Lei created FLINK-35030: -- Summary: Introduce Epoch Manager for watermark under async execution Key: FLINK-35030 URL: https://issues.apache.org/jira/browse/FLINK-35030 Project: Flink

[jira] [Updated] (FLINK-35034) codegen compile error raised when use kafka connector and protobuf format

2024-04-07 Thread yufeng.sun (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yufeng.sun updated FLINK-35034: --- Description: The following error messages and stack were encountered When i using Flink SQL with

[jira] [Created] (FLINK-35034) codegen compile error raised when use kafka connector and protobuf format

2024-04-07 Thread yufeng.sun (Jira)
yufeng.sun created FLINK-35034: -- Summary: codegen compile error raised when use kafka connector and protobuf format Key: FLINK-35034 URL: https://issues.apache.org/jira/browse/FLINK-35034 Project: Flink

Re: [PR] [FLINK-34634]Fix that Restarting the job will not read the changelog anymore if it stops before the synchronization of meta information is complete and some table is removed [flink-cdc]

2024-04-07 Thread via GitHub
ruanhang1993 commented on code in PR #3134: URL: https://github.com/apache/flink-cdc/pull/3134#discussion_r1554839652 ## flink-cdc-connect/flink-cdc-source-connectors/flink-cdc-base/src/main/java/org/apache/flink/cdc/connectors/base/source/enumerator/IncrementalSourceEnumerator.java:

[jira] [Commented] (FLINK-34712) Update reference data for Migration Tests

2024-04-07 Thread lincoln lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834634#comment-17834634 ] lincoln lee commented on FLINK-34712: - fixed in 1.19: 4397c9f1d0f300bd8c0f9de4e59e1a5d7883ec2c >

Re: [PR] [FLINK-34959] Update old flink-cdc-connectors artifactId [flink-cdc]

2024-04-07 Thread via GitHub
PatrickRen merged PR #3200: URL: https://github.com/apache/flink-cdc/pull/3200 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (FLINK-34959) Update old flink-cdc-connectors artifactId

2024-04-07 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834638#comment-17834638 ] Qingsheng Ren commented on FLINK-34959: --- cdc-master: 6510e670faa154d619937d97dc3f146eb162fac2 >

[jira] [Resolved] (FLINK-34959) Update old flink-cdc-connectors artifactId

2024-04-07 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qingsheng Ren resolved FLINK-34959. --- Resolution: Fixed > Update old flink-cdc-connectors artifactId >

Re: [PR] [cdc-connector][cdc-base] Shade guava31 to avoid dependency conflict with flink below 1.18 [flink-cdc]

2024-04-07 Thread via GitHub
PatrickRen commented on code in PR #3083: URL: https://github.com/apache/flink-cdc/pull/3083#discussion_r1554857536 ## pom.xml: ## @@ -462,8 +462,15 @@ under the License. submodules, ${flink.version} will be resolved as the actual Flink

[jira] [Created] (FLINK-35027) Implement checkpoint drain in AsyncExecutionController

2024-04-07 Thread Yanfei Lei (Jira)
Yanfei Lei created FLINK-35027: -- Summary: Implement checkpoint drain in AsyncExecutionController Key: FLINK-35027 URL: https://issues.apache.org/jira/browse/FLINK-35027 Project: Flink Issue

[jira] [Commented] (FLINK-34995) flink kafka connector source stuck when partition leader invalid

2024-04-07 Thread yansuopeng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834629#comment-17834629 ] yansuopeng commented on FLINK-34995: https://github.com/apache/flink-connector-kafka/pull/91 >

[jira] [Updated] (FLINK-35027) Implement checkpoint drain in AsyncExecutionController

2024-04-07 Thread Yanfei Lei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanfei Lei updated FLINK-35027: --- Component/s: Runtime / Checkpointing > Implement checkpoint drain in AsyncExecutionController >

[jira] [Updated] (FLINK-35025) Wire AsyncExecutionController to AbstractStreamOperator

2024-04-07 Thread Yanfei Lei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanfei Lei updated FLINK-35025: --- Component/s: Runtime / Task > Wire AsyncExecutionController to AbstractStreamOperator >

Re: [PR] [pipeline-connector][paimon] add paimon pipeline data sink connector. [flink-cdc]

2024-04-07 Thread via GitHub
yuxiqian commented on code in PR #2916: URL: https://github.com/apache/flink-cdc/pull/2916#discussion_r1549225693 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-paimon/src/main/java/org/apache/flink/cdc/connectors/paimon/sink/v2/PaimonWriter.java:

[PR] [hotfix][doc] Generate and use docs of RpcOptions instead of AkkaOptions [flink]

2024-04-07 Thread via GitHub
Zakelly opened a new pull request, #24629: URL: https://github.com/apache/flink/pull/24629 ## What is the purpose of the change Currently, when re-generating docs on master branch, the `rpc_configuration.html` is generated. The `AkkaOptions` is renamed to `RpcOptions` via

Re: [PR] [FLINK-34908][pipeline-connector][doris] Fix Mysql pipeline to doris will lost precision for timestamp [flink-cdc]

2024-04-07 Thread via GitHub
yuxiqian commented on PR #3207: URL: https://github.com/apache/flink-cdc/pull/3207#issuecomment-2041372727 I wonder if changing `DorisEventSerializer.DATE_TIME_FORMATTER` to `-MM-dd HH:mm:ss.SS` would fix this problem, too? -- This is an automated message from the Apache Git

[jira] [Commented] (FLINK-32070) FLIP-306 Unified File Merging Mechanism for Checkpoints

2024-04-07 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834609#comment-17834609 ] xiaogang zhou commented on FLINK-32070: --- Is there any Branch I can view do a POC? And I think if

[jira] [Assigned] (FLINK-35006) Use try with-resource for StandaloneAutoscalerExecutor

2024-04-07 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan reassigned FLINK-35006: --- Assignee: Kirill Plugatarev > Use try with-resource for StandaloneAutoscalerExecutor >

Re: [PR] [pipeline-connector][paimon] add paimon pipeline data sink connector. [flink-cdc]

2024-04-07 Thread via GitHub
yuxiqian commented on code in PR #2916: URL: https://github.com/apache/flink-cdc/pull/2916#discussion_r1554819937 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-paimon/src/main/java/org/apache/flink/cdc/connectors/paimon/sink/v2/PaimonWriterHelper.java:

Re: [PR] [FLINK-34995] flink kafka connector source stuck when partition leade… [flink-connector-kafka]

2024-04-07 Thread via GitHub
boring-cyborg[bot] commented on PR #91: URL: https://github.com/apache/flink-connector-kafka/pull/91#issuecomment-2041355545 Thanks for opening this pull request! Please check out our contributing guidelines. (https://flink.apache.org/contributing/how-to-contribute.html) -- This is

[jira] [Updated] (FLINK-34995) flink kafka connector source stuck when partition leader invalid

2024-04-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-34995: --- Labels: pull-request-available (was: ) > flink kafka connector source stuck when partition

[PR] [FLINK-34995] flink kafka connector source stuck when partition leade… [flink-connector-kafka]

2024-04-07 Thread via GitHub
yanspirit opened a new pull request, #91: URL: https://github.com/apache/flink-connector-kafka/pull/91 when partition leader invalid(leader=-1),  the flink streaming job using KafkaSource can't restart or start a new instance with a new groupid,  it will stuck and got following exception:

[jira] [Closed] (FLINK-34712) Update reference data for Migration Tests

2024-04-07 Thread lincoln lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lincoln lee closed FLINK-34712. --- Resolution: Fixed > Update reference data for Migration Tests >

[jira] [Comment Edited] (FLINK-34712) Update reference data for Migration Tests

2024-04-07 Thread lincoln lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834634#comment-17834634 ] lincoln lee edited comment on FLINK-34712 at 4/7/24 8:53 AM: - fixed in 1.19:

[jira] [Assigned] (FLINK-34959) Update old flink-cdc-connectors artifactId

2024-04-07 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qingsheng Ren reassigned FLINK-34959: - Assignee: xleoken > Update old flink-cdc-connectors artifactId >

[jira] [Updated] (FLINK-35034) codegen compile error raised when use kafka connector and protobuf format

2024-04-07 Thread yufeng.sun (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yufeng.sun updated FLINK-35034: --- Description: The following error messages and stack were encountered When i using Flink SQL with

[jira] [Updated] (FLINK-35035) Reduce job pause time when cluster resources are expanded in adaptive mode

2024-04-07 Thread yuanfenghu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuanfenghu updated FLINK-35035: --- Description: When 'jobmanager.scheduler = adaptive' , job graph changes triggered by cluster

Re: [PR] [hotfix][doc] Generate and use docs of RpcOptions instead of AkkaOptions [flink]

2024-04-07 Thread via GitHub
flinkbot commented on PR #24629: URL: https://github.com/apache/flink/pull/24629#issuecomment-2041363992 ## CI report: * 1eeedee02ccdb674b5b2598bec8531e8eac49bf9 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-34712][release] Generate reference data for state migration tests based on release-1.19.0 [flink]

2024-04-07 Thread via GitHub
lincoln-lil merged PR #24517: URL: https://github.com/apache/flink/pull/24517 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] [FLINK-31664] Implement ARRAY_INTERSECT function [flink]

2024-04-07 Thread via GitHub
liuyongvs commented on PR #24526: URL: https://github.com/apache/flink/pull/24526#issuecomment-2041370638 hi @MartijnVisser -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[PR] [FLINK-34915][table] Complete `DESCRIBE CATALOG` syntax [flink]

2024-04-07 Thread via GitHub
liyubin117 opened a new pull request, #24630: URL: https://github.com/apache/flink/pull/24630 ## What is the purpose of the change Describe the metadata of an existing catalog. The metadata information includes the catalog’s name, type, and comment. If the optional EXTENDED option

[jira] [Updated] (FLINK-34915) Complete `DESCRIBE CATALOG` syntax

2024-04-07 Thread Yubin Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yubin Li updated FLINK-34915: - Attachment: image-2024-04-07-17-54-51-203.png Description: Describe the metadata of an existing

[jira] [Updated] (FLINK-35037) Optimize uniqueKeys and upsertKeys inference of windows with ROW_NUMBER

2024-04-07 Thread yisha zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yisha zhou updated FLINK-35037: --- Description: In current Implementation, relNodes with Window type will only deliver upsert/unique

Re: [PR] [FLINK-34915][table] Complete `DESCRIBE CATALOG` syntax [flink]

2024-04-07 Thread via GitHub
liyubin117 commented on PR #24630: URL: https://github.com/apache/flink/pull/24630#issuecomment-2041527525 @LadyForest Hi, CI passed now, Looking forward your review, Thanks very much :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[jira] [Created] (FLINK-35037) Optimize uniqueKeys and upsertKeys inference of windows with ROW_NUMBER

2024-04-07 Thread yisha zhou (Jira)
yisha zhou created FLINK-35037: -- Summary: Optimize uniqueKeys and upsertKeys inference of windows with ROW_NUMBER Key: FLINK-35037 URL: https://issues.apache.org/jira/browse/FLINK-35037 Project: Flink

Re: [PR] [FLINK-34986][Runtime/State] Basic framework of async execution for state [flink]

2024-04-07 Thread via GitHub
ljz2051 commented on code in PR #24614: URL: https://github.com/apache/flink/pull/24614#discussion_r1554960979 ## flink-runtime/src/main/java/org/apache/flink/runtime/asyncprocessing/StateRequest.java: ## @@ -0,0 +1,99 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[jira] [Created] (FLINK-35038) Bump test dependency org.yaml:snakeyaml to 2.2

2024-04-07 Thread Ufuk Celebi (Jira)
Ufuk Celebi created FLINK-35038: --- Summary: Bump test dependency org.yaml:snakeyaml to 2.2 Key: FLINK-35038 URL: https://issues.apache.org/jira/browse/FLINK-35038 Project: Flink Issue Type:

[jira] [Updated] (FLINK-34915) Complete `DESCRIBE CATALOG` syntax

2024-04-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-34915: --- Labels: pull-request-available (was: ) > Complete `DESCRIBE CATALOG` syntax >

Re: [PR] [FLINK-34915][table] Complete `DESCRIBE CATALOG` syntax [flink]

2024-04-07 Thread via GitHub
flinkbot commented on PR #24630: URL: https://github.com/apache/flink/pull/24630#issuecomment-2041394595 ## CI report: * a1146244ce8a490c2ca1557f4c2410b59effb333 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-32440][checkpoint] Introduce file merging configurations [flink]

2024-04-07 Thread via GitHub
fredia commented on PR #22973: URL: https://github.com/apache/flink/pull/22973#issuecomment-2041450107 @Zakelly I have rebased this PR, could you please take a look if you're free? thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log

[jira] [Commented] (FLINK-34955) Upgrade commons-compress to 1.26.0

2024-04-07 Thread Zhongqiang Gong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834678#comment-17834678 ] Zhongqiang Gong commented on FLINK-34955: - [~slfan1989] [~mbalassi] According to

[jira] [Commented] (FLINK-34955) Upgrade commons-compress to 1.26.0

2024-04-07 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834681#comment-17834681 ] Shilun Fan commented on FLINK-34955: [~gongzhongqiang] From my personal perspective, I believe

[jira] [Comment Edited] (FLINK-34955) Upgrade commons-compress to 1.26.0

2024-04-07 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834682#comment-17834682 ] Shilun Fan edited comment on FLINK-34955 at 4/7/24 2:17 PM:

Re: [PR] [FLINK-34915][table] Complete `DESCRIBE CATALOG` syntax [flink]

2024-04-07 Thread via GitHub
liyubin117 commented on PR #24630: URL: https://github.com/apache/flink/pull/24630#issuecomment-2041411609 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] [FLINK-34969][cdc-cli]Add support for both new and old Flink config files in Flink… [flink-cdc]

2024-04-07 Thread via GitHub
PatrickRen commented on code in PR #3194: URL: https://github.com/apache/flink-cdc/pull/3194#discussion_r1554892220 ## flink-cdc-cli/src/main/java/org/apache/flink/cdc/cli/utils/FlinkEnvironmentUtils.java: ## @@ -20,18 +20,33 @@ import

[jira] [Updated] (FLINK-35037) Optimize uniqueKeys and upsertKeys inference of windows with ROW_NUMBER

2024-04-07 Thread yisha zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yisha zhou updated FLINK-35037: --- Description: In current Implementation, relNodes with Window type will only deliver upsert/unique

[jira] [Commented] (FLINK-34955) Upgrade commons-compress to 1.26.0

2024-04-07 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834682#comment-17834682 ] Shilun Fan commented on FLINK-34955: [~gongzhongqiang] Of course, if upgrading is possible, it would

[jira] [Commented] (FLINK-34898) Cannot create ARRAY of named STRUCTs

2024-04-07 Thread Feng Jin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834685#comment-17834685 ] Feng Jin commented on FLINK-34898: -- [~chloehe]   Thank you for the update, sorry for the late reply.

Re: [PR] [FLINK-34908][pipeline-connector][doris] Fix Mysql pipeline to doris will lost precision for timestamp [flink-cdc]

2024-04-07 Thread via GitHub
gong commented on PR #3207: URL: https://github.com/apache/flink-cdc/pull/3207#issuecomment-2041406982 > I wonder if changing `DorisEventSerializer.DATE_TIME_FORMATTER` to `-MM-dd HH:mm:ss.SS` fixes this problem, too? @yuxiqian I think that it can fix this problem, too. --

Re: [PR] [FLINK-35010][connectors/mongodb] Bump org.apache.commons:commons-compress from 1.24.0 to 1.26.0 for Flink Mongodb connector [flink-connector-mongodb]

2024-04-07 Thread via GitHub
GOODBOY008 commented on PR #32: URL: https://github.com/apache/flink-connector-mongodb/pull/32#issuecomment-2041478551 @Jiabao-Sun PR updated and version to `1.26.1`. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[jira] [Updated] (FLINK-34898) Cannot create ARRAY of named STRUCTs

2024-04-07 Thread Feng Jin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feng Jin updated FLINK-34898: - Attachment: 截屏2024-04-07 22.05.40.png > Cannot create ARRAY of named STRUCTs >

Re: [PR] [hotfix][doc] Generate and use docs of RpcOptions instead of AkkaOptions [flink]

2024-04-07 Thread via GitHub
Zakelly commented on PR #24629: URL: https://github.com/apache/flink/pull/24629#issuecomment-2041409660 @XComp Would you please take a look? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] [FLINK-34986][Runtime/State] Basic framework of async execution for state [flink]

2024-04-07 Thread via GitHub
Zakelly commented on code in PR #24614: URL: https://github.com/apache/flink/pull/24614#discussion_r1554965456 ## flink-runtime/src/main/java/org/apache/flink/runtime/asyncprocessing/StateRequest.java: ## @@ -0,0 +1,99 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

Re: [PR] [FLINK-35006] Use try with-resource for StandaloneAutoscalerExecutor [flink-kubernetes-operator]

2024-04-07 Thread via GitHub
plugatarev commented on code in PR #811: URL: https://github.com/apache/flink-kubernetes-operator/pull/811#discussion_r1555135563 ## flink-autoscaler-standalone/src/main/java/org/apache/flink/autoscaler/standalone/StandaloneAutoscalerEntrypoint.java: ## @@ -60,9 +60,11 @@

[jira] [Closed] (FLINK-34573) the task is stuck on the high presure

2024-04-07 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo closed FLINK-34573. -- Resolution: Won't Fix > the task is stuck on the high presure > -

[jira] [Commented] (FLINK-35036) Flink CDC Job cancel with savepoint failed

2024-04-07 Thread Biao Geng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834749#comment-17834749 ] Biao Geng commented on FLINK-35036: --- Hi [~fly365], according to the attached screenshot, the failure

Re: [PR] [FLINK-34487][ci] Adds Python Wheels nightly GHA workflow [flink]

2024-04-07 Thread via GitHub
morazow commented on PR #24426: URL: https://github.com/apache/flink/pull/24426#issuecomment-2041795538 Thanks @XComp, I am going to address your suggestions. Please have a look once you are back -- This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Updated] (FLINK-35040) The performance of serializerHeavyString regresses since April 3

2024-04-07 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan updated FLINK-35040: Description: The performance of serializerHeavyString regresses since April 3, and had not yet recovered

Re: [PR] [FLINK-35006] Use try with-resource for StandaloneAutoscalerExecutor [flink-kubernetes-operator]

2024-04-07 Thread via GitHub
plugatarev closed pull request #811: [FLINK-35006] Use try with-resource for StandaloneAutoscalerExecutor URL: https://github.com/apache/flink-kubernetes-operator/pull/811 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[jira] [Closed] (FLINK-35006) Use try with-resource for StandaloneAutoscalerExecutor

2024-04-07 Thread Kirill Plugatarev (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Plugatarev closed FLINK-35006. - Resolution: Not A Problem > Use try with-resource for StandaloneAutoscalerExecutor >

Re: [PR] [hotfix] Correct the option key for sortPartition's java doc [flink]

2024-04-07 Thread via GitHub
reswqa merged PR #24627: URL: https://github.com/apache/flink/pull/24627 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (FLINK-35009) Change on getTransitivePredecessors breaks connectors

2024-04-07 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834751#comment-17834751 ] Weijie Guo commented on FLINK-35009: This change can be done in a compatible way. But one could

[jira] [Comment Edited] (FLINK-35009) Change on getTransitivePredecessors breaks connectors

2024-04-07 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834751#comment-17834751 ] Weijie Guo edited comment on FLINK-35009 at 4/8/24 2:13 AM: This change can

Re: [PR] [FLINK-33984][runtime] Support batch snapshot for OperatorCoordinator. [flink]

2024-04-07 Thread via GitHub
zhuzhurk closed pull request #24415: [FLINK-33984][runtime] Support batch snapshot for OperatorCoordinator. URL: https://github.com/apache/flink/pull/24415 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[jira] [Commented] (FLINK-35039) Create Profiling JobManager/TaskManager Instance failed

2024-04-07 Thread JJJJude (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834758#comment-17834758 ] ude commented on FLINK-35039: - [~Yu Chen] Please have a look, If my modification plan is fine,

Re: [PR] [FLINK-34487][ci] Adds Python Wheels nightly GHA workflow [flink]

2024-04-07 Thread via GitHub
morazow commented on code in PR #24426: URL: https://github.com/apache/flink/pull/24426#discussion_r1555166750 ## .github/workflows/template.python-wheels-ci.yml: ## @@ -0,0 +1,67 @@ +# Licensed to the Apache Software Foundation (ASF) under one or more +# contributor license

[jira] [Commented] (FLINK-33934) Flink SQL Source use raw format maybe lead to data lost

2024-04-07 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834765#comment-17834765 ] Yun Tang commented on FLINK-33934: -- I think it's easy to let data lost when using {{raw}} format with

[jira] [Commented] (FLINK-34966) Support to read snapshot by table partitions in MySQL CDC Source

2024-04-07 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834756#comment-17834756 ] Qingsheng Ren commented on FLINK-34966: --- [~wanghe] Could you provide some context in the

[jira] [Created] (FLINK-35039) Create Profiling JobManager/TaskManager Instance failed

2024-04-07 Thread JJJJude (Jira)
ude created FLINK-35039: --- Summary: Create Profiling JobManager/TaskManager Instance failed Key: FLINK-35039 URL: https://issues.apache.org/jira/browse/FLINK-35039 Project: Flink Issue Type:

Re: [PR] [FLINK-34986][Runtime/State] Basic framework of async execution for state [flink]

2024-04-07 Thread via GitHub
fredia commented on code in PR #24614: URL: https://github.com/apache/flink/pull/24614#discussion_r1555208732 ## flink-runtime/src/main/java/org/apache/flink/runtime/asyncprocessing/StateRequest.java: ## @@ -0,0 +1,99 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[jira] [Assigned] (FLINK-33986) Extend shuffleMaster to support batch snapshot.

2024-04-07 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-33986: --- Assignee: Junrui Li > Extend shuffleMaster to support batch snapshot. >

[jira] [Commented] (FLINK-35036) Flink CDC Job cancel with savepoint failed

2024-04-07 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834755#comment-17834755 ] Qingsheng Ren commented on FLINK-35036: --- [~fly365] Thanks for reporting the issue! I agree with

  1   2   >