Re: [PR] [FLINK-35228][Connectors/Kafka] Fix: DynamicKafkaSource does not read re-added topic for the same cluster [flink-connector-kafka]

2024-04-29 Thread via GitHub
boring-cyborg[bot] commented on PR #97: URL: https://github.com/apache/flink-connector-kafka/pull/97#issuecomment-2083840330 Awesome work, congrats on your first merged pull request! -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[jira] [Updated] (FLINK-35039) Create Profiling JobManager/TaskManager Instance failed

2024-04-29 Thread Yu Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Chen updated FLINK-35039: Attachment: image-2024-04-30-11-12-34-734.png > Create Profiling JobManager/TaskManager Instance failed >

Re: [PR] [FLINK-32002] Adjust autoscaler defaults for release [flink-kubernetes-operator]

2024-04-29 Thread via GitHub
trystanj commented on code in PR #586: URL: https://github.com/apache/flink-kubernetes-operator/pull/586#discussion_r1583828939 ## flink-kubernetes-operator-autoscaler/src/main/java/org/apache/flink/kubernetes/operator/autoscaler/config/AutoScalerOptions.java: ## @@ -68,15

Re: [PR] [FLINK-35228][Connectors/Kafka] Fix: DynamicKafkaSource does not read re-added topic for the same cluster [flink-connector-kafka]

2024-04-29 Thread via GitHub
mas-chen merged PR #97: URL: https://github.com/apache/flink-connector-kafka/pull/97 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (FLINK-35184) Hash collision inside MiniBatchStreamingJoin operator

2024-04-29 Thread dalongliu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842219#comment-17842219 ] dalongliu commented on FLINK-35184: --- [~rovboyko] Can you help create a backport pr to release-1.19? >

[jira] [Resolved] (FLINK-35184) Hash collision inside MiniBatchStreamingJoin operator

2024-04-29 Thread dalongliu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dalongliu resolved FLINK-35184. --- Resolution: Fixed > Hash collision inside MiniBatchStreamingJoin operator >

[jira] [Updated] (FLINK-35184) Hash collision inside MiniBatchStreamingJoin operator

2024-04-29 Thread dalongliu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dalongliu updated FLINK-35184: -- Fix Version/s: 1.20.0 > Hash collision inside MiniBatchStreamingJoin operator >

[jira] [Updated] (FLINK-35030) Introduce Epoch Manager for under async execution

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35030: --- Labels: pull-request-available (was: ) > Introduce Epoch Manager for under async

[PR] [FLINK-35030][runtime] Introduce Epoch Manager for under async execution [flink]

2024-04-29 Thread via GitHub
fredia opened a new pull request, #24748: URL: https://github.com/apache/flink/pull/24748 ## What is the purpose of the change This PR introduces Epoch Manager to handle watermark and watermark status processing under async execution. Epoch manager segments inputs into

Re: [PR] [BP-1.19][FLINK-34379][table] Fix OutOfMemoryError with large queries [flink]

2024-04-29 Thread via GitHub
lsyldliu merged PR #24745: URL: https://github.com/apache/flink/pull/24745 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Updated] (FLINK-35249) Support DataGeneratorSource in PyFlink

2024-04-29 Thread Wei Yuan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yuan updated FLINK-35249: - Description: I notice DataGeneratorSource with Java has submitted in

Re: [PR] [FLINK-35184][table-runtime] fix minibatch join hash collision release-1.19 [flink]

2024-04-29 Thread via GitHub
flinkbot commented on PR #24749: URL: https://github.com/apache/flink/pull/24749#issuecomment-2084336643 ## CI report: * cba2e44d01b250e2de4619ba40af17709feb4786 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-35194][table] Support describe job with job id [flink]

2024-04-29 Thread via GitHub
xuyangzhong commented on PR #24728: URL: https://github.com/apache/flink/pull/24728#issuecomment-2084076648 The doc jira is: https://issues.apache.org/jira/browse/FLINK-35271 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[jira] [Commented] (FLINK-35191) Support alter materialized table related syntaxes: suspend, resume, refresh, set and reset

2024-04-29 Thread dalongliu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842211#comment-17842211 ] dalongliu commented on FLINK-35191: --- Merged in master: 330f524d185d575ceb679a6c587e9c39612e844c >

[jira] [Resolved] (FLINK-35191) Support alter materialized table related syntaxes: suspend, resume, refresh, set and reset

2024-04-29 Thread dalongliu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dalongliu resolved FLINK-35191. --- Resolution: Fixed > Support alter materialized table related syntaxes: suspend, resume, refresh, >

[jira] [Resolved] (FLINK-35228) DynamicKafkaSource does not read re-added topic for the same cluster

2024-04-29 Thread Mason Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mason Chen resolved FLINK-35228. Resolution: Fixed CI passes > DynamicKafkaSource does not read re-added topic for the same

[PR] [FLINK-35184][table-runtime] fix minibatch join hash collision release-1.19 [flink]

2024-04-29 Thread via GitHub
rovboyko opened a new pull request, #24749: URL: https://github.com/apache/flink/pull/24749 ## What is the purpose of the change This change fixes the possible error because of hash collision in MiniBatchStreamingJoinOperator ## Brief change log Currently

Re: [PR] [BP-1.19][FLINK-32622][table-planner] Optimize mini-batch assignment (#23470) [flink]

2024-04-29 Thread via GitHub
JingGe merged PR #24746: URL: https://github.com/apache/flink/pull/24746 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (FLINK-32622) Do not add mini-batch assigner operator if it is useless

2024-04-29 Thread Jing Ge (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842242#comment-17842242 ] Jing Ge commented on FLINK-32622: - 1.19: c370b20c8e2d1ea55dd1fc4c283430832d9f9aae > Do not add

Re: [PR] [BP-1.18][FLINK-34379][table] Fix OutOfMemoryError with large queries [flink]

2024-04-29 Thread via GitHub
lsyldliu commented on PR #24744: URL: https://github.com/apache/flink/pull/24744#issuecomment-2084205892 The CI is failed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Updated] (FLINK-30586) Fix calcCodeGen failed if calc with like condition contains double quotation mark

2024-04-29 Thread Benchao Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benchao Li updated FLINK-30586: --- Fix Version/s: 1.16.1 > Fix calcCodeGen failed if calc with like condition contains double

[jira] [Commented] (FLINK-35192) operator oom

2024-04-29 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842249#comment-17842249 ] Gyula Fora commented on FLINK-35192: That makes sense [~bgeng777] this would be a good improvement

Re: [PR] [FLINK-32002] Adjust autoscaler defaults for release [flink-kubernetes-operator]

2024-04-29 Thread via GitHub
trystanj commented on code in PR #586: URL: https://github.com/apache/flink-kubernetes-operator/pull/586#discussion_r1583828939 ## flink-kubernetes-operator-autoscaler/src/main/java/org/apache/flink/kubernetes/operator/autoscaler/config/AutoScalerOptions.java: ## @@ -68,15

Re: [PR] [FLINK-34549][API] Introduce config, context and processingTimerService for DataStream API V2 [flink]

2024-04-29 Thread via GitHub
jeyhunkarimov commented on code in PR #24541: URL: https://github.com/apache/flink/pull/24541#discussion_r1583695410 ## flink-core-api/src/main/java/org/apache/flink/api/common/operators/SlotSharingGroupDescriptor.java: ## @@ -0,0 +1,238 @@ +/* + * Licensed to the Apache

Re: [PR] [FLINK-35191][table] Support alter materialized table related syntaxes: suspend, resume, refresh, set and reset [flink]

2024-04-29 Thread via GitHub
lsyldliu commented on PR #24737: URL: https://github.com/apache/flink/pull/24737#issuecomment-2084089129 Sorry for forgetting to approve, +1. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] [FLINK-35191][table] Support alter materialized table related syntaxes: suspend, resume, refresh, set and reset [flink]

2024-04-29 Thread via GitHub
lsyldliu closed pull request #24737: [FLINK-35191][table] Support alter materialized table related syntaxes: suspend, resume, refresh, set and reset URL: https://github.com/apache/flink/pull/24737 -- This is an automated message from the Apache Git Service. To respond to the message, please

Re: [PR] [FLINK-35184][table-runtime] fix minibatch join hash collision [flink]

2024-04-29 Thread via GitHub
lsyldliu closed pull request #24703: [FLINK-35184][table-runtime] fix minibatch join hash collision URL: https://github.com/apache/flink/pull/24703 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Assigned] (FLINK-35184) Hash collision inside MiniBatchStreamingJoin operator

2024-04-29 Thread dalongliu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dalongliu reassigned FLINK-35184: - Assignee: Roman Boyko > Hash collision inside MiniBatchStreamingJoin operator >

[jira] [Commented] (FLINK-35184) Hash collision inside MiniBatchStreamingJoin operator

2024-04-29 Thread dalongliu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842218#comment-17842218 ] dalongliu commented on FLINK-35184: --- Merged in master: f543cc543e9b0eb05415095190e86d3b22cdf1a4 >

Re: [PR] [FLINK-35039][rest] Use PUT method supported by YARN web proxy instead of POST [flink]

2024-04-29 Thread via GitHub
yuchen-ecnu commented on PR #24689: URL: https://github.com/apache/flink/pull/24689#issuecomment-2084282176 Hi @yeezychao , sorry for the late response. It's not enough to just change the request type on the front end, you also need to modify the type of the corresponding REST interface

Re: [PR] [FLINK-35030][runtime] Introduce Epoch Manager for under async execution [flink]

2024-04-29 Thread via GitHub
flinkbot commented on PR #24748: URL: https://github.com/apache/flink/pull/24748#issuecomment-2084288856 ## CI report: * 9f3239c4bebe6a60ae8db7892e7df1a58fc868f0 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Commented] (FLINK-34380) Strange RowKind and records about intermediate output when using minibatch join

2024-04-29 Thread Roman Boyko (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842243#comment-17842243 ] Roman Boyko commented on FLINK-34380: - [~xuyangzhong] , [~xu_shuai_] , what do you think? May I

Re: [PR] [FLINK-32002] Adjust autoscaler defaults for release [flink-kubernetes-operator]

2024-04-29 Thread via GitHub
trystanj commented on code in PR #586: URL: https://github.com/apache/flink-kubernetes-operator/pull/586#discussion_r1583828939 ## flink-kubernetes-operator-autoscaler/src/main/java/org/apache/flink/kubernetes/operator/autoscaler/config/AutoScalerOptions.java: ## @@ -68,15

Re: [PR] [FLINK-32002] Adjust autoscaler defaults for release [flink-kubernetes-operator]

2024-04-29 Thread via GitHub
trystanj commented on code in PR #586: URL: https://github.com/apache/flink-kubernetes-operator/pull/586#discussion_r1583828939 ## flink-kubernetes-operator-autoscaler/src/main/java/org/apache/flink/kubernetes/operator/autoscaler/config/AutoScalerOptions.java: ## @@ -68,15

[jira] [Updated] (FLINK-34379) table.optimizer.dynamic-filtering.enabled lead to OutOfMemoryError

2024-04-29 Thread dalongliu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dalongliu updated FLINK-34379: -- Fix Version/s: 1.19.1 > table.optimizer.dynamic-filtering.enabled lead to OutOfMemoryError >

[jira] [Created] (FLINK-35271) Add doc for syntax `describe job 'xxx'`

2024-04-29 Thread xuyang (Jira)
xuyang created FLINK-35271: -- Summary: Add doc for syntax `describe job 'xxx'` Key: FLINK-35271 URL: https://issues.apache.org/jira/browse/FLINK-35271 Project: Flink Issue Type: Sub-task

[jira] [Commented] (FLINK-35272) Pipeline Transform job supports omitting / renaming calculation column

2024-04-29 Thread yux (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842212#comment-17842212 ] yux commented on FLINK-35272: - [~renqs] I'm willing to implement this. > Pipeline Transform job supports

[jira] [Created] (FLINK-35272) Pipeline Transform job supports omitting / renaming calculation column

2024-04-29 Thread yux (Jira)
yux created FLINK-35272: --- Summary: Pipeline Transform job supports omitting / renaming calculation column Key: FLINK-35272 URL: https://issues.apache.org/jira/browse/FLINK-35272 Project: Flink Issue

[jira] [Updated] (FLINK-35228) DynamicKafkaSource does not read re-added topic for the same cluster

2024-04-29 Thread Mason Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mason Chen updated FLINK-35228: --- Fix Version/s: kafka-3.3.0 > DynamicKafkaSource does not read re-added topic for the same cluster >

[jira] [Updated] (FLINK-35039) Create Profiling JobManager/TaskManager Instance failed

2024-04-29 Thread Yu Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Chen updated FLINK-35039: Attachment: image-2024-04-30-11-14-44-335.png > Create Profiling JobManager/TaskManager Instance failed >

[jira] [Commented] (FLINK-35184) Hash collision inside MiniBatchStreamingJoin operator

2024-04-29 Thread Roman Boyko (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842232#comment-17842232 ] Roman Boyko commented on FLINK-35184: - [~lsy] , done - https://github.com/apache/flink/pull/24749 >

Re: [PR] [BP-1.17][FLINK-34379][table] Fix OutOfMemoryError with large queries [flink]

2024-04-29 Thread via GitHub
lsyldliu commented on PR #24743: URL: https://github.com/apache/flink/pull/24743#issuecomment-2084206324 The CI is failed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Commented] (FLINK-34379) table.optimizer.dynamic-filtering.enabled lead to OutOfMemoryError

2024-04-29 Thread dalongliu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842220#comment-17842220 ] dalongliu commented on FLINK-34379: --- Release-1.19: f321970111cfb6f340bd2eb0795cf24b81d583a6 >

Re: [PR] [FLINK-35165][runtime/coordination] AdaptiveBatch Scheduler should not restrict the default source parall… [flink]

2024-04-29 Thread via GitHub
venkata91 commented on PR #24736: URL: https://github.com/apache/flink/pull/24736#issuecomment-2084313431 cc @SinBex and @JunRuiLee for reviews. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Commented] (FLINK-35039) Create Profiling JobManager/TaskManager Instance failed

2024-04-29 Thread Yu Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842230#comment-17842230 ] Yu Chen commented on FLINK-35039: - Hi [~wczhu] , sorry for the late response. It does surprise me that

Re: [PR] [FLINK-32002] Adjust autoscaler defaults for release [flink-kubernetes-operator]

2024-04-29 Thread via GitHub
gyfora commented on code in PR #586: URL: https://github.com/apache/flink-kubernetes-operator/pull/586#discussion_r1584144759 ## flink-kubernetes-operator-autoscaler/src/main/java/org/apache/flink/kubernetes/operator/autoscaler/config/AutoScalerOptions.java: ## @@ -68,15

Re: [PR] [FLINK-35039][rest] Use PUT method supported by YARN web proxy instead of POST [flink]

2024-04-29 Thread via GitHub
yeezychao commented on PR #24689: URL: https://github.com/apache/flink/pull/24689#issuecomment-2084432438 Hi @yuchen-ecnu, I agreee with you,so I created issues [YARN-11691](https://issues.apache.org/jira/browse/YARN-11691) to the YARN community. -- This is an automated message from

Re: [PR] [FLINK-35223][rest] Add jobType in JobDetailsInfo related rest api [flink]

2024-04-29 Thread via GitHub
1996fanrui commented on PR #24718: URL: https://github.com/apache/flink/pull/24718#issuecomment-2081946736 Thanks @RocMarshal for the review! > Would we keep the same style typing in the commits message ? Updated, and the CI is green for now. Merging~ -- This is an

Re: [PR] [FLINK-35161][state] Implement StateExecutor for ForStStateBackend [flink]

2024-04-29 Thread via GitHub
flinkbot commented on PR #24739: URL: https://github.com/apache/flink/pull/24739#issuecomment-2082072721 ## CI report: * 751bee80d40a2f1e4a8669f514371f68730a4a0a UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Created] (FLINK-35262) Bridge between AsyncKeyedStateBackend and AsyncExecutionController

2024-04-29 Thread Hangxiang Yu (Jira)
Hangxiang Yu created FLINK-35262: Summary: Bridge between AsyncKeyedStateBackend and AsyncExecutionController Key: FLINK-35262 URL: https://issues.apache.org/jira/browse/FLINK-35262 Project: Flink

[PR] [FLINK-35262] Bridge between AsyncKeyedStateBackend and AsyncExecutionController [flink]

2024-04-29 Thread via GitHub
masteryhx opened a new pull request, #24740: URL: https://github.com/apache/flink/pull/24740 ## What is the purpose of the change Bridge between AsyncKeyedStateBackend and AsyncExecutionController, which make aec usable with StateBackend ## Brief change log

[jira] [Resolved] (FLINK-34878) [Feature][Pipeline] Flink CDC pipeline transform supports CASE WHEN

2024-04-29 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qingsheng Ren resolved FLINK-34878. --- Resolution: Fixed > [Feature][Pipeline] Flink CDC pipeline transform supports CASE WHEN >

[jira] [Assigned] (FLINK-20400) Migrate test_streaming_sql.sh

2024-04-29 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu reassigned FLINK-20400: --- Assignee: Muhammet Orazov > Migrate test_streaming_sql.sh > - > >

[jira] [Comment Edited] (FLINK-34878) [Feature][Pipeline] Flink CDC pipeline transform supports CASE WHEN

2024-04-29 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841825#comment-17841825 ] Qingsheng Ren edited comment on FLINK-34878 at 4/29/24 8:22 AM:

[jira] [Commented] (FLINK-34903) Add mysql-pipeline-connector with tables.exclude option to exclude unnecessary tables

2024-04-29 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841895#comment-17841895 ] Qingsheng Ren commented on FLINK-34903: --- flink-cdc master:

[jira] [Resolved] (FLINK-34903) Add mysql-pipeline-connector with tables.exclude option to exclude unnecessary tables

2024-04-29 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qingsheng Ren resolved FLINK-34903. --- Assignee: Thorne Resolution: Fixed > Add mysql-pipeline-connector with tables.exclude

Re: [PR] Add tables.exclude.list option [flink-cdc]

2024-04-29 Thread via GitHub
eskabetxe closed pull request #2271: Add tables.exclude.list option URL: https://github.com/apache/flink-cdc/pull/2271 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] [FLINK-35228][Connectors/Kafka] Fix: DynamicKafkaSource does not read re-added topic for the same cluster [flink-connector-kafka]

2024-04-29 Thread via GitHub
IgnasD commented on code in PR #97: URL: https://github.com/apache/flink-connector-kafka/pull/97#discussion_r1582739755 ## flink-connector-kafka/src/test/java/org/apache/flink/connector/kafka/dynamic/source/enumerator/DynamicKafkaSourceEnumeratorTest.java: ## @@ -464,6 +466,87

[jira] [Commented] (FLINK-35222) Adding getJobType for AccessExecutionGraph

2024-04-29 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841854#comment-17841854 ] Rui Fan commented on FLINK-35222: - Merged to master(1.20.0) via:

[jira] [Resolved] (FLINK-35223) Add jobType in JobDetailsInfo related rest api

2024-04-29 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan resolved FLINK-35223. - Resolution: Fixed > Add jobType in JobDetailsInfo related rest api >

[jira] [Commented] (FLINK-35224) Show the JobType on Flink WebUI

2024-04-29 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841856#comment-17841856 ] Rui Fan commented on FLINK-35224: - Merged to master(1.20.0) via:

Re: [PR] [FLINK-35194][table] Support describe job with job id [flink]

2024-04-29 Thread via GitHub
lsyldliu commented on code in PR #24728: URL: https://github.com/apache/flink/pull/24728#discussion_r1582558688 ## flink-table/flink-sql-gateway/src/main/java/org/apache/flink/table/gateway/service/operation/OperationExecutor.java: ## @@ -774,6 +777,53 @@ public ResultFetcher

Re: [PR] [FLINK-34916][table] Support `ALTER CATALOG SET` syntax [flink]

2024-04-29 Thread via GitHub
liyubin117 commented on PR #24735: URL: https://github.com/apache/flink/pull/24735#issuecomment-2081957087 @LadyForest Hi, CI passed, looking forward your review, thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

Re: [PR] [BP-3.1][FLINK-35255] DataSinkWriterOperator should override snapshotState and processWatermark method [flink-cdc]

2024-04-29 Thread via GitHub
PatrickRen merged PR #3279: URL: https://github.com/apache/flink-cdc/pull/3279 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Resolved] (FLINK-35255) DataSinkWriterOperator should override snapshotState and processWatermark method

2024-04-29 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qingsheng Ren resolved FLINK-35255. --- Resolution: Fixed > DataSinkWriterOperator should override snapshotState and

[jira] [Comment Edited] (FLINK-35255) DataSinkWriterOperator should override snapshotState and processWatermark method

2024-04-29 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841827#comment-17841827 ] Qingsheng Ren edited comment on FLINK-35255 at 4/29/24 7:24 AM:

Re: [PR] [FLINK-34902][table] Fix IndexOutOfBoundsException for VALUES [flink]

2024-04-29 Thread via GitHub
twalthr commented on code in PR #24724: URL: https://github.com/apache/flink/pull/24724#discussion_r1582644328 ## flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/calcite/FlinkCalciteSqlValidatorTest.java: ## @@ -63,6 +64,55 @@ void testInsertInto2()

Re: [PR] [FLINK-35184][table-runtime] fix minibatch join hash collision [flink]

2024-04-29 Thread via GitHub
xishuaidelin commented on PR #24703: URL: https://github.com/apache/flink/pull/24703#issuecomment-2082060777 LGTM! @lsyldliu do you have any more comments on this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] [FLINK-32084][checkpoint] Migrate current file merging of channel state snapshot into the unify file merging framework [flink]

2024-04-29 Thread via GitHub
1996fanrui commented on code in PR #24653: URL: https://github.com/apache/flink/pull/24653#discussion_r1582655229 ## flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/tasks/SubtaskCheckpointCoordinatorImpl.java: ## @@ -234,16 +230,15 @@ class

[jira] [Assigned] (FLINK-35161) Implement StateExecutor for ForStStateBackend

2024-04-29 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu reassigned FLINK-35161: Assignee: Jinzhong Li > Implement StateExecutor for ForStStateBackend >

[jira] [Created] (FLINK-35264) Flink CDC Pipeline transform rules do not take effect

2024-04-29 Thread yux (Jira)
yux created FLINK-35264: --- Summary: Flink CDC Pipeline transform rules do not take effect Key: FLINK-35264 URL: https://issues.apache.org/jira/browse/FLINK-35264 Project: Flink Issue Type: Bug

Re: [PR] [FLINK-35039][rest] Use PUT method supported by YARN web proxy instead of POST [flink]

2024-04-29 Thread via GitHub
Myasuka commented on PR #24689: URL: https://github.com/apache/flink/pull/24689#issuecomment-2082294994 @yeezychao from many tests, we can use this profiling feature in a standalone cluster on local Mac. If the Flink cluster cannot be profiled after merging your PR, I think this introduced

Re: [PR] [FLINK-34517][table]fix environment configs ignored when calling procedure operation [flink]

2024-04-29 Thread via GitHub
JustinLeesin commented on PR #24397: URL: https://github.com/apache/flink/pull/24397#issuecomment-2082005693 > > @JustinLeesin Could you please cherry pick it to release-1.19 branch? And if ci passed, please let me know > > Sorry to reply so late, I will work on it recently.

Re: [PR] [BP-3.1][minor][docs] Fix route definition example in core concept docs [flink-cdc]

2024-04-29 Thread via GitHub
PatrickRen merged PR #3270: URL: https://github.com/apache/flink-cdc/pull/3270 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Assigned] (FLINK-35048) Implement all methods of AsyncKeyedStateBakend

2024-04-29 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu reassigned FLINK-35048: Assignee: Hangxiang Yu > Implement all methods of AsyncKeyedStateBakend >

[jira] [Updated] (FLINK-35264) Flink CDC Pipeline transform rules do not take effect

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35264: --- Labels: pull-request-available (was: ) > Flink CDC Pipeline transform rules do not take

Re: [PR] [FLINK-33211][table] support flink table lineage [flink]

2024-04-29 Thread via GitHub
davidradl commented on code in PR #24618: URL: https://github.com/apache/flink/pull/24618#discussion_r1582733973 ## flink-streaming-java/src/main/java/org/apache/flink/streaming/api/transformations/OneInputTransformation.java: ## @@ -42,7 +42,7 @@ * @param The type of the

Re: [PR] [FLINK-32852][JUnit5 Migration] Migrate the scheduler package of flink-runtime module to JUnit5 [flink]

2024-04-29 Thread via GitHub
1996fanrui commented on code in PR #24732: URL: https://github.com/apache/flink/pull/24732#discussion_r1582594242 ## flink-runtime/src/test/java/org/apache/flink/runtime/scheduler/adaptive/BackgroundTaskTest.java: ## @@ -18,55 +18,52 @@ package

[jira] [Updated] (FLINK-35262) Bridge between AsyncKeyedStateBackend and AsyncExecutionController

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35262: --- Labels: pull-request-available (was: ) > Bridge between AsyncKeyedStateBackend and

[jira] [Resolved] (FLINK-35127) CDC ValuesDataSourceITCase crashed due to OutOfMemoryError

2024-04-29 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qingsheng Ren resolved FLINK-35127. --- Resolution: Fixed > CDC ValuesDataSourceITCase crashed due to OutOfMemoryError >

[jira] [Commented] (FLINK-35127) CDC ValuesDataSourceITCase crashed due to OutOfMemoryError

2024-04-29 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841894#comment-17841894 ] Qingsheng Ren commented on FLINK-35127: --- flink-cdc master:

[jira] [Commented] (FLINK-34317) Cleanup pending Flink CDC issues on GitHub

2024-04-29 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841898#comment-17841898 ] Qingsheng Ren commented on FLINK-34317: --- All issues have been imported to Jira:

[jira] [Resolved] (FLINK-34317) Cleanup pending Flink CDC issues on GitHub

2024-04-29 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qingsheng Ren resolved FLINK-34317. --- Resolution: Done > Cleanup pending Flink CDC issues on GitHub >

Re: [PR] [FLINK-33211][table] support flink table lineage [flink]

2024-04-29 Thread via GitHub
davidradl commented on code in PR #24618: URL: https://github.com/apache/flink/pull/24618#discussion_r1582722531 ## flink-streaming-java/src/main/java/org/apache/flink/streaming/api/lineage/LineageGraph.java: ## @@ -20,13 +20,12 @@ package

[jira] [Created] (FLINK-35265) Implement FlinkStateSnapshot custom resource

2024-04-29 Thread Mate Czagany (Jira)
Mate Czagany created FLINK-35265: Summary: Implement FlinkStateSnapshot custom resource Key: FLINK-35265 URL: https://issues.apache.org/jira/browse/FLINK-35265 Project: Flink Issue Type:

Re: [PR] [FLINK-35245][cdc-connector][tidb] Add metrics for flink-connector-tidb-cdc [flink-cdc]

2024-04-29 Thread via GitHub
czy006 commented on code in PR #3266: URL: https://github.com/apache/flink-cdc/pull/3266#discussion_r1582741087 ## flink-cdc-connect/flink-cdc-source-connectors/flink-connector-tidb-cdc/src/test/java/org/apache/flink/cdc/connectors/tidb/metrics/TiDBSourceMetricsTest.java: ## @@

Re: [PR] [FLINK-33211][table] support flink table lineage [flink]

2024-04-29 Thread via GitHub
davidradl commented on code in PR #24618: URL: https://github.com/apache/flink/pull/24618#discussion_r1582750064 ## flink-table/flink-table-planner/src/test/java/org/apache/flink/connector/source/ValuesSource.java: ## @@ -52,7 +60,9 @@ * must be 1. RowData is not serializable

Re: [PR] [FLINK-35223][rest] Add jobType in JobDetailsInfo related rest api [flink]

2024-04-29 Thread via GitHub
1996fanrui merged PR #24718: URL: https://github.com/apache/flink/pull/24718 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[PR] [FLINK-35161][state] Implement StateExecutor for ForStStateBackend [flink]

2024-04-29 Thread via GitHub
ljz2051 opened a new pull request, #24739: URL: https://github.com/apache/flink/pull/24739 ## What is the purpose of the change This pull request implements the StateExecutor for ForStStatebackend, which groups the remote state access to optimize performance. Please refer to

[jira] [Updated] (FLINK-35161) Implement StateExecutor for ForStStateBackend

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35161: --- Labels: pull-request-available (was: ) > Implement StateExecutor for ForStStateBackend >

[jira] [Closed] (FLINK-34185) Remove unwanted bundle dependencies

2024-04-29 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qingsheng Ren closed FLINK-34185. - Fix Version/s: cdc-3.1.0 Resolution: Fixed > Remove unwanted bundle dependencies >

[jira] [Resolved] (FLINK-34180) Accept Flink CDC project as part of Apache Flink

2024-04-29 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qingsheng Ren resolved FLINK-34180. --- Resolution: Fixed > Accept Flink CDC project as part of Apache Flink >

[jira] [Created] (FLINK-35267) Create documentation for FlinkStateSnapshot CR

2024-04-29 Thread Mate Czagany (Jira)
Mate Czagany created FLINK-35267: Summary: Create documentation for FlinkStateSnapshot CR Key: FLINK-35267 URL: https://issues.apache.org/jira/browse/FLINK-35267 Project: Flink Issue Type:

Re: [PR] [FLINK-33211][table] support flink table lineage [flink]

2024-04-29 Thread via GitHub
davidradl commented on code in PR #24618: URL: https://github.com/apache/flink/pull/24618#discussion_r1582743283 ## flink-table/flink-table-planner/src/main/java/org/apache/flink/table/planner/lineage/ModifyType.java: ## @@ -0,0 +1,34 @@ +/* + * Licensed to the Apache Software

[jira] [Updated] (FLINK-34883) Error on Postgres-CDC using incremental snapshot with UUID column as PK

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-34883: --- Labels: github-import pull-request-available (was: github-import) > Error on Postgres-CDC

Re: [PR] [FLINK-33211][table] support flink table lineage [flink]

2024-04-29 Thread via GitHub
davidradl commented on code in PR #24618: URL: https://github.com/apache/flink/pull/24618#discussion_r1582744606 ## flink-table/flink-table-planner/src/main/java/org/apache/flink/table/planner/lineage/TableColumnLineageEdge.java: ## @@ -0,0 +1,45 @@ +/* + * Licensed to the

Re: [PR] [FLINK-34954][core] Kryo Input bug fix [flink]

2024-04-29 Thread via GitHub
davidradl commented on code in PR #24586: URL: https://github.com/apache/flink/pull/24586#discussion_r1582776111 ## flink-core/src/main/java/org/apache/flink/api/java/typeutils/runtime/NoFetchingInput.java: ## @@ -73,17 +73,14 @@ protected int require(int required) throws

[jira] [Commented] (FLINK-35223) Add jobType in JobDetailsInfo related rest api

2024-04-29 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841855#comment-17841855 ] Rui Fan commented on FLINK-35223: - Merged to master(1.20.0) via:

[jira] [Resolved] (FLINK-35222) Adding getJobType for AccessExecutionGraph

2024-04-29 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan resolved FLINK-35222. - Resolution: Fixed > Adding getJobType for AccessExecutionGraph >

[jira] [Resolved] (FLINK-35224) Show the JobType on Flink WebUI

2024-04-29 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan resolved FLINK-35224. - Resolution: Fixed > Show the JobType on Flink WebUI > --- > >

  1   2   >