[jira] [Assigned] (FLINK-34937) Apache Infra GHA policy update

2024-05-02 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl reassigned FLINK-34937: - Assignee: Matthias Pohl > Apache Infra GHA policy update >

Re: [PR] [FLINK-34369][connectors/elasticsearch] Elasticsearch connector supports SSL context [flink-connector-elasticsearch]

2024-05-02 Thread via GitHub
liuml07 commented on PR #91: URL: https://github.com/apache/flink-connector-elasticsearch/pull/91#issuecomment-2092337019 Thanks for reviewing and your approval. Could you help merge this @reta? -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [PR] [FLINK-35176][Connector/JDBC] Support property authentication connection for JDBC catalog & dynamic table [flink-connector-jdbc]

2024-05-02 Thread via GitHub
RocMarshal commented on PR #116: URL: https://github.com/apache/flink-connector-jdbc/pull/116#issuecomment-2092246949 Thanks @eskabetxe for the comments. Updated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[jira] [Updated] (FLINK-35286) Cannot discover Hive connector outside Hive catalog

2024-05-02 Thread Ryan Goldenberg (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Goldenberg updated FLINK-35286: Description: *Problem* Referencing tables with the 'hive' connector outside of

[jira] [Created] (FLINK-35286) Cannot discover Hive connector outside Hive catalog

2024-05-02 Thread Ryan Goldenberg (Jira)
Ryan Goldenberg created FLINK-35286: --- Summary: Cannot discover Hive connector outside Hive catalog Key: FLINK-35286 URL: https://issues.apache.org/jira/browse/FLINK-35286 Project: Flink

Re: [PR] [FLINK-33306] Use observed source throughput as true processing rate [flink-kubernetes-operator]

2024-05-02 Thread via GitHub
trystanj commented on code in PR #686: URL: https://github.com/apache/flink-kubernetes-operator/pull/686#discussion_r1588463242 ## flink-autoscaler/src/main/java/org/apache/flink/autoscaler/ScalingMetricEvaluator.java: ## @@ -154,6 +153,56 @@ private Map evaluateMetrics(

Re: [PR] [FLINK-33306] Use observed source throughput as true processing rate [flink-kubernetes-operator]

2024-05-02 Thread via GitHub
trystanj commented on code in PR #686: URL: https://github.com/apache/flink-kubernetes-operator/pull/686#discussion_r1588463242 ## flink-autoscaler/src/main/java/org/apache/flink/autoscaler/ScalingMetricEvaluator.java: ## @@ -154,6 +153,56 @@ private Map evaluateMetrics(

Re: [PR] [FLINK-33306] Use observed source throughput as true processing rate [flink-kubernetes-operator]

2024-05-02 Thread via GitHub
trystanj commented on code in PR #686: URL: https://github.com/apache/flink-kubernetes-operator/pull/686#discussion_r1588463242 ## flink-autoscaler/src/main/java/org/apache/flink/autoscaler/ScalingMetricEvaluator.java: ## @@ -154,6 +153,56 @@ private Map evaluateMetrics(

Re: [PR] [FLINK-33306] Use observed source throughput as true processing rate [flink-kubernetes-operator]

2024-05-02 Thread via GitHub
trystanj commented on code in PR #686: URL: https://github.com/apache/flink-kubernetes-operator/pull/686#discussion_r1588463242 ## flink-autoscaler/src/main/java/org/apache/flink/autoscaler/ScalingMetricEvaluator.java: ## @@ -154,6 +153,56 @@ private Map evaluateMetrics(

Re: [PR] Add release announcement for Flink CDC 3.1.0 [flink-web]

2024-05-02 Thread via GitHub
morazow commented on code in PR #739: URL: https://github.com/apache/flink-web/pull/739#discussion_r1588306116 ## docs/content/posts/2024-MM-DD-release-cdc-3.1.0.md: ## @@ -0,0 +1,67 @@ +--- +title: "Apache Flink CDC 3.1.0 Release Announcement" +date:

[jira] [Commented] (FLINK-35285) Autoscaler key group optimization can interfere with scale-down.max-factor

2024-05-02 Thread Trystan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17843022#comment-17843022 ] Trystan commented on FLINK-35285: - If this is deemed an actual bug, I'd be happy to submit a PR >

[jira] [Updated] (FLINK-35285) Autoscaler key group optimization can interfere with scale-down.max-factor

2024-05-02 Thread Trystan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Trystan updated FLINK-35285: Description: When setting a less aggressive scale down limit, the key group optimization can prevent a

[jira] [Updated] (FLINK-35285) Autoscaler key group optimization can interfere with scale-down.max-factor

2024-05-02 Thread Trystan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Trystan updated FLINK-35285: Description: When setting a less aggressive scale down limit, the key group optimization can prevent a

[jira] [Updated] (FLINK-35285) Autoscaler key group optimization can interfere with scale-down.max-factor

2024-05-02 Thread Trystan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Trystan updated FLINK-35285: Description: When setting a less aggressive scale down limit, the key group optimization can prevent a

[jira] [Created] (FLINK-35285) Autoscaler key group optimization can interfere with scale-down.max-factor

2024-05-02 Thread Trystan (Jira)
Trystan created FLINK-35285: --- Summary: Autoscaler key group optimization can interfere with scale-down.max-factor Key: FLINK-35285 URL: https://issues.apache.org/jira/browse/FLINK-35285 Project: Flink

[jira] [Updated] (FLINK-35285) Autoscaler key group optimization can interfere with scale-down.max-factor

2024-05-02 Thread Trystan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Trystan updated FLINK-35285: Component/s: Kubernetes Operator > Autoscaler key group optimization can interfere with

[jira] [Commented] (FLINK-35041) IncrementalRemoteKeyedStateHandleTest.testSharedStateReRegistration failed

2024-05-02 Thread Ryan Skraba (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17843018#comment-17843018 ] Ryan Skraba commented on FLINK-35041: - 1.20 test_cron_hadoop313 core

[jira] [Commented] (FLINK-34273) git fetch fails

2024-05-02 Thread Ryan Skraba (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17843017#comment-17843017 ] Ryan Skraba commented on FLINK-34273: - 1.20 test_cron_adaptive_scheduler tests

[jira] [Created] (FLINK-35284) Streaming File Sink end-to-end test times out

2024-05-02 Thread Ryan Skraba (Jira)
Ryan Skraba created FLINK-35284: --- Summary: Streaming File Sink end-to-end test times out Key: FLINK-35284 URL: https://issues.apache.org/jira/browse/FLINK-35284 Project: Flink Issue Type: Bug

Re: [PR] [FLINK-35149][cdc-composer] Fix DataSinkTranslator#sinkTo ignoring pre-write topology if not TwoPhaseCommittingSink [flink-cdc]

2024-05-02 Thread via GitHub
pvary commented on PR #3233: URL: https://github.com/apache/flink-cdc/pull/3233#issuecomment-2090855121 > > Could you please add a test case to prevent later code changes to revert this fix? > > I'd like to, but it seems no pipeline sink which is WithPreWriteTopology but not

[PR] [FLINK-21373] Add RabbitMQ SinkV2 Implementation, Port Flink version to Flink 1.19 [flink-connector-rabbitmq]

2024-05-02 Thread via GitHub
vahmed-hamdy opened a new pull request, #29: URL: https://github.com/apache/flink-connector-rabbitmq/pull/29 ## Purpose of the change Add SinkV2 implemetation for RabbitMQ. ## Verifying this change Please make sure both new and modified tests in this PR follows

[jira] [Updated] (FLINK-21373) Port RabbitMQ Sink to FLIP-143 API

2024-05-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-21373: --- Labels: auto-unassigned pull-request-available (was: auto-unassigned) > Port RabbitMQ Sink

Re: [PR] [FLINK-21373] Add RabbitMQ SinkV2 Implementation, Port Flink version to Flink 1.19 [flink-connector-rabbitmq]

2024-05-02 Thread via GitHub
boring-cyborg[bot] commented on PR #29: URL: https://github.com/apache/flink-connector-rabbitmq/pull/29#issuecomment-2090628185 Thanks for opening this pull request! Please check out our contributing guidelines. (https://flink.apache.org/contributing/how-to-contribute.html) -- This

Re: [PR] [FLINK-35278] Fix occasional NPE on getting latest resource for status replace [flink-kubernetes-operator]

2024-05-02 Thread via GitHub
ferenc-csaky commented on code in PR #823: URL: https://github.com/apache/flink-kubernetes-operator/pull/823#discussion_r1587630531 ## flink-kubernetes-operator/src/main/java/org/apache/flink/kubernetes/operator/utils/StatusRecorder.java: ## @@ -127,47 +128,65 @@ private void

[PR] [FLINK-35278] Fix occasional NPE on getting latest resource for status replace [flink-kubernetes-operator]

2024-05-02 Thread via GitHub
ferenc-csaky opened a new pull request, #823: URL: https://github.com/apache/flink-kubernetes-operator/pull/823 ## What is the purpose of the change Fix occasional NPE on getting latest resource for status replace. ## Brief change log - Added a `null`-check for `latest`

[jira] [Updated] (FLINK-35278) Occasional NPE on k8s operator status replacement

2024-05-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35278: --- Labels: pull-request-available (was: ) > Occasional NPE on k8s operator status replacement

[jira] [Updated] (FLINK-35282) PyFlink Support for Apache Beam > 2.49

2024-05-02 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martijn Visser updated FLINK-35282: --- Component/s: API / Python > PyFlink Support for Apache Beam > 2.49 >

[jira] [Updated] (FLINK-35282) PyFlink Support for Apache Beam > 2.49

2024-05-02 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martijn Visser updated FLINK-35282: --- Priority: Major (was: Blocker) > PyFlink Support for Apache Beam > 2.49 >

Re: [PR] [hotfix] Mention mTLS in SSL documentation page [flink]

2024-05-02 Thread via GitHub
flinkbot commented on PR #24755: URL: https://github.com/apache/flink/pull/24755#issuecomment-2090064080 ## CI report: * 78c85b8180d2c0e133eb7218c3f39aba81073003 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[PR] [hotfix] Mention mTLS in SSL documentation page [flink]

2024-05-02 Thread via GitHub
rmetzger opened a new pull request, #24755: URL: https://github.com/apache/flink/pull/24755 Make it more explicit that Flink supports mTLS. This term doesn't get mentioned in the docs, but is a common search term for this concept. -- This is an automated message from the Apache Git

[jira] [Updated] (FLINK-35283) Add support unique Kafka producer client ids

2024-05-02 Thread Francis (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Francis updated FLINK-35283: Description: This issue came out of debuging a warning we're seeing in our Flink logs. We're running

[jira] [Commented] (FLINK-35283) Add support unique Kafka producer client ids

2024-05-02 Thread Francis (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842916#comment-17842916 ] Francis commented on FLINK-35283: - I've added a PoC here:

[jira] [Created] (FLINK-35283) Add support unique Kafka producer client ids

2024-05-02 Thread Francis (Jira)
Francis created FLINK-35283: --- Summary: Add support unique Kafka producer client ids Key: FLINK-35283 URL: https://issues.apache.org/jira/browse/FLINK-35283 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-35282) Support for Apache Beam > 2.49

2024-05-02 Thread APA (Jira)
APA created FLINK-35282: --- Summary: Support for Apache Beam > 2.49 Key: FLINK-35282 URL: https://issues.apache.org/jira/browse/FLINK-35282 Project: Flink Issue Type: Improvement Reporter:

[jira] [Updated] (FLINK-35282) PyFlink Support for Apache Beam > 2.49

2024-05-02 Thread APA (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] APA updated FLINK-35282: Summary: PyFlink Support for Apache Beam > 2.49 (was: Support for Apache Beam > 2.49) > PyFlink Support for

[jira] [Assigned] (FLINK-35279) Support "last-state" upgrade mode for FlinkSessionJob

2024-05-02 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora reassigned FLINK-35279: -- Assignee: Alan Zhang > Support "last-state" upgrade mode for FlinkSessionJob >

Re: [PR] PoC for supporting unique Kafka producer client ids [flink-connector-kafka]

2024-05-02 Thread via GitHub
boring-cyborg[bot] commented on PR #101: URL: https://github.com/apache/flink-connector-kafka/pull/101#issuecomment-2089910632 Thanks for opening this pull request! Please check out our contributing guidelines. (https://flink.apache.org/contributing/how-to-contribute.html) -- This

[PR] PoC for supporting unique Kafka producer client ids [flink-connector-kafka]

2024-05-02 Thread via GitHub
francis-a opened a new pull request, #101: URL: https://github.com/apache/flink-connector-kafka/pull/101 This PR came out of debuging a warning we’re seeing in our Flink logs. We’re running Flink 1.18 and have an application that uses Kafka topics as a source and a sink. We’re running with

[jira] [Created] (FLINK-35281) FlinkEnvironmentUtils#addJar add each jar only once

2024-05-02 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35281: - Summary: FlinkEnvironmentUtils#addJar add each jar only once Key: FLINK-35281 URL: https://issues.apache.org/jira/browse/FLINK-35281 Project: Flink Issue

Re: [PR] [FLINK-35149][cdc-composer] Fix DataSinkTranslator#sinkTo ignoring pre-write topology if not TwoPhaseCommittingSink [flink-cdc]

2024-05-02 Thread via GitHub
loserwang1024 commented on PR #3233: URL: https://github.com/apache/flink-cdc/pull/3233#issuecomment-2089709636 > Could you please add a test case to prevent later code changes to revert this fix? I'd like to, but it seems no pipeline sink which is WithPreWriteTopology but not