[jira] [Updated] (FLINK-33799) Add e2e's for tls enabled operator

2024-03-14 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-33799: --- Fix Version/s: kubernetes-operator-1.9.0 (was:

[jira] [Updated] (FLINK-34151) Integrate Karpenter resource limits into cluster capacity check

2024-03-14 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-34151: --- Fix Version/s: kubernetes-operator-1.9.0 (was:

[jira] [Updated] (FLINK-32120) Add autoscaler config option to disable parallelism key group alignment

2024-03-14 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-32120: --- Fix Version/s: kubernetes-operator-1.9.0 (was:

[jira] [Updated] (FLINK-32119) Revise source partition skew logic

2024-03-14 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-32119: --- Fix Version/s: kubernetes-operator-1.9.0 (was:

[jira] [Updated] (FLINK-34540) Tune number of task slots

2024-03-14 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-34540: --- Fix Version/s: kubernetes-operator-1.9.0 (was:

[jira] [Updated] (FLINK-31502) Limit the number of concurrent scale operations to reduce cluster churn

2024-03-14 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-31502: --- Fix Version/s: kubernetes-operator-1.9.0 (was:

[jira] [Updated] (FLINK-33789) Expose restart time as a metric

2024-03-14 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-33789: --- Fix Version/s: kubernetes-operator-1.9.0 (was:

[jira] [Updated] (FLINK-33773) Add fairness to scaling decisions

2024-03-14 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-33773: --- Fix Version/s: kubernetes-operator-1.9.0 (was:

[jira] [Updated] (FLINK-33673) SizeLimits not being set on emptyDir

2024-03-14 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-33673: --- Fix Version/s: kubernetes-operator-1.9.0 (was:

[jira] [Updated] (FLINK-34539) Tune JobManager memory

2024-03-14 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-34539: --- Fix Version/s: kubernetes-operator-1.9.0 (was:

[jira] [Updated] (FLINK-34389) JdbcAutoscalerStateStore explicitly writes update_time

2024-03-14 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-34389: --- Fix Version/s: kubernetes-operator-1.9.0 (was:

[jira] [Resolved] (FLINK-34152) Tune TaskManager memory

2024-03-14 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved FLINK-34152. Release Note: TaskManager memory (heap, network, metaspace, managed) is optimized

[jira] [Resolved] (FLINK-34619) Do not wait for scaling completion in UPGRADE state with in-place scaling

2024-03-14 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved FLINK-34619. Release Note: Merged via 8938658ed245545e6436ff22cbb8b2fabd4047f1

[jira] [Resolved] (FLINK-34104) Improve the ScalingReport format of autoscaling

2024-03-14 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved FLINK-34104. Resolution: Fixed > Improve the ScalingReport format of autoscaling >

[jira] [Commented] (FLINK-34655) Autoscaler doesn't work for flink 1.15

2024-03-13 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17826015#comment-17826015 ] Maximilian Michels commented on FLINK-34655: Thanks for raising awareness for the Flink

[jira] [Comment Edited] (FLINK-34152) Tune TaskManager memory

2024-03-02 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17822790#comment-17822790 ] Maximilian Michels edited comment on FLINK-34152 at 3/2/24 9:11 AM:

[jira] [Commented] (FLINK-34152) Tune TaskManager memory

2024-03-02 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17822790#comment-17822790 ] Maximilian Michels commented on FLINK-34152: {quote}What I'm trying to say is that I didn't

[jira] [Commented] (FLINK-34152) Tune TaskManager memory

2024-03-01 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17822512#comment-17822512 ] Maximilian Michels commented on FLINK-34152: Hi [~yang]! Thanks for taking a look at the

[jira] [Updated] (FLINK-34152) Tune TaskManager memory

2024-02-28 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-34152: --- Summary: Tune TaskManager memory (was: Tune TaskManager memory of autoscaled jobs)

[jira] [Updated] (FLINK-34152) Tune TaskManager memory of austoscaled jobs

2024-02-28 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-34152: --- Summary: Tune TaskManager memory of austoscaled jobs (was: Tune TaskManager

[jira] [Assigned] (FLINK-34540) Tune number of task slots

2024-02-28 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reassigned FLINK-34540: -- Assignee: (was: Maximilian Michels) > Tune number of task slots >

[jira] [Updated] (FLINK-34152) Tune TaskManager memory of autoscaled jobs

2024-02-28 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-34152: --- Summary: Tune TaskManager memory of autoscaled jobs (was: Tune TaskManager memory

[jira] [Updated] (FLINK-34540) Tune number of task slots

2024-02-28 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-34540: --- Description: (was: Adjustments similar to FLINK-34152, but simpler because we

[jira] [Updated] (FLINK-34539) Tune JobManager memory

2024-02-28 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-34539: --- Summary: Tune JobManager memory (was: Tune JobManager memory of autoscaled jobs)

[jira] [Updated] (FLINK-34152) Tune TaskManager memory

2024-02-28 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-34152: --- Summary: Tune TaskManager memory (was: Tune TaskManager memory of autoscaled jobs)

[jira] [Created] (FLINK-34540) Tune number of task slots

2024-02-28 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-34540: -- Summary: Tune number of task slots Key: FLINK-34540 URL: https://issues.apache.org/jira/browse/FLINK-34540 Project: Flink Issue Type: Sub-task

[jira] [Updated] (FLINK-34538) Tune Flink config of autoscaled jobs

2024-02-28 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-34538: --- Description: Umbrella issue to tackle tuning the Flink configuration as part of

[jira] [Updated] (FLINK-34538) Tune Flink config of autoscaled jobs

2024-02-28 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-34538: --- Labels: (was: pull-request-available) > Tune Flink config of autoscaled jobs >

[jira] [Updated] (FLINK-34538) Tune Flink config of autoscaled jobs

2024-02-28 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-34538: --- Description: Umbrella issue to tackle (was: The current autoscaling algorithm

[jira] [Updated] (FLINK-34538) Tune Flink config of autoscaled jobs

2024-02-28 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-34538: --- Fix Version/s: (was: kubernetes-operator-1.8.0) > Tune Flink config of

[jira] [Updated] (FLINK-34538) Tune Flink config of autoscaled jobs

2024-02-28 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-34538: --- Summary: Tune Flink config of autoscaled jobs (was: Tune memory of autoscaled

[jira] [Updated] (FLINK-34539) Tune JobManager memory of autoscaled jobs

2024-02-28 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-34539: --- Labels: (was: pull-request-available) > Tune JobManager memory of autoscaled jobs

[jira] [Updated] (FLINK-34539) Tune JobManager memory of autoscaled jobs

2024-02-28 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-34539: --- Description: Adjustments similar to FLINK-34152, but simpler because we only need

[jira] [Updated] (FLINK-34538) Tune memory of autoscaled jobs

2024-02-28 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-34538: --- Description: The current autoscaling algorithm adjusts the parallelism of the job

[jira] [Updated] (FLINK-34539) Tune JobManager memory of autoscaled jobs

2024-02-28 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-34539: --- Description: Similarly to (was: The current autoscaling algorithm adjusts the

[jira] [Created] (FLINK-34539) Tune JobManager memory of autoscaled jobs

2024-02-28 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-34539: -- Summary: Tune JobManager memory of autoscaled jobs Key: FLINK-34539 URL: https://issues.apache.org/jira/browse/FLINK-34539 Project: Flink Issue

[jira] [Updated] (FLINK-34152) Tune TaskManager memory of autoscaled jobs

2024-02-28 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-34152: --- Parent: FLINK-34538 Issue Type: Sub-task (was: New Feature) > Tune

[jira] [Created] (FLINK-34538) Tune memory of autoscaled jobs

2024-02-28 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-34538: -- Summary: Tune memory of autoscaled jobs Key: FLINK-34538 URL: https://issues.apache.org/jira/browse/FLINK-34538 Project: Flink Issue Type: New

[jira] [Updated] (FLINK-34538) Tune memory of autoscaled jobs

2024-02-28 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-34538: --- Description: (was: The current autoscaling algorithm adjusts the parallelism of

[jira] [Updated] (FLINK-34152) Tune TaskManager memory of autoscaled jobs

2024-02-28 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-34152: --- Summary: Tune TaskManager memory of autoscaled jobs (was: Tune memory of

[jira] [Updated] (FLINK-34152) Tune TaskManager memory of autoscaled jobs

2024-02-28 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-34152: --- Summary: Tune TaskManager memory of autoscaled jobs (was: Tune memory of

[jira] [Updated] (FLINK-34152) Tune memory of autoscaled jobs

2024-02-28 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-34152: --- Summary: Tune memory of autoscaled jobs (was: Tune TaskManager memory of

[jira] [Updated] (FLINK-34152) Tune memory of autoscaled jobs

2024-02-28 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-34152: --- Description: The current autoscaling algorithm adjusts the parallelism of the job

[jira] [Updated] (FLINK-34152) Tune memory of autoscaled jobs

2024-02-28 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-34152: --- Description: The current autoscaling algorithm adjusts the parallelism of the job

[jira] [Commented] (FLINK-34471) Tune network memory as part of Autoscaler Memory Tuning

2024-02-22 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819591#comment-17819591 ] Maximilian Michels commented on FLINK-34471: Yes, that is exactly what I meant: Moving from

[jira] [Comment Edited] (FLINK-34471) Tune network memory as part of Autoscaler Memory Tuning

2024-02-22 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819578#comment-17819578 ] Maximilian Michels edited comment on FLINK-34471 at 2/22/24 10:18 AM:

[jira] [Commented] (FLINK-34471) Tune network memory as part of Autoscaler Memory Tuning

2024-02-22 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819578#comment-17819578 ] Maximilian Michels commented on FLINK-34471: Thanks! That would be very helpful – I don’t

[jira] [Commented] (FLINK-34471) Tune network memory as part of Autoscaler Memory Tuning

2024-02-21 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819306#comment-17819306 ] Maximilian Michels commented on FLINK-34471: I think in addition to the fine-grained

[jira] [Updated] (FLINK-34471) Tune network memory as part of Autoscaler Memory Tuning

2024-02-21 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-34471: --- Summary: Tune network memory as part of Autoscaler Memory Tuning (was: Tune the

[jira] [Updated] (FLINK-34471) Tune the network memory in Autoscaler

2024-02-21 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-34471: --- Summary: Tune the network memory in Autoscaler (was: Tune the network memroy in

[jira] [Commented] (FLINK-34471) Tune the network memroy in Autoscaler

2024-02-21 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819233#comment-17819233 ] Maximilian Michels commented on FLINK-34471: Thanks Rui! > Tune the network memroy in

[jira] [Assigned] (FLINK-34471) Tune the network memroy in Autoscaler

2024-02-21 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reassigned FLINK-34471: -- Assignee: Maximilian Michels > Tune the network memroy in Autoscaler >

[jira] [Commented] (FLINK-33092) Improve the resource-stabilization-timeout mechanism when rescale a job for Adaptive Scheduler

2024-01-31 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812778#comment-17812778 ] Maximilian Michels commented on FLINK-33092: +1 waiting on resources in the Executing state.

[jira] [Commented] (FLINK-34266) Output ratios should be computed over the whole metric window instead of averaged

2024-01-29 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811988#comment-17811988 ] Maximilian Michels commented on FLINK-34266: Yes, using the total sum and substracting the

[jira] [Commented] (FLINK-34266) Output ratios should be computed over the whole metric window instead of averaged

2024-01-29 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811921#comment-17811921 ] Maximilian Michels commented on FLINK-34266: The way I understand the code is that for every

[jira] [Commented] (FLINK-34213) Consider using accumulated busy time instead of busyMsPerSecond

2024-01-23 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17810006#comment-17810006 ] Maximilian Michels commented on FLINK-34213: If we had to query metrics per vertex, that

[jira] [Created] (FLINK-34213) Consider using accumulated busy time instead of busyMsPerSecond

2024-01-23 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-34213: -- Summary: Consider using accumulated busy time instead of busyMsPerSecond Key: FLINK-34213 URL: https://issues.apache.org/jira/browse/FLINK-34213 Project:

[jira] [Updated] (FLINK-34152) Tune memory of autoscaled jobs

2024-01-22 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-34152: --- Description: The current autoscaling algorithm adjusts the parallelism of the job

[jira] [Created] (FLINK-34152) Tune memory of autoscaled jobs

2024-01-18 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-34152: -- Summary: Tune memory of autoscaled jobs Key: FLINK-34152 URL: https://issues.apache.org/jira/browse/FLINK-34152 Project: Flink Issue Type: New

[jira] [Updated] (FLINK-34152) Tune heap memory of autoscaled jobs

2024-01-18 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-34152: --- Summary: Tune heap memory of autoscaled jobs (was: Tune memory of autoscaled jobs)

[jira] [Updated] (FLINK-34152) Tune memory of autoscaled jobs

2024-01-18 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-34152: --- Summary: Tune memory of autoscaled jobs (was: Tune heap memory of autoscaled jobs)

[jira] [Created] (FLINK-34151) Integrate Karpenter resource limits into cluster capacity check

2024-01-18 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-34151: -- Summary: Integrate Karpenter resource limits into cluster capacity check Key: FLINK-34151 URL: https://issues.apache.org/jira/browse/FLINK-34151 Project:

[jira] [Resolved] (FLINK-33771) Add cluster capacity awareness to Autoscaler

2024-01-18 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved FLINK-33771. Resolution: Fixed > Add cluster capacity awareness to Autoscaler >

[jira] [Commented] (FLINK-31977) If scaling.effectiveness.detection.enabled is false, the call to the detectIneffectiveScaleUp() function is unnecessary

2024-01-11 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805650#comment-17805650 ] Maximilian Michels commented on FLINK-31977: I think this is related to FLINK-33993. The

[jira] [Closed] (FLINK-33993) Ineffective scaling detection events are misleading

2024-01-05 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed FLINK-33993. -- Resolution: Fixed > Ineffective scaling detection events are misleading >

[jira] [Created] (FLINK-33993) Ineffective scaling detection events are misleading

2024-01-04 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-33993: -- Summary: Ineffective scaling detection events are misleading Key: FLINK-33993 URL: https://issues.apache.org/jira/browse/FLINK-33993 Project: Flink

[jira] [Commented] (FLINK-33940) Update the auto-derivation rule of max parallelism for enlarged upscaling space

2024-01-02 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17801843#comment-17801843 ] Maximilian Michels commented on FLINK-33940: [~Zhanghao Chen] Even though the factor only

[jira] [Commented] (FLINK-33940) Update the auto-derivation rule of max parallelism for enlarged upscaling space

2024-01-02 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17801790#comment-17801790 ] Maximilian Michels commented on FLINK-33940: [~Zhanghao Chen] Thank you for the proposal. I

[jira] [Resolved] (FLINK-33795) Add new config to forbid autoscaling in certain periods of a day

2024-01-02 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved FLINK-33795. Fix Version/s: kubernetes-operator-1.8.0 Assignee: yonghua jian

[jira] [Resolved] (FLINK-33917) IllegalArgumentException: hostname can't be null

2024-01-02 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved FLINK-33917. Fix Version/s: kubernetes-operator-1.8.0 Assignee: Tom Resolution:

[jira] [Commented] (FLINK-33917) IllegalArgumentException: hostname can't be null

2023-12-22 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17799701#comment-17799701 ] Maximilian Michels commented on FLINK-33917: {{new URI("123-test").getHost()}} returns null.

[jira] [Commented] (FLINK-33917) IllegalArgumentException: hostname can't be null

2023-12-21 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17799352#comment-17799352 ] Maximilian Michels commented on FLINK-33917: The description doesn’t describe under which

[jira] [Resolved] (FLINK-33770) Autoscaler logs are full of deprecated key warnings

2023-12-11 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved FLINK-33770. Resolution: Fixed > Autoscaler logs are full of deprecated key warnings >

[jira] [Assigned] (FLINK-31400) Add autoscaler integration for Iceberg source

2023-12-07 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reassigned FLINK-31400: -- Assignee: Mason Chen > Add autoscaler integration for Iceberg source >

[jira] [Updated] (FLINK-31502) Limit the number of concurrent scale operations to reduce cluster churn

2023-12-07 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-31502: --- Fix Version/s: kubernetes-operator-1.8.0 (was:

[jira] [Updated] (FLINK-33771) Add cluster capacity awareness to Autoscaler

2023-12-07 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-33771: --- Description: To avoid starvation of pipelines when the Kubernetes cluster runs out

[jira] [Created] (FLINK-33773) Add fairness to scaling decisions

2023-12-07 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-33773: -- Summary: Add fairness to scaling decisions Key: FLINK-33773 URL: https://issues.apache.org/jira/browse/FLINK-33773 Project: Flink Issue Type:

[jira] [Created] (FLINK-33771) Add cluster capacity awareness to Autoscaler

2023-12-07 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-33771: -- Summary: Add cluster capacity awareness to Autoscaler Key: FLINK-33771 URL: https://issues.apache.org/jira/browse/FLINK-33771 Project: Flink

[jira] [Reopened] (FLINK-31502) Limit the number of concurrent scale operations to reduce cluster churn

2023-12-07 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reopened FLINK-31502: Reopening because this is an actual issue. > Limit the number of concurrent scale

[jira] [Created] (FLINK-33770) Autoscaler logs are full of deprecated key warnings

2023-12-07 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-33770: -- Summary: Autoscaler logs are full of deprecated key warnings Key: FLINK-33770 URL: https://issues.apache.org/jira/browse/FLINK-33770 Project: Flink

[jira] [Commented] (FLINK-33710) Autoscaler redeploys pipeline for a NOOP parallelism change

2023-12-06 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17793800#comment-17793800 ] Maximilian Michels commented on FLINK-33710: Additional fix via

[jira] [Updated] (FLINK-33522) Savepoint upgrade mode fails despite the savepoint succeeding

2023-12-01 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-33522: --- Fix Version/s: kubernetes-operator-1.8.0 (was:

[jira] [Commented] (FLINK-33522) Savepoint upgrade mode fails despite the savepoint succeeding

2023-12-01 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17791975#comment-17791975 ] Maximilian Michels commented on FLINK-33522: Additional fix required via

[jira] [Created] (FLINK-33710) Autoscaler redeploys pipeline for a NOOP parallelism change

2023-11-30 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-33710: -- Summary: Autoscaler redeploys pipeline for a NOOP parallelism change Key: FLINK-33710 URL: https://issues.apache.org/jira/browse/FLINK-33710 Project:

[jira] [Resolved] (FLINK-30593) Determine restart time on the fly for Autoscaler

2023-11-24 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved FLINK-30593. Fix Version/s: kubernetes-operator-1.8.0 Resolution: Fixed > Determine

[jira] [Closed] (FLINK-33572) Minimize ConfigMap API operations for autoscaler state

2023-11-16 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed FLINK-33572. -- Resolution: Fixed Implemented via 02840b96ef3116ea95a440af4f945398900d89df and

[jira] [Updated] (FLINK-33572) Minimize ConfigMap API operations for autoscaler state

2023-11-16 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-33572: --- Release Note: Minimize ConfigMap operations for autoscaler state (was: Implemented

[jira] [Reopened] (FLINK-33572) Minimize ConfigMap API operations for autoscaler state

2023-11-16 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reopened FLINK-33572: > Minimize ConfigMap API operations for autoscaler state >

[jira] [Closed] (FLINK-33572) Minimize ConfigMap API operations for autoscaler state

2023-11-16 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed FLINK-33572. -- Release Note: Implemented via 02840b96ef3116ea95a440af4f945398900d89df and

[jira] [Created] (FLINK-33572) Minimize ConfigMap API operations for autoscaler state

2023-11-16 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-33572: -- Summary: Minimize ConfigMap API operations for autoscaler state Key: FLINK-33572 URL: https://issues.apache.org/jira/browse/FLINK-33572 Project: Flink

[jira] [Resolved] (FLINK-32960) Logic to log vertex exclusion only once does not work correctly

2023-11-15 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved FLINK-32960. Resolution: Later > Logic to log vertex exclusion only once does not work

[jira] [Commented] (FLINK-32723) FLIP-334 : Decoupling autoscaler and kubernetes and support the Standalone Autoscaler

2023-11-11 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785183#comment-17785183 ] Maximilian Michels commented on FLINK-32723: Thanks for following through with this

[jira] [Updated] (FLINK-33522) Savepoint upgrade mode fails despite the savepoint succeeding

2023-11-10 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-33522: --- Description: Under certain circumstances, savepoint creation can succeed but the

[jira] [Created] (FLINK-33522) Savepoint upgrade mode fails despite the savepoint succeeding

2023-11-10 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-33522: -- Summary: Savepoint upgrade mode fails despite the savepoint succeeding Key: FLINK-33522 URL: https://issues.apache.org/jira/browse/FLINK-33522 Project:

[jira] [Commented] (FLINK-33429) Metric collection during stabilization phase may error due to missing metrics

2023-11-03 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17782643#comment-17782643 ] Maximilian Michels commented on FLINK-33429: Thanks for closing! > Metric collection during

[jira] [Created] (FLINK-33429) Metric collection during stabilization phase may error due to missing metrics

2023-11-01 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-33429: -- Summary: Metric collection during stabilization phase may error due to missing metrics Key: FLINK-33429 URL: https://issues.apache.org/jira/browse/FLINK-33429

[jira] [Commented] (FLINK-32127) Source busy time is inaccurate in many cases

2023-10-31 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17781296#comment-17781296 ] Maximilian Michels commented on FLINK-32127: A new scaling method has been merged to address

[jira] [Resolved] (FLINK-32991) Some metrics from autoscaler never get registered

2023-08-31 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved FLINK-32991. Resolution: Fixed > Some metrics from autoscaler never get registered >

[jira] [Commented] (FLINK-32992) Recommended parallelism metric is a duplicate of Parallelism metric

2023-08-31 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17760934#comment-17760934 ] Maximilian Michels commented on FLINK-32992: That makes sense. Closing. > Recommended

[jira] [Resolved] (FLINK-32992) Recommended parallelism metric is a duplicate of Parallelism metric

2023-08-31 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved FLINK-32992. Resolution: Not A Problem > Recommended parallelism metric is a duplicate of

  1   2   3   4   5   6   7   8   9   10   >