The Apache Flink community is very happy to announce the release of
the Apache Flink Kubernetes Operator version 1.8.0.
The Flink Kubernetes Operator allows users to manage their Apache
Flink applications on Kubernetes through all aspects of their
lifecycle.
Release highlights:
- Flink
The vote is now closed.
I'm happy to announce that we have unanimously approved this release.
There are 6 approving votes, 3 of which are binding:
* Gyula Fora (binding)
* Marton Balassi (binding)
* Maximilian Michels (binding)
* Rui Fan (non-binding)
* Alexander Fedulov (non-binding)
* Mate
utoscaler-standalone/dependency-reduced-pom.xml though
> > > - Verified that chart and appVersion matches the target release (91d67d9)
> > > - Verified that Helm chart can be installed from the local Helm folder
> > > without overriding any parameters
> > &
ning.enabled: "true"
> > - Download Autoscaler standalone: wget
> >
> > https://repository.apache.org/content/repositories/orgapacheflink-1710/org/apache/flink/flink-autoscaler-standalone/1.8.0/flink-autoscaler-standalone-1.8.0.jar
> > - Ran Autoscaler standalone locally,
Hi everyone,
Please review and vote on the release candidate #1 for the version
1.8.0 of the Apache Flink Kubernetes Operator, as follows:
[ ] +1, Approve the release
[ ] -1, Do not approve the release (please provide specific comments)
**Release Overview**
As an overview, the release consists
Hey everyone,
I don't see any immediate blockers, so I'm going to start the release process.
Thanks,
Max
On Tue, Feb 20, 2024 at 8:55 PM Maximilian Michels wrote:
>
> Hey Rui, hey Ryan,
>
> Good points. Non-committers can't directly release but they can assist
> with the re
Hi Kevin,
Theoretically, as long as you move over all k8s resources, failover
should work fine on the Flink and Flink Operator side. The tricky part
is the handover. You will need to backup all resources from the old
cluster, shutdown the old cluster, then re-create them on the new
cluster. The
ers which I think
> > > > > is recognized in other ways
> > > > > (e.g., credit of committer and PMC member).
> > > > >
> > > > > Best,
> > > > > Jark
> > > > >
> > > > > [1]: https://www.apache.org
The FLIP mentions: "The contents described in this FLIP are all new
APIs and do not involve compatibility issues."
In this thread it looks like the plan is to remove the old state
declaration API. I think we should consider keeping the old APIs to
avoid breaking too many jobs. The new APIs will
+1 (binding)
Max
On Thu, Feb 29, 2024 at 4:24 AM Hang Ruan wrote:
>
> +1 (non-binding)
>
> Best,
> Hang
>
> weijie guo 于2024年2月29日周四 09:55写道：
>
> > +1 (binding)
> >
> > Best regards,
> >
> > Weijie
> >
> >
> > Feng Jin 于2024年2月29日周四 09:37写道：
> >
> > > +1 (non-binding)
> > >
> > > Best,
> > >
I'm a bit torn on this idea. On the one hand, it makes sense to thank
sponsors and entities who have supported Flink in the past. On other
hand, this list is bound to be incomplete and maybe also biased, even
if not intended to be so. I think the power of open-source comes from
the unconditional
Maximilian Michels created FLINK-34540:
--
Summary: Tune number of task slots
Key: FLINK-34540
URL: https://issues.apache.org/jira/browse/FLINK-34540
Project: Flink
Issue Type: Sub-task
Maximilian Michels created FLINK-34539:
--
Summary: Tune JobManager memory of autoscaled jobs
Key: FLINK-34539
URL: https://issues.apache.org/jira/browse/FLINK-34539
Project: Flink
Issue
Maximilian Michels created FLINK-34538:
--
Summary: Tune memory of autoscaled jobs
Key: FLINK-34538
URL: https://issues.apache.org/jira/browse/FLINK-34538
Project: Flink
Issue Type: New
r to be a release manager. I haven't done it for
> > Apache/Flink or the operator before so I may be a good candidate.
> >
> > Ryan van Huuksloot
> > Sr. Production Engineer | Streaming Platform
> > [image: Shopify]
> > <https://www.shopify.com/?utm_medium=sale
]` thread and FLIP doc. Please let me know if there are any
> > > concerns.
> > >
> > > Best,
> > > Mason
> > >
> > > On Mon, Jan 29, 2024 at 5:32 AM Thomas Weise wrote:
> > >
> > >> +1 (binding)
>
;> contributors) in the operator release process so that we have some fresh
>> eyes on the process.
>> Would anyone be interested in volunteering to help with the next release?
>>
>> Cheers,
>> Gyula
>>
>> On Tue, Feb 6, 2024 at 4:35 PM Maximilian Michels
improvements to both the operator and the
> > autoscaler logic.
> >
> > There are a few outstanding PRs currently, including some larger features
> > for the Autoscaler (JDBC event handler, Heap tuning), we have to make a
> > decision regarding those as well whether t
+1 (binding)
- Inspected source release (checked license, headers, no binaries)
- Verified checksums and signature
Cheers,
Max
On Sun, Feb 4, 2024 at 5:41 AM Qingsheng Ren wrote:
>
> Thanks for driving this, Martijn!
>
> +1 (binding)
>
> - Verified checksum and signature
> - Verified no
- Inspected the source for licenses and corresponding headers
- Checksums and signature OK
+1 (binding)
On Tue, Jan 23, 2024 at 4:08 PM Etienne Chauchot wrote:
>
> Hi everyone,
>
> Please review and vote on the release candidate #1 for the version
> 1.1.0, as follows:
>
> [ ] +1, Approve the
+1 (binding)
On Fri, Jan 26, 2024 at 6:03 AM Rui Fan <1996fan...@gmail.com> wrote:
>
> +1(binding)
>
> Best,
> Rui
>
> On Fri, Jan 26, 2024 at 11:55 AM Xuyang wrote:
>
> > +1 (non-binding)
> >
> >
> > --
> >
> > Best！
> > Xuyang
> >
> >
> >
> >
> >
> > 在 2024-01-26 10:12:34，"Hang Ruan"
Maximilian Michels created FLINK-34213:
--
Summary: Consider using accumulated busy time instead of
busyMsPerSecond
Key: FLINK-34213
URL: https://issues.apache.org/jira/browse/FLINK-34213
Project
Maximilian Michels created FLINK-34152:
--
Summary: Tune memory of autoscaled jobs
Key: FLINK-34152
URL: https://issues.apache.org/jira/browse/FLINK-34152
Project: Flink
Issue Type: New
Maximilian Michels created FLINK-34151:
--
Summary: Integrate Karpenter resource limits into cluster capacity
check
Key: FLINK-34151
URL: https://issues.apache.org/jira/browse/FLINK-34151
Project
+1 (binding)
On Wed, Jan 10, 2024 at 11:22 AM Martijn Visser
wrote:
>
> +1 (binding)
>
> On Wed, Jan 10, 2024 at 4:43 AM Xingbo Huang wrote:
> >
> > +1 (binding)
> >
> > Best,
> > Xingbo
> >
> > Dian Fu 于2024年1月10日周三 11:35写道：
> >
> > > +1 (binding)
> > >
> > > Regards,
> > > Dian
> > >
> > >
Maximilian Michels created FLINK-33993:
--
Summary: Ineffective scaling detection events are misleading
Key: FLINK-33993
URL: https://issues.apache.org/jira/browse/FLINK-33993
Project: Flink
nexpected IIUC.
>> Would you like to fix it?
>>
>> Feel free to create a FLINK JIRA to fix it if you would like to, and I'm
>> happy to
>> review!
>>
>> And cc @Maximilian Michels
>>
>> Best,
>> Rui
>>
>> On Tue,
Happy New Year everyone,
I'd like to start the year off by announcing Alexander Fedulov as a
new Flink committer.
Alex has been active in the Flink community since 2019. He has
contributed more than 100 commits to Flink, its Kubernetes operator,
and various connectors [1][2].
Especially
> Anyone for pushing my pub key to apache dist ?
Done.
On Thu, Dec 21, 2023 at 2:36 PM Etienne Chauchot wrote:
>
> Hello,
>
> All the ongoing PRs on this repo were merged. But, I'd like to leave
> some more days until feature freeze in case someone had a feature ready
> to integrate.
>
> Let'
Hi Rui,
+1 for removing the @Deprecated annotation from `getString(String key,
String defaultValue)`. I would remove the other typed variants with
default values but I'm ok with keeping them if they are still used.
-Max
On Wed, Dec 13, 2023 at 4:59 AM Rui Fan <1996fan...@gmail.com> wrote:
>
>
+1 (binding)
On Tue, Dec 12, 2023 at 2:23 PM Peter Huang wrote:
>
> +1 Non-binding
>
>
> Peter Huang
>
> Őrhidi Mátyás 于2023年12月12日 周二下午9:14写道：
>
> > +1
> > Matyas
> >
> > On Mon, Dec 11, 2023 at 10:26 PM Gyula Fóra wrote:
> >
> > > +1
> > >
> > > Gyula
> > >
> > > On Mon, Dec 11, 2023 at 1:26
king forward to your feedback, thanks~
>
> [1] https://github.com/apache/flink/pull/23247#discussion_r1422626734
> [2]
> https://github.com/apache/flink/assets/38427477/642c57e0-b415-4326-af05-8b506c5fbb3a
> [3] https://issues.apache.org/jira/browse/FLINK-33736
>
> Best,
> Ru
Hey Rui,
+1 for changing the default restart strategy to exponential-delay.
This is something all users eventually run into. They end up changing
the restart strategy to exponential-delay. I think the current
defaults are quite balanced. Restarts happen quickly enough unless
there are consecutive
Maximilian Michels created FLINK-33773:
--
Summary: Add fairness to scaling decisions
Key: FLINK-33773
URL: https://issues.apache.org/jira/browse/FLINK-33773
Project: Flink
Issue Type
Maximilian Michels created FLINK-33771:
--
Summary: Add cluster capacity awareness to Autoscaler
Key: FLINK-33771
URL: https://issues.apache.org/jira/browse/FLINK-33771
Project: Flink
Maximilian Michels created FLINK-33770:
--
Summary: Autoscaler logs are full of deprecated key warnings
Key: FLINK-33770
URL: https://issues.apache.org/jira/browse/FLINK-33770
Project: Flink
Maximilian Michels created FLINK-33710:
--
Summary: Autoscaler redeploys pipeline for a NOOP parallelism
change
Key: FLINK-33710
URL: https://issues.apache.org/jira/browse/FLINK-33710
Project
Thank you Rui for driving this!
On Thu, Nov 30, 2023 at 3:01 AM Rui Fan <1996fan...@gmail.com> wrote:
>
> The Apache Flink community is very happy to announce the release of
> Apache Flink 1.16.3, which is the
> third bugfix release for the Apache Flink 1.16 series.
>
>
>
> Apache Flink® is an
+1 (binding)
-Max
On Thu, Nov 30, 2023 at 9:15 AM Rui Fan <1996fan...@gmail.com> wrote:
>
> +1(binding)
>
> Best,
> Rui
>
> On Mon, Nov 13, 2023 at 11:01 AM Rui Fan <1996fan...@gmail.com> wrote:
>
> > Hi everyone,
> >
> > Thank you to everyone for the feedback on FLIP-364: Improve the
> >
Thanks for reviving the efforts here Matthias! +1 for the transition
to GitHub Actions.
As for ASF Infra Jenkins, it works fine. Jenkins is extremely
feature-rich. Not sure about the spare capacity though. I know that
for Apache Beam, Google donated a bunch of servers to get additional
build
+1 (binding)
1. Downloaded the archives, checksums, and signatures
2. Verified the signatures and checksums
3. Extract and inspect the source code for binaries
4. Compiled and tested the source code via mvn verify
5. Verified license files / headers
6. Deployed helm chart to test cluster
7. Build
Hi Mason,
Thank you for the proposal. This is a highly requested feature to make
the source scaling of Flink Autoscaling generic across all sources.
The current implementation handles every source individually, and if
we don't find any backlog metrics, we default to using busy time only.
At this
Maximilian Michels created FLINK-33572:
--
Summary: Minimize ConfigMap API operations for autoscaler state
Key: FLINK-33572
URL: https://issues.apache.org/jira/browse/FLINK-33572
Project: Flink
Maximilian Michels created FLINK-33522:
--
Summary: Savepoint upgrade mode fails despite the savepoint
succeeding
Key: FLINK-33522
URL: https://issues.apache.org/jira/browse/FLINK-33522
Project
+1 for targeting the release as soon as possible. Given the effort
that Rui has undergone to decouple the autoscaling implementation, it
makes sense to also include an alternative implementation with the
release. In the long run, I wonder whether the standalone
implementation should even be part
Maximilian Michels created FLINK-33429:
--
Summary: Metric collection during stabilization phase may error
due to missing metrics
Key: FLINK-33429
URL: https://issues.apache.org/jira/browse/FLINK-33429
Have a great time off, Etienne!
On Thu, Oct 26, 2023 at 3:38 PM Etienne Chauchot wrote:
>
> Hi,
>
> FYI, I'll be off and unresponsive for a week starting tomorrow evening.
> For ongoing work, please ping me before tomorrow evening or within a week
>
> Best
>
> Etienne
+1 (binding)
1. Downloaded the archives, checksums, and signatures
2. Verified the signatures and checksums ( gpg --recv-keys
B2D64016B940A7E0B9B72E0D7D0528B28037D8BC )
3. Extract and inspect the source code for binaries
4. Compiled and tested the source code via mvn verify
5. Verified license
Hey Rui,
+1 for making exponential backoff the default. I agree with Konstantin
that retrying forever is a good default for exponential backoff
because oftentimes the issue will resolve eventually. The purpose of
exponential backoff is precisely to continue to retry without causing
too much load.
+1 (binding)
On Thu, Sep 14, 2023 at 4:26 AM Venkatakrishnan Sowrirajan
wrote:
>
> +1 (non-binding)
>
> On Wed, Sep 13, 2023, 6:55 PM Matt Wang wrote:
>
> > +1 (non-binding)
> >
> >
> > Thanks for driving this FLIP
> >
> >
> >
> >
> > --
> >
> > Best,
> > Matt Wang
> >
> >
> > Replied
+1 (binding)
On Wed, Sep 13, 2023 at 12:28 PM Gyula Fóra wrote:
>
> +1 (binding)
>
> Gyula
>
> On Wed, 13 Sep 2023 at 09:33, Matt Wang wrote:
>
> > Thank you for driving this FLIP,
> >
> > +1 (non-binding)
> >
> >
> > --
> >
> > Best,
> > Matt Wang
> >
> >
> > Replied Message
> > |
> (PR) for YARN as well.
> >
> > Our initial approach was to create a decoupled interface as part of
> > FLIP-334 and then implement it for YARN in the subsequent phase.
> > However, if you recommend combining both phases, we can certainly consider
> > that option
Sep 5, 2023 at 8:13 AM Gyula Fóra wrote:
> >
> > > Hi All!
> > >
> > > @Maximilian Michels has raised the question of Flink
> > > version support in the operator before the last release. I would like to
> > > open this discussion pu
t;> handlerScalingFailure/handlerScalingReport (one of the
>> handles the event of scale failure, and the other handles
>> the event of scale success).
>>
>>
>>
>> --
>>
>> Best,
>> Matt Wang
>>
>>
>> Replied Message
>
Hi Gyula,
+1 The proposed changes make sense and are in line with what is
available for other metrics, e.g. number of records processed.
-Max
On Tue, Sep 5, 2023 at 2:43 PM Gyula Fóra wrote:
>
> Hi Devs,
>
> I would like to start a discussion on FLIP-361: Improve GC Metrics [1].
>
> The
Maximilian Michels created FLINK-32991:
--
Summary: Some metrics from autoscaler never get registered
Key: FLINK-32991
URL: https://issues.apache.org/jira/browse/FLINK-32991
Project: Flink
Maximilian Michels created FLINK-32992:
--
Summary: Recommended parallelism metric is a duplicate of
Parallelism metric
Key: FLINK-32992
URL: https://issues.apache.org/jira/browse/FLINK-32992
Maximilian Michels created FLINK-32960:
--
Summary: Logic to log vertex exclusion only once does not work
correctly
Key: FLINK-32960
URL: https://issues.apache.org/jira/browse/FLINK-32960
Project
Maximilian Michels created FLINK-32959:
--
Summary: Operator standalone mode throws NoClassDefFoundError
Key: FLINK-32959
URL: https://issues.apache.org/jira/browse/FLINK-32959
Project: Flink
Maximilian Michels created FLINK-32903:
--
Summary: Add a load simulation example pipeline for canary testing
Key: FLINK-32903
URL: https://issues.apache.org/jira/browse/FLINK-32903
Project: Flink
+1 (binding)
1. Downloaded the archives, checksums, and signatures
2. Verified the signatures and checksums
3. Extract and inspect the source code for binaries
4. Compiled and tested the source code via mvn verify
5. Verified license files / headers
6. Deployed helm chart to test cluster
7. Ran
+1 (binding)
-Max
On Tue, Aug 8, 2023 at 10:56 AM Etienne Chauchot wrote:
>
> Hi all,
>
> As part of Flink bylaws, binding votes for FLIP changes are active
> committer votes.
>
> Up to now, we have only 2 binding votes. Can one of the committers/PMC
> members vote on this FLIP ?
>
> Thanks
>
>
Maximilian Michels created FLINK-32813:
--
Summary: Split autoscaler ConfigMap
Key: FLINK-32813
URL: https://issues.apache.org/jira/browse/FLINK-32813
Project: Flink
Issue Type
Congrats, well done, and welcome to the PMC Matthias!
-Max
On Tue, Aug 8, 2023 at 8:36 AM yh z wrote:
>
> Congratulations, Matthias!
>
> Best,
> Yunhong Zheng (Swuferhong)
>
> Ryan Skraba 于2023年8月7日周一 21:39写道：
>
> > Congratulations Matthias -- very well-deserved, the community is lucky to
> >
ease helm chart, docker image
> - Verified doc build, links
> - Ran basic stateful example, upgrade, savepoint. Checked logs, no errors
>
> Gyula
>
> On Mon, Jul 31, 2023 at 2:24 PM Maximilian Michels wrote:
>
> > +1 (binding)
> >
> > 1. Downloaded the sou
Maximilian Michels created FLINK-32774:
--
Summary: Reconciliation for autoscaling overrides gets stuck after
cancel-with-savepoint
Key: FLINK-32774
URL: https://issues.apache.org/jira/browse/FLINK-32774
Hi Rui,
Thanks for the proposal. I think it makes a lot of sense to decouple
the autoscaler from Kubernetes-related dependencies. A couple of notes
when I read the proposal:
1. You propose AutoScalerEventHandler, AutoScalerStateStore,
AutoScalerStateStoreFactory, and AutoScalerEventHandler.
+1 (binding)
1. Downloaded the source and helm archives, checksums, and signatures
2. Verified the signatures and checksums
3. Extract and inspect the source code for binaries
4. Compiled and tested the source code via mvn verify
5. Verified license files / headers
6. Deployed helm chart to test
Hi Daren,
The behavior is consistent with the regular FlinkDeployment where the
cleanup will also cancel any running jobs. Are you intending to
recover jobs from another session cluster?
-Max
On Mon, Jul 17, 2023 at 4:48 PM Wong, Daren
wrote:
>
> Hi devs,
>
> I would like to enquire about the
Hi Chesnay,
+1 Sounds good to me!
-Max
On Tue, Jul 18, 2023 at 10:59 AM Chesnay Schepler wrote:
>
> MetricGroup#getAllVariables returns all variables associated with the
> metric, for example:
>
> | = abcde|
> | = ||0|
>
> The keys are surrounded by brackets for no particular reason.
>
> In
+1
On Tue, Jul 18, 2023 at 12:29 PM Gyula Fóra wrote:
>
> +1
>
> On Tue, 18 Jul 2023 at 12:12, Xintong Song wrote:
>
> > +1
> >
> > Best,
> >
> > Xintong
> >
> >
> >
> > On Tue, Jul 18, 2023 at 4:25 PM Chesnay Schepler
> > wrote:
> >
> > > The endpoint hasn't been working for years and was
+1
On Mon, Jul 17, 2023 at 10:45 AM Chesnay Schepler wrote:
>
> +1
>
> On 16/07/2023 08:10, Mohan, Deepthi wrote:
> > @Chesnay
> >
> > Thank you for your feedback.
> >
> > An important takeaway from the previous discussion [1] and your feedback
> > was to keep the design and text/diagram
Maximilian Michels created FLINK-32589:
--
Summary: Carry over parallelism overrides to prevent users from
clearing them on updates
Key: FLINK-32589
URL: https://issues.apache.org/jira/browse/FLINK-32589
Maximilian Michels created FLINK-32170:
--
Summary: Continue metric collection on intermittant job restarts
Key: FLINK-32170
URL: https://issues.apache.org/jira/browse/FLINK-32170
Project: Flink
Niceee. Thanks for managing the release, Gyula!
-Max
On Wed, May 17, 2023 at 8:25 PM Márton Balassi wrote:
>
> Thanks, awesome! :-)
>
> On Wed, May 17, 2023 at 2:24 PM Gyula Fóra wrote:
>>
>> The Apache Flink community is very happy to announce the release of Apache
>> Flink Kubernetes
Maximilian Michels created FLINK-32120:
--
Summary: Add autoscaler config option to disable parallelism key
group alignment
Key: FLINK-32120
URL: https://issues.apache.org/jira/browse/FLINK-32120
Maximilian Michels created FLINK-32119:
--
Summary: Disable key group alignment for determining source
parallelism
Key: FLINK-32119
URL: https://issues.apache.org/jira/browse/FLINK-32119
Project
+1 (binding)
1. Downloaded the archives, checksums, and signatures
2. Verified the signatures and checksums
3. Extract and inspect the source code for binaries
4. Verified license files / headers
5. Compiled and tested the source code via mvn verify
6. Deployed helm chart to test cluster
7. Ran
Maximilian Michels created FLINK-32102:
--
Summary: Aggregate multiple pendingRecords metric per source if
present
Key: FLINK-32102
URL: https://issues.apache.org/jira/browse/FLINK-32102
Project
Maximilian Michels created FLINK-32100:
--
Summary: Max parallelism is incorrectly calculated with multiple
topics
Key: FLINK-32100
URL: https://issues.apache.org/jira/browse/FLINK-32100
Project
Maximilian Michels created FLINK-32061:
--
Summary: Resource metric groups are not cleaned up on removal
Key: FLINK-32061
URL: https://issues.apache.org/jira/browse/FLINK-32061
Project: Flink
Maximilian Michels created FLINK-32005:
--
Summary: Add a per-deployment error metric to signal about
potential issues
Key: FLINK-32005
URL: https://issues.apache.org/jira/browse/FLINK-32005
Maximilian Michels created FLINK-32002:
--
Summary: Revisit autoscaler defaults for next release
Key: FLINK-32002
URL: https://issues.apache.org/jira/browse/FLINK-32002
Project: Flink
Thanks for starting the discussion, Jark and Xingtong!
Flink 2.0 is long overdue. In the past, the expectations for such a
release were unreasonably high. I think everybody had a different
understanding of what exactly the criteria were. This led to releasing
18 minor releases for the current
If we ban Mockito imports, I can still write tests using the full
qualifiers, right?
For example:
org.mockito.Mockito.when(somethingThatShouldHappen).thenReturn(somethingThatNeverActuallyHappens)
Just kidding, +1 on the proposal.
-Max
On Wed, Apr 26, 2023 at 9:02 AM Panagiotis Garefalakis
+1
On Tue, Apr 25, 2023 at 5:24 PM David Morávek wrote:
>
> Hi Eric,
>
> this sounds reasonable, there are definitely cases where you need to limit
> sink parallelism for example not to overload the storage or limit the
> number of output files
>
> +1
>
> Best,
> D.
>
> On Sun, Apr 23, 2023 at
Maximilian Michels created FLINK-31921:
--
Summary: Create a mini cluster based metric collection test
Key: FLINK-31921
URL: https://issues.apache.org/jira/browse/FLINK-31921
Project: Flink
Maximilian Michels created FLINK-31920:
--
Summary: Flaky tests
Key: FLINK-31920
URL: https://issues.apache.org/jira/browse/FLINK-31920
Project: Flink
Issue Type: Bug
Thanks for driving the release Gordon!
-Max
On Fri, Apr 21, 2023 at 12:33 AM Tzu-Li (Gordon) Tai
wrote:
>
> We have unanimously approved this release.
>
> There are 6 approving votes, 3 of which are binding:
>
> * Alexander Sorokoumov
> * Martijn Visser (binding)
> * Tzu-Li (Gordon) Tai
Maximilian Michels created FLINK-31867:
--
Summary: Enforce a minimum number of observations within a metric
window
Key: FLINK-31867
URL: https://issues.apache.org/jira/browse/FLINK-31867
Project
Maximilian Michels created FLINK-31866:
--
Summary: Autoscaler metric trimming reduces the numbet of metric
observations
Key: FLINK-31866
URL: https://issues.apache.org/jira/browse/FLINK-31866
Maximilian Michels created FLINK-31684:
--
Summary: Autoscaler metrics are only visible after metric window
is full
Key: FLINK-31684
URL: https://issues.apache.org/jira/browse/FLINK-31684
Project
Maximilian Michels created FLINK-31502:
--
Summary: Limit the number of concurrent scale operations to reduce
cluster churn
Key: FLINK-31502
URL: https://issues.apache.org/jira/browse/FLINK-31502
+1 (binding)
On Mon, Mar 13, 2023 at 11:33 AM Etienne Chauchot wrote:
>
> +1 (not binding)
>
> Etienne
>
> Le 11/03/2023 à 07:37, Yangze Guo a écrit :
> > +1 (binding)
> >
> > Zhanghao Chen 于 2023年3月10日周五 下午5:07写道：
> >
> >> Thanks Weihua. +1 (non-binding)
> >>
> >> Best,
> >> Zhanghao Chen
> >>
+1 on the proposal.
I'm wondering about the scale down behavior of the unified
implementation. Does the new unified implementation prioritize
releasing entire task managers in favor of evenly spreading out task
managers? Consider a scale down from parallelism 15 to parallelism 10
where each task
Maximilian Michels created FLINK-31400:
--
Summary: Add autoscaler integration for Iceberg source
Key: FLINK-31400
URL: https://issues.apache.org/jira/browse/FLINK-31400
Project: Flink
Maximilian Michels created FLINK-31345:
--
Summary: Trim autoscaler configMap to not exceed 1mb size limit
Key: FLINK-31345
URL: https://issues.apache.org/jira/browse/FLINK-31345
Project: Flink
Maximilian Michels created FLINK-31299:
--
Summary: PendingRecords metric might not be available
Key: FLINK-31299
URL: https://issues.apache.org/jira/browse/FLINK-31299
Project: Flink
t; > the desired parallelism declaration is important.
> >
> > Having the ability to specify min parallelism might be useful in
> > environments with multiple jobs: Scheduler will then have an option to stop
> > the less suitable job.
> > In other setups, where
thias Pohl wrote:
> >> > Thanks for your clarifications, David. I don't have any additional major
> >> > points to add. One thing about the FLIP: The RPC layer API for updating
> >> the
> >> > JRR returns a future with a JRR? I don't see value in returni
1 - 100 of 691 matches
Mail list logo
