haishui created FLINK-32496:
---
Summary: Sources with idleness and alignment always wait for
alignment when part of multiple sources is idle
Key: FLINK-32496
URL: https://issues.apache.org/jira/browse/FLINK-32496
Rui Fan created FLINK-32495:
---
Summary:
SourceCoordinatorAlignmentTest.testWatermarkAlignmentWithTwoGroups fails
Key: FLINK-32495
URL: https://issues.apache.org/jira/browse/FLINK-32495
Project: Flink
Hi Jing,
Thanks for your input!
> Would you like to add
> one section to describe(better with script/code example) how to use it in
> these two scenarios from users' perspective?
OK. I’ll update the FLIP with the code snippet after I get the POC branch done.
> NIT: the pictures have
Sorry, I used the wrong title. I just sent another email with the right
title to announce the voting result.
On Fri, Jun 30, 2023 at 7:26 AM Dong Lin wrote:
> Hi all,
>
> I'm happy to announce that we have unanimously approved this release [1].
>
> There are 5 approving votes, 3 of which are
Hi all,
I'm happy to announce that we have unanimously approved this release [1].
There are 5 approving votes, 3 of which are binding:
- Dian Fu (binding)
- Xingbo Huang (binding)
- Dong Lin (binding)
- Xin Jiang (non-binding)
- Zhipeng Zhang (non-binding)
There are no disapproving votes.
Yunfeng Zhou created FLINK-32494:
Summary: Cannot convert list literal to Table with PyFlink
Key: FLINK-32494
URL: https://issues.apache.org/jira/browse/FLINK-32494
Project: Flink
Issue
dalongliu created FLINK-32493:
-
Summary: Introduce RuntimeFilterBuilderOperator to build a
BloomFilter from build side data of shuffle join
Key: FLINK-32493
URL: https://issues.apache.org/jira/browse/FLINK-32493
I see. Thanks for the explanation. I may have not looked into this deeply
enough, and would trust the decision from you and the community members who
participated in the discussion & vote.
Best,
Xintong
On Thu, Jun 29, 2023 at 10:28 PM Alexander Fedulov <
alexander.fedu...@gmail.com> wrote:
Lijie Wang created FLINK-32492:
--
Summary: Introduce FlinkRuntimeFilterProgram to inject runtime
filter
Key: FLINK-32492
URL: https://issues.apache.org/jira/browse/FLINK-32492
Project: Flink
Hi Martijn,
Thanks for the reply. Regarding the behavioral stability guarantee, by
definition, an "API" always consists of the signature + behavior. So, the
behavior is a native part of an API. Therefore, behavioral changes should
be treated with the same guarantee as signature changes.
+1 on
Hi all,
I'm happy to announce that we have unanimously approved this release [1].
There are 5 approving votes, 3 of which are binding:
- Dian Fu (binding)
- Xingbo Huang (binding)
- Dong Lin (binding)
- Xin Jiang (non-binding)
- Zhipeng Zhang (non-binding)
There are no disapproving votes.
I will also vote +1 (binding).
- Verified checksums and GPG for all maven artifacts and source
distributions
- Successfully run the Flink ML Python/Java quickstart using source
distributions.
- Verified that the source distributions do not contain any unwanted
binaries.
- Built the source
Thanks Xintong for driving the effort.
I’d add a +1 to reworking configs, as suggested by @Jark and @Chesnay,
especially the types. We have various configs that encode Time / MemorySize
that are Long instead!
Regards,
Hong
> On 29 Jun 2023, at 16:19, Yuan Mei wrote:
>
> CAUTION: This
dalongliu created FLINK-32491:
-
Summary: Introduce RuntimeFilterOperator to support runtime filter
which can reduce the shuffle data size before shuffle join
Key: FLINK-32491
URL:
Sergey Nuyanzin created FLINK-32490:
---
Summary:
ArrayElementOutputTypeStrategyTest>TypeStrategiesTestBase.testTypeStrategy
constantly fails
Key: FLINK-32490
URL:
Hi Martijn,
Our team shared the same concern. We've considered a few options:
*1. Add a new package such as `flink-metrics-prometheus-native` and
eventually deprecate the original.*
*Pros:*
- Supports backward compatibility.
*Cons:*
- Two packages to maintain in the interim.
- Not consistent
dalongliu created FLINK-32489:
-
Summary: Support serialize and merge BloomFilter for runtime filter
Key: FLINK-32489
URL: https://issues.apache.org/jira/browse/FLINK-32489
Project: Flink
Issue
Hong Liang Teoh created FLINK-32488:
---
Summary: Introduce configuration to control ExecutionGraph cache
in REST API
Key: FLINK-32488
URL: https://issues.apache.org/jira/browse/FLINK-32488
Project:
Thanks all for participating!
Best,
Ron
Lijie Wang 于2023年6月29日周四 21:38写道：
> Hi, all
> Happy to announce that FLIP-324 [1] has been approved unanimously.
> According to the vote thread[2], there are 10 approving votes, out of
> which 7 are binding:
>
> - Jing Ge (binding)
> - Rui Fan (binding)
Thanks for driving this effort, Xintong!
To Chesnay
> I'm curious as to why the "Disaggregated State Management" item is
> marked as a must-have; will it require changes that break something?
> What prevents it from being added in 2.1?
As to "Disaggregated State Management".
We plan to provide
Hi Shammon,
Thanks for your comments. Please see my reply inline.
On Thu, Jun 29, 2023 at 6:01 PM Shammon FY wrote:
> Hi Dong and Yunfeng,
>
> Thanks for bringing up this discussion.
>
> As described in the FLIP, the differences between `end-to-end latency` and
>
Martijn Visser created FLINK-32487:
--
Summary:
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=50647=logs=0da23115-68bb-5dcd-192c-bd4c8adebde1=24c3384f-1bcb-57b3-224f-51bf973bbee8=8617
Key: FLINK-32487
Hi Martijn,
Thanks for your feedback! Please see my replhy inline.
On Thu, Jun 29, 2023 at 4:35 PM Martijn Visser
wrote:
> Hi Dong and Yunfeng,
>
> Thanks for the FLIP. What's not clear for me is what's the expected
> behaviour when the allowed latency can't be met, for whatever reason.
>
> However, I'm not sure about 2.
I am not aware of a bylaw that states the specific requirements in order to
mark something as @Deprecated. My understanding from the discussion and the
vote was that the community recognizes the necessity to make it explicit
that
the usage of the SourceFunction
+1 (binding)
- Verified the checksums and GPG files.
- Reviewed the website PR.
- Check the Python package apache-flink-ml-2.3.0.tar.gz
Best,
Xingbo
Dian Fu 于2023年6月29日周四 19:46写道：
> +1 (binding)
>
> - Verified the checksums and signatures.
> - The website PR LGTM
>
> Regards,
> Dian
>
> On
Hi Martijn,
Thanks for your feedback. I makes total sense to me.
I'll enable it for Cassandra.
Best
Etienne
Le 29/06/2023 à 10:54, Martijn Visser a écrit :
Hi Etienne,
I think it all depends on the actual maintainers of the connector to
make a decision on that: if their unreleased version
Hi all,
Thanks for all the feedback about the FLIP-322: Cooldown period for
adaptive scheduler [1].
This FLIP was discussed in [2].
I'd like to start a vote for it. The vote will be open for at least 72
hours (until July 3rd 14:00 GMT) unless there is an objection or
insufficient votes.
[1]
Lijie Wang created FLINK-32486:
--
Summary: FLIP-324: Introduce Runtime Filter for Flink Batch Jobs
Key: FLINK-32486
URL: https://issues.apache.org/jira/browse/FLINK-32486
Project: Flink
Issue
Thanks Chesnay for your feedback. I have updated the FLIP. I'll start a
vote thread.
Best
Etienne
Le 28/06/2023 à 11:49, Chesnay Schepler a écrit :
> we should schedule a check that will rescale if
min-parallelism-increase is met. Then, what it the use of
scaling-interval.max timeout in
Hi, all
Happy to announce that FLIP-324 [1] has been approved unanimously.
According to the vote thread[2], there are 10 approving votes, out of
which 7 are binding:
- Jing Ge (binding)
- Rui Fan (binding)
- Zhu Zhu (binding)
- Yuepeng Pan (non-binding)
- Yuxia (binding)
- Xia Sun (non-binding)
-
Thanks for everyone's votes!
Closing this vote now and following up with the result in a separate email.
Best,
Lijie
Benchao Li 于2023年6月25日周日 12:48写道：
> +1 (binding)
>
> Yuxin Tan 于2023年6月25日周日 12:27写道：
>
> > +1 (non-binding)
> >
> > Best,
> > Yuxin
> >
> >
> > Yangze Guo 于2023年6月25日周日
Hello,
when using our docker image users can enable certain plugins via an
environment variable, listing all plugins they'd like to enable.
This is a list of plugin jar names, which contain the full Flink
version, like 1.16.1.
This implies that users always need to be aware of the patch
Ran Tao created FLINK-32485:
---
Summary: Flink State Backend Changelog should support build
test-jar
Key: FLINK-32485
URL: https://issues.apache.org/jira/browse/FLINK-32485
Project: Flink
Issue
+1 (non-binding)
Best,
Xiangyu
yuxia 于2023年6月29日周四 20:44写道：
> +1 (binding)
>
> Best regards,
> Yuxia
>
> - 原始邮件 -
> 发件人: "Yuepeng Pan"
> 收件人: "dev"
> 发送时间: 星期四, 2023年 6 月 29日 下午 8:21:14
> 主题: Re: [VOTE] FLIP-309: Support using larger checkpointing interval when
> source is processing
+1 (binding) from my sides.
Best regards,
Yuxia
- 原始邮件 -
发件人: "lincoln 86xy"
收件人: "dev"
发送时间: 星期四, 2023年 6 月 29日 下午 2:12:08
主题: Re: [VOTE] FLIP-303: Support REPLACE TABLE AS SELECT statement
+1 (binding)
Best,
Lincoln Lee
liu ron 于2023年6月29日周四 13:22写道：
> +1(no-binding)
>
> Best,
+1 (binding)
Best regards,
Yuxia
- 原始邮件 -
发件人: "Yuepeng Pan"
收件人: "dev"
发送时间: 星期四, 2023年 6 月 29日 下午 8:21:14
主题: Re: [VOTE] FLIP-309: Support using larger checkpointing interval when
source is processing backlog
+1 non-binding.
Best.
Yuepeng Pan
Replied Message
| From |
Something else configuration-related is that there are a bunch of
options where the type isn't quite correct (e.g., a String where it
could be an enum, a string where it should be an int or something).
Could do a pass over those as well.
On 29/06/2023 13:50, Jark Wu wrote:
Hi,
I think one
Thanks for the explanation, Alex.
Not blocking the deprecation on 1 & 3 makes sense to me. However, I'm not
sure about 2.
It sounds to me that, without FLINK-28051 & FLINK-28054, some of the
connectors cannot migrate to the new Source API, or at least further
investigation is needed to
+1 non-binding.
Best.
Yuepeng Pan
Replied Message
| From | Jingsong Li |
| Date | 06/29/2023 13:25 |
| To | dev |
| Cc | flink.zhouyunfeng |
| Subject | Re: [VOTE] FLIP-309: Support using larger checkpointing interval
when source is processing backlog |
+1 binding
On Thu, Jun 29,
Hi Shammon,
Thank you for your answer and explanation, my latest experiment was a SELECT
query and my assumptions were based on that, INSERT works as described.
Regarding the state of FLIP-295, I just checked out the recently created jiras
[1] and if I can help out with any part, please let me
@Xintong
The original discussion [1] and vote [2] converged on the idea that it is
better
to make it clear to the users that they should stop using SourceFunction
since it
is going away. The longer we do not have this indication, the more user
implementations will be based on it and the more pain
Hi,
I think one more thing we need to consider to do in 2.0 is changing the
default value of configuration to improve out-of-box user experience.
Currently, in order to run a Flink job, users may need to set
a bunch of configurations, such as minibatch, checkpoint interval,
exactly-once,
+1 (binding)
- Verified the checksums and signatures.
- The website PR LGTM
Regards,
Dian
On Thu, Jun 29, 2023 at 7:03 PM Zhipeng Zhang wrote:
>
> Thanks Dong and Xin for driving this release.
>
> +1 (non-binding)
>
> - Verified that the checksums and GPG files.
> - Verified that the source
+1 (binding)
Best,
Jark
> 2023年6月29日 18:12，Jing Ge 写道：
>
> +1(binding)
>
> On Thu, Jun 29, 2023 at 7:47 AM Leonard Xu wrote:
>
>> +1 (binding)
>>
>> Best,
>> Leonard
>>
>>> On Jun 29, 2023, at 1:25 PM, Jingsong Li wrote:
>>>
>>> +1 binding
>>>
>>> On Thu, Jun 29, 2023 at 11:03 AM Dong
Prabhu Joseph created FLINK-32484:
-
Summary: AdaptiveScheduler combined restart during scaling out
Key: FLINK-32484
URL: https://issues.apache.org/jira/browse/FLINK-32484
Project: Flink
Thanks for the inputs, Martijn, Jing and Alex.
@Martijn,
Regarding the Scala supports, I personally don't think "a fully striked
through experience in the IDE" is something we want to avoid, especially
given that we are planning to remove the deprecated APIs soon, unlike when
FLINK-29740 was
Thanks Dong and Xin for driving this release.
+1 (non-binding)
- Verified that the checksums and GPG files.
- Verified that the source distributions do not contain any binaries.
- Browsed through JIRA release notes files.
- Browsed through README.md files.
Xin Jiang 于2023年6月29日周四 12:08写道：
>
>
Sergey Nuyanzin created FLINK-32483:
---
Summary:
RescaleCheckpointManuallyITCase.testCheckpointRescalingOutKeyedState fails on
AZP
Key: FLINK-32483
URL: https://issues.apache.org/jira/browse/FLINK-32483
Chesnay Schepler created FLINK-32482:
Summary: Add Java 17 to Docker build matrix
Key: FLINK-32482
URL: https://issues.apache.org/jira/browse/FLINK-32482
Project: Flink
Issue Type:
+1(binding)
On Thu, Jun 29, 2023 at 7:47 AM Leonard Xu wrote:
> +1 (binding)
>
> Best,
> Leonard
>
> > On Jun 29, 2023, at 1:25 PM, Jingsong Li wrote:
> >
> > +1 binding
> >
> > On Thu, Jun 29, 2023 at 11:03 AM Dong Lin wrote:
> >>
> >> Hi all,
> >>
> >> We would like to start the vote for
Hi Xintong,
Thanks for bringing up this topic. I can provide some details regarding
the SourceFunction deprecation efforts. Marking SourceFunction as
deprecated was not possible until now since we have stringent compiler
checks in flink-examples against using any deprecated APIs. We actually
Hi Dong and Yunfeng,
Thanks for bringing up this discussion.
As described in the FLIP, the differences between `end-to-end latency` and
`table.exec.mini-batch.allow-latency` are: "It allows users to specify the
end-to-end latency, whereas table.exec.mini-batch.allow-latency applies to
each
Hi Xintong,
2. SourceFunction / SinkFunction
This is one with challenges. There were many discussions in the past.
2.1 SourceFunction
The voting was passed[1], but there are still some ongoing issues[2]. The
SourceFunction is not marked as @deprecated yet[3], afaik.
2.2 SinkFunction
SinkV2 is a
luoyuxia created FLINK-32481:
Summary: Support type inference for procedure
Key: FLINK-32481
URL: https://issues.apache.org/jira/browse/FLINK-32481
Project: Flink
Issue Type: Sub-task
Viktor Feklin created FLINK-32480:
-
Summary: Keyed State always returns new value instance
Key: FLINK-32480
URL: https://issues.apache.org/jira/browse/FLINK-32480
Project: Flink
Issue Type:
Chesnay Schepler created FLINK-32479:
Summary: Tests revoke leadership too early
Key: FLINK-32479
URL: https://issues.apache.org/jira/browse/FLINK-32479
Project: Flink
Issue Type:
Hi Etienne,
I think it all depends on the actual maintainers of the connector to
make a decision on that: if their unreleased version of the connector
should be compatible with a new Flink version, then they should test
against it. For example, that's already done at Elasticsearch [1] and
JDBC
Hi Xintong,
With regards to the deprecation of the Scala APIs, during the PR
review it was requested to not mark all APIs as deprecated but only
the entry point [1], to avoid a fully striked through experience in
the IDE. I think the same idea was applicable on the DataSet API. I
think it depends
Hi Dong and Xuannan,
I'm excited to see this FLIP. I think support for processing-time
temporal joins is something that the Flink users will greatly benefit
off. I specifically want to call-out that it's great to see the use
cases that this enables. From a technical implementation perspective,
I
Hi Dong and Yunfeng,
Thanks for the FLIP. What's not clear for me is what's the expected
behaviour when the allowed latency can't be met, for whatever reason.
Given that we're talking about an "allowed latency", it implies that
something has gone wrong and should fail? Isn't this more a minimum
Hi Ryan,
I think there definitely is an interest in the
flink-metrics-prometheus, but I do see some challenges as well. Given
that the Prometheus simpleclient doesn't yet have a major version,
there are breaking changes happening in that. If we would update this,
it can/probably breaks the
Hi devs,
Looking at the release 2.0 proposals [1], I noticed that many APIs that are
proposed to be removed in 2.0 are not (fully) deprecated yet. We might want
to properly mark them as `@Deprecated` in 1.18 if we agree they should be
removed in 2.0. Moreover, according to FLIP-321 [2] (not voted
The Apache Flink community is very happy to announce the release of
Apache flink-connector-jdbc v3.1.1. This version is compatible with
Flink 1.16 and Flink 1.17.
Apache Flink® is an open-source stream processing framework for
distributed, high-performing, always-available, and accurate data
I'm happy to announce that we have unanimously approved this release.
There are 5 approving votes, 3 of which are binding:
* Danny (binding)
* Leonard (binding)
* Sergey (non-binding)
* Martijn (binding)
* Yuepeng (non-binding)
There are no disapproving votes.
Thanks all!
Best regards,
Rui Fan created FLINK-32478:
---
Summary:
SourceCoordinatorAlignmentTest.testAnnounceCombinedWatermarkWithoutStart fails
Key: FLINK-32478
URL: https://issues.apache.org/jira/browse/FLINK-32478
Project: Flink
+1 (binding)
Best,
Lincoln Lee
liu ron 于2023年6月29日周四 13:22写道：
> +1(no-binding)
>
> Best,
> Ron
>
> Feng Jin 于2023年6月29日周四 00:22写道：
>
> > +1 (no-binding)
> >
> >
> > Best
> > Feng
> >
> > On Wed, Jun 28, 2023 at 11:03 PM Jing Ge
> > wrote:
> >
> > > +1(binding)
> > >
> > > On Wed, Jun 28,
66 matches
Mail list logo
