Congratulations！
发件人： Yun Tang
发送时间： 2020-09-16 20:31
收件人： dev
主题： Re: Re: [ANNOUNCE] New Apache Flink Committer - Godfrey He
Congratulations, Godfrey ~
Best
Yun Tang
From: Kurt Young
Sent: Wednesday, September 16, 2020 17:02
To: dev
Subject: Re: Re:
Thanks ZhuZhu for driving the release.
Best,
Jingsong
On Thu, Sep 17, 2020 at 1:29 PM Zhu Zhu wrote:
> The Apache Flink community is very happy to announce the release of Apache
> Flink 1.11.2, which is the second bugfix release for the Apache Flink 1.11
> series.
>
> Apache Flink® is an
The Apache Flink community is very happy to announce the release of Apache
Flink 1.11.2, which is the second bugfix release for the Apache Flink 1.11
series.
Apache Flink® is an open-source stream processing framework for
distributed, high-performing, always-available, and accurate data streaming
+1 (non-binding)
Best,
Congxian
David Anderson 于2020年9月15日周二 下午11:38写道：
> +1 (binding)
>
> David
>
> On Tue, Sep 15, 2020 at 10:25 AM Tzu-Li (Gordon) Tai
> wrote:
>
> > +1 (binding)
> >
> > On Tue, Sep 15, 2020 at 3:26 PM Aljoscha Krettek
> > wrote:
> >
> > > +1 (binding)
> > >
> > >
Thanks for the detailed replay, +1 from my side.
Best,
Congxian
Seth Wiesman 于2020年9月17日周四 上午1:33写道：
> Hi Stephan,
>
> Regarding backward compatibility, I agree and the intention is that all
> existing code will continue to function with the same semantics. My working
> idea is to remove the
Hi, Steven
I am not particularly sure whether to provide id in GlobalCommit.
But my understanding is: if the committer function is idempotent, the
framework can guarantee exactly once semantics in batch/stream execution
mode. But I think maybe the idempotence should be guaranteed by the sink
Thank @piotr very much for your patient explanation.
I would try to explain what is in my mind.
Considering following case:
FlinkSink E6 -> Client Buffer Queue |E5|E4|E3|E2| --> External
System E1
When the FlinkSink can not add the E6 to the Queue maybe the external
client is
Hi Alexey,
I have created FLIP-144[1] for the native Kubernetes HA support. Please
have a look if you are interested.
Frankly speaking, I am not against the "StatefulSet + PV +
FileSystemHAService". Maybe in the future,
we could have the both in Flink.
[1].
Hi:
As a user, i have a question:
How can i use Table API to get a part of resurt randomly
It seem i must use orderBy() before fetch(), that will sort my data, it is not
what i want.
Thanks Timo,
The updates to `Schema` and LIKE clause looks good to me.
Best,
Jark
On Tue, 15 Sep 2020 at 10:30, Leonard Xu wrote:
> Hi, Timo
>
> Thanks for your explanation, it makes sense to me.
>
> Best,
> Leonard
>
>
> >> Hi, Timo
> >> Thanks for the update
> >> I have a minor suggestion
+1 (binding)
Best,
Jark
On Tue, 15 Sep 2020 at 10:32, Leonard Xu wrote:
> +1(non-binding)
>
> Leonard
>
> > 在 2020年9月12日，21:46，Danny Chan 写道：
> >
> > +1, non-binding ~
> >
> > Konstantin Knauf 于2020年9月11日 周五上午2:04写道：
> >
> >> +1 (binding)
> >>
> >>
> >>
> >> On Thu, Sep 10, 2020 at 4:29 PM
Hi Xintong and Stephan,
Thanks a lot for your attention on this FLIP. I will address the comments
inline.
# Architecture -> One or two ConfigMaps
Both of you are right. One ConfigMap will make the design and
implementation easier. Actually, in my POC codes,
I am using just one ConfigMap(e.g.
Xintong Song created FLINK-19267:
Summary: Calculate managed memory fractions for fine grained
resource specs
Key: FLINK-19267
URL: https://issues.apache.org/jira/browse/FLINK-19267
Project: Flink
Guowei, thanks a lot for the summary. Here are a couple more questions that
need more clarification for the GlobalCommitter case.
* framework provides some sort of unique id per GlobalCommT (e.g. nonce or
some sort of transaction id)
* commit failure handling. Should we roll over to the next
Congratulations!
Best,
Dan Zou
> 2020年9月16日 下午8:29，Yun Tang 写道：
>
> Congratulations , Arvid
>
> Best
> Yun Tang
>
> From: Yuan Mei
> Sent: Wednesday, September 16, 2020 14:27
> To: dev
> Subject: Re: [ANNOUNCE] New Apache Flink Committer - Arvid Heise
>
>
Congratulations!
Best,
Dan Zou
> 2020年9月16日 下午8:51，Igal Shilman 写道：
>
> Congratulations Godfrey!
> Impressive track record :-)
>
> All the best,
> Igal.
>
> On Wed, Sep 16, 2020 at 2:31 PM Yun Tang wrote:
>
>> Congratulations, Godfrey ~
>>
>> Best
>> Yun Tang
>>
hailong wang created FLINK-19266:
Summary: Test fail when run azure in
AbstractCloseableRegistryTest#testClose
Key: FLINK-19266
URL: https://issues.apache.org/jira/browse/FLINK-19266
Project: Flink
Hi Stephan,
Regarding backward compatibility, I agree and the intention is that all
existing code will continue to function with the same semantics. My working
idea is to remove the two checkpoint-storage related methods from
StateBackend into a new SnapshotStorage interface but then have
@Yun and @Congxian:
I think "async", "incremental", and similar flags belong very much with the
state backend (the index structure).
They define how the snapshotting procedure behaves.
The SnapshotStorage is really just about storage of checkpoint streams
(bytes) and handles and pointers.
Best,
Thanks for the great suggestion and the great discussion. Generally big +1
to this effort.
Some thoughts from my side:
*## Backwards Compatibility*
I think we should really strive to make this non breaking. Maybe we have
new classes / interfaces for StateBackends and CheckpointStorage and let
Stephan Ewen created FLINK-19265:
Summary: Simplify handling of 'NoMoreSplitsEvent'
Key: FLINK-19265
URL: https://issues.apache.org/jira/browse/FLINK-19265
Project: Flink
Issue Type:
I think the mentioned settings should be in the state backend. They
configure how a certain backend writes to a snapshot storage, but it’s
still the backend that has the logic and decides.
I think it's a good point, though, to be conscious about those settings.
I'm sure we can figure out the
Hi Congxian,
There is an allusion to those configs in the wiki but let me better spell
out my thinking. The flink-conf configurations will not change and I
believe the java code switches should remain on the state backend objects.
We are of course not fully disentangling state backends from
Aljoscha Krettek created FLINK-19264:
Summary: MiniCluster is flaky with concurrent job execution
Key: FLINK-19264
URL: https://issues.apache.org/jira/browse/FLINK-19264
Project: Flink
Congratulations Godfrey!
Impressive track record :-)
All the best,
Igal.
On Wed, Sep 16, 2020 at 2:31 PM Yun Tang wrote:
> Congratulations, Godfrey ~
>
> Best
> Yun Tang
>
> From: Kurt Young
> Sent: Wednesday, September 16, 2020 17:02
> To: dev
> Subject: Re:
Congratulations, Godfrey ~
Best
Yun Tang
From: Kurt Young
Sent: Wednesday, September 16, 2020 17:02
To: dev
Subject: Re: Re: [ANNOUNCE] New Apache Flink Committer - Godfrey He
Congrats and welcome, Godfrey!
Best,
Kurt
On Wed, Sep 16, 2020 at 4:59 PM Xintong
Congratulations , Arvid
Best
Yun Tang
From: Yuan Mei
Sent: Wednesday, September 16, 2020 14:27
To: dev
Subject: Re: [ANNOUNCE] New Apache Flink Committer - Arvid Heise
Congrats, Arvid! ☺
On Wed, Sep 16, 2020 at 12:37 PM Guowei Ma wrote:
> Congratulations
This is a very cool feature proposal.
One lesson-learned from the ZooKeeper-based HA is that it is overly
complicated to have the Leader RPC address in a different node than the
LeaderLock. There is extra code needed to make sure these converge and the
can be temporarily out of sync.
A much
OK, thanks so much David very helpful.
Sorry for any inconvenience.
--
Sent from: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/
Thank you so much Igal, complex things will appear as I progresses on the
implementation and I will surely follow up with you.
Best regards,
--
Sent from: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/
Hi all,
Thanks for keeping the discussion running while I was on holidays!
I am catching up currently and I will post in the voting thread if I
have any comments :)
Cheers,
Kostas
On Wed, Sep 16, 2020 at 11:25 AM David Anderson wrote:
>
> Aljoscha,
>
> Thanks for the thorough response. I'm
Chesnay Schepler created FLINK-19263:
Summary: Enforce alphabetical order in configuration option docs
Key: FLINK-19263
URL: https://issues.apache.org/jira/browse/FLINK-19263
Project: Flink
+1
Thanks for the discussion. Looking forward to seeing this all come to pass!
David
On Wed, Sep 16, 2020 at 9:28 AM Guowei Ma wrote:
> +1 (non-binding)
>
> Best,
> Guowei
>
>
> On Wed, Sep 16, 2020 at 3:03 PM Yun Gao
> wrote:
>
> > +1 (non-binding)
> >
> > Very thanks for bring this up! And
Thanks for preparing this FLIP, @Yang.
In general, I'm +1 for this new feature. Leveraging Kubernetes's buildtin
ConfigMap for Flink's HA services should significantly reduce the
maintenance overhead compared to deploying a ZK cluster. I think this is an
attractive feature for users.
Concerning
Aljoscha,
Thanks for the thorough response. I'm still wanting to think about and
discuss the Trigger topic some more, but I'm content with where you've left
it for now. Everything else seems good.
David
On Fri, Sep 11, 2020 at 2:08 PM Aljoscha Krettek
wrote:
> Thanks for the thoughtful
Congrats, Godfrey!
Best,
Paul Lam
> 2020年9月16日 17:03，Xingbo Huang 写道：
>
> Congratulations, well deserved.
>
> Best,
> Xingbo
>
> Xintong Song 于2020年9月16日周三 下午4:59写道：
>
>> Congratulations, Godfrey~!
>>
>> Thank you~
>>
>> Xintong Song
>>
>>
>>
>> On Wed, Sep 16, 2020 at 3:28 PM Yu Li
Hey
Thanks Dawid for bringing up my suggestion :)
> I'm not so sure about this, the sinks I'm aware of would not be able to
> implement this method: Kafka doesn't have this, I didn't see it in the
> Iceberg interfaces, and HDFS/S3 also don't have it.
Aljoscha, as I wrote, FlinkKafkaProducer is
Congratulations, well deserved.
Best,
Xingbo
Xintong Song 于2020年9月16日周三 下午4:59写道：
> Congratulations, Godfrey~!
>
> Thank you~
>
> Xintong Song
>
>
>
> On Wed, Sep 16, 2020 at 3:28 PM Yu Li wrote:
>
> > Congrats and welcome, Godfrey!
> >
> > Best Regards,
> > Yu
> >
> >
> > On Wed, 16 Sep 2020
Congrats and welcome, Godfrey!
Best,
Kurt
On Wed, Sep 16, 2020 at 4:59 PM Xintong Song wrote:
> Congratulations, Godfrey~!
>
> Thank you~
>
> Xintong Song
>
>
>
> On Wed, Sep 16, 2020 at 3:28 PM Yu Li wrote:
>
> > Congrats and welcome, Godfrey!
> >
> > Best Regards,
> > Yu
> >
> >
> > On
Congratulations, Godfrey~!
Thank you~
Xintong Song
On Wed, Sep 16, 2020 at 3:28 PM Yu Li wrote:
> Congrats and welcome, Godfrey!
>
> Best Regards,
> Yu
>
>
> On Wed, 16 Sep 2020 at 15:18, 刘大龙 wrote:
>
> >
> > Congratulations!
> >
> > > -原始邮件-
> > > 发件人: "Benchao Li"
> > > 发送时间:
Thank you!
I hope I can live up to the expectations.
On Wed, Sep 16, 2020 at 8:27 AM Yuan Mei wrote:
> Congrats, Arvid! ☺
>
> On Wed, Sep 16, 2020 at 12:37 PM Guowei Ma wrote:
>
> > Congratulations :)
> >
> > Best,
> > Guowei
> >
> >
> > On Tue, Sep 15, 2020 at 6:41 PM 刘建刚 wrote:
> >
> > >
Jingsong Lee created FLINK-19262:
Summary: Can not setParallelism for FLIP-27 source
Key: FLINK-19262
URL: https://issues.apache.org/jira/browse/FLINK-19262
Project: Flink
Issue Type: Bug
Guowei Ma created FLINK-19261:
-
Summary: Update document according to RestOptions
Key: FLINK-19261
URL: https://issues.apache.org/jira/browse/FLINK-19261
Project: Flink
Issue Type: Sub-task
Thank you all very much for your kind welcome :-)
Thanks,
Igal.
On Wed, Sep 16, 2020 at 8:50 AM Kostas Kloudas wrote:
> Congratulations Igal and welcome!
>
> Kostas
>
> On Wed, Sep 16, 2020 at 6:37 AM Guowei Ma wrote:
> >
> > Congratulations :)
> > Best,
> > Guowei
> >
> >
> > On Wed, Sep 16,
Guowei Ma created FLINK-19260:
-
Summary: Update documentation based on bin/flink output
Key: FLINK-19260
URL: https://issues.apache.org/jira/browse/FLINK-19260
Project: Flink
Issue Type: Bug
Hello all,
If an event is available now to Flink keyedcoprocess operator, and if
another event will be available 1 minute later to that operator (same key),
as a result of connecting the two streams, Flink does not provide any
guarantee that the event available now will be processed
Mazen, questions like this are better suited to the user mailing list.
FYI, this is also being discussed on stackoverflow:
https://stackoverflow.com/questions/63902457/flink-timeout-using-keyedcoprocessfunction-and-order-of-reading-for-flinkkafkaco
Regards,
David
On Wed, Sep 16, 2020 at 9:41 AM
Hi,
When answering a user question in ML[1] I spotted that when we forward
Kafka's metrics we use only the name of the metric[2]. I was wondering
if we should use both the metric name and group? I think it would make
it easier to track back a particular metric.
Moreover we still register Kafka's
Hey all,
I am using the KeyedCoProcessFunction class in Flink DataStream APIs to
implement a timeout like use case. The scenario is as follows: I have an
input kafka topic and an output Kafka topic, a service reads from the input
topic processes it (for variable amount of time) and then
Hey all,
I am using the KeyedCoProcessFunction class in Flink DataStream APIs to
implement a timeout like use case. The scenario is as follows: I have an
input kafka topic and an output Kafka topic, a service reads from the input
topic processes it (for variable amount of time) and then
Robert Metzger created FLINK-19259:
--
Summary: Use classloader release hooks with Kinesis producer to
avoid metaspace leak
Key: FLINK-19259
URL: https://issues.apache.org/jira/browse/FLINK-19259
Congrats and welcome, Godfrey!
Best Regards,
Yu
On Wed, 16 Sep 2020 at 15:18, 刘大龙 wrote:
>
> Congratulations!
>
> > -原始邮件-
> > 发件人: "Benchao Li"
> > 发送时间: 2020-09-16 14:22:25 (星期三)
> > 收件人: dev
> > 抄送: "贺小令"
> > 主题: Re: [ANNOUNCE] New Apache Flink Committer - Godfrey He
> >
> >
+1 (non-binding)
Best,
Guowei
On Wed, Sep 16, 2020 at 3:03 PM Yun Gao
wrote:
> +1 (non-binding)
>
> Very thanks for bring this up! And the FLIP is indeed necessary for stream
> & batch unification.
>
> --
> Sender:Dawid
Jark Wu created FLINK-19258:
---
Summary: Fix the wrong example of "csv.line-delimiter" in CSV
documentation
Key: FLINK-19258
URL: https://issues.apache.org/jira/browse/FLINK-19258
Project: Flink
Congratulations!
> -原始邮件-
> 发件人: "Benchao Li"
> 发送时间: 2020-09-16 14:22:25 (星期三)
> 收件人: dev
> 抄送: "贺小令"
> 主题: Re: [ANNOUNCE] New Apache Flink Committer - Godfrey He
>
> Congratulations!
>
> Zhu Zhu 于2020年9月16日周三 下午1:36写道：
>
> > Congratulations!
> >
> > Thanks,
> > Zhu
> >
> >
+1 (non-binding)
Very thanks for bring this up! And the FLIP is indeed necessary for stream &
batch unification.
--
Sender:Dawid Wysakowicz
Date:2020/09/16 15:01:08
Recipient:; Aljoscha Krettek
Theme:Re: [VOTE] FLIP-134: Batch
+1 (binding)
On 14/09/2020 14:25, Aljoscha Krettek wrote:
>
> Hi all,
>
> After the discussion in [1], I would like to open a voting thread for
> FLIP-134 (https://s.apache.org/FLIP-134) [2] which discusses a new
> BATCH execution mode for the DataStream API.
>
> The vote will be open until
Hey all,
I am using the KeyedCoProcessFunction class in Flink DataStream APIs to
implement a timeout like use case. The scenario is as follows: I have an
input kafka topic and an output Kafka topic, a service reads from the input
topic processes it (for variable amount of time) and then
Congratulations Igal and welcome!
Kostas
On Wed, Sep 16, 2020 at 6:37 AM Guowei Ma wrote:
>
> Congratulations :)
> Best,
> Guowei
>
>
> On Wed, Sep 16, 2020 at 11:54 AM Zhijiang
> wrote:
>
> > Congratulations and welcome, Igal!
> >
> >
> >
liufangliang created FLINK-19257:
Summary: HBase ConnectorDescriptor can not work in Table API of
release-1.11
Key: FLINK-19257
URL: https://issues.apache.org/jira/browse/FLINK-19257
Project: Flink
Tzu-Li (Gordon) Tai created FLINK-19256:
---
Summary: Validate Stateful Functions configuration only where
necessary
Key: FLINK-19256
URL: https://issues.apache.org/jira/browse/FLINK-19256
Congrats, Arvid! ☺
On Wed, Sep 16, 2020 at 12:37 PM Guowei Ma wrote:
> Congratulations :)
>
> Best,
> Guowei
>
>
> On Tue, Sep 15, 2020 at 6:41 PM 刘建刚 wrote:
>
> > Congratulations!
> >
> > Best
> >
> > Matthias Pohl 于2020年9月15日周二 下午6:07写道：
> >
> > > Congratulations! ;-)
> > >
> > > On Tue,
Congrats!
Best,
PengchengLiu
在 2020/9/16 下午2:23，“Benchao Li” 写入:
Congratulations!
Zhu Zhu 于2020年9月16日周三 下午1:36写道：
> Congratulations!
>
> Thanks,
> Zhu
>
> Leonard Xu 于2020年9月16日周三 下午1:32写道：
>
> > Congratulations! Godfrey
> >
> > Best,
>
Congratulations!
Zhu Zhu 于2020年9月16日周三 下午1:36写道：
> Congratulations!
>
> Thanks,
> Zhu
>
> Leonard Xu 于2020年9月16日周三 下午1:32写道：
>
> > Congratulations! Godfrey
> >
> > Best,
> > Leonard
> >
> > > 在 2020年9月16日，13:12，Yangze Guo 写道：
> > >
> > > Congratulations! Xiaoling.
> > >
> > > Best,
> > >
64 matches
Mail list logo
