Hi all,
The voting time for FLIP-140 has passed. I'm closing the vote now.
There were 4 +1 votes, 3 of which are binding:
- Aljoscha (binding)
- Seth (binding)
- Dawid (binding)
- Yun Gao (non-binding)
There were no disapproving votes.
Thus, FLIP-140 has been accepted.
Thanks everyone for
Hi all,
The voting time for FLIP-107 has passed. I'm closing the vote now.
There were 6 +1 votes, 4 of which are binding:
- Aljoscha (binding)
- Dawid (binding)
- Konstantin (binding)
- Danny (non-binding)
- Leonard (non-binding)
- Jark (binding)
There were no disapproving votes.
Thus,
Leonard Xu created FLINK-19271:
--
Summary: wrong HOP_PROCTIME output when materialize proctime
Key: FLINK-19271
URL: https://issues.apache.org/jira/browse/FLINK-19271
Project: Flink
Issue Type:
Timo Walther created FLINK-19273:
Summary: Update parser module for FLIP-107
Key: FLINK-19273
URL: https://issues.apache.org/jira/browse/FLINK-19273
Project: Flink
Issue Type: Sub-task
Hi everyone,
thanks for all the feedback. I updated the FLIP again on Thursday to
integrate the feedback I got from Jingsong and Jark offline. In
particular I updated the `Improve dealing with Row in DataStream API`
section another time. We introduced static methods for Row that should
make
Thanks for all your kind welcome and very glad to be one of the committers of
Flink community.
Best
Yun Tang
From: Congxian Qiu
Sent: Wednesday, September 16, 2020 13:10
To: dev@flink.apache.org
Cc: Zhijiang ; tangyun ; Yun
Tang
Subject: Re: [ANNOUNCE] New
Dawid Wysakowicz created FLINK-19270:
Summary: Extract an inteface from Abstract
Key: FLINK-19270
URL: https://issues.apache.org/jira/browse/FLINK-19270
Project: Flink
Issue Type:
+1 (binding)
Looking forward to review the pull requests for this valuable feature.
Regards,
Timo
On 16.09.20 07:35, Aljoscha Krettek wrote:
+1 (binding)
Nice work! :-)
Aljoscha
On 16.09.20 06:00, Xuannan Su wrote:
Hi all,
I'd like to start the vote for FLIP-36[1], which has been
Timo Walther created FLINK-19272:
Summary: Add interfaces for FLIP-107
Key: FLINK-19272
URL: https://issues.apache.org/jira/browse/FLINK-19272
Project: Flink
Issue Type: Sub-task
+1 It is very useful
Best,
Jingsong
On Thu, Sep 17, 2020 at 11:12 AM Jark Wu wrote:
> +1 (binding)
>
> Best,
> Jark
>
> On Tue, 15 Sep 2020 at 10:32, Leonard Xu wrote:
>
> > +1(non-binding)
> >
> > Leonard
> >
> > > 在 2020年9月12日，21:46，Danny Chan 写道：
> > >
> > > +1, non-binding ~
> > >
> > >
Congratulations :)
czw., 17 wrz 2020 o 04:24 Zou Dan napisał(a):
> Congratulations!
>
> Best,
> Dan Zou
>
> > 2020年9月16日 下午8:29，Yun Tang 写道：
> >
> > Congratulations , Arvid
> >
> > Best
> > Yun Tang
> >
> > From: Yuan Mei
> > Sent: Wednesday, September 16,
Thanks for the suggestion and discussion, and sorry for being late to the
party.
For me, +1 for the idea, but +0 for the current FLIP document.
First of all, I suggest we explicitly mention the deprecation of existing
backends in the document. From the description, we plan to mark all
existing
Yes, we can. Do you have any concerns already?
On 17/09/2020 10:10, Yu Li wrote:
> Hi Dawid,
>
> Thanks for driving the discussion and voting, and sorry for being late. Is
> it possible to defer the conclusion a little bit so we could give a review
> from the state backend side? Thanks.
>
> Best
Hi Chenyang,
we will relax this constraint in 1.12. The issue has alsready been
implemented: https://issues.apache.org/jira/browse/FLINK-18569
Until then, you can use SQL. It supports FETCH and LIMIT already without
ordering.
Btw please use the user@ mailing list for questions of this
Dawid Wysakowicz created FLINK-19269:
Summary: Make the PushingAsyncDataInput.DataOutput aware of
endOfInput
Key: FLINK-19269
URL: https://issues.apache.org/jira/browse/FLINK-19269
Project: Flink
Hi Dawid,
Thanks for driving the discussion and voting, and sorry for being late. Is
it possible to defer the conclusion a little bit so we could give a review
from the state backend side? Thanks.
Best Regards,
Yu
On Thu, 17 Sep 2020 at 14:42, Dawid Wysakowicz
wrote:
> Hi all,
>
> The voting
+1 (binding)
On 17/09/2020 07:19, Congxian Qiu wrote:
> +1 (non-binding)
>
> Best,
> Congxian
>
>
> David Anderson 于2020年9月15日周二 下午11:38写道：
>
>> +1 (binding)
>>
>> David
>>
>> On Tue, Sep 15, 2020 at 10:25 AM Tzu-Li (Gordon) Tai
>> wrote:
>>
>>> +1 (binding)
>>>
>>> On Tue, Sep 15, 2020 at 3:26
Thanks everyone,
I'm closing this vote now in a separate email.
Best,
Dawid
On 15/09/2020 08:52, Yun Gao wrote:
> Very thanks for bring this up!
>
> +1 (non-binding)
>
> Best,
> Yun
>
>
> --
> Sender:Seth Wiesman
>
Dawid Wysakowicz created FLINK-19268:
Summary: Introduce bounded style execution for keyed streams
Key: FLINK-19268
URL: https://issues.apache.org/jira/browse/FLINK-19268
Project: Flink
+1
On 9/4/2020 9:40 AM, Zhu Zhu wrote:
+1
Thanks,
Zhu
Xintong Song 于2020年9月4日周五 下午1:26写道：
Thanks for starting this vote.
+1 from my side.
Thank you~
Xintong Song
On Fri, Sep 4, 2020 at 12:37 AM Till Rohrmann
wrote:
Hi devs,
I'd like to start a voting thread on FLIP-138 [1], which
Hi Guowei,
Thanks for the explanation. Now I get your point.
Basically any action that would make sink unavailable, would also cause it
to block on snapshotting the state (in option 1. with flushing). I agree
that lack of availability is much less of an issue than I have thought
before.
For
Congratulations :)
czw., 17 wrz 2020 o 14:23 godfrey he napisał(a):
> Congratulations!
>
> Best,
> Godfrey
>
> Guowei Ma 于2020年9月16日周三 下午12:38写道：
>
> > Congratulations :)
> >
> > Best,
> > Guowei
> >
> >
> > On Tue, Sep 15, 2020 at 6:14 PM Matthias Pohl
> > wrote:
> >
> > > Congrats!
> > >
>
Congratulations :)
czw., 17 wrz 2020 o 15:20 godfrey he napisał(a):
> Congratulations!
>
> Regards,
> Godfrey
>
> Yun Tang 于2020年9月17日周四 下午2:22写道：
>
> > Thanks for all your kind welcome and very glad to be one of the
> > committers of Flink community.
> >
> > Best
> > Yun Tang
> >
> >
Congratulations :)
czw., 17 wrz 2020 o 14:23 godfrey he napisał(a):
> Congratulations!
>
> Best,
> Godfrey
>
> Igal Shilman 于2020年9月16日周三 下午4:35写道：
>
> > Thank you all very much for your kind welcome :-)
> >
> > Thanks,
> > Igal.
> >
> > On Wed, Sep 16, 2020 at 8:50 AM Kostas Kloudas
> wrote:
That makes sense to me, I've updated the FLIP and also took this chance to
make it clearer what the goals and non-goals of this proposal are.
Seth
On Thu, Sep 17, 2020 at 9:17 AM Stephan Ewen wrote:
> Just a quick note that it should be possible to rename "CheckpointStorage"
> because it is a
Hi all,
When I do a leftOuterJoin(stream, JoinHint.REPARTITION_SORT_MERGE), I’m running
into an IOException caused by too many open files.
The slaves in my YARN cluster (each with 48 slots and 320gb memory) are
currently set up with a limit of 32767, so I really don’t want to crank this up
Hi all,
Updated - I found the logging for the error, and it’s happening during a
GroupReduce. This is also happening at the same time as the leftOuterJoin and
the CoGroup.
Caused by: java.io.FileNotFoundException:
Adrian Kreuziger created FLINK-19283:
Summary: Allow subclasses to override/extend
FlinkKafkaConsumerBase checkpoint methods
Key: FLINK-19283
URL: https://issues.apache.org/jira/browse/FLINK-19283
Timo Walther created FLINK-19274:
Summary: Support FLIP-107 interfaces in planner
Key: FLINK-19274
URL: https://issues.apache.org/jira/browse/FLINK-19274
Project: Flink
Issue Type: Sub-task
Huang Xingbo created FLINK-19277:
Summary: Introduce
BatchArrowPythonGroupWindowAggregateFunctionOperator
Key: FLINK-19277
URL: https://issues.apache.org/jira/browse/FLINK-19277
Project: Flink
Congratulations and welcome Arvid Heise.
Best,
Jincheng
Piotr Nowojski 于2020年9月17日周四 下午3:33写道：
> Congratulations :)
>
> czw., 17 wrz 2020 o 04:24 Zou Dan napisał(a):
>
> > Congratulations!
> >
> > Best,
> > Dan Zou
> >
> > > 2020年9月16日 下午8:29，Yun Tang 写道：
> > >
> > > Congratulations ,
Stephan Ewen created FLINK-19278:
Summary: Bump Scala Macros Version to 2.1.1
Key: FLINK-19278
URL: https://issues.apache.org/jira/browse/FLINK-19278
Project: Flink
Issue Type: Improvement
Timo Walther created FLINK-19275:
Summary: Allow to read and write metadata in Kafka table
source/sink
Key: FLINK-19275
URL: https://issues.apache.org/jira/browse/FLINK-19275
Project: Flink
Igal Shilman created FLINK-19279:
Summary: Remove StatefulFunctionUnvierse cache
Key: FLINK-19279
URL: https://issues.apache.org/jira/browse/FLINK-19279
Project: Flink
Issue Type: Bug
Timo Walther created FLINK-19276:
Summary: Allow to read metadata for Debezium format
Key: FLINK-19276
URL: https://issues.apache.org/jira/browse/FLINK-19276
Project: Flink
Issue Type:
Dian Fu created FLINK-19284:
---
Summary: Add documentation about how to use Python UDF in the Java
Table API
Key: FLINK-19284
URL: https://issues.apache.org/jira/browse/FLINK-19284
Project: Flink
Okey, sorry and thanks.
At 2020-09-17 15:02:44, "Timo Walther" wrote:
>Hi Chenyang,
>
>we will relax this constraint in 1.12. The issue has alsready been
>implemented: https://issues.apache.org/jira/browse/FLINK-18569
>
>Until then, you can use SQL. It supports FETCH and LIMIT
Hi Dev,
Flink 1.11.2 has been released, (thanks ZhuZhu)
But I found the site version on
https://ci.apache.org/projects/flink/flink-docs-release-1.11/dev/table/hive/#using-bundled-hive-jar
is still 1.11.0. (1.10 is the same)
For example:
limbo created FLINK-19285:
-
Summary: Kafka sql connector fixed partitioner not work
Key: FLINK-19285
URL: https://issues.apache.org/jira/browse/FLINK-19285
Project: Flink
Issue Type: Bug
Zhu Zhu created FLINK-19286:
---
Summary: Improve pipelined region scheduling performance
Key: FLINK-19286
URL: https://issues.apache.org/jira/browse/FLINK-19286
Project: Flink
Issue Type: Sub-task
Congratulations!
Best,
Godfrey
Igal Shilman 于2020年9月16日周三 下午4:35写道：
> Thank you all very much for your kind welcome :-)
>
> Thanks,
> Igal.
>
> On Wed, Sep 16, 2020 at 8:50 AM Kostas Kloudas wrote:
>
> > Congratulations Igal and welcome!
> >
> > Kostas
> >
> > On Wed, Sep 16, 2020 at 6:37 AM
Congratulations!
Regards,
Godfrey
Yun Tang 于2020年9月17日周四 下午2:22写道：
> Thanks for all your kind welcome and very glad to be one of the
> committers of Flink community.
>
> Best
> Yun Tang
>
>
> From: Congxian Qiu
> Sent: Wednesday, September 16, 2020 13:10
>
I've just added some comments in the discussion thread [1]. Thanks.
Best Regards,
Yu
[1] https://s.apache.org/esigy
On Thu, 17 Sep 2020 at 16:29, Dawid Wysakowicz
wrote:
> Yes, we can. Do you have any concerns already?
>
> On 17/09/2020 10:10, Yu Li wrote:
> > Hi Dawid,
> >
> > Thanks for
Shengkai Fang created FLINK-19282:
-
Summary: Support watermark push down with WatermarkStrategy
Key: FLINK-19282
URL: https://issues.apache.org/jira/browse/FLINK-19282
Project: Flink
Issue
Hi Yu,
I've updated the Deprecation / Compatibility / Migration section to more
explicitly lay out the steps that we would take as part of this FLIP. It
includes your above concerns.
Regarding SnapshotStorage vs CheckpointStorage. I'm not sure users are
going to have a problem with this. I doubt
Congratulations!
Best,
Godfrey
Guowei Ma 于2020年9月16日周三 下午12:38写道：
> Congratulations :)
>
> Best,
> Guowei
>
>
> On Tue, Sep 15, 2020 at 6:14 PM Matthias Pohl
> wrote:
>
> > Congrats!
> >
> > Best,
> > Matthias
> >
> > On Tue, Sep 15, 2020 at 9:26 AM Dawid Wysakowicz >
> > wrote:
> >
> > >
Jark Wu created FLINK-19280:
---
Summary: The option "sink.buffer-flush.max-rows" for JDBC can't be
disabled by set to zero
Key: FLINK-19280
URL: https://issues.apache.org/jira/browse/FLINK-19280
Project:
Benchao Li created FLINK-19281:
--
Summary: LIKE cannot recognize full table path
Key: FLINK-19281
URL: https://issues.apache.org/jira/browse/FLINK-19281
Project: Flink
Issue Type: Bug
Hi all,
Sorry for being late to the discussion, but I just noticed there are some
state backend related changes proposed in this FLIP, so would like to share
my two cents.
First of all, for the performance testing result, I'm wondering whether the
sorting cost is counted in the result for both
Guowei
Just to add to what Aljoscha said regarding the unique id. Iceberg sink
checkpoints the unique id into state during snapshot. It also inserts the
unique id into the Iceberg snapshot metadata during commit. When a job
restores the state after failure, it needs to know if the restored
Thanks for the comments Yu.
> First of all, for the performance testing result, I'm wondering whether the
> sorting cost is counted in the result for both DataSet and refined
> DataStream implementations. I could think of the saving of hash computation
> and final iteration to emit the word-count
Just a quick note that it should be possible to rename "CheckpointStorage"
because it is a purely internal interface.
Looks like the "SnapshotStorage" takes some limited amount of functionality
from the "CheckpointStorage", like location pointer resolution.
One option could be to rename
Thanks for the summary!
On 16.09.20 06:29, Guowei Ma wrote:
## Consensus
1. The motivation of the unified sink API is to decouple the sink
implementation from the different runtime execution mode.
2. The initial scope of the unified sink API only covers the file system
type, which supports the
53 matches
Mail list logo
