Re: [ANNOUNCE] Apache Flink 1.8.1 released

Awesome! Thanks a lot for being the release manager. Great job! @Jincheng Regards, Dian > 在 2019年7月3日，上午10:08，jincheng sun 写道： > > I've also tweeted about it from my twitter: > https://twitter.com/sunjincheng121/status/1146236834344648704 >

Re: [DISCUSS] Publish the PyFlink into PyPI

Hi Chesnay, Thanks a lot for the suggestions. Regarding “distributing java/scala code to PyPI”: The Python Table API is just a wrapper of the Java Table API and without the java/scala code, two steps will be needed to set up an environment to execute a Python Table API program: 1) Install pyfli

Re: [VOTE] Migrate to sponsored Travis account

+1. Thanks Chesnay and Bowen for pushing this forward. Regards, Dian > 在 2019年7月4日，下午6:28，zhijiang 写道： > > +1 and thanks for Chesnay' work on this. > > Best, > Zhijiang > > -- > From:Haibo Sun > Send Time:2019年7月4日(星期四) 18:21 >

Re: [DISCUSS] ARM support for Flink

Hi Xiyuan, Thanks for bring the discussion. WRT the exception, it's because the native bundled in the rocksdb jar file isn't compiled with cross platform support. You can refer [1] for how to build rocksdb which has ARM platform. WRT ARM support, the rocksdb currently used in Flink is hosted

Re: [ANNOUNCE] Rong Rong becomes a Flink committer

Congrats Rong! > 在 2019年7月12日，上午8:47，Chen YuZhao 写道： > > congratulations! > > 获取 Outlook for iOS > > 发件人: Rong Rong > 发送时间: 星期五, 七月 12, 2019 8:09 上午 > 收件人: Hao Sun > 抄送: Xuefu Z; dev; Flink ML > 主题: Re: [ANNOUNCE] Rong Rong becomes a Flink committer > > Thank you

Re: flink-python failed on Travis

Thanks for reporting this issue. I will take a look at it. > 在 2019年7月17日，上午11:50，Danny Chan 写道： > > I have the same issue ~~ > > Best, > Danny Chan > 在 2019年7月17日 +0800 AM11:21，Haibo Sun ，写道： >> Hi, folks >> >> >> I noticed that all of the Travis tests reported the following failure. Is >>

Re: flink-python failed on Travis

： > > Hi Dian, > > Is there any update on this? It seems have been failing for a day. > > > > On Tue, Jul 16, 2019 at 9:35 PM Dian Fu wrote: > >> Thanks for reporting this issue. I will take a look at it. >> >>> 在 2019年7月17日，上午11:50，Danny Chan

Re: [ANNOUNCE] Jiangjie (Becket) Qin has been added as a committer to the Flink project

Congrats Becket! > 在 2019年7月18日，下午6:42，Danny Chan 写道： > >> Congratulations! > > Best, > Danny Chan > 在 2019年7月18日 +0800 PM6:29，Haibo Sun ，写道： >> Congratulations Becket!Best, >> Haibo >> 在 2019-07-18 17:51:06，"Hequn Cheng" 写道： >>> Congratulations Becket! >>> >>> Best, Hequn >>> >>> On Thu, Ju

Re: [DISCUSS] Setup a bui...@flink.apache.org mailing list for travis builds

Thanks Jark for the proposal, sounds reasonable for me. +1. This ML could be used for all the build notifications including master and CRON jobs. > 在 2019年7月20日，下午2:55，Xu Forward 写道： > > +1 ,Thanks jark for the proposal. > Best > Forward > > Jark Wu 于2019年7月20日周六 下午12:14写道： > >> Hi all, >>

Re: [ANNOUNCE] Zhijiang Wang has been added as a committer to the Flink project

Congrats Zhijiang! > 在 2019年7月23日，上午9:14，Kurt Young 写道： > > Congratulations Zhijiang! > > Best, > Kurt > > > On Tue, Jul 23, 2019 at 8:59 AM Biao Liu wrote: > >> Congrats Zhijiang. Well deserved! >> >> SHI Xiaogang 于2019年7月23日 周二08:35写道： >> >>> Congratulations Zhijiang! >>> >>> Regards,

Re: [ANNOUNCE] Kete Young is now part of the Flink PMC

Congrats, Kurt! > 在 2019年7月23日，下午5:33，Zili Chen 写道： > > Congratulations Kurt! > > Best, > tison. > > > JingsongLee 于2019年7月23日周二 下午5:29写道： > >> Congratulations Kurt! >> >> Best, Jingsong Lee >> >> >> -- >> From:Robert Metzge

Re: [DISCUSS] Publish the PyFlink into PyPI

t if anyone can give us feedback and suggestions! >>> >>> Best, >>> Jincheng >>> >>> >>> >>> >>> Chesnay Schepler 于2019年7月3日周三 下午8:46写道： >>> >>>> So this would not be a source release then, but a full

Re: [VOTE] Publish the PyFlink into PyPI

Hi Jincheng, Thanks a lot for driving this. +1 (non-binding). Regards, Dian > 在 2019年8月1日，下午3:24，jincheng sun 写道： > > Hi all, > > Publish the PyFlink into PyPI is very important for our user, Please vote > on the following proposal: > > 1. Create PyPI Project for Apache Flink Python API, nam

Re: [ANNOUNCE] Hequn becomes a Flink committer

Congratulations, Hequn! Well deserved! > 在 2019年8月7日，下午5:13，Jeff Zhang 写道： > > Congrats Hequn! > > Paul Lam mailto:paullin3...@gmail.com>> 于2019年8月7日周三 > 下午5:08写道： > Congrats Hequn! Well deserved! > > Best, > Paul Lam > >> 在 2019年8月7日，16:28，jincheng sun > > 写

Re: [DISCUSS] Flink Python User-Defined Function for Table API

for Python users, we'd like to start the >> discussion about the Python UDF support in the Python Table API. >> Aljoscha Krettek, Dian Fu and I have discussed offline and have drafted a >> design doc[1]. It includes the following items: >> >> - The user-defined

Re: CiBot Update

Thanks Chesnay for your great work! A very useful feature! Just one minor suggestion: It will be better if we could add this command to the section "Bot commands" in the flinkbot template. Regards, Dian > 在 2019年8月23日，上午2:06，Ethan Li 写道： > > My question is specifically about implementation o

Re: [DISCUSS] Flink Python User-Defined Function for Table API

. Feel free to leave comments if >> there are anything not describe clearly. >> >> Best, >> Jincheng >> >> >> Dian Fu 于2019年8月14日周三 上午10:08写道： >> >>> Hi Thomas, >>> >>> Thanks a lot the suggestions. >>> >>> Regardin

Re: [ANNOUNCE] Apache Flink 1.9.0 released

Great news! Thanks Gordon and Kurt for pushing this forward and everybody who contributed to this release. Regards, Dian > 在 2019年8月23日，上午9:41，Guowei Ma 写道： > > Congratulations!! > Best, > Guowei > > > Congxian Qiu mailto:qcx978132...@gmail.com>> > 于2019年8月23日周五 上午9:32写道： > Congratulations,

Re: [DISCUSS] Flink Python User-Defined Function for Table API

Hi Jincheng, Appreciated for the kind tips and offering of help. Definitely need it! Could you grant me write permission for confluence? My Id: Dian Fu Thanks, Dian > 在 2019年8月26日，上午9:53，jincheng sun 写道： > > Thanks for your feedback Hequn & Dian. > > Dian, I am glad t

Re: [DISCUSS] Flink Python User-Defined Function for Table API

Hi Jincheng, Thanks! It works. Thanks, Dian > 在 2019年8月27日，上午10:55，jincheng sun 写道： > > Hi Dian, can you check if you have edit access? :) > > > Dian Fu 于2019年8月26日周一 上午10:52写道： > >> Hi Jincheng, >> >> Appreciated for the kind tips and offering of

[VOTE] FLIP-58: Flink Python User-Defined Function for Table API

Hi all, I'd like to start a voting thread for FLIP-58 [1] since that we have reached an agreement on the design in the discussion thread [2], This vote will be open for at least 72 hours. Unless there is an objection, I will try to close it by Sept 2, 2019 00:00 UTC if we have received sufficie

Re: [DISCUSS] Flink Python User-Defined Function for Table API

gt; Bowen > > > On Mon, Aug 26, 2019 at 8:05 PM Dian Fu wrote: > >> Hi Jincheng, >> >> Thanks! It works. >> >> Thanks, >> Dian >> >>> 在 2019年8月27日，上午10:55，jincheng sun 写道： >>> >>> Hi Dian, can you check if yo

Re: [DISCUSS] Releasing Flink 1.8.2

Hi Jincheng, Thanks a lot for bring up this discussion. +1 for this release. Regards, Dian > 在 2019年8月30日，下午6:31，Maximilian Michels 写道： > > Hi Jincheng, > > +1 I would be for a 1.8.2 release such that we can fix the problems with the > nested closure cleaner which currently block 1.8.1 users

Re: State of FLIPs

Hi Chesnay, Thanks a lot for the remind. FLIP-38 has been released in 1.9 and I have updated the status in the wiki page. Regards, Dian On Fri, Aug 30, 2019 at 9:38 PM Becket Qin wrote: > Hi Chesnay, > > You are right. FLIP-36 actually has not passed the vote yet. In fact some > of the key des

Re: [DISCUSS] FLIP-66: Support time attribute in SQL DDL

Hi Jark, Thanks for bringing up this discussion and the detailed design doc. This is definitely a critical feature for streaming SQL jobs. I have left a few comments in the design doc. Thanks, Dian > 在 2019年9月6日，上午11:48，Forward Xu 写道： > > Thanks Jark for this topic, This will be very useful.

Re: [DISCUSS] Support notifyOnMaster for notifyCheckpointComplete

Hi Jingsong, Thanks for bring up this discussion. You can try to look at the GlobalAggregateManager to see if it can meet your requirements. It can be got via StreamingRuntimeContext#getGlobalAggregateManager(). Regards, Dian > 在 2019年9月6日，下午1:39，shimin yang 写道： > > Hi Jingsong, > > Big fan

Re: [DISCUSS] Support notifyOnMaster for notifyCheckpointComplete

case as long as it's > an atomic operation. > > Dian Fu 于2019年9月6日周五 下午2:22写道： > >> Hi Jingsong, >> >> Thanks for bring up this discussion. You can try to look at the >> GlobalAggregateManager to see if it can meet your requirements. It can be >

Re: [DISCUSS] Flink Python User-Defined Function for Table API

feedback: >>>>>>>>>>> >>>>>>>>>>> 1. DataViews: With the current non-annotation design for >> DataViews, >>>>>> we >>>>>>>>>>> cannot perform eager state declaration, right? At whi

Re: [DISCUSS] Flink Python User-Defined Function for Table API

Hi all, I have updated the FLIP and removed content relate to UDAF and also changed the title of the FLIP to "Flink Python User-Defined Stateless Function for Table". Does it make sense to you? Regards, Dian > 在 2019年9月6日，下午6:09，Dian Fu 写道： > > Hi all, > > Thanks

Re: Checkpointing clarification

When a WindowOperator receives all the barrier from the upstream, it will forward the barrier to downstream operator and perform the checkpoint asynchronously. It doesn't have to wait the window to trigger before sending out the barrier. Regards, Dian > 在 2019年9月6日，下午8:02，Dominik Wosiński 写道：

Re: [ANNOUNCE] Kostas Kloudas joins the Flink PMC

Congratulations Kostas! Regards, Dian > 在 2019年9月6日，下午8:58，Wesley Peng 写道： > > On 2019/9/6 8:55 下午, Fabian Hueske wrote: >> I'm very happy to announce that Kostas Kloudas is joining the Flink PMC. >> Kostas is contributing to Flink for many years and puts lots of effort in >> helping our users

Re: [DISCUSS] Features for Apache Flink 1.10

Hi Gary, Thanks for kicking off the release schedule of 1.10. +1 for you and Yu Li as the release manager. The feature freeze/release time sounds reasonable. Thanks, Dian > 在 2019年9月7日，上午11:30，Jark Wu 写道： > > Thanks Gary for kicking off the discussion for 1.10 release. > > +1 for Gary and Y

Re: [VOTE] Release 1.8.2, release candidate #1

+1 (non-binding) - built from source successfully (mvn clean install -DskipTests) - checked gpg signature and hashes of the source release and binary release packages - All artifacts have been deployed to the maven central repository - no new dependencies were added since 1.8.1 - run a couple of

Re: [VOTE] FLIP-58: Flink Python User-Defined Function for Table API

;>>> Hi Dian, >>>>>>>> >>>>>>>> +1, >>>>>>>> Thanks a lot for driving this. >>>>>>>> >>>>>>>> Best, >>>>>>>> Xingbo >>>>>>>&g

Re: [DISCUSS] Support notifyOnMaster for notifyCheckpointComplete

more operation. But these accumulators are not fault-tolerant? >> >> Best, >> Jingsong Lee >> >> >> -- >> From:shimin yang >> Send Time:2019年9月6日(星期五) 15:21 >> To:dev >> Subject:Re: [DISCUSS] Support notifyOnMaster for notifyCheckpointCom

Re: [ANNOUNCE] Zili Chen becomes a Flink committer

Congratulations! > 在 2019年9月11日，下午5:26，Jeff Zhang 写道： > > Congratulations Zili Chen! > > Wesley Peng mailto:wes...@thepeng.eu>> 于2019年9月11日周三 > 下午5:25写道： > Hi > > on 2019/9/11 17:22, Till Rohrmann wrote: > > I'm very happy to announce that Zili Chen (some of you might also know > > him as T

Re: Flink stream python

Hi Milan, Hoping Till has answered your questions. WRT whether it supports to use libraries from Java code in Python, the answer is yes. Regarding to use Java connectors in Python, there are two ways: 1) If there is a Java TableFactory[1] defined for the connector, you could try to use the pyf

Re: [ANNOUNCE] Apache Flink 1.8.2 released

Thanks Jark for being the release manager and the great work! Also thanks to everyone who has contributed to this release. Regards, Dian > 在 2019年9月14日，上午3:24，Till Rohrmann 写道： > > Thanks Jark for being our release manager and thanks to everyone who has > contributed. > > Cheers, > Till > >

Re: [VOTE] Apache Flink ML Release 2.3.0, release candidate #1

+1 (binding) - Verified the checksums and signatures. - The website PR LGTM Regards, Dian On Thu, Jun 29, 2023 at 7:03 PM Zhipeng Zhang wrote: > > Thanks Dong and Xin for driving this release. > > +1 (non-binding) > > - Verified that the checksums and GPG files. > - Verified that the source dis

Re: [DISCUSS] Flink and Externalized connectors leads to block and circular dependency problems

Thanks Ran Tao for proposing this discussion and Martijn for sharing the thought. > While flink-python now fails the CI, it shouldn't actually depend on the externalized connectors. I'm not sure what PyFlink does with it, but if belongs to the connector code, For each DataStream connector, there

Re: [DISCUSS] Flink and Externalized connectors leads to block and circular dependency problems

ectors underneath? > > The wrapping of connectors is a bit of a maintenance nightmare and > doesn't really work with external/custom connectors. > > On 04/07/2023 13:35, Dian Fu wrote: > > Thanks Ran Tao for proposing this discussion and Martijn for sharing > > the th

Re: Python connector question

Hi Peter, Thanks a lot for taking care of this. Appreciate it! Re flink-sql-client-1.18.0.jar: The original motivation of including it in the PyFlink package is that we want to make sure that Python users get most things they need after piping install PyFlink. So most artifacts of a normal Flink

Re: [PROPOSAL] Contribute Flink CDC Connectors project to Apache Flink

Big +1 for this! Thanks for driving this effort! Regards, Dian On Mon, Dec 11, 2023 at 4:48 PM Leonard Xu wrote: > > Hey all, > > I want to extend my gratitude for the positive feedback we've received, > particularly from voices in other communities. It is an honor for the Flink > CDC communit

Re: Re: [VOTE] Accept Flink CDC into Apache Flink

+1 (binding) Regards, Dian On Wed, Jan 10, 2024 at 5:09 AM Sharath wrote: > > +1 (non-binding) > > Best, > Sharath > > On Tue, Jan 9, 2024 at 1:02 PM Venkata Sanath Muppalla > wrote: > > > +1 (non-binding) > > > > Thanks, > > Sanath > > > > On Tue, Jan 9, 2024 at 11:16 AM Peter Huang > > wrote

Re: [DISCUSS] Support Python ML Pipeline API

Hi Hequn, Thanks for bringing up the discussion. +1 to this feature. The design LGTM. It's great that the Python ML users could use both the Java Pipeline Transformer/Estimator/Model classes and the Python Pipeline Transformer/Estimator/Model in the same job. Regards, Dian On Mon, Feb 10, 2020 a

Re: [DISCUSS] Support scalar vectorized Python UDF in PyFlink

Hi Jincheng, Hequn & Jingsong, Thanks a lot for your suggestions. I have created FLIP-97[1] for this feature. > One little suggestion: maybe it would be nice if we can add some performance explanation in the document? (I just very curious:)) Thanks for the suggestion. I have updated the design do

Re: [DISCUSS] Support scalar vectorized Python UDF in PyFlink

We all realize that "batch.size" should be a larger value, so "bundle.size" > must also be increased. Now the default value of "bundle.size" is only 1000. > I think you can update design to provide meaningful default value for > "batch.size" and "

Re: [VOTE] Release Flink Python API(PyFlink) 1.9.2 to PyPI, release candidate #1

+1 (non-binding) - Verified the signature and checksum - Pip installed the package successfully: pip install apache-flink-1.9.2.tar.gz - Run word count example successfully. Regards, Dian > 在 2020年2月11日，上午11:44，jincheng sun 写道： > > > +1 (binding) > > - Install the PyFlink by `pip install` [

Re: [VOTE] FLIP-55: Introduction of a Table API Java Expression DSL

Hi Dawid, Thanks for driving this feature. The design looks very well for me overall. I have only one concern: $ is not allowed to be used in the identifier of Python and so we have to come out with another symbol when aligning this feature in the Python Table API. I noticed that there are also

Re: [DISCUSS] Support scalar vectorized Python UDF in PyFlink

Hi all, Thanks you all participating this discussion and sharing your thoughts. It seems that we have reached consensus on the design now. I will start a VOTE thread if there are no other feedbacks. Thanks, Dian On Tue, Feb 11, 2020 at 10:23 AM Dian Fu wrote: > Hi Jingsong, > > You

Re: [VOTE] FLIP-55: Introduction of a Table API Java Expression DSL

lus(1). >>> >>> @Jark I think it makes sense to shorten them, I will do it I hope people >>> that already voted don't mind. >>> >>> @Dian That's a valid concern. I would not discard the '$' as a column >>> expression for java and sca

[VOTE] Support scalar vectorized Python UDF in PyFlink

Hi all, I'd like to start the vote of FLIP-97[1] which is discussed and reached consensus in the discussion thread[2]. The vote will be open for at least 72 hours. Unless there is an objection, I will try to close it by Feb 17, 2020 08:00 UTC if we have received sufficient votes. Regards, Dia

Re: [ANNOUNCE] Apache Flink 1.10.0 released

Thanks Gary & Yu and everyone involved, Great work! Regards, Dian > 在 2020年2月12日，下午11:57，Haibo Sun 写道： > > Thanks Gary & Yu. Great work! > > Best, > Haibo > > At 2020-02-12 21:31:00, "Yu Li" wrote: > >The Apache Flink community is very happy to announce the release of Apache > >Flink 1.10.0,

Re: [ANNOUNCE] Apache Flink Python API(PyFlink) 1.9.2 released

Thanks for the great work, Jincheng. Regards, Dian > 在 2020年2月13日，下午1:32，jincheng sun 写道： > > Hi everyone, > > The Apache Flink community is very happy to announce the release of Apache > Flink Python API(PyFlink) 1.9.2, which is the first release to PyPI for the > Apache Flink Python API 1.

Re: [VOTE] Release flink-shaded 10.0, release candidate #3

+1 (non-binding) - Verified the signature and checksum - Checked the release note that all the tickets included in this release are there - Checked the website PR and it LGTM - Checked the notice file of the newly added module flink-shade-zookeeper-3 and it LGTM Regards, Dian > 在 2020年2月14日，下午

Re: [VOTE] Support Python ML Pipeline API

+1 (binding) Regards, Dian > 在 2020年2月14日，下午2:49，Yuan Mei 写道： > > +1 vote > > This is one of the most important things for Flink ML framework to be > widely adopted since most data scientists use python. > > Best > > Yuan > > On Fri, Feb 14, 2020 at 9:45 AM Hequn Cheng wrote: > >> Hi ever

Re: [ANNOUNCE] New Documentation Style Guide

Thanks for the great work! This is very helpful to keep the documentation style consistent across the whole project. It's also very helpful for non-native English contributors like me. > 在 2020年2月15日，下午3:42，Jark Wu 写道： > > Great summary! Thanks for adding the translation specification in it. >

Re: [VOTE] Support scalar vectorized Python UDF in PyFlink

e >> >> On Thu, Feb 13, 2020 at 11:45 AM jincheng sun >> wrote: >> >>> +1 (binding) >>> >>> Best, >>> Jincheng >>> >>> >>> Dian Fu 于2020年2月12日周三 下午1:31写道： >>> >>>> Hi all, >>>&

[RESULT][VOTE] FLIP-97: Support scalar vectorized Python UDF in PyFlink

Hi all, Thanks you all for the discussion and votes. So far, we have - 3 binding +1 votes (Jincheng, Hequn, Dian) - 1 non-binding +1 votes (Jingsong) - No -1 votes The voting time has passed and there are enough +1 votes. Therefore, I'm happy to announce that FLIP-97[1] has been accepted.

Re: [DISCUSS] Kicking off the 1.11 release cycle

Thanks Stephan kicking off this discussion and Zhijiang volunteering as one of the release managers. +1 for the "feature freeze date" around end of April. There are still more than 2 months left, so I think it's a reasonable time. Thanks, Dian > 在 2020年2月19日，下午10:52，Aljoscha Krettek 写道： > >

Re: [ANNOUNCE] Apache Flink-shaded 10.0 released

Thanks Chesnay for the great work and everyone involved! Regards, Dian > 在 2020年2月20日，上午12:21，Zhijiang 写道： > > Thanks Chesnay for making the release efficiently and also thanks to all the > other participants! > > Best, > Zhijiang > > > -

Re: [ANNOUNCE] Jingsong Lee becomes a Flink committer

Congrats Jingsong! > 在 2020年2月21日，上午11:39，Jark Wu 写道： > > Congratulations Jingsong! Well deserved. > > Best, > Jark > > On Fri, 21 Feb 2020 at 11:32, zoudan wrote: > >> Congratulations! Jingsong >> >> >> Best, >> Dan Zou >>

Re: Flink dev blog

Big +1 on this idea. It will benefit both the developers and users a lot. Regarding to the place to hold these blogs, my preference is 3) as I notice that there are already a few high quality blogs on flink web-site[1] and I guess that may be a good place to start with. We just need to figure ou

Re: Flink dev blog

es and title names. >>>>>>> Because, the dev blogs are very good learning materials. I >> believe >>>> many >>>>>>> users will be interested in these posts. It's just like >>>>>>> "Technology Deep Dive

Re: [DISCUSS] Disable "Squash and merge" button for Flink repository on GitHub

Hi Jark, Thanks for starting this discussion. Personally I also love the "squash and merge" button. It's very convenient. Regarding to the email address "noreply", it seems that there are two cases: - The email address in the original commit is already "noreply". In this case, this issue will s

Re: [DISCUSS] FLIP-112: Support User-Defined Metrics for Python UDF

Hi Hequn, Thanks for driving this. +1 to this feature. Just one minor comment: It seems that we will add an API get_metric_group for the Python class FunctionContext, could you update the FLIP reflecting this? Thanks, Dian > 在 2020年3月10日，下午3:38，Wei Zhong 写道： > > Hi Hequn, > > Thanks for dri

Re: [VOTE] FLIP-106: Support Python UDF in SQL Function DDL

+1 (binding) On Tue, Mar 17, 2020 at 6:56 PM Hequn Cheng wrote: > +1 (binding) > > Best, > Hequn > > > On Mar 17, 2020, at 5:03 PM, Benchao Li wrote: > > > > +1 (non-binding) > > > > BTW it's in the same thread in my gmail too. > > > > > > > > Kurt Young 于2020年3月17日周二 上午11:47写道： > > > >> Looks

Re: [VOTE] FLIP-112: Support User-Defined Metrics for Python UDF

+1 (binding) On Tue, Mar 17, 2020 at 10:35 AM jincheng sun wrote: > +1 > > Best, > Jincheng > > > > Hequn Cheng 于2020年3月16日周一 上午10:01写道： > > > Hi everyone, > > > > I'd like to start the vote of FLIP-112[1] which is discussed and reached > > consensus in the discussion thread[2]. > > The vote wi

Re: [DISCUSS] Introduce TableFactory for StatefulSequenceSource

Thanks Jingsong for bringing up this discussion. +1 to this proposal. I think Bowen's proposal makes much sense to me. This is also a painful problem for PyFlink users. Currently there is no built-in easy-to-use table source/sink and it requires users to write a lot of code to trying out PyFlin

Re: [DISCUSS] Switch to Azure Pipelines as the primary CI tool / switch off Travis

Hi Robert, Thanks a lot for your great work! Overall I'm +1 to switch to Azure as the primary CI tool if it's stable enough as I think there is no need to run both the travis and Azure for one single PR. However, there are still some improvements need to do and it would be great if these issue

Re: [DISCUSS] Switch to Azure Pipelines as the primary CI tool / switch off Travis

年3月25日，下午4:43，Chesnay Schepler 写道： > > @Dian we haven't been rebasing PR's against master for months, ever since we > switched to CiBot. > > On 25/03/2020 09:29, Dian Fu wrote: >> Hi Robert, >> >> Thanks a lot for your great work! >> >> Ove

Re: [DISCUSS] FLIP-114: Support Python UDF in SQL Client

Thanks Wei for this work! +1 to bring up the VOTE thread. > 在 2020年3月30日，下午2:43，jincheng sun 写道： > > Hi Wei, > > +1, Thanks for this discussion which is crucial for SQL users to use > PyFlink. Would be great to bring up the VOTE thread. > > Best, > Jincheng > > > Wei Zhong 于2020年3月30日周一 下午2

Re: [ANNOUNCE] Flink on Zeppelin (Zeppelin 0.9 is released)

Hi Jeff, Thanks for the great work and sharing it with the community! Very impressive and will try it out. Regards, Dian > 在 2020年3月30日，下午9:16，Till Rohrmann 写道： > > This is great news Jeff! Thanks a lot for sharing it with the community. > Looking forward trying Flink on Zeppelin out :-) >

[DISCUSS] FLIP-120: Support conversion between PyFlink Table and Pandas DataFrame

Hi everyone, I'd like to start a discussion about supporting conversion between PyFlink Table and Pandas DataFrame. Pandas dataframe is the de-facto standard to work with tabular data in Python community. PyFlink table is Flink’s representation of the tabular data in Python language. It would

Re: [DISCUSS] FLIP-120: Support conversion between PyFlink Table and Pandas DataFrame

think ArrowTableSink may not be enough for to_pandas, because pandas > dataframe is on client side, it is not a table sink. We still need to > convert ArrowTableSink to pandas dataframe if I understand correctly. > > > > > Dian Fu 于2020年4月1日周三 上午10:49写道： > >> Hi ev

Re: [ANNOUNCE] New Committers and PMC member

Congratulations to you all. > 在 2020年4月1日，下午5:00，Robert Metzger 写道： > > Welcome & congratulations to all of you! > > > On Wed, Apr 1, 2020 at 10:58 AM Jingsong Li wrote: > >> Congratulations! Konstantin, Dawid, Zhijiang. Well deserved. >> >> Best, >> Jingsong Lee >> >> On Wed, Apr 1, 2020

Re: [VOTE] Apache Flink Stateful Functions Release 2.0.0, release candidate #5

Another issue: https://issues.apache.org/jira/browse/FLINK-16932 The following packages which are declared in the NOTICE to be bundled in the jar of statefun-flink-distribution are not actually bundled in it: - org.apache.commons:commons-math3:

Re: [VOTE] FLIP-114: Support Python UDF in SQL Client

+1 (binding) Regards, Dian > 在 2020年4月3日，上午11:12，Hequn Cheng 写道： > > +1 (binding) > > Best, > Hequn > > On Fri, Apr 3, 2020 at 10:20 AM jincheng sun > wrote: > >> +1(binding) >> >> Best, >> Jincheng >> >> >> >> Xingbo Huang 于2020年4月1日周三 下午5:36写道： >> >>> Hi Wei, >>> >>> +1 (non-bindi

Re: [VOTE] Apache Flink Stateful Functions Release 2.0.0, release candidate #6

+1 (non-binding) - built from source with tests (mvn clean install) - verified the checksum and signature - checked the bundled licenses and notices - verified that the source distribution doesn't container unnecessary binaries - checked that the version pointed to the same version - flink-web PR

Re: [DISCUSS] FLIP-120: Support conversion between PyFlink Table and Pandas DataFrame

ndas in PyFlink! > > Best, > Wei > >> 在 2020年4月3日，13:46，jincheng sun 写道： >> >> +1, Thanks for bring up this discussion @Dian Fu >> >> Best, >> Jincheng >> >> >> Jeff Zhang 于2020年4月1日周三 下午1:27写道： >> >>> Thanks fo

Re: [DISCUSS] FLIP-121: Support Cython Optimizing Python User Defined Function

Hi Xingbo, Thanks a lot for the great work. Big +1 to this feature. The performance improvement is impressive. Regards, Dian > 在 2020年4月7日，下午12:38，Robert Metzger 写道： > > Thank you for posting the FLIP. > > The proposed integration with Azure Pipelines looks good to me. > > On Tue, Mar 31, 2

Re: [ANNOUNCE] New Flink committer: Seth Wiesman

Congratulations! > 在 2020年4月7日，下午2:35，Konstantin Knauf 写道： > > Congratulations, Seth! Well deserved :) > > On Tue, Apr 7, 2020 at 8:33 AM Tzu-Li (Gordon) Tai > wrote: > >> Hi everyone! >> >> On behalf of the PMC, I’m very happy to announce Seth Wiesman as a new >> Flink committer. >> >> Set

Re: [VOTE] FLIP-121: Support Cython Optimizing Python User Defined Function

+1 (binding) > 在 2020年4月8日，上午9:53，Xingbo Huang 写道： > > Hi all, > I would like to start the vote for FLIP-121[1], which is discussed and > reached a consensus in the discussion thread[2]. > > The vote will be open for at least 72h, unless there is an objection or not > enough votes. > > Best, >

[VOTE] FLIP-120: Support conversion between PyFlink Table and Pandas DataFrame

Hi all, I'd like to start the vote for FLIP-120[1] which is discussed and reached consensus in the discussion thread[2]. The vote will be open for at least 72 hours unless there is an objection or we have not received sufficient votes. Regards, Dian [1] https://cwiki.apache.org/confluence/di

Re: Configuring autolinks to Flink JIRA ticket in github repos

Cool! Thanks Yun for this effort. Very useful feature. Regards, Dian > 在 2020年4月9日，下午4:32，Yu Li 写道： > > Great! Thanks for the efforts Yun. > > Best Regards, > Yu > > > On Thu, 9 Apr 2020 at 16:15, Jark Wu wrote: > >> Thanks Yun, >> >> This's a great feature! I was surprised by the autolin

[DISCUSS] Releasing Flink 1.9.3

Hi all, It has been more than two months since we released Flink 1.9.2. There are already 36 improvements/bugfixes in the release-1.9 branch. Therefore, I propose to create the next bugfix release 1.9.3 for Flink 1.9. Most notable fixes are: - [FLINK-15085] HistoryServer dashboard config json

Re: [DISCUSS] Creating a new repo to host Flink benchmarks

+1 for this proposal. > 在 2020年4月10日，上午10:58，Zhijiang 写道： > > +1 for the proposal. > > Best, > Zhijiang > > > -- > From:Robert Metzger > Send Time:2020 Apr. 10 (Fri.) 02:15 > To:dev > Subject:Re: [DISCUSS] Creating a new repo

Re: [DISCUSS] Releasing Flink 1.9.3

hed. :) > > Best, > Jincheng > > > > Dian Fu 于2020年4月10日周五 上午11:08写道： > >> Hi all, >> >> It has been more than two months since we released Flink 1.9.2. There are >> already 36 improvements/bugfixes in the release-1.9 branch. Therefore, I >> pr

Re: [VOTE] FLIP-120: Support conversion between PyFlink Table and Pandas DataFrame

nding) >>> >>> Best, >>> Jincheng >>> >>> >>> >>> Xingbo Huang 于2020年4月9日周四 下午8:27写道： >>> >>>> Hi Dian, >>>> >>>> +1 (non-binding) >>>> Thanks a lot for driving thi

Re: [VOTE] FLIP-120: Support conversion between PyFlink Table and Pandas DataFrame

Hi all, Thanks a lot for the discussion and votes. I'll summarize the voting results in a separate email. Regards, Dian > 在 2020年4月13日，下午2:40，Dian Fu 写道： > > +1 (binding) > > Regards, > Dian > >> 在 2020年4月13日，下午1:31，Hequn Cheng 写道： >> >> +1 (

[RESULT][VOTE] FLIP-120: Support conversion between PyFlink Table and Pandas DataFrame

Hi all, The voting time for FLIP-120[1] has passed. I'm closing the vote now. There are 5 +1 votes, 3 of which are binding: - Jincheng (binding) - Hequn (binding) - Dian Fu (binding) - Xingbo Huang (non-binding) - Jeff (non-binding) There are no disapproving votes and thus FLIP-120 has

Re: [DISCUSS] Releasing "fat" and "slim" Flink distributions

+1 to this proposal. Missing connector jars is also a big problem for PyFlink users. Currently, after a Python user has installed PyFlink using `pip`, he has to manually copy the connector fat jars to the PyFlink installation directory for the connectors to be used if he wants to run jobs local

Re: [DISCUSS] Releasing Flink 1.9.3

heng for your continuous efforts on helping the releasing. >>>> >>>> Best, >>>> Hequn >>>> >>>> On Wed, Apr 15, 2020 at 3:45 PM Till Rohrmann >>>> wrote: >>>> >>>>> Hi Dian, >>>>> &

Re: [DISCUSS] Releasing Flink 1.10.1

Thanks a lot for driving this, Yu! Looking forward for the first RC of 1.10.1. > 在 2020年4月16日，上午10:24，jincheng sun 写道： > > Looking forward the first RC of Flink 1.10.1 . > Good job Yu! > > Best, > Jincheng > > > > Jark Wu 于2020年4月15日周三 下午6:28写道： > >> +1 to have a 1.10.1 RC soon. It has be

Re: [DISCUSS] Releasing Flink 1.9.3

Hi all, All the blocker issues for 1.9.3 have been resolved and I'm preparing the first RC now. Thanks, Dian > 在 2020年4月15日，下午10:27，Dian Fu 写道： > > Thanks you all for the positive feedback and thanks a lot Congxian and Yu for > working on FLINK-16576. > > I'

Re: [ANNOUNCE] New Apache Flink PMC Member - Hequn Chen

Congratulations, Hequn! > 在 2020年4月17日，下午2:36，Becket Qin 写道： > > Hi all, > > I am glad to announce that Hequn Chen has joined the Flink PMC. > > Hequn has contributed to Flink for years. He has worked on several > components including Table / SQL，PyFlink and Flink ML Pipeline. Besides, > Hequn

[VOTE] Release 1.9.3, release candidate #1

Hi everyone, Please review and vote on the release candidate #1 for the version 1.9.3, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release notes [1], *

Re: [VOTE] Release 1.9.3, release candidate #1

Fabian > > > On 18. Apr 2020, at 04:37, Dian Fu wrote: > > > > Hi everyone, > > > > Please review and vote on the release candidate #1 for the version 1.9.3, > > as follows: > > [ ] +1, Approve the release > > [ ] -1, Do not approve the rel

Re: [DISCUSS] Exact feature freeze date

+1 Regards, Dian > 在 2020年4月24日，上午9:47，Leonard Xu 写道： > > + 1 for the feature freeze date > > Best, > Leonard Xu > > >> 在 2020年4月24日，09:32，Jingsong Li 写道： >> >> +1 >> >> Best, >> Jingsong Lee >> >> On Fri, Apr 24, 2020 at 2:27 AM Zhu Zhu wrote: >> >>> +1 for extending the code freeze d

Re: [VOTE] Release 1.9.3, release candidate #1

;>> - checked that there are no missing artifacts in staging area >>>> - built from source sing scala 2.11 and using Scala 2.12 succeeded >>>> - ran a couple of end-to-end tests locally and succeeded >>>> - went through all commits checked in between 1.9.3 and 1.

  1   2   3   4   5   6   7   8   >