[jira] [Created] (FLINK-35208) Respect pipeline.cached-files during processing Python dependencies

2024-04-22 Thread Dian Fu (Jira)
Dian Fu created FLINK-35208: --- Summary: Respect pipeline.cached-files during processing Python dependencies Key: FLINK-35208 URL: https://issues.apache.org/jira/browse/FLINK-35208 Project: Flink

[jira] [Created] (FLINK-34985) It doesn't support to access fields by name for map function in thread mode

2024-04-01 Thread Dian Fu (Jira)
Dian Fu created FLINK-34985: --- Summary: It doesn't support to access fields by name for map function in thread mode Key: FLINK-34985 URL: https://issues.apache.org/jira/browse/FLINK-34985 Project: Flink

Re: Re: [VOTE] Accept Flink CDC into Apache Flink

2024-01-09 Thread Dian Fu
+1 (binding) Regards, Dian On Wed, Jan 10, 2024 at 5:09 AM Sharath wrote: > > +1 (non-binding) > > Best, > Sharath > > On Tue, Jan 9, 2024 at 1:02 PM Venkata Sanath Muppalla > wrote: > > > +1 (non-binding) > > > > Thanks, > > Sanath > > > > On Tue, Jan 9, 2024 at 11:16 AM Peter Huang > >

Re: [PROPOSAL] Contribute Flink CDC Connectors project to Apache Flink

2023-12-12 Thread Dian Fu
Big +1 for this! Thanks for driving this effort! Regards, Dian On Mon, Dec 11, 2023 at 4:48 PM Leonard Xu wrote: > > Hey all, > > I want to extend my gratitude for the positive feedback we've received, > particularly from voices in other communities. It is an honor for the Flink > CDC

Re: Python connector question

2023-11-30 Thread Dian Fu
Hi Peter, Thanks a lot for taking care of this. Appreciate it! Re flink-sql-client-1.18.0.jar: The original motivation of including it in the PyFlink package is that we want to make sure that Python users get most things they need after piping install PyFlink. So most artifacts of a normal Flink

[jira] [Created] (FLINK-32989) PyFlink wheel package build failed

2023-08-29 Thread Dian Fu (Jira)
Dian Fu created FLINK-32989: --- Summary: PyFlink wheel package build failed Key: FLINK-32989 URL: https://issues.apache.org/jira/browse/FLINK-32989 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-32724) Mark CEP API classes as Public / PublicEvolving

2023-08-01 Thread Dian Fu (Jira)
Dian Fu created FLINK-32724: --- Summary: Mark CEP API classes as Public / PublicEvolving Key: FLINK-32724 URL: https://issues.apache.org/jira/browse/FLINK-32724 Project: Flink Issue Type

Re: [DISCUSS] Flink and Externalized connectors leads to block and circular dependency problems

2023-07-05 Thread Dian Fu
erneath? > > The wrapping of connectors is a bit of a maintenance nightmare and > doesn't really work with external/custom connectors. > > On 04/07/2023 13:35, Dian Fu wrote: > > Thanks Ran Tao for proposing this discussion and Martijn for sharing > > the thought. > >

Re: [DISCUSS] Flink and Externalized connectors leads to block and circular dependency problems

2023-07-04 Thread Dian Fu
Thanks Ran Tao for proposing this discussion and Martijn for sharing the thought. > While flink-python now fails the CI, it shouldn't actually depend on the externalized connectors. I'm not sure what PyFlink does with it, but if belongs to the connector code, For each DataStream connector,

Re: [VOTE] Apache Flink ML Release 2.3.0, release candidate #1

2023-06-29 Thread Dian Fu
+1 (binding) - Verified the checksums and signatures. - The website PR LGTM Regards, Dian On Thu, Jun 29, 2023 at 7:03 PM Zhipeng Zhang wrote: > > Thanks Dong and Xin for driving this release. > > +1 (non-binding) > > - Verified that the checksums and GPG files. > - Verified that the source

[jira] [Created] (FLINK-32131) Support specifying hadoop config dir for Python HiveCatalog

2023-05-18 Thread Dian Fu (Jira)
Dian Fu created FLINK-32131: --- Summary: Support specifying hadoop config dir for Python HiveCatalog Key: FLINK-32131 URL: https://issues.apache.org/jira/browse/FLINK-32131 Project: Flink Issue

[jira] [Created] (FLINK-31949) The state of CountTumblingWindowAssigner of Python DataStream API were never purged

2023-04-26 Thread Dian Fu (Jira)
Dian Fu created FLINK-31949: --- Summary: The state of CountTumblingWindowAssigner of Python DataStream API were never purged Key: FLINK-31949 URL: https://issues.apache.org/jira/browse/FLINK-31949 Project

[jira] [Created] (FLINK-31905) Exception thrown when accessing nested field of the result of Python UDF with complex type

2023-04-24 Thread Dian Fu (Jira)
Dian Fu created FLINK-31905: --- Summary: Exception thrown when accessing nested field of the result of Python UDF with complex type Key: FLINK-31905 URL: https://issues.apache.org/jira/browse/FLINK-31905

[jira] [Created] (FLINK-31861) Introduce ByteArraySchema which serialize/deserialize data of type byte array

2023-04-19 Thread Dian Fu (Jira)
Dian Fu created FLINK-31861: --- Summary: Introduce ByteArraySchema which serialize/deserialize data of type byte array Key: FLINK-31861 URL: https://issues.apache.org/jira/browse/FLINK-31861 Project: Flink

[jira] [Created] (FLINK-31707) Constant string cannot be used as input arguments of Pandas UDAF

2023-04-03 Thread Dian Fu (Jira)
Dian Fu created FLINK-31707: --- Summary: Constant string cannot be used as input arguments of Pandas UDAF Key: FLINK-31707 URL: https://issues.apache.org/jira/browse/FLINK-31707 Project: Flink

[jira] [Created] (FLINK-31690) The current key is not set for KeyedCoProcessOperator

2023-04-02 Thread Dian Fu (Jira)
Dian Fu created FLINK-31690: --- Summary: The current key is not set for KeyedCoProcessOperator Key: FLINK-31690 URL: https://issues.apache.org/jira/browse/FLINK-31690 Project: Flink Issue Type: Bug

Re: [DISCUSS] FLIP-304: Pluggable failure handling for Apache Flink

2023-03-21 Thread Dian Fu
Hi Panagiotis, Thanks for the proposal. This is a very valuable feature and will be a good add-on for Flink. I also think that it will be great if we can consider how to make it possible for users to customize the failure handling in this FLIP. It's highly related to the problem we want to

[jira] [Created] (FLINK-31532) Support StreamExecutionEnvironment.socketTextStream in Python DataStream API

2023-03-21 Thread Dian Fu (Jira)
Dian Fu created FLINK-31532: --- Summary: Support StreamExecutionEnvironment.socketTextStream in Python DataStream API Key: FLINK-31532 URL: https://issues.apache.org/jira/browse/FLINK-31532 Project: Flink

[jira] [Created] (FLINK-31503) "org.apache.beam.sdk.options.PipelineOptionsRegistrar: Provider org.apache.beam.sdk.options.DefaultPipelineOptionsRegistrar not a subtype" is thrown when executing Pytho

2023-03-17 Thread Dian Fu (Jira)
Dian Fu created FLINK-31503: --- Summary: "org.apache.beam.sdk.options.PipelineOptionsRegistrar: Provider org.apache.beam.sdk.options.DefaultPipelineOptionsRegistrar not a subtype" is thrown when executing Python UDFs in SQL Client

[jira] [Created] (FLINK-31478) TypeError: a bytes-like object is required, not 'JavaList' is thrown when ds.execute_and_collect() is called on a KeyedStream

2023-03-15 Thread Dian Fu (Jira)
Dian Fu created FLINK-31478: --- Summary: TypeError: a bytes-like object is required, not 'JavaList' is thrown when ds.execute_and_collect() is called on a KeyedStream Key: FLINK-31478 URL: https://issues.apache.org/jira

Re: [VOTE] Release 1.15.4, release candidate #2

2023-03-13 Thread Dian Fu
+1 (binding) - Verified the checksum and signature - Installed PyFlink on MacOS and run a word count example successfully - The website PR LGTM Regards, Dian On Thu, Mar 9, 2023 at 8:22 PM Danny Cranmer wrote: > Hi everyone, > Please review and vote on the release candidate #2 for the version

Re: [VOTE] Release 1.15.4, release candidate #1

2023-03-05 Thread Dian Fu
date at this point unless I get a -1 > veto. Is this issue impacting all Python Datastream apps with a Tumbling > window or a subset? I am wondering why it is only a Major? > > Thanks, > Danny > > [1] https://lists.apache.org/thread/9w99mgx3nw5tc0v26wcvlyqxrcrkpzdz > >

Re: [VOTE] Release 1.15.4, release candidate #1

2023-03-02 Thread Dian Fu
Hi Danny, I'm sorry that I'm coming to this thread a little late. It seems that this will be the last bugfix release of Flink 1.15? If so, I'd like to also include https://issues.apache.org/jira/browse/FLINK-31272 into this release which fixes a serious issue of PyFlink. Regards, Dian On Thu,

[jira] [Created] (FLINK-31286) Python processes are still alive when shutting down a session cluster directly without stopping the jobs

2023-03-01 Thread Dian Fu (Jira)
Dian Fu created FLINK-31286: --- Summary: Python processes are still alive when shutting down a session cluster directly without stopping the jobs Key: FLINK-31286 URL: https://issues.apache.org/jira/browse/FLINK-31286

[jira] [Created] (FLINK-31272) Duplicate operators appear in the StreamGraph for Python DataStream API jobs

2023-02-28 Thread Dian Fu (Jira)
Dian Fu created FLINK-31272: --- Summary: Duplicate operators appear in the StreamGraph for Python DataStream API jobs Key: FLINK-31272 URL: https://issues.apache.org/jira/browse/FLINK-31272 Project: Flink

Re: [VOTE] FLIP-289: Support online inference (Flink ML)

2023-02-26 Thread Dian Fu
you all for the votes! > > > > > > The vote is now closed. I will announce the results in a separate > email. > > > > > > Cheers, > > > Dong > > > > > > On Thu, Feb 16, 2023 at 6:02 PM Zhipeng Zhang > > > > wrote: > > > >

Re: [ANNOUNCE] New Apache Flink Committer - Rui Fan

2023-02-21 Thread Dian Fu
Congratulations Rui! On Tue, Feb 21, 2023 at 6:34 PM Maximilian Michels wrote: > Congrats Rui! Well done!! > > -Max > > On Tue, Feb 21, 2023 at 10:09 AM Roman Khachatryan > wrote: > > > > Congratulations Rui! > > > > Regards, > > Roman > > > > > > On Mon, Feb 20, 2023 at 5:58 PM Anton

Re: [ANNOUNCE] New Apache Flink Committer - Anton Kalashnikov

2023-02-21 Thread Dian Fu
Congratulations Anton! On Tue, Feb 21, 2023 at 9:12 PM Austin Cawley-Edwards < austin.caw...@gmail.com> wrote: > Congrats Anton 拾 > > On Tue, Feb 21, 2023 at 04:08 Roman Khachatryan wrote: > > > Congratulations Anton, well deserved! > > > > Regards, > > Roman > > > > > > On Tue, Feb 21, 2023 at

Re: [ANNOUNCE] New Apache Flink Committer - Sergey Nuyanzin

2023-02-21 Thread Dian Fu
Congratulations Sergey! On Tue, Feb 21, 2023 at 9:07 PM Rui Fan wrote: > Congratulations, Sergey! > > Best > Rui Fan > > On Tue, Feb 21, 2023 at 20:55 Junrui Lee wrote: > > > Congratulations Sergey! > > > > weijie guo 于2023年2月21日周二 20:54写道: > > > > > Congratulations, Sergey~ > > > > > > Best

[jira] [Created] (FLINK-31172) Support coGroup in Python DataStream API

2023-02-21 Thread Dian Fu (Jira)
Dian Fu created FLINK-31172: --- Summary: Support coGroup in Python DataStream API Key: FLINK-31172 URL: https://issues.apache.org/jira/browse/FLINK-31172 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-31171) Support iterate in Python DataStream API

2023-02-21 Thread Dian Fu (Jira)
Dian Fu created FLINK-31171: --- Summary: Support iterate in Python DataStream API Key: FLINK-31171 URL: https://issues.apache.org/jira/browse/FLINK-31171 Project: Flink Issue Type: New Feature

Re: [ANNOUNCE] New Apache Flink PMC Member - Dong Lin

2023-02-15 Thread Dian Fu
Congratulations Dong! Regards, Dian On Thu, Feb 16, 2023 at 2:41 PM Junrui Lee wrote: > Congratulations, Dong! > > Best, > Junrui > > Guowei Ma 于2023年2月16日周四 14:21写道: > > > Hi, everyone > > > > On behalf of the PMC, I'm very happy to announce Dong Lin as a new > > Flink PMC. > > > >

Re: [ANNOUNCE] New Apache Flink Committer - Jing Ge

2023-02-15 Thread Dian Fu
Congratulations Jing! Regards, Dian On Wed, Feb 15, 2023 at 8:04 PM Yun Tang wrote: > Congratulations, Jing! > > Best > Yun Tang > > From: Dong Lin > Sent: Wednesday, February 15, 2023 19:40 > To: dev@flink.apache.org > Subject: Re: [ANNOUNCE] New Apache

Re: Re: [ANNOUNCE] New Apache Flink Committer - Weijie Guo

2023-02-13 Thread Dian Fu
Congratulations, Weijie! Regards, Dian On Mon, Feb 13, 2023 at 10:55 PM Matthias Pohl wrote: > Congrats, Weijie! :-) > > On Mon, Feb 13, 2023 at 10:50 AM Sergey Nuyanzin > wrote: > > > Congratulations, Weijie! > > > > On Mon, Feb 13, 2023 at 10:32 AM Yun Tang wrote: > > > > >

Re: [VOTE] FLIP-289: Support online inference (Flink ML)

2023-02-13 Thread Dian Fu
+1 (binding) Regards, Dian On Mon, Feb 13, 2023 at 11:04 AM Dong Lin wrote: > Hi all, > > We would like to start the vote for FLIP-289: Support online inference > (Flink ML) [1]. This FLIP was discussed in this thread [2]. > > The goal of this FLIP is to enable users to use the model trained

[jira] [Created] (FLINK-31043) KeyError exception is thrown in CachedMapState

2023-02-13 Thread Dian Fu (Jira)
Dian Fu created FLINK-31043: --- Summary: KeyError exception is thrown in CachedMapState Key: FLINK-31043 URL: https://issues.apache.org/jira/browse/FLINK-31043 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-31031) Disable the output buffer of Python process to make it more convenient for interactive users

2023-02-12 Thread Dian Fu (Jira)
Dian Fu created FLINK-31031: --- Summary: Disable the output buffer of Python process to make it more convenient for interactive users Key: FLINK-31031 URL: https://issues.apache.org/jira/browse/FLINK-31031

Re: [DISCUSS] FLIP-289: Support online inference (Flink ML)

2023-02-09 Thread Dian Fu
Hi Dong, Thanks for the reply. Got your points and it makes sense to me now~ Regards, Dian On Thu, Feb 9, 2023 at 3:45 PM Dong Lin wrote: > Hi Dian, > > Thanks for the review! Please see my reply inline. > > Regards, > Dong > > On Wed, Feb 8, 2023 at 11:58 AM Dian

Re: [DISCUSS] FLIP-289: Support online inference (Flink ML)

2023-02-07 Thread Dian Fu
Hi Dong, Thanks for driving this effort! This FLIP LGTM overall. I have just a few minor comments regarding the proposed API: 1) For the method `DataFrame.collect()`, why is it named `collect` instead of something else, e.g. `get`? Does it mean that the result will be computed during this

Re: [ANNOUNCE] New Apache Flink Committer - Lincoln Lee

2023-01-09 Thread Dian Fu
Congratulations, Lincoln! Regards, Dian On Tue, Jan 10, 2023 at 1:31 PM weijie guo wrote: > Congratulations, Lincoln! > > Best regards, > > Weijie > > > Lijie Wang 于2023年1月10日周二 12:24写道: > > > Congratulations, Lincoln! > > > > Best, > > Lijie > > > > Jingsong Li 于2023年1月10日周二 12:07写道: > > >

[jira] [Created] (FLINK-30364) Job failed without exception stack

2022-12-11 Thread Dian Fu (Jira)
Dian Fu created FLINK-30364: --- Summary: Job failed without exception stack Key: FLINK-30364 URL: https://issues.apache.org/jira/browse/FLINK-30364 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-30308) ClassCastException: class java.io.ObjectStreamClass$Caches$1 cannot be cast to class java.util.Map is showing in the logging when the job shutdown

2022-12-05 Thread Dian Fu (Jira)
Dian Fu created FLINK-30308: --- Summary: ClassCastException: class java.io.ObjectStreamClass$Caches$1 cannot be cast to class java.util.Map is showing in the logging when the job shutdown Key: FLINK-30308 URL: https

[ANNOUNCE] New Apache Flink PMC Members - Godfrey He, Xingbo Huang

2022-11-22 Thread Dian Fu
Hi everyone, On behalf of the Apache Flink PMC, I'm very happy to announce that Godfrey He and Xingbo Huang have joined the Flink PMC! Godfrey He becomes a Flink committer in Sep 2020. His contributions are mainly focused on the Flink table module, covering almost all important parts such as

Re: [ANNOUNCE] New Apache Flink Committer - Matyas Orhidi

2022-11-21 Thread Dian Fu
Congrats Matyas! On Tue, Nov 22, 2022 at 9:00 AM Tony Wei wrote: > Congrats Matyas! > > Thomas Weise 於 2022年11月22日 週二 上午8:56寫道: > > > Congrats Matyas! > > > > > > On Mon, Nov 21, 2022 at 6:28 PM Őrhidi Mátyás > > wrote: > > > > > Thanks folks, > > > > > > So proud and honored to be part of

Re: [VOTE] Release 1.14.6, release candidate #2

2022-09-22 Thread Dian Fu
+1 (binding) - Reviewed the flink-web PR - Installed the PyFlink package and run a simple example successfully - Verified the checksum and signature Regards, Dian On Thu, Sep 22, 2022 at 8:36 PM Yun Tang wrote: > +1 (non-binding) > > > * Check the checksums of released tar packages. > *

[jira] [Created] (FLINK-29192) Add completeness test for built-in functions between Java and Python Table API

2022-09-05 Thread Dian Fu (Jira)
Dian Fu created FLINK-29192: --- Summary: Add completeness test for built-in functions between Java and Python Table API Key: FLINK-29192 URL: https://issues.apache.org/jira/browse/FLINK-29192 Project: Flink

[jira] [Created] (FLINK-28886) Support HybridSource in Python DataStream API

2022-08-09 Thread Dian Fu (Jira)
Dian Fu created FLINK-28886: --- Summary: Support HybridSource in Python DataStream API Key: FLINK-28886 URL: https://issues.apache.org/jira/browse/FLINK-28886 Project: Flink Issue Type: Improvement

Re: Python Job Support for the Kubernetes Operator

2022-07-05 Thread Dian Fu
Thanks for the confirmation Matyas! On Tue, Jul 5, 2022 at 3:00 PM Őrhidi Mátyás wrote: > Yes, this is the plan Dian. Appreciate your assistance! > > Best, > Matyas > > On Tue, Jul 5, 2022 at 8:55 AM Dian Fu wrote: > >> Hi Matyas, >> >> Accordin

Re: Python Job Support for the Kubernetes Operator

2022-07-05 Thread Dian Fu
te: > >> Thank you for the info and help Dian :) >> >> Gyula >> >> On Tue, 5 Jul 2022 at 05:14, Yang Wang wrote: >> >> > Thanks Dian for the confirmation and nice help. >> > >> > Best, >> > Yang >> > >> > Dian Fu

Re: [VOTE] Apache Flink ML Release 2.1.0, release candidate #2

2022-07-05 Thread Dian Fu
+1 (binding) - Verified the checksum and signature - Installed the Python package and runs an example documented here[1] - Reviewed the website PR and LGTM overall Regards, Dian [1] https://nightlies.apache.org/flink/flink-ml-docs-master/docs/operators/clustering/kmeans/#examples On Mon, Jul

Re: Python Job Support for the Kubernetes Operator

2022-07-04 Thread Dian Fu
r. > However, they need some manual operations, including specify the user jar, > download python script via init container, etc. > > What we could do in the Flink kubernetes operator is to make the > submission more convenient by introducing a new field(e.g. pyScript). > > cc @Dian

[jira] [Created] (FLINK-28253) LocalDateTime is not supported in PyFlink

2022-06-26 Thread Dian Fu (Jira)
Dian Fu created FLINK-28253: --- Summary: LocalDateTime is not supported in PyFlink Key: FLINK-28253 URL: https://issues.apache.org/jira/browse/FLINK-28253 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-28140) Improve the documentation by adding Python examples

2022-06-20 Thread Dian Fu (Jira)
Dian Fu created FLINK-28140: --- Summary: Improve the documentation by adding Python examples Key: FLINK-28140 URL: https://issues.apache.org/jira/browse/FLINK-28140 Project: Flink Issue Type

Re: [ANNOUNCE] New Apache Flink Committers: Qingsheng Ren, Shengkai Fang

2022-06-20 Thread Dian Fu
Congratulations, Qingsheng and ShengKai! Regards, Dian On Mon, Jun 20, 2022 at 5:41 PM Lincoln Lee wrote: > Congrats, Qingsheng and Shengkai! > > > Best, > Lincoln Lee > > > Sergey Nuyanzin 于2022年6月20日周一 17:24写道: > > > Congratulations, Qingsheng and ShengKai. > > > > On Mon, Jun 20, 2022 at

[jira] [Created] (FLINK-28114) The path of the Python client interpreter could not point to an archive file in distributed file system

2022-06-17 Thread Dian Fu (Jira)
Dian Fu created FLINK-28114: --- Summary: The path of the Python client interpreter could not point to an archive file in distributed file system Key: FLINK-28114 URL: https://issues.apache.org/jira/browse/FLINK-28114

Re: [VOTE] Release 1.14.5, release candidate #1

2022-06-16 Thread Dian Fu
+1 (binding) - Verified the checksum and signature - Reviewed the website PR - Go through the artifacts to be deployed to maven central repository, there should be no missing artifacts Regards, Dian On Tue, Jun 14, 2022 at 11:27 AM Xingbo Huang wrote: > +1 (non-binding) > > - verify

Re: [ANNOUNCE] New Apache Flink PMC Member - Jingsong Lee

2022-06-15 Thread Dian Fu
Congratulations, Jingsong! Regards, Dian On Thu, Jun 16, 2022 at 1:08 AM Yu Li wrote: > Congrats, Jingsong! > > Best Regards, > Yu > > > On Wed, 15 Jun 2022 at 15:26, Sergey Nuyanzin wrote: > > > Congratulations, Jingsong! > > > > On Wed, Jun 15, 2022 at 8:45 AM Jingsong Li > > wrote: > > >

[jira] [Created] (FLINK-28071) Support missing built-in functions in Table API

2022-06-14 Thread Dian Fu (Jira)
Dian Fu created FLINK-28071: --- Summary: Support missing built-in functions in Table API Key: FLINK-28071 URL: https://issues.apache.org/jira/browse/FLINK-28071 Project: Flink Issue Type: Sub-task

Re: [VOTE] FLIP-228: Support Within between events in CEP Pattern

2022-06-13 Thread Dian Fu
+1 (binding) Regards, Dian On Mon, Jun 13, 2022 at 3:55 PM Rui Fan <1996fan...@gmail.com> wrote: > Thanks for Nicholas driving this. > > +1(non-binding) > > Best, > Rui Fan > > On Mon, Jun 13, 2022 at 3:05 PM md peng wrote: > > > +1(not-binding) > > > > Best, > > Mingde Peng > > > > Martijn

[jira] [Created] (FLINK-28015) FROM_UNIXTIME could not be used in Table API

2022-06-12 Thread Dian Fu (Jira)
Dian Fu created FLINK-28015: --- Summary: FROM_UNIXTIME could not be used in Table API Key: FLINK-28015 URL: https://issues.apache.org/jira/browse/FLINK-28015 Project: Flink Issue Type: Bug

Re: [DISCUSS] FLIP-228: Support Within between events in CEP Pattern

2022-06-10 Thread Dian Fu
nType` could update to > `PREVIOUS_AND_NEXT` and `FIRST_AND_LAST` which directly indicate the time > interval within the PREVIOUS and NEXT event and within the FIRST and LAST > event. `RELATIVE_TO_FIRST` and `RELATIVE_TO_PREVIOUS` are not clear to > understand which event

Re: [DISCUSS] FLIP-228: Support Within between events in CEP Pattern

2022-06-08 Thread Dian Fu
; Best regards, > > Martijn > > Op ma 6 jun. 2022 om 09:49 schreef Dian Fu : > > > Hi Nicholas, > > > > Thanks a lot for the update. > > > > Regarding the pattern API, should we also introduce APIs such as > > Pattern.times(int from, int to, Time wi

Re: [DISCUSS] FLIP-228: Support Within between events in CEP Pattern

2022-06-06 Thread Dian Fu
artijn > > https://twitter.com/MartijnVisser82 > > https://github.com/MartijnVisser > > > > > > On Sat, 7 May 2022 at 11:17, Dian Fu wrote: > > > > > Hi Nicholas, > > > > > > Thanks a lot for bringing up this discussion. If I recall

Re: [DISCUSS] Releasing Flink 1.14.5

2022-05-26 Thread Dian Fu
Hi Xingbo, Thanks for driving this release. +1 for 1.14.5 as there are already nearly 100 commits [1] since 1.14.4. Regards, Dian [1] https://github.com/apache/flink/compare/release-1.14.4...release-1.14 On Tue, May 24, 2022 at 2:23 PM Xingbo Huang wrote: > Hi all, > > I would like to start

[jira] [Created] (FLINK-27760) NPE is thrown when executing PyFlink jobs in batch mode

2022-05-24 Thread Dian Fu (Jira)
Dian Fu created FLINK-27760: --- Summary: NPE is thrown when executing PyFlink jobs in batch mode Key: FLINK-27760 URL: https://issues.apache.org/jira/browse/FLINK-27760 Project: Flink Issue Type

[jira] [Created] (FLINK-27729) Support constructing StartCursor and StopCursor from MessageId

2022-05-21 Thread Dian Fu (Jira)
Dian Fu created FLINK-27729: --- Summary: Support constructing StartCursor and StopCursor from MessageId Key: FLINK-27729 URL: https://issues.apache.org/jira/browse/FLINK-27729 Project: Flink Issue

[jira] [Created] (FLINK-27598) Improve the exception message when mixing use Python UDF and Pandas UDF

2022-05-13 Thread Dian Fu (Jira)
Dian Fu created FLINK-27598: --- Summary: Improve the exception message when mixing use Python UDF and Pandas UDF Key: FLINK-27598 URL: https://issues.apache.org/jira/browse/FLINK-27598 Project: Flink

[jira] [Created] (FLINK-27584) Support broadcast state in PyFlink DataStream API

2022-05-12 Thread Dian Fu (Jira)
Dian Fu created FLINK-27584: --- Summary: Support broadcast state in PyFlink DataStream API Key: FLINK-27584 URL: https://issues.apache.org/jira/browse/FLINK-27584 Project: Flink Issue Type: New

[jira] [Created] (FLINK-27564) Split PyFlink DataStream connectors into separate files

2022-05-10 Thread Dian Fu (Jira)
Dian Fu created FLINK-27564: --- Summary: Split PyFlink DataStream connectors into separate files Key: FLINK-27564 URL: https://issues.apache.org/jira/browse/FLINK-27564 Project: Flink Issue Type

[jira] [Created] (FLINK-27545) Update examples in PyFlink shell

2022-05-08 Thread Dian Fu (Jira)
Dian Fu created FLINK-27545: --- Summary: Update examples in PyFlink shell Key: FLINK-27545 URL: https://issues.apache.org/jira/browse/FLINK-27545 Project: Flink Issue Type: Bug Components

Re: Re: [ANNOUNCE] New Flink PMC member: Yang Wang

2022-05-07 Thread Dian Fu
Congrats Yang! Regards, Dian On Sat, May 7, 2022 at 12:51 PM Jacky Lau wrote: > Congrats Yang and well Deserved! > > Best, > Jacky Lau > > Yun Gao 于2022年5月7日周六 10:44写道: > > > Congratulations Yang! > > > > Best, > > Yun Gao > > > > > > > > --Original Mail -- >

Re: [DISCUSS] FLIP-228: Support Within between events in CEP Pattern

2022-05-07 Thread Dian Fu
Hi Nicholas, Thanks a lot for bringing up this discussion. If I recall it correctly, this feature has been requested many times by the users and is among one of the most requested features in CEP. So big +1 to this feature overall. Regarding the API, the name `partialWithin` sounds a little

[jira] [Created] (FLINK-27421) Bundle test utility classes into the PyFlink package to make users write test cases easily

2022-04-26 Thread Dian Fu (Jira)
Dian Fu created FLINK-27421: --- Summary: Bundle test utility classes into the PyFlink package to make users write test cases easily Key: FLINK-27421 URL: https://issues.apache.org/jira/browse/FLINK-27421

[jira] [Created] (FLINK-27373) Disable installing PyFlink using `python setup.py install`

2022-04-24 Thread Dian Fu (Jira)
Dian Fu created FLINK-27373: --- Summary: Disable installing PyFlink using `python setup.py install` Key: FLINK-27373 URL: https://issues.apache.org/jira/browse/FLINK-27373 Project: Flink Issue Type

[jira] [Created] (FLINK-27223) State access doesn't work as expected when cache size is set to 0

2022-04-13 Thread Dian Fu (Jira)
Dian Fu created FLINK-27223: --- Summary: State access doesn't work as expected when cache size is set to 0 Key: FLINK-27223 URL: https://issues.apache.org/jira/browse/FLINK-27223 Project: Flink

Re: [ANNOUNCE] New scalafmt formatter has been merged

2022-04-13 Thread Dian Fu
Thanks a lot for this great work Francesco! Regards, Dian On Wed, Apr 13, 2022 at 3:23 PM Marios Trivyzas wrote: > Thank you for this Francesco! > > It will really improve the lives of everyone touching scala code! > > Best, > Marios > > On Wed, Apr 13, 2022 at 9:55 AM Timo Walther wrote: > >

[jira] [Created] (FLINK-27126) Respect the state cache size configurations in Python DataStream API operators

2022-04-07 Thread Dian Fu (Jira)
Dian Fu created FLINK-27126: --- Summary: Respect the state cache size configurations in Python DataStream API operators Key: FLINK-27126 URL: https://issues.apache.org/jira/browse/FLINK-27126 Project: Flink

[jira] [Created] (FLINK-27108) State cache clean up doesn't work as expected

2022-04-07 Thread Dian Fu (Jira)
Dian Fu created FLINK-27108: --- Summary: State cache clean up doesn't work as expected Key: FLINK-27108 URL: https://issues.apache.org/jira/browse/FLINK-27108 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-27067) Prevent usage of deprecated APIs in PyFlink examples

2022-04-05 Thread Dian Fu (Jira)
Dian Fu created FLINK-27067: --- Summary: Prevent usage of deprecated APIs in PyFlink examples Key: FLINK-27067 URL: https://issues.apache.org/jira/browse/FLINK-27067 Project: Flink Issue Type

[jira] [Created] (FLINK-26986) Remove deprecated string expressions in Python Table API

2022-04-01 Thread Dian Fu (Jira)
Dian Fu created FLINK-26986: --- Summary: Remove deprecated string expressions in Python Table API Key: FLINK-26986 URL: https://issues.apache.org/jira/browse/FLINK-26986 Project: Flink Issue Type

[jira] [Created] (FLINK-26920) It reported "The configured managed memory fraction for Python worker process must be within (0, 1], was: %s."

2022-03-30 Thread Dian Fu (Jira)
Dian Fu created FLINK-26920: --- Summary: It reported "The configured managed memory fraction for Python worker process must be within (0, 1], was: %s." Key: FLINK-26920 URL: https://issues.apache.org/jira/br

[jira] [Created] (FLINK-26919) Table API program compiles field with "Cannot resolve field [a], input field list:[EXPR$0]"

2022-03-29 Thread Dian Fu (Jira)
Dian Fu created FLINK-26919: --- Summary: Table API program compiles field with "Cannot resolve field [a], input field list:[EXPR$0]" Key: FLINK-26919 URL: https://issues.apache.org/jira/browse/F

[jira] [Created] (FLINK-26855) ImportError: cannot import name 'environmentfilter' from 'jinja2'

2022-03-24 Thread Dian Fu (Jira)
Dian Fu created FLINK-26855: --- Summary: ImportError: cannot import name 'environmentfilter' from 'jinja2' Key: FLINK-26855 URL: https://issues.apache.org/jira/browse/FLINK-26855 Project: Flink

[jira] [Created] (FLINK-26847) Unify the logic for the command line option -py and -pym

2022-03-24 Thread Dian Fu (Jira)
Dian Fu created FLINK-26847: --- Summary: Unify the logic for the command line option -py and -pym Key: FLINK-26847 URL: https://issues.apache.org/jira/browse/FLINK-26847 Project: Flink Issue Type

[jira] [Created] (FLINK-26846) Gauge metrics doesn't work in PyFlink

2022-03-24 Thread Dian Fu (Jira)
Dian Fu created FLINK-26846: --- Summary: Gauge metrics doesn't work in PyFlink Key: FLINK-26846 URL: https://issues.apache.org/jira/browse/FLINK-26846 Project: Flink Issue Type: Bug

Re: [DISCUSS] Structure of the Flink Documentation (Languages & APIs)

2022-03-23 Thread Dian Fu
To summarize, I tend to Option 2 "Language First" in case we could find a way to eliminate documentation duplication. On Wed, Mar 23, 2022 at 5:02 PM Dian Fu wrote: > Hi Konstantin, > > Thanks a lot for bringing up this discussion. > > Currently, the Python documentati

Re: [DISCUSS] Structure of the Flink Documentation (Languages & APIs)

2022-03-23 Thread Dian Fu
Hi Konstantin, Thanks a lot for bringing up this discussion. Currently, the Python documentation is more like a mixture of Option 1 and Option 2. It contains two parts: 1) The first part is the independent page [1] which could be seen as the main entrypoint for Python users. 2) The second part

Re: status of Apple Silicon (M1) as Flink dev platform?

2022-03-09 Thread Dian Fu
Hi David, Thanks for bringing up this question. Regarding PyFlink, the dependent Python libraries have already supported M1 recently and so I guess we could also make it in the next release, e.g. Flink 1.16. I will follow up with it. Regards, Dian On Wed, Mar 9, 2022 at 3:27 PM Yun Tang

[jira] [Created] (FLINK-26506) Support StreamExecutionEnvironment.registerCachedFile in Python DataStream API

2022-03-06 Thread Dian Fu (Jira)
Dian Fu created FLINK-26506: --- Summary: Support StreamExecutionEnvironment.registerCachedFile in Python DataStream API Key: FLINK-26506 URL: https://issues.apache.org/jira/browse/FLINK-26506 Project: Flink

[jira] [Created] (FLINK-26483) Support WindowedStream.aggregate in Python DataStream API

2022-03-03 Thread Dian Fu (Jira)
Dian Fu created FLINK-26483: --- Summary: Support WindowedStream.aggregate in Python DataStream API Key: FLINK-26483 URL: https://issues.apache.org/jira/browse/FLINK-26483 Project: Flink Issue Type

[jira] [Created] (FLINK-26482) Support WindowedStream.reduce in Python DataStream API

2022-03-03 Thread Dian Fu (Jira)
Dian Fu created FLINK-26482: --- Summary: Support WindowedStream.reduce in Python DataStream API Key: FLINK-26482 URL: https://issues.apache.org/jira/browse/FLINK-26482 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-26481) Support side output for windowing in Python DataStream API

2022-03-03 Thread Dian Fu (Jira)
Dian Fu created FLINK-26481: --- Summary: Support side output for windowing in Python DataStream API Key: FLINK-26481 URL: https://issues.apache.org/jira/browse/FLINK-26481 Project: Flink Issue Type

[jira] [Created] (FLINK-26480) Support window_all in Python DataStream API

2022-03-03 Thread Dian Fu (Jira)
Dian Fu created FLINK-26480: --- Summary: Support window_all in Python DataStream API Key: FLINK-26480 URL: https://issues.apache.org/jira/browse/FLINK-26480 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-26479) Add time_window and count_window in KeyedStream in Python DataStream API

2022-03-03 Thread Dian Fu (Jira)
Dian Fu created FLINK-26479: --- Summary: Add time_window and count_window in KeyedStream in Python DataStream API Key: FLINK-26479 URL: https://issues.apache.org/jira/browse/FLINK-26479 Project: Flink

[jira] [Created] (FLINK-26478) Support evictor in Python DataStream API

2022-03-03 Thread Dian Fu (Jira)
Dian Fu created FLINK-26478: --- Summary: Support evictor in Python DataStream API Key: FLINK-26478 URL: https://issues.apache.org/jira/browse/FLINK-26478 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-26477) Finalize the window support in Python DataStream API

2022-03-03 Thread Dian Fu (Jira)
Dian Fu created FLINK-26477: --- Summary: Finalize the window support in Python DataStream API Key: FLINK-26477 URL: https://issues.apache.org/jira/browse/FLINK-26477 Project: Flink Issue Type

Re: Re: Change of focus

2022-03-01 Thread Dian Fu
Thanks for the efforts you have done for the community. Good luck! Regards, Dian On Tue, Mar 1, 2022 at 10:28 PM Guowei Ma wrote: > Thanks Till for everything you've done for the community! > It has been a great honor working with you. > > Best, > Guowei > > > On Tue, Mar 1, 2022 at 9:26 PM

Re: [ANNOUNCE] New Flink PMC members: Igal Shilman, Konstantin Knauf and Yun Gao

2022-02-17 Thread Dian Fu
Congratulations! Regards, Dian On Thu, Feb 17, 2022 at 6:54 PM Johannes Moser wrote: >  > > > On 17.02.2022, at 10:19, Yuan Mei wrote: > > > > Congratulations! > > > > Best Regards, > > Yuan > > > > On Thu, Feb 17, 2022 at 5:17 PM Aitozi wrote: > > > >> Congratulations! > >> > >> Best, > >>

Re: [ANNOUNCE] New Apache Flink Committers: Feng Wang, Zhipeng Zhang

2022-02-17 Thread Dian Fu
Congratulations! Regards, Dian On Thu, Feb 17, 2022 at 5:18 PM Yuan Mei wrote: > Congratulations! > > Best Regards, > Yuan > > On Thu, Feb 17, 2022 at 5:15 PM Aitozi wrote: > > > Congratulations! > > > > Best, > > Aitozi > > > > Guowei Ma 于2022年2月17日周四 15:52写道: > > > > > Congratulations to

Re: [VOTE] FLIP-205: Support cache in DataStream for Batch Processing

2022-01-21 Thread Dian Fu
+1 (binding) Thanks for driving this. Looking forward to this feature. Regards, Dian On Thu, Jan 20, 2022 at 5:57 PM Gen Luo wrote: > +1 (non-binding) > > On Thu, Jan 20, 2022 at 3:26 PM Yun Gao > wrote: > > > +1 (binding) > > > > Thanks Xuannan for driving this! > > > > Best, > > Yun > > >

  1   2   3   4   5   6   7   8   >