[ANNOUNCE] Apache Flink Stateful Functions 2.2.0 released

2020-09-27 Thread Tzu-Li (Gordon) Tai
The Apache Flink community is very happy to announce the release of Apache Flink Stateful Functions 2.2.0. Stateful Functions is an API that simplifies the building of distributed stateful applications with a runtime built for serverless architectures. It's based on functions with persistent state

Re: [DISCUSS] Support registering custom JobStatusListeners when scheduling a job

2020-09-27 Thread 季文昊
Hi Aljoscha, Yes, that is not enough, since the `JobListener`s are called only once when `excute()` or `executeAsync()` is called. And in order to sync the status, I also have to call `JobClient#getJobStatus` periodically. On Fri, Sep 25, 2020 at 8:12 PM Aljoscha Krettek wrote: > Hi, > > I unde

[jira] [Created] (FLINK-19438) Queryable State need implement both read-uncommitted and read-committed

2020-09-27 Thread sheep (Jira)
sheep created FLINK-19438: - Summary: Queryable State need implement both read-uncommitted and read-committed Key: FLINK-19438 URL: https://issues.apache.org/jira/browse/FLINK-19438 Project: Flink Is

[jira] [Created] (FLINK-19437) FileSourceTextLinesITCase.testContinuousTextFileSource failed with "SimpleStreamFormat is not splittable, but found split end (0) different from file length (198)"

2020-09-27 Thread Dian Fu (Jira)
Dian Fu created FLINK-19437: --- Summary: FileSourceTextLinesITCase.testContinuousTextFileSource failed with "SimpleStreamFormat is not splittable, but found split end (0) different from file length (198)" Key: FLINK-19437

Apply for permission of jira contributor

2020-09-27 Thread Xie Billy
Hi Guys, I want to contribute to Apache Flink. Would you please give me the permission as a contributor? My JIRA ID is billyxie. thanks a lot. Best Regards! Billy xie(谢志民)

[jira] [Created] (FLINK-19436) TPC-DS end-to-end test (Blink planner) failed during shutdown

2020-09-27 Thread Dian Fu (Jira)
Dian Fu created FLINK-19436: --- Summary: TPC-DS end-to-end test (Blink planner) failed during shutdown Key: FLINK-19436 URL: https://issues.apache.org/jira/browse/FLINK-19436 Project: Flink Issue Ty

Re: [VOTE] FLIP-33: Standardize connector metrics

2020-09-27 Thread Becket Qin
Hi all, Thanks everyone for voting. Here is the result: binding +1s: 4 (Stephan, Yu, Jincheng, Becket) There is no -1 or non-binding +1s. FLIP-33 has been accepted. Thanks, Jiangjie (Becket) Qin On Sun, Sep 27, 2020 at 7:18 PM Stephan Ewen wrote: > +1 > > On Mon, Sep 21, 2020 at 11:48 AM Yu

Re: [VOTE] FLIP-143: Unified Sink API

2020-09-27 Thread Kostas Kloudas
+1 (binding) @Steven Wu I think there will be opportunities to fine tune the API during the implementation. Cheers, Kostas On Sun, Sep 27, 2020 at 7:56 PM Steven Wu wrote: > > +1 (non-binding) > > Although I would love to continue the discussion for tweaking the > CommitResult/GlobaCommitter in

Re: [VOTE] FLIP-143: Unified Sink API

2020-09-27 Thread Steven Wu
+1 (non-binding) Although I would love to continue the discussion for tweaking the CommitResult/GlobaCommitter interface maybe during the implementation phase. On Fri, Sep 25, 2020 at 5:35 AM Aljoscha Krettek wrote: > +1 (binding) > > Aljoscha > > On 25.09.20 14:26, Guowei Ma wrote: > > From t

Re: [DISCUSS] FLIP-143: Unified Sink API

2020-09-27 Thread Steven Wu
It is more about extended outages of metastore. E.g. If we commit every 2 minutes, 4 hours of metastore outage can lead to over 120 GlobalCommitT. And regarding metastore outages, it is undesirable for streaming jobs to fail the job and keep restarting. It is better to keep processing records (avoi

.ORC file reading from Apache Flink +SCALA

2020-09-27 Thread Ajay Kumar
Hi Team, I am struggling to read .ORC file as a source from Apache flink. Unfortunately there is no reach reference over internet also, Appreciate your help ! Thanks in advance ! Regards Ajay

Re: [DISCUSS] FLIP-145: Support SQL windowing table-valued function

2020-09-27 Thread liupengcheng
Hi Jark, Thanks for reply, yes, I think it's a good feature, it can improve the NRT scenarios as you mentioned in the FLIP. Also, I think it can improve the streaming SQL greatly, it can support richer window operations in flink SQL and bring great convenience to users.

[jira] [Created] (FLINK-19435) jdbc JDBCOutputFormat open function invoke Class.forName(drivername)

2020-09-27 Thread xiaodao (Jira)
xiaodao created FLINK-19435: --- Summary: jdbc JDBCOutputFormat open function invoke Class.forName(drivername) Key: FLINK-19435 URL: https://issues.apache.org/jira/browse/FLINK-19435 Project: Flink I

Re: [DISCUSS] FLIP-142: Disentangle StateBackends from Checkpointing

2020-09-27 Thread Stephan Ewen
Good to see this FLIP moving. >From what I understand, the remaining questions are mainly about how to express the roles of the CheckpointStorage and specifically the behavior of JMCheckpointStorage and FsCheckpointStorage in the docs. This sounds like details we should discuss over the concrete t

Re: [VOTE] FLIP-33: Standardize connector metrics

2020-09-27 Thread Stephan Ewen
+1 On Mon, Sep 21, 2020 at 11:48 AM Yu Li wrote: > +1 > > I could see this is a well written document after a long and thorough > discussion [1]. Thanks for driving this all along, Becket! > > Best Regards, > Yu > > [1] > > http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-F

[jira] [Created] (FLINK-19434) Add StreamJobGraphGenerator support for source chaining

2020-09-27 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-19434: --- Summary: Add StreamJobGraphGenerator support for source chaining Key: FLINK-19434 URL: https://issues.apache.org/jira/browse/FLINK-19434 Project: Flink Issue T

[jira] [Created] (FLINK-19433) An Error example of FROM_UNIXTIME function in document

2020-09-27 Thread Kyle Zhang (Jira)
Kyle Zhang created FLINK-19433: -- Summary: An Error example of FROM_UNIXTIME function in document Key: FLINK-19433 URL: https://issues.apache.org/jira/browse/FLINK-19433 Project: Flink Issue Type