Re: [DISCUSS] Releasing Stateful Functions 2.1.0 soon?

2020-05-20 Thread Marta Paes Moreira
+1 for more frequent releases with a shorter (but feedback-informed) feature set. Thanks, Gordon (and Igal)! Marta On Thu, 21 May 2020 at 03:44, Yu Li wrote: > +1, it makes a lot of sense for stateful functions to evolve faster. > > Best Regards, > Yu > > > On Wed, 20 May 2020 at 23:36,

[jira] [Created] (FLINK-17858) Yarn mode, windows and linux environment should be interlinked

2020-05-20 Thread ChengWei Ye (Jira)
ChengWei Ye created FLINK-17858: --- Summary: Yarn mode, windows and linux environment should be interlinked Key: FLINK-17858 URL: https://issues.apache.org/jira/browse/FLINK-17858 Project: Flink

[jira] [Created] (FLINK-17857) All Kubernetes e2e tests could not run on Mac after migration

2020-05-20 Thread Yang Wang (Jira)
Yang Wang created FLINK-17857: - Summary: All Kubernetes e2e tests could not run on Mac after migration Key: FLINK-17857 URL: https://issues.apache.org/jira/browse/FLINK-17857 Project: Flink

[jira] [Created] (FLINK-17856) Adds the feature of monitoring directory changes for FileSystem table source connector

2020-05-20 Thread sunjincheng (Jira)
sunjincheng created FLINK-17856: --- Summary: Adds the feature of monitoring directory changes for FileSystem table source connector Key: FLINK-17856 URL: https://issues.apache.org/jira/browse/FLINK-17856

[DISCUSS] How to view azure pipeline results and cancel a pipeline?

2020-05-20 Thread Leonard Xu
Hi, dear community I have two questions about the azure pipeline. One is I can not open the CI url like [1][2] from CI mail list(bui...@flink.apache.org) which return a 401 error code. The other is I can not cancel a running pipeline when I update a PR and want to cancel current pipeline and

[jira] [Created] (FLINK-17855) UDF with parameter Array(Row) can not work

2020-05-20 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-17855: Summary: UDF with parameter Array(Row) can not work Key: FLINK-17855 URL: https://issues.apache.org/jira/browse/FLINK-17855 Project: Flink Issue Type: Bug

Re: [DISCUSS] Add a material web page under "https://flink.apache.org/"

2020-05-20 Thread Yu Li
+1 (belated) for adding such a website with the name of flink-learning.org, especially if we could have a (virtual) team to maintain and prevent it from being stale. Thanks for starting the discussion and driving this, Yuan! Best Regards, Yu On Mon, 18 May 2020 at 15:22, Robert Metzger wrote:

Re: [DISCUSS] Releasing Stateful Functions 2.1.0 soon?

2020-05-20 Thread Yu Li
+1, it makes a lot of sense for stateful functions to evolve faster. Best Regards, Yu On Wed, 20 May 2020 at 23:36, Zhijiang wrote: > I also like this idea, considering stateful functions flexible enough to > have a faster release cycle. +1 from my side. > > Best, > Zhijiang > > >

[jira] [Created] (FLINK-17854) Use InputStatus directly in user-facing async input APIs (like source readers)

2020-05-20 Thread Stephan Ewen (Jira)
Stephan Ewen created FLINK-17854: Summary: Use InputStatus directly in user-facing async input APIs (like source readers) Key: FLINK-17854 URL: https://issues.apache.org/jira/browse/FLINK-17854

Issues using StreamingFileSink (Cannot locate configuration: tried hadoop-metrics2-s3a-file-system.properties, hadoop-metrics2.properties)

2020-05-20 Thread vishalovercome
I've written a Flink job to stream updates to S3 using StreamingFileSink. I used the presto plugin for checkpointing and the hadoop plugin for writing part files to S3. I was going through my application logs and found these messages which I couldn't understand and would like to know if there's

[jira] [Created] (FLINK-17853) JobGraph is not getting deleted after Job cancelation

2020-05-20 Thread Fritz Budiyanto (Jira)
Fritz Budiyanto created FLINK-17853: --- Summary: JobGraph is not getting deleted after Job cancelation Key: FLINK-17853 URL: https://issues.apache.org/jira/browse/FLINK-17853 Project: Flink

[jira] [Created] (FLINK-17852) FlinkSQL support WITH clause in query statement

2020-05-20 Thread sam lin (Jira)
sam lin created FLINK-17852: --- Summary: FlinkSQL support WITH clause in query statement Key: FLINK-17852 URL: https://issues.apache.org/jira/browse/FLINK-17852 Project: Flink Issue Type: New

[jira] [Created] (FLINK-17851) FlinkKafkaProducerITCase.testResumeTransaction:108->assertRecord NoSuchElement

2020-05-20 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-17851: -- Summary: FlinkKafkaProducerITCase.testResumeTransaction:108->assertRecord NoSuchElement Key: FLINK-17851 URL: https://issues.apache.org/jira/browse/FLINK-17851

[jira] [Created] (FLINK-17850) PostgresCatalogITCase . testGroupByInsert() fails on CI

2020-05-20 Thread Stephan Ewen (Jira)
Stephan Ewen created FLINK-17850: Summary: PostgresCatalogITCase . testGroupByInsert() fails on CI Key: FLINK-17850 URL: https://issues.apache.org/jira/browse/FLINK-17850 Project: Flink

[jira] [Created] (FLINK-17849) YARNHighAvailabilityITCase hangs in Azure Pipelines CI

2020-05-20 Thread Stephan Ewen (Jira)
Stephan Ewen created FLINK-17849: Summary: YARNHighAvailabilityITCase hangs in Azure Pipelines CI Key: FLINK-17849 URL: https://issues.apache.org/jira/browse/FLINK-17849 Project: Flink Issue

[jira] [Created] (FLINK-17848) Allow scala datastream api to create named sources

2020-05-20 Thread Zack Loebel-Begelman (Jira)
Zack Loebel-Begelman created FLINK-17848: Summary: Allow scala datastream api to create named sources Key: FLINK-17848 URL: https://issues.apache.org/jira/browse/FLINK-17848 Project: Flink

[jira] [Created] (FLINK-17847) ArrayIndexOutOfBoundsException happened in when codegen StreamExec operator

2020-05-20 Thread Leonard Xu (Jira)
Leonard Xu created FLINK-17847: -- Summary: ArrayIndexOutOfBoundsException happened in when codegen StreamExec operator Key: FLINK-17847 URL: https://issues.apache.org/jira/browse/FLINK-17847 Project:

Re: [DISCUSS] Releasing Stateful Functions 2.1.0 soon?

2020-05-20 Thread Zhijiang
I also like this idea, considering stateful functions flexible enough to have a faster release cycle. +1 from my side. Best, Zhijiang -- From:Seth Wiesman Send Time:2020年5月20日(星期三) 21:45 To:dev Subject:Re: [DISCUSS] Releasing

Re: [DISCUSS] increase "state.backend.fs.memory-threshold" from 1K to 100K

2020-05-20 Thread Stephan Ewen
Sounds good to me. By the next release, we should have also phased out the old Kafka Source, which is one of the most common and most problematic users of Union State On Wed, May 20, 2020 at 11:12 AM Yu Li wrote: > +1 on improving Union State implementation. > > I think the concerns raised

[jira] [Created] (FLINK-17846) flink-walkthrough-table-scala failed on azure

2020-05-20 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-17846: Summary: flink-walkthrough-table-scala failed on azure Key: FLINK-17846 URL: https://issues.apache.org/jira/browse/FLINK-17846 Project: Flink Issue

[jira] [Created] (FLINK-17845) Can't remove a table connector property with ALTER TABLE

2020-05-20 Thread Fabian Hueske (Jira)
Fabian Hueske created FLINK-17845: - Summary: Can't remove a table connector property with ALTER TABLE Key: FLINK-17845 URL: https://issues.apache.org/jira/browse/FLINK-17845 Project: Flink

[RESULT] [VOTE] Guarantee that @PublicEvolving classes are API and binary compatible across bug fix releases (x.y.u and x.y.v)

2020-05-20 Thread Till Rohrmann
Hi all, The voting time for stricter API and binary stability guarantees [1] has passed. I'm closing the vote now. There were 19 +1 votes, 4 of which are binding: Thomas Weise (binding) Jingsong Li (non-binding) Zhijiang (binding) Ufuk Celebi (binding) Yuan Mei (non-binding) Yangze Guo

[jira] [Created] (FLINK-17844) Activate japicmp-maven-plugin checks for @PublicEvolving between bug fix releases (x.y.u -> x.y.v)

2020-05-20 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-17844: - Summary: Activate japicmp-maven-plugin checks for @PublicEvolving between bug fix releases (x.y.u -> x.y.v) Key: FLINK-17844 URL:

Re: [VOTE] Guarantee that @PublicEvolving classes are API and binary compatible across bug fix releases (x.y.u and x.y.v)

2020-05-20 Thread Till Rohrmann
Thanks everyone for voting. I will post the result of the vote in a separate email. Cheers, Till On Mon, May 18, 2020 at 1:03 PM Piotr Nowojski wrote: > +1 > > > On 18 May 2020, at 10:43, Canbin Zheng wrote: > > > > +1 (non-binding) > > > > Regards, > > Canbin Zheng > > > > Till Rohrmann

Re: [DISCUSS] Releasing Stateful Functions 2.1.0 soon?

2020-05-20 Thread Seth Wiesman
+1 for a fast release cycle Seth On Wed, May 20, 2020 at 8:43 AM Robert Metzger wrote: > I like the idea of releasing Statefun more frequently to have faster > feedback cycles! > > No objections for releasing 2.1.0 from my side. > > On Wed, May 20, 2020 at 2:22 PM Tzu-Li (Gordon) Tai > wrote:

Re: [DISCUSS] Releasing Stateful Functions 2.1.0 soon?

2020-05-20 Thread Robert Metzger
I like the idea of releasing Statefun more frequently to have faster feedback cycles! No objections for releasing 2.1.0 from my side. On Wed, May 20, 2020 at 2:22 PM Tzu-Li (Gordon) Tai wrote: > Hi devs, > > Since Stateful Functions 2.0 was released early April, > we've been getting some good

Re: Discussion on Project Idea for Session Of docs 2020

2020-05-20 Thread Divya Sanghi
Thanks Jark I will subscribe to channel name provided by you Thanks On Wed, 20 May 2020, 14:48 Jark Wu, wrote: > Hi Divya, > > I think you may not subscribe the dev mailing list, that's why you can't > see Seth's reply. > You can subscribe dev mailing list by sending email to >

[DISCUSS] Releasing Stateful Functions 2.1.0 soon?

2020-05-20 Thread Tzu-Li (Gordon) Tai
Hi devs, Since Stateful Functions 2.0 was released early April, we've been getting some good feedback from various channels, including the Flink mailing lists, JIRA issues, as well as Stack Overflow questions. Some of the discussions have actually translated into new features currently being

[jira] [Created] (FLINK-17843) Check for RowKind when converting Row to expression

2020-05-20 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-17843: Summary: Check for RowKind when converting Row to expression Key: FLINK-17843 URL: https://issues.apache.org/jira/browse/FLINK-17843 Project: Flink

[jira] [Created] (FLINK-17842) Performance regression on 19.05.2020

2020-05-20 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-17842: -- Summary: Performance regression on 19.05.2020 Key: FLINK-17842 URL: https://issues.apache.org/jira/browse/FLINK-17842 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-17841) Add document for new ElasticSearch connector

2020-05-20 Thread Danny Chen (Jira)
Danny Chen created FLINK-17841: -- Summary: Add document for new ElasticSearch connector Key: FLINK-17841 URL: https://issues.apache.org/jira/browse/FLINK-17841 Project: Flink Issue Type:

[jira] [Created] (FLINK-17840) Add document for new Kafka connector

2020-05-20 Thread Danny Chen (Jira)
Danny Chen created FLINK-17840: -- Summary: Add document for new Kafka connector Key: FLINK-17840 URL: https://issues.apache.org/jira/browse/FLINK-17840 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-17839) Add document for new Hbase connector

2020-05-20 Thread Danny Chen (Jira)
Danny Chen created FLINK-17839: -- Summary: Add document for new Hbase connector Key: FLINK-17839 URL: https://issues.apache.org/jira/browse/FLINK-17839 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-17838) Add document for new JDBC connector

2020-05-20 Thread Danny Chen (Jira)
Danny Chen created FLINK-17838: -- Summary: Add document for new JDBC connector Key: FLINK-17838 URL: https://issues.apache.org/jira/browse/FLINK-17838 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-17835) Add document for Hive streaming sink

2020-05-20 Thread Danny Chen (Jira)
Danny Chen created FLINK-17835: -- Summary: Add document for Hive streaming sink Key: FLINK-17835 URL: https://issues.apache.org/jira/browse/FLINK-17835 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-17836) Add document for Hive dim join

2020-05-20 Thread Danny Chen (Jira)
Danny Chen created FLINK-17836: -- Summary: Add document for Hive dim join Key: FLINK-17836 URL: https://issues.apache.org/jira/browse/FLINK-17836 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-17837) Add document for Hive DDL and DML

2020-05-20 Thread Danny Chen (Jira)
Danny Chen created FLINK-17837: -- Summary: Add document for Hive DDL and DML Key: FLINK-17837 URL: https://issues.apache.org/jira/browse/FLINK-17837 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-17834) Add document for Hive streaming source

2020-05-20 Thread Danny Chen (Jira)
Danny Chen created FLINK-17834: -- Summary: Add document for Hive streaming source Key: FLINK-17834 URL: https://issues.apache.org/jira/browse/FLINK-17834 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-17833) Add document for 1.11 SQL

2020-05-20 Thread Danny Chen (Jira)
Danny Chen created FLINK-17833: -- Summary: Add document for 1.11 SQL Key: FLINK-17833 URL: https://issues.apache.org/jira/browse/FLINK-17833 Project: Flink Issue Type: Task Components:

[jira] [Created] (FLINK-17831) Add documentation for the new Kafka connector

2020-05-20 Thread Jark Wu (Jira)
Jark Wu created FLINK-17831: --- Summary: Add documentation for the new Kafka connector Key: FLINK-17831 URL: https://issues.apache.org/jira/browse/FLINK-17831 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-17832) Add documentation for the new Elasticsearch connector

2020-05-20 Thread Jark Wu (Jira)
Jark Wu created FLINK-17832: --- Summary: Add documentation for the new Elasticsearch connector Key: FLINK-17832 URL: https://issues.apache.org/jira/browse/FLINK-17832 Project: Flink Issue Type:

[jira] [Created] (FLINK-17830) Add documentation for the new HBase connector

2020-05-20 Thread Jark Wu (Jira)
Jark Wu created FLINK-17830: --- Summary: Add documentation for the new HBase connector Key: FLINK-17830 URL: https://issues.apache.org/jira/browse/FLINK-17830 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-17829) Add documentation for the new JDBC connector

2020-05-20 Thread Jark Wu (Jira)
Jark Wu created FLINK-17829: --- Summary: Add documentation for the new JDBC connector Key: FLINK-17829 URL: https://issues.apache.org/jira/browse/FLINK-17829 Project: Flink Issue Type: Sub-task

Fwd: Google Season of Document

2020-05-20 Thread Marta Paes Moreira
Forwarding Seth's reply, which was only sent to the mailing list (you can only see these if you are subscribed [1]). [1] https://flink.apache.org/community.html#mailing-lists -- Forwarded message - From: Seth Wiesman Date: Tue, May 19, 2020 at 4:32 PM Subject: Re: Google Season

Re: Interested In Google Season of Docs!

2020-05-20 Thread Jark Wu
Hi Roopal, I think you may not subscribe the dev mailing list, that's why you can't see Seth's reply. You can subscribe dev mailing list by sending email to dev-subscr...@flink.apache.org I copied Seth's reply here, hope it can help you:

Re: Discussion on Project Idea for Session Of docs 2020

2020-05-20 Thread Jark Wu
Hi Divya, I think you may not subscribe the dev mailing list, that's why you can't see Seth's reply. You can subscribe dev mailing list by sending email to dev-subscr...@flink.apache.org I copied Seth's reply here, hope it can help you:

Re: Discussion on Project Idea for Session Of docs 2020

2020-05-20 Thread Divya Sanghi
Follow up ,can anyone please reply On Tue, 19 May 2020, 18:02 Divya Sanghi, wrote: > Hello Aljoscha , Sjwiesman > > I am working on Big Data technologies and have hands-on experience on > Flink, Spark, Kafka. > > These are some tasks done by me: > 1. I did POC where I created a Docker image of

Re: Interested In Google Season of Docs!

2020-05-20 Thread Roopal Jain
Hi Marta, Just wanted to check if you had time to see my email On Sun, 17 May 2020, 18:01 Roopal Jain, wrote: > Hi Marta, > > Thank you for responding to my email. I went through the link you > attached. I have a few questions: > 1. As per the

Re: [DISCUSS] increase "state.backend.fs.memory-threshold" from 1K to 100K

2020-05-20 Thread Yu Li
+1 on improving Union State implementation. I think the concerns raised around union state is valid, meanwhile jobs with 200 parallelism on the source operator could be regarded as "large job". To compromise, I suggest we split the improvements of the issue into 3 steps: 1. Increase

[jira] [Created] (FLINK-17828) AggregateReduceGroupingITCase fails on azure

2020-05-20 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-17828: Summary: AggregateReduceGroupingITCase fails on azure Key: FLINK-17828 URL: https://issues.apache.org/jira/browse/FLINK-17828 Project: Flink Issue

[DISCUSS] Remove dependency shipping through nested jars during job submission.

2020-05-20 Thread Kostas Kloudas
Hi all, I would like to bring the discussion in https://issues.apache.org/jira/browse/FLINK-17745 to the dev mailing list, just to hear the opinions of the community. In a nutshell, in the early days of Flink, users could submit their jobs as fat-jars that had a specific structure. More

[jira] [Created] (FLINK-17827) scala-shell.sh should fail early if no mode is specified, or have default logging settings

2020-05-20 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-17827: Summary: scala-shell.sh should fail early if no mode is specified, or have default logging settings Key: FLINK-17827 URL:

[jira] [Created] (FLINK-17826) Add missing custom query support on new jdbc connector

2020-05-20 Thread Jark Wu (Jira)
Jark Wu created FLINK-17826: --- Summary: Add missing custom query support on new jdbc connector Key: FLINK-17826 URL: https://issues.apache.org/jira/browse/FLINK-17826 Project: Flink Issue Type:

[jira] [Created] (FLINK-17825) HA end-to-end gets killed due to timeout

2020-05-20 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-17825: -- Summary: HA end-to-end gets killed due to timeout Key: FLINK-17825 URL: https://issues.apache.org/jira/browse/FLINK-17825 Project: Flink Issue Type: Bug