Re: [DISCUSS] Remove Eclipse-specific plugin configurations

2020-02-28 Thread Stephan Ewen
Flavio, do you load Flink source code into Eclipse, or develop Flink applications in Eclipse (based on the quickstart archetypes)? On Fri, Feb 28, 2020 at 4:10 PM Chesnay Schepler wrote: > What do you have to change it to? > > What happens if you just remove it completely? > > On 28/02/2020

[jira] [Created] (FLINK-16348) Add commas to large numeric accumulators

2020-02-28 Thread Kboh (Jira)
Kboh created FLINK-16348: Summary: Add commas to large numeric accumulators Key: FLINK-16348 URL: https://issues.apache.org/jira/browse/FLINK-16348 Project: Flink Issue Type: Improvement

Re: [VOTE] FLIP-103: Better TM/JM Log Display

2020-02-28 Thread Till Rohrmann
Hi Yadong, Gary might be able to help with this effort. Cheers, Till On Fri, Feb 28, 2020 at 11:08 AM Yadong Xie wrote: > Hi Till > > In addition to the front end, the FLIP-103 would also include some rest API > changes. > Could you assign one PMC or committer to help us review the pull

Re: [VOTE] FLIP-98: Better Back Pressure Detection

2020-02-28 Thread Till Rohrmann
I'm pulling in Gary who could help with this effort. Cheers, Till On Fri, Feb 28, 2020 at 11:08 AM Yadong Xie wrote: > Hi Till > > In addition to the front end, the FLIP-98 would also include some rest API > changes. > Could you assign one PMC or committer to help us review the pull request >

[jira] [Created] (FLINK-16347) Remove distinction between "operatorIDs" and "userDefinedOperatorIds"

2020-02-28 Thread Stephan Ewen (Jira)
Stephan Ewen created FLINK-16347: Summary: Remove distinction between "operatorIDs" and "userDefinedOperatorIds" Key: FLINK-16347 URL: https://issues.apache.org/jira/browse/FLINK-16347 Project: Flink

[jira] [Created] (FLINK-16346) BlobsCleanupITCase.testBlobServerCleanupCancelledJob fails on Travis

2020-02-28 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-16346: - Summary: BlobsCleanupITCase.testBlobServerCleanupCancelledJob fails on Travis Key: FLINK-16346 URL: https://issues.apache.org/jira/browse/FLINK-16346 Project:

[jira] [Created] (FLINK-16345) Computed column can not refer time attribute column

2020-02-28 Thread Leonard Xu (Jira)
Leonard Xu created FLINK-16345: -- Summary: Computed column can not refer time attribute column Key: FLINK-16345 URL: https://issues.apache.org/jira/browse/FLINK-16345 Project: Flink Issue Type:

[jira] [Created] (FLINK-16344) Preserve nullability for nested types

2020-02-28 Thread Timo Walther (Jira)
Timo Walther created FLINK-16344: Summary: Preserve nullability for nested types Key: FLINK-16344 URL: https://issues.apache.org/jira/browse/FLINK-16344 Project: Flink Issue Type: Sub-task

Re: [VOTE] FLIP-93: JDBC catalog and Postgres catalog

2020-02-28 Thread Benchao Li
+1 (non-binding) It's a very useful feature, especially for batch jobs. Bowen Li 于2020年2月28日周五 上午2:39写道: > Hi all, > > I'd like to kick off the vote for FLIP-93 [1] to add JDBC catalog and > Postgres catalog. > > The vote will last for at least 72 hours, following the consensus voting >

Re: [DISCUSS] Remove Eclipse-specific plugin configurations

2020-02-28 Thread Chesnay Schepler
What do you have to change it to? What happens if you just remove it completely? On 28/02/2020 16:08, Flavio Pompermaier wrote: I use Eclipse but the stuff added in the pom.xml to improve the out-of-the-box experience is pretty useless, I always have to change it On Fri, Feb 28, 2020 at 4:01

Re: [DISCUSS] Remove Eclipse-specific plugin configurations

2020-02-28 Thread Flavio Pompermaier
I use Eclipse but the stuff added in the pom.xml to improve the out-of-the-box experience is pretty useless, I always have to change it On Fri, Feb 28, 2020 at 4:01 PM Chesnay Schepler wrote: > Hello, > > in various maven pom.xml we have some plugin definitions exclusively to > increase support

[DISCUSS] Remove Eclipse-specific plugin configurations

2020-02-28 Thread Chesnay Schepler
Hello, in various maven pom.xml we have some plugin definitions exclusively to increase support for the Eclipse IDE. From what I have heard developing Flink is not really possible with Exclipse (we explicitly recommend IntelliJ in our documentation); I'm not aware of any committer using it

[jira] [Created] (FLINK-16343) Failed to read a table with watermark in batch mode

2020-02-28 Thread Kurt Young (Jira)
Kurt Young created FLINK-16343: -- Summary: Failed to read a table with watermark in batch mode Key: FLINK-16343 URL: https://issues.apache.org/jira/browse/FLINK-16343 Project: Flink Issue Type:

Re: [DISCUSS] FLIP-76: Unaligned checkpoints

2020-02-28 Thread Yu Li
Thanks for the further feedback Zhijiang and Piotr! I think this is a great feature and will watch the progress. Please also feel free to involve me in discussions/reviews on state-related part. Thanks. Best Regards, Yu On Thu, 27 Feb 2020 at 23:24, Piotr Nowojski wrote: > Hi Yu, > > Re 4. >

[jira] [Created] (FLINK-16342) Remove mocking from DatadogHttpClientTest

2020-02-28 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-16342: Summary: Remove mocking from DatadogHttpClientTest Key: FLINK-16342 URL: https://issues.apache.org/jira/browse/FLINK-16342 Project: Flink Issue

Re: [VOTE] FLIP-84: Improve & Refactor API of TableEnvironment

2020-02-28 Thread Benchao Li
+1 (non-binding) Jark Wu 于2020年2月28日周五 下午5:11写道: > +1 from my side. > > Best, > Jark > > On Fri, 28 Feb 2020 at 15:07, kant kodali wrote: > > > Nice!! > > > > Sent from my iPhone > > > > > On Feb 27, 2020, at 9:03 PM, godfrey he wrote: > > > > > > Hi kant, yes. We hope to deprecate the

Re: [DISCUSS] FLIP-84: Improve & Refactor execute/sqlQuery/sqlUpdate APIS of TableEnvironment

2020-02-28 Thread Benchao Li
Hi godfrey, Thanks for your explanation. Do we need to clarify this in the FLIP? Maybe this confuses other users as well. godfrey he 于2020年2月28日周五 下午4:54写道: > Hi Benchao, > > > I have one question about this FLIP: > > executeStatement accepts DML, what if it's a streaming DML ? > >does

[jira] [Created] (FLINK-16341) Remove DatadogReporter#DatadogHttpRequest

2020-02-28 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-16341: Summary: Remove DatadogReporter#DatadogHttpRequest Key: FLINK-16341 URL: https://issues.apache.org/jira/browse/FLINK-16341 Project: Flink Issue

[jira] [Created] (FLINK-16340) Expose stop with savepoint feature in the webUI

2020-02-28 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-16340: -- Summary: Expose stop with savepoint feature in the webUI Key: FLINK-16340 URL: https://issues.apache.org/jira/browse/FLINK-16340 Project: Flink Issue

[jira] [Created] (FLINK-16339) DatadogReporter isn't logging configuration options

2020-02-28 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-16339: Summary: DatadogReporter isn't logging configuration options Key: FLINK-16339 URL: https://issues.apache.org/jira/browse/FLINK-16339 Project: Flink

[jira] [Created] (FLINK-16338) Log series size in DatadogMetricReporter

2020-02-28 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-16338: Summary: Log series size in DatadogMetricReporter Key: FLINK-16338 URL: https://issues.apache.org/jira/browse/FLINK-16338 Project: Flink Issue Type:

Re: [DISCUSS] Migrate build infrastructure from Travis CI to Azure Pipelines

2020-02-28 Thread Robert Metzger
Quick update on this effort: Since yesterday, I'm experimenting with running the end to end tests with each pull request and "master" push. I hope that this helps to uncover issues earlier (without waiting for the nightly test execution) The tests run for almost 3 hours, so the overall build

[jira] [Created] (FLINK-16337) Add RelNodes and Rules for vectorized Python UDF execution

2020-02-28 Thread Dian Fu (Jira)
Dian Fu created FLINK-16337: --- Summary: Add RelNodes and Rules for vectorized Python UDF execution Key: FLINK-16337 URL: https://issues.apache.org/jira/browse/FLINK-16337 Project: Flink Issue Type:

[jira] [Created] (FLINK-16336) Support new type inference for temporal table functions

2020-02-28 Thread Timo Walther (Jira)
Timo Walther created FLINK-16336: Summary: Support new type inference for temporal table functions Key: FLINK-16336 URL: https://issues.apache.org/jira/browse/FLINK-16336 Project: Flink

[jira] [Created] (FLINK-16335) vertex timeline should display all status other than the last one

2020-02-28 Thread Yadong Xie (Jira)
Yadong Xie created FLINK-16335: -- Summary: vertex timeline should display all status other than the last one Key: FLINK-16335 URL: https://issues.apache.org/jira/browse/FLINK-16335 Project: Flink

[jira] [Created] (FLINK-16334) flink-sql kafka-connector support ignore the invalid data during parsing bytes to json row

2020-02-28 Thread roncenzhao (Jira)
roncenzhao created FLINK-16334: -- Summary: flink-sql kafka-connector support ignore the invalid data during parsing bytes to json row Key: FLINK-16334 URL: https://issues.apache.org/jira/browse/FLINK-16334

[jira] [Created] (FLINK-16333) After exiting from the command line client, the process still exists

2020-02-28 Thread jinxin (Jira)
jinxin created FLINK-16333: -- Summary: After exiting from the command line client, the process still exists Key: FLINK-16333 URL: https://issues.apache.org/jira/browse/FLINK-16333 Project: Flink

[jira] [Created] (FLINK-16332) Support un-ordered mode for async lookup join

2020-02-28 Thread Jark Wu (Jira)
Jark Wu created FLINK-16332: --- Summary: Support un-ordered mode for async lookup join Key: FLINK-16332 URL: https://issues.apache.org/jira/browse/FLINK-16332 Project: Flink Issue Type: New Feature

Re: [DISCUSS] FLIP-106: Support Python UDF in SQL Function DDL

2020-02-28 Thread Benchao Li
Big +1 for this feature. We built our SQL platform on Java Table API, and most common UDF are implemented in Java. However some python developers are not familiar with Java/Scala, and it's very inconvenient for these users to use UDF in SQL. Wei Zhong 于2020年2月28日周五 下午6:58写道: > Thank for your

[jira] [Created] (FLINK-16331) Remove source licenses for old WebUI

2020-02-28 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-16331: Summary: Remove source licenses for old WebUI Key: FLINK-16331 URL: https://issues.apache.org/jira/browse/FLINK-16331 Project: Flink Issue Type: Bug

Re: [DISCUSS] FLIP-106: Support Python UDF in SQL Function DDL

2020-02-28 Thread Wei Zhong
Thank for your reply Dan! By the way, this FLIP is closely related to the SQL API. @Jark Wu @Timo could you please take a look? Thanks, Wei > 在 2020年2月25日,16:25,zoudan 写道: > > +1 for supporting Python UDF in Java/Scala Table API. > This is a great feature and would be helpful for python

Re: [VOTE] FLIP-100: Add Attempt Information

2020-02-28 Thread Yadong Xie
Hi everyone A subtask filter and an attempt id filter was added to the attempt timeline page now check the POC here: http://101.132.122.69:8081/web/#/job/9d651769488466d33e7a607e85203543/timeline FLIP doc was also updated:

Re: [VOTE] FLIP-98: Better Back Pressure Detection

2020-02-28 Thread Yadong Xie
Hi Till In addition to the front end, the FLIP-98 would also include some rest API changes. Could you assign one PMC or committer to help us review the pull request and drive this FLIP forward? We will start to create PR as soon as possible, thanks! Till Rohrmann 于2020年2月25日周二 下午6:12写道: > late

Re: [VOTE] FLIP-103: Better TM/JM Log Display

2020-02-28 Thread Yadong Xie
Hi Till In addition to the front end, the FLIP-103 would also include some rest API changes. Could you assign one PMC or committer to help us review the pull request and drive this FLIP forward? We will start to create PR as soon as possible, thanks! Till Rohrmann 于2020年2月25日周二 下午6:03写道: >

[jira] [Created] (FLINK-16330) Set up environment variables for the S3 tests in Azure

2020-02-28 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-16330: -- Summary: Set up environment variables for the S3 tests in Azure Key: FLINK-16330 URL: https://issues.apache.org/jira/browse/FLINK-16330 Project: Flink

[jira] [Created] (FLINK-16329) Set up build notifications from AZP to builds@f.a.o

2020-02-28 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-16329: -- Summary: Set up build notifications from AZP to builds@f.a.o Key: FLINK-16329 URL: https://issues.apache.org/jira/browse/FLINK-16329 Project: Flink

Re: [VOTE] FLIP-84: Improve & Refactor API of TableEnvironment

2020-02-28 Thread Jark Wu
+1 from my side. Best, Jark On Fri, 28 Feb 2020 at 15:07, kant kodali wrote: > Nice!! > > Sent from my iPhone > > > On Feb 27, 2020, at 9:03 PM, godfrey he wrote: > > > > Hi kant, yes. We hope to deprecate the methods which confuse users ASAP. > > > > Bests, > > godfrey > > > > kant kodali

Re: Flink 1.10 exception : Unable to instantiate java compiler

2020-02-28 Thread Till Rohrmann
Hi, with Flink 1.10 we changed the behaviour on the client side so that it also uses the child first class loader [1]. Due to that it might be the case that you have some conflicting dependencies bundled in your user code jar which don't play well together with what you have on the system class

Re: Flink 1.10 exception : Unable to instantiate java compiler

2020-02-28 Thread LakeShen
I have solved this problem. I set the flink-table-planner-blink maven scope to provided . kant kodali 于2020年2月28日周五 下午3:32写道: > Same problem! > > On Thu, Feb 27, 2020 at 11:10 PM LakeShen > wrote: > >> Hi community, >> now I am using the flink 1.10 to run the flink task >>

[jira] [Created] (FLINK-16328) Restart batch timer in JDBC sink

2020-02-28 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-16328: - Summary: Restart batch timer in JDBC sink Key: FLINK-16328 URL: https://issues.apache.org/jira/browse/FLINK-16328 Project: Flink Issue Type:

Re: [DISCUSS] FLIP-84: Improve & Refactor execute/sqlQuery/sqlUpdate APIS of TableEnvironment

2020-02-28 Thread godfrey he
Hi Benchao, > I have one question about this FLIP: > executeStatement accepts DML, what if it's a streaming DML ? >does it submit the job to cluster directly and blocks forever? what's > the behavior for the next statements? `executeStatement` is a synchronous method, will execute the

[jira] [Created] (FLINK-16327) Add TableEnvironment.fromElements interfaces for usability

2020-02-28 Thread Zhenghua Gao (Jira)
Zhenghua Gao created FLINK-16327: Summary: Add TableEnvironment.fromElements interfaces for usability Key: FLINK-16327 URL: https://issues.apache.org/jira/browse/FLINK-16327 Project: Flink

Re: [DISCUSS] FLIP-84: Improve & Refactor execute/sqlQuery/sqlUpdate APIS of TableEnvironment

2020-02-28 Thread Benchao Li
Hi Terry, Thanks for the propose, and sorry for joining the party late. I have one question about this FLIP: executeStatement accepts DML, what if it's a streaming DML ? does it submit the job to cluster directly and blocks forever? what's the behavior for the next statements? nit: there's