Re: [DISCUSS] FLIP-84: Improve & Refactor execute/sqlQuery/sqlUpdate APIS of TableEnvironment

2020-02-12 Thread Jingsong Li
Hi Godfrey, Thanks for updating. +1 sketchy. I have no idea to change "sqlQuery" to "fromQuery", I think "sqlQuery" is OK, It's not that confusing with return values. Can we change the "DmlBatch" to "Inserts"? I don't see any other needs. "Dml" seems a little weird. It is better to support

[jira] [Created] (FLINK-16031) Improve the description in the README file of PyFlink 1.9.x

2020-02-12 Thread Wei Zhong (Jira)
Wei Zhong created FLINK-16031: - Summary: Improve the description in the README file of PyFlink 1.9.x Key: FLINK-16031 URL: https://issues.apache.org/jira/browse/FLINK-16031 Project: Flink

[jira] [Created] (FLINK-16030) Add heartbeat between netty server and client to detect long connection alive

2020-02-12 Thread begginghard (Jira)
begginghard created FLINK-16030: --- Summary: Add heartbeat between netty server and client to detect long connection alive Key: FLINK-16030 URL: https://issues.apache.org/jira/browse/FLINK-16030 Project:

Re: [ANNOUNCE] Apache Flink Python API(PyFlink) 1.9.2 released

2020-02-12 Thread Dian Fu
Thanks for the great work, Jincheng. Regards, Dian > 在 2020年2月13日,下午1:32,jincheng sun 写道: > > Hi everyone, > > The Apache Flink community is very happy to announce the release of Apache > Flink Python API(PyFlink) 1.9.2, which is the first release to PyPI for the > Apache Flink Python API

[jira] [Created] (FLINK-16029) Remove register source and sink in test cases of planner

2020-02-12 Thread Zhenghua Gao (Jira)
Zhenghua Gao created FLINK-16029: Summary: Remove register source and sink in test cases of planner Key: FLINK-16029 URL: https://issues.apache.org/jira/browse/FLINK-16029 Project: Flink

[ANNOUNCE] Apache Flink Python API(PyFlink) 1.9.2 released

2020-02-12 Thread jincheng sun
Hi everyone, The Apache Flink community is very happy to announce the release of Apache Flink Python API(PyFlink) 1.9.2, which is the first release to PyPI for the Apache Flink Python API 1.9 series. Apache Flink® is an open-source stream processing framework for distributed, high-performing,

[jira] [Created] (FLINK-16028) hbase connector's 'connector.table-name' property should be optional rather than required

2020-02-12 Thread Bowen Li (Jira)
Bowen Li created FLINK-16028: Summary: hbase connector's 'connector.table-name' property should be optional rather than required Key: FLINK-16028 URL: https://issues.apache.org/jira/browse/FLINK-16028

[jira] [Created] (FLINK-16027) kafka connector's 'connector.topic' property should be optional rather than required

2020-02-12 Thread Bowen Li (Jira)
Bowen Li created FLINK-16027: Summary: kafka connector's 'connector.topic' property should be optional rather than required Key: FLINK-16027 URL: https://issues.apache.org/jira/browse/FLINK-16027

[jira] [Created] (FLINK-16026) Travis failed due to python setup

2020-02-12 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-16026: Summary: Travis failed due to python setup Key: FLINK-16026 URL: https://issues.apache.org/jira/browse/FLINK-16026 Project: Flink Issue Type: Bug

Re: [VOTE] Support scalar vectorized Python UDF in PyFlink

2020-02-12 Thread Jingsong Li
+1 (non-binding) Thanks Dian for driving. Best, Jingsong Lee On Thu, Feb 13, 2020 at 11:45 AM jincheng sun wrote: > +1 (binding) > > Best, > Jincheng > > > Dian Fu 于2020年2月12日周三 下午1:31写道: > > > Hi all, > > > > I'd like to start the vote of FLIP-97[1] which is discussed and reached > >

Re: [VOTE] Support scalar vectorized Python UDF in PyFlink

2020-02-12 Thread jincheng sun
+1 (binding) Best, Jincheng Dian Fu 于2020年2月12日周三 下午1:31写道: > Hi all, > > I'd like to start the vote of FLIP-97[1] which is discussed and reached > consensus in the discussion thread[2]. > > The vote will be open for at least 72 hours. Unless there is an objection, > I will try to close it by

Re: [ANNOUNCE] Apache Flink 1.10.0 released

2020-02-12 Thread Zhijiang
Really great work and thanks everyone involved, especially for the release managers! Best, Zhijiang -- From:Kurt Young Send Time:2020 Feb. 13 (Thu.) 11:06 To:[None] Cc:user ; dev Subject:Re: [ANNOUNCE] Apache Flink 1.10.0 released

Re: [ANNOUNCE] Apache Flink 1.10.0 released

2020-02-12 Thread Kurt Young
Congratulations to everyone involved! Great thanks to Yu & Gary for being the release manager! Best, Kurt On Thu, Feb 13, 2020 at 10:06 AM Hequn Cheng wrote: > Great thanks to Yu & Gary for being the release manager! > Also thanks to everyone who made this release possible! > > Best, Hequn >

Re: [DISCUSS] Improve history server with log support

2020-02-12 Thread SHI Xiaogang
Hi Rong Rong, Thanks for the proposal. We are also suffering from some pains brought by history server. To address them, we propose a trace system, which is very similar to the metric system, for historical information. A trace is semi-structured information about events in Flink. Useful traces

Re: [DISCUSS] Support Python ML Pipeline API

2020-02-12 Thread Becket Qin
+1. I'd say this is almost a must-have for machine learning. Thanks, Jiangjie (Becket) Qin On Thu, Feb 13, 2020 at 10:03 AM Rong Rong wrote: > Thanks for driving this initiative @Hequn Cheng . > > Moving towards python based ML is definitely a huge win consider how large > the python-ML

[RESULT] [VOTE] Release Flink Python API(PyFlink) 1.9.2 to PyPI, release candidate #1

2020-02-12 Thread jincheng sun
Hi everyone, I'm happy to announce that we have unanimously approved this release. There are 7 approving votes, 3 of which are binding: * Wei Zhong * Jincheng Sun(binding) * Dian Fu * Hequn Cheng * Jark Wu (binding) * Jiangjie (Becket) Qin (binding) * Xingbo Huang There are no disapproving

Re: [DISCUSS] Support Python ML Pipeline API

2020-02-12 Thread Rong Rong
Thanks for driving this initiative @Hequn Cheng . Moving towards python based ML is definitely a huge win consider how large the python-ML community is. a big +1 on my side! Regarding the doc, I only left a few comments on the specific APIs. overall the architecture looks very good! Looking

[jira] [Created] (FLINK-16025) Service could expose different blob server port mismatched with JM Container

2020-02-12 Thread Canbin Zheng (Jira)
Canbin Zheng created FLINK-16025: Summary: Service could expose different blob server port mismatched with JM Container Key: FLINK-16025 URL: https://issues.apache.org/jira/browse/FLINK-16025

Re: [VOTE] Release Flink Python API(PyFlink) 1.9.2 to PyPI, release candidate #1

2020-02-12 Thread jincheng sun
Hi folks, Thanks everyone for voting. I'm closing the vote now and will post the result as a separate email. Best, Jincheng Xingbo Huang 于2020年2月13日周四 上午9:28写道: > +1 (non-binding) > > - Install the PyFlink by `pip install` [SUCCESS] > - Run word_count.py [SUCCESS] > > Thanks, > Xingbo > >

[DISCUSS] Improve history server with log support

2020-02-12 Thread Rong Rong
Hi All, Recently we have been experimenting using Flink’s history server as a centralized debugging service for completed streaming jobs. Specifically, we dynamically generate links to access log files on the YARN host; in the meantime, we use the Flink history server to show job graphs,

Re: [ANNOUNCE] Apache Flink 1.10.0 released

2020-02-12 Thread Jeff Zhang
Congratulations! Really appreciated your hard work. Yangze Guo 于2020年2月13日周四 上午9:29写道: > Thanks, Gary & Yu. Congrats to everyone involved! > > Best, > Yangze Guo > > On Thu, Feb 13, 2020 at 9:23 AM Jingsong Li > wrote: > > > > Congratulations! Great work. > > > > Best, > > Jingsong Lee > > > >

Re: [ANNOUNCE] Apache Flink 1.10.0 released

2020-02-12 Thread Yangze Guo
Thanks, Gary & Yu. Congrats to everyone involved! Best, Yangze Guo On Thu, Feb 13, 2020 at 9:23 AM Jingsong Li wrote: > > Congratulations! Great work. > > Best, > Jingsong Lee > > On Wed, Feb 12, 2020 at 11:05 PM Leonard Xu wrote: >> >> Great news! >> Thanks everyone involved ! >> Thanks Gary

Re: [VOTE] Release Flink Python API(PyFlink) 1.9.2 to PyPI, release candidate #1

2020-02-12 Thread Xingbo Huang
+1 (non-binding) - Install the PyFlink by `pip install` [SUCCESS] - Run word_count.py [SUCCESS] Thanks, Xingbo Becket Qin 于2020年2月12日周三 下午2:28写道: > +1 (binding) > > - verified signature > - Ran word count example successfully. > > Thanks, > > Jiangjie (Becket) Qin > > On Wed, Feb 12, 2020 at

Re: [ANNOUNCE] Apache Flink 1.10.0 released

2020-02-12 Thread Jingsong Li
Congratulations! Great work. Best, Jingsong Lee On Wed, Feb 12, 2020 at 11:05 PM Leonard Xu wrote: > Great news! > Thanks everyone involved ! > Thanks Gary and Yu for being the release manager ! > > Best, > Leonard Xu > > 在 2020年2月12日,23:02,Stephan Ewen 写道: > > Congrats to us all. > > A big

Re: [ANNOUNCE] Apache Flink 1.10.0 released

2020-02-12 Thread Dian Fu
Thanks Gary & Yu and everyone involved, Great work! Regards, Dian > 在 2020年2月12日,下午11:57,Haibo Sun 写道: > > Thanks Gary & Yu. Great work! > > Best, > Haibo > > At 2020-02-12 21:31:00, "Yu Li" wrote: > >The Apache Flink community is very happy to announce the release of Apache > >Flink

[jira] [Created] (FLINK-16024) support filter pushdown in jdbc connector

2020-02-12 Thread Bowen Li (Jira)
Bowen Li created FLINK-16024: Summary: support filter pushdown in jdbc connector Key: FLINK-16024 URL: https://issues.apache.org/jira/browse/FLINK-16024 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-16023) jdbc connector's 'connector.table' property should be optional rather than required

2020-02-12 Thread Bowen Li (Jira)
Bowen Li created FLINK-16023: Summary: jdbc connector's 'connector.table' property should be optional rather than required Key: FLINK-16023 URL: https://issues.apache.org/jira/browse/FLINK-16023 Project:

Re:[ANNOUNCE] Apache Flink 1.10.0 released

2020-02-12 Thread Haibo Sun
Thanks Gary & Yu. Great work! Best, Haibo At 2020-02-12 21:31:00, "Yu Li" wrote: >The Apache Flink community is very happy to announce the release of Apache >Flink 1.10.0, which is the latest major release. > >Apache Flink® is an open-source stream processing framework for >distributed,

[jira] [Created] (FLINK-16022) AbstractDownloadCache does not clean up download directory in case of failures

2020-02-12 Thread Alexander Fedulov (Jira)
Alexander Fedulov created FLINK-16022: - Summary: AbstractDownloadCache does not clean up download directory in case of failures Key: FLINK-16022 URL: https://issues.apache.org/jira/browse/FLINK-16022

Re: [ANNOUNCE] Apache Flink 1.10.0 released

2020-02-12 Thread Fabian Hueske
Congrats team and a big thank you to the release managers! Am Mi., 12. Feb. 2020 um 16:33 Uhr schrieb Timo Walther : > Congratualations everyone! Great stuff :-) > > Regards, > Timo > > > On 12.02.20 16:05, Leonard Xu wrote: > > Great news! > > Thanks everyone involved ! > > Thanks Gary and Yu

Re: Add support for IAM Roles for Service Accounts in AWS EKS (Web Identity)

2020-02-12 Thread Stephan Ewen
This sounds like a good addition. Can you comment on the jira issue, to have the discussion in one place. Unless anyone raises concerns, I can assign you the issue then and we could proceed with a PR. On Tue, Feb 11, 2020 at 4:10 PM Rafi Aroch wrote: > Hi, > > IAM Roles for Service Accounts

Re: [ANNOUNCE] Apache Flink 1.10.0 released

2020-02-12 Thread Timo Walther
Congratualations everyone! Great stuff :-) Regards, Timo On 12.02.20 16:05, Leonard Xu wrote: Great news! Thanks everyone involved ! Thanks Gary and Yu for being the release manager ! Best, Leonard Xu 在 2020年2月12日,23:02,Stephan Ewen 写道: Congrats to us all. A big piece of work, nicely

Re: [ANNOUNCE] Apache Flink 1.10.0 released

2020-02-12 Thread Leonard Xu
Great news! Thanks everyone involved ! Thanks Gary and Yu for being the release manager ! Best, Leonard Xu > 在 2020年2月12日,23:02,Stephan Ewen 写道: > > Congrats to us all. > > A big piece of work, nicely done. > > Let's hope that this helps our users make their existing use cases easier and >

Re: [ANNOUNCE] Apache Flink 1.10.0 released

2020-02-12 Thread Stephan Ewen
Congrats to us all. A big piece of work, nicely done. Let's hope that this helps our users make their existing use cases easier and also opens up new use cases. On Wed, Feb 12, 2020 at 3:31 PM 张光辉 wrote: > Greet work. > > Congxian Qiu 于2020年2月12日周三 下午10:11写道: > >> Great work. >> Thanks

[jira] [Created] (FLINK-16021) DescriptorProperties.putTableSchema does not include constraints

2020-02-12 Thread Timo Walther (Jira)
Timo Walther created FLINK-16021: Summary: DescriptorProperties.putTableSchema does not include constraints Key: FLINK-16021 URL: https://issues.apache.org/jira/browse/FLINK-16021 Project: Flink

[VOTE] Release flink-shaded 10.0, release candidate #3

2020-02-12 Thread Chesnay Schepler
Hi everyone, Please review and vote on the release candidate #3 for the version 10.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release notes [1],

[CANCELED][VOTE] Release flink-shaded 10.0, release candidate #2

2020-02-12 Thread Chesnay Schepler
Canceled because I forgot to do _the one thing_ that was required for rc2: cherry-picking the commit to the 10.0 release branch. On 12/02/2020 12:52, Chesnay Schepler wrote: Hi everyone, Please review and vote on the release candidate #2 for the version 10.0, as follows: [ ] +1, Approve the

Re: [ANNOUNCE] Apache Flink 1.10.0 released

2020-02-12 Thread Xintong Song
Great to hear that! Thanks for being the release managers, Gary & Yu. Great work! Thank you~ Xintong Song On Wed, Feb 12, 2020 at 9:31 PM Yu Li wrote: > The Apache Flink community is very happy to announce the release of Apache > Flink 1.10.0, which is the latest major release. > > Apache

[ANNOUNCE] Apache Flink 1.10.0 released

2020-02-12 Thread Yu Li
The Apache Flink community is very happy to announce the release of Apache Flink 1.10.0, which is the latest major release. Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data streaming applications. The release is

[jira] [Created] (FLINK-16020) Use Flink-1.10 released version instead of the snapshot version

2020-02-12 Thread Igal Shilman (Jira)
Igal Shilman created FLINK-16020: Summary: Use Flink-1.10 released version instead of the snapshot version Key: FLINK-16020 URL: https://issues.apache.org/jira/browse/FLINK-16020 Project: Flink

[jira] [Created] (FLINK-16019) ContinuousFileReaderOperatorBenchmark restarts indefinetly on failure

2020-02-12 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-16019: - Summary: ContinuousFileReaderOperatorBenchmark restarts indefinetly on failure Key: FLINK-16019 URL: https://issues.apache.org/jira/browse/FLINK-16019

[jira] [Created] (FLINK-16018) Improve error reporting when submitting batch job (instead of AskTimeoutException)

2020-02-12 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-16018: -- Summary: Improve error reporting when submitting batch job (instead of AskTimeoutException) Key: FLINK-16018 URL: https://issues.apache.org/jira/browse/FLINK-16018

[VOTE] Release flink-shaded 10.0, release candidate #2

2020-02-12 Thread Chesnay Schepler
Hi everyone, Please review and vote on the release candidate #2 for the version 10.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release notes [1],

[jira] [Created] (FLINK-16017) Improve attachJobGraph Performance

2020-02-12 Thread Jiayi Liao (Jira)
Jiayi Liao created FLINK-16017: -- Summary: Improve attachJobGraph Performance Key: FLINK-16017 URL: https://issues.apache.org/jira/browse/FLINK-16017 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-16016) The out-of-date warning doesn't show up in release-1.6 document

2020-02-12 Thread Yu Li (Jira)
Yu Li created FLINK-16016: - Summary: The out-of-date warning doesn't show up in release-1.6 document Key: FLINK-16016 URL: https://issues.apache.org/jira/browse/FLINK-16016 Project: Flink Issue

[jira] [Created] (FLINK-16015) Refine fallback filesystems to only handle specific filesystems

2020-02-12 Thread Arvid Heise (Jira)
Arvid Heise created FLINK-16015: --- Summary: Refine fallback filesystems to only handle specific filesystems Key: FLINK-16015 URL: https://issues.apache.org/jira/browse/FLINK-16015 Project: Flink

[jira] [Created] (FLINK-16014) S3 plugin ClassNotFoundException SAXParser

2020-02-12 Thread Arvid Heise (Jira)
Arvid Heise created FLINK-16014: --- Summary: S3 plugin ClassNotFoundException SAXParser Key: FLINK-16014 URL: https://issues.apache.org/jira/browse/FLINK-16014 Project: Flink Issue Type: Bug

[DISCUSS] What parts of Flink SQL should we improve for usability?

2020-02-12 Thread Leonard Xu
Hi, all We have listened some user's compliant voice about Flink SQL usability from online and offline, especially about using Flink SQL to build ETL job, but it's not detailed. So, I'd like to start a discussion about Flink SQL usability, hope we can have more input from user side which