[jira] [Created] (FLINK-16839) Connectors Kinesis metrics can be disabled

2020-03-27 Thread Muchl (Jira)
Muchl created FLINK-16839: - Summary: Connectors Kinesis metrics can be disabled Key: FLINK-16839 URL: https://issues.apache.org/jira/browse/FLINK-16839 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-16838) Stateful Functions Quickstart archetype Dockerfile should reference a specific version tag

2020-03-27 Thread Tzu-Li (Gordon) Tai (Jira)
Tzu-Li (Gordon) Tai created FLINK-16838: --- Summary: Stateful Functions Quickstart archetype Dockerfile should reference a specific version tag Key: FLINK-16838 URL:

Re: contribute to Apache Flink

2020-03-27 Thread Hequn Cheng
Hi Leping, Welcome to the community! You no longer need contributor permissions. You can simply create a JIRA ticket and ask to be assigned to work on it. For some reasons[1], only committers can assign a Jira ticket now. You can also take a look at the Flink's contribution guidelines [2] for

contribute to Apache Flink

2020-03-27 Thread Leping Huang
Hi Guys, I want to contribute to Apache Flink. Would you please give me the permission as a contributor? My JIRA ID is soundhearer.

[jira] [Created] (FLINK-16837) Disable trimStackTrace in surefire plugin

2020-03-27 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-16837: Summary: Disable trimStackTrace in surefire plugin Key: FLINK-16837 URL: https://issues.apache.org/jira/browse/FLINK-16837 Project: Flink Issue

Re: [VOTE] Apache Flink Stateful Functions Release 2.0.0, release candidate #2

2020-03-27 Thread Tzu-Li (Gordon) Tai
Hi Hequn, That's a good catch. Unfortunately, the spring boot dependency there, while itself being ASLv2 licensed, pulls in other dependencies that are not ASLv2. That would indeed make this problem a blocker. I'll do a thorough check again on the Maven artifacts that do bundle dependencies,

[jira] [Created] (FLINK-16836) Losing leadership does not clear rpc connection in JobManagerLeaderListener

2020-03-27 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-16836: - Summary: Losing leadership does not clear rpc connection in JobManagerLeaderListener Key: FLINK-16836 URL: https://issues.apache.org/jira/browse/FLINK-16836

[jira] [Created] (FLINK-16835) Replace TableConfig with Configuration

2020-03-27 Thread Timo Walther (Jira)
Timo Walther created FLINK-16835: Summary: Replace TableConfig with Configuration Key: FLINK-16835 URL: https://issues.apache.org/jira/browse/FLINK-16835 Project: Flink Issue Type:

[jira] [Created] (FLINK-16834) Examples cannot be run from IDE

2020-03-27 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-16834: - Summary: Examples cannot be run from IDE Key: FLINK-16834 URL: https://issues.apache.org/jira/browse/FLINK-16834 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-16833) Make JDBCDialect pluggable for JDBC SQL connector

2020-03-27 Thread Jark Wu (Jira)
Jark Wu created FLINK-16833: --- Summary: Make JDBCDialect pluggable for JDBC SQL connector Key: FLINK-16833 URL: https://issues.apache.org/jira/browse/FLINK-16833 Project: Flink Issue Type: New

[jira] [Created] (FLINK-16832) Refactor ReporSetup

2020-03-27 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-16832: Summary: Refactor ReporSetup Key: FLINK-16832 URL: https://issues.apache.org/jira/browse/FLINK-16832 Project: Flink Issue Type: Improvement

Re: [DISCUSS] FLIP-119: Pipelined Region Scheduling

2020-03-27 Thread Till Rohrmann
Thanks for creating this FLIP Zhu Zhu and Gary! +1 for adding pipelined region scheduling. Concerning the extended SlotProvider interface I have an idea how we could further improve it. If I am not mistaken, then you have proposed to introduce the two timeouts in order to distinguish between

Re: [VOTE] Apache Flink Stateful Functions Release 2.0.0, release candidate #2

2020-03-27 Thread Hequn Cheng
Thanks Gordon for the release and the nice release checking guide! It seems the NOTICE file is missing in the `statefun-ridesharing-example-simulator` module while it bundles dependencies like `org.springframework.boot:spring-boot-loader:2.1.6.RELEASE`. Best, Hequn On Fri, Mar 27, 2020 at 3:35

[jira] [Created] (FLINK-16831) Support plugin directory as JarLocation

2020-03-27 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-16831: Summary: Support plugin directory as JarLocation Key: FLINK-16831 URL: https://issues.apache.org/jira/browse/FLINK-16831 Project: Flink Issue Type:

[jira] [Created] (FLINK-16830) Let users use Row/List/Map/Seq directly in Expression DSL

2020-03-27 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-16830: Summary: Let users use Row/List/Map/Seq directly in Expression DSL Key: FLINK-16830 URL: https://issues.apache.org/jira/browse/FLINK-16830 Project: Flink

[jira] [Created] (FLINK-16829) Pass PrometheusReporter arguments via constructor

2020-03-27 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-16829: Summary: Pass PrometheusReporter arguments via constructor Key: FLINK-16829 URL: https://issues.apache.org/jira/browse/FLINK-16829 Project: Flink

[jira] [Created] (FLINK-16828) PrometheusReporters support factories

2020-03-27 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-16828: Summary: PrometheusReporters support factories Key: FLINK-16828 URL: https://issues.apache.org/jira/browse/FLINK-16828 Project: Flink Issue Type:

[jira] [Created] (FLINK-16827) FLINK 1.9.1 KAFKA流数据按时间字段排序在多并发情况下抛出空指针异常

2020-03-27 Thread wuchangjun (Jira)
wuchangjun created FLINK-16827: -- Summary: FLINK 1.9.1 KAFKA流数据按时间字段排序在多并发情况下抛出空指针异常 Key: FLINK-16827 URL: https://issues.apache.org/jira/browse/FLINK-16827 Project: Flink Issue Type: Bug

Re: [DISCUSS] Releasing Flink 1.10.1

2020-03-27 Thread Yu Li
Here comes the latest status of issues in 1.10.1 watch list: * Blockers (4 left) - [Under Discussion] FLINK-16018 Improve error reporting when submitting batch job (instead of AskTimeoutException) - [Closed] FLINK-16142 Memory Leak causes Metaspace OOM error on repeated job submission -

[jira] [Created] (FLINK-16826) Support copying of jars

2020-03-27 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-16826: Summary: Support copying of jars Key: FLINK-16826 URL: https://issues.apache.org/jira/browse/FLINK-16826 Project: Flink Issue Type: Improvement

Re: [DISCUSS] FLIP-108: Add GPU support in Flink

2020-03-27 Thread Stephan Ewen
Maybe one final comment: It is probably not an issue, but let's try and keep user code (via user code classloader) out of the ResourceManager, if possible. As background: There were thoughts in the past to support setups where the RM must run with "superuser" credentials, but we cannot run JM/TM

Re: [DISCUSS] FLIP-119: Pipelined Region Scheduling

2020-03-27 Thread Xintong Song
Gary & Zhu Zhu, Thanks for preparing this FLIP, and a BIG +1 from my side. The trade-off between resource utilization and potential deadlock problems has always been a pain. Despite not solving all the deadlock cases, this FLIP is definitely a big improvement. IIUC, it has already covered all the

[jira] [Created] (FLINK-16825) PrometheusReporterEndToEndITCase should rely on path returned by DownloadCache

2020-03-27 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-16825: Summary: PrometheusReporterEndToEndITCase should rely on path returned by DownloadCache Key: FLINK-16825 URL: https://issues.apache.org/jira/browse/FLINK-16825

Re: [DISCUSS] FLIP-119: Pipelined Region Scheduling

2020-03-27 Thread Zhu Zhu
To Yangze, >> the blocking edge will not be consumable before the upstream is finished. Yes. This is how we define a BLOCKING result partition, "Blocking partitions represent blocking data exchanges, where the data stream is first fully produced and then consumed". >> I'm also wondering could we

Re: [Discussion] Job generation / submission hooks & Atlas integration

2020-03-27 Thread Gyula Fóra
Hi Jack! You can find the document here: https://docs.google.com/document/d/1wSgzPdhcwt-SlNBBqL-Zb7g8fY6bN8JwHEg7GCdsBG8/edit?usp=sharing The document links to an already working Atlas hook prototype (and accompanying flink fork). The links for that are also here: Flink:

Re: [Discussion] Job generation / submission hooks & Atlas integration

2020-03-27 Thread jackylau
Hi Márton Balassi: I am very glad to look at it and where to find . And it is my issue , which you can see https://issues.apache.org/jira/browse/FLINK-16774 -- Sent from: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/

Re: [Discussion] Job generation / submission hooks & Atlas integration

2020-03-27 Thread Márton Balassi
Hi Jack, Yes, we know how to do it and even have the implementation ready and being reviewed by the Atlas community at the moment. :-) Would you be interested in having a look? On Thu, Mar 19, 2020 at 12:56 PM jackylau wrote: > Hi: > i think flink integrate atlas also need add catalog

Re: [DISCUSS] Creating a new repo to host Stateful Functions Dockerfiles

2020-03-27 Thread Zhijiang
+1 for this proposal. Very reasonable analysis! Best, Zhijiang -- From:Hequn Cheng Send Time:2020 Mar. 27 (Fri.) 09:46 To:dev Cc:private Subject:Re: [DISCUSS] Creating a new repo to host Stateful Functions Dockerfiles +1 for a

Re: Dynamic Flink SQL

2020-03-27 Thread Krzysztof Zarzycki
I want to do a bit different hacky PoC: * I will write a sink, that caches the results in "JVM global" memory. Then I will write a source, that reads this cache. * I will launch one job, that reads from Kafka source, shuffles the data to the desired partitioning and then sinks to that cache. *

Re: [DISCUSS] Creating a new repo to host Stateful Functions Dockerfiles

2020-03-27 Thread Gary Yao
+1 for a separate repository. Best, Gary On Fri, Mar 27, 2020 at 2:46 AM Hequn Cheng wrote: > +1 for a separate repository. > The dedicated `flink-docker` repo works fine now. We can do it similarly. > > Best, > Hequn > > On Fri, Mar 27, 2020 at 1:16 AM Till Rohrmann > wrote: > > > +1 for a

[jira] [Created] (FLINK-16824) Creating Temporal Table Function via DDL

2020-03-27 Thread Konstantin Knauf (Jira)
Konstantin Knauf created FLINK-16824: Summary: Creating Temporal Table Function via DDL Key: FLINK-16824 URL: https://issues.apache.org/jira/browse/FLINK-16824 Project: Flink Issue Type:

Re: [DISCUSS] FLIP-119: Pipelined Region Scheduling

2020-03-27 Thread Yangze Guo
Thanks for updating! +1 for supporting the pipelined region scheduling. Although we could not prevent resource deadlock in all scenarios, it is really a big step. The design generally LGTM. One minor thing I want to make sure. If I understand correctly, the blocking edge will not be consumable

Re: [VOTE] Apache Flink Stateful Functions Release 2.0.0, release candidate #1

2020-03-27 Thread Tzu-Li (Gordon) Tai
This vote is cancelled. Please see the voting thread for the new candidate, RC2: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/VOTE-Apache-Flink-Stateful-Functions-Release-2-0-0-release-candidate-2-td39379.html On Fri, Mar 27, 2020 at 2:39 PM Tzu-Li (Gordon) Tai wrote: > -1 >

[VOTE] Apache Flink Stateful Functions Release 2.0.0, release candidate #2

2020-03-27 Thread Tzu-Li (Gordon) Tai
Hi everyone, Please review and vote on the release candidate #2 for the version 2.0.0 of Apache Flink Stateful Functions, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) **Testing Guideline** You can find here [1] a doc that we can

Re: [VOTE] Apache Flink Stateful Functions Release 2.0.0, release candidate #1

2020-03-27 Thread Tzu-Li (Gordon) Tai
-1 Already discovered that the source distribution NOTICE file is missing mentions for font-awesome. The source of that is bundled under "docs/page/font-awesome/fonts", and is licensed with SIL OFL 1.1 license, which makes it a requirement to be listed in the NOTICE file. I'll open a new RC2