[jira] [Created] (FLINK-14075) Remove unnecessary resource close in JDBCOutputFormatTest.java

Canbin Zheng created FLINK-14075: Summary: Remove unnecessary resource close in JDBCOutputFormatTest.java Key: FLINK-14075 URL: https://issues.apache.org/jira/browse/FLINK-14075 Project: Flink

Re: Checkpoint metrics.

Alright, here's another case where this is very pronounced. Here's a link to a couple of screenshots showing the overall stats for a slow task as well as a zoom in on the slowest of them: https://pasteboard.co/IxhGWXz.png This is the sink stage of a pipeline with 3 upstream tasks. All the upstr

Re: Checkpoint metrics.

Here's the second screenshot I forgot to include: https://pasteboard.co/IxhNIhc.png On Fri, Sep 13, 2019 at 4:34 PM Jamie Grier wrote: > Alright, here's another case where this is very pronounced. Here's a link > to a couple of screenshots showing the overall stats for a slow task as > well as

Re: Flink operators for Kubernetes

Hey guys, We open sourced the flink on K8s operator - https://github.com/lyft/flinkk8soperator and have been stabilizing it for a while. Several folks from the community have already been using it. Please check it out and give us your feedback. If you ha

Re: [ANNOUNCE] Apache Flink 1.8.2 released

Thanks Jark for being our release manager and thanks to everyone who has contributed. Cheers, Till On Fri, Sep 13, 2019 at 4:12 PM jincheng sun wrote: > Thanks for being the release manager and the great work Jark :) > Also thanks to the community making this release possible! > > Best, > Jinch

Re: Checkpoint metrics.

Thanks Seth and Stephan, Yup, I had intended to upload a image. Here it is: https://pasteboard.co/Ixg0YP2.png This one is very simple and I suppose can be explained by heavy backpressure. The more complex version of this problem I run into frequently is where a single (or a couple of) sub-task(

Re: [DISCUSS] FLIP-57 - Rework FunctionCatalog

Hi Fabian, Yes, I agree 1-part/no-override is the least favorable thus I didn't include that as a voting option, and the discussion is mainly between 1-part/override builtin and 3-part/not override builtin. Re > However, it means that temp functions are differently treated than other db objects.

Re: [DISCUSS] Contribute Pulsar Flink connector back to Flink

Hi All, Sorry for joining the discussion late and thanks Yijie & Sijie for driving the discussion. I also think the Pulsar connector would be a very valuable addition to Flink. I can also help out a bit on the review side :-) Regarding the timeline, I also share concerns with Becket on the relati

Re: [DISCUSS] Contribute Pulsar Flink connector back to Flink

Technically speaking, removing the old connector code is a backwards incompatible change which requires a major version bump, i.e. Flink 2.x. Given that we don't have a clear plan on when to have the next major version release, it seems unclear how long the old connector code will be there if we ch

Re: How stable is FlinkSQL.

Can you share some more details? - are you running batch SQL or streaming SQL - are you running the original Flink SQL engine or the new Blink SQL engine (since 1.9) Best, Stephan On Fri, Sep 13, 2019 at 3:24 PM srikanth flink wrote: > Hi there, > > I'm trying to get some hands on with Fl

Re: [ANNOUNCE] Apache Flink 1.8.2 released

Thanks for being the release manager and the great work Jark :) Also thanks to the community making this release possible! Best, Jincheng Jark Wu 于2019年9月13日周五 下午10:07写道： > Hi, > > The Apache Flink community is very happy to announce the release of Apache > Flink 1.8.2, which is the second bugf

[ANNOUNCE] Apache Flink 1.8.2 released

Hi, The Apache Flink community is very happy to announce the release of Apache Flink 1.8.2, which is the second bugfix release for the Apache Flink 1.8 series. Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data streami

How stable is FlinkSQL.

Hi there, I'm trying to get some hands on with FlinkSQL and take to production, if works. Would like to know if someone deployed FlinkSQL in production? I'm facing issues while running FlinkSQL queries. Thanks Srikanth

Re: [DISCUSS] FLIP-57 - Rework FunctionCatalog

Hi all, Thanks Dawid for the additional explanation! As others summarized there are two questions: 1) Are temporal functions a) top-level functions (1-part address) and not associated with a catalog/db or b) do we threat them like any other database object with a 3-part address. 2) If we treat t

Re: Flink stream python

Hi Milan, Hoping Till has answered your questions. WRT whether it supports to use libraries from Java code in Python, the answer is yes. Regarding to use Java connectors in Python, there are two ways: 1) If there is a Java TableFactory[1] defined for the connector, you could try to use the pyf

Re: Uncertain result when using group by in stream sql

Hi, A GROUP BY query on a streaming table requires that the result is continuously updated. Updates are propagated as a retraction stream (see tEnv.toRetractStream(table, Row.class).print(); in your code). A retraction stream encodes the type of the update as a boolean flag, the "true" and "false

[jira] [Created] (FLINK-14074) MesosResourceManager can't create new taskmanagers in Session Cluster Mode.

Alexander Kasyanenko created FLINK-14074: Summary: MesosResourceManager can't create new taskmanagers in Session Cluster Mode. Key: FLINK-14074 URL: https://issues.apache.org/jira/browse/FLINK-14074

Re: [DISCUSS] FLIP-56: Dynamic Slot Allocation

Thanks for the update Xintong. From a high level perspective the implementation plan looks good to me. Cheers, Till On Thu, Sep 12, 2019 at 11:04 AM Xintong Song wrote: > Added implementation steps for this FLIP on the wiki page [1]. > > > Thank you~ > > Xintong Song > > > [1] > > https://cwiki

Re: Flink stream python

Hi Milan, I can only give you some high level answers because I'm not actively involved in the development of Flink's Python support. But I've cc'ed Jincheng who is driving this effort and can give you more detailed answers. At the moment, Flink's Python API can be seen as a thin wrapper around F

Flink stream python

Hello everyone, I would appreciate if someone could please clarify me several things regarding Flink. Flink 1.10 I'm trying to develop PYTHON stream application using pyflink-stream. I managed successfully to run wordcount.py (in attachment). Now, I would like to go one step further and to use

Uncertain result when using group by in stream sql

I use flink stream sql to write a demo about "group by". The records are [(bj, 1), (bj, 3), (bj, 5)]. I group by the first element and sum the second element. Every time I run the program, the result is different. It seems that the records are out of order. Even sometimes record is los

[jira] [Created] (FLINK-14073) CalcITCase failed on Travis

Till Rohrmann created FLINK-14073: - Summary: CalcITCase failed on Travis Key: FLINK-14073 URL: https://issues.apache.org/jira/browse/FLINK-14073 Project: Flink Issue Type: Bug Compo

Retention policy | Memory management.

Hi there, I came across Flink and FlinkSQL and using FlinkSQL for stream processing. Flink runs as 3 node cluster with embedded Zookeeper, given heap 80GB on each. I came across few issues and would like to get some clarification. - Job1: Using Flink(java) to read and flatten my JSON and write