[jira] [Created] (FLINK-13523) Verify and correct arithmetic function's semantic for Blink planner

Zhenghua Gao created FLINK-13523: Summary: Verify and correct arithmetic function's semantic for Blink planner Key: FLINK-13523 URL: https://issues.apache.org/jira/browse/FLINK-13523 Project: Flink

[jira] [Created] (FLINK-13522) Verify and correct builtin function's semantic for Blink planner

Zhenghua Gao created FLINK-13522: Summary: Verify and correct builtin function's semantic for Blink planner Key: FLINK-13522 URL: https://issues.apache.org/jira/browse/FLINK-13522 Project: Flink

[jira] [Created] (FLINK-13521) Allow set configuration in SQL CLI

Jark Wu created FLINK-13521: --- Summary: Allow set configuration in SQL CLI Key: FLINK-13521 URL: https://issues.apache.org/jira/browse/FLINK-13521 Project: Flink Issue Type: Task

[jira] [Created] (FLINK-13520) Add documentation for the different behavior of row count sliding window in blink planner

Jark Wu created FLINK-13520: --- Summary: Add documentation for the different behavior of row count sliding window in blink planner Key: FLINK-13520 URL: https://issues.apache.org/jira/browse/FLINK-13520

Re: [DISCUSS] ARM support for Flink

Thanks for your reply. We are now keeping investigating and debugging Flink on ARM. It's hard for us to say How many kinds of test are enough for ARM support at this moment, but `core` and `test` are necessary of cause I think. What we do now is following travis-ci, added all the module that

[jira] [Created] (FLINK-13519) Elasticsearch Connector sample code for Scala on version 6.x will not work

Alberto Romero created FLINK-13519: -- Summary: Elasticsearch Connector sample code for Scala on version 6.x will not work Key: FLINK-13519 URL: https://issues.apache.org/jira/browse/FLINK-13519

[jira] [Created] (FLINK-13518) Disable Hive tests

Chesnay Schepler created FLINK-13518: Summary: Disable Hive tests Key: FLINK-13518 URL: https://issues.apache.org/jira/browse/FLINK-13518 Project: Flink Issue Type: Sub-task

Flink metrics with parallel operator

Hello, I have been working on a flink project and need some help with the metric system. I have a logic inside a process function which side outputs a particular message on certain failure parameters. This process function has a parallelism > 1. How do I keep track of the failed messages

[jira] [Created] (FLINK-13517) Restructure Hive Catalog documentation

Seth Wiesman created FLINK-13517: Summary: Restructure Hive Catalog documentation Key: FLINK-13517 URL: https://issues.apache.org/jira/browse/FLINK-13517 Project: Flink Issue Type:

[DISCUSS] CPU flame graph for a job vertex in web UI.

Hello, While looking into Flink internals, I've noticed that there is already a mechanism for stack-trace sampling of a particular job vertex. I think it may be really useful to allow user to easily render a cpu flamegraph in a new UI for a selected

[jira] [Created] (FLINK-13516) YARNSessionFIFOSecuredITCase fails on Java 11

Chesnay Schepler created FLINK-13516: Summary: YARNSessionFIFOSecuredITCase fails on Java 11 Key: FLINK-13516 URL: https://issues.apache.org/jira/browse/FLINK-13516 Project: Flink Issue

[jira] [Created] (FLINK-13515) ClassLoaderITCase fails on Java 11

Chesnay Schepler created FLINK-13515: Summary: ClassLoaderITCase fails on Java 11 Key: FLINK-13515 URL: https://issues.apache.org/jira/browse/FLINK-13515 Project: Flink Issue Type:

Re: [DISCUSS] Removing the flink-mapr-fs module

This has been fixed in master and 1.9, see https://issues.apache.org/jira/browse/FLINK-13499 On Tue, Jul 30, 2019 at 3:28 PM Stephan Ewen wrote: > I will open a PR later today, changing the module to use reflection rather > than a hard MapR dependency. > > On Tue, Jul 30, 2019 at 6:40 AM Rong

[jira] [Created] (FLINK-13514) StreamTaskTest#testAsyncCheckpointingConcurrentCloseAfterAcknowledge unstable

Chesnay Schepler created FLINK-13514: Summary: StreamTaskTest#testAsyncCheckpointingConcurrentCloseAfterAcknowledge unstable Key: FLINK-13514 URL: https://issues.apache.org/jira/browse/FLINK-13514

Re: [DISCUSS] ARM support for Flink

Wow, that is pretty nice work, thanks a lot! We need some support from Apache Infra to see if we can connect the Flink Github Repo with the OpenLab CI. We would also need a discussion on the developer mailing list, to get community agreement. Have you looked at whether we need to run all tests

Re: [DISCUSS] Flink client api enhancement for downstream project

Thanks tison for the effort. I left a few comments. Zili Chen 于2019年7月31日周三 下午8:24写道： > Hi Flavio, > > Thanks for your reply. > > Either current impl and in the design, ClusterClient > never takes responsibility for generating JobGraph. > (what you see in current codebase is several class

[jira] [Created] (FLINK-13513) Add the FlatMapper and related classes for later algorithm implementations.

Xu Yang created FLINK-13513: --- Summary: Add the FlatMapper and related classes for later algorithm implementations. Key: FLINK-13513 URL: https://issues.apache.org/jira/browse/FLINK-13513 Project: Flink

Re: [DISCUSS] Flink client api enhancement for downstream project

Hi Flavio, Thanks for your reply. Either current impl and in the design, ClusterClient never takes responsibility for generating JobGraph. (what you see in current codebase is several class methods) Instead, user describes his program in the main method with ExecutionEnvironment apis and calls

Re: [DISCUSS] Flink client api enhancement for downstream project

Just one note on my side: it is not clear to me whether the client needs to be able to generate a job graph or not. In my opinion, the job jar must resides only on the server/jobManager side and the client requires a way to get the job graph. If you really want to access to the job graph, I'd add

[jira] [Created] (FLINK-13512) Kinesis connector missing jaxb-api dependency

Chesnay Schepler created FLINK-13512: Summary: Kinesis connector missing jaxb-api dependency Key: FLINK-13512 URL: https://issues.apache.org/jira/browse/FLINK-13512 Project: Flink Issue

[jira] [Created] (FLINK-13511) Kafka 0.10/0.11 tests failing doe to missing jaxb-api dependency

Chesnay Schepler created FLINK-13511: Summary: Kafka 0.10/0.11 tests failing doe to missing jaxb-api dependency Key: FLINK-13511 URL: https://issues.apache.org/jira/browse/FLINK-13511 Project:

Re: REST API / JarRunHandler: More flexibility for launching jobs

By the way, currently Dispatcher implements RestfulGateway and delegate resource request to ResourceManager. If we can, semantically, let WebMonitor implement RestfulGateway, and delegate job request to Dispatcher, resource request to ResourceManager, it seems reasonable that when WebMonitor

[jira] [Created] (FLINK-13510) Show fail attemp for subtask in timelime

lining created FLINK-13510: -- Summary: Show fail attemp for subtask in timelime Key: FLINK-13510 URL: https://issues.apache.org/jira/browse/FLINK-13510 Project: Flink Issue Type: Improvement

Re: REST API / JarRunHandler: More flexibility for launching jobs

I don't think the `Program` interface could solve the problem. The launcher launches the job server which creates the job graph, submits it and keeps monitoring. Even if user program implement `Program` Flink still extracts the JobGraph from `getPlan` and submits it, instead of really execute

Re: [DISCUSS] Flink client api enhancement for downstream project

Hi all, Here is a document[1] on client api enhancement from our perspective. We have investigated current implementations. And we propose 1. Unify the implementation of cluster deployment and job submission in Flink. 2. Provide programmatic interfaces to allow flexible job and cluster

[jira] [Created] (FLINK-13509) Support `is not distinct from ` and similar syntax in LookupJoin

Jing Zhang created FLINK-13509: -- Summary: Support `is not distinct from ` and similar syntax in LookupJoin Key: FLINK-13509 URL: https://issues.apache.org/jira/browse/FLINK-13509 Project: Flink

Re: [DISCUSS] ARM support for Flink

We (as in the Flink PMC) cannot add apps to the GitHub repo; please check first with INFRA whether these CI systems are allowed. On 30/07/2019 03:44, Xiyuan Wang wrote: Hi Stephan, Maybe I misled you in the previous email. We don't need to migrate CI completely, travis-ci is still there

[jira] [Created] (FLINK-13508) CommonTestUtils#waitUntilCondition() may attempt to sleep with negative time

Gary Yao created FLINK-13508: Summary: CommonTestUtils#waitUntilCondition() may attempt to sleep with negative time Key: FLINK-13508 URL: https://issues.apache.org/jira/browse/FLINK-13508 Project: Flink

[jira] [Created] (FLINK-13507) kafka consumer not able to distinguish topic name after add source

quanduoling created FLINK-13507: --- Summary: kafka consumer not able to distinguish topic name after add source Key: FLINK-13507 URL: https://issues.apache.org/jira/browse/FLINK-13507 Project: Flink

Re: REST API / JarRunHandler: More flexibility for launching jobs

Are you looking for something similar to the `Program` interface? This interface, even though it is a bit outdated and might get removed in the future, offers a `getPlan` method which is called in order to generate the `JobGraph`. In the client refactoring discussion thread it is currently being

Re: REST API / JarRunHandler: More flexibility for launching jobs

Couldn't the beam job server use the same work-around we're using in the JarRunHandler to get access to the JobGraph? On 26/07/2019 17:38, Thomas Weise wrote: Hi Till, Thanks for taking a look! The Beam job server does not currently have the ability to just output the job graph (and related

[jira] [Created] (FLINK-13506) flink1.6.1 can't consume the specified topic list，only a few topic was consumed

jiangxiaozhi created FLINK-13506: Summary: flink1.6.1 can't consume the specified topic list，only a few topic was consumed Key: FLINK-13506 URL: https://issues.apache.org/jira/browse/FLINK-13506

[jira] [Created] (FLINK-13505) Translate "Java Lambda Expressions" page into Chinese

WangHengWei created FLINK-13505: --- Summary: Translate "Java Lambda Expressions" page into Chinese Key: FLINK-13505 URL: https://issues.apache.org/jira/browse/FLINK-13505 Project: Flink Issue

Re: Flink Kafka Issues

Is the watermarking configured per-partition in Kafka, or per source? If it is configured per partition, then a late (trailing) or early (leading) partition would not affect the watermark as a whole. There would not be any dropping of late data, simply a delay in the results until the latest

[jira] [Created] (FLINK-13504) NoSuchFieldError when executing DDL via tEnv.sqlUpdate in application project

Jark Wu created FLINK-13504: --- Summary: NoSuchFieldError when executing DDL via tEnv.sqlUpdate in application project Key: FLINK-13504 URL: https://issues.apache.org/jira/browse/FLINK-13504 Project: Flink

[jira] [Created] (FLINK-13503) Correct the behavior of `JDBCLookupFunction`

Jing Zhang created FLINK-13503: -- Summary: Correct the behavior of `JDBCLookupFunction` Key: FLINK-13503 URL: https://issues.apache.org/jira/browse/FLINK-13503 Project: Flink Issue Type: Task

Re: Flink Kafka Issues

Hi Jiangjie, Thanks for your response. I was able to figure out the issue. We have multiple end points from which we receive data. Out of which, one of the endpoints NTP was not set up/rather not getting synced to ntp properly. so those VM's were sending packets which was 2 mins ahead of time. So