[jira] [Created] (FLINK-8563) Support consecutive DOT operators

2018-02-05 Thread Timo Walther (JIRA)
Timo Walther created FLINK-8563: --- Summary: Support consecutive DOT operators Key: FLINK-8563 URL: https://issues.apache.org/jira/browse/FLINK-8563 Project: Flink Issue Type: Improvement

[Discuss] Proposing FLIP-25 - Support User State TTL Natively in Flink

2018-02-05 Thread Bowen Li
Hi guys, I want to propose a new FLIP -- FLIP-25 - Support User State TTL Natively in Flink. This has been one of most handy and most frequently asked features in Flink community. The jira ticket is FLINK-3089 . I've written a rough design

[jira] [Created] (FLINK-8562) Fix YARNSessionFIFOSecuredITCase

2018-02-05 Thread Shuyi Chen (JIRA)
Shuyi Chen created FLINK-8562: - Summary: Fix YARNSessionFIFOSecuredITCase Key: FLINK-8562 URL: https://issues.apache.org/jira/browse/FLINK-8562 Project: Flink Issue Type: Bug

Timestamp/watermark support in Kinesis consumer

2018-02-05 Thread Thomas Weise
Hi, The Kinesis consumer currently does not emit watermarks, and this can lead to problems when a single subtask reads from multiple shards and offsets are not closely aligned with respect to the event time. The Kafka consumer has support for periodic and punctuated watermarks, although there is

Re: [DISCUSS] Releasing Flink 1.5.0

2018-02-05 Thread Kostas Kloudas
Hi Aljoscha, I believe that support for Broadcast State should also be in 1.5. There is an open PR https://github.com/apache/flink/pull/5230 for that and there are some pending issues related to scala api and documentation. Thanks, Kostas > On Feb 5,

Re: Fetch Metrics

2018-02-05 Thread Amit Jain
Hi Suvimal, You may use REST API connecting to Job Manager to retrieve the stored metrics. Have a look at this link https://ci.apache.org/ projects/flink/flink-docs-release-1.4/monitoring/metrics.html#rest-api- integration -- Thanks, Amit On Mon, Feb 5, 2018 at 2:47 PM, Suvimal Yashraj <

Re: [DISCUSS] Releasing Flink 1.5.0

2018-02-05 Thread Timo Walther
Hi Shuyi, I will take a look at it again this week. I'm pretty sure it will be part of 1.5.0. Regards, Timo Am 2/5/18 um 5:25 PM schrieb Shuyi Chen: Hi Aljoscha, can we get this feature in for 1.5.0? We have a lot of internal users waiting for this feature. [FLINK-7923

Re: [DISCUSS] Releasing Flink 1.5.0

2018-02-05 Thread Shuyi Chen
Hi Aljoscha, can we get this feature in for 1.5.0? We have a lot of internal users waiting for this feature. [FLINK-7923 ] Support accessing subfields of a Composite element in an Object Array type column Thanks a lot Shuyi On Mon, Feb 5, 2018

Re: [DISCUSS] Releasing Flink 1.5.0

2018-02-05 Thread Christophe Jolif
Hi guys, Sorry for jumping in, but I think [FLINK-8101] Elasticsearch 6.X support [FLINK-7386] Flink Elasticsearch 5 connector is not compatible with Elasticsearch 5.2+ client have long been awaited and there was one PR from me and from someone else showing the interest ;) So if you could

Re: [DISCUSS] Releasing Flink 1.5.0

2018-02-05 Thread Timo Walther
Hi Aljoscha, it would be great if we can include the first version of the SQL client (see FLIP-24, Implementation Plan 1). I will open a PR this week. I think we can merge this with explicit "experimental/alpha" status. It is far away from feature completeness but will be a great tool for

Re: [DISCUSS] Releasing Flink 1.5.0

2018-02-05 Thread Tzu-Li (Gordon) Tai
Hi Aljoscha, Thanks for starting the discussion. I think there’s a few connector related must-have improvements that we should get in before the feature freeze, since quite a few users have been asking for them: [FLINK-6352] FlinkKafkaConsumer should support to use timestamp to set up start

[jira] [Created] (FLINK-8561) SharedBuffer line 573 uses == to compare BufferEntries instead of .equals.

2018-02-05 Thread Kostas Kloudas (JIRA)
Kostas Kloudas created FLINK-8561: - Summary: SharedBuffer line 573 uses == to compare BufferEntries instead of .equals. Key: FLINK-8561 URL: https://issues.apache.org/jira/browse/FLINK-8561 Project:

[jira] [Created] (FLINK-8560) Access to the current key in ProcessFunction after keyBy()

2018-02-05 Thread JIRA
Jürgen Thomann created FLINK-8560: - Summary: Access to the current key in ProcessFunction after keyBy() Key: FLINK-8560 URL: https://issues.apache.org/jira/browse/FLINK-8560 Project: Flink

[jira] [Created] (FLINK-8559) JobManagerHACheckpointRecoveryITCase runs indefinitely on Windows

2018-02-05 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-8559: --- Summary: JobManagerHACheckpointRecoveryITCase runs indefinitely on Windows Key: FLINK-8559 URL: https://issues.apache.org/jira/browse/FLINK-8559 Project: Flink

[jira] [Created] (FLINK-8558) Add unified format interfaces and format discovery

2018-02-05 Thread Timo Walther (JIRA)
Timo Walther created FLINK-8558: --- Summary: Add unified format interfaces and format discovery Key: FLINK-8558 URL: https://issues.apache.org/jira/browse/FLINK-8558 Project: Flink Issue Type:

[jira] [Created] (FLINK-8557) OperatorSubtaskDescriptionText causes failures on Windows

2018-02-05 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-8557: --- Summary: OperatorSubtaskDescriptionText causes failures on Windows Key: FLINK-8557 URL: https://issues.apache.org/jira/browse/FLINK-8557 Project: Flink

Fetch Metrics

2018-02-05 Thread Suvimal Yashraj
Hello, I'm new to apache flink and I want to extract the already present metrics in flink which is stored on the server of the currently running jobs like bytes transferred, cpu usage, duration, etc. I'm finding it difficult so as to how to connect my java program to the server and fetch these