Re: Too many open files

Not sure if you have looked at FLINK-8707 FYI On Tue, Mar 20, 2018 at 2:13 PM, Govindarajan Srinivasaraghavan < govindragh...@gmail.com> wrote: > Hi, > > We have a streaming job that runs on flink in docker and checkpointing > happens every 10 seconds. After several starts and cancellations we

Too many open files

Hi, We have a streaming job that runs on flink in docker and checkpointing happens every 10 seconds. After several starts and cancellations we are facing this issue with file handles. The job reads data from kafka, processes it and writes it back to kafka and we are using RocksDB state backend.

Re: [ANNOUNCE] Weekly community update #12

Great initiative, highly appreciated, Till! On Mon, Mar 19, 2018 at 7:06 PM, Till Rohrmann wrote: > Dear community, > > I've noticed that Flink has grown quite a bit in the past. As a > consequence it can be quite challenging to stay up to date. Especially for > community

Re: FLIP-6 / Kubernetes

@Eron That is definitely the way we want to suggest as the way to use k8s in the future. This feature did not make it for 1.5, but should come very soon after. @Thomas An implementation of a ResourceManager for k8s should come in the near future. Would be happy to jump on a joint FLIP, after the

[jira] [Created] (FLINK-9036) Add default value via suppliers

Stephan Ewen created FLINK-9036: --- Summary: Add default value via suppliers Key: FLINK-9036 URL: https://issues.apache.org/jira/browse/FLINK-9036 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-9035) State Descriptors have broken hashCode() and equals()

Stephan Ewen created FLINK-9035: --- Summary: State Descriptors have broken hashCode() and equals() Key: FLINK-9035 URL: https://issues.apache.org/jira/browse/FLINK-9035 Project: Flink Issue

[jira] [Created] (FLINK-9034) State Descriptors drop TypeInformation on serialization

Stephan Ewen created FLINK-9034: --- Summary: State Descriptors drop TypeInformation on serialization Key: FLINK-9034 URL: https://issues.apache.org/jira/browse/FLINK-9034 Project: Flink Issue

[jira] [Created] (FLINK-9033) Replace usages of deprecated TASK_MANAGER_NUM_TASK_SLOTS

Hai Zhou created FLINK-9033: --- Summary: Replace usages of deprecated TASK_MANAGER_NUM_TASK_SLOTS Key: FLINK-9033 URL: https://issues.apache.org/jira/browse/FLINK-9033 Project: Flink Issue Type:

Re: FLIP-6 / Kubernetes

Till, is it possible to package a Flink application as a self-contained deployment on Kubernetes? I mean, run a Flink application using 'flink run' such that it launches its own RM/JM and waits for a sufficient # of TMs to join? Thanks! On Mon, Mar 19, 2018 at 2:57 AM, Till Rohrmann

[jira] [Created] (FLINK-9032) Deprecate ConfigConstants#YARN_CONTAINER_START_COMMAND_TEMPLATE

Hai Zhou created FLINK-9032: --- Summary: Deprecate ConfigConstants#YARN_CONTAINER_START_COMMAND_TEMPLATE Key: FLINK-9032 URL: https://issues.apache.org/jira/browse/FLINK-9032 Project: Flink Issue

[jira] [Created] (FLINK-9030) JobManager fails to archive job to FS when TM is lost

Jared Stehler created FLINK-9030: Summary: JobManager fails to archive job to FS when TM is lost Key: FLINK-9030 URL: https://issues.apache.org/jira/browse/FLINK-9030 Project: Flink Issue

[jira] [Created] (FLINK-9029) Getting write permission from HDFS after updating flink-1.40 to flink-1.4.2

Mohammad Abareghi created FLINK-9029: Summary: Getting write permission from HDFS after updating flink-1.40 to flink-1.4.2 Key: FLINK-9029 URL: https://issues.apache.org/jira/browse/FLINK-9029

Re: [ANNOUNCE] Apache Flink 1.3.3 released

Whoops, looks like we forgot to push the release button :) Thank you for notifying us. The artifacts should be available soon. On 20.03.2018 11:35, Philip Luppens wrote: Hi everyone, Thanks, but I don’t see the binaries for 1.3.3 being pushed anywhere in the Maven repositories [1]. Can we

Re: [ANNOUNCE] Apache Flink 1.3.3 released

Hi everyone, Thanks, but I don’t see the binaries for 1.3.3 being pushed anywhere in the Maven repositories [1]. Can we expect them to show up over there as well eventually? [1] https://repo.maven.apache.org/maven2/org/apache/flink/flink-java/ Kind regards, -Phil On Fri, Mar 16, 2018 at 3:36

[jira] [Created] (FLINK-9028) flip6 should check config before starting cluster

Sihua Zhou created FLINK-9028: - Summary: flip6 should check config before starting cluster Key: FLINK-9028 URL: https://issues.apache.org/jira/browse/FLINK-9028 Project: Flink Issue Type: Bug