Re: [DISCUSS] Releasing Flink 1.1.4

+1 Looking forward this release ! Regards JB ⁣​ On Oct 25, 2016, 14:43, at 14:43, Robert Metzger wrote: >+1 for a bugfix release soon. > >On Tue, Oct 25, 2016 at 10:53 AM, Stephan Ewen >wrote: > >> Thanks fort starting this Ufuk. >> >> I would like to

[jira] [Created] (FLINK-4923) Expose input/output queued buffers and buffer usage as a metric for a Task

zhuhaifeng created FLINK-4923: - Summary: Expose input/output queued buffers and buffer usage as a metric for a Task Key: FLINK-4923 URL: https://issues.apache.org/jira/browse/FLINK-4923 Project: Flink

[jira] [Created] (FLINK-4922) Write documentation

Eron Wright created FLINK-4922: --- Summary: Write documentation Key: FLINK-4922 URL: https://issues.apache.org/jira/browse/FLINK-4922 Project: Flink Issue Type: Sub-task Reporter:

[jira] [Created] (FLINK-4921) Upgrade to Mesos 1.0.1

Eron Wright created FLINK-4921: --- Summary: Upgrade to Mesos 1.0.1 Key: FLINK-4921 URL: https://issues.apache.org/jira/browse/FLINK-4921 Project: Flink Issue Type: Sub-task

SVMITSuite Testing

Hello, I am trying to run the SVMITSuite in the Flink-ML library. When I build the package it seems to skip all tests in SVMITSuite - I'm assuming it's because there's no ExecutionEnvironment set up to use the DataSet API. I can't seem to find any documentation on how to run this either. Any

Re: [FLINK-3035] Redis as State Backend

FYI.I was using Redis as a state backend in my benchmarking Beam.It proved to be a bottleneck. Perhaps due to high frequency of updating state components.I replaced it with Java 8 ConcurrentHashmaps and it settled down tremendously.Amir- From: Ovidiu-Cristian MARCU

[jira] [Created] (FLINK-4919) Add secure cookie support for the cluster deployed in Mesos environment

Vijay Srinivasaraghavan created FLINK-4919: -- Summary: Add secure cookie support for the cluster deployed in Mesos environment Key: FLINK-4919 URL: https://issues.apache.org/jira/browse/FLINK-4919

[jira] [Created] (FLINK-4918) Add SSL support to Mesos artifact server

Vijay Srinivasaraghavan created FLINK-4918: -- Summary: Add SSL support to Mesos artifact server Key: FLINK-4918 URL: https://issues.apache.org/jira/browse/FLINK-4918 Project: Flink

Re: Python API iteration issues

Hey Geoffrey, that's great to hear! Random.nextInt() should suffice; but this is only done twice per operator anyway so i wouldn't worry too much about it. Regards, Chesnay On 25.10.2016 17:52, Geoffrey Mon wrote: Hello Chesnay, Thank you, this solves the last problem that I had with my

[Discuss] FLIP-13 Side Outputs in Flink

Hey folks, Please give feedback on FLIP-13! https://cwiki.apache.org/confluence/display/FLINK/FLIP-13+Side+Outputs+in+Flink JIRA task link to google doc https://issues.apache.org/jira/browse/FLINK-4460 Thanks, Chen Qin

Re: Python API iteration issues

Hello Chesnay, Thank you, this solves the last problem that I had with my project! I added code to append a random UUID to each data channel. (see https://github.com/GEOFBOT/flink/commit/b94b1249c4a014d8d1e412f7647ff192f3621b10) However, is a UUID overkill? We only need the channel to be unique

Re: FLIP-6 and running many "small" jobs

Hi Maciek, Your use case will be covered by the FLIP-6 "Sessions". Sessions are similar to how the on-premise Flink or the Yarn session operates today. We will have a long-running dispatcher, resource manager, and task managers. We will bring up a job manager for each job but the overhead for

[jira] [Created] (FLINK-4917) Deprecate "CheckpointedAsynchronously" interface

Stephan Ewen created FLINK-4917: --- Summary: Deprecate "CheckpointedAsynchronously" interface Key: FLINK-4917 URL: https://issues.apache.org/jira/browse/FLINK-4917 Project: Flink Issue Type:

[jira] [Created] (FLINK-4915) Define parameters for reconciliation

Stephan Ewen created FLINK-4915: --- Summary: Define parameters for reconciliation Key: FLINK-4915 URL: https://issues.apache.org/jira/browse/FLINK-4915 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-4914) Define parameters for reconciliation

Stephan Ewen created FLINK-4914: --- Summary: Define parameters for reconciliation Key: FLINK-4914 URL: https://issues.apache.org/jira/browse/FLINK-4914 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-4913) Per-job Yarn clusters: include user jar in system class loader

Maximilian Michels created FLINK-4913: - Summary: Per-job Yarn clusters: include user jar in system class loader Key: FLINK-4913 URL: https://issues.apache.org/jira/browse/FLINK-4913 Project:

[jira] [Created] (FLINK-4912) Introduce RECONCILIATING state in ExecutionGraph

Stephan Ewen created FLINK-4912: --- Summary: Introduce RECONCILIATING state in ExecutionGraph Key: FLINK-4912 URL: https://issues.apache.org/jira/browse/FLINK-4912 Project: Flink Issue Type:

Re: [DISCUSS] Schedule and Scope for Flink 1.2

+1 the schedule proposed so far. Do we also want to get in the "Trigger DSL" that we've had brewing for a while now? On Mon, 17 Oct 2016 at 16:17 Stephan Ewen wrote: > I think this sounds very reasonable, +1 to the schedule. > > I would definitely add > - FLIP-10 (unify

[jira] [Created] (FLINK-4911) Non-disruptive JobManager Failures

Stephan Ewen created FLINK-4911: --- Summary: Non-disruptive JobManager Failures Key: FLINK-4911 URL: https://issues.apache.org/jira/browse/FLINK-4911 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-4908) Add docs about evaluate operation to all predictors

Theodore Vasiloudis created FLINK-4908: -- Summary: Add docs about evaluate operation to all predictors Key: FLINK-4908 URL: https://issues.apache.org/jira/browse/FLINK-4908 Project: Flink

Re: [DISCUSS] Releasing Flink 1.1.4

+1 for a bugfix release soon. On Tue, Oct 25, 2016 at 10:53 AM, Stephan Ewen wrote: > Thanks fort starting this Ufuk. > > I would like to add the following issues to 1.1.4: > > Build errors due to Storm dependencies *(fix pending)* > - [FLINK-4298] [storm compatibility]

[jira] [Created] (FLINK-4907) Add Test for Timers/State Provided by AbstractStreamOperator

Aljoscha Krettek created FLINK-4907: --- Summary: Add Test for Timers/State Provided by AbstractStreamOperator Key: FLINK-4907 URL: https://issues.apache.org/jira/browse/FLINK-4907 Project: Flink

[jira] [Created] (FLINK-4906) Use constants for the name of system-defined metrics

Chesnay Schepler created FLINK-4906: --- Summary: Use constants for the name of system-defined metrics Key: FLINK-4906 URL: https://issues.apache.org/jira/browse/FLINK-4906 Project: Flink

[jira] [Created] (FLINK-4905) Kafka test instability IllegalStateException: Client is not started

Robert Metzger created FLINK-4905: - Summary: Kafka test instability IllegalStateException: Client is not started Key: FLINK-4905 URL: https://issues.apache.org/jira/browse/FLINK-4905 Project: Flink

Re: [DISCUSS] Releasing Flink 1.1.4

Thanks fort starting this Ufuk. I would like to add the following issues to 1.1.4: Build errors due to Storm dependencies *(fix pending)* - [FLINK-4298] [storm compatibility] Add proper repository for Closure dependencies. Stability on S3 considering eventual consistency *(fix pending)*

[jira] [Created] (FLINK-4904) Add a limit for how much data may be spilled in checkpoint alignments

Stephan Ewen created FLINK-4904: --- Summary: Add a limit for how much data may be spilled in checkpoint alignments Key: FLINK-4904 URL: https://issues.apache.org/jira/browse/FLINK-4904 Project: Flink

[jira] [Created] (FLINK-4903) Introduce non async future methods

Till Rohrmann created FLINK-4903: Summary: Introduce non async future methods Key: FLINK-4903 URL: https://issues.apache.org/jira/browse/FLINK-4903 Project: Flink Issue Type: Improvement

Re: [FLINK-3035] Redis as State Backend

Thank you! Best, Ovidiu > On 24 Oct 2016, at 16:11, Aljoscha Krettek wrote: > > Hi, > regarding RocksDB, yes this is possible because RocksDB is essentially only > used as an out-of-core hash table. When checkpointing we write everything > from RocksDB to HDFS. When