Looking for a partner for an European H2020 project

2015-12-16 Thread Pharizna
We are looking for a company to help us in our SOIRE2-2016 proposal to present 20 January. We have industrial / end users partners, statistical and data Mining too but we need FLINK people! Please, contact me if you are interested in our proposal in order to send you more information Thank

Re: Specify jobmanager port in HA mode

2015-12-16 Thread Ufuk Celebi
Hey Cory, I’ve opened a pull request for this [1]. It’s based on the current snapshot version. This is not a bug fix, but since we are only adding behaviour I think that it can make its way into 0.10.2 if it is a blocker for users. Currently, you can only try it out by building it yourself.

Apache Flink Web Dashboard - Completed Job history

2015-12-16 Thread Ovidiu-Cristian MARCU
Hi If I restart the Flink I don’t see anymore the history of the completed jobs. Is this a missing feature or what should I do to see the completed job list history? Best regards, Ovidiu

Re: Using S3 as state backend

2015-12-16 Thread Thomas Götzinger
Hi Brian, thanks, that helped me a lot. 2015-12-15 16:52 GMT+01:00 Brian Chhun : > Sure, excuse me if anything was obvious or wrong, I know next to nothing > about Hadoop. > > 1. get the Hadoop 2.7 distribution (I set its path to HADOOP_HOME to make > things

All datanodes are bad

2015-12-16 Thread Muhammad Ali Orakzai
Hi, I am receiving the following exception while trying to run the terasort program on flink. My configuration is as follows: Hadoop: 2.6.2 Flink: 0.10.1 Server 1: Hadoop data and name node Flink job and task manager Server 2: Flink task manager

Re: Apache Flink Web Dashboard - Completed Job history

2015-12-16 Thread Matthias J. Sax
I guess it should be possible to manually save this information from the corresponding directory and copy it back after restart? But I am not sure? Please correct me if I am wrong. -Matthias On 12/16/2015 03:16 PM, Ufuk Celebi wrote: > >> On 16 Dec 2015, at 15:00, Ovidiu-Cristian MARCU >>

Re: Apache Flink Web Dashboard - Completed Job history

2015-12-16 Thread Ufuk Celebi
> On 16 Dec 2015, at 15:00, Ovidiu-Cristian MARCU > wrote: > > Hi > > If I restart the Flink I don’t see anymore the history of the completed jobs. > Is this a missing feature or what should I do to see the completed job list > history? Not possible at the

Re: global watermark across multiple kafka consumers

2015-12-16 Thread Till Rohrmann
Hi Andrew, as far as I know, there is nothing such as a prescribed way of handling this kind of situation. If you want to synchronize the watermark generation given a set of KafkaConsumers you need some kind of ground truth. This could be, for example, a central registry such as ZooKeeper in

Re: Tiny topology shows '0' for all stats.

2015-12-16 Thread Niels Basjes
@Nick: That is what I read in the current description and comments. On Tue, Dec 15, 2015 at 6:25 PM, Nick Dimiduk wrote: > For my own understanding, are you suggesting the FLINK-2944 (or a subtask) > is the appropriate place to implement exposure of metrics such as bytes, >