Issue while restarting from SavePoint

Hi, I am relatively new to Flink and I was experimenting with the save points feature. I have an HA cluster running with 1 Master and 4 Workers. The flink-config.yaml is as follows : #== # Common #===

Re: Issue while restarting from SavePoint

org.apache.flink.runtime.jobmanager.JobManager$$anonfun$org$apache$flink$runtime$jobmanager$JobManager$$submitJob$1.apply$mcV$sp(JobManager.scala:1302) ... 10 more Thanks. From: Anirudh Mallem Date: Tuesday, October 18, 2016 at 2:07 PM To: "user@flink.apache.org<mailto:user@flink.apache.org>" Subject: Issue while restartin

Re: Issue while restarting from SavePoint

pendent of the savepoints. Can you >confirm this? > >(2) The program was changed in a non-compatible way after the >savepoint. Did you change the program and if yes in which way? > >– Ufuk > > >On Wed, Oct 19, 2016 at 12:01 AM, Anirudh Mallem > wrote: >> Hi, &g

Query regarding state backend for Custom Map Function

Hi Everyone, I am trying to understand the Working With State feature page of the Flink documentation. My question is in case I am using a ValueState in my CustomMap class to store my states with the RocksDb as my state backend then it is clear that every state value is stored in RocksDb. Now i

Re: Query regarding state backend for Custom Map Function

ght be what you are looking for. Best, Stefan Am 01.12.2016 um 09:35 schrieb Anirudh Mallem mailto:anirudh.mal...@247-inc.com>>: Hi Everyone, I am trying to understand the Working With State feature page of the Flink documentation. My question is in case I am using a ValueState in my Custom

Reg Checkpoint size using RocksDb

Hi, I was experimenting with using RocksDb as the state backend for my job and to test its behavior I modified the socket word count program to store states. I also wrote a RichMapFunction which stores the states as a ValueState with default value as null. What the job does basically is, for eve

Re: Reg Checkpoint size using RocksDb

that there simply has not been a compaction in RocksDB when checkpointing, so the checkpoint contains some "old data" as well. If you switch to the "fully async" mode, it should always only checkpoint the latest state of RocksDB. Best, Stephan On Mon, Dec 19, 2016 at

Re: Serializing NULLs

If you are using Avro generated classes then you cannot have your values null. https://cwiki.apache.org/confluence/display/AVRO/FAQ#FAQ-Whyisn'teveryvalueinAvronullable? From: Stephan Ewen Reply-To: "user@flink.apache.org" Date: Tuesday, December 20, 2016 at 8:17 AM T