Re: Simple batch job hangs if run twice

2016-09-19 Thread Chesnay Schepler
No, I can't recall that i had this happen to me. I would enable logging and try again, as well as checking whether the second job is actually running through the WebInterface. If you tell me your NetBeans version i can try to reproduce it. Also, which version of Flink are you using? On 19.09

Re: Serialization problem for Guava's TreeMultimap

2016-09-19 Thread Stephan Ewen
Hi! Can you use "env.getConfig().registerTypeWithKryoSerializer(TreeMultimap.class, JavaSerializer.class)" ? Best, Stephan On Sun, Sep 18, 2016 at 12:53 PM, Yukun Guo wrote: > Here is the code snippet: > > windowedStream.fold(TreeMultimap.create(), new > FoldFunction, TreeMultimap>() { >

Re: Simple batch job hangs if run twice

2016-09-19 Thread Yassine MARZOUGUI
Hi Chensey, I am running Flink 1.1.2, and using NetBeans 8.1. I made a screencast reproducing the problem here: http://recordit.co/P53OnFokN4 . Best, Yassine 2016-09-19 10:04 GMT+02:00 Chesnay Schepler : > No, I can't recall that i had this happen to me. > > I wo

flink run throws NPE, JobSubmissionResult is null when interactive and not isDetached()

2016-09-19 Thread Luis Mariano Guerra
hi submitting a job I get a NPE here: https://github.com/apache/flink/blob/master/flink-clients/src/main/java/org/apache/flink/client/CliFrontend.java#L781 building from source and adding some prints I got that this.lastJobExecutionResult here seems to be null: https://github.com/apache/flink/blo

Re: flink run throws NPE, JobSubmissionResult is null when interactive and not isDetached()

2016-09-19 Thread Luis Mariano Guerra
context: I have two other similar jobs in the same project that run without problem. On Mon, Sep 19, 2016 at 4:28 PM, Luis Mariano Guerra < mari...@event-fabric.com> wrote: > hi > > submitting a job I get a NPE here: > https://github.com/apache/flink/blob/master/flink- > clients/src/main/java/org

SQL / Tuple question

2016-09-19 Thread Radu Tudoran
Hi, I am trying to create an sql statement that is suppose to return a string and and integer Mytable.sql("select mystringfield,myintfield ) I am trying to give the typefinormation as a class to the TypeInformation> tpinf = new TypeHint>(){}.getTypeInfo(); .toDataStream( , tpinf.getTypeC

Re: SQL / Tuple question

2016-09-19 Thread Fabian Hueske
Hi Radu, you can pass the TypeInfo directly without accessing the TypeClass. Have you tried this? TypeInformation> tpinf = new TypeHint>(){}.getTypeInfo(); .toDataStream( , tpinf ) Best, Fabian 2016-09-19 17:53 GMT+02:00 Radu Tudoran : > Hi, > > > > I am trying to create an sql statement th

Job Stuck in cancel state

2016-09-19 Thread Janardhan Reddy
HI, I cancelled a restarting job from flink UI and the job is stuck in cancelling state. (Fixed delay restart strategy was configured for the job). The following error message is present in taskmanager logs. akka.remote.OversizedPayloadException: Discarding oversized payload sent to Actor[akka.tc

Re: Job Stuck in cancel state

2016-09-19 Thread Fabian Hueske
Hi Janardhan, to sure what's going wrong here. Maybe Till (in CC) has an idea? Best, Fabian 2016-09-19 19:45 GMT+02:00 Janardhan Reddy : > HI, > > I cancelled a restarting job from flink UI and the job is stuck in > cancelling state. (Fixed delay restart strategy was configured for the > job).

Re: Problem with CEPPatternOperator when taskmanager is killed

2016-09-19 Thread Fabian Hueske
Thanks for looking into this Frank! I opened FLINK-4636 [1] to track the issue. Would you or Jaxbihani like to contribute a patch for this bug? [1] https://issues.apache.org/jira/browse/FLINK-4636 2016-09-17 21:15 GMT+02:00 Frank Dekervel : > Hello, > > looks like a bug ... when a PriorityQueu

Re: flink run throws NPE, JobSubmissionResult is null when interactive and not isDetached()

2016-09-19 Thread Fabian Hueske
Hi Luis, this looks like a bug. Can you open a JIRA [1] issue and provide a more detailed description of what you do (Environment, DataStream / DataSet, how do you submit the program, maybe add a small program that reproduce the problem on your setup)? Thanks, Fabian 2016-09-19 17:30 GMT+02:00 L

Re: Job Stuck in cancel state

2016-09-19 Thread Stephan Ewen
Hi Janardhan! I think you gave us the stack trace of the JPS process, not the Flink process. Can you post the stack trace of the TaskManager? Thanks, Stephan On Mon, Sep 19, 2016 at 8:15 PM, Fabian Hueske wrote: > Hi Janardhan, > > to sure what's going wrong here. Maybe Till (in CC) has an id

RE: SQL / Tuple question

2016-09-19 Thread Radu Tudoran
Hi Fabiane, Thanks for the advice. It works this way! From: Fabian Hueske [mailto:fhue...@gmail.com] Sent: Monday, September 19, 2016 6:08 PM To: user@flink.apache.org Subject: Re: SQL / Tuple question Hi Radu, you can pass the TypeInfo directly without accessing the TypeClass. Have you tried t

Re: Serialization problem for Guava's TreeMultimap

2016-09-19 Thread Yukun Guo
Hi, The same error occurs after changing the code, unfortunately. BTW, registerTypeWithKryoSerializer requires the 2nd argument to be a `T serializer` where T extends Serializer & Serializable, so I pass a custom GenericJavaSerializer, but I guess this doesn't matter much. On 19 September 2016

Re: Problem with CEPPatternOperator when taskmanager is killed

2016-09-19 Thread jaxbihani
@Frank : Thanks. I verified changing that and it works fine. (I still need to copy the user jar to the lib dir which ideally shouldn't be required but I think that is because of userCodeClassLoader() related problem. Will look into that) About implementation I feel instead of initializing priorit

Custom(application) Metrics - Piggyback on Flink's metrics infra or not?

2016-09-19 Thread Eswar Reddy
Hi, I see Flink support's built-in metrics to monitor various components of Flink. In addition, one can register application specific(custom) metrics to Flink's built-in metrics infra. The problem with this is user has to develop his custom metrics using Flink's metrics framework/API rather than a