Re: Looking for co founder /partner in Bangalore

for co founder/partner in > Bangalore . > > I am sorry if this is not a right forum to express this. > > Thanks > Ashutosh > -- jay vyas

Destroy StreamExecutionEnv

Tuple2 map(String s) throws Exception { Map transaction = MAPPER.readValue(s, Map.class); return new Tuple2<>(transaction, 1); } }); counts.print(); -- jay vyas

Re: setSlotSharing NPE: Starting a stream consumer in a thread

ic String map(String value) throws Exception { System.out.println(value); return ">>> > > > > " + value + " < < < < <<<"; } }); try { env.execute(); } catch(Exception e){ e.pr

setSlotSharing NPE: Starting a stream consumer in a thread

e https://gist.github.com/jayunit100/c7ab61d1833708d290df, and the offending line is the DataStream dataStream = env.readFileStream("/tmp/a",1000, FileMonitoringFunction.WatchType.ONLY_NEW_FILES); line. Thanks again ! -- jay vyas

Re: Using Flink with Redis question

Maybe wrapping Jedis with a serializable class will do the trick? But in general is there a way to reference jar classes in flink apps without serializable them? > On Sep 4, 2015, at 1:36 PM, Jerry Peng wrote: > > Hello, > > So I am trying to use jedis (redis java client) with Flink streami

Re: Bigpetstore - Flink integration

x. Onward and upward ! On Wed, Sep 2, 2015 at 9:33 AM, Robert Metzger wrote: > Okay, I see. > > As I said before, I was not able to reproduce the serialization issue > you've reported. > Can you maybe post the exception you are seeing? > > On Wed, Sep 2, 2015 at 3:32 PM,

Re: Bigpetstore - Flink integration

I don't think that you need to register a Kryo serializer for the Product >> and Transaction type. >> I was able to run the code without the serializer registration. >> >> >> -- Forwarded message -- >> From: jay vyas >> Date: Wed, S

Re: Bigpetstore - Flink integration

uct > and Transaction type. > I was able to run the code without the serializer registration. > > > -- Forwarded message -- > From: jay vyas > Date: Wed, Sep 2, 2015 at 2:56 PM > Subject: Re: Hardware requirements and learning resources > To: user@flink.apach

Re: Hardware requirements and learning resources

Just running the main class is sufficient > On Sep 2, 2015, at 8:59 AM, Robert Metzger wrote: > > Hey jay, > > How can I reproduce the error? > >> On Wed, Sep 2, 2015 at 2:56 PM, jay vyas wrote: >> We're also working on a bigpetstore implementation of flin

Re: Hardware requirements and learning resources

y interesting for building small Flink >>>> clusters for educational purposes, or for small projects. >>>> >>>> Apart from that, I wonder if there is some blog post by the comunity >>>> about transitioning from Spark to Flink. I think it could be interesting, >>>> as there are some similarities in the APIs, but also deep differences in >>>> the underlying approaches. I was thinking in something like Breeze's >>>> cheatsheet comparing its matrix operatations with those available in Matlab >>>> and Numpy >>>> https://github.com/scalanlp/breeze/wiki/Linear-Algebra-Cheat-Sheet, or >>>> like http://rosettacode.org/wiki/Factorial. Just an idea anyway. Also, >>>> any pointer to some online course, book or training for Flink besides the >>>> official programming guides would be much appreciated >>>> >>>> Thanks in advance for help >>>> >>>> Greetings, >>>> >>>> Juan >>>> >>>> >>> >> > -- jay vyas

Re: Serialization and kryo

lem, you can register a specific > serializer via "ExecuionEnvironment.registerTypeWithKryoSerializer(...)." > > Let us know what is the problem in the end. > > Greetings, > Stephan > > > On Sun, Aug 16, 2015 at 4:54 PM, jay vyas > wrote: > >> >&

Re: Serialization and kryo

1. Just wanted to updated.. possibly I'm hitting ? FLINK-1417 Automatically register nested types at Kryo <https://issues.apache.org/jira/browse/FLINK-1417> ... On Sun, Aug 16, 2015 at 10:38 AM, jay vyas wrote: > Hi flink. > > I just ran into the following se

Serialization and kryo

Hi flink. I just ran into the following serialization error in BigPetStore Flink. It appears to be that someone is trying to add elements to a map during serialization. I doubt this is a bug in flink because it would have surely been caught early on. Some possible explanations ... 1 - Probably

Flink Streaming and flink-staging

if thats the right way to move forward.) Thanks ! -- jay vyas

Re: bigpetstore flink : parallelizing collections

9:07 AM, Maximilian Michels wrote: > Hi Jay, > > Great to hear there is effort to integrate Flink with BigTop. Please let > us know if any questions come up in the course of the integration! > > Best, > Max > > > On Sun, Jul 12, 2015 at 3:57 PM, jay vyas > wrote

Re: bigpetstore flink : parallelizing collections

> Here is a code sample: > > ExecutionEnvironment env = ExecutionEnvironment.getExecutionEnvironment(); > > DataSet data = env.fromElements(myArray); > > data.map(new TrasactionMapper()).setParallelism(80); // makes sure you > have 80 mappers > > > Stephan > > > On Sun, Jul 12, 2015

bigpetstore flink : parallelizing collections

en capture the RDD from , and run a parallelized transform. In flink, i have an array of "customers" and i want to parallelize our transaction generator for each customer. How would i do that? -- jay vyas