Streaming data from MongoDB using Flink

2017-02-16 Thread Pedro Monteiro
Good morning, I am trying to get data from MongoDB to be analysed in Flink. I would like to know if it is possible to stream data from MongoDB into Flink. I have looked into Flink's source function to add in the addSource method of the StreamExecutionEnvironment but I had no luck. Can anyone help

Re: Streaming data from MongoDB using Flink

2017-02-16 Thread Pedro Monteiro
etch the data. > It should be straightforward and works well with MongoDB’s cursor APIs. > > Could you explain a bit which part in particular you were stuck with? > > Cheers, > Gordon > > > On February 16, 2017 at 5:31:39 PM, Pedro Monteiro ( > pedro.mlmonte...@gmail

Re: Streaming data from MongoDB using Flink

2017-02-16 Thread Pedro Monteiro
MongoDB source that works with Flink’s > checkpointing for exactly-once, be sure to check out: > https://ci.apache.org/projects/flink/flink-docs- > release-1.2/dev/stream/state.html#stateful-source-functions > > Cheers, > Gordon > > On February 16, 2017 at 5:53:03 PM, Pedro Monteiro ( >

Re: Streaming data from MongoDB using Flink

2017-02-16 Thread Pedro Monteiro
wait to hear from you! Cumprimentos, *Pedro Lima Monteiro* On 16 February 2017 at 11:29, Pedro Monteiro wrote: > Thank you again for your prompt response. > > I will give it a try and will come back to you. > > *Pedro Lima Monteiro* > > On 16 February 2017 at 10:20, Tzu-Li

Re: Streaming data from MongoDB using Flink

2017-02-17 Thread Pedro Monteiro
Dear Gordon, Till Thank you so much for your helpful answers. I managed to solve my problem with your guidelines. Much appreciated, keep up the good work! Cheers Cumprimentos, *Pedro Lima Monteiro* On 17 February 2017 at 10:10, Tzu-Li (Gordon) Tai wrote: > Sorry, I just realized I didn’t no