Thanks to everybody, all my doubts are solved. I gotta give it to you guys,
the answers were really fast!
Cheers,
Omar.
--
View this message in context:
http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Data-ingestion-using-a-Flink-TCP-Server-tp7134p7169.html
Sent from the A
Hi,
yes, if you have 4 independent non-parallel sources they will be executed
independently in different threads.
Cheers,
Aljoscha
On Wed, 25 May 2016 at 13:40 omaralvarez wrote:
> Thanks for your answers, this makes the implementation way easier, I don't
> have to worry about queues.
>
> I wil
Thanks for your answers, this makes the implementation way easier, I don't
have to worry about queues.
I will take a look at the kafka connector.
So my only remaining question is how serial stream sources are handled. If I
have four independent streams, will the sources be handled by different
Hi!
A typical example of a parallel source is the Kafka Source.
Actually, other threads than the main run() thread can call ctx.collect(),
provided they use the checkpoint lock properly. The Kafka source does that.
Stephan
On Wed, May 25, 2016 at 11:50 AM, omaralvarez
wrote:
> Hi,
>
> Thank
Hi,
Thank you very much for your answer. There is one more doubt in my mind. How
are not parallelized source funtions processed? For instance, lets say I
have four streams that implement SourceFunction, will they be placed on
different parallel instances or will they be processed sequentially by t
Hi,
regarding your first question. I think it is in general not safe to call
ctx.collect() from Threads other than the Thread that is invoking the run()
method of your SourceFunction. What I would suggest is to have a queue that
your reader threads put data into and then read from that queue in the
