Hi Ken, I don't have much experience with streaming iterations. Maybe Aljoscha (in CC) has an idea what is happening and if it can be prevented.
Best, Fabian 2017-10-05 1:33 GMT+02:00 Ken Krugler <kkrugler_li...@transpac.com>: > Hi all, > > I’ve got a streaming topology with an iteration, and a RichAsyncFunction > in that iteration. > > When the iteration terminates due to no activity, I see this message in > the logs: > > 17/10/04 16:01:36 DEBUG async.Emitter:91 - Emitter thread got interrupted. > This indicates that the emitter should shut down. > java.lang.InterruptedException > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject. > reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject.await(AbstractQueuedSynchronizer.java:2048) > at org.apache.flink.streaming.api.operators.async.queue. > UnorderedStreamElementQueue.peekBlockingly(UnorderedStreamElementQueue. > java:147) > at org.apache.flink.streaming.api.operators.async.Emitter. > run(Emitter.java:82) > at java.lang.Thread.run(Thread.java:748) > > I read through https://issues.apache.org/jira/browse/FLINK-5638, which > makes me wonder if there’s a different but related issue involving an async > function in an iteration. > > Or perhaps I need to do something in my RichAsyncFunction to avoid this > situation? > > Or is this expected and just the way things are currently? > > Just FYI, my topology is here: https://s3.amazonaws. > com/su-public/flink-crawler+topology.pdf > > Thanks, > > — Ken > > -------------------------- > Ken Krugler > +1 530-210-6378 <(530)%20210-6378> > http://www.scaleunlimited.com > custom big data solutions & training > Hadoop, Cascading, Cassandra & Solr > >
