Raghu Angadi created BEAM-257:
---------------------------------
Summary: fix ConcurrentModificationException in KafkaIO
Key: BEAM-257
URL: https://issues.apache.org/jira/browse/BEAM-257
Project: Beam
Issue Type: Bug
Components: sdk-java-extensions
Reporter: Raghu Angadi
Assignee: James Malone
[~tgroh] reported the following exception with KafkaIO while using with
DirectRunner. Fixing it in https://github.com/apache/incubator-beam/pull/290
{code}
java.util.ConcurrentModificationException: KafkaConsumer is not safe for
multi-threaded access
at
org.apache.kafka.clients.consumer.KafkaConsumer.acquire(KafkaConsumer.java:1324)
at
org.apache.kafka.clients.consumer.KafkaConsumer.close(KafkaConsumer.java:1255)
at com.google.common.io.Closeables.close(Closeables.java:79)
at
org.apache.beam.sdk.io.kafka.KafkaIO$UnboundedKafkaReader.close(KafkaIO.java:1050)
at
org.apache.beam.runners.direct.UnboundedReadEvaluatorFactory$UnboundedReadEvaluator.finishBundle(UnboundedReadEvaluatorFactory.java:167)
at
org.apache.beam.runners.direct.TransformExecutor.finishBundle(TransformExecutor.java:161)
at
org.apache.beam.runners.direct.TransformExecutor.call(TransformExecutor.java:116)
at
org.apache.beam.runners.direct.TransformExecutor.call(TransformExecutor.java:41)
at java.util.concurrent.FutureTask.run(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Unknown Source)
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
