[
https://issues.apache.org/jira/browse/FLINK-18767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nico Kruber updated FLINK-18767:
--------------------------------
Description:
The following code is stuck sending data from the source to the map operator.
Two settings seem to have an influence here: {{env.setBufferTimeout(-1);}} and
{{env.disableOperatorChaining();}} - if I remove either of these, the job works
as expected.
(I pre-populated my Kafka topic with one element to reproduce easily)
{code}
StreamExecutionEnvironment env =
StreamExecutionEnvironment.getExecutionEnvironment();
// comment either these two and the job works
env.setBufferTimeout(-1);
env.disableOperatorChaining();
Properties properties = new Properties();
properties.setProperty("bootstrap.servers", "localhost:9092");
properties.setProperty("group.id", "test");
FlinkKafkaConsumer<String> consumer = new FlinkKafkaConsumer<>("topic", new
SimpleStringSchema(), properties);
consumer.setStartFromEarliest();
DataStreamSource<String> input = env.addSource(consumer);
input
.map((x) -> x)
.print();
env.execute();
{code}
was:
The following code is stuck sending data from the source to the map operator.
Two settings seem to have an influence here: {{env.setBufferTimeout(-1);}} and
{{env.disableOperatorChaining();}} - if I remove either of these, the job works
as expected.
(I pre-populated my Kafka topic with one element to reproduce easily)
{code}
StreamExecutionEnvironment env =
StreamExecutionEnvironment.getExecutionEnvironment();
// comment either these two and the job works
env.setBufferTimeout(-1);
env.disableOperatorChaining();
Properties properties = new Properties();
properties.setProperty("bootstrap.servers", "localhost:9092");
properties.setProperty("group.id", "test");
FlinkKafkaConsumer<String> consumer = new FlinkKafkaConsumer<>("topic", new
SimpleStringSchema(),
properties);
consumer.setStartFromEarliest();
DataStreamSource<String> input = env.addSource(
consumer);
input
.map((x) -> x)
.print();
env.execute();
{code}
> Streaming job stuck when disabling operator chaining
> ----------------------------------------------------
>
> Key: FLINK-18767
> URL: https://issues.apache.org/jira/browse/FLINK-18767
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Network
> Affects Versions: 1.8.3, 1.9.3, 1.10.1, 1.11.1
> Reporter: Nico Kruber
> Priority: Major
>
> The following code is stuck sending data from the source to the map operator.
> Two settings seem to have an influence here: {{env.setBufferTimeout(-1);}}
> and {{env.disableOperatorChaining();}} - if I remove either of these, the job
> works as expected.
> (I pre-populated my Kafka topic with one element to reproduce easily)
> {code}
> StreamExecutionEnvironment env =
> StreamExecutionEnvironment.getExecutionEnvironment();
> // comment either these two and the job works
> env.setBufferTimeout(-1);
> env.disableOperatorChaining();
> Properties properties = new Properties();
> properties.setProperty("bootstrap.servers", "localhost:9092");
> properties.setProperty("group.id", "test");
> FlinkKafkaConsumer<String> consumer = new FlinkKafkaConsumer<>("topic",
> new SimpleStringSchema(), properties);
> consumer.setStartFromEarliest();
> DataStreamSource<String> input = env.addSource(consumer);
> input
> .map((x) -> x)
> .print();
> env.execute();
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
