Jiang Xin created FLINK-33961:
---------------------------------
Summary: Hybrid Shuffle may hang when exclusive buffers per
channel is set to 0
Key: FLINK-33961
URL: https://issues.apache.org/jira/browse/FLINK-33961
Project: Flink
Issue Type: Bug
Components: Runtime / Network
Reporter: Jiang Xin
I found that the Hybrid Shuffle without enabling new mode may hang when
exclusive-buffers-per-channel is set to 0. It can be reproduced by adding the
following test into
HybridShuffleITCase.java and run it.
{code:java}
@RepeatedTest(10)
void testHybridFullExchangesWithNonBuffersPerChannel() throws Exception {
final int numRecordsToSend = 10000;
Configuration configuration = configureHybridOptions(getConfiguration(),
false);
configuration.set(
NettyShuffleEnvironmentOptions.NETWORK_HYBRID_SHUFFLE_ENABLE_NEW_MODE, false);
configuration.set(NETWORK_BUFFERS_PER_CHANNEL, 0);
JobGraph jobGraph = createJobGraph(numRecordsToSend, false, configuration);
executeJob(jobGraph, configuration, numRecordsToSend);
} {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
