wuyi created SPARK-31017: ---------------------------- Summary: Test for shuffle requests packaging with different size and numBlocks limit Key: SPARK-31017 URL: https://issues.apache.org/jira/browse/SPARK-31017 Project: Spark Issue Type: Test Components: Spark Core, Tests Affects Versions: 3.0.0 Reporter: wuyi
When packaging shuffle fetch requests in ShuffleBlockFetcherIterator, there are two limitations: maxBytesInFlight and maxBlocksInFlightPerAddress. However, we don’t have test cases to test them both, e.g. the size limitation is hit before the numBlocks limitation. We should add test cases in ShuffleBlockFetcherIteratorSuite to test: # the size limitation is hit before the numBlocks limitation # the numBlocks limitation is hit before the size limitation -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org