summaryzb opened a new pull request, #1260:
URL: https://github.com/apache/incubator-uniffle/pull/1260
### What changes were proposed in this pull request?
as title
### Why are the changes needed?
```
[INFO] Running org.apache.uniffle.test.ContinuousSelectPartitionStrategyTest
Error: Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed:
59.195 s <<< FAILURE! - in
org.apache.uniffle.test.ContinuousSelectPartitionStrategyTest
Error: resultCompareTest Time elapsed: 55.751 s <<< ERROR!
org.apache.spark.SparkException:
Job aborted due to stage failure: Task 6 in stage 1.0 failed 1 times, most
recent failure: Lost task 6.0 in stage 1.0 (TID 16)
(fv-az391-410.nf14wd45lyte3l5gjbhk121dmd.jx.internal.cloudapp.net executor
driver): org.apache.uniffle.common.exception.RssException: Timeout: Task[16_0]
failed because 9 blocks can't be sent to shuffle server in 30000 ms.
at
org.apache.spark.shuffle.writer.RssShuffleWriter.checkBlockSendResult(RssShuffleWriter.java:350)
at
org.apache.spark.shuffle.writer.RssShuffleWriter.writeImpl(RssShuffleWriter.java:246)
at
org.apache.spark.shuffle.writer.RssShuffleWriter.write(RssShuffleWriter.java:209)
at
org.apache.spark.shuffle.ShuffleWriteProcessor.write(ShuffleWriteProcessor.scala:59)
at
org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:99)
at
org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:52)
```
I debug the test and find that all blocks are successfully send, but some
blocks are not in the block tracker
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Integration test
Especially run below test in a loop of many times without a fail
```
mvn -B -fae test
-Dtest=org.apache.uniffle.test.ContinuousSelectPartitionStrategyTest -Pspark3
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
