warrenzhu25 opened a new pull request, #53706: URL: https://github.com/apache/spark/pull/53706
### What changes were proposed in this pull request? This adds detailed shuffle migration statistics to block manager decommissioning. A new `MigrationInfo`/`MigrationStat` exposes counts and sizes for discovered, migrated, remaining, and deleted shuffle blocks, and the executor shutdown path uses the new struct. A unit test verifies the stats and size accounting. ### Why are the changes needed? Decommissioning currently exposes only a boolean for “all blocks migrated.” The additional stats provide visibility into shuffle migration progress and help diagnose slow/failed migrations. ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? `./build/sbt "testOnly org.apache.spark.storage.BlockManagerDecommissionUnitSuite"` (Note: the suite passed, but the sbt run ended with `sql-api / Antlr4 / antlr4Generate` exit code 1.) ### Was this patch authored or co-authored using generative AI tooling? Generated-by: Codex (GPT-5) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
