Holden Karau created SPARK-33200:
------------------------------------
Summary: Validate that all shuffle files are migrated during E2E
testing
Key: SPARK-33200
URL: https://issues.apache.org/jira/browse/SPARK-33200
Project: Spark
Issue Type: Improvement
Components: Kubernetes, Tests
Affects Versions: 3.1.0
Reporter: Holden Karau
Currently the end to end testing only migrates a small number of shuffle files.
While we can't migrate large amounts of data in the time of the integration
suite we can extend the decommissioning test to migrate multiple shuffle files
of different sizes.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
