Hi Team, I am using the recently released shuffle recovery feature using `KubernetesLocalDiskShuffleDataIO` plugin class on Spark 3.4.1.
Can someone explain why the mount path has spark-x/executor-x/ pattern dependency? I got this path detail from this PR <https://github.com/apache/spark/pull/42417>. Is it to avoid other folders in the volume ? Also, does this mean the path should use executor ID and spark app id or just hardcoded spark-x/executor-x/? Sorry, I couldn't fully understand the reasoning for this. Any help will be super useful. Arun Ravi M V B.Tech (Batch: 2010-2014) Computer Science and Engineering Govt. Model Engineering College Cochin University Of Science And Technology Kochi arunrav...@gmail.com +91 9995354581 Skype : arunravimv