Github user LiShuMing commented on the issue:
https://github.com/apache/spark/pull/18905
@jerryshao Thanks for your replies! I will do such things then:
1. "it is good to change to other directories (is yarn internally relying
on it)?"
I think the recovery path(local variable) is only used in
`YarnShuffleService`, principally not affects yarn environment. This PR cares
the scene that we can find a better way to choose a useful disk for the
recovery path when there are many disks that can choose.
2. Check HDFS/YARN's disk healthy check mechanism to better define
`checkFileAvailable() `;
3. Fix code format.
4. Throw an exception when `_recoveryPath` is empty finally.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
