HeartSaVioR opened a new pull request #31464: URL: https://github.com/apache/spark/pull/31464
### What changes were proposed in this pull request? This PR proposes to expose the number of truncated paths in Utils.buildLocationMetadata(), with relaxing space usage a bit (around 10 chars). Suppose the first 2 of 5 paths are only fit to the threshold, the outputs between the twos are below: * before the change: [path1, path2] * after the change: [path1, path2, ... 3 more] ### Why are the changes needed? SPARK-31793 silently truncates the paths hence end users can't indicate how many paths are truncated, and even more, whether paths are truncated or not. ### Does this PR introduce _any_ user-facing change? Yes, the location metadata will also show how many paths are truncated (not shown), instead of silently truncated. ### How was this patch tested? Modified UTs ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
