suryaprasanna opened a new pull request, #18416: URL: https://github.com/apache/hudi/pull/18416
### Describe the issue this Pull Request addresses Spark job descriptions for recursive partition listing were not clear enough in the Spark UI. When there are join queries multiple table's recursive calls are getting overlapped. Since, table names are not included in the job description and it was hard to tell which recursive listing pass was running longer. ### Summary and Changelog Updated recursive partition listing job descriptions in `FileSystemBackedTableMetadata` to include the table name. Also, added a recursive listing step counter and appended it to the job name. ### Impact Improves Spark UI observability during recursive partition listing. No user-facing behavior or API changes. ### Risk Level low String-only change to Spark job descriptions. ### Documentation Update none ### Contributor's checklist - [x] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute) - [x] Enough context is provided in the sections above - [x] Adequate tests were added if applicable -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
