LantaoJin opened a new pull request #24984: [SPARK-28183][CORE][UI] Add a task status filter for taskList in REST API URL: https://github.com/apache/spark/pull/24984 ## What changes were proposed in this pull request? We have a scenario that our application needs to query failed tasks by REST API `/applications/[app-id]/stages/[stage-id]/[stage-attempt-id]/taskList` when Spark job is running. In a large Stage, it may filter out dozens of failed tasks from hundred thousands total tasks. It consumes much unnecessary memory and time both in Spark and App side. This PR requires #24982 as pre-work. Filter should be handled before pagination. ## How was this patch tested? Manually test.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
