This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 92aa0f6e1d8c [SPARK-45229][CORE][UI] Show the number of drivers
waiting in SUBMITTED status in MasterPage
92aa0f6e1d8c is described below
commit 92aa0f6e1d8ca50cd89ae7f6080713c8ccdb3e70
Author: Dongjoon Hyun <[email protected]>
AuthorDate: Tue Sep 19 23:40:01 2023 -0700
[SPARK-45229][CORE][UI] Show the number of drivers waiting in SUBMITTED
status in MasterPage
### What changes were proposed in this pull request?
This PR aims to show the number of drivers waiting in `SUBMITTED` status in
MasterPage. Note that this UI improvement is valid even when we don't use
`spark.deploy.maxDrivers` because the submitted drivers are in `SUBMITTED`
status until it gets allocated in all Spark versions.
**BEFORE**:
```
Drivers: 3 Running, 13 Completed
```
**AFTER**:
```
Drivers: 3 Running (1 Waiting), 13 Completed
```
### Why are the changes needed?
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Manual check.
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #43007 from dongjoon-hyun/SPARK-45229.
Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
---
core/src/main/scala/org/apache/spark/deploy/master/ui/MasterPage.scala | 3 ++-
1 file changed, 2 insertions(+), 1 deletion(-)
diff --git
a/core/src/main/scala/org/apache/spark/deploy/master/ui/MasterPage.scala
b/core/src/main/scala/org/apache/spark/deploy/master/ui/MasterPage.scala
index a71eb33a2fe1..02c488656b84 100644
--- a/core/src/main/scala/org/apache/spark/deploy/master/ui/MasterPage.scala
+++ b/core/src/main/scala/org/apache/spark/deploy/master/ui/MasterPage.scala
@@ -147,7 +147,8 @@ private[ui] class MasterPage(parent: MasterWebUI) extends
WebUIPage("") {
{state.activeApps.length} <a href="#running-app">Running</a>,
{state.completedApps.length} <a
href="#completed-app">Completed</a> </li>
<li><strong>Drivers:</strong>
- {state.activeDrivers.length} Running,
+ {state.activeDrivers.length} Running
+ ({state.activeDrivers.count(_.state == DriverState.SUBMITTED)}
Waiting),
{state.completedDrivers.length} Completed </li>
<li><strong>Status:</strong> {state.status}</li>
</ul>
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
