This is an automated email from the ASF dual-hosted git repository.
chenyulin0719 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/yunikorn-site.git
The following commit(s) were added to refs/heads/master by this push:
new 6720e9c418 [YUNIKORN-2462] incorrect gang annotations in example (#422)
6720e9c418 is described below
commit 6720e9c4185ae979169389b961eacafda89847cb
Author: steinsgateted <[email protected]>
AuthorDate: Thu Jun 6 14:11:30 2024 +0800
[YUNIKORN-2462] incorrect gang annotations in example (#422)
Closes: #422
Signed-off-by: Yu-Lin Chen <[email protected]>
---
docs/user_guide/gang_scheduling.md | 49 ++++++++++++++++++--------------------
1 file changed, 23 insertions(+), 26 deletions(-)
diff --git a/docs/user_guide/gang_scheduling.md
b/docs/user_guide/gang_scheduling.md
index 1b8dd24bf2..f96bbe7996 100644
--- a/docs/user_guide/gang_scheduling.md
+++ b/docs/user_guide/gang_scheduling.md
@@ -180,32 +180,29 @@ Each Spark job runs 2 types of pods, driver and executor.
Hence, we need to defi
The annotations for the driver pod looks like:
```yaml
-Annotations:
- yunikorn.apache.org/schedulingPolicyParameters:
“placeholderTimeoutSeconds=30”
- yunikorn.apache.org/taskGroupName: “spark-driver”
- yunikorn.apache.org/taskGroup: “
- TaskGroups: [
- {
- Name: “spark-driver”,
- minMember: 1,
- minResource: {
- Cpu: 1,
- Memory: 2Gi
- },
- Node-selector: ...,
- Tolerations: ...,
- Affinity: ...
+annotations:
+ yunikorn.apache.org/schedulingPolicyParameters:
"placeholderTimeoutInSeconds=30 gangSchedulingStyle=Hard"
+ yunikorn.apache.org/task-group-name: "spark-driver"
+ yunikorn.apache.org/task-groups: |-
+ [{
+ "name": "spark-driver",
+ "minMember": 1,
+ "minResource": {
+ "cpu": "1",
+ "memory": "2Gi"
+ },
+ "nodeSelector": {},
+ "tolerations": [],
+ "affinity": {}
},
- {
- Name: “spark-executor”,
- minMember: 10,
- minResource: {
- Cpu: 1,
- Memory: 2Gi
+ {
+ "name": "spark-executor",
+ "minMember": 1,
+ "minResource": {
+ "cpu": "1",
+ "memory": "2Gi"
}
- }
- ]
- ”
+ }]
```
:::note
@@ -216,10 +213,10 @@ See the [Spark
documentation](https://spark.apache.org/docs/latest/configuration
For all the executor pods,
```yaml
-Annotations:
+annotations:
# the taskGroup name should match to the names
# defined in the taskGroups field
- yunikorn.apache.org/taskGroupName: “spark-executor”
+ yunikorn.apache.org/task-group-name: "spark-executor"
```
Once the job is submitted to the scheduler, the job won’t be scheduled
immediately.
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
