This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-3.3
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.3 by this push:
new 896ecd85edc [SPARK-38803][K8S][TESTS] Lower minio cpu to 250m (0.25)
from 1 in K8s IT
896ecd85edc is described below
commit 896ecd85edc31965beba1ca207863cc860b5cc45
Author: Yikun Jiang <[email protected]>
AuthorDate: Fri Apr 8 00:38:59 2022 -0700
[SPARK-38803][K8S][TESTS] Lower minio cpu to 250m (0.25) from 1 in K8s IT
### What changes were proposed in this pull request?
This PR aims to set minio request cpu to `250m` (0.25).
- This value also recommand in
[link](https://docs.gitlab.com/charts/charts/minio/#installation-command-line-options).
- There are [no cpu request
limitation](https://github.com/minio/minio/blob/a3e317773a2b90a433136e1ff2a8394bc5017c75/helm/minio/values.yaml#L251)
on current minio.
### Why are the changes needed?
In some cases (such as resource limited case), we reduce request cpu of
minio.
See also:
https://github.com/apache/spark/pull/35830#pullrequestreview-929597027
### Does this PR introduce _any_ user-facing change?
No, test only
### How was this patch tested?
IT passsed
Closes #36096 from Yikun/minioRequestCores.
Authored-by: Yikun Jiang <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
(cherry picked from commit 5ea2b386eb866e20540660cdb6ed43792cb29969)
Signed-off-by: Dongjoon Hyun <[email protected]>
---
.../org/apache/spark/deploy/k8s/integrationtest/DepsTestsSuite.scala | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git
a/resource-managers/kubernetes/integration-tests/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/DepsTestsSuite.scala
b/resource-managers/kubernetes/integration-tests/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/DepsTestsSuite.scala
index 3f3c4ef1460..10ac197ec77 100644
---
a/resource-managers/kubernetes/integration-tests/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/DepsTestsSuite.scala
+++
b/resource-managers/kubernetes/integration-tests/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/DepsTestsSuite.scala
@@ -58,7 +58,7 @@ private[spark] trait DepsTestsSuite { k8sSuite:
KubernetesSuite =>
).toArray
val resources = Map(
- "cpu" -> new Quantity("1"),
+ "cpu" -> new Quantity("250m"),
"memory" -> new Quantity("512M")
).asJava
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
