[
https://issues.apache.org/jira/browse/SPARK-44996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-44996:
----------------------------------
Description:
Since `VolcanoFeatureStep` creates `DefaultVolcanoClient` always, the unit test
suite `VolcanoFeatureStepSuite` behaves like an integration test. In other
words, it fails when there is no backend K8s clusters.
{code}
$ build/sbt -Pkubernetes -Pvolcano "kubernetes/testOnly *Volcano* -- -z
SPARK-36061"
...
[info] VolcanoFeatureStepSuite:
[info] - SPARK-36061: Driver Pod with Volcano PodGroup *** FAILED *** (646
milliseconds)
[info] org.snakeyaml.engine.v2.exceptions.ScannerException: mapping values
are not allowed here
[info] in reader, line 1, column 94:
[info] ... well-known/openid-configuration": dial tcp: lookup iam.corp. ...
[info] ^
{code}
was:
Since `VolcanoFeatureStep` creates `DefaultVolcanoClient` always, the unit test
suite `VolcanoFeatureStepSuite` behaves like an integration test. In other
words, it fails when there is no network connectivity.
{code}
$ build/sbt -Pkubernetes -Pvolcano "kubernetes/testOnly *Volcano* -- -z
SPARK-36061"
...
[info] VolcanoFeatureStepSuite:
[info] - SPARK-36061: Driver Pod with Volcano PodGroup *** FAILED *** (646
milliseconds)
[info] org.snakeyaml.engine.v2.exceptions.ScannerException: mapping values
are not allowed here
[info] in reader, line 1, column 94:
[info] ... well-known/openid-configuration": dial tcp: lookup iam.corp. ...
[info] ^
{code}
> VolcanoFeatureStep should not create `DefaultVolcanoClient` if not needed
> -------------------------------------------------------------------------
>
> Key: SPARK-44996
> URL: https://issues.apache.org/jira/browse/SPARK-44996
> Project: Spark
> Issue Type: Improvement
> Components: Kubernetes
> Affects Versions: 4.0.0
> Reporter: Dongjoon Hyun
> Priority: Minor
>
> Since `VolcanoFeatureStep` creates `DefaultVolcanoClient` always, the unit
> test suite `VolcanoFeatureStepSuite` behaves like an integration test. In
> other words, it fails when there is no backend K8s clusters.
> {code}
> $ build/sbt -Pkubernetes -Pvolcano "kubernetes/testOnly *Volcano* -- -z
> SPARK-36061"
> ...
> [info] VolcanoFeatureStepSuite:
> [info] - SPARK-36061: Driver Pod with Volcano PodGroup *** FAILED *** (646
> milliseconds)
> [info] org.snakeyaml.engine.v2.exceptions.ScannerException: mapping values
> are not allowed here
> [info] in reader, line 1, column 94:
> [info] ... well-known/openid-configuration": dial tcp: lookup iam.corp.
> ...
> [info] ^
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
