[ 
https://issues.apache.org/jira/browse/SPARK-49658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Qi Tan updated SPARK-49658:
---------------------------
    Description: 
Current matrix
kubernetes-version:
 - "1.28.0"

"1.31.0"
test-group:
 - spark-versions
 - python
 - state-transition
dynamic-config-test-group:
 - watched-namespaces

result in combination

1.28.0, spark-versions, watched-namespace
1.28.0, python, watched-namespace
1.28.0, state-transition, watched-namespace
...

It is costing more time and resources since in every run, the watched-namespace 
test will be run. It shall be run once after dynamic-mode operator is installed.

  was:
Current matrix
kubernetes-version:
 - "1.28.0"
 - "1.31.0"
test-group:
 - spark-versions
 - python
 - state-transition
dynamic-config-test-group:
 - watched-namespaces

result in combination

1.28.0, spark-versions, watched-namespace
1.28.0, python, watched-namespace
1.28.0, state-transition, watched-namespace
...

It is costing more time and resources since in every run, the watched-namespace 
test will be run. It shall be run once after dynamic-mode operator is installed.


> E2E Workflow Refactor
> ---------------------
>
>                 Key: SPARK-49658
>                 URL: https://issues.apache.org/jira/browse/SPARK-49658
>             Project: Spark
>          Issue Type: Sub-task
>          Components: Kubernetes
>    Affects Versions: 4.0.0
>            Reporter: Qi Tan
>            Priority: Minor
>
> Current matrix
> kubernetes-version:
>  - "1.28.0"
> "1.31.0"
> test-group:
>  - spark-versions
>  - python
>  - state-transition
> dynamic-config-test-group:
>  - watched-namespaces
> result in combination
> 1.28.0, spark-versions, watched-namespace
> 1.28.0, python, watched-namespace
> 1.28.0, state-transition, watched-namespace
> ...
> It is costing more time and resources since in every run, the 
> watched-namespace test will be run. It shall be run once after dynamic-mode 
> operator is installed.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to