Qi Tan created SPARK-49658:
------------------------------
Summary: E2E Workflow Refactor
Key: SPARK-49658
URL: https://issues.apache.org/jira/browse/SPARK-49658
Project: Spark
Issue Type: Sub-task
Components: Kubernetes
Affects Versions: 4.0.0
Reporter: Qi Tan
Current matrix
kubernetes-version:
- "1.28.0"
- "1.31.0"
test-group:
- spark-versions
- python
- state-transition
dynamic-config-test-group:
- watched-namespaces
result in combination
1.28.0, spark-versions, watched-namespace
1.28.0, python, watched-namespace
1.28.0, state-transition, watched-namespace
...
It is costing more time and resources.
Ideally, it shall be a combination
1.28 spark-version
1.28 watch-namespace
1.31...
Note that the reason why watched-namespaces could not be put under test-group
is the operator configurations are different between dynamic and static mode.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
