n-badtke-cg opened a new issue, #74081:
URL: https://github.com/apache/airflow/issues/74081

   ### Description
   
   The ASF started [a new Kubernetes Operator for Apache 
Spark](https://github.com/apache/spark-kubernetes-operator) in May 2025. 
   With that, there are now two distinct officially released Kubernetes 
Operators for Apache Spark:
    
   - [Kubeflow Spark Operator](https://github.com/kubeflow/spark-operator)
   - [Apache Spark Kubernetes 
Operator](https://github.com/apache/spark-kubernetes-operator)
   
   The new Apache Spark Kubernetes Operator already had its v1 release.
   
   The Kubeflow Spark Operator has currently Apache Airflow support through the 
[`SparkKubernetesOperator` class in the 
`apache-airflow-providers-cncf-kubernetes` 
package](https://airflow.apache.org/docs/apache-airflow-providers-cncf-kubernetes/stable/operators.html#sparkkubernetesoperator).
 
   
   It might be time to support the new Operator with an Airflow provider like 
with the Kubeflow Operator.
   
   ### Use case/motivation
   
   The Apache Spark Kubernetes Operator implements differently and has a better 
lookout for future development.
   
   ### Related issues
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [x] I agree to follow this project's [Code of 
Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to