mik-laj opened a new issue #8567:
URL: https://github.com/apache/airflow/issues/8567


   **Description**
   
   Hello,
   
   We have an operator that allows us to run build in the Cloud Build service.
   
https://github.com/apache/airflow/blob/3c4ca62af11e84fc7c09428642d09055b704c576/airflow/providers/google/cloud/operators/cloud_build.py
   Unfortunately, this operator did not allow easy use with YAML files. In this 
way, tasks are defined in this service. 
https://cloud.google.com/cloud-build/docs/build-config#yaml
   I think we should add the possibility to pass the path to the file from 
which the definition will be loaded.
   We have similar functionality in SparkKubernetesOperator.
   
https://github.com/apache/airflow/blob/master/airflow/providers/cncf/kubernetes/operators/spark_kubernetes.py
   
https://github.com/apache/airflow/blob/master/airflow/providers/cncf/kubernetes/example_dags/example_spark_kubernetes_operator_spark_pi.yaml
   
https://github.com/apache/airflow/blob/master/airflow/providers/cncf/kubernetes/example_dags/example_spark_kubernetes_operator.py#L63-L70
   
   If anyone wants to do this task, please remember to update system tests and 
documentation.
   
   Best regards,
   Kamil


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to