Evgeny Podlepaev created AIRFLOW-2773:
-----------------------------------------
Summary: DataFlowPythonOperator does not handle correctly task_id
containing underscores
Key: AIRFLOW-2773
URL: https://issues.apache.org/jira/browse/AIRFLOW-2773
Project: Apache Airflow
Issue Type: Bug
Components: Dataflow
Affects Versions: 1.9.0
Reporter: Evgeny Podlepaev
DataFlowPythonOperator generates a job name that does not get accepted by
Dataflow API when task_id contains underscores. Example:
DataFlowPythonOperator(task_id='analyze_search_results', ...)
will lead to the following error:
ValueError: Pipeline has validations errors: Invalid job_name
(analyze_search_results-02e17268); the name must consist of only the characters
[-a-z0-9], starting with a letter and ending with a letter or number.
The fix seems to be as simple as changing DataFlowHook.start_python_dataflow()
to do
name = task_id.replace('_', '-')
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
