[
https://issues.apache.org/jira/browse/AIRFLOW-782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15840261#comment-15840261
]
ASF subversion and git services commented on AIRFLOW-782:
---------------------------------------------------------
Commit dc97bcd3b7e0a7eebd838f0fb0452a0b47ba417b in incubator-airflow's branch
refs/heads/master from [~farlue]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=dc97bcd ]
[AIRFLOW-782] Add support for DataFlowPythonOperator.
DataFlowPythonOperator allows users to definie GCP
dataflow task where
the pipeline job is specified in Python. The
corresponding unit tests
are also included. To run the tests:
nosetests tests.contrib.hooks.gcp_dataflow_hook:Da
taFlowHookTest and
nosetests tests.contrib.operators.dataflow_operato
r:DataFlowPythonOperatorTest.
Closes #2025 from fenglu-g/master
> Add a new PythonDataFlowOperator which runs python based dataflow jobs.
> -----------------------------------------------------------------------
>
> Key: AIRFLOW-782
> URL: https://issues.apache.org/jira/browse/AIRFLOW-782
> Project: Apache Airflow
> Issue Type: Improvement
> Components: contrib
> Reporter: Feng Lu
> Assignee: Feng Lu
>
> This operator should start a python based dataflow pipeline job.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
