[
https://issues.apache.org/jira/browse/AIRFLOW-2411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16463038#comment-16463038
]
ASF subversion and git services commented on AIRFLOW-2411:
----------------------------------------------------------
Commit c5fa8cd411ca67889eafd109988d2472ccfbba10 in incubator-airflow's branch
refs/heads/master from [~mchalek]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=c5fa8cd ]
[AIRFLOW-2411] add dataproc_jars to templated_fields
This commit makes it possible to use jinja
templates when passing
JAR file URIs to the DataProc operators that
require JAR files,
specifically the DataProc Hive, Pig, SparkSql,
Spark, Hadoop and
PySpark operators.
Closes #3305 from mchalek/template-dataproc-jars
> Add dataproc_jars to the templated operator lists for GCP dataproc operators
> ----------------------------------------------------------------------------
>
> Key: AIRFLOW-2411
> URL: https://issues.apache.org/jira/browse/AIRFLOW-2411
> Project: Apache Airflow
> Issue Type: Improvement
> Components: gcp
> Affects Versions: 1.9.0
> Reporter: Kevin McHale
> Assignee: Kevin McHale
> Priority: Trivial
>
> I would like to add `dataproc_jars` to the list of templated fields for the
> various DataProc operators. This will allow the jars to be specified using
> jinja templates — for example, to automatically pull in the latest jar from a
> set of jars built nightly.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)