incubator-airflow git commit: [AIRFLOW-1623] Trigger on_kill method in operators

2018-04-11 Thread bolke
Repository: incubator-airflow Updated Branches: refs/heads/master e58d0c9e2 -> 39b7d7d87 [AIRFLOW-1623] Trigger on_kill method in operators on_kill methods were not triggered, due to processes not being properly terminated. This was due to the fact the runners use a shell which is then

[jira] [Commented] (AIRFLOW-1623) Clearing task in UI does not trigger on_kill method in operator

2018-04-11 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16433448#comment-16433448 ] ASF subversion and git services commented on AIRFLOW-1623: -- Commit

[jira] [Resolved] (AIRFLOW-1623) Clearing task in UI does not trigger on_kill method in operator

2018-04-11 Thread Bolke de Bruin (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bolke de Bruin resolved AIRFLOW-1623. - Resolution: Fixed Issue resolved by pull request #3204

[jira] [Commented] (AIRFLOW-1623) Clearing task in UI does not trigger on_kill method in operator

2018-04-11 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16433447#comment-16433447 ] ASF subversion and git services commented on AIRFLOW-1623: -- Commit

[jira] [Created] (AIRFLOW-2313) Add ClusterLifecycleConfig to DataprocClusterCreateOperator

2018-04-11 Thread e b (JIRA)
e b created AIRFLOW-2313: Summary: Add ClusterLifecycleConfig to DataprocClusterCreateOperator Key: AIRFLOW-2313 URL: https://issues.apache.org/jira/browse/AIRFLOW-2313 Project: Apache Airflow

[jira] [Updated] (AIRFLOW-2313) Add ClusterLifecycleConfig to DataprocClusterCreateOperator

2018-04-11 Thread e b (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] e b updated AIRFLOW-2313: - Description: Google introduced Cloud Dataproc Cluster

[jira] [Updated] (AIRFLOW-2313) Add ClusterLifecycleConfig to DataprocClusterCreateOperator

2018-04-11 Thread e b (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] e b updated AIRFLOW-2313: - Description: Google introduced [Cloud Dataproc Cluster Scheduled

incubator-airflow git commit: [AIRFLOW-2302] Add missing operators and hooks

2018-04-11 Thread fokko
Repository: incubator-airflow Updated Branches: refs/heads/master 69ccf8432 -> 3475faf6b [AIRFLOW-2302] Add missing operators and hooks Many operators and hooks are not listed in the config, and therefore not picked up by the docks generator. Closes #3201 from Fokko/airflow-2302-add-missing-

[jira] [Resolved] (AIRFLOW-2302) Add missing operators/hooks to the docs

2018-04-11 Thread Fokko Driesprong (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved AIRFLOW-2302. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request #3201

[jira] [Updated] (AIRFLOW-2313) Add ClusterLifecycleConfig to DataprocClusterCreateOperator

2018-04-11 Thread e b (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] e b updated AIRFLOW-2313: - Description: Google introduced [Cloud Dataproc Cluster Scheduled

[jira] [Resolved] (AIRFLOW-2312) Docs Typo Correction: Corresponding

2018-04-11 Thread Fokko Driesprong (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved AIRFLOW-2312. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request #3211

[jira] [Resolved] (AIRFLOW-1774) Better handling of templated parameters in Google ML batch prediction/training operators

2018-04-11 Thread Fokko Driesprong (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved AIRFLOW-1774. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request #2746

incubator-airflow git commit: [AIRFLOW-1774] Allow consistent templating of arguments in MLEngineBatchPredictionOperator

2018-04-11 Thread fokko
Repository: incubator-airflow Updated Branches: refs/heads/master 3475faf6b -> 65e7025f3 [AIRFLOW-1774] Allow consistent templating of arguments in MLEngineBatchPredictionOperator Fix a minor typo and a wrong non-default assignment Fix one more typo Adapt tests to new error messages and

[jira] [Commented] (AIRFLOW-1774) Better handling of templated parameters in Google ML batch prediction/training operators

2018-04-11 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16433662#comment-16433662 ] ASF subversion and git services commented on AIRFLOW-1774: -- Commit

[jira] [Assigned] (AIRFLOW-2313) Add ClusterLifecycleConfig to DataprocClusterCreateOperator

2018-04-11 Thread Egidijus Bartkus (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Egidijus Bartkus reassigned AIRFLOW-2313: - Assignee: Egidijus Bartkus > Add ClusterLifecycleConfig to

incubator-airflow git commit: [AIRFLOW-2312] Docs Typo Correction: Corresponding

2018-04-11 Thread fokko
Repository: incubator-airflow Updated Branches: refs/heads/master 39b7d7d87 -> 69ccf8432 [AIRFLOW-2312] Docs Typo Correction: Corresponding # JIRA [x] My PR addresses the following Airflow JIRA issues and references them in the PR title. * https://issues.apache.org/jira/browse/AIRFLOW-2312 #

[jira] [Commented] (AIRFLOW-2312) Docs Typo Correction: Corresponding

2018-04-11 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16433633#comment-16433633 ] ASF subversion and git services commented on AIRFLOW-2312: -- Commit

[jira] [Commented] (AIRFLOW-2312) Docs Typo Correction: Corresponding

2018-04-11 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16433632#comment-16433632 ] ASF subversion and git services commented on AIRFLOW-2312: -- Commit

[jira] [Commented] (AIRFLOW-2302) Add missing operators/hooks to the docs

2018-04-11 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16433657#comment-16433657 ] ASF subversion and git services commented on AIRFLOW-2302: -- Commit

incubator-airflow git commit: [AIRFLOW-2291] Add optional params to ML Engine

2018-04-11 Thread fokko
Repository: incubator-airflow Updated Branches: refs/heads/master 65e7025f3 -> d9bf1edd4 [AIRFLOW-2291] Add optional params to ML Engine This commit adds three extra optional parameters to the `MLEngineTrainingOperator` as well as a new unit test for the `MLEngineVersionOperator` Closes

[jira] [Commented] (AIRFLOW-2291) Ability to specify runtimeVersion, pythonVersion and jobDir in ML Engine operator

2018-04-11 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16433809#comment-16433809 ] ASF subversion and git services commented on AIRFLOW-2291: -- Commit

[jira] [Created] (AIRFLOW-2314) Fix strip of trailing slash in GCS paths

2018-04-11 Thread JIRA
Guillermo Rodríguez Cano created AIRFLOW-2314: - Summary: Fix strip of trailing slash in GCS paths Key: AIRFLOW-2314 URL: https://issues.apache.org/jira/browse/AIRFLOW-2314 Project: Apache

[jira] [Assigned] (AIRFLOW-2314) Fix strip of trailing slash in GCS paths

2018-04-11 Thread JIRA
[ https://issues.apache.org/jira/browse/AIRFLOW-2314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guillermo Rodríguez Cano reassigned AIRFLOW-2314: - Assignee: Guillermo Rodríguez Cano > Fix strip of trailing

[jira] [Commented] (AIRFLOW-2314) Fix strip of trailing slash in GCS paths

2018-04-11 Thread JIRA
[ https://issues.apache.org/jira/browse/AIRFLOW-2314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16433859#comment-16433859 ] Guillermo Rodríguez Cano commented on AIRFLOW-2314: --- PR addressing the issue: 

[jira] [Resolved] (AIRFLOW-2291) Ability to specify runtimeVersion, pythonVersion and jobDir in ML Engine operator

2018-04-11 Thread Fokko Driesprong (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved AIRFLOW-2291. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request #3202

[jira] [Created] (AIRFLOW-2315) S3Hook Extra Extras

2018-04-11 Thread Josh Bacon (JIRA)
Josh Bacon created AIRFLOW-2315: --- Summary: S3Hook Extra Extras Key: AIRFLOW-2315 URL: https://issues.apache.org/jira/browse/AIRFLOW-2315 Project: Apache Airflow Issue Type: Improvement

[jira] [Updated] (AIRFLOW-2315) S3Hook Extra Extras

2018-04-11 Thread Josh Bacon (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Bacon updated AIRFLOW-2315: Labels: beginner features newbie starter (was: ) > S3Hook Extra Extras > >