[GitHub] Fokko commented on issue #3871: [AIRFLOW-2797] Create Google Dataproc cluster with custom image

2018-09-12 Thread GitBox
Fokko commented on issue #3871: [AIRFLOW-2797] Create Google Dataproc cluster with custom image URL: https://github.com/apache/incubator-airflow/pull/3871#issuecomment-420559697 Thanks @exploy This is an automated message

[jira] [Resolved] (AIRFLOW-2797) Add ability to create Google Dataproc cluster with custom image

2018-09-12 Thread Fokko Driesprong (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved AIRFLOW-2797. --- Resolution: Fixed > Add ability to create Google Dataproc cluster with custom

[jira] [Commented] (AIRFLOW-2797) Add ability to create Google Dataproc cluster with custom image

2018-09-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16611752#comment-16611752 ] ASF GitHub Bot commented on AIRFLOW-2797: - Fokko closed pull request #3871: [AIRFLOW-2797]

[GitHub] Fokko closed pull request #3871: [AIRFLOW-2797] Create Google Dataproc cluster with custom image

2018-09-12 Thread GitBox
Fokko closed pull request #3871: [AIRFLOW-2797] Create Google Dataproc cluster with custom image URL: https://github.com/apache/incubator-airflow/pull/3871 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of

[GitHub] Fokko commented on issue #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose

2018-09-12 Thread GitBox
Fokko commented on issue #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose URL: https://github.com/apache/incubator-airflow/pull/3797#issuecomment-420559346 Awesome work @dimberman This is an automated message from

[GitHub] ashb commented on a change in pull request #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose

2018-09-12 Thread GitBox
ashb commented on a change in pull request #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose URL: https://github.com/apache/incubator-airflow/pull/3797#discussion_r216941912 ## File path: scripts/ci/run-ci-kubernetes.sh ## @@ -0,0 +1,50 @@ +#!/usr/bin/env bash +

[GitHub] ashb commented on a change in pull request #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose

2018-09-12 Thread GitBox
ashb commented on a change in pull request #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose URL: https://github.com/apache/incubator-airflow/pull/3797#discussion_r216940646 ## File path: scripts/ci/run-ci-docker.sh ## @@ -0,0 +1,40 @@ +#!/usr/bin/env bash + +# +#

[GitHub] ashb commented on a change in pull request #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose

2018-09-12 Thread GitBox
ashb commented on a change in pull request #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose URL: https://github.com/apache/incubator-airflow/pull/3797#discussion_r216941993 ## File path: scripts/ci/kubernetes/setup_kubernetes.sh ## @@ -22,8 +22,9 @@ echo "This

[GitHub] ashb commented on a change in pull request #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose

2018-09-12 Thread GitBox
ashb commented on a change in pull request #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose URL: https://github.com/apache/incubator-airflow/pull/3797#discussion_r216941728 ## File path: scripts/ci/run-ci-kubernetes.sh ## @@ -0,0 +1,50 @@ +#!/usr/bin/env bash +

[GitHub] ashb commented on a change in pull request #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose

2018-09-12 Thread GitBox
ashb commented on a change in pull request #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose URL: https://github.com/apache/incubator-airflow/pull/3797#discussion_r216942408 ## File path: .travis.yml ## @@ -43,12 +45,21 @@ before_install: - sudo ls -lh

[GitHub] ashb commented on a change in pull request #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose

2018-09-12 Thread GitBox
ashb commented on a change in pull request #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose URL: https://github.com/apache/incubator-airflow/pull/3797#discussion_r216941074 ## File path: tests/operators/__init__.py ## @@ -7,21 +7,26 @@ # to you under the Apache

[GitHub] ashb commented on a change in pull request #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose

2018-09-12 Thread GitBox
ashb commented on a change in pull request #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose URL: https://github.com/apache/incubator-airflow/pull/3797#discussion_r216941583 ## File path: tox.ini ## @@ -57,10 +58,12 @@ passenv = * commands = pip wheel

[GitHub] ashb commented on a change in pull request #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose

2018-09-12 Thread GitBox
ashb commented on a change in pull request #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose URL: https://github.com/apache/incubator-airflow/pull/3797#discussion_r216942079 ## File path: scripts/ci/kubernetes/minikube/start_kubeadm.sh ## @@ -0,0 +1,50 @@

[GitHub] kaxil commented on a change in pull request #3884: [AIRFLOW-3035] Allow custom 'job_error_states' in dataproc ops

2018-09-12 Thread GitBox
kaxil commented on a change in pull request #3884: [AIRFLOW-3035] Allow custom 'job_error_states' in dataproc ops URL: https://github.com/apache/incubator-airflow/pull/3884#discussion_r216943814 ## File path: airflow/contrib/operators/dataproc_operator.py ## @@ -688,6

[jira] [Updated] (AIRFLOW-3012) Email on sla miss is send only to first address on the list

2018-09-12 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-3012: Fix Version/s: 1.10.1 > Email on sla miss is send only to first address on the list >

[GitHub] Fokko commented on issue #3886: [AIRFLOW-1298] Fix 'clear only_failed'

2018-09-12 Thread GitBox
Fokko commented on issue #3886: [AIRFLOW-1298] Fix 'clear only_failed' URL: https://github.com/apache/incubator-airflow/pull/3886#issuecomment-420545978 ``` Running flake8 on the diff in the range 1411245..fd21d8f (1 commit(s)):

[GitHub] Fokko commented on issue #3519: [AIRFLOW-2642] fix wrong value git-sync initcontainer env GIT_SYNC_ROOT

2018-09-12 Thread GitBox
Fokko commented on issue #3519: [AIRFLOW-2642] fix wrong value git-sync initcontainer env GIT_SYNC_ROOT URL: https://github.com/apache/incubator-airflow/pull/3519#issuecomment-420545783 @dimberman Do you have an opinion about this?

[jira] [Commented] (AIRFLOW-3044) Dataflow operators accept templated job_name param

2018-09-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16611723#comment-16611723 ] ASF GitHub Bot commented on AIRFLOW-3044: - jeffkpayne opened a new pull request #3887:

[GitHub] jeffkpayne opened a new pull request #3887: [AIRFLOW-3044] Dataflow operators accept templated job_name param

2018-09-12 Thread GitBox
jeffkpayne opened a new pull request #3887: [AIRFLOW-3044] Dataflow operators accept templated job_name param URL: https://github.com/apache/incubator-airflow/pull/3887 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[GitHub] Fokko commented on issue #3869: [AIRFLOW-3012] Fix Bug when passing emails for SLA

2018-09-12 Thread GitBox
Fokko commented on issue #3869: [AIRFLOW-3012] Fix Bug when passing emails for SLA URL: https://github.com/apache/incubator-airflow/pull/3869#issuecomment-420563135 I've closed the issue!  This is an automated message

[jira] [Resolved] (AIRFLOW-3012) Email on sla miss is send only to first address on the list

2018-09-12 Thread Fokko Driesprong (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved AIRFLOW-3012. --- Resolution: Fixed > Email on sla miss is send only to first address on the list >

[jira] [Commented] (AIRFLOW-540) Allow BigQuery operators to specify default dataset

2018-09-12 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16611773#comment-16611773 ] Kaxil Naik commented on AIRFLOW-540: I don't think this is required since we just put the SQL query

[jira] [Updated] (AIRFLOW-2524) Airflow integration with AWS Sagemaker

2018-09-12 Thread Fokko Driesprong (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated AIRFLOW-2524: -- Fix Version/s: (was: 2.0.0) 1.10.1 > Airflow integration with

[GitHub] Fokko commented on issue #3885: [AIRFLOW-3001] Add index 'ti_dag_date' to taskinstance

2018-09-12 Thread GitBox
Fokko commented on issue #3885: [AIRFLOW-3001] Add index 'ti_dag_date' to taskinstance URL: https://github.com/apache/incubator-airflow/pull/3885#issuecomment-420546390 ``` Running flake8 on the diff in the range 1411245..33a63de (1 commit(s)):

[GitHub] XD-DENG closed pull request #3889: [AIRFLOW-3048] Add access to self-manage pages for non-Admin roles

2018-09-12 Thread GitBox
XD-DENG closed pull request #3889: [AIRFLOW-3048] Add access to self-manage pages for non-Admin roles URL: https://github.com/apache/incubator-airflow/pull/3889 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of

[GitHub] XD-DENG removed a comment on issue #3889: [AIRFLOW-3048] Add access to self-manage pages for non-Admin roles

2018-09-12 Thread GitBox
XD-DENG removed a comment on issue #3889: [AIRFLOW-3048] Add access to self-manage pages for non-Admin roles URL: https://github.com/apache/incubator-airflow/pull/3889#issuecomment-420676042 Hi @r39132, may you kindly refer committers or contributors who's working on the `www_rbac` to

[GitHub] feluelle commented on a change in pull request #3661: [AIRFLOW-2780] Adds IMAP Hook to interact with a mail server

2018-09-12 Thread GitBox
feluelle commented on a change in pull request #3661: [AIRFLOW-2780] Adds IMAP Hook to interact with a mail server URL: https://github.com/apache/incubator-airflow/pull/3661#discussion_r217070936 ## File path: airflow/contrib/hooks/imap_hook.py ## @@ -0,0 +1,262 @@ +# -*-

[GitHub] xnuinside commented on issue #3870: [AIRFLOW-2932] GoogleCloudStorageHook - allow compression of file

2018-09-12 Thread GitBox
xnuinside commented on issue #3870: [AIRFLOW-2932] GoogleCloudStorageHook - allow compression of file URL: https://github.com/apache/incubator-airflow/pull/3870#issuecomment-420712325 @neil90, Hi and thank you for PR! Could you fix your flake8 issues? Your travis build failed in flake8

[GitHub] dlebech opened a new pull request #3890: [AIRFLOW-3049] Add extra operations for Mongo hook

2018-09-12 Thread GitBox
dlebech opened a new pull request #3890: [AIRFLOW-3049] Add extra operations for Mongo hook URL: https://github.com/apache/incubator-airflow/pull/3890 Make sure you have checked _all_ steps below. ### Jira - [X] My PR addresses the following [Airflow

[jira] [Commented] (AIRFLOW-3049) Add update, replace, delete commands for Mongo hook

2018-09-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16612480#comment-16612480 ] ASF GitHub Bot commented on AIRFLOW-3049: - dlebech opened a new pull request #3890:

[GitHub] codecov-io edited a comment on issue #3878: [AIRFLOW-3034]: Update Readme : Add slack link, remove Gitter

2018-09-12 Thread GitBox
codecov-io edited a comment on issue #3878: [AIRFLOW-3034]: Update Readme : Add slack link, remove Gitter URL: https://github.com/apache/incubator-airflow/pull/3878#issuecomment-420078393 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3878?src=pr=h1) Report > Merging

[GitHub] codecov-io edited a comment on issue #3878: [AIRFLOW-3034]: Update Readme : Add slack link, remove Gitter

2018-09-12 Thread GitBox
codecov-io edited a comment on issue #3878: [AIRFLOW-3034]: Update Readme : Add slack link, remove Gitter URL: https://github.com/apache/incubator-airflow/pull/3878#issuecomment-420078393 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3878?src=pr=h1) Report > Merging

[GitHub] jeffkpayne commented on a change in pull request #3884: [AIRFLOW-3035] Allow custom 'job_error_states' in dataproc ops

2018-09-12 Thread GitBox
jeffkpayne commented on a change in pull request #3884: [AIRFLOW-3035] Allow custom 'job_error_states' in dataproc ops URL: https://github.com/apache/incubator-airflow/pull/3884#discussion_r217107487 ## File path: airflow/contrib/operators/dataproc_operator.py ## @@

[jira] [Commented] (AIRFLOW-2889) Fix typos detected by github.com/client9/misspell

2018-09-12 Thread Iuliia Volkova (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16612432#comment-16612432 ] Iuliia Volkova commented on AIRFLOW-2889: - [~ashb], [~seratch] , please close the task. Seem

[jira] [Created] (AIRFLOW-3049) Add update, replace, delete commands for Mongo hook

2018-09-12 Thread David Volquartz Lebech (JIRA)
David Volquartz Lebech created AIRFLOW-3049: --- Summary: Add update, replace, delete commands for Mongo hook Key: AIRFLOW-3049 URL: https://issues.apache.org/jira/browse/AIRFLOW-3049 Project:

[jira] [Commented] (AIRFLOW-2772) BigQuery hook does not allow specifying both the partition field name and table name at the same time

2018-09-12 Thread Iuliia Volkova (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16612438#comment-16612438 ] Iuliia Volkova commented on AIRFLOW-2772: - [~kaxilnaik] , [~fenglu] , please write your

[jira] [Comment Edited] (AIRFLOW-2772) BigQuery hook does not allow specifying both the partition field name and table name at the same time

2018-09-12 Thread Iuliia Volkova (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16612438#comment-16612438 ] Iuliia Volkova edited comment on AIRFLOW-2772 at 9/12/18 4:38 PM: --

[GitHub] XD-DENG commented on issue #3889: [AIRFLOW-3048] Add access to self-manage pages for non-Admin roles

2018-09-12 Thread GitBox
XD-DENG commented on issue #3889: [AIRFLOW-3048] Add access to self-manage pages for non-Admin roles URL: https://github.com/apache/incubator-airflow/pull/3889#issuecomment-420690342 CI fails. Will re-open after I fix the CI.

[jira] [Commented] (AIRFLOW-3048) (www_rbac) Non-Admin Roles' Access to Pages "Profile", "Edit User", and "Reset my password"

2018-09-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16612332#comment-16612332 ] ASF GitHub Bot commented on AIRFLOW-3048: - XD-DENG closed pull request #3889: [AIRFLOW-3048]

[GitHub] feng-tao commented on issue #3889: [AIRFLOW-3048] Add access to self-manage pages for non-Admin roles

2018-09-12 Thread GitBox
feng-tao commented on issue #3889: [AIRFLOW-3048] Add access to self-manage pages for non-Admin roles URL: https://github.com/apache/incubator-airflow/pull/3889#issuecomment-420690835 I worked on this code. I will take a look.

[jira] [Commented] (AIRFLOW-638) Added schema_update_options to BigQueryBaseCursor and GoogleCloudStorageToBigQueryOperator

2018-09-12 Thread Iuliia Volkova (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16612452#comment-16612452 ] Iuliia Volkova commented on AIRFLOW-638: [~ashb] , [~kaxilnaik] , please close this task. It's

[GitHub] dimberman commented on a change in pull request #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose

2018-09-12 Thread GitBox
dimberman commented on a change in pull request #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose URL: https://github.com/apache/incubator-airflow/pull/3797#discussion_r217119304 ## File path: tox.ini ## @@ -57,10 +58,12 @@ passenv = * commands = pip wheel

[GitHub] dimberman commented on a change in pull request #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose

2018-09-12 Thread GitBox
dimberman commented on a change in pull request #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose URL: https://github.com/apache/incubator-airflow/pull/3797#discussion_r217119163 ## File path: tests/operators/__init__.py ## @@ -7,21 +7,26 @@ # to you under the

[GitHub] codecov-io edited a comment on issue #3884: [AIRFLOW-3035] Allow custom 'job_error_states' in dataproc ops

2018-09-12 Thread GitBox
codecov-io edited a comment on issue #3884: [AIRFLOW-3035] Allow custom 'job_error_states' in dataproc ops URL: https://github.com/apache/incubator-airflow/pull/3884#issuecomment-420458359 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3884?src=pr=h1) Report >

[GitHub] codecov-io edited a comment on issue #3878: [AIRFLOW-3034]: Update Readme : Add slack link, remove Gitter

2018-09-12 Thread GitBox
codecov-io edited a comment on issue #3878: [AIRFLOW-3034]: Update Readme : Add slack link, remove Gitter URL: https://github.com/apache/incubator-airflow/pull/3878#issuecomment-420078393 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3878?src=pr=h1) Report > Merging

[GitHub] feng-tao commented on issue #3889: [AIRFLOW-3048] Add access to self-manage pages for non-Admin roles

2018-09-12 Thread GitBox
feng-tao commented on issue #3889: [AIRFLOW-3048] Add access to self-manage pages for non-Admin roles URL: https://github.com/apache/incubator-airflow/pull/3889#issuecomment-420692913 FYI, this fix won't work as there are five types of authentication model. This change only intends for

[GitHub] jeffkpayne commented on a change in pull request #3884: [AIRFLOW-3035] Allow custom 'job_error_states' in dataproc ops

2018-09-12 Thread GitBox
jeffkpayne commented on a change in pull request #3884: [AIRFLOW-3035] Allow custom 'job_error_states' in dataproc ops URL: https://github.com/apache/incubator-airflow/pull/3884#discussion_r217110985 ## File path: airflow/contrib/operators/dataproc_operator.py ## @@

[GitHub] dimberman commented on a change in pull request #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose

2018-09-12 Thread GitBox
dimberman commented on a change in pull request #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose URL: https://github.com/apache/incubator-airflow/pull/3797#discussion_r217129158 ## File path: tests/operators/__init__.py ## @@ -7,21 +7,26 @@ # to you under the

[jira] [Created] (AIRFLOW-3050) Deactivate Stale DAGs in the Main Scheduler Loop

2018-09-12 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-3050: Summary: Deactivate Stale DAGs in the Main Scheduler Loop Key: AIRFLOW-3050 URL: https://issues.apache.org/jira/browse/AIRFLOW-3050 Project: Apache Airflow

[GitHub] jeffkpayne commented on issue #3887: [AIRFLOW-3044] Dataflow operators accept templated job_name param

2018-09-12 Thread GitBox
jeffkpayne commented on issue #3887: [AIRFLOW-3044] Dataflow operators accept templated job_name param URL: https://github.com/apache/incubator-airflow/pull/3887#issuecomment-420768848 Fixing now... This is an automated

[jira] [Commented] (AIRFLOW-3029) New Operator - SqlOperator

2018-09-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16612686#comment-16612686 ] ASF GitHub Bot commented on AIRFLOW-3029: - jbacon opened a new pull request #3891:

[GitHub] jbacon opened a new pull request #3891: [AIRFLOW-3029] New Operator - SqlOperator

2018-09-12 Thread GitBox
jbacon opened a new pull request #3891: [AIRFLOW-3029] New Operator - SqlOperator URL: https://github.com/apache/incubator-airflow/pull/3891 Introduces a new `SqlOperator` that executes sql code in a database. Surprisingly this operator doesn't already exist. It is not always necessary to

[jira] [Comment Edited] (AIRFLOW-2469) example task in documentation causes dataflow operator to fail

2018-09-12 Thread Iuliia Volkova (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16612593#comment-16612593 ] Iuliia Volkova edited comment on AIRFLOW-2469 at 9/12/18 7:02 PM: --

[GitHub] xnuinside commented on issue #3826: [AIRFLOW-2988] Run specifically python2 for dataflow

2018-09-12 Thread GitBox
xnuinside commented on issue #3826: [AIRFLOW-2988] Run specifically python2 for dataflow URL: https://github.com/apache/incubator-airflow/pull/3826#issuecomment-420762430 @kaxil , @tswast , please review This is an

[GitHub] jeffkpayne commented on issue #3884: [AIRFLOW-3035] Allow custom 'job_error_states' in dataproc ops

2018-09-12 Thread GitBox
jeffkpayne commented on issue #3884: [AIRFLOW-3035] Allow custom 'job_error_states' in dataproc ops URL: https://github.com/apache/incubator-airflow/pull/3884#issuecomment-420762458 @kaxil Made the requested changes to the docstrings.

[jira] [Commented] (AIRFLOW-2928) Use uuid.uuid4 to create unique job name

2018-09-12 Thread Iuliia Volkova (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16612619#comment-16612619 ] Iuliia Volkova commented on AIRFLOW-2928: - [~ashb], [~Fokko] , please close the issue, it's

[GitHub] dimberman commented on issue #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose

2018-09-12 Thread GitBox
dimberman commented on issue #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose URL: https://github.com/apache/incubator-airflow/pull/3797#issuecomment-420793289 @Fokko @bolkedebruin @ashb I am seeing multiple errors with the kubernetes executor once running: 1. The API

[jira] [Commented] (AIRFLOW-2469) example task in documentation causes dataflow operator to fail

2018-09-12 Thread Iuliia Volkova (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16612566#comment-16612566 ] Iuliia Volkova commented on AIRFLOW-2469: - link to the doc with pattern matching condition:

[jira] [Issue Comment Deleted] (AIRFLOW-2469) example task in documentation causes dataflow operator to fail

2018-09-12 Thread Iuliia Volkova (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Iuliia Volkova updated AIRFLOW-2469: Comment: was deleted (was: link to the doc with pattern matching condition:

[jira] [Commented] (AIRFLOW-2469) example task in documentation causes dataflow operator to fail

2018-09-12 Thread Iuliia Volkova (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16612593#comment-16612593 ] Iuliia Volkova commented on AIRFLOW-2469: - link to the doc with pattern matching condition:

[GitHub] xnuinside edited a comment on issue #3826: [AIRFLOW-2988] Run specifically python2 for dataflow

2018-09-12 Thread GitBox
xnuinside edited a comment on issue #3826: [AIRFLOW-2988] Run specifically python2 for dataflow URL: https://github.com/apache/incubator-airflow/pull/3826#issuecomment-420762430 @kaxil , please review This is an automated

[GitHub] feng-tao commented on issue #3873: [Airflow-2760] Decouple DAG parsing loop from scheduler loop

2018-09-12 Thread GitBox
feng-tao commented on issue #3873: [Airflow-2760] Decouple DAG parsing loop from scheduler loop URL: https://github.com/apache/incubator-airflow/pull/3873#issuecomment-420764932 will take a look later this week. This is an

[jira] [Commented] (AIRFLOW-2953) Installing postgres and gcp_api doesn't install PostgresToGoogleCloudStorageOperator

2018-09-12 Thread Iuliia Volkova (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16612621#comment-16612621 ] Iuliia Volkova commented on AIRFLOW-2953: - [~robert.l.kelly3] , do you fix the issue with 1.10

[jira] [Commented] (AIRFLOW-3050) Deactivate Stale DAGs in the Main Scheduler Loop

2018-09-12 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16612658#comment-16612658 ] Ash Berlin-Taylor commented on AIRFLOW-3050: I would probably say at scheduler start up and

[jira] [Assigned] (AIRFLOW-2469) example task in documentation causes dataflow operator to fail

2018-09-12 Thread Iuliia Volkova (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Iuliia Volkova reassigned AIRFLOW-2469: --- Assignee: Iuliia Volkova > example task in documentation causes dataflow operator

[GitHub] danmactough commented on a change in pull request #3435: [AIRFLOW-2539] OS Environment variable for logging FILENAME_TEMPLATE

2018-09-12 Thread GitBox
danmactough commented on a change in pull request #3435: [AIRFLOW-2539] OS Environment variable for logging FILENAME_TEMPLATE URL: https://github.com/apache/incubator-airflow/pull/3435#discussion_r217152739 ## File path: airflow/config_templates/default_airflow.cfg ## @@

[GitHub] danmactough commented on a change in pull request #3435: [AIRFLOW-2539] OS Environment variable for logging FILENAME_TEMPLATE

2018-09-12 Thread GitBox
danmactough commented on a change in pull request #3435: [AIRFLOW-2539] OS Environment variable for logging FILENAME_TEMPLATE URL: https://github.com/apache/incubator-airflow/pull/3435#discussion_r217152739 ## File path: airflow/config_templates/default_airflow.cfg ## @@

[jira] [Commented] (AIRFLOW-1009) Remove SQLOperator from Concepts page

2018-09-12 Thread Josh Bacon (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16612694#comment-16612694 ] Josh Bacon commented on AIRFLOW-1009: - Hello,  Just for the record here: I just submitted a

[jira] [Created] (AIRFLOW-3051) The cli tools for manipulating users should be symmetric with connections

2018-09-12 Thread William Pursell (JIRA)
William Pursell created AIRFLOW-3051: Summary: The cli tools for manipulating users should be symmetric with connections Key: AIRFLOW-3051 URL: https://issues.apache.org/jira/browse/AIRFLOW-3051

[GitHub] kaxil closed pull request #3884: [AIRFLOW-3035] Allow custom 'job_error_states' in dataproc ops

2018-09-12 Thread GitBox
kaxil closed pull request #3884: [AIRFLOW-3035] Allow custom 'job_error_states' in dataproc ops URL: https://github.com/apache/incubator-airflow/pull/3884 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of

[jira] [Commented] (AIRFLOW-2772) BigQuery hook does not allow specifying both the partition field name and table name at the same time

2018-09-12 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16612790#comment-16612790 ] Kaxil Naik commented on AIRFLOW-2772: - [~xnuinside] Looks the this was a mistake. Can you send a PR

[jira] [Updated] (AIRFLOW-3052) Add logo options to Airflow

2018-09-12 Thread Siddharth Anand (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Anand updated AIRFLOW-3052: - External issue URL: https://github.com/apache/incubator-airflow/pull/3892 > Add logo

[jira] [Commented] (AIRFLOW-3052) Add logo options to Airflow

2018-09-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16612855#comment-16612855 ] ASF GitHub Bot commented on AIRFLOW-3052: - r39132 opened a new pull request #3892:

[GitHub] r39132 opened a new pull request #3892: [AIRFLOW-3052] Add logo options to Airflow

2018-09-12 Thread GitBox
r39132 opened a new pull request #3892: [AIRFLOW-3052] Add logo options to Airflow URL: https://github.com/apache/incubator-airflow/pull/3892 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[GitHub] gerardo commented on issue #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose

2018-09-12 Thread GitBox
gerardo commented on issue #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose URL: https://github.com/apache/incubator-airflow/pull/3797#issuecomment-420799103 If it's becoming too hard, I agree with reverting the docker-compose CI changes. I could go back and create a new branch

[GitHub] kaxil commented on a change in pull request #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset

2018-09-12 Thread GitBox
kaxil commented on a change in pull request #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset URL: https://github.com/apache/incubator-airflow/pull/3876#discussion_r217204755 ## File path: airflow/contrib/hooks/bigquery_hook.py ##

[GitHub] kaxil commented on a change in pull request #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset

2018-09-12 Thread GitBox
kaxil commented on a change in pull request #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset URL: https://github.com/apache/incubator-airflow/pull/3876#discussion_r217204607 ## File path: airflow/contrib/hooks/bigquery_hook.py ##

[GitHub] kaxil commented on a change in pull request #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset

2018-09-12 Thread GitBox
kaxil commented on a change in pull request #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset URL: https://github.com/apache/incubator-airflow/pull/3876#discussion_r217206007 ## File path: airflow/contrib/operators/bigquery_operator.py

[GitHub] jeffkpayne commented on a change in pull request #3887: [AIRFLOW-3044] Dataflow operators accept templated job_name param

2018-09-12 Thread GitBox
jeffkpayne commented on a change in pull request #3887: [AIRFLOW-3044] Dataflow operators accept templated job_name param URL: https://github.com/apache/incubator-airflow/pull/3887#discussion_r217206882 ## File path: airflow/contrib/hooks/gcp_dataflow_hook.py ## @@

[GitHub] kaxil commented on a change in pull request #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset

2018-09-12 Thread GitBox
kaxil commented on a change in pull request #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset URL: https://github.com/apache/incubator-airflow/pull/3876#discussion_r217205897 ## File path: airflow/contrib/hooks/bigquery_hook.py ##

[GitHub] kaxil commented on a change in pull request #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset

2018-09-12 Thread GitBox
kaxil commented on a change in pull request #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset URL: https://github.com/apache/incubator-airflow/pull/3876#discussion_r217206388 ## File path: airflow/contrib/operators/bigquery_operator.py

[GitHub] kaxil commented on a change in pull request #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset

2018-09-12 Thread GitBox
kaxil commented on a change in pull request #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset URL: https://github.com/apache/incubator-airflow/pull/3876#discussion_r217206794 ## File path: docs/integration.rst ## @@ -349,6 +349,7 @@

[jira] [Updated] (AIRFLOW-3052) Add logo options to Airflow

2018-09-12 Thread Siddharth Anand (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Anand updated AIRFLOW-3052: - Summary: Add logo options to Airflow (was: Add new logos to Airflow) > Add logo

[GitHub] kaxil commented on a change in pull request #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset

2018-09-12 Thread GitBox
kaxil commented on a change in pull request #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset URL: https://github.com/apache/incubator-airflow/pull/3876#discussion_r217204960 ## File path: airflow/contrib/hooks/bigquery_hook.py ##

[GitHub] kaxil commented on a change in pull request #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset

2018-09-12 Thread GitBox
kaxil commented on a change in pull request #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset URL: https://github.com/apache/incubator-airflow/pull/3876#discussion_r217205266 ## File path: airflow/contrib/operators/bigquery_operator.py

[GitHub] kaxil commented on a change in pull request #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset

2018-09-12 Thread GitBox
kaxil commented on a change in pull request #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset URL: https://github.com/apache/incubator-airflow/pull/3876#discussion_r217204000 ## File path: airflow/contrib/hooks/bigquery_hook.py ##

[GitHub] jeffkpayne commented on issue #3887: [AIRFLOW-3044] Dataflow operators accept templated job_name param

2018-09-12 Thread GitBox
jeffkpayne commented on issue #3887: [AIRFLOW-3044] Dataflow operators accept templated job_name param URL: https://github.com/apache/incubator-airflow/pull/3887#issuecomment-420818546 Fixing conflicts now... This is an

[GitHub] XD-DENG commented on issue #3889: [AIRFLOW-3048] Add access to self-manage pages for non-Admin roles

2018-09-12 Thread GitBox
XD-DENG commented on issue #3889: [AIRFLOW-3048] Add access to self-manage pages for non-Admin roles URL: https://github.com/apache/incubator-airflow/pull/3889#issuecomment-420828802 I was wrong: **userinfoedit** and **resermypassword** don’t have to be applicalble, for example LDAP.

[GitHub] xnuinside commented on a change in pull request #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset

2018-09-12 Thread GitBox
xnuinside commented on a change in pull request #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset URL: https://github.com/apache/incubator-airflow/pull/3876#discussion_r217244436 ## File path: airflow/contrib/hooks/bigquery_hook.py

[GitHub] ndmar commented on issue #2708: [AIRFLOW-1746] Add a Nomad operator to trigger job from Airflow

2018-09-12 Thread GitBox
ndmar commented on issue #2708: [AIRFLOW-1746] Add a Nomad operator to trigger job from Airflow URL: https://github.com/apache/incubator-airflow/pull/2708#issuecomment-420805366 @Fokko Just wanted to follow up and see if there was anything else I should tackle. Seems like most of your

[jira] [Commented] (AIRFLOW-3035) gcp_dataproc_hook should treat CANCELLED job state consistently

2018-09-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16612774#comment-16612774 ] ASF GitHub Bot commented on AIRFLOW-3035: - kaxil closed pull request #3884: [AIRFLOW-3035]

[jira] [Resolved] (AIRFLOW-3035) gcp_dataproc_hook should treat CANCELLED job state consistently

2018-09-12 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-3035. - Resolution: Fixed Fix Version/s: (was: 1.10.1) 2.0.0 Resolved by

[jira] [Closed] (AIRFLOW-2469) example task in documentation causes dataflow operator to fail

2018-09-12 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik closed AIRFLOW-2469. --- Resolution: Fixed This has already been fixed > example task in documentation causes dataflow

[jira] [Created] (AIRFLOW-3052) Add new logos to Airflow

2018-09-12 Thread Siddharth Anand (JIRA)
Siddharth Anand created AIRFLOW-3052: Summary: Add new logos to Airflow Key: AIRFLOW-3052 URL: https://issues.apache.org/jira/browse/AIRFLOW-3052 Project: Apache Airflow Issue Type: New

[GitHub] codecov-io commented on issue #3887: [AIRFLOW-3044] Dataflow operators accept templated job_name param

2018-09-12 Thread GitBox
codecov-io commented on issue #3887: [AIRFLOW-3044] Dataflow operators accept templated job_name param URL: https://github.com/apache/incubator-airflow/pull/3887#issuecomment-420833798 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3887?src=pr=h1) Report > Merging

[GitHub] codecov-io edited a comment on issue #3878: [AIRFLOW-3034]: Readme updates : Add Slack & Twitter, remove Gitter

2018-09-12 Thread GitBox
codecov-io edited a comment on issue #3878: [AIRFLOW-3034]: Readme updates : Add Slack & Twitter, remove Gitter URL: https://github.com/apache/incubator-airflow/pull/3878#issuecomment-420078393 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3878?src=pr=h1) Report >

[GitHub] codecov-io edited a comment on issue #3878: [AIRFLOW-3034]: Readme updates : Add Slack & Twitter, remove Gitter

2018-09-12 Thread GitBox
codecov-io edited a comment on issue #3878: [AIRFLOW-3034]: Readme updates : Add Slack & Twitter, remove Gitter URL: https://github.com/apache/incubator-airflow/pull/3878#issuecomment-420078393 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3878?src=pr=h1) Report >

[GitHub] kaxil commented on a change in pull request #3887: [AIRFLOW-3044] Dataflow operators accept templated job_name param

2018-09-12 Thread GitBox
kaxil commented on a change in pull request #3887: [AIRFLOW-3044] Dataflow operators accept templated job_name param URL: https://github.com/apache/incubator-airflow/pull/3887#discussion_r217194071 ## File path: tests/contrib/hooks/test_gcp_dataflow_hook.py ## @@ -178,18

[GitHub] kaxil commented on a change in pull request #3887: [AIRFLOW-3044] Dataflow operators accept templated job_name param

2018-09-12 Thread GitBox
kaxil commented on a change in pull request #3887: [AIRFLOW-3044] Dataflow operators accept templated job_name param URL: https://github.com/apache/incubator-airflow/pull/3887#discussion_r217195863 ## File path: airflow/contrib/hooks/gcp_dataflow_hook.py ## @@ -208,56

[jira] [Closed] (AIRFLOW-2953) Installing postgres and gcp_api doesn't install PostgresToGoogleCloudStorageOperator

2018-09-12 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik closed AIRFLOW-2953. --- Resolution: Not A Problem > Installing postgres and gcp_api doesn't install >

  1   2   >