[jira] [Created] (AIRFLOW-5578) The root url "/" should be configurable, not hardcoded

2019-09-30 Thread David Dossett (Jira)
David Dossett created AIRFLOW-5578: -- Summary: The root url "/" should be configurable, not hardcoded Key: AIRFLOW-5578 URL: https://issues.apache.org/jira/browse/AIRFLOW-5578 Project: Apache Airflow

[jira] [Assigned] (AIRFLOW-5577) Dags Filter_by_owner is missing in RBAC

2019-09-30 Thread David Dossett (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Dossett reassigned AIRFLOW-5577: -- Assignee: David Dossett > Dags Filter_by_owner is missing in RBAC >

[jira] [Assigned] (AIRFLOW-5577) Dags Filter_by_owner is missing in RBAC

2019-09-30 Thread David Dossett (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Dossett reassigned AIRFLOW-5577: -- Assignee: Hari (was: David Dossett) Sorry, keyboard shortcuts assigned this to me w

[GitHub] [airflow] feng-tao commented on a change in pull request #6219: Dags filter by owner in RBAC

2019-09-30 Thread GitBox
feng-tao commented on a change in pull request #6219: Dags filter by owner in RBAC URL: https://github.com/apache/airflow/pull/6219#discussion_r329867789 ## File path: airflow/www_rbac/views.py ## @@ -229,11 +229,17 @@ def get_int_arg(value, default=0): hide_p

[GitHub] [airflow] feng-tao commented on issue #6219: Dags filter by owner in RBAC

2019-09-30 Thread GitBox
feng-tao commented on issue #6219: Dags filter by owner in RBAC URL: https://github.com/apache/airflow/pull/6219#issuecomment-536846276 I don't know why you need to manually assign, you could declare which role could access the DAG(check out this pr: https://github.com/apache/airflow/pull/

[GitHub] [airflow] makaraju commented on issue #6219: Dags filter by owner in RBAC

2019-09-30 Thread GitBox
makaraju commented on issue #6219: Dags filter by owner in RBAC URL: https://github.com/apache/airflow/pull/6219#issuecomment-536845079 @feng-tao I agree with that, but let me give you an example, for example you have 10,000 Dags are running in the cluster with multiple users and the users

[GitHub] [airflow] feng-tao commented on issue #6219: Dags filter by owner in RBAC

2019-09-30 Thread GitBox
feng-tao commented on issue #6219: Dags filter by owner in RBAC URL: https://github.com/apache/airflow/pull/6219#issuecomment-536842502 it filter all the DAGs that are viewable by the users through https://github.com/apache/airflow/blob/master/airflow/www/views.py#L231. ---

[GitHub] [airflow] feng-tao edited a comment on issue #6219: Dags filter by owner in RBAC

2019-09-30 Thread GitBox
feng-tao edited a comment on issue #6219: Dags filter by owner in RBAC URL: https://github.com/apache/airflow/pull/6219#issuecomment-536839678 Could you explain the intent behind the pr? If the user has the DAG role to view this DAG, he/she should be able to view the DAG even he/she is not

[GitHub] [airflow] feng-tao commented on issue #6219: Dags filter by owner in RBAC

2019-09-30 Thread GitBox
feng-tao commented on issue #6219: Dags filter by owner in RBAC URL: https://github.com/apache/airflow/pull/6219#issuecomment-536839678 can't understand the intent behind the pr. If the user has the DAG role to view this DAG, he/she should be able to view the DAG even he/she is not the own

[GitHub] [airflow] ldfreight commented on issue #3115: [AIRFLOW-2193] Add ROperator for using R

2019-09-30 Thread GitBox
ldfreight commented on issue #3115: [AIRFLOW-2193] Add ROperator for using R URL: https://github.com/apache/airflow/pull/3115#issuecomment-536836684 any update on this? Why is integrating R different from any other operator? ---

[GitHub] [airflow] ldfreight edited a comment on issue #3115: [AIRFLOW-2193] Add ROperator for using R

2019-09-30 Thread GitBox
ldfreight edited a comment on issue #3115: [AIRFLOW-2193] Add ROperator for using R URL: https://github.com/apache/airflow/pull/3115#issuecomment-536836684 any update on this? We are also interested in this feature. Why is integrating R different from any other operator?

[GitHub] [airflow] makaraju opened a new pull request #6219: Dags filter by owner in RBAC

2019-09-30 Thread GitBox
makaraju opened a new pull request #6219: Dags filter by owner in RBAC URL: https://github.com/apache/airflow/pull/6219 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow Jira](https://issues.apache.org/jira/browse/AIRFLOW/) iss

[jira] [Created] (AIRFLOW-5577) Dags Filter_by_owner is missing in RBAC

2019-09-30 Thread Hari (Jira)
Hari created AIRFLOW-5577: - Summary: Dags Filter_by_owner is missing in RBAC Key: AIRFLOW-5577 URL: https://issues.apache.org/jira/browse/AIRFLOW-5577 Project: Apache Airflow Issue Type: Bug

[jira] [Updated] (AIRFLOW-5576) relation "variable" does not exist - psycopg2 - DagBag import

2019-09-30 Thread Darren Weber (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Darren Weber updated AIRFLOW-5576: -- Description: While loading dags during a db-reset, before creating any DAG, some code attemp

[jira] [Updated] (AIRFLOW-5576) relation "variable" does not exist - psycopg2 - DagBag import

2019-09-30 Thread Darren Weber (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Darren Weber updated AIRFLOW-5576: -- Description: While loading dags during a db-reset, before creating any DAG, some code attemp

[jira] [Updated] (AIRFLOW-5576) relation "variable" does not exist - psycopg2 - DagBag import

2019-09-30 Thread Darren Weber (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Darren Weber updated AIRFLOW-5576: -- Description: While loading dags during a db-reset, before creating any DAG, some code attemp

[jira] [Updated] (AIRFLOW-5576) relation "variable" does not exist - psycopg2 - DagBag import

2019-09-30 Thread Darren Weber (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Darren Weber updated AIRFLOW-5576: -- Description: While loading dags during a db-reset, before creating any DAG, some code attemp

[jira] [Created] (AIRFLOW-5576) relation "variable" does not exist - psycopg2 - DagBag import

2019-09-30 Thread Darren Weber (Jira)
Darren Weber created AIRFLOW-5576: - Summary: relation "variable" does not exist - psycopg2 - DagBag import Key: AIRFLOW-5576 URL: https://issues.apache.org/jira/browse/AIRFLOW-5576 Project: Apache Air

[GitHub] [airflow] bolkedebruin opened a new pull request #4507: [AIRFLOW-3391] Upgrade Pendulum to latest version

2019-09-30 Thread GitBox
bolkedebruin opened a new pull request #4507: [AIRFLOW-3391] Upgrade Pendulum to latest version URL: https://github.com/apache/airflow/pull/4507 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow Jira](https://issues.apache.org

[GitHub] [airflow] feng-tao commented on issue #4507: [AIRFLOW-3391] Upgrade Pendulum to latest version

2019-09-30 Thread GitBox
feng-tao commented on issue #4507: [AIRFLOW-3391] Upgrade Pendulum to latest version URL: https://github.com/apache/airflow/pull/4507#issuecomment-536812789 cc @bolkedebruin This is an automated message from the Apache Git S

[jira] [Commented] (AIRFLOW-3391) Upgrade pendulum to latest major version

2019-09-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941437#comment-16941437 ] ASF GitHub Bot commented on AIRFLOW-3391: - bolkedebruin commented on pull reque

[GitHub] [airflow] pabloem commented on issue #6218: [AIRFLOW-5574] Fix Google Analytics script loading

2019-09-30 Thread GitBox
pabloem commented on issue #6218: [AIRFLOW-5574] Fix Google Analytics script loading URL: https://github.com/apache/airflow/pull/6218#issuecomment-536807916 Thanks. This seems reasonable to me. I'll let @ashb and @aijamalnk do their own review and see what they think : ) -

[GitHub] [airflow] dongli commented on issue #4507: [AIRFLOW-3391] Upgrade Pendulum to latest version

2019-09-30 Thread GitBox
dongli commented on issue #4507: [AIRFLOW-3391] Upgrade Pendulum to latest version URL: https://github.com/apache/airflow/pull/4507#issuecomment-536807333 We really need newer pendulum. This is an automated message from the A

[GitHub] [airflow] codecov-io edited a comment on issue #6218: [AIRFLOW-5574] Fix Google Analytics script loading

2019-09-30 Thread GitBox
codecov-io edited a comment on issue #6218: [AIRFLOW-5574] Fix Google Analytics script loading URL: https://github.com/apache/airflow/pull/6218#issuecomment-536768683 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6218?src=pr&el=h1) Report > Merging [#6218](https://codecov.io/gh

[GitHub] [airflow] mik-laj commented on issue #6218: [AIRFLOW-5574] Fix Google Analytics script loading

2019-09-30 Thread GitBox
mik-laj commented on issue #6218: [AIRFLOW-5574] Fix Google Analytics script loading URL: https://github.com/apache/airflow/pull/6218#issuecomment-536777332 the debugger does not work if you do not have open development tools. I deleted this line. -

[GitHub] [airflow] pabloem commented on issue #6218: [AIRFLOW-5574] Fix Google Analytics script loading

2019-09-30 Thread GitBox
pabloem commented on issue #6218: [AIRFLOW-5574] Fix Google Analytics script loading URL: https://github.com/apache/airflow/pull/6218#issuecomment-536772231 Aijamal asked me to take a look : ) - does the `debugger;` statement potentially stop processing? I was not familiar with it. -

[GitHub] [airflow] codecov-io edited a comment on issue #6218: [AIRFLOW-5574] Fix Google Analytics script loading

2019-09-30 Thread GitBox
codecov-io edited a comment on issue #6218: [AIRFLOW-5574] Fix Google Analytics script loading URL: https://github.com/apache/airflow/pull/6218#issuecomment-536768683 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6218?src=pr&el=h1) Report > Merging [#6218](https://codecov.io/gh

[GitHub] [airflow] codecov-io edited a comment on issue #6218: [AIRFLOW-5574] Fix Google Analytics script loading

2019-09-30 Thread GitBox
codecov-io edited a comment on issue #6218: [AIRFLOW-5574] Fix Google Analytics script loading URL: https://github.com/apache/airflow/pull/6218#issuecomment-536768683 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6218?src=pr&el=h1) Report > Merging [#6218](https://codecov.io/gh

[GitHub] [airflow] codecov-io commented on issue #6218: [AIRFLOW-5574] Fix Google Analytics script loading

2019-09-30 Thread GitBox
codecov-io commented on issue #6218: [AIRFLOW-5574] Fix Google Analytics script loading URL: https://github.com/apache/airflow/pull/6218#issuecomment-536768683 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6218?src=pr&el=h1) Report > Merging [#6218](https://codecov.io/gh/apache

[jira] [Commented] (AIRFLOW-5219) Alarm if the task is not executed within the expected time range.

2019-09-30 Thread t oo (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941354#comment-16941354 ] t oo commented on AIRFLOW-5219: --- Pr is unrelated [~jackjack10] > Alarm if the task is no

[jira] [Created] (AIRFLOW-5574) Google Analytics script could not be loaded

2019-09-30 Thread Kamil Bregula (Jira)
Kamil Bregula created AIRFLOW-5574: -- Summary: Google Analytics script could not be loaded Key: AIRFLOW-5574 URL: https://issues.apache.org/jira/browse/AIRFLOW-5574 Project: Apache Airflow Is

[jira] [Created] (AIRFLOW-5575) Cannot use the mark future success/failure feature in the UI

2019-09-30 Thread Christopher Hyatt (Jira)
Christopher Hyatt created AIRFLOW-5575: -- Summary: Cannot use the mark future success/failure feature in the UI Key: AIRFLOW-5575 URL: https://issues.apache.org/jira/browse/AIRFLOW-5575 Project: A

[jira] [Commented] (AIRFLOW-5574) Google Analytics script could not be loaded

2019-09-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941334#comment-16941334 ] ASF GitHub Bot commented on AIRFLOW-5574: - mik-laj commented on pull request #6

[GitHub] [airflow] mik-laj opened a new pull request #6218: [AIRFLOW-5574] Fix Google Analytics script loading

2019-09-30 Thread GitBox
mik-laj opened a new pull request #6218: [AIRFLOW-5574] Fix Google Analytics script loading URL: https://github.com/apache/airflow/pull/6218 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow Jira](https://issues.apache.org/jir

[jira] [Closed] (AIRFLOW-5054) Upgrading to 1.10.3 from 1.10

2019-09-30 Thread Christopher Hyatt (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christopher Hyatt closed AIRFLOW-5054. -- Resolution: Not A Bug > Upgrading to 1.10.3 from 1.10 >

[jira] [Commented] (AIRFLOW-5121) Normalize *_conn_id parameters

2019-09-30 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941291#comment-16941291 ] jack commented on AIRFLOW-5121: --- ho.. didn't notice subtasks are opened as we go.. I'm us

[jira] [Commented] (AIRFLOW-5121) Normalize *_conn_id parameters

2019-09-30 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941207#comment-16941207 ] jack commented on AIRFLOW-5121: --- [~kamil.bregula]  PR was merged. can Jira be closed? >

[GitHub] [airflow] mik-laj commented on a change in pull request #6180: [AIRFLOW-5549] Extended BQ GetDataOperator to handle query params

2019-09-30 Thread GitBox
mik-laj commented on a change in pull request #6180: [AIRFLOW-5549] Extended BQ GetDataOperator to handle query params URL: https://github.com/apache/airflow/pull/6180#discussion_r329719643 ## File path: UPDATING.md ## @@ -40,6 +40,29 @@ assists users migrating to a new ve

[jira] [Closed] (AIRFLOW-5114) TypeError when running S3ToGoogleCloudStorageTransferOperator or GoogleCloudStorageToGoogleCloudStorageTransferOperator with default arguments

2019-09-30 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula closed AIRFLOW-5114. -- Fix Version/s: 1.10.6 Resolution: Fixed > TypeError when running S3ToGoogleCloudStorag

[jira] [Commented] (AIRFLOW-5121) Normalize *_conn_id parameters

2019-09-30 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941224#comment-16941224 ] Kamil Bregula commented on AIRFLOW-5121: The work was only done for GCP. Other

[GitHub] [airflow] feng-tao commented on issue #6174: [AIRFLOW-5543] Fix tooltip disappears in tree and graph view

2019-09-30 Thread GitBox
feng-tao commented on issue #6174: [AIRFLOW-5543] Fix tooltip disappears in tree and graph view URL: https://github.com/apache/airflow/pull/6174#issuecomment-536684174 @KevinYang21 that's great, sent you an email :) This is a

[jira] [Commented] (AIRFLOW-5114) TypeError when running S3ToGoogleCloudStorageTransferOperator or GoogleCloudStorageToGoogleCloudStorageTransferOperator with default arguments

2019-09-30 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941214#comment-16941214 ] jack commented on AIRFLOW-5114: --- [~kamil.bregula]PR was merged. Jira can be closed > Typ

[jira] [Commented] (AIRFLOW-5118) Airflow DataprocClusterCreateOperator does not currently support setting optional components

2019-09-30 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941208#comment-16941208 ] jack commented on AIRFLOW-5118: --- PR was merged. Jira can be closed > Airflow DataprocClu

[GitHub] [airflow] KevinYang21 commented on issue #6174: [AIRFLOW-5543] Fix tooltip disappears in tree and graph view

2019-09-30 Thread GitBox
KevinYang21 commented on issue #6174: [AIRFLOW-5543] Fix tooltip disappears in tree and graph view URL: https://github.com/apache/airflow/pull/6174#issuecomment-536681119 Hi @ashb, does @pingzh's recent change look good to you? Wanna make sure you're good with it before I merge it 🙏

[jira] [Commented] (AIRFLOW-5222) Dag run status is wrongly set to SUCCESS

2019-09-30 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941202#comment-16941202 ] jack commented on AIRFLOW-5222: --- I think the DAG state is determent by the last task stat

[jira] [Commented] (AIRFLOW-5231) S3Hook delete fails with over 1000 keys

2019-09-30 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941199#comment-16941199 ] jack commented on AIRFLOW-5231: --- In luigi it was solved with loop deleting 1000 files eac

[GitHub] [airflow] milton0825 commented on issue #5498: [AIRFLOW-4509] SubDagOperator using scheduler instead of backfill

2019-09-30 Thread GitBox
milton0825 commented on issue #5498: [AIRFLOW-4509] SubDagOperator using scheduler instead of backfill URL: https://github.com/apache/airflow/pull/5498#issuecomment-536679117 @clacke sorry I was on vacation and was not able to reply (should have let you know).Let me know if you have a PR.

[jira] [Commented] (AIRFLOW-5471) Fix docstring in GcpTransferServiceOperationsListOperator

2019-09-30 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941194#comment-16941194 ] jack commented on AIRFLOW-5471: --- [~ash] also merged and Jira open > Fix docstring in Gcp

[jira] [Commented] (AIRFLOW-5484) PigCliHook has incorrect named parameter

2019-09-30 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941195#comment-16941195 ] jack commented on AIRFLOW-5484: --- [~ash] merged and Jira open > PigCliHook has incorrect

[GitHub] [airflow] codecov-io edited a comment on issue #6180: [AIRFLOW-5549] Extended BQ GetDataOperator to handle query params

2019-09-30 Thread GitBox
codecov-io edited a comment on issue #6180: [AIRFLOW-5549] Extended BQ GetDataOperator to handle query params URL: https://github.com/apache/airflow/pull/6180#issuecomment-536591424 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6180?src=pr&el=h1) Report > Merging [#6180](https:

[GitHub] [airflow] codecov-io edited a comment on issue #6180: [AIRFLOW-5549] Extended BQ GetDataOperator to handle query params

2019-09-30 Thread GitBox
codecov-io edited a comment on issue #6180: [AIRFLOW-5549] Extended BQ GetDataOperator to handle query params URL: https://github.com/apache/airflow/pull/6180#issuecomment-536591424 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6180?src=pr&el=h1) Report > Merging [#6180](https:

[GitHub] [airflow] codecov-io edited a comment on issue #6180: [AIRFLOW-5549] Extended BQ GetDataOperator to handle query params

2019-09-30 Thread GitBox
codecov-io edited a comment on issue #6180: [AIRFLOW-5549] Extended BQ GetDataOperator to handle query params URL: https://github.com/apache/airflow/pull/6180#issuecomment-536591424 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6180?src=pr&el=h1) Report > Merging [#6180](https:

[jira] [Commented] (AIRFLOW-5487) airflow/utils/strings.py: Fix unused warning variable

2019-09-30 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941179#comment-16941179 ] jack commented on AIRFLOW-5487: --- [~ash] PR was merged Jira is still open > airflow/utils

[jira] [Commented] (AIRFLOW-5490) security.py: Fix incorrect None comparison

2019-09-30 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941178#comment-16941178 ] jack commented on AIRFLOW-5490: --- [~ash] PR was merged. Jira can be closed > security.py:

[GitHub] [airflow] mik-laj commented on a change in pull request #6180: [AIRFLOW-5549] Extended BQ GetDataOperator to handle query params

2019-09-30 Thread GitBox
mik-laj commented on a change in pull request #6180: [AIRFLOW-5549] Extended BQ GetDataOperator to handle query params URL: https://github.com/apache/airflow/pull/6180#discussion_r329704187 ## File path: airflow/gcp/operators/bigquery.py ## @@ -242,9 +252,14 @@ class BigQu

[jira] [Commented] (AIRFLOW-5568) Add Hook / Operators for GCP Healthcare API

2019-09-30 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941171#comment-16941171 ] jack commented on AIRFLOW-5568: --- Can you please add also GCP component? > Add Hook / Ope

[jira] [Commented] (AIRFLOW-5524) Airflow Mark Success tasks in GUI uses values from Clear

2019-09-30 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941176#comment-16941176 ] jack commented on AIRFLOW-5524: --- Which UI are u using? (RBAC or regular one?) > Airflow

[jira] [Commented] (AIRFLOW-5541) Exclude example tags from coverage

2019-09-30 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941175#comment-16941175 ] jack commented on AIRFLOW-5541: --- [~Urbaszek] can you close this? was covered in another p

[jira] [Created] (AIRFLOW-5573) Explain/Improve Default Logging Behaviour

2019-09-30 Thread Raphael Dumas (Jira)
Raphael Dumas created AIRFLOW-5573: -- Summary: Explain/Improve Default Logging Behaviour Key: AIRFLOW-5573 URL: https://issues.apache.org/jira/browse/AIRFLOW-5573 Project: Apache Airflow Issu

[jira] [Commented] (AIRFLOW-5566) Invalid deprecation warning for airflow home specification within config file

2019-09-30 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941172#comment-16941172 ] jack commented on AIRFLOW-5566: --- Can you PR a fix? > Invalid deprecation warning for air

[GitHub] [airflow] mik-laj commented on a change in pull request #6180: [AIRFLOW-5549] Extended BQ GetDataOperator to handle query params

2019-09-30 Thread GitBox
mik-laj commented on a change in pull request #6180: [AIRFLOW-5549] Extended BQ GetDataOperator to handle query params URL: https://github.com/apache/airflow/pull/6180#discussion_r329700323 ## File path: airflow/gcp/operators/bigquery.py ## @@ -242,9 +245,14 @@ class BigQu

[jira] [Commented] (AIRFLOW-1940) s3_file_transform_operator does not work with boto3

2019-09-30 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-1940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941169#comment-16941169 ] jack commented on AIRFLOW-1940: --- [~ash] can this be closed? > s3_file_transform_operator

[jira] [Commented] (AIRFLOW-2819) Clarify the Timezone support for Cron schedules

2019-09-30 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941166#comment-16941166 ] jack commented on AIRFLOW-2819: --- [~akkidx] You need to specify timezone aware DAG with pe

[jira] [Commented] (AIRFLOW-3539) Error Importing sub-dag (Webserver module load fail, scheduler works fine)

2019-09-30 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941163#comment-16941163 ] jack commented on AIRFLOW-3539: --- Is this a bug in Airflow core or in docker-airflow [htt

[jira] [Commented] (AIRFLOW-5219) Alarm if the task is not executed within the expected time range.

2019-09-30 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941160#comment-16941160 ] jack commented on AIRFLOW-5219: --- [~ash] This can be closed. PR is merged > Alarm if the

[GitHub] [airflow] mohannadbanayosi commented on issue #6180: [AIRFLOW-5549] Extended BQ GetDataOperator to handle query params

2019-09-30 Thread GitBox
mohannadbanayosi commented on issue #6180: [AIRFLOW-5549] Extended BQ GetDataOperator to handle query params URL: https://github.com/apache/airflow/pull/6180#issuecomment-536650667 Makes sense, added. This is an automated mes

[GitHub] [airflow] mik-laj merged pull request #6215: [AIRFLOW-XXX] Update airflow commands

2019-09-30 Thread GitBox
mik-laj merged pull request #6215: [AIRFLOW-XXX] Update airflow commands URL: https://github.com/apache/airflow/pull/6215 This is an automated message from the Apache Git Service. To respond to the message, please log on to G

[GitHub] [airflow] potiuk merged pull request #6214: [AIRFLOW-XXX] Improve link to plugin page

2019-09-30 Thread GitBox
potiuk merged pull request #6214: [AIRFLOW-XXX] Improve link to plugin page URL: https://github.com/apache/airflow/pull/6214 This is an automated message from the Apache Git Service. To respond to the message, please log on t

[jira] [Commented] (AIRFLOW-5563) Airflow Webserver can crashes for a DAG Issues

2019-09-30 Thread Jarek Potiuk (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941100#comment-16941100 ] Jarek Potiuk commented on AIRFLOW-5563: --- There is a work in progress related to i

[GitHub] [airflow] ashb commented on issue #6195: [AIRFLOW-5560] Allow no confirmation on reset dags

2019-09-30 Thread GitBox
ashb commented on issue #6195: [AIRFLOW-5560] Allow no confirmation on reset dags URL: https://github.com/apache/airflow/pull/6195#issuecomment-536632267 Oh and `--yes` is what we already use for no-confirm on `db reset`/`resetdb` ---

[jira] [Resolved] (AIRFLOW-5563) Airflow Webserver can crashes for a DAG Issues

2019-09-30 Thread Jarek Potiuk (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk resolved AIRFLOW-5563. --- Resolution: Duplicate > Airflow Webserver can crashes for a DAG Issues > --

[jira] [Commented] (AIRFLOW-910) Parallelize dag runs in backfills

2019-09-30 Thread Alexey Bandurkin (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941080#comment-16941080 ] Alexey Bandurkin commented on AIRFLOW-910: -- Looks like this happened on 1.10.5

[jira] [Resolved] (AIRFLOW-3965) GoogleCloudStorageToBigQueryOperator has no "location" parameter

2019-09-30 Thread Jarek Potiuk (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk resolved AIRFLOW-3965. --- Resolution: Duplicate > GoogleCloudStorageToBigQueryOperator has no "location" parameter >

[GitHub] [airflow] potiuk edited a comment on issue #4785: [AIRFLOW-3965] Fixing GoogleCloudStorageToBigQueryOperator failing for jobs outside US and EU

2019-09-30 Thread GitBox
potiuk edited a comment on issue #4785: [AIRFLOW-3965] Fixing GoogleCloudStorageToBigQueryOperator failing for jobs outside US and EU URL: https://github.com/apache/airflow/pull/4785#issuecomment-536615489 It's been already merged in a set of other PRs related to BigQuery.

[jira] [Commented] (AIRFLOW-3965) GoogleCloudStorageToBigQueryOperator has no "location" parameter

2019-09-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941061#comment-16941061 ] ASF GitHub Bot commented on AIRFLOW-3965: - potiuk commented on pull request #47

[GitHub] [airflow] potiuk closed pull request #4785: [AIRFLOW-3965] Fixing GoogleCloudStorageToBigQueryOperator failing for jobs outside US and EU

2019-09-30 Thread GitBox
potiuk closed pull request #4785: [AIRFLOW-3965] Fixing GoogleCloudStorageToBigQueryOperator failing for jobs outside US and EU URL: https://github.com/apache/airflow/pull/4785 This is an automated message from the Apache Gi

[GitHub] [airflow] potiuk commented on issue #4785: [AIRFLOW-3965] Fixing GoogleCloudStorageToBigQueryOperator failing for jobs outside US and EU

2019-09-30 Thread GitBox
potiuk commented on issue #4785: [AIRFLOW-3965] Fixing GoogleCloudStorageToBigQueryOperator failing for jobs outside US and EU URL: https://github.com/apache/airflow/pull/4785#issuecomment-536615489 It's been already merged in #4448

[GitHub] [airflow] feluelle commented on issue #6180: [AIRFLOW-5549] Extended BQ GetDataOperator to handle query params

2019-09-30 Thread GitBox
feluelle commented on issue #6180: [AIRFLOW-5549] Extended BQ GetDataOperator to handle query params URL: https://github.com/apache/airflow/pull/6180#issuecomment-536613568 > Are you talking about the return type of get_tabledata function in hooks/bigquery.py? It was dict which is correct,

[jira] [Commented] (AIRFLOW-5408) Fix env variable name in Kubernetes template

2019-09-30 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941040#comment-16941040 ] ASF subversion and git services commented on AIRFLOW-5408: -- Co

[GitHub] [airflow] mohannadbanayosi commented on issue #6180: [AIRFLOW-5549] Extended BQ GetDataOperator to handle query params

2019-09-30 Thread GitBox
mohannadbanayosi commented on issue #6180: [AIRFLOW-5549] Extended BQ GetDataOperator to handle query params URL: https://github.com/apache/airflow/pull/6180#issuecomment-536605327 Thank you! 😊 Are you talking about the return type of `get_tabledata` function in `hooks/bigquery.py`

[jira] [Commented] (AIRFLOW-5408) Fix env variable name in Kubernetes template

2019-09-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941039#comment-16941039 ] ASF GitHub Bot commented on AIRFLOW-5408: - potiuk commented on pull request #60

[GitHub] [airflow] potiuk merged pull request #6016: [AIRFLOW-5408] Fix env variable name in Kubernetes template

2019-09-30 Thread GitBox
potiuk merged pull request #6016: [AIRFLOW-5408] Fix env variable name in Kubernetes template URL: https://github.com/apache/airflow/pull/6016 This is an automated message from the Apache Git Service. To respond to the messa

[GitHub] [airflow] feluelle edited a comment on issue #6180: [AIRFLOW-5549] Extended BQ GetDataOperator to handle query params

2019-09-30 Thread GitBox
feluelle edited a comment on issue #6180: [AIRFLOW-5549] Extended BQ GetDataOperator to handle query params URL: https://github.com/apache/airflow/pull/6180#issuecomment-536592512 I really like the new tests ❤️ (I think you could also have put both assertions into one test - but it's fine

[GitHub] [airflow] ashb commented on issue #6216: [AIRFLOW-XXX] Update Alembic autogenerator to pass pylint

2019-09-30 Thread GitBox
ashb commented on issue #6216: [AIRFLOW-XXX] Update Alembic autogenerator to pass pylint URL: https://github.com/apache/airflow/pull/6216#issuecomment-536593405 > Nit: Should we split it to two separate commits? Filtering out of Flask Appbuilder tables should be separate commit I think.

[GitHub] [airflow] ashb commented on issue #6182: [AIRFLOW-3877] -Changing full file path in scheduler

2019-09-30 Thread GitBox
ashb commented on issue #6182: [AIRFLOW-3877] -Changing full file path in scheduler URL: https://github.com/apache/airflow/pull/6182#issuecomment-536593070 If the existing tests pass before and still pass after (which they did) then your change is untested. ---

[GitHub] [airflow] feluelle commented on issue #6180: [AIRFLOW-5549] Extended BQ GetDataOperator to handle query params

2019-09-30 Thread GitBox
feluelle commented on issue #6180: [AIRFLOW-5549] Extended BQ GetDataOperator to handle query params URL: https://github.com/apache/airflow/pull/6180#issuecomment-536592512 I really like the new tests ❤️ After you have made the changes to the UPDATING.md. I would like to have @mik-

[GitHub] [airflow] codecov-io commented on issue #6180: [AIRFLOW-5549] Extended BQ GetDataOperator to handle query params

2019-09-30 Thread GitBox
codecov-io commented on issue #6180: [AIRFLOW-5549] Extended BQ GetDataOperator to handle query params URL: https://github.com/apache/airflow/pull/6180#issuecomment-536591424 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6180?src=pr&el=h1) Report > Merging [#6180](https://codec

[GitHub] [airflow] codecov-io edited a comment on issue #6180: [AIRFLOW-5549] Extended BQ GetDataOperator to handle query params

2019-09-30 Thread GitBox
codecov-io edited a comment on issue #6180: [AIRFLOW-5549] Extended BQ GetDataOperator to handle query params URL: https://github.com/apache/airflow/pull/6180#issuecomment-536591424 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6180?src=pr&el=h1) Report > Merging [#6180](https:

[GitHub] [airflow] codecov-io edited a comment on issue #6096: [AIRFLOW-5477] Rewrite Google PubSub Hook to Google Cloud Python

2019-09-30 Thread GitBox
codecov-io edited a comment on issue #6096: [AIRFLOW-5477] Rewrite Google PubSub Hook to Google Cloud Python URL: https://github.com/apache/airflow/pull/6096#issuecomment-531411977 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6096?src=pr&el=h1) Report > Merging [#6096](https:/

[GitHub] [airflow] mohannadbanayosi commented on a change in pull request #6180: [AIRFLOW-5549] Extended BQ GetDataOperator to handle query params

2019-09-30 Thread GitBox
mohannadbanayosi commented on a change in pull request #6180: [AIRFLOW-5549] Extended BQ GetDataOperator to handle query params URL: https://github.com/apache/airflow/pull/6180#discussion_r329593078 ## File path: airflow/gcp/operators/bigquery.py ## @@ -217,7 +217,17 @@ cl

[GitHub] [airflow] mohannadbanayosi commented on a change in pull request #6180: [AIRFLOW-5549] Extended BQ GetDataOperator to handle query params

2019-09-30 Thread GitBox
mohannadbanayosi commented on a change in pull request #6180: [AIRFLOW-5549] Extended BQ GetDataOperator to handle query params URL: https://github.com/apache/airflow/pull/6180#discussion_r329592909 ## File path: airflow/gcp/operators/bigquery.py ## @@ -285,37 +299,45 @@ d

[GitHub] [airflow] feluelle commented on issue #6213: [AIRFLOW-XXX] Extract operators and hooks to separate page

2019-09-30 Thread GitBox
feluelle commented on issue #6213: [AIRFLOW-XXX] Extract operators and hooks to separate page URL: https://github.com/apache/airflow/pull/6213#issuecomment-536561641 > With those changes where we restructure it and separate out types of integration, it is much easier to navigate with the c

[GitHub] [airflow] codecov-io edited a comment on issue #6169: [AIRFLOW-4970][Don't merge] Add Google Campaign Manager integration

2019-09-30 Thread GitBox
codecov-io edited a comment on issue #6169: [AIRFLOW-4970][Don't merge] Add Google Campaign Manager integration URL: https://github.com/apache/airflow/pull/6169#issuecomment-534125545 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6169?src=pr&el=h1) Report > Merging [#6169](http

[GitHub] [airflow] yuqian90 commented on a change in pull request #5189: [AIRFLOW-4415] skip status propagation

2019-09-30 Thread GitBox
yuqian90 commented on a change in pull request #5189: [AIRFLOW-4415] skip status propagation URL: https://github.com/apache/airflow/pull/5189#discussion_r329533503 ## File path: airflow/models/baseoperator.py ## @@ -264,7 +264,7 @@ def __init__( on_failure_callbac

[GitHub] [airflow] potiuk commented on issue #6213: [AIRFLOW-XXX] Extract operators and hooks to separate page

2019-09-30 Thread GitBox
potiuk commented on issue #6213: [AIRFLOW-XXX] Extract operators and hooks to separate page URL: https://github.com/apache/airflow/pull/6213#issuecomment-536556186 I agree with @mik-laj, Integration.rst was really "a bag of everything" (see it [here](https://airflow.readthedocs.io/en/late

[GitHub] [airflow] mik-laj edited a comment on issue #6213: [AIRFLOW-XXX] Extract operators and hooks to separate page

2019-09-30 Thread GitBox
mik-laj edited a comment on issue #6213: [AIRFLOW-XXX] Extract operators and hooks to separate page URL: https://github.com/apache/airflow/pull/6213#issuecomment-536548349 To be precise, the documentation was versioned, but links to old versions were not made public. For example: ht

[GitHub] [airflow] mik-laj commented on issue #6213: [AIRFLOW-XXX] Extract operators and hooks to separate page

2019-09-30 Thread GitBox
mik-laj commented on issue #6213: [AIRFLOW-XXX] Extract operators and hooks to separate page URL: https://github.com/apache/airflow/pull/6213#issuecomment-536548349 To be precise, the documentation was versioned, but links to old versions were not made public. http://airflow.apache.org/

[GitHub] [airflow] codecov-io edited a comment on issue #6217: [AIRFLOW-5572] Clearing Task Instances with reschedule mode does not clear reschedules during up_for_reschedule

2019-09-30 Thread GitBox
codecov-io edited a comment on issue #6217: [AIRFLOW-5572] Clearing Task Instances with reschedule mode does not clear reschedules during up_for_reschedule URL: https://github.com/apache/airflow/pull/6217#issuecomment-536547844 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6217?src

[GitHub] [airflow] mik-laj commented on issue #6213: [AIRFLOW-XXX] Extract operators and hooks to separate page

2019-09-30 Thread GitBox
mik-laj commented on issue #6213: [AIRFLOW-XXX] Extract operators and hooks to separate page URL: https://github.com/apache/airflow/pull/6213#issuecomment-536547830 The user will read the document and find a link to the second page in it. This is not very important change, because u

[GitHub] [airflow] codecov-io commented on issue #6217: [AIRFLOW-5572] Clearing Task Instances with reschedule mode does not clear reschedules during up_for_reschedule

2019-09-30 Thread GitBox
codecov-io commented on issue #6217: [AIRFLOW-5572] Clearing Task Instances with reschedule mode does not clear reschedules during up_for_reschedule URL: https://github.com/apache/airflow/pull/6217#issuecomment-536547844 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6217?src=pr&el=h

  1   2   >