[jira] [Commented] (AIRFLOW-6981) Move Google Cloud Build from Discovery API to Python Library

2020-06-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17130084#comment-17130084 ] ASF GitHub Bot commented on AIRFLOW-6981: - ryanyuan commented on pull request #8575: URL:

[GitHub] [airflow] ryanyuan commented on pull request #8575: [AIRFLOW-6981] Move Google Cloud Build from Discovery API to Python Library

2020-06-09 Thread GitBox
ryanyuan commented on pull request #8575: URL: https://github.com/apache/airflow/pull/8575#issuecomment-641730079 Thanks @mik-laj, I've applied your patch. For the exception you had, it seems you ran the example dag but it failed in the midway and you re-ran it so that it said the

[GitHub] [airflow] shanit-saha commented on issue #9197: dagrun_operator in Airflow Version 1.10.10 ERRORS _run_raw_task result = task_copy.execute(context=context)

2020-06-09 Thread GitBox
shanit-saha commented on issue #9197: URL: https://github.com/apache/airflow/issues/9197#issuecomment-641702409 Please advise as to what could be the work around. The DAG code perfectly works fine in our production with `Airflow1.10.2` , until now that when we are in the urgent need to

[GitHub] [airflow] syucream commented on pull request #8550: Add DataflowStartFlexTemplateOperator

2020-06-09 Thread GitBox
syucream commented on pull request #8550: URL: https://github.com/apache/airflow/pull/8550#issuecomment-641689350 What's the current status? Do you have any progress? I want this patch, Can I help you anything? @mik-laj

[airflow] tag nightly-master updated (7fd3695 -> 82c8343)

2020-06-09 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to tag nightly-master in repository https://gitbox.apache.org/repos/asf/airflow.git. *** WARNING: tag nightly-master was modified! *** from 7fd3695 (commit) to 82c8343 (commit) from

[GitHub] [airflow] thesuperzapper commented on pull request #9133: Include missing RBAC roles

2020-06-09 Thread GitBox
thesuperzapper commented on pull request #9133: URL: https://github.com/apache/airflow/pull/9133#issuecomment-641659270 @ashb, I have made the change requested, is this PR now acceptable? This is an automated message from

[GitHub] [airflow] mik-laj commented on pull request #9170: [WIP] Read only endpoint for XCom #8134

2020-06-09 Thread GitBox
mik-laj commented on pull request #9170: URL: https://github.com/apache/airflow/pull/9170#issuecomment-641653054 @ashb It looks good, but I don't know if it suits our code style. We use explicit joins instead of relying on ORM generated more often. Generating joints by ORM together with

[GitHub] [airflow] casassg commented on issue #8058: [AIP-31] Add lazy way to get Airflow context from a wrapped function

2020-06-09 Thread GitBox
casassg commented on issue #8058: URL: https://github.com/apache/airflow/issues/8058#issuecomment-641650049 Any updates on this? This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [airflow] kaxil commented on pull request #8186: Add support for AWS Secrets Manager as Secrets Backend

2020-06-09 Thread GitBox
kaxil commented on pull request #8186: URL: https://github.com/apache/airflow/pull/8186#issuecomment-641627856 > @kaxil Just curious if the choice to not support encrypted parameters was just to simplify the implementation or if there's another motivation? Yes it was just to

[GitHub] [airflow] robmoore commented on pull request #8186: Add support for AWS Secrets Manager as Secrets Backend

2020-06-09 Thread GitBox
robmoore commented on pull request #8186: URL: https://github.com/apache/airflow/pull/8186#issuecomment-641627087 @kaxil Just curious if the choice to not support encrypted parameters was just to simplify the implementation or if there's another motivation?

[GitHub] [airflow] casassg commented on a change in pull request #8962: [AIRFLOW-8057] [AIP-31] Add @task decorator

2020-06-09 Thread GitBox
casassg commented on a change in pull request #8962: URL: https://github.com/apache/airflow/pull/8962#discussion_r437767677 ## File path: airflow/operators/python.py ## @@ -145,6 +149,131 @@ def execute_callable(self): return self.python_callable(*self.op_args,

[GitHub] [airflow] jkbngl closed pull request #9201: Added MSSql To Oracle Transfer Operator

2020-06-09 Thread GitBox
jkbngl closed pull request #9201: URL: https://github.com/apache/airflow/pull/9201 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Commented] (AIRFLOW-3391) Upgrade pendulum to latest major version

2020-06-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129838#comment-17129838 ] ASF GitHub Bot commented on AIRFLOW-3391: - crhyatt closed pull request #7626: URL:

[jira] [Commented] (AIRFLOW-3391) Upgrade pendulum to latest major version

2020-06-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129839#comment-17129839 ] ASF GitHub Bot commented on AIRFLOW-3391: - crhyatt commented on pull request #7626: URL:

[GitHub] [airflow] crhyatt closed pull request #7626: [AIRFLOW-3391] Upgrade pendulum to latest major version

2020-06-09 Thread GitBox
crhyatt closed pull request #7626: URL: https://github.com/apache/airflow/pull/7626 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] crhyatt commented on pull request #7626: [AIRFLOW-3391] Upgrade pendulum to latest major version

2020-06-09 Thread GitBox
crhyatt commented on pull request #7626: URL: https://github.com/apache/airflow/pull/7626#issuecomment-641607055 @ashb I messed something up with a merge. I am going to close this PR and just use https://github.com/apache/airflow/pull/9184 .

[jira] [Commented] (AIRFLOW-3973) `airflow initdb` logs errors when `Variable` is used in DAGs and Postgres is used for the internal database

2020-06-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129818#comment-17129818 ] ASF GitHub Bot commented on AIRFLOW-3973: - eeshugerman commented on pull request #9182: URL:

[GitHub] [airflow] eeshugerman commented on pull request #9182: [AIRFLOW-3973] Commit after each alembic migration

2020-06-09 Thread GitBox
eeshugerman commented on pull request #9182: URL: https://github.com/apache/airflow/pull/9182#issuecomment-641595881 :+1: I see, thanks, I was wondering how that works. This is an automated message from the Apache Git

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #9201: Added MSSql To Oracle Transfer Operator

2020-06-09 Thread GitBox
boring-cyborg[bot] commented on pull request #9201: URL: https://github.com/apache/airflow/pull/9201#issuecomment-641592925 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our

[GitHub] [airflow] jkbngl opened a new pull request #9201: Added MSSql To Oracle Transfer Operator

2020-06-09 Thread GitBox
jkbngl opened a new pull request #9201: URL: https://github.com/apache/airflow/pull/9201 --- Make sure to mark the boxes below before creating PR: [x] Added an Operator building on top of the OracleToOracleTransfer operator to extract data from a Microsoft SQL Database to an

[airflow] branch master updated (c18f4c0 -> 82c8343)

2020-06-09 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from c18f4c0 Fix typo in BREEZE.rst (#9199) add 82c8343 Support additional apt dependencies (#9189) No new

[GitHub] [airflow] potiuk merged pull request #9189: Support additional apt dependencies

2020-06-09 Thread GitBox
potiuk merged pull request #9189: URL: https://github.com/apache/airflow/pull/9189 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Commented] (AIRFLOW-3391) Upgrade pendulum to latest major version

2020-06-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129771#comment-17129771 ] ASF GitHub Bot commented on AIRFLOW-3391: - ashb commented on a change in pull request #7626:

[GitHub] [airflow] ashb commented on a change in pull request #7626: [AIRFLOW-3391] Upgrade pendulum to latest major version

2020-06-09 Thread GitBox
ashb commented on a change in pull request #7626: URL: https://github.com/apache/airflow/pull/7626#discussion_r437697053 ## File path: tests/www/test_views.py ## @@ -883,7 +882,7 @@ def test_run_with_not_runnable_states(self, get_default_executor_function):

[GitHub] [airflow] ashb commented on pull request #9195: Update pre-commit-hooks repo version

2020-06-09 Thread GitBox
ashb commented on pull request #9195: URL: https://github.com/apache/airflow/pull/9195#issuecomment-641549005 isort seems to be wreaking havok with the UPDATING.md -- we might have to not pick the latest version (or else turn it tune it down): ```diff diff --git

[jira] [Commented] (AIRFLOW-3973) `airflow initdb` logs errors when `Variable` is used in DAGs and Postgres is used for the internal database

2020-06-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129761#comment-17129761 ] ASF GitHub Bot commented on AIRFLOW-3973: - ashb edited a comment on pull request #9182: URL:

[GitHub] [airflow] ashb edited a comment on pull request #9182: [AIRFLOW-3973] Commit after each alembic migration

2020-06-09 Thread GitBox
ashb edited a comment on pull request #9182: URL: https://github.com/apache/airflow/pull/9182#issuecomment-641543813 Ah, we don't need a PR in this case -- just marking the original PR for the milestone 1.10.11 is enough and we'd cherry pick it. Since you've got it opened I'll merge

[jira] [Commented] (AIRFLOW-3973) `airflow initdb` logs errors when `Variable` is used in DAGs and Postgres is used for the internal database

2020-06-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129758#comment-17129758 ] ASF GitHub Bot commented on AIRFLOW-3973: - ashb merged pull request #9182: URL:

[jira] [Commented] (AIRFLOW-3973) `airflow initdb` logs errors when `Variable` is used in DAGs and Postgres is used for the internal database

2020-06-09 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129759#comment-17129759 ] ASF subversion and git services commented on AIRFLOW-3973: -- Commit

[GitHub] [airflow] ashb merged pull request #9182: [AIRFLOW-3973] Commit after each alembic migration

2020-06-09 Thread GitBox
ashb merged pull request #9182: URL: https://github.com/apache/airflow/pull/9182 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[airflow] branch v1-10-stable updated: [AIRFLOW-3973] Commit after each alembic migration (#4797)

2020-06-09 Thread ash
This is an automated email from the ASF dual-hosted git repository. ash pushed a commit to branch v1-10-stable in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/v1-10-stable by this push: new 5b48a53 [AIRFLOW-3973] Commit after

[jira] [Commented] (AIRFLOW-3973) `airflow initdb` logs errors when `Variable` is used in DAGs and Postgres is used for the internal database

2020-06-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129757#comment-17129757 ] ASF GitHub Bot commented on AIRFLOW-3973: - ashb commented on pull request #9182: URL:

[GitHub] [airflow] ashb commented on pull request #9182: [AIRFLOW-3973] Commit after each alembic migration

2020-06-09 Thread GitBox
ashb commented on pull request #9182: URL: https://github.com/apache/airflow/pull/9182#issuecomment-641543813 Ah, we don't need a PR in this case -- just marking the original PR for the milestone 1.10.11 is enough and we'd cherry pick it. Since you've got it opened I'll merge this

[GitHub] [airflow] CodingJonas commented on pull request #8617: Extend docker swarm operator configuration

2020-06-09 Thread GitBox
CodingJonas commented on pull request #8617: URL: https://github.com/apache/airflow/pull/8617#issuecomment-641541320 Yes, I guess I should have structured this PR more in the first place, I see that I split the commit into better reviewable commits in the next days!

[GitHub] [airflow] CodingJonas commented on a change in pull request #8617: Extend docker swarm operator configuration

2020-06-09 Thread GitBox
CodingJonas commented on a change in pull request #8617: URL: https://github.com/apache/airflow/pull/8617#discussion_r437686189 ## File path: airflow/providers/docker/operators/docker_swarm.py ## @@ -93,20 +95,37 @@ class DockerSwarmOperator(DockerOperator): Supported

[GitHub] [airflow] CodingJonas commented on a change in pull request #8617: Extend docker swarm operator configuration

2020-06-09 Thread GitBox
CodingJonas commented on a change in pull request #8617: URL: https://github.com/apache/airflow/pull/8617#discussion_r437686189 ## File path: airflow/providers/docker/operators/docker_swarm.py ## @@ -93,20 +95,37 @@ class DockerSwarmOperator(DockerOperator): Supported

[GitHub] [airflow] nullhack edited a comment on issue #9176: [Feature request] Add reverse run of DAGs

2020-06-09 Thread GitBox
nullhack edited a comment on issue #9176: URL: https://github.com/apache/airflow/issues/9176#issuecomment-641536838 > I think `back_run=True` can work only if `catchup=True` but `depends_on_past=False` > `catchup=False` means past runs are not necessary. > Can anyone correct me if I

[GitHub] [airflow] nullhack commented on issue #9176: [Feature request] Add reverse run of DAGs

2020-06-09 Thread GitBox
nullhack commented on issue #9176: URL: https://github.com/apache/airflow/issues/9176#issuecomment-641536838 > I think `back_run=True` can work only if `catchup=True` but `depends_on_past=False` > `catchup=False` means past runs are not necessary. > Can anyone correct me if I am

[GitHub] [airflow] eeshugerman commented on pull request #9182: [AIRFLOW-3973] Commit after each alembic migration

2020-06-09 Thread GitBox
eeshugerman commented on pull request #9182: URL: https://github.com/apache/airflow/pull/9182#issuecomment-641534402 This is already in `master`. I'm trying to backport to v1.10. Please see the discussion here: https://github.com/apache/airflow/pull/4797 (Sorry for the confusion, I

[jira] [Commented] (AIRFLOW-3973) `airflow initdb` logs errors when `Variable` is used in DAGs and Postgres is used for the internal database

2020-06-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129748#comment-17129748 ] ASF GitHub Bot commented on AIRFLOW-3973: - eeshugerman commented on pull request #9182: URL:

[airflow] branch v1-10-test updated: fixup! Kubernetes Cluster is started on host not in the container (#8265)

2020-06-09 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v1-10-test in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/v1-10-test by this push: new 782d916 fixup! Kubernetes Cluster is

[GitHub] [airflow] RachaelDS commented on a change in pull request #8954: Wait for pipeline state in Data Fusion operators

2020-06-09 Thread GitBox
RachaelDS commented on a change in pull request #8954: URL: https://github.com/apache/airflow/pull/8954#discussion_r437672204 ## File path: airflow/providers/google/cloud/hooks/datafusion.py ## @@ -386,15 +480,29 @@ def start_pipeline( pipeline_name,

[GitHub] [airflow] mik-laj opened a new issue #9200: CLI toolls wrapper doesn't support pipe

2020-06-09 Thread GitBox
mik-laj opened a new issue #9200: URL: https://github.com/apache/airflow/issues/9200 When I run the following command ussing native gcloud ``` Copying from ... / [1 files][0.0 B/0.0 B] Operation completed over 1 objects. ``` When I executed this command in Breeze.

[GitHub] [airflow] stale[bot] commented on pull request #8242: Jinjafy params arg in BaseOperator

2020-06-09 Thread GitBox
stale[bot] commented on pull request #8242: URL: https://github.com/apache/airflow/pull/8242#issuecomment-641514215 This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[jira] [Commented] (AIRFLOW-6981) Move Google Cloud Build from Discovery API to Python Library

2020-06-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129723#comment-17129723 ] ASF GitHub Bot commented on AIRFLOW-6981: - mik-laj commented on pull request #8575: URL:

[GitHub] [airflow] mik-laj commented on pull request #8575: [AIRFLOW-6981] Move Google Cloud Build from Discovery API to Python Library

2020-06-09 Thread GitBox
mik-laj commented on pull request #8575: URL: https://github.com/apache/airflow/pull/8575#issuecomment-641510720 I saw that a new DAG was not added to the system tests. I prepared change - https://termbin.com/7ezm To add to your branch, run the following command: ```bash curl

[GitHub] [airflow] potiuk commented on issue #9193: Breaks production Docker image: Celery 4.4.4 (known bug) lacks "future" module thus breaks airflow

2020-06-09 Thread GitBox
potiuk commented on issue #9193: URL: https://github.com/apache/airflow/issues/9193#issuecomment-641502284 Fixed in #9194 - the images should rebuild tonight (we have nightly builds) and they should contain celery 4.4.5

[GitHub] [airflow] potiuk closed issue #9193: Breaks production Docker image: Celery 4.4.4 (known bug) lacks "future" module thus breaks airflow

2020-06-09 Thread GitBox
potiuk closed issue #9193: URL: https://github.com/apache/airflow/issues/9193 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Commented] (AIRFLOW-3973) `airflow initdb` logs errors when `Variable` is used in DAGs and Postgres is used for the internal database

2020-06-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129699#comment-17129699 ] ASF GitHub Bot commented on AIRFLOW-3973: - ashb commented on pull request #9182: URL:

[jira] [Commented] (AIRFLOW-3973) `airflow initdb` logs errors when `Variable` is used in DAGs and Postgres is used for the internal database

2020-06-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129698#comment-17129698 ] ASF GitHub Bot commented on AIRFLOW-3973: - ashb closed pull request #9183: URL:

[jira] [Commented] (AIRFLOW-3973) `airflow initdb` logs errors when `Variable` is used in DAGs and Postgres is used for the internal database

2020-06-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129697#comment-17129697 ] ASF GitHub Bot commented on AIRFLOW-3973: - ashb commented on pull request #9183: URL:

[GitHub] [airflow] ashb commented on pull request #9182: [AIRFLOW-3973] Commit after each alembic migration

2020-06-09 Thread GitBox
ashb commented on pull request #9182: URL: https://github.com/apache/airflow/pull/9182#issuecomment-641497817 As mentioned in our other PR https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#airflow-git-branches -- this PR needs to target master, not v1-10-test/stable please.

[GitHub] [airflow] ashb commented on pull request #9183: [AIRFLOW-3973] Commit after each alembic migration

2020-06-09 Thread GitBox
ashb commented on pull request #9183: URL: https://github.com/apache/airflow/pull/9183#issuecomment-641497412 Duplicate of #9182 - please https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#airflow-git-branches

[GitHub] [airflow] ashb closed pull request #9183: [AIRFLOW-3973] Commit after each alembic migration

2020-06-09 Thread GitBox
ashb closed pull request #9183: URL: https://github.com/apache/airflow/pull/9183 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] Udit107710 commented on pull request #9199: Fixed typo

2020-06-09 Thread GitBox
Udit107710 commented on pull request #9199: URL: https://github.com/apache/airflow/pull/9199#issuecomment-641497300 Thanks @ashb ! This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [airflow] ashb merged pull request #9199: Fixed typo

2020-06-09 Thread GitBox
ashb merged pull request #9199: URL: https://github.com/apache/airflow/pull/9199 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[airflow] branch master updated (6d4972a -> c18f4c0)

2020-06-09 Thread ash
This is an automated email from the ASF dual-hosted git repository. ash pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 6d4972a Remove httplib2 from Google requirements (#9194) add c18f4c0 Fix typo in BREEZE.rst (#9199) No new

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #9199: Fixed typo

2020-06-09 Thread GitBox
boring-cyborg[bot] commented on pull request #9199: URL: https://github.com/apache/airflow/pull/9199#issuecomment-641496812 Awesome work, congrats on your first merged pull request! This is an automated message from the

[airflow] branch master updated: Remove httplib2 from Google requirements (#9194)

2020-06-09 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/master by this push: new 6d4972a Remove httplib2 from Google

[GitHub] [airflow] potiuk merged pull request #9194: Remove httplib2 from Google requirements

2020-06-09 Thread GitBox
potiuk merged pull request #9194: URL: https://github.com/apache/airflow/pull/9194 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #9199: Fixed typo

2020-06-09 Thread GitBox
boring-cyborg[bot] commented on pull request #9199: URL: https://github.com/apache/airflow/pull/9199#issuecomment-641490412 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our

[GitHub] [airflow] Udit107710 opened a new pull request #9199: Fixed typo

2020-06-09 Thread GitBox
Udit107710 opened a new pull request #9199: URL: https://github.com/apache/airflow/pull/9199 Changed 'y' to 'by' since it was incorrect. --- Make sure to mark the boxes below before creating PR: [x] - [x ] Description above provides context of the change - [ ] Unit tests

[GitHub] [airflow] swapniel99 commented on issue #9176: [Feature request] Add reverse run of DAGs

2020-06-09 Thread GitBox
swapniel99 commented on issue #9176: URL: https://github.com/apache/airflow/issues/9176#issuecomment-641485098 I think `back_run=True` can work only if `catchup=True` but `depends_on_past=False` catchup=False means past runs are not necessary. Can anyone correct me if I am wrong?

[GitHub] [airflow] swapniel99 edited a comment on issue #9176: [Feature request] Add reverse run of DAGs

2020-06-09 Thread GitBox
swapniel99 edited a comment on issue #9176: URL: https://github.com/apache/airflow/issues/9176#issuecomment-641485098 I think `back_run=True` can work only if `catchup=True` but `depends_on_past=False` `catchup=False` means past runs are not necessary. Can anyone correct me if I am

[GitHub] [airflow] SamWheating commented on a change in pull request #9159: Adding Google Deployment Manager Hook

2020-06-09 Thread GitBox
SamWheating commented on a change in pull request #9159: URL: https://github.com/apache/airflow/pull/9159#discussion_r437614992 ## File path: airflow/providers/google/cloud/hooks/gdm.py ## @@ -0,0 +1,103 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or

[GitHub] [airflow] shanit-saha edited a comment on pull request #7324: [AIRFLOW-6704] Copy common TaskInstance attributes from Task

2020-06-09 Thread GitBox
shanit-saha edited a comment on pull request #7324: URL: https://github.com/apache/airflow/pull/7324#issuecomment-641433495 On Migrating Airflow from V1.10.2 to V1.10.10 One of our DAG have a task which is of dagrun_operator type. Code snippet of the task looks something as below.

[jira] [Commented] (AIRFLOW-6704) TaskInstance.operator is not set when task is marked success or failed in the Web UI

2020-06-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129665#comment-17129665 ] ASF GitHub Bot commented on AIRFLOW-6704: - shanit-saha edited a comment on pull request #7324:

[GitHub] [airflow] mik-laj commented on issue #8629: DockerOperator cannot pull image when docker client uses json-file log driver

2020-06-09 Thread GitBox
mik-laj commented on issue #8629: URL: https://github.com/apache/airflow/issues/8629#issuecomment-641461423 @languitar We plan to release it in Airflow 2.0. However, you will be able to use it in Airflow 1.10 using backport packages. The releasing process of these packages is ongoing. I

[airflow] branch master updated (7ad827f -> efb86df)

2020-06-09 Thread turbaszek
This is an automated email from the ASF dual-hosted git repository. turbaszek pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 7ad827f Set conn_type as not-nullable (#9187) add efb86df Call super.tearDown in SystemTest tearDown

[GitHub] [airflow] turbaszek merged pull request #9196: Call super.tearDown in SystemTest tearDown

2020-06-09 Thread GitBox
turbaszek merged pull request #9196: URL: https://github.com/apache/airflow/pull/9196 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [airflow] mik-laj commented on issue #9186: Add SRV DNS record support to http connections

2020-06-09 Thread GitBox
mik-laj commented on issue #9186: URL: https://github.com/apache/airflow/issues/9186#issuecomment-641456055 It makes sense. Support for service discovery in Airflow may be helpful in some use cases. I'd love to see implementations of this change if you plan to work on it.

[GitHub] [airflow] ephraimbuddy commented on a change in pull request #9095: [WIP]Add readonly connection endpoints

2020-06-09 Thread GitBox
ephraimbuddy commented on a change in pull request #9095: URL: https://github.com/apache/airflow/pull/9095#discussion_r437590382 ## File path: airflow/api_connexion/openapi/v1.yaml ## @@ -1146,14 +1146,19 @@ components: type: string conn_type:

[GitHub] [airflow] jaketf commented on pull request #8954: Wait for pipeline state in Data Fusion operators

2020-06-09 Thread GitBox
jaketf commented on pull request #8954: URL: https://github.com/apache/airflow/pull/8954#issuecomment-641453114 Thanks for following up @turbaszek. *tl;dr* I think we should merge this PR as it fixes the immediate issue. We can file a lower priority issue to handle streaming pipelines

[airflow] branch v1-10-test updated (f21618b -> 6ecede2)

2020-06-09 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch v1-10-test in repository https://gitbox.apache.org/repos/asf/airflow.git. discard f21618b Chown should work now when building the documentation (#8600) add 6ecede2 Chown should work now

[airflow] branch v1-10-test updated (f21618b -> 6ecede2)

2020-06-09 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch v1-10-test in repository https://gitbox.apache.org/repos/asf/airflow.git. discard f21618b Chown should work now when building the documentation (#8600) add 6ecede2 Chown should work now

[GitHub] [airflow] potiuk commented on pull request #9198: Fixes failures if python2 is still default on path

2020-06-09 Thread GitBox
potiuk commented on pull request #9198: URL: https://github.com/apache/airflow/pull/9198#issuecomment-641442431 Closed. The reason was different *major/minor version wrongly set) This is an automated message from the Apache

[GitHub] [airflow] potiuk closed pull request #9198: Fixes failures if python2 is still default on path

2020-06-09 Thread GitBox
potiuk closed pull request #9198: URL: https://github.com/apache/airflow/pull/9198 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] potiuk opened a new pull request #9198: Fixes failures if python2 is still default on path

2020-06-09 Thread GitBox
potiuk opened a new pull request #9198: URL: https://github.com/apache/airflow/pull/9198 In some systems python2 is still default. This causes failure of the script when run without the image --- Make sure to mark the boxes below before creating PR: [x] - [x] Description

[GitHub] [airflow] jaketf commented on a change in pull request #8954: Wait for pipeline state in Data Fusion operators

2020-06-09 Thread GitBox
jaketf commented on a change in pull request #8954: URL: https://github.com/apache/airflow/pull/8954#discussion_r437578759 ## File path: airflow/providers/google/cloud/hooks/datafusion.py ## @@ -435,20 +435,52 @@ def _get_pipeline( "workflows",

[GitHub] [airflow] jaketf commented on a change in pull request #8954: Wait for pipeline state in Data Fusion operators

2020-06-09 Thread GitBox
jaketf commented on a change in pull request #8954: URL: https://github.com/apache/airflow/pull/8954#discussion_r437578183 ## File path: airflow/providers/google/cloud/hooks/datafusion.py ## @@ -435,20 +435,52 @@ def _get_pipeline( "workflows",

[GitHub] [airflow] shanit-saha commented on pull request #7324: [AIRFLOW-6704] Copy common TaskInstance attributes from Task

2020-06-09 Thread GitBox
shanit-saha commented on pull request #7324: URL: https://github.com/apache/airflow/pull/7324#issuecomment-641433495 On Migrating Airflow from V1.10.2 to V1.10.10 One of our DAG have a task which is of dagrun_operator type. Code snippet of the task looks something as below. Please

[jira] [Commented] (AIRFLOW-6704) TaskInstance.operator is not set when task is marked success or failed in the Web UI

2020-06-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129613#comment-17129613 ] ASF GitHub Bot commented on AIRFLOW-6704: - shanit-saha commented on pull request #7324: URL:

[GitHub] [airflow] boring-cyborg[bot] commented on issue #9197: Apache Airflow dagrun_operator in Airflow Version 1.10.10

2020-06-09 Thread GitBox
boring-cyborg[bot] commented on issue #9197: URL: https://github.com/apache/airflow/issues/9197#issuecomment-641408208 Thanks for opening your first issue here! Be sure to follow the issue template! This is an automated

[GitHub] [airflow] potiuk commented on pull request #9195: Update pre-commit-hooks repo version

2020-06-09 Thread GitBox
potiuk commented on pull request #9195: URL: https://github.com/apache/airflow/pull/9195#issuecomment-641418199 It looks like the new stylelint requires some style improvements as well @feluelle This is an automated

[GitHub] [airflow] dimon222 commented on issue #9118: Improve/surface errors when attempting to read S3 logs

2020-06-09 Thread GitBox
dimon222 commented on issue #9118: URL: https://github.com/apache/airflow/issues/9118#issuecomment-641416176 Any clue what component can be touched to impact on this? I'm having trouble to find what code swallows exceptions. Really looking to investigate and resolve S3 logs issue.

[GitHub] [airflow] edejong edited a comment on issue #8903: BigQueryHook refactor + deterministic BQ Job ID

2020-06-09 Thread GitBox
edejong edited a comment on issue #8903: URL: https://github.com/apache/airflow/issues/8903#issuecomment-641387021 I should really check GitHub more often, I only saw the notification now. Let me know if I understand the question correctly: should the BigQueryHook's interface rely

[GitHub] [airflow] mik-laj commented on a change in pull request #9095: [WIP]Add readonly connection endpoints

2020-06-09 Thread GitBox
mik-laj commented on a change in pull request #9095: URL: https://github.com/apache/airflow/pull/9095#discussion_r437559058 ## File path: airflow/api_connexion/openapi/v1.yaml ## @@ -1146,14 +1146,19 @@ components: type: string conn_type: type:

[GitHub] [airflow] potiuk commented on a change in pull request #9162: Improve production image iteration speed

2020-06-09 Thread GitBox
potiuk commented on a change in pull request #9162: URL: https://github.com/apache/airflow/pull/9162#discussion_r437550994 ## File path: scripts/ci/in_container/entrypoint_ci.sh ## @@ -134,10 +123,6 @@ if [[ ${INTEGRATION_KERBEROS:="false"} == "true" ]]; then fi -# Start

[GitHub] [airflow] shanit-saha opened a new issue #9197: Apache Airflow dagrun_operator in Airflow Version 1.10.10

2020-06-09 Thread GitBox
shanit-saha opened a new issue #9197: URL: https://github.com/apache/airflow/issues/9197 On Migrating Airflow from V1.10.2 to V1.10.10 One of our DAG have a task which is of dagrun_operator type. Code snippet of the task looks something as below. Please assume that DAG

[GitHub] [airflow] feluelle opened a new pull request #9196: Call super.tearDown in SystemTest tearDown

2020-06-09 Thread GitBox
feluelle opened a new pull request #9196: URL: https://github.com/apache/airflow/pull/9196 `TestCase.setUp` and -`tearDown` are empty functions but I think it does not harm if we change it accordingly. --- Make sure to mark the boxes below before creating PR: [x] - [ ]

[GitHub] [airflow] mik-laj merged pull request #9187: Set conn_type as not-nullable

2020-06-09 Thread GitBox
mik-laj merged pull request #9187: URL: https://github.com/apache/airflow/pull/9187 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] casassg commented on a change in pull request #8962: [AIRFLOW-8057] [AIP-31] Add @task decorator

2020-06-09 Thread GitBox
casassg commented on a change in pull request #8962: URL: https://github.com/apache/airflow/pull/8962#discussion_r432601178 ## File path: airflow/operators/python.py ## @@ -145,6 +149,131 @@ def execute_callable(self): return self.python_callable(*self.op_args,

[airflow] 01/02: Improved cloud tool available in the trimmed down CI container (#9167)

2020-06-09 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v1-10-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 5661dc95a7e157b612fe817057048486275d735a Author: Jarek Potiuk AuthorDate: Tue Jun 9 09:33:16 2020 +0200

[airflow] 02/02: Chown should work now when building the documentation (#8600)

2020-06-09 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v1-10-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit f21618bdae4ba157929477bfb96819b5caa15a78 Author: Jarek Potiuk AuthorDate: Tue Apr 28 13:03:08 2020 +0200

[GitHub] [airflow] mik-laj commented on a change in pull request #9170: [WIP] Read only endpoint for XCom #8134

2020-06-09 Thread GitBox
mik-laj commented on a change in pull request #9170: URL: https://github.com/apache/airflow/pull/9170#discussion_r437084427 ## File path: airflow/api_connexion/schemas/xcom_schema.py ## @@ -0,0 +1,67 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more

[GitHub] [airflow] SamWheating commented on a change in pull request #9159: Adding Google Deployment Manager Hook

2020-06-09 Thread GitBox
SamWheating commented on a change in pull request #9159: URL: https://github.com/apache/airflow/pull/9159#discussion_r436680469 ## File path: airflow/providers/google/cloud/hooks/gdm.py ## @@ -0,0 +1,103 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or

[airflow] branch v1-10-test updated (4b8fbf2 -> f21618b)

2020-06-09 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch v1-10-test in repository https://gitbox.apache.org/repos/asf/airflow.git. omit 4b8fbf2 Improved cloud tool available in the trimmed down CI container (#9167) new 5661dc9 Improved

[GitHub] [airflow] potiuk commented on pull request #9029: Remove Hive/Hadoop/Java dependency from unit tests

2020-06-09 Thread GitBox
potiuk commented on pull request #9029: URL: https://github.com/apache/airflow/pull/9029#issuecomment-641191536 Hey @jhtimmins -> I cherry-picked your changes to https://github.com/apache/airflow/commit/d4a00b7c69d5d1c4514bc70b2a0022f36b85a06b I'd love if you can take a look and

[GitHub] [airflow] leahecole commented on pull request #9174: Don't use the term "whitelist" - language matters

2020-06-09 Thread GitBox
leahecole commented on pull request #9174: URL: https://github.com/apache/airflow/pull/9174#issuecomment-640865479 I was just going to make this PR - so glad you beat me to it!! This is an automated message from the Apache

[GitHub] [airflow] crhyatt opened a new pull request #8500: [Airflow-3391] Upgrade pendulum to latest major version

2020-06-09 Thread GitBox
crhyatt opened a new pull request #8500: URL: https://github.com/apache/airflow/pull/8500 --- Make sure to mark the boxes below before creating PR: [x] - [x] Description above provides context of the change - [x] Unit tests coverage for changes (not needed for documentation

  1   2   3   >