[jira] [Commented] (AIRFLOW-4355) Externally triggered DAG is marked as 'success' even if a task has been 'removed'!

2020-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119285#comment-17119285 ] ASF GitHub Bot commented on AIRFLOW-4355: - tooptoop4 commented on pull request #8082: URL:

[GitHub] [airflow] tooptoop4 commented on pull request #8082: [AIRFLOW-4355] removed task should not lead to dagrun success

2020-05-28 Thread GitBox
tooptoop4 commented on pull request #8082: URL: https://github.com/apache/airflow/pull/8082#issuecomment-635771508 not stale This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [airflow] sarahmaas commented on a change in pull request #8721: Add OpenAPI specification (II)

2020-05-28 Thread GitBox
sarahmaas commented on a change in pull request #8721: URL: https://github.com/apache/airflow/pull/8721#discussion_r432264640 ## File path: openapi.yaml ## @@ -0,0 +1,2411 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license

[jira] [Commented] (AIRFLOW-6402) SSH operator exception - 'NoneType' object has no attribute 'startswith'

2020-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119246#comment-17119246 ] ASF GitHub Bot commented on AIRFLOW-6402: - stale[bot] closed pull request #7008: URL:

[jira] [Commented] (AIRFLOW-6404) Add ANSI color support

2020-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119245#comment-17119245 ] ASF GitHub Bot commented on AIRFLOW-6404: - stale[bot] closed pull request #6998: URL:

[GitHub] [airflow] stale[bot] commented on pull request #8146: [AIRFLOW-6780] Add option to use args instead of command in K8s pod spec

2020-05-28 Thread GitBox
stale[bot] commented on pull request #8146: URL: https://github.com/apache/airflow/pull/8146#issuecomment-635739676 This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[GitHub] [airflow] stale[bot] commented on pull request #8244: Add Option for BashOperator to Set State to SKIPPED

2020-05-28 Thread GitBox
stale[bot] commented on pull request #8244: URL: https://github.com/apache/airflow/pull/8244#issuecomment-635739683 This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[GitHub] [airflow] stale[bot] closed pull request #6998: [AIRFLOW-6404] - ANSI color support for WebUI logger

2020-05-28 Thread GitBox
stale[bot] closed pull request #6998: URL: https://github.com/apache/airflow/pull/6998 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [airflow] stale[bot] closed pull request #7008: [AIRFLOW-6402] fix ssh_operator default value

2020-05-28 Thread GitBox
stale[bot] closed pull request #7008: URL: https://github.com/apache/airflow/pull/7008 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Commented] (AIRFLOW-4355) Externally triggered DAG is marked as 'success' even if a task has been 'removed'!

2020-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119244#comment-17119244 ] ASF GitHub Bot commented on AIRFLOW-4355: - stale[bot] commented on pull request #8082: URL:

[jira] [Commented] (AIRFLOW-6780) Use args Instead of command in Kubernetes Executor Worker Pods

2020-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119243#comment-17119243 ] ASF GitHub Bot commented on AIRFLOW-6780: - stale[bot] commented on pull request #8146: URL:

[GitHub] [airflow] stale[bot] commented on pull request #8082: [AIRFLOW-4355] removed task should not lead to dagrun success

2020-05-28 Thread GitBox
stale[bot] commented on pull request #8082: URL: https://github.com/apache/airflow/pull/8082#issuecomment-635739690 This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[airflow] tag nightly-master updated (7386670 -> decf7e8)

2020-05-28 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to tag nightly-master in repository https://gitbox.apache.org/repos/asf/airflow.git. *** WARNING: tag nightly-master was modified! *** from 7386670 (commit) to decf7e8 (commit) from

[GitHub] [airflow] mdediana commented on pull request #9058: Improve test for the next_execution cli command

2020-05-28 Thread GitBox
mdediana commented on pull request #9058: URL: https://github.com/apache/airflow/pull/9058#issuecomment-635693864 My intention with this change is that I'd like to try to add a new option to this command but first wanted to get the related tests in a better state.

[airflow] branch master updated (e4d811d -> decf7e8)

2020-05-28 Thread keviny
This is an automated email from the ASF dual-hosted git repository. keviny pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from e4d811d Use production image for k8s tests (#9038) add decf7e8 Profile hostname for celery executor (#8624)

[GitHub] [airflow] KevinYang21 merged pull request #8624: Profile hostname for celery executor (#8619)

2020-05-28 Thread GitBox
KevinYang21 merged pull request #8624: URL: https://github.com/apache/airflow/pull/8624 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [airflow] mdediana opened a new pull request #9058: Improve test for the next_execution cli command

2020-05-28 Thread GitBox
mdediana opened a new pull request #9058: URL: https://github.com/apache/airflow/pull/9058 Improve `TestCliDags.test_next_execution` in terms of efficiency and readability. Perhaps the `@pytest.mark.quarantined` annotation could be removed, but it is still there because locally the test

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #9058: Improve test for the next_execution cli command

2020-05-28 Thread GitBox
boring-cyborg[bot] commented on pull request #9058: URL: https://github.com/apache/airflow/pull/9058#issuecomment-635681639 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our

[GitHub] [airflow] notatallshaw opened a new pull request #9057: Update Breeze Documentation to have WSL 2 Instructions instead of WSL 1

2020-05-28 Thread GitBox
notatallshaw opened a new pull request #9057: URL: https://github.com/apache/airflow/pull/9057 WSL 2 is now available on stable version of Windows 10: https://docs.microsoft.com/en-us/windows/wsl/wsl2-index WSL 2 works with Docker Desktop on Windows with better performance:

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #9057: Update Breeze Documentation to have WSL 2 Instructions instead of WSL 1

2020-05-28 Thread GitBox
boring-cyborg[bot] commented on pull request #9057: URL: https://github.com/apache/airflow/pull/9057#issuecomment-635653937 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our

[GitHub] [airflow] ashb commented on a change in pull request #8227: Add run_type to DagRun

2020-05-28 Thread GitBox
ashb commented on a change in pull request #8227: URL: https://github.com/apache/airflow/pull/8227#discussion_r432152810 ## File path: airflow/models/dag.py ## @@ -1468,14 +1472,28 @@ def create_dagrun(self, :param session: database session :type session:

[GitHub] [airflow] ashb commented on a change in pull request #8227: Add run_type to DagRun

2020-05-28 Thread GitBox
ashb commented on a change in pull request #8227: URL: https://github.com/apache/airflow/pull/8227#discussion_r432151494 ## File path: airflow/migrations/versions/3c20cacc0044_add_dagrun_run_type.py ## @@ -0,0 +1,58 @@ +# +# Licensed to the Apache Software Foundation (ASF)

[GitHub] [airflow] ashb commented on a change in pull request #8227: Add run_type to DagRun

2020-05-28 Thread GitBox
ashb commented on a change in pull request #8227: URL: https://github.com/apache/airflow/pull/8227#discussion_r432151089 ## File path: airflow/migrations/versions/3c20cacc0044_add_dagrun_run_type.py ## @@ -0,0 +1,90 @@ +# +# Licensed to the Apache Software Foundation (ASF)

[GitHub] [airflow] ashb commented on pull request #8721: Add OpenAPI specification (II)

2020-05-28 Thread GitBox
ashb commented on pull request #8721: URL: https://github.com/apache/airflow/pull/8721#issuecomment-635630236 Posted to https://lists.apache.org/thread.html/r88f5f57b4586f75eda382ce2c7309bd32b58cd9cfa1b01f681b6c8d1%40%3Cdev.airflow.apache.org%3E

[GitHub] [airflow] ephraimbuddy commented on issue #9053: Airflow scheduler not starting

2020-05-28 Thread GitBox
ephraimbuddy commented on issue #9053: URL: https://github.com/apache/airflow/issues/9053#issuecomment-635626182 Have you tried initializing the db or resetting it? `airflow db init` or `airflow db reset` This is an

[GitHub] [airflow] ashb commented on a change in pull request #8895: Add Delete/Create S3 bucket operators

2020-05-28 Thread GitBox
ashb commented on a change in pull request #8895: URL: https://github.com/apache/airflow/pull/8895#discussion_r432077780 ## File path: airflow/providers/amazon/aws/example_dags/example_s3_bucket.py ## @@ -0,0 +1,65 @@ +# Licensed to the Apache Software Foundation (ASF) under

[GitHub] [airflow] ephraimbuddy opened a new pull request #9056: add example dag and system test for GoogleSheetsToGCSOperator

2020-05-28 Thread GitBox
ephraimbuddy opened a new pull request #9056: URL: https://github.com/apache/airflow/pull/9056 --- This PR closes one of the issues in #8280 Make sure to mark the boxes below before creating PR: [x] - [x] Description above provides context of the change - [x] Unit tests

[GitHub] [airflow] casassg commented on pull request #8962: [AIRFLOW-8057] [AIP-31] Add @task decorator

2020-05-28 Thread GitBox
casassg commented on pull request #8962: URL: https://github.com/apache/airflow/pull/8962#issuecomment-635533530 1. Switched to use factory method (aka reuse function several times in a DAG). Cleaned a lot of code that had to do with this decision. 2. Added check for multiple outputs

[GitHub] [airflow] casassg commented on a change in pull request #8962: [AIRFLOW-8057] [AIP-31] Add @task decorator

2020-05-28 Thread GitBox
casassg commented on a change in pull request #8962: URL: https://github.com/apache/airflow/pull/8962#discussion_r432039428 ## File path: airflow/operators/python.py ## @@ -145,6 +147,141 @@ def execute_callable(self): return self.python_callable(*self.op_args,

[airflow] branch v1-10-test updated (7595db8 -> 3a4e73c)

2020-05-28 Thread dimberman
This is an automated email from the ASF dual-hosted git repository. dimberman pushed a change to branch v1-10-test in repository https://gitbox.apache.org/repos/asf/airflow.git. omit 7595db8 Use production image for k8s tests (#9038) new 3a4e73c Use production image for k8s tests

[airflow] 01/01: Use production image for k8s tests (#9038)

2020-05-28 Thread dimberman
This is an automated email from the ASF dual-hosted git repository. dimberman pushed a commit to branch v1-10-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 3a4e73c7468ec5609936237cdfc8838626f20073 Author: Daniel Imberman AuthorDate: Thu May 28 09:53:03 2020 -0700

[jira] [Commented] (AIRFLOW-4526) KubernetesPodOperator gets stuck in Running state when get_logs is set to True and there is a long gap without logs from pod

2020-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118966#comment-17118966 ] ASF GitHub Bot commented on AIRFLOW-4526: - sarah-johnson commented on pull request #7428: URL:

[GitHub] [airflow] sarah-johnson commented on pull request #7428: [AIRFLOW-4526] Poll k8s logs to avoid problem with kubernetes logs --follow

2020-05-28 Thread GitBox
sarah-johnson commented on pull request #7428: URL: https://github.com/apache/airflow/pull/7428#issuecomment-635518705 @dorranh yes, I believe so, and if so that would be incredible. Thank you so much. I got sidetracked from this, sorry it took me so long to get back to you. I was never

[airflow] 01/01: Use production image for k8s tests (#9038)

2020-05-28 Thread dimberman
This is an automated email from the ASF dual-hosted git repository. dimberman pushed a commit to branch v1-10-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 7595db803a7b89e9e1ec10ebfb51dd265a8e512e Author: Daniel Imberman AuthorDate: Thu May 28 09:53:03 2020 -0700

[GitHub] [airflow] mik-laj edited a comment on issue #8893: Displaying field templates and constructor parameters in scripts/list-integration.py

2020-05-28 Thread GitBox
mik-laj edited a comment on issue #8893: URL: https://github.com/apache/airflow/issues/8893#issuecomment-635508132 This file? What exactly code? https://github.com/apache/airflow/blob/master/scripts/list-integrations.py I want to have the following output or equivalent: ```

[GitHub] [airflow] mik-laj commented on issue #8893: Displaying field templates and constructor parameters in scripts/list-integration.py

2020-05-28 Thread GitBox
mik-laj commented on issue #8893: URL: https://github.com/apache/airflow/issues/8893#issuecomment-635508132 This file? What exactly code? https://github.com/apache/airflow/blob/master/scripts/list-integrations.py I want to have the following output or equivalent: ```

[GitHub] [airflow] casassg commented on a change in pull request #8962: [AIRFLOW-8057] [AIP-31] Add @task decorator

2020-05-28 Thread GitBox
casassg commented on a change in pull request #8962: URL: https://github.com/apache/airflow/pull/8962#discussion_r432023999 ## File path: airflow/operators/python.py ## @@ -145,6 +148,140 @@ def execute_callable(self): return self.python_callable(*self.op_args,

[GitHub] [airflow] maverick12345678 commented on issue #8893: Displaying field templates and constructor parameters in scripts/list-integration.py

2020-05-28 Thread GitBox
maverick12345678 commented on issue #8893: URL: https://github.com/apache/airflow/issues/8893#issuecomment-635503974 I would like to have some insight on what exactly is having in this code ? @mik-laj This is an automated

[GitHub] [airflow] BrainLogic edited a comment on issue #8674: Fix problems with, and test agsinst, Python 3.8

2020-05-28 Thread GitBox
BrainLogic edited a comment on issue #8674: URL: https://github.com/apache/airflow/issues/8674#issuecomment-635489054 Hi Airflow Team, I tried to run airflow 1.10.10 with Python 3.8.3 (the same for 3.8.0) on macOs Mojave 10.14.6 as a demon process `airflow webserver -p 8080 -D`

[airflow] branch v1-10-test updated (e75562d -> 14a6102)

2020-05-28 Thread dimberman
This is an automated email from the ASF dual-hosted git repository. dimberman pushed a change to branch v1-10-test in repository https://gitbox.apache.org/repos/asf/airflow.git. omit e75562d Use production image for k8s tests (#9038) new 14a6102 Use production image for k8s tests

[airflow] 01/01: Use production image for k8s tests (#9038)

2020-05-28 Thread dimberman
This is an automated email from the ASF dual-hosted git repository. dimberman pushed a commit to branch v1-10-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 14a61026ca7e48ee6f07e6a8d6c08e8e8f443bde Author: Daniel Imberman AuthorDate: Thu May 28 09:53:03 2020 -0700

[airflow] branch v1-10-test updated (77e6311 -> e75562d)

2020-05-28 Thread dimberman
This is an automated email from the ASF dual-hosted git repository. dimberman pushed a change to branch v1-10-test in repository https://gitbox.apache.org/repos/asf/airflow.git. omit 77e6311 Use production image for k8s tests (#9038) new e75562d Use production image for k8s

[airflow] 01/01: Use production image for k8s tests (#9038)

2020-05-28 Thread dimberman
This is an automated email from the ASF dual-hosted git repository. dimberman pushed a commit to branch v1-10-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit e75562d8ca6b30f076075b393ffcd41a6f80677c Author: Daniel Imberman AuthorDate: Thu May 28 09:53:03 2020 -0700

[GitHub] [airflow] BrainLogic commented on issue #8674: Fix problems with, and test agsinst, Python 3.8

2020-05-28 Thread GitBox
BrainLogic commented on issue #8674: URL: https://github.com/apache/airflow/issues/8674#issuecomment-635489054 Hi Airflow Team, I tried to run airflow with Python 3.8.3 (the same for 3.8.0) on macOs Mojave 10.14.6 as a demon process `airflow webserver -p 8080 -D` this way

[GitHub] [airflow] aneesh-joseph commented on a change in pull request #9044: do a kinit before yarn kill if keytab and principal are provided

2020-05-28 Thread GitBox
aneesh-joseph commented on a change in pull request #9044: URL: https://github.com/apache/airflow/pull/9044#discussion_r431999272 ## File path: airflow/providers/apache/spark/hooks/spark_submit.py ## @@ -617,6 +617,13 @@ def on_kill(self): self._submit_sp.kill()

[GitHub] [airflow] aneesh-joseph commented on a change in pull request #9044: do a kinit before yarn kill if keytab and principal are provided

2020-05-28 Thread GitBox
aneesh-joseph commented on a change in pull request #9044: URL: https://github.com/apache/airflow/pull/9044#discussion_r431999272 ## File path: airflow/providers/apache/spark/hooks/spark_submit.py ## @@ -617,6 +617,13 @@ def on_kill(self): self._submit_sp.kill()

[GitHub] [airflow] ephraimbuddy opened a new pull request #9055: add correct description for dst parameter in LocalFilesystemToGCSOperator

2020-05-28 Thread GitBox
ephraimbuddy opened a new pull request #9055: URL: https://github.com/apache/airflow/pull/9055 --- Closes: #9040 Make sure to mark the boxes below before creating PR: [x] - [x] Description above provides context of the change - [x] Unit tests coverage for changes (not

[GitHub] [airflow] mik-laj commented on pull request #9030: Allow using Airflow with Flask CLI

2020-05-28 Thread GitBox
mik-laj commented on pull request #9030: URL: https://github.com/apache/airflow/pull/9030#issuecomment-635478964 I still have to find one side effect because MySQL behaves differently than PostgresSQL. This is an automated

[GitHub] [airflow] simond commented on pull request #9023: Add snowflake to slack operator

2020-05-28 Thread GitBox
simond commented on pull request #9023: URL: https://github.com/apache/airflow/pull/9023#issuecomment-635477727 Thanks for the review @turbaszek , just updated the PR with the changes you've suggested. This is an automated

[GitHub] [airflow] mik-laj commented on a change in pull request #9030: Allow using Airflow with Flask CLI

2020-05-28 Thread GitBox
mik-laj commented on a change in pull request #9030: URL: https://github.com/apache/airflow/pull/9030#discussion_r431991963 ## File path: airflow/www/app.py ## @@ -70,6 +73,31 @@ def create_app(config=None, testing=False, app_name="Airflow"): app.json_encoder =

[GitHub] [airflow] potiuk commented on a change in pull request #9030: Allow using Airflow with Flask CLI

2020-05-28 Thread GitBox
potiuk commented on a change in pull request #9030: URL: https://github.com/apache/airflow/pull/9030#discussion_r431987129 ## File path: airflow/www/app.py ## @@ -39,15 +39,18 @@ from airflow.utils.json import AirflowJsonEncoder from airflow.www.static_config import

[GitHub] [airflow] potiuk commented on issue #9040: Correctly describe the dst parameter in LocalFilesystemToGCS operator

2020-05-28 Thread GitBox
potiuk commented on issue #9040: URL: https://github.com/apache/airflow/issues/9040#issuecomment-635470492 It's a bit ambiguous indeed and it would be great to make it consistent. Objects in GCS are often referred to as files - even if they are really objects - but in all kinds of UI

[airflow] 01/01: Use production image for k8s tests (#9038)

2020-05-28 Thread dimberman
This is an automated email from the ASF dual-hosted git repository. dimberman pushed a commit to branch v1-10-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 77e63116a03abafb8aeeacc09fc4f9411e1832cb Author: Daniel Imberman AuthorDate: Thu May 28 09:53:03 2020 -0700

[airflow] branch v1-10-test updated (59cac08 -> 77e6311)

2020-05-28 Thread dimberman
This is an automated email from the ASF dual-hosted git repository. dimberman pushed a change to branch v1-10-test in repository https://gitbox.apache.org/repos/asf/airflow.git. omit 59cac08 Use production image for k8s tests (#9038) omit 027a2c8 Bust pre-commit cache on Github

[GitHub] [airflow] JavierLopezT opened a new pull request #9054: Add MySqlToS3Operator

2020-05-28 Thread GitBox
JavierLopezT opened a new pull request #9054: URL: https://github.com/apache/airflow/pull/9054 Adding a new operator from transfering files from mysql to s3. This is a new PR for the same code of https://github.com/apache/airflow/pull/6670/files#, made for cleaning my git, which was

[GitHub] [airflow] ashb commented on pull request #8721: Add OpenAPI specification (II)

2020-05-28 Thread GitBox
ashb commented on pull request #8721: URL: https://github.com/apache/airflow/pull/8721#issuecomment-635432491 Only outstanding point is about https://github.com/apache/airflow/pull/8721#discussion_r427618086 (conf param to trigger as string vs object) -- I'll take it to the mailing list.

[GitHub] [airflow] JavierLopezT commented on pull request #9008: Get connections uri with AWS Secrets Manager backend

2020-05-28 Thread GitBox
JavierLopezT commented on pull request #9008: URL: https://github.com/apache/airflow/pull/9008#issuecomment-635432873 > Please add tests Sure, but what kind of tests? I assumed that since there are already tests, if they work with the new script it'll be fine.

[GitHub] [airflow] ashb commented on a change in pull request #8721: Add OpenAPI specification (II)

2020-05-28 Thread GitBox
ashb commented on a change in pull request #8721: URL: https://github.com/apache/airflow/pull/8721#discussion_r431929827 ## File path: openapi.yaml ## @@ -0,0 +1,2434 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements.

[GitHub] [airflow] mik-laj commented on pull request #8721: Add OpenAPI specification (II)

2020-05-28 Thread GitBox
mik-laj commented on pull request #8721: URL: https://github.com/apache/airflow/pull/8721#issuecomment-635422152 @ashb I answered all comments. Would you like to add something else?  This is an automated message from the

[GitHub] [airflow] mik-laj commented on a change in pull request #8721: Add OpenAPI specification (II)

2020-05-28 Thread GitBox
mik-laj commented on a change in pull request #8721: URL: https://github.com/apache/airflow/pull/8721#discussion_r431923833 ## File path: openapi.yaml ## @@ -0,0 +1,2434 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements.

[GitHub] [airflow] mik-laj commented on a change in pull request #8721: Add OpenAPI specification (II)

2020-05-28 Thread GitBox
mik-laj commented on a change in pull request #8721: URL: https://github.com/apache/airflow/pull/8721#discussion_r431924469 ## File path: openapi.yaml ## @@ -0,0 +1,2434 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements.

[GitHub] [airflow] mik-laj commented on a change in pull request #8721: Add OpenAPI specification (II)

2020-05-28 Thread GitBox
mik-laj commented on a change in pull request #8721: URL: https://github.com/apache/airflow/pull/8721#discussion_r431923246 ## File path: openapi.yaml ## @@ -0,0 +1,2434 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements.

[GitHub] [airflow] mik-laj commented on pull request #8721: Add OpenAPI specification (II)

2020-05-28 Thread GitBox
mik-laj commented on pull request #8721: URL: https://github.com/apache/airflow/pull/8721#issuecomment-635415105 > Errors > > > Semantic error at paths./dags/{dag_id}.get.requestBody > GET operations cannot have a requestBody. > Jump to line 181 I am fixing it. I

[GitHub] [airflow] mik-laj commented on a change in pull request #8721: Add OpenAPI specification (II)

2020-05-28 Thread GitBox
mik-laj commented on a change in pull request #8721: URL: https://github.com/apache/airflow/pull/8721#discussion_r431877857 ## File path: openapi.yaml ## @@ -0,0 +1,2411 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements.

[GitHub] [airflow] dimberman merged pull request #9038: Use production image for k8s tests

2020-05-28 Thread GitBox
dimberman merged pull request #9038: URL: https://github.com/apache/airflow/pull/9038 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [airflow] turbaszek commented on a change in pull request #8805: Resolve upstream tasks when template field is XComArg

2020-05-28 Thread GitBox
turbaszek commented on a change in pull request #8805: URL: https://github.com/apache/airflow/pull/8805#discussion_r431860047 ## File path: tests/models/test_baseoperator.py ## @@ -347,3 +350,67 @@ def test_lineage_composition(self): task4 =

[GitHub] [airflow] turbaszek commented on pull request #8805: Resolve upstream tasks when template field is XComArg

2020-05-28 Thread GitBox
turbaszek commented on pull request #8805: URL: https://github.com/apache/airflow/pull/8805#issuecomment-635363551 @ashb currently proposed approach resolves the relation when creating a DagBag: ```python for task in dag.tasks: settings.policy(task)

[GitHub] [airflow] boring-cyborg[bot] commented on issue #9053: Airflow scheduler not starting

2020-05-28 Thread GitBox
boring-cyborg[bot] commented on issue #9053: URL: https://github.com/apache/airflow/issues/9053#issuecomment-635358459 Thanks for opening your first issue here! Be sure to follow the issue template! This is an automated

[GitHub] [airflow] rishabhgarg7 opened a new issue #9053: Airflow scheduler not starting

2020-05-28 Thread GitBox
rishabhgarg7 opened a new issue #9053: URL: https://github.com/apache/airflow/issues/9053 When I'm doing airflow scheduler on my local machine, it's giving the following SQLAlchemy error: File "/home/ubuntu/anaconda3/lib/python3.7/site-packages/sqlalchemy/engine/default.py",

[airflow] branch master updated (52c7862 -> 902703d)

2020-05-28 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 52c7862 Add a tip to trigger DAG screen (#9049) add 902703d [AIRFLOW-6231] Display DAG run conf in the

[airflow] branch master updated (902703d -> 14e241f)

2020-05-28 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 902703d [AIRFLOW-6231] Display DAG run conf in the list view (#6794) add 14e241f detect incompatible docker

[airflow] branch master updated (1ed171b -> 52c7862)

2020-05-28 Thread kamilbregula
This is an automated email from the ASF dual-hosted git repository. kamilbregula pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 1ed171b Add script_args for S3FileTransformOperator (#9019) add 52c7862 Add a tip to trigger DAG

[airflow] branch master updated: Add script_args for S3FileTransformOperator (#9019)

2020-05-28 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/master by this push: new 1ed171b Add script_args for

[GitHub] [airflow] kaxil commented on a change in pull request #8227: Add run_type to DagRun

2020-05-28 Thread GitBox
kaxil commented on a change in pull request #8227: URL: https://github.com/apache/airflow/pull/8227#discussion_r431247683 ## File path: airflow/models/dagrun.py ## @@ -54,25 +54,27 @@ class DagRun(Base, LoggingMixin): _state = Column('state', String(50),

[GitHub] [airflow] randr97 commented on a change in pull request #8895: Add Delete/Create S3 bucket operators

2020-05-28 Thread GitBox
randr97 commented on a change in pull request #8895: URL: https://github.com/apache/airflow/pull/8895#discussion_r431703233 ## File path: tests/providers/amazon/aws/operators/test_s3_bucket.py ## @@ -0,0 +1,84 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one

[GitHub] [airflow] gundoganalperen opened a new issue #9047: DockerSwarmOperator can not mount a volume

2020-05-28 Thread GitBox
gundoganalperen opened a new issue #9047: URL: https://github.com/apache/airflow/issues/9047 **Apache Airflow version**: 1.10.10 **Kubernetes version (if you are using kubernetes)** (use `kubectl version`): **Environment**: - **Cloud provider or

[GitHub] [airflow] feluelle commented on a change in pull request #8895: Add Delete/Create S3 bucket operators

2020-05-28 Thread GitBox
feluelle commented on a change in pull request #8895: URL: https://github.com/apache/airflow/pull/8895#discussion_r431682722 ## File path: tests/providers/amazon/aws/operators/test_s3_bucket.py ## @@ -0,0 +1,84 @@ +# +# Licensed to the Apache Software Foundation (ASF) under

[GitHub] [airflow] boring-cyborg[bot] commented on issue #9047: DockerSwarmOperator can not mount a volume

2020-05-28 Thread GitBox
boring-cyborg[bot] commented on issue #9047: URL: https://github.com/apache/airflow/issues/9047#issuecomment-635211505 Thanks for opening your first issue here! Be sure to follow the issue template! This is an automated

[GitHub] [airflow] turbaszek commented on a change in pull request #8962: [AIRFLOW-8057] [AIP-31] Add @task decorator

2020-05-28 Thread GitBox
turbaszek commented on a change in pull request #8962: URL: https://github.com/apache/airflow/pull/8962#discussion_r431578845 ## File path: airflow/operators/python.py ## @@ -145,6 +147,141 @@ def execute_callable(self): return self.python_callable(*self.op_args,

[GitHub] [airflow] turbaszek commented on a change in pull request #8962: [AIRFLOW-8057] [AIP-31] Add @task decorator

2020-05-28 Thread GitBox
turbaszek commented on a change in pull request #8962: URL: https://github.com/apache/airflow/pull/8962#discussion_r431578845 ## File path: airflow/operators/python.py ## @@ -145,6 +147,141 @@ def execute_callable(self): return self.python_callable(*self.op_args,

[GitHub] [airflow] turbaszek commented on a change in pull request #8962: [AIRFLOW-8057] [AIP-31] Add @task decorator

2020-05-28 Thread GitBox
turbaszek commented on a change in pull request #8962: URL: https://github.com/apache/airflow/pull/8962#discussion_r431674712 ## File path: docs/concepts.rst ## @@ -116,6 +116,47 @@ DAGs can be used as context managers to automatically assign new operators to th op.dag

[GitHub] [airflow] feluelle commented on a change in pull request #8962: [AIRFLOW-8057] [AIP-31] Add @task decorator

2020-05-28 Thread GitBox
feluelle commented on a change in pull request #8962: URL: https://github.com/apache/airflow/pull/8962#discussion_r431671551 ## File path: docs/concepts.rst ## @@ -116,6 +116,47 @@ DAGs can be used as context managers to automatically assign new operators to th op.dag

[GitHub] [airflow] feluelle commented on a change in pull request #8962: [AIRFLOW-8057] [AIP-31] Add @task decorator

2020-05-28 Thread GitBox
feluelle commented on a change in pull request #8962: URL: https://github.com/apache/airflow/pull/8962#discussion_r431670798 ## File path: airflow/operators/python.py ## @@ -145,6 +148,140 @@ def execute_callable(self): return self.python_callable(*self.op_args,

[GitHub] [airflow] feluelle commented on a change in pull request #8962: [AIRFLOW-8057] [AIP-31] Add @task decorator

2020-05-28 Thread GitBox
feluelle commented on a change in pull request #8962: URL: https://github.com/apache/airflow/pull/8962#discussion_r431670798 ## File path: airflow/operators/python.py ## @@ -145,6 +148,140 @@ def execute_callable(self): return self.python_callable(*self.op_args,

[GitHub] [airflow] boring-cyborg[bot] commented on issue #9046: TimeDeltaSensor and schedule_interval="@once" leads to crash

2020-05-28 Thread GitBox
boring-cyborg[bot] commented on issue #9046: URL: https://github.com/apache/airflow/issues/9046#issuecomment-635182466 Thanks for opening your first issue here! Be sure to follow the issue template! This is an automated

[GitHub] [airflow] anon-john opened a new issue #9046: TimeDeltaSensor and schedule_interval="@once" leads to crash

2020-05-28 Thread GitBox
anon-john opened a new issue #9046: URL: https://github.com/apache/airflow/issues/9046 **Apache Airflow version**: 1.10.10 **Environment**: - **OS** (e.g. from /etc/os-release): centos7, Ubuntu 18.04.4 LTS - **Install tools**: pip inside virtualenv Using TimeDeltaSensor

[GitHub] [airflow] mik-laj opened a new pull request #9045: [WIP] Add basic read-only DAG Model endpoints

2020-05-28 Thread GitBox
mik-laj opened a new pull request #9045: URL: https://github.com/apache/airflow/pull/9045 --- Make sure to mark the boxes below before creating PR: [x] - [X] Description above provides context of the change - [X] Unit tests coverage for changes (not needed for documentation

[GitHub] [airflow] turbaszek commented on a change in pull request #8227: Add run_type to DagRun

2020-05-28 Thread GitBox
turbaszek commented on a change in pull request #8227: URL: https://github.com/apache/airflow/pull/8227#discussion_r431629432 ## File path: airflow/models/dag.py ## @@ -1468,14 +1472,26 @@ def create_dagrun(self, :param session: database session :type

[GitHub] [airflow] turbaszek commented on a change in pull request #8227: Add run_type to DagRun

2020-05-28 Thread GitBox
turbaszek commented on a change in pull request #8227: URL: https://github.com/apache/airflow/pull/8227#discussion_r431627592 ## File path: airflow/models/dagrun.py ## @@ -54,25 +54,27 @@ class DagRun(Base, LoggingMixin): _state = Column('state', String(50),

[jira] [Commented] (AIRFLOW-5506) Airflow scheduler stuck

2020-05-28 Thread Junyoung Park (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118395#comment-17118395 ] Junyoung Park commented on AIRFLOW-5506: +1 same issue. I solved it by reducing DB latency. >

[GitHub] [airflow] turbaszek closed issue #9034: Fix GoogleDiscoveryApiHook docs warnings

2020-05-28 Thread GitBox
turbaszek closed issue #9034: URL: https://github.com/apache/airflow/issues/9034 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] turbaszek commented on issue #9034: Fix GoogleDiscoveryApiHook docs warnings

2020-05-28 Thread GitBox
turbaszek commented on issue #9034: URL: https://github.com/apache/airflow/issues/9034#issuecomment-635142616 Indeed, thanks @mik-laj ~ This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [airflow] codecov-commenter commented on pull request #8227: Add run_type to DagRun

2020-05-28 Thread GitBox
codecov-commenter commented on pull request #8227: URL: https://github.com/apache/airflow/pull/8227#issuecomment-635135845 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8227?src=pr=h1) Report > Merging [#8227](https://codecov.io/gh/apache/airflow/pull/8227?src=pr=desc) into

[jira] [Commented] (AIRFLOW-3391) Upgrade pendulum to latest major version

2020-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118368#comment-17118368 ] ASF GitHub Bot commented on AIRFLOW-3391: - codecov-commenter commented on pull request #7626:

[GitHub] [airflow] codecov-commenter commented on pull request #7626: [AIRFLOW-3391] Upgrade pendulum to latest major version

2020-05-28 Thread GitBox
codecov-commenter commented on pull request #7626: URL: https://github.com/apache/airflow/pull/7626#issuecomment-635135025 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7626?src=pr=h1) Report > Merging [#7626](https://codecov.io/gh/apache/airflow/pull/7626?src=pr=desc) into

[jira] [Commented] (AIRFLOW-6231) Show DAG Run conf in graph view

2020-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118342#comment-17118342 ] ASF GitHub Bot commented on AIRFLOW-6231: - codecov-commenter commented on pull request #6794:

[GitHub] [airflow] codecov-commenter commented on pull request #6794: [AIRFLOW-6231] Display DAG run conf in the list view

2020-05-28 Thread GitBox
codecov-commenter commented on pull request #6794: URL: https://github.com/apache/airflow/pull/6794#issuecomment-635124552 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6794?src=pr=h1) Report > Merging [#6794](https://codecov.io/gh/apache/airflow/pull/6794?src=pr=desc) into