[GitHub] [airflow] github-actions[bot] commented on pull request #14219: Provide login endpoint for the REST API with JWT authentication method

2021-03-04 Thread GitBox
github-actions[bot] commented on pull request #14219: URL: https://github.com/apache/airflow/pull/14219#issuecomment-791232030 [The Workflow run](https://github.com/apache/airflow/actions/runs/623738817) is cancelling this PR. It has some failed jobs matching ^Pylint$,^Static

[GitHub] [airflow] turbaszek commented on a change in pull request #14492: Adds new community provider Airbyte

2021-03-04 Thread GitBox
turbaszek commented on a change in pull request #14492: URL: https://github.com/apache/airflow/pull/14492#discussion_r588092881 ## File path: airflow/providers/airbyte/example_dags/example_airbyte_trigger_job.py ## @@ -0,0 +1,66 @@ +# +# Licensed to the Apache Software

[GitHub] [airflow] ephraimbuddy closed pull request #14617: Fix breeze no --log-out option in script

2021-03-04 Thread GitBox
ephraimbuddy closed pull request #14617: URL: https://github.com/apache/airflow/pull/14617 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [airflow] ephraimbuddy commented on pull request #14617: Fix breeze no --log-out option in script

2021-03-04 Thread GitBox
ephraimbuddy commented on pull request #14617: URL: https://github.com/apache/airflow/pull/14617#issuecomment-791207300 Looks like not the right solution :) produces `typescript` file This is an automated message from the

[GitHub] [airflow] github-actions[bot] commented on pull request #14614: Allow function wrappers for @task operator

2021-03-04 Thread GitBox
github-actions[bot] commented on pull request #14614: URL: https://github.com/apache/airflow/pull/14614#issuecomment-791204129 [The Workflow run](https://github.com/apache/airflow/actions/runs/623618271) is cancelling this PR. It has some failed jobs matching ^Pylint$,^Static

[GitHub] [airflow] ephraimbuddy opened a new pull request #14617: Fix breeze no --log-out option in script

2021-03-04 Thread GitBox
ephraimbuddy opened a new pull request #14617: URL: https://github.com/apache/airflow/pull/14617 I tried starting breeze after a rebase and I couldn't. I had this error: ``` script: unrecognized option '--log-out' Try 'script --help' for more information. ``` when I tried

[GitHub] [airflow] dstandish commented on a change in pull request #14492: Adds new community provider Airbyte

2021-03-04 Thread GitBox
dstandish commented on a change in pull request #14492: URL: https://github.com/apache/airflow/pull/14492#discussion_r588067984 ## File path: airflow/providers/airbyte/example_dags/example_airbyte_trigger_job.py ## @@ -0,0 +1,66 @@ +# +# Licensed to the Apache Software

[GitHub] [airflow] HugoPu opened a new issue #14616: Install airflow with docker No module named 'airflow'

2021-03-04 Thread GitBox
HugoPu opened a new issue #14616: URL: https://github.com/apache/airflow/issues/14616 **Apache Airflow version**: 2.0.1 **Kubernetes version (if you are using kubernetes)** (use `kubectl version`): No **Environment**: centos 7.9 in ubuntu 20.04 virtualbox Docker

[GitHub] [airflow] boring-cyborg[bot] commented on issue #14616: Install airflow with docker No module named 'airflow'

2021-03-04 Thread GitBox
boring-cyborg[bot] commented on issue #14616: URL: https://github.com/apache/airflow/issues/14616#issuecomment-791194167 Thanks for opening your first issue here! Be sure to follow the issue template! This is an

[jira] [Commented] (AIRFLOW-5071) Thousand os Executor reports task instance X finished (success) although the task says its queued. Was the task killed externally?

2021-03-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17295777#comment-17295777 ] ASF GitHub Bot commented on AIRFLOW-5071: - yougyoung94 commented on issue #10790: URL:

[GitHub] [airflow] yougyoung94 commented on issue #10790: Copy of [AIRFLOW-5071] JIRA: Thousands of Executor reports task instance X finished (success) although the task says its queued. Was the task

2021-03-04 Thread GitBox
yougyoung94 commented on issue #10790: URL: https://github.com/apache/airflow/issues/10790#issuecomment-791165423 Hello. I am using airflow 2.0 and just ran into this error. How can I fix it?? This is an automated

[GitHub] [airflow] jbampton opened a new pull request #14615: chore: remove duplicate words

2021-03-04 Thread GitBox
jbampton opened a new pull request #14615: URL: https://github.com/apache/airflow/pull/14615 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#pull-request-guidelines)** for more

[GitHub] [airflow] dimberman opened a new pull request #14614: Allow function wrappers for @task operator

2021-03-04 Thread GitBox
dimberman opened a new pull request #14614: URL: https://github.com/apache/airflow/pull/14614 Make the @task decorator easily extensible by allowing users to add custom wrapper functions for setup/teardown of environments --- **^ Add meaningful description above**

[GitHub] [airflow] mattellis edited a comment on issue #14265: successful DAG run fails to be scheduled after being manually cleared if Dag.dagrun_timeout is set

2021-03-04 Thread GitBox
mattellis edited a comment on issue #14265: URL: https://github.com/apache/airflow/issues/14265#issuecomment-791091325 @YangMuye @kaxil Our users have the same issue. In case it's of use, I figured out that the `models.dag.clear` method being invoked when a dag run is cleared from the

[GitHub] [airflow] mattellis commented on issue #14265: successful DAG run fails to be scheduled after being manually cleared if Dag.dagrun_timeout is set

2021-03-04 Thread GitBox
mattellis commented on issue #14265: URL: https://github.com/apache/airflow/issues/14265#issuecomment-791091325 @YangMuye @kaxil Our users have the same issue. In case it's of use, I figured out that the `models.dag.clear` method being invoked when a dag run is cleared from the graph

[GitHub] [airflow] linxiaohui commented on issue #13637: Scheduler takes 100% of CPU without task execution

2021-03-04 Thread GitBox
linxiaohui commented on issue #13637: URL: https://github.com/apache/airflow/issues/13637#issuecomment-791086852 Hi everypone, I am using apache-airflow 2.0.1 (using CeleryExecuor), an I have set `min_file_process_interval = 60` and `parsing_processes = 2`. But still the scheduler CPU

[GitHub] [airflow] marcosmarxm commented on a change in pull request #14492: Adds new community provider Airbyte

2021-03-04 Thread GitBox
marcosmarxm commented on a change in pull request #14492: URL: https://github.com/apache/airflow/pull/14492#discussion_r587949402 ## File path: airflow/providers/airbyte/example_dags/example_airbyte_trigger_job.py ## @@ -0,0 +1,66 @@ +# +# Licensed to the Apache Software

[airflow] branch master updated: Fix bug allowing task instances to survive when dagrun_timeout is exceeded (#14321)

2021-03-04 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/master by this push: new 09327ba Fix bug allowing task instances to

[GitHub] [airflow] kaxil closed issue #12912: dagrun_timeout doesn't kill task instances on timeout

2021-03-04 Thread GitBox
kaxil closed issue #12912: URL: https://github.com/apache/airflow/issues/12912 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [airflow] github-actions[bot] commented on pull request #14321: Fix bug allowing task instances to survive when dagrun_timeout is exceeded

2021-03-04 Thread GitBox
github-actions[bot] commented on pull request #14321: URL: https://github.com/apache/airflow/pull/14321#issuecomment-791059325 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] kaxil merged pull request #14321: Fix bug allowing task instances to survive when dagrun_timeout is exceeded

2021-03-04 Thread GitBox
kaxil merged pull request #14321: URL: https://github.com/apache/airflow/pull/14321 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] github-actions[bot] closed pull request #12956: Fix case of JavaScript

2021-03-04 Thread GitBox
github-actions[bot] closed pull request #12956: URL: https://github.com/apache/airflow/pull/12956 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [airflow] github-actions[bot] closed pull request #12600: Check K8S event reason in executor after Pod run

2021-03-04 Thread GitBox
github-actions[bot] closed pull request #12600: URL: https://github.com/apache/airflow/pull/12600 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [airflow] github-actions[bot] commented on pull request #12952: Add support for capacityProviderStrategy option in ECSOperator.

2021-03-04 Thread GitBox
github-actions[bot] commented on pull request #12952: URL: https://github.com/apache/airflow/pull/12952#issuecomment-791054942 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank

[GitHub] [airflow] github-actions[bot] closed pull request #12792: This table represents the list of all alembic revisions until 2.0.0

2021-03-04 Thread GitBox
github-actions[bot] closed pull request #12792: URL: https://github.com/apache/airflow/pull/12792 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [airflow] github-actions[bot] closed pull request #12755: Improve Kubernetes docs, add Helm section, closes #10523

2021-03-04 Thread GitBox
github-actions[bot] closed pull request #12755: URL: https://github.com/apache/airflow/pull/12755 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [airflow] github-actions[bot] closed pull request #12712: AWS Hook - allow IDP HTTP retry (#12639)

2021-03-04 Thread GitBox
github-actions[bot] closed pull request #12712: URL: https://github.com/apache/airflow/pull/12712 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [airflow] github-actions[bot] closed pull request #12391: Don't tar.gz artifacts before uploading them to GitHub

2021-03-04 Thread GitBox
github-actions[bot] closed pull request #12391: URL: https://github.com/apache/airflow/pull/12391 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [airflow] github-actions[bot] closed pull request #12703: Widen importlib-* backport deps, add python_version limits.

2021-03-04 Thread GitBox
github-actions[bot] closed pull request #12703: URL: https://github.com/apache/airflow/pull/12703 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [airflow] github-actions[bot] closed pull request #12710: Enable SparkSqlHook to use supplied connections

2021-03-04 Thread GitBox
github-actions[bot] closed pull request #12710: URL: https://github.com/apache/airflow/pull/12710 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [airflow] github-actions[bot] closed pull request #12521: [AIRFLOW-12520] feat(gcs_to_bq): support schema in different bucket

2021-03-04 Thread GitBox
github-actions[bot] closed pull request #12521: URL: https://github.com/apache/airflow/pull/12521 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [airflow] github-actions[bot] closed pull request #13517: Support Brotli compression for web views

2021-03-04 Thread GitBox
github-actions[bot] closed pull request #13517: URL: https://github.com/apache/airflow/pull/13517 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [airflow] github-actions[bot] closed pull request #13083: Update app.py

2021-03-04 Thread GitBox
github-actions[bot] closed pull request #13083: URL: https://github.com/apache/airflow/pull/13083 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [airflow] github-actions[bot] closed pull request #12963: Remove unneeded words from the spelling wordlist

2021-03-04 Thread GitBox
github-actions[bot] closed pull request #12963: URL: https://github.com/apache/airflow/pull/12963 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [airflow] github-actions[bot] closed pull request #13058: Set timeout for child processes

2021-03-04 Thread GitBox
github-actions[bot] closed pull request #13058: URL: https://github.com/apache/airflow/pull/13058 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [airflow] github-actions[bot] closed pull request #13552: Allow namespace in KubernetesPodOperator to be templated

2021-03-04 Thread GitBox
github-actions[bot] closed pull request #13552: URL: https://github.com/apache/airflow/pull/13552 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [airflow] github-actions[bot] closed pull request #13394: Add rest API to query for providers

2021-03-04 Thread GitBox
github-actions[bot] closed pull request #13394: URL: https://github.com/apache/airflow/pull/13394 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [airflow] fjmacagno opened a new issue #14613: Better "dependency already registered" warning message

2021-03-04 Thread GitBox
fjmacagno opened a new issue #14613: URL: https://github.com/apache/airflow/issues/14613 **Description** I have started getting a bunch of warnings like: ``` [2021-03-05 00:28:49,472] {baseoperator.py:1151} WARNING - Dependency , notify_on_slack already registered ``` I am

[GitHub] [airflow] dstandish commented on a change in pull request #14492: Adds new community provider Airbyte

2021-03-04 Thread GitBox
dstandish commented on a change in pull request #14492: URL: https://github.com/apache/airflow/pull/14492#discussion_r587935083 ## File path: airflow/providers/airbyte/example_dags/example_airbyte_trigger_job.py ## @@ -0,0 +1,66 @@ +# +# Licensed to the Apache Software

[GitHub] [airflow] dstandish commented on a change in pull request #14492: Adds new community provider Airbyte

2021-03-04 Thread GitBox
dstandish commented on a change in pull request #14492: URL: https://github.com/apache/airflow/pull/14492#discussion_r587934022 ## File path: airflow/providers/airbyte/example_dags/example_airbyte_trigger_job.py ## @@ -0,0 +1,66 @@ +# +# Licensed to the Apache Software

[GitHub] [airflow] mik-laj commented on pull request #14608: Bump Redoc to resolve vulnerability in sub-dependency

2021-03-04 Thread GitBox
mik-laj commented on pull request #14608: URL: https://github.com/apache/airflow/pull/14608#issuecomment-791051570 Can you also update redoc version for docs? https://github.com/apache/airflow/blob/9f37af25ae7eb85fa8dbb70b7dbb23bbd5505323/docs/conf.py#L534

[GitHub] [airflow] kaxil opened a new pull request #14612: Default to Celery Task model when backendmodel does not exist

2021-03-04 Thread GitBox
kaxil opened a new pull request #14612: URL: https://github.com/apache/airflow/pull/14612 closes https://github.com/apache/airflow/issues/14586 We add this feature in https://github.com/apache/airflow/pull/12336 but looks like for some users this attribute does not exist.

[GitHub] [airflow] mik-laj commented on issue #14586: AttributeError: 'DatabaseBackend' object has no attribute 'task_cls'

2021-03-04 Thread GitBox
mik-laj commented on issue #14586: URL: https://github.com/apache/airflow/issues/14586#issuecomment-791036601 Can you provide the output of the commands below? ``` python -c "from airflow.executors.celery_executor import app; print(type(app.backend))" ``` ``` pip freeze

[GitHub] [airflow] mik-laj commented on issue #14597: Provide jinja template syntax to access connections

2021-03-04 Thread GitBox
mik-laj commented on issue #14597: URL: https://github.com/apache/airflow/issues/14597#issuecomment-791031515 At the beginning, I was concerned that it would be compatible with the rest of the operators and the users would have no problems understanding this feature, but as I read the

[GitHub] [airflow] github-actions[bot] commented on pull request #14611: Remove duplicate dependencies

2021-03-04 Thread GitBox
github-actions[bot] commented on pull request #14611: URL: https://github.com/apache/airflow/pull/14611#issuecomment-791030393 The PR is likely OK to be merged with just subset of tests for default Python and Database versions without running the full matrix of tests, because it does not

[GitHub] [airflow] mik-laj closed issue #14573: DockerOperator: OCI Runtime create failed: exec: "PYTHONPATH=.": executable file not found in $PATH: unknown

2021-03-04 Thread GitBox
mik-laj closed issue #14573: URL: https://github.com/apache/airflow/issues/14573 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] mik-laj commented on issue #14573: DockerOperator: OCI Runtime create failed: exec: "PYTHONPATH=.": executable file not found in $PATH: unknown

2021-03-04 Thread GitBox
mik-laj commented on issue #14573: URL: https://github.com/apache/airflow/issues/14573#issuecomment-791028808 I agree with @xinbinhuang. It doesn't look like a bug. This is an automated message from the Apache Git Service.

[GitHub] [airflow] github-actions[bot] commented on pull request #14611: Remove duplicate dependencies

2021-03-04 Thread GitBox
github-actions[bot] commented on pull request #14611: URL: https://github.com/apache/airflow/pull/14611#issuecomment-791028760 [The Workflow run](https://github.com/apache/airflow/actions/runs/622488598) is cancelling this PR. Building images for the PR has failed. Follow the the workflow

[GitHub] [airflow] kaxil commented on issue #14598: Provide shared storage between task via pluggable storage providers (akin to S3 remote logging)

2021-03-04 Thread GitBox
kaxil commented on issue #14598: URL: https://github.com/apache/airflow/issues/14598#issuecomment-791019313 @ecerulm Mailing list is the best place This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] marcosmarxm commented on a change in pull request #14492: Adds new community provider Airbyte

2021-03-04 Thread GitBox
marcosmarxm commented on a change in pull request #14492: URL: https://github.com/apache/airflow/pull/14492#discussion_r587893347 ## File path: airflow/providers/airbyte/example_dags/example_airbyte_trigger_job.py ## @@ -0,0 +1,66 @@ +# +# Licensed to the Apache Software

[GitHub] [airflow] marcosmarxm commented on a change in pull request #14492: Adds new community provider Airbyte

2021-03-04 Thread GitBox
marcosmarxm commented on a change in pull request #14492: URL: https://github.com/apache/airflow/pull/14492#discussion_r587893347 ## File path: airflow/providers/airbyte/example_dags/example_airbyte_trigger_job.py ## @@ -0,0 +1,66 @@ +# +# Licensed to the Apache Software

[GitHub] [airflow] marcosmarxm commented on a change in pull request #14492: Adds new community provider Airbyte

2021-03-04 Thread GitBox
marcosmarxm commented on a change in pull request #14492: URL: https://github.com/apache/airflow/pull/14492#discussion_r587893347 ## File path: airflow/providers/airbyte/example_dags/example_airbyte_trigger_job.py ## @@ -0,0 +1,66 @@ +# +# Licensed to the Apache Software

[GitHub] [airflow] xinbinhuang edited a comment on pull request #14418: Fix #14417 : Failing to submit Druid ingestion task

2021-03-04 Thread GitBox
xinbinhuang edited a comment on pull request #14418: URL: https://github.com/apache/airflow/pull/14418#issuecomment-790981879 @TheRum sorry for the late response. You can use the same `expected` and `assert` from the previous test case `test_render_template`. The idea here is to make sure

[GitHub] [airflow] xinbinhuang commented on pull request #14418: Fix #14417 : Failing to submit Druid ingestion task

2021-03-04 Thread GitBox
xinbinhuang commented on pull request #14418: URL: https://github.com/apache/airflow/pull/14418#issuecomment-790981879 @TheRum sorry for the late response. You can use the same `expected` and `assert` from the previous test case `test_render_template`. The idea here is to make sure that

[GitHub] [airflow] github-actions[bot] commented on pull request #14606: Use built-in `cached_property` on Python 3.8 where possible

2021-03-04 Thread GitBox
github-actions[bot] commented on pull request #14606: URL: https://github.com/apache/airflow/pull/14606#issuecomment-790978548 [The Workflow run](https://github.com/apache/airflow/actions/runs/622370410) is cancelling this PR. Building images for the PR has failed. Follow the the workflow

[GitHub] [airflow] dstandish commented on a change in pull request #14492: Adds new community provider Airbyte

2021-03-04 Thread GitBox
dstandish commented on a change in pull request #14492: URL: https://github.com/apache/airflow/pull/14492#discussion_r587858660 ## File path: airflow/providers/airbyte/hooks/airbyte.py ## @@ -0,0 +1,99 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or

[GitHub] [airflow] ryanahamilton opened a new pull request #14611: Remove duplicate dependecies

2021-03-04 Thread GitBox
ryanahamilton opened a new pull request #14611: URL: https://github.com/apache/airflow/pull/14611 These three “devDependencies” already exist (same versions) in “dependencies”. A `yarn install` of this modified `package.json` has no impact on the generated `yarn.lock`. Avoids potential

[GitHub] [airflow] ecerulm commented on issue #14598: Provide shared storage between task via pluggable storage providers (akin to S3 remote logging)

2021-03-04 Thread GitBox
ecerulm commented on issue #14598: URL: https://github.com/apache/airflow/issues/14598#issuecomment-790965006 I must confess that I didn't know about [Airflow 2.0: DAG Authoring Redesigned](https://medium.com/apache-airflow/airflow-2-0-dag-authoring-redesigned-651edc397178) and that it

[GitHub] [airflow] github-actions[bot] commented on pull request #14581: Rename last_scheduler_run into last_parsed_time, and ensure it's updated in DB

2021-03-04 Thread GitBox
github-actions[bot] commented on pull request #14581: URL: https://github.com/apache/airflow/pull/14581#issuecomment-790940020 [The Workflow run](https://github.com/apache/airflow/actions/runs/622370410) is cancelling this PR. It has some failed jobs matching ^Pylint$,^Static

[GitHub] [airflow] ashb closed pull request #14606: Use built-in `cached_property` on Python 3.8 where possible

2021-03-04 Thread GitBox
ashb closed pull request #14606: URL: https://github.com/apache/airflow/pull/14606 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] marcosmarxm commented on a change in pull request #14492: Adds new community provider Airbyte

2021-03-04 Thread GitBox
marcosmarxm commented on a change in pull request #14492: URL: https://github.com/apache/airflow/pull/14492#discussion_r587821411 ## File path: airflow/providers/airbyte/hooks/airbyte.py ## @@ -0,0 +1,99 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or

[GitHub] [airflow] github-actions[bot] commented on pull request #14418: Fix #14417 : Failing to submit Druid ingestion task

2021-03-04 Thread GitBox
github-actions[bot] commented on pull request #14418: URL: https://github.com/apache/airflow/pull/14418#issuecomment-790926509 [The Workflow run](https://github.com/apache/airflow/actions/runs/622275036) is cancelling this PR. Building images for the PR has failed. Follow the the workflow

[GitHub] [airflow] marcosmarxm commented on a change in pull request #14492: Adds new community provider Airbyte

2021-03-04 Thread GitBox
marcosmarxm commented on a change in pull request #14492: URL: https://github.com/apache/airflow/pull/14492#discussion_r587809789 ## File path: airflow/providers/airbyte/operators/airbyte.py ## @@ -0,0 +1,78 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one

[GitHub] [airflow] dstandish commented on a change in pull request #14492: Adds new community provider Airbyte

2021-03-04 Thread GitBox
dstandish commented on a change in pull request #14492: URL: https://github.com/apache/airflow/pull/14492#discussion_r587808062 ## File path: airflow/providers/airbyte/operators/airbyte.py ## @@ -0,0 +1,77 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +#

[GitHub] [airflow] TheRum commented on pull request #14418: Fix #14417 : Failing to submit Druid ingestion task

2021-03-04 Thread GitBox
TheRum commented on pull request #14418: URL: https://github.com/apache/airflow/pull/14418#issuecomment-790917666 @xinbinhuang Can you please suggest any changes to test case ? Once task is submitted/run, it should generate a druid task_id and completed.

[GitHub] [airflow] kuga14 commented on issue #14610: GCSToS3Operator ERROR - An error occurred (AccessDenied) when calling the PutObject operation: Access Denied

2021-03-04 Thread GitBox
kuga14 commented on issue #14610: URL: https://github.com/apache/airflow/issues/14610#issuecomment-790912134 I've found the reason of this behavior. My 'yandexcloud_default' connection schema is set to 'default' value This

[GitHub] [airflow] kuga14 closed issue #14610: GCSToS3Operator ERROR - An error occurred (AccessDenied) when calling the PutObject operation: Access Denied

2021-03-04 Thread GitBox
kuga14 closed issue #14610: URL: https://github.com/apache/airflow/issues/14610 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [airflow] dstandish commented on a change in pull request #14492: Adds new community provider Airbyte

2021-03-04 Thread GitBox
dstandish commented on a change in pull request #14492: URL: https://github.com/apache/airflow/pull/14492#discussion_r587763575 ## File path: airflow/providers/airbyte/hooks/airbyte.py ## @@ -0,0 +1,99 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or

[GitHub] [airflow] dstandish commented on a change in pull request #14492: Adds new community provider Airbyte

2021-03-04 Thread GitBox
dstandish commented on a change in pull request #14492: URL: https://github.com/apache/airflow/pull/14492#discussion_r587737276 ## File path: airflow/providers/airbyte/example_dags/example_airbyte_trigger_job.py ## @@ -0,0 +1,66 @@ +# +# Licensed to the Apache Software

[GitHub] [airflow] kaxil commented on pull request #14581: Ensure last_scheduler_run is updated in DB

2021-03-04 Thread GitBox
kaxil commented on pull request #14581: URL: https://github.com/apache/airflow/pull/14581#issuecomment-790869922 I would vote for `last_parsed_time` This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] github-actions[bot] commented on pull request #14219: Provide login endpoint for the REST API with JWT authentication method

2021-03-04 Thread GitBox
github-actions[bot] commented on pull request #14219: URL: https://github.com/apache/airflow/pull/14219#issuecomment-790869420 [The Workflow run](https://github.com/apache/airflow/actions/runs/622127230) is cancelling this PR. It has some failed jobs matching ^Pylint$,^Static

[GitHub] [airflow] github-actions[bot] commented on pull request #14219: Provide login endpoint for the REST API with JWT authentication method

2021-03-04 Thread GitBox
github-actions[bot] commented on pull request #14219: URL: https://github.com/apache/airflow/pull/14219#issuecomment-790868876 [The Workflow run](https://github.com/apache/airflow/actions/runs/622105358) is cancelling this PR. It has some failed jobs matching ^Pylint$,^Static

[GitHub] [airflow] kaxil commented on a change in pull request #14588: Fill DagBag from dag_folder setting for upgrade rules

2021-03-04 Thread GitBox
kaxil commented on a change in pull request #14588: URL: https://github.com/apache/airflow/pull/14588#discussion_r587755783 ## File path: airflow/upgrade/rules/no_additional_args_in_operators.py ## @@ -43,7 +42,11 @@ def check(self, dags_folder=None): old_level =

[GitHub] [airflow] kaxil edited a comment on issue #14598: Provide shared storage between task via pluggable storage providers (akin to S3 remote logging)

2021-03-04 Thread GitBox
kaxil edited a comment on issue #14598: URL: https://github.com/apache/airflow/issues/14598#issuecomment-790867151 There is some discussion around it here: - https://lists.apache.org/thread.html/rd6926b3442ad85f1ce72c5e2e80d8a31c0b5707da17b614ebb48c8c4%40%3Cdev.airflow.apache.org%3E

[GitHub] [airflow] kaxil commented on issue #14598: Provide shared storage between task via pluggable storage providers (akin to S3 remote logging)

2021-03-04 Thread GitBox
kaxil commented on issue #14598: URL: https://github.com/apache/airflow/issues/14598#issuecomment-790867151 There is some discussion around it here: - https://lists.apache.org/thread.html/rd6926b3442ad85f1ce72c5e2e80d8a31c0b5707da17b614ebb48c8c4%40%3Cdev.airflow.apache.org%3E -

[GitHub] [airflow] kuga14 opened a new issue #14610: GCSToS3Operator ERROR - An error occurred (AccessDenied) when calling the PutObject operation: Access Denied

2021-03-04 Thread GitBox
kuga14 opened a new issue #14610: URL: https://github.com/apache/airflow/issues/14610 **Version: v2.0.1** **Git Version:.release:2.0.1+beb8af5ac6c438c29e2c186145115fb1334a3735** **Docker Image Tag 2.0.1-python3.8-build** **What happened:** Try to use GCSToS3Operator to sync

[GitHub] [airflow] boring-cyborg[bot] commented on issue #14610: GCSToS3Operator ERROR - An error occurred (AccessDenied) when calling the PutObject operation: Access Denied

2021-03-04 Thread GitBox
boring-cyborg[bot] commented on issue #14610: URL: https://github.com/apache/airflow/issues/14610#issuecomment-790865310 Thanks for opening your first issue here! Be sure to follow the issue template! This is an

[airflow] branch master updated (1c23e91 -> 9f37af2)

2021-03-04 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 1c23e91 Bump Redoc to resolve vulnerability in sub-dependency (#14608) add 9f37af2 Fix docstrings for

[GitHub] [airflow] zachliu commented on issue #9975: max_active_runs = 1 can still create multiple active execution runs

2021-03-04 Thread GitBox
zachliu commented on issue #9975: URL: https://github.com/apache/airflow/issues/9975#issuecomment-790864871 @FredericoCoelhoNunes i didn't create a stable API, i generated a Python client and use it to interact with the stable API: ```python from

[GitHub] [airflow] kaxil merged pull request #14605: Fix docstrings for Kubernetes code

2021-03-04 Thread GitBox
kaxil merged pull request #14605: URL: https://github.com/apache/airflow/pull/14605 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] turbaszek commented on a change in pull request #14492: Adds new community provider Airbyte

2021-03-04 Thread GitBox
turbaszek commented on a change in pull request #14492: URL: https://github.com/apache/airflow/pull/14492#discussion_r587747285 ## File path: airflow/providers/airbyte/sensors/airbyte.py ## @@ -0,0 +1,72 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or

[GitHub] [airflow] xinbinhuang commented on issue #14598: Provide shared storage between task via pluggable storage providers (akin to S3 remote logging)

2021-03-04 Thread GitBox
xinbinhuang commented on issue #14598: URL: https://github.com/apache/airflow/issues/14598#issuecomment-790859549 I think it would be nice to have `CustomXComBackend` for some common providers (e.g. GCP, AWS, Azure, etc.) added to `core/providers` as similar to `SecretsBackend`. What do

[GitHub] [airflow] turbaszek commented on a change in pull request #14492: Adds new community provider Airbyte

2021-03-04 Thread GitBox
turbaszek commented on a change in pull request #14492: URL: https://github.com/apache/airflow/pull/14492#discussion_r587736397 ## File path: airflow/__init__.py ## @@ -1,91 +0,0 @@ -# -# Licensed to the Apache Software Foundation (ASF) under one -# or more contributor license

[GitHub] [airflow] github-actions[bot] commented on pull request #14607: Do not suppress error in airflow plugins cli

2021-03-04 Thread GitBox
github-actions[bot] commented on pull request #14607: URL: https://github.com/apache/airflow/pull/14607#issuecomment-790841751 [The Workflow run](https://github.com/apache/airflow/actions/runs/621890607) is cancelling this PR. It has some failed jobs matching ^Pylint$,^Static

[airflow] branch master updated: Bump Redoc to resolve vulnerability in sub-dependency (#14608)

2021-03-04 Thread ryanahamilton
This is an automated email from the ASF dual-hosted git repository. ryanahamilton pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/master by this push: new 1c23e91 Bump Redoc to resolve

[GitHub] [airflow] ryanahamilton merged pull request #14608: Bump Redoc to resolve vulnerability in sub-dependency

2021-03-04 Thread GitBox
ryanahamilton merged pull request #14608: URL: https://github.com/apache/airflow/pull/14608 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [airflow] github-actions[bot] commented on pull request #14608: Bump Redoc to resolve vulnerability in sub-dependency

2021-03-04 Thread GitBox
github-actions[bot] commented on pull request #14608: URL: https://github.com/apache/airflow/pull/14608#issuecomment-790819642 The PR is likely OK to be merged with just subset of tests for default Python and Database versions without running the full matrix of tests, because it does not

[GitHub] [airflow] fhoda commented on issue #14592: Unreachable Secrets Backend Causes Web Server Crash

2021-03-04 Thread GitBox
fhoda commented on issue #14592: URL: https://github.com/apache/airflow/issues/14592#issuecomment-790817766 I have not experienced the web server crashing (probably because of DAG serialization being enabled), but do have task failures that don't check the downstream Secrets Backends if

[GitHub] [airflow] ryanahamilton closed pull request #14550: Bump prismjs from 1.21.0 to 1.23.0 in /airflow/www

2021-03-04 Thread GitBox
ryanahamilton closed pull request #14550: URL: https://github.com/apache/airflow/pull/14550 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [airflow] dependabot[bot] commented on pull request #14550: Bump prismjs from 1.21.0 to 1.23.0 in /airflow/www

2021-03-04 Thread GitBox
dependabot[bot] commented on pull request #14550: URL: https://github.com/apache/airflow/pull/14550#issuecomment-790807363 OK, I won't notify you again about this release, but will get in touch when a new version is available. If you'd rather skip all updates until the next major or minor

[GitHub] [airflow] ryanahamilton commented on pull request #14550: Bump prismjs from 1.21.0 to 1.23.0 in /airflow/www

2021-03-04 Thread GitBox
ryanahamilton commented on pull request #14550: URL: https://github.com/apache/airflow/pull/14550#issuecomment-790807334 Closing in favor of #14608 that bumps the parent package and resolves the same vulnerability. This is

[GitHub] [airflow] ryanahamilton opened a new pull request #14608: Bump Redoc to resolve vulnerability in sub-dependency

2021-03-04 Thread GitBox
ryanahamilton opened a new pull request #14608: URL: https://github.com/apache/airflow/pull/14608 Replaces #14550 as it resolves the same vulnerability caused by prismjs, a dependency of Redoc. I ran and tested the Redoc web interface after bumping.

[GitHub] [airflow] github-actions[bot] commented on pull request #14606: Use built-in `cached_property` on Python 3.8 where possible

2021-03-04 Thread GitBox
github-actions[bot] commented on pull request #14606: URL: https://github.com/apache/airflow/pull/14606#issuecomment-790798673 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] github-actions[bot] commented on pull request #14605: Fix docstrings for Kubernetes code

2021-03-04 Thread GitBox
github-actions[bot] commented on pull request #14605: URL: https://github.com/apache/airflow/pull/14605#issuecomment-790797255 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] github-actions[bot] commented on pull request #14588: Fill DagBag from dag_folder setting for upgrade rules

2021-03-04 Thread GitBox
github-actions[bot] commented on pull request #14588: URL: https://github.com/apache/airflow/pull/14588#issuecomment-790784870 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] XD-DENG commented on pull request #14581: Ensure last_scheduler_run is updated in DB

2021-03-04 Thread GitBox
XD-DENG commented on pull request #14581: URL: https://github.com/apache/airflow/pull/14581#issuecomment-790776421 > That column name is wrong now though -- I wonder if it is worth updating/renaming that to "last_parsed_time" or "last_seen_time"? Good point. I favor

[GitHub] [airflow] ashb commented on issue #14364: Missing schedule_delay metric

2021-03-04 Thread GitBox
ashb commented on issue #14364: URL: https://github.com/apache/airflow/issues/14364#issuecomment-790769619 When you say "emitted all the time" what are you thinking? Could you provide a bit more detail to what you mean?

[GitHub] [airflow] ashb edited a comment on pull request #14581: Ensure last_scheduler_run is updated in DB

2021-03-04 Thread GitBox
ashb edited a comment on pull request #14581: URL: https://github.com/apache/airflow/pull/14581#issuecomment-790768377 That column name is wrong now though -- I wonder if it is worth updating/renaming that to "last_parsed_time" or "last_seen_time"?

[GitHub] [airflow] ashb commented on pull request #14581: Ensure last_scheduler_run is updated in DB

2021-03-04 Thread GitBox
ashb commented on pull request #14581: URL: https://github.com/apache/airflow/pull/14581#issuecomment-790768377 That column name is wrong now though -- I wonder if it is worth updating/renaming that to "last_parsed_time"?

[GitHub] [airflow] ecerulm opened a new pull request #14607: Do not suppress error in airflow plugins cli

2021-03-04 Thread GitBox
ecerulm opened a new pull request #14607: URL: https://github.com/apache/airflow/pull/14607 Currently `airflow plugins` with suppress all errors, and warnings, so for example if the plugins contain errors, the output will simply show ``` airflow plugins No plugins loaded ```

  1   2   >