[GitHub] [airflow] lukas-at-harren edited a comment on issue #13542: Task stuck in "scheduled" or "queued" state, pool has all slots queued, nothing is executing

2021-04-05 Thread GitBox
lukas-at-harren edited a comment on issue #13542: URL: https://github.com/apache/airflow/issues/13542#issuecomment-813831995 @kaxil I have checked, `min_file_process_interval` is set to `30`, however the problem is still there for me. @SalmonTimo I have a pretty high CPU utilisation

[GitHub] [airflow] lukas-at-harren commented on issue #13542: Task stuck in "scheduled" or "queued" state, pool has all slots queued, nothing is executing

2021-04-05 Thread GitBox
lukas-at-harren commented on issue #13542: URL: https://github.com/apache/airflow/issues/13542#issuecomment-813831995 @kaxil I have checked, `min_file_process_interval` is set to `30`, however the problem is still there for me. @SalmonTimo I have a pretty high CPU utilisation (60%),

[GitHub] [airflow] ginevragaudioso removed a comment on pull request #15210: order query to find out tasks to queue

2021-04-05 Thread GitBox
ginevragaudioso removed a comment on pull request #15210: URL: https://github.com/apache/airflow/pull/15210#issuecomment-813749166 @ashb @kaxil @XD-DENG Could some of you help with the check failures? I'd love to get this PR ready, but I am having a hard time understanding how the

[GitHub] [airflow] mik-laj commented on a change in pull request #15222: Run kubernetes tests in parallel

2021-04-05 Thread GitBox
mik-laj commented on a change in pull request #15222: URL: https://github.com/apache/airflow/pull/15222#discussion_r607450356 ## File path: scripts/ci/kubernetes/ci_setup_clusters_and_run_kubernetes_tests_in_parallel.sh ## @@ -0,0 +1,106 @@ +#!/usr/bin/env bash +# Licensed to

[GitHub] [airflow] potiuk opened a new pull request #15222: Run kubernetes tests in parallel

2021-04-05 Thread GitBox
potiuk opened a new pull request #15222: URL: https://github.com/apache/airflow/pull/15222 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#pull-request-guidelines)** for more

[GitHub] [airflow] mik-laj commented on issue #15198: "cannot import make_kwargs_callable" occurs when using airflow.providers.http.operators.http in 1.10.14.

2021-04-05 Thread GitBox
mik-laj commented on issue #15198: URL: https://github.com/apache/airflow/issues/15198#issuecomment-813779593 If you are using Docker, you don't even need to prepare the pip package, but you can overwrite the required files in your image. -- This is an automated message from the Apache

[GitHub] [airflow] girishrd2004 commented on issue #13542: Task stuck in "scheduled" or "queued" state, pool has all slots queued, nothing is executing

2021-04-05 Thread GitBox
girishrd2004 commented on issue #13542: URL: https://github.com/apache/airflow/issues/13542#issuecomment-813778875 I had the task stuck because I changed the DAG id as part of my code change. After reverting the DAG id change, things worked fine. However the old queued tasks had to be

[GitHub] [airflow] mik-laj commented on issue #15198: "cannot import make_kwargs_callable" occurs when using airflow.providers.http.operators.http in 1.10.14.

2021-04-05 Thread GitBox
mik-laj commented on issue #15198: URL: https://github.com/apache/airflow/issues/15198#issuecomment-813778747 > Can you at least explore this before dismissing it completely? There have been drastic differences between the Airflow 2.0 and Airflow 1.10 releases, and cherry-picking

[airflow] branch master updated (e1beefc -> aebacd7)

2021-04-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from e1beefc Fix test bug introduced by #15165 (#15221) add aebacd7 Constraints are now parallelized and merged

[GitHub] [airflow] potiuk merged pull request #15211: Constraints are now parallelized and merged in single job

2021-04-05 Thread GitBox
potiuk merged pull request #15211: URL: https://github.com/apache/airflow/pull/15211 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [airflow] github-actions[bot] commented on pull request #15211: Constraints are now parallelized and merged in single job

2021-04-05 Thread GitBox
github-actions[bot] commented on pull request #15211: URL: https://github.com/apache/airflow/pull/15211#issuecomment-813769834 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] odajun commented on issue #15198: "cannot import make_kwargs_callable" occurs when using airflow.providers.http.operators.http in 1.10.14.

2021-04-05 Thread GitBox
odajun commented on issue #15198: URL: https://github.com/apache/airflow/issues/15198#issuecomment-813767714 @mik-laj Thank you for confirming this. As for SimpleHttpOperator, I will try to upgrade it to 2.0.x without changing the import source. ``` from

[airflow] branch v2-0-test updated (601193f -> 5ce558c)

2021-04-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch v2-0-test in repository https://gitbox.apache.org/repos/asf/airflow.git. discard 601193f Less docker magic in docs building (#15176) new 5ce558c Less docker magic in docs building

[airflow] 01/01: Less docker magic in docs building (#15176)

2021-04-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-0-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 5ce558c3f91afe1ffb488bf5ec756a4f18d4c883 Author: Kamil BreguĊ‚a AuthorDate: Tue Apr 6 03:10:42 2021 +0200 Less

[airflow] branch constraints-2-0 updated: Updated to latest constraint version

2021-04-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch constraints-2-0 in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-2-0 by this push: new 59f34d5 Updated to latest

[GitHub] [airflow] potiuk merged pull request #15221: Fix test bug introduced by #15165

2021-04-05 Thread GitBox
potiuk merged pull request #15221: URL: https://github.com/apache/airflow/pull/15221 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[airflow] branch master updated (3bd1163 -> e1beefc)

2021-04-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 3bd1163 Less docker magic in docs building (#15176) add e1beefc Fix test bug introduced by #15165 (#15221)

[GitHub] [airflow] potiuk commented on pull request #15221: Fix test bug introduced by #15165

2021-04-05 Thread GitBox
potiuk commented on pull request #15221: URL: https://github.com/apache/airflow/pull/15221#issuecomment-813755138 I tested it locally. Works. Merging it to rebase other changes. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[airflow] branch v2-0-test updated: Less docker magic in docs building (#15176)

2021-04-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-0-test in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/v2-0-test by this push: new 601193f Less docker magic in docs

[GitHub] [airflow] github-actions[bot] commented on pull request #15221: Fix test bug introduced by #15165

2021-04-05 Thread GitBox
github-actions[bot] commented on pull request #15221: URL: https://github.com/apache/airflow/pull/15221#issuecomment-813754030 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] dimberman opened a new pull request #15221: Fix test bug introduced by #15165

2021-04-05 Thread GitBox
dimberman opened a new pull request #15221: URL: https://github.com/apache/airflow/pull/15221 https://github.com/apache/airflow/pull/15165 introduced a bug in the kubernetes_executor tests. This fixes that bug by changing pytest mock --- **^ Add meaningful description

[airflow] branch master updated (c73052f -> 3bd1163)

2021-04-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from c73052f Update .github/CODEOWNERS (#15215) add 3bd1163 Less docker magic in docs building (#15176) No new

[GitHub] [airflow] potiuk merged pull request #15176: Less docker magic in docs building

2021-04-05 Thread GitBox
potiuk merged pull request #15176: URL: https://github.com/apache/airflow/pull/15176 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [airflow] SangwanP commented on pull request #15216: Fix deprecated warning hvac auth

2021-04-05 Thread GitBox
SangwanP commented on pull request #15216: URL: https://github.com/apache/airflow/pull/15216#issuecomment-813752172 Appreciate the resources! While diagnosing the cause for this, I realized I made a branch name typo while rebasing. Looking forward to contributing to the project in the

[GitHub] [airflow] potiuk commented on pull request #15176: Less docker magic in docs building

2021-04-05 Thread GitBox
potiuk commented on pull request #15176: URL: https://github.com/apache/airflow/pull/15176#issuecomment-813752048 It's a different problem - merging this one now -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [airflow] mik-laj commented on pull request #15216: Fix deprecated warning hvac auth

2021-04-05 Thread GitBox
mik-laj commented on pull request #15216: URL: https://github.com/apache/airflow/pull/15216#issuecomment-813749598 I suggest always doing rebase in interactive mode. This way, many troubles can be avoided. ```shell export EDITOR='code --wait' git fetch apache git rebase -i

[GitHub] [airflow] andrewgodwin commented on pull request #15212: Fixed #9963: Display explicit error in case UID has no actual username

2021-04-05 Thread GitBox
andrewgodwin commented on pull request #15212: URL: https://github.com/apache/airflow/pull/15212#issuecomment-813749344 > Imports are failing when you import providers. Providers are supposed to work even with older versions of Airflow Ah yes! That's on me, I'm still getting used to

[GitHub] [airflow] ginevragaudioso commented on pull request #15210: AIRFLOW-15171 order query to find out tasks to queue

2021-04-05 Thread GitBox
ginevragaudioso commented on pull request #15210: URL: https://github.com/apache/airflow/pull/15210#issuecomment-813749166 @ashb @kaxil @XD-DENG Could some of you help with the check failures? I'd love to get this PR ready, but I am having a hard time understanding how the failure is

[GitHub] [airflow] kaxil commented on pull request #15216: Fix deprecated warning hvac auth

2021-04-05 Thread GitBox
kaxil commented on pull request #15216: URL: https://github.com/apache/airflow/pull/15216#issuecomment-813749002 Hey no issues at all :) We are very glad you are here to help Airflow better. Looks like you have already fixed issues with commit. We had instructions on How to rebase

[GitHub] [airflow] kaxil closed issue #15149: Kubernetes Executor does not delete pods stuck at creating because of volume mount errors

2021-04-05 Thread GitBox
kaxil closed issue #15149: URL: https://github.com/apache/airflow/issues/15149 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [airflow] SangwanP commented on pull request #15216: Fix deprecated warning hvac auth

2021-04-05 Thread GitBox
SangwanP commented on pull request #15216: URL: https://github.com/apache/airflow/pull/15216#issuecomment-813745062 Apologies, everyone. It's my first PR here and I made some mistake while rebasing which caused all the other changes to get pushed here as well. How do you guys suggest I

[GitHub] [airflow] kaxil commented on pull request #15216: Fix deprecated warning hvac auth

2021-04-05 Thread GitBox
kaxil commented on pull request #15216: URL: https://github.com/apache/airflow/pull/15216#issuecomment-813745031 Can you rebase on the master please, looks like some extra commits exists on your PR, most likely due to merging master -- This is an automated message from the Apache Git

[airflow] branch v2-0-test updated: not fail on missing status in tests

2021-04-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-0-test in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/v2-0-test by this push: new 752191d not fail on missing status in

[GitHub] [airflow] github-actions[bot] closed pull request #12768: Add extended information about XCom backends in docs

2021-04-05 Thread GitBox
github-actions[bot] closed pull request #12768: URL: https://github.com/apache/airflow/pull/12768 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this

[GitHub] [airflow] github-actions[bot] commented on issue #12251: 'TaskInstance' object has no attribute 'get_previous_execution_date'

2021-04-05 Thread GitBox
github-actions[bot] commented on issue #12251: URL: https://github.com/apache/airflow/issues/12251#issuecomment-813735856 This issue has been automatically marked as stale because it has been open for 30 days with no response from the author. It will be closed in next 7 days if no further

[GitHub] [airflow] github-actions[bot] closed pull request #12638: Allow BashOperator to take command as list

2021-04-05 Thread GitBox
github-actions[bot] closed pull request #12638: URL: https://github.com/apache/airflow/pull/12638 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this

[GitHub] [airflow] github-actions[bot] closed pull request #13894: critical class definition issue

2021-04-05 Thread GitBox
github-actions[bot] closed pull request #13894: URL: https://github.com/apache/airflow/pull/13894 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this

[GitHub] [airflow] github-actions[bot] commented on pull request #15220: Use context manager to manage pools

2021-04-05 Thread GitBox
github-actions[bot] commented on pull request #15220: URL: https://github.com/apache/airflow/pull/15220#issuecomment-813735670 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] potiuk edited a comment on pull request #15176: Less docker magic in docs building

2021-04-05 Thread GitBox
potiuk edited a comment on pull request #15176: URL: https://github.com/apache/airflow/pull/15176#issuecomment-813734939 I pushed rebase for master that likely caused the kubernetes tests failures -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [airflow] potiuk commented on pull request #15176: Less docker magic in docs building

2021-04-05 Thread GitBox
potiuk commented on pull request #15176: URL: https://github.com/apache/airflow/pull/15176#issuecomment-813734939 I pushed rebase for master that likely casued the kubernetes tests failures -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [airflow] kaxil closed issue #15077: [KubernetesExecutor] Task stuck in queued state after pod end with up_for_reschedule

2021-04-05 Thread GitBox
kaxil closed issue #15077: URL: https://github.com/apache/airflow/issues/15077 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [airflow] jedcunningham commented on issue #14307: KubernetesPodOperator raises exception when pod_template_file contains multiple objects

2021-04-05 Thread GitBox
jedcunningham commented on issue #14307: URL: https://github.com/apache/airflow/issues/14307#issuecomment-813716813 @everglory99, have you considered exposing a way to add these extra objects into your helm chart, say via `extraConfigMaps` etc or more generally `extraObjects`? It seems

[GitHub] [airflow] jedcunningham commented on issue #13888: Kubernetes Launchers Log Check in Time is Not Configurable - Excess Logs Slow Airflow

2021-04-05 Thread GitBox
jedcunningham commented on issue #13888: URL: https://github.com/apache/airflow/issues/13888#issuecomment-813712563 @alittlesliceoftom, are you seeing a bunch of occurrences of this log line?

[airflow] branch master updated: Update .github/CODEOWNERS (#15215)

2021-04-05 Thread kamilbregula
This is an automated email from the ASF dual-hosted git repository. kamilbregula pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/master by this push: new c73052f Update .github/CODEOWNERS

[GitHub] [airflow] mik-laj merged pull request #15215: Update .github/CODEOWNERS

2021-04-05 Thread GitBox
mik-laj merged pull request #15215: URL: https://github.com/apache/airflow/pull/15215 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [airflow] mik-laj opened a new pull request #15220: Use context manager to manage pools

2021-04-05 Thread GitBox
mik-laj opened a new pull request #15220: URL: https://github.com/apache/airflow/pull/15220 To make sure that the processes are properly closed, we should use a context manager to manage the processes. This also marks their life cycle, which makes the code more readable. Depends

[GitHub] [airflow] mik-laj commented on pull request #15176: Less docker magic in docs building

2021-04-05 Thread GitBox
mik-laj commented on pull request #15176: URL: https://github.com/apache/airflow/pull/15176#issuecomment-813701693 "Build docs" step is greeen. Before: > Elapsed time spent in the script: 589 seconds After: > Elapsed time spent in the script: 510 seconds

[GitHub] [airflow] jedcunningham commented on issue #14619: json.decoder.JSONDecodeError: Expecting property name enclosed in double quotes: line 1 column 2 (char 1)

2021-04-05 Thread GitBox
jedcunningham commented on issue #14619: URL: https://github.com/apache/airflow/issues/14619#issuecomment-813699611 > Not the kube_client_request_args, tried that with escaping the " Can you try without anything for `kube_client_request_args`, e.g: ```

[GitHub] [airflow] potiuk commented on pull request #15212: Fixed #9963: Display explicit error in case UID has no actual username

2021-04-05 Thread GitBox
potiuk commented on pull request #15212: URL: https://github.com/apache/airflow/pull/15212#issuecomment-813698561 @andrewgodwin -> One more change is needed. Imports are failing when you import providers. Providers are supposed to work even with older versions of Airflow, so you shoudl

[GitHub] [airflow] github-actions[bot] commented on pull request #15212: Fixed #9963: Fall back to UID if no current username

2021-04-05 Thread GitBox
github-actions[bot] commented on pull request #15212: URL: https://github.com/apache/airflow/pull/15212#issuecomment-813697655 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] potiuk commented on pull request #15212: Fixed #9963: Fall back to UID if no current username

2021-04-05 Thread GitBox
potiuk commented on pull request #15212: URL: https://github.com/apache/airflow/pull/15212#issuecomment-813696590 > Generally, though, I have found that a surprising number of tools will happily work without an actual user record, so there is a user expectation here when they're firing

[GitHub] [airflow] mik-laj commented on pull request #15100: Add support for arbitrary json in conn uri format

2021-04-05 Thread GitBox
mik-laj commented on pull request #15100: URL: https://github.com/apache/airflow/pull/15100#issuecomment-813696555 > Would you say we should merge as is? Do you think this needs to go to mailing list? I don't think this needs a mailing list discussion, but I called a second

[GitHub] [airflow] github-actions[bot] commented on pull request #15100: Add support for arbitrary json in conn uri format

2021-04-05 Thread GitBox
github-actions[bot] commented on pull request #15100: URL: https://github.com/apache/airflow/pull/15100#issuecomment-813696318 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] jedcunningham commented on issue #13916: ECONNRESET error in scheduler using KubernetesExecutor on AKS

2021-04-05 Thread GitBox
jedcunningham commented on issue #13916: URL: https://github.com/apache/airflow/issues/13916#issuecomment-813695523 Turning on tcp keepalive may (should) also help: https://airflow.apache.org/docs/apache-airflow/stable/configurations-ref.html#enable-tcp-keepalive -- This is an

[GitHub] [airflow] github-actions[bot] commented on pull request #15210: AIRFLOW-15171 order query to find out tasks to queue

2021-04-05 Thread GitBox
github-actions[bot] commented on pull request #15210: URL: https://github.com/apache/airflow/pull/15210#issuecomment-813695553 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [airflow] github-actions[bot] commented on pull request #15210: AIRFLOW-15171 order query to find out tasks to queue

2021-04-05 Thread GitBox
github-actions[bot] commented on pull request #15210: URL: https://github.com/apache/airflow/pull/15210#issuecomment-813695332 [The Workflow run](https://github.com/apache/airflow/actions/runs/720606699) is cancelling this PR. It has some failed jobs matching ^Pylint$,^Static

[GitHub] [airflow] mik-laj commented on a change in pull request #15215: Update .github/CODEOWNERS

2021-04-05 Thread GitBox
mik-laj commented on a change in pull request #15215: URL: https://github.com/apache/airflow/pull/15215#discussion_r607374566 ## File path: .github/CODEOWNERS ## @@ -26,8 +26,8 @@ /airflow/www/ @ryanahamilton @ashb # Providers -/airflow/providers/google/ @turbaszek

[GitHub] [airflow] vemikhaylov opened a new pull request #14500: Clear tasks by task ids in REST API

2021-04-05 Thread GitBox
vemikhaylov opened a new pull request #14500: URL: https://github.com/apache/airflow/pull/14500 closes: #13225 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries

[GitHub] [airflow] ephraimbuddy commented on pull request #14500: Clear tasks by task ids in REST API

2021-04-05 Thread GitBox
ephraimbuddy commented on pull request #14500: URL: https://github.com/apache/airflow/pull/14500#issuecomment-813689725 Closing and reopening to trigger test runs -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [airflow] ephraimbuddy closed pull request #14500: Clear tasks by task ids in REST API

2021-04-05 Thread GitBox
ephraimbuddy closed pull request #14500: URL: https://github.com/apache/airflow/pull/14500 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this

[GitHub] [airflow] dstandish commented on pull request #15146: Validate that the extra parameter is parseable as JSON

2021-04-05 Thread GitBox
dstandish commented on pull request #15146: URL: https://github.com/apache/airflow/pull/15146#issuecomment-813687022 alternatively we could continute to allow users to put arbitrary string in `extra`, but have change `extra_dejson` so that it returns `self.extra` in that case (instead of

[GitHub] [airflow] github-actions[bot] commented on pull request #15215: Update .github/CODEOWNERS

2021-04-05 Thread GitBox
github-actions[bot] commented on pull request #15215: URL: https://github.com/apache/airflow/pull/15215#issuecomment-813685591 The PR is likely ready to be merged. No tests are needed as no important environment files, nor python files were modified by it. However, committers might decide

[GitHub] [airflow] github-actions[bot] commented on pull request #15216: Fix deprecated warning hvac auth

2021-04-05 Thread GitBox
github-actions[bot] commented on pull request #15216: URL: https://github.com/apache/airflow/pull/15216#issuecomment-813685233 The PR is likely OK to be merged with just subset of tests for default Python and Database versions without running the full matrix of tests, because it does not

[GitHub] [airflow] jedcunningham opened a new issue #15219: Operators in cncf.kubernetes provider are configured differently

2021-04-05 Thread GitBox
jedcunningham opened a new issue #15219: URL: https://github.com/apache/airflow/issues/15219 The operators in the cncf.kubernetes provider use different methods of configuring where the k8s cluster you want run against is. `KubernetesPodOperator` uses `in_cluster`, `cluster_context`,

[GitHub] [airflow] mik-laj commented on pull request #15176: Less docker magic in docs building

2021-04-05 Thread GitBox
mik-laj commented on pull request #15176: URL: https://github.com/apache/airflow/pull/15176#issuecomment-813683155 I pushed the fix. In addition, I noticed that multiprocessing does not work on Mac OS and I fixed it. -- This is an automated message from the Apache Git Service. To

[GitHub] [airflow] dstandish commented on pull request #15100: Add support for arbitrary json in conn uri format

2021-04-05 Thread GitBox
dstandish commented on pull request #15100: URL: https://github.com/apache/airflow/pull/15100#issuecomment-813681040 > SGTM OK nice Would you say we should merge as is? Do you think this needs to go to mailing list? -- This is an automated message from the Apache Git

[GitHub] [airflow] jedcunningham commented on issue #15149: Kubernetes Executor does not delete pods stuck at creating because of volume mount errors

2021-04-05 Thread GitBox
jedcunningham commented on issue #15149: URL: https://github.com/apache/airflow/issues/15149#issuecomment-813678440 This is related to, but not a duplicate of that other one. This issue identifies that the poison pill (e.g. "Mark failed") doesn't clean up the pending pod.

[GitHub] [airflow] jedcunningham opened a new issue #15218: Task stuck in queued state with pending pod

2021-04-05 Thread GitBox
jedcunningham opened a new issue #15218: URL: https://github.com/apache/airflow/issues/15218 **Apache Airflow version**: 2.0.1 **Kubernetes version**: v1.19.7 **Executor**: KubernetesExecutor **What happened**: If you have a worker that gets stuck in pending forever, say

[GitHub] [airflow] potiuk commented on pull request #15176: Less docker magic in docs building

2021-04-05 Thread GitBox
potiuk commented on pull request #15176: URL: https://github.com/apache/airflow/pull/15176#issuecomment-813671971 Yeah :( -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [airflow] jedcunningham commented on issue #15077: [KubernetesExecutor] Task stuck in queued state after pod end with up_for_reschedule

2021-04-05 Thread GitBox
jedcunningham commented on issue #15077: URL: https://github.com/apache/airflow/issues/15077#issuecomment-813671966 This has been fixed in #14810, which will be in 2.0.2. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [airflow] andrewgodwin commented on pull request #15212: Fixed #9963: Fall back to UID if no current username

2021-04-05 Thread GitBox
andrewgodwin commented on pull request #15212: URL: https://github.com/apache/airflow/pull/15212#issuecomment-813671560 Honestly, I agree, I was just following along with the original ticket's suggestion since nobody suggested an explicit error instead so I presumed there was implicit

[airflow] 13/16: Fixes problem when Pull Request is `weird` - has null head_repo (#15189)

2021-04-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-0-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 25caba7e31baf6f6ae066a6dbe766b3afd08d5cc Author: Jarek Potiuk AuthorDate: Sun Apr 4 20:30:02 2021 +0200 Fixes

[airflow] 09/16: Merges prepare/test provider packages into two jobs (#15152)

2021-04-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-0-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 3c24a314128935d7b2b4ec821ee2c8efc8fbd016 Author: Jarek Potiuk AuthorDate: Sat Apr 3 12:48:54 2021 +0200 Merges

[airflow] 12/16: Bump K8S versions to latest supported ones. (#15156)

2021-04-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-0-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 3e9633e720b3eefa774087a4b8c9bacbbb22615a Author: Jarek Potiuk AuthorDate: Sun Apr 4 15:08:18 2021 +0200 Bump

[airflow] 16/16: Updates 3.6 limits for latest versions of a few libraries (#15209)

2021-04-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-0-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 5f5a914db9352453b2ca11dc415a7837a53be327 Author: Jarek Potiuk AuthorDate: Mon Apr 5 20:25:11 2021 +0200

[airflow] 10/16: Finish quarantine for test_should_force_kill_process (#15081)

2021-04-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-0-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 657e707aac3862af3a452ce39e56ff46cfa3d14c Author: Jarek Potiuk AuthorDate: Sat Apr 3 12:49:40 2021 +0200 Finish

[airflow] 14/16: Removes unused CI feature of printing output on error (#15190)

2021-04-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-0-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 3d172162837f9327135e4e051e303c827d70a708 Author: Jarek Potiuk AuthorDate: Sun Apr 4 22:20:11 2021 +0200

[airflow] 04/16: Add timeout to test jobs to prevent hanging docker containers (#15078)

2021-04-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-0-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 7a5c26cdde2dcd58378ff133ac7411e5a84aef55 Author: Jarek Potiuk AuthorDate: Wed Mar 31 01:01:47 2021 +0200 Add

[airflow] 15/16: Merges quarantined tests into single job (#15153)

2021-04-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-0-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit e87cd1f259f591aeaa0521ef79b9d6249739d411 Author: Jarek Potiuk AuthorDate: Mon Apr 5 19:58:10 2021 +0200 Merges

[airflow] 05/16: Better handling of docker command (#15080)

2021-04-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-0-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit f840d1674d3cc3634764fe2ee911332d9872df3a Author: Jarek Potiuk AuthorDate: Fri Apr 2 07:31:00 2021 +0200 Better

[airflow] 08/16: Increase timeout for building the docs (#15157)

2021-04-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-0-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 321237a74b2494d05804ce1ff1f3a315ccc65b7a Author: Jarek Potiuk AuthorDate: Sat Apr 3 10:27:58 2021 +0200

[airflow] 11/16: Adds Blinker dependency which is missing after recent changes (#15182)

2021-04-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-0-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 65c3ecf1f13411091e0bbfa669f69c89fe796964 Author: Jarek Potiuk AuthorDate: Sun Apr 4 01:57:56 2021 +0200 Adds

[airflow] 06/16: Mark the test_scheduler_task_start_date as quarantined (#15086)

2021-04-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-0-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 6e17675013071fe6eb3701464dee12a4b62560ba Author: Jarek Potiuk AuthorDate: Fri Apr 2 07:31:15 2021 +0200 Mark

[airflow] branch v2-0-test updated (663985d -> 5f5a914)

2021-04-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch v2-0-test in repository https://gitbox.apache.org/repos/asf/airflow.git. from 663985d Fix bug in airflow.stats timing that broke dogstatsd mode (#15132) new 530abe5 The

[airflow] 07/16: Fixes failing docs upload on master (#15148)

2021-04-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-0-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 30e5584d1d03d5a828a5f1e841b8c85817d4a059 Author: Jarek Potiuk AuthorDate: Fri Apr 2 19:25:58 2021 +0200 Fixes

[airflow] 03/16: Parallelize build of documentation. (#15062)

2021-04-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-0-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 17b89f3514e65c9671c722d40278ca8a0e8f2220 Author: Jarek Potiuk AuthorDate: Wed Mar 31 00:24:09 2021 +0200

[airflow] 01/16: The PYTHON_MAJOR_MINOR build arg has been deprecated (#15054)

2021-04-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-0-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 530abe5bbb254f0ec9a2331bc212bc570edc5ef5 Author: Jarek Potiuk AuthorDate: Sun Mar 28 20:58:52 2021 +0200 The

[airflow] 02/16: The --force-pull-images is restored in breeze (#15063)

2021-04-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-0-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit d7c45f359207488c72ac0567a959d3d77a9e9c1c Author: Jarek Potiuk AuthorDate: Tue Mar 30 01:02:48 2021 +0200 The

[GitHub] [airflow] dimberman merged pull request #15165: Separate Kubernetes pod_launcher from core airflow

2021-04-05 Thread GitBox
dimberman merged pull request #15165: URL: https://github.com/apache/airflow/pull/15165 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[airflow] branch master updated (643d158 -> 6d7a70b)

2021-04-05 Thread dimberman
This is an automated email from the ASF dual-hosted git repository. dimberman pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 643d158 Add support for modifying celery worker deployment strategy (#15213) add 6d7a70b Separate

[GitHub] [airflow] github-actions[bot] commented on pull request #15206: [WIP] Bump sphinx-autoapi from 1.0.0 to 1.7.5

2021-04-05 Thread GitBox
github-actions[bot] commented on pull request #15206: URL: https://github.com/apache/airflow/pull/15206#issuecomment-813667286 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [airflow] github-actions[bot] commented on pull request #15176: Less docker magic in docs building

2021-04-05 Thread GitBox
github-actions[bot] commented on pull request #15176: URL: https://github.com/apache/airflow/pull/15176#issuecomment-813667266 [The Workflow run](https://github.com/apache/airflow/actions/runs/720475959) is cancelling this PR. It has some failed jobs matching ^Pylint$,^Static

[GitHub] [airflow] github-actions[bot] commented on pull request #15176: Less docker magic in docs building

2021-04-05 Thread GitBox
github-actions[bot] commented on pull request #15176: URL: https://github.com/apache/airflow/pull/15176#issuecomment-813666946 [The Workflow run](https://github.com/apache/airflow/actions/runs/720460399) is cancelling this PR. It has some failed jobs matching ^Pylint$,^Static

[GitHub] [airflow] github-actions[bot] commented on pull request #15206: [WIP] Bump sphinx-autoapi from 1.0.0 to 1.7.5

2021-04-05 Thread GitBox
github-actions[bot] commented on pull request #15206: URL: https://github.com/apache/airflow/pull/15206#issuecomment-813666957 [The Workflow run](https://github.com/apache/airflow/actions/runs/720460399) is cancelling this PR. It has some failed jobs matching ^Pylint$,^Static

[airflow] branch master updated (e497228 -> 643d158)

2021-04-05 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from e497228 Updates 3.6 limits for latest versions of a few libraries (#15209) add 643d158 Add support for

[GitHub] [airflow] kaxil merged pull request #15213: Add support for modifying celery worker deployment strategy

2021-04-05 Thread GitBox
kaxil merged pull request #15213: URL: https://github.com/apache/airflow/pull/15213 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [airflow] mik-laj commented on pull request #15176: Less docker magic in docs building

2021-04-05 Thread GitBox
mik-laj commented on pull request #15176: URL: https://github.com/apache/airflow/pull/15176#issuecomment-813664215 There seems to be some problem. I am looking at it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [airflow] github-actions[bot] commented on pull request #15165: Separate Kubernetes pod_launcher from core airflow

2021-04-05 Thread GitBox
github-actions[bot] commented on pull request #15165: URL: https://github.com/apache/airflow/pull/15165#issuecomment-813661035 The PR is likely OK to be merged with just subset of tests for default Python and Database versions without running the full matrix of tests, because it does not

[GitHub] [airflow] github-actions[bot] commented on pull request #15214: Build priority packages in separate processes pool

2021-04-05 Thread GitBox
github-actions[bot] commented on pull request #15214: URL: https://github.com/apache/airflow/pull/15214#issuecomment-813660049 The PR is likely ready to be merged. No tests are needed as no important environment files, nor python files were modified by it. However, committers might decide

[GitHub] [airflow] mik-laj opened a new pull request #15217: Remove TaskInstance.log_filepath attribute

2021-04-05 Thread GitBox
mik-laj opened a new pull request #15217: URL: https://github.com/apache/airflow/pull/15217 Continuation of: https://github.com/apache/airflow/pull/9084 (I transfer this PR to my private account) --- **^ Add meaningful description above** Read the **[Pull

  1   2   3   >