[GitHub] [airflow] ekarsten commented on pull request #16341: Pass parameters to PostgresHook from PostgresOperator

2021-06-08 Thread GitBox
ekarsten commented on pull request #16341: URL: https://github.com/apache/airflow/pull/16341#issuecomment-857383697 First, thanks for the tip on specifying this information in the connections tab of the UI. I will say that in my testing, I find that these changes lead to different

[GitHub] [airflow] uranusjr commented on pull request #16341: Pass parameters to PostgresHook from PostgresOperator

2021-06-08 Thread GitBox
uranusjr commented on pull request #16341: URL: https://github.com/apache/airflow/pull/16341#issuecomment-857374084 That’s the extra field on the connection, but I don’t think passing the extras as an argument to `PostgresHook` would end up in there? Instead you need to set them [on the

[GitHub] [airflow] ekarsten commented on pull request #16341: Pass parameters to PostgresHook from PostgresOperator

2021-06-08 Thread GitBox
ekarsten commented on pull request #16341: URL: https://github.com/apache/airflow/pull/16341#issuecomment-857363291 The `extra` kwarg is used in a few places in the `PostgresHook`. For example line 91

[GitHub] [airflow] uranusjr commented on pull request #16341: Pass parameters to PostgresHook from PostgresOperator

2021-06-08 Thread GitBox
uranusjr commented on pull request #16341: URL: https://github.com/apache/airflow/pull/16341#issuecomment-857359704 I think I’m missing something. What does the `extra` kwarg do? It is not handled anywhere in `PostgresHook` from what I can tell. -- This is an automated message from the

[GitHub] [airflow] boring-cyborg[bot] commented on issue #16346: What Can I Do If Error AttributeError: module 'airflow' has no attribute 'startswith' Is Reported After the command 'airflow db init' i

2021-06-08 Thread GitBox
boring-cyborg[bot] commented on issue #16346: URL: https://github.com/apache/airflow/issues/16346#issuecomment-857352592 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] keep-forward opened a new issue #16346: What Can I Do If Error AttributeError: module 'airflow' has no attribute 'startswith' Is Reported After the command 'airflow db init' is exec

2021-06-08 Thread GitBox
keep-forward opened a new issue #16346: URL: https://github.com/apache/airflow/issues/16346 The procedure is as follows: 1. export AIRFLOW_HOME=~/airflow 2. pip install apache-airflow 3. airflow db init the error is as follows: Traceback (most recent call last): File

[GitHub] [airflow] patsevanton commented on issue #15340: helm install airflow in namespace get error: File "", line 32, in TimeoutError: There are still unapplied migrations after 60

2021-06-08 Thread GitBox
patsevanton commented on issue #15340: URL: https://github.com/apache/airflow/issues/15340#issuecomment-857350317 @LiboShen How add wait false to install I install airflow: ``` git clone https://github.com/apache/airflow.git cd airflow/chart/ helm dependency update

[GitHub] [airflow] uranusjr commented on issue #16328: error on click in dag-dependencies - airflow 2.1

2021-06-08 Thread GitBox
uranusjr commented on issue #16328: URL: https://github.com/apache/airflow/issues/16328#issuecomment-857349273 This reminds me of a task I left on the backburner, so I submitted a fix to this together. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] uranusjr opened a new pull request #16345: Correctly handle None returns from Query.scalar()

2021-06-08 Thread GitBox
uranusjr opened a new pull request #16345: URL: https://github.com/apache/airflow/pull/16345 Toward #8171, fix #16328. `None` is possible when the query does not return a row, according to SQLAlchemy documentation. We can handle them to provide better errors in unexpected

[GitHub] [airflow] mik-laj commented on pull request #16342: Remove ``[core] store_dag_code`` & use DB to get Dag Code

2021-06-08 Thread GitBox
mik-laj commented on pull request #16342: URL: https://github.com/apache/airflow/pull/16342#issuecomment-857346455 Can you explain a little more why you want to delete this option? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [airflow] mik-laj commented on issue #16344: Tried to upgrade to Airflow 2.1.0

2021-06-08 Thread GitBox
mik-laj commented on issue #16344: URL: https://github.com/apache/airflow/issues/16344#issuecomment-857345953 Did you do a db migration? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [airflow] boring-cyborg[bot] commented on issue #16344: Tried to upgrade to Airflow 2.1.0

2021-06-08 Thread GitBox
boring-cyborg[bot] commented on issue #16344: URL: https://github.com/apache/airflow/issues/16344#issuecomment-857340943 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] Laydas opened a new issue #16344: Tried to upgrade to Airflow 2.1.0

2021-06-08 Thread GitBox
Laydas opened a new issue #16344: URL: https://github.com/apache/airflow/issues/16344 **Apache Airflow version**: 2.1.0 **Kubernetes version (if you are using kubernetes)** (use `kubectl version`): **Environment**: - **Cloud provider or hardware

[GitHub] [airflow] mik-laj commented on issue #16336: Initialization issue when running docker-compose up airflow-init

2021-06-08 Thread GitBox
mik-laj commented on issue #16336: URL: https://github.com/apache/airflow/issues/16336#issuecomment-857335769 `Version: 3` means that we use some feature from latest version of docker compose spec. We support Airflow 2.1 with this docker compose file. You need to also have installed

[GitHub] [airflow] bbovenzi commented on a change in pull request #16253: Client-side filter dag dependencies

2021-06-08 Thread GitBox
bbovenzi commented on a change in pull request #16253: URL: https://github.com/apache/airflow/pull/16253#discussion_r647931429 ## File path: airflow/www/static/js/dag_dependencies.js ## @@ -187,10 +179,50 @@ function searchboxHighlighting(s) { } }

[GitHub] [airflow] echang0929 commented on issue #16336: Initialization issue when running docker-compose up airflow-init

2021-06-08 Thread GitBox
echang0929 commented on issue #16336: URL: https://github.com/apache/airflow/issues/16336#issuecomment-857333585 @mik-laj This docker-compose.yaml file needs airflow image version 3: ``` version: '3' x-airflow-common: image:

[GitHub] [airflow] mik-laj commented on issue #16336: Initialization issue when running docker-compose up airflow-init

2021-06-08 Thread GitBox
mik-laj commented on issue #16336: URL: https://github.com/apache/airflow/issues/16336#issuecomment-857313546 We had a race-condition bug in the `docker-compose` file, but it has been fixed. See: https://github.com/apache/airflow/pull/16180 Can you check a new file? -- This is an

[GitHub] [airflow] echang0929 commented on issue #16336: Initialization issue when running docker-compose up airflow-init

2021-06-08 Thread GitBox
echang0929 commented on issue #16336: URL: https://github.com/apache/airflow/issues/16336#issuecomment-857311920 @potiuk , it is the error just I run ```docker-compose up airflow-init```. I think other people got this error as weill:

[GitHub] [airflow] github-actions[bot] commented on pull request #16253: Client-side filter dag dependencies

2021-06-08 Thread GitBox
github-actions[bot] commented on pull request #16253: URL: https://github.com/apache/airflow/pull/16253#issuecomment-857294609 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [airflow] jhtimmins commented on a change in pull request #16253: Client-side filter dag dependencies

2021-06-08 Thread GitBox
jhtimmins commented on a change in pull request #16253: URL: https://github.com/apache/airflow/pull/16253#discussion_r647888221 ## File path: airflow/www/static/js/dag_dependencies.js ## @@ -187,10 +179,50 @@ function searchboxHighlighting(s) { } }

[GitHub] [airflow] ephraimbuddy opened a new pull request #16343: Fix DAG run state not updated while DAG is paused

2021-06-08 Thread GitBox
ephraimbuddy opened a new pull request #16343: URL: https://github.com/apache/airflow/pull/16343 Closes: https://github.com/apache/airflow/issues/15439 The state of a DAG run does not update while the DAG is paused. The tasks continue to run if the DAG run was kicked off

[GitHub] [airflow] github-actions[bot] commented on issue #11237: Missing "git_subpath" config in Helm values

2021-06-08 Thread GitBox
github-actions[bot] commented on issue #11237: URL: https://github.com/apache/airflow/issues/11237#issuecomment-857273153 This issue has been automatically marked as stale because it has been open for 30 days with no response from the author. It will be closed in next 7 days if no further

[GitHub] [airflow] github-actions[bot] commented on issue #11354: "trying to overwrite a task will raise an exception"

2021-06-08 Thread GitBox
github-actions[bot] commented on issue #11354: URL: https://github.com/apache/airflow/issues/11354#issuecomment-857273138 This issue has been automatically marked as stale because it has been open for 30 days with no response from the author. It will be closed in next 7 days if no further

[GitHub] [airflow] kaxil opened a new pull request #16342: Remove ``[core] store_dag_code`` & use DB to get Dag Code

2021-06-08 Thread GitBox
kaxil opened a new pull request #16342: URL: https://github.com/apache/airflow/pull/16342 - [ ] Add note in Updating.md --- **^ Add meaningful description above** Read the **[Pull Request

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #16341: Pass parameters to PostgresHook from PostgresOperator

2021-06-08 Thread GitBox
boring-cyborg[bot] commented on pull request #16341: URL: https://github.com/apache/airflow/pull/16341#issuecomment-857267758 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our

[GitHub] [airflow] ekarsten opened a new pull request #16341: Pass parameters to PostgresHook from PostgresOperator

2021-06-08 Thread GitBox
ekarsten opened a new pull request #16341: URL: https://github.com/apache/airflow/pull/16341 Passing extra kwargs from PostgresOperator to PostgresHook. This shouldn't need extra tests because it is a minor update to the PostgresOperator that doesn't change core functionality, so

[GitHub] [airflow] boring-cyborg[bot] commented on issue #16340: Allow user to pass parameters to PostgresHook in PostgresOperator

2021-06-08 Thread GitBox
boring-cyborg[bot] commented on issue #16340: URL: https://github.com/apache/airflow/issues/16340#issuecomment-857264068 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] ekarsten opened a new issue #16340: Allow user to pass parameters to PostgresHook in PostgresOperator

2021-06-08 Thread GitBox
ekarsten opened a new issue #16340: URL: https://github.com/apache/airflow/issues/16340 **Description** Currently, the [PostgresOperator](https://github.com/apache/airflow/blob/main/airflow/providers/postgres/operators/postgres.py) defines the database hook in a fixed way:

[GitHub] [airflow] jedcunningham opened a new pull request #16339: Always deploy a gitsync init container

2021-06-08 Thread GitBox
jedcunningham opened a new pull request #16339: URL: https://github.com/apache/airflow/pull/16339 We will always deploy a gitsync init container anywhere we deploy a gitsync sidecar, that way we ensure the main container has the DAGs when it starts. -- This is an automated message

[GitHub] [airflow] jedcunningham closed pull request #16331: Support job level annotations; fix jobs scheduling config

2021-06-08 Thread GitBox
jedcunningham closed pull request #16331: URL: https://github.com/apache/airflow/pull/16331 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this

[GitHub] [airflow] jedcunningham closed pull request #16315: podAntiAffinity for scheduler, webserver, and workers

2021-06-08 Thread GitBox
jedcunningham closed pull request #16315: URL: https://github.com/apache/airflow/pull/16315 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this

[airflow] branch main updated: Chart docs: Fix ``extrasecrets`` example (#16305)

2021-06-08 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 2aed146 Chart docs: Fix ``extrasecrets``

[GitHub] [airflow] kaxil merged pull request #16305: Fix extrasecrets example

2021-06-08 Thread GitBox
kaxil merged pull request #16305: URL: https://github.com/apache/airflow/pull/16305 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [airflow] LiboShen commented on issue #15340: helm install airflow in namespace get error: File "", line 32, in TimeoutError: There are still unapplied migrations after 60 se

2021-06-08 Thread GitBox
LiboShen commented on issue #15340: URL: https://github.com/apache/airflow/issues/15340#issuecomment-857226092 FYI, have you tried set "wait" false? I found this works for me: https://forum.astronomer.io/t/run-airflow-migration-and-wait-for-airflow-migrations/1189/10 -- This is an

[GitHub] [airflow] jedcunningham closed pull request #16305: Fix extrasecrets example

2021-06-08 Thread GitBox
jedcunningham closed pull request #16305: URL: https://github.com/apache/airflow/pull/16305 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this

[GitHub] [airflow] dstandish closed issue #16211: CeleryKubernetesExecutor error: Could not get scheduler_job_id

2021-06-08 Thread GitBox
dstandish closed issue #16211: URL: https://github.com/apache/airflow/issues/16211 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [airflow] jedcunningham commented on issue #16211: CeleryKubernetesExecutor error: Could not get scheduler_job_id

2021-06-08 Thread GitBox
jedcunningham commented on issue #16211: URL: https://github.com/apache/airflow/issues/16211#issuecomment-857177304 @dstandish, can we close this in favor of #16326? I assume this was with 2.0.2, and this specific problem doesn't happen in 2.1.0. -- This is an automated message from the

[GitHub] [airflow] codenamestif commented on pull request #15848: Add support of capacity provider strategy for ECSOperator

2021-06-08 Thread GitBox
codenamestif commented on pull request #15848: URL: https://github.com/apache/airflow/pull/15848#issuecomment-857155792 @feluelle could you please have a look if anything else needs to be done? Thanks. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] jhtimmins commented on issue #16328: error on click in dag-dependencies - airflow 2.1

2021-06-08 Thread GitBox
jhtimmins commented on issue #16328: URL: https://github.com/apache/airflow/issues/16328#issuecomment-857150748 @jcmartins thanks for submitting. Do you want to submit a fix as well?x -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [airflow] jhtimmins edited a comment on issue #16328: error on click in dag-dependencies - airflow 2.1

2021-06-08 Thread GitBox
jhtimmins edited a comment on issue #16328: URL: https://github.com/apache/airflow/issues/16328#issuecomment-857150748 @jcmartins thanks for submitting. Do you want to submit a fix as well? -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [airflow] jhtimmins commented on pull request #16100: Avoid passing `aws_conn_id` as conn_args for `psycopg2.connect`

2021-06-08 Thread GitBox
jhtimmins commented on pull request #16100: URL: https://github.com/apache/airflow/pull/16100#issuecomment-857140614 @gabrielsyapse can you try rebasing and then running the pre-commit checks on this? That should address the failing static check

[airflow] branch main updated (5631093 -> 143d21c)

2021-06-08 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 5631093 Docs: Fix ``flask-ouathlib`` to ``flask-oauthlib`` in Upgrading docs (#16320) add 143d21c Chart:

[GitHub] [airflow] kaxil merged pull request #16337: Chart: Update the ``appVersion`` to 2.1.0 in ``Chart.yaml``

2021-06-08 Thread GitBox
kaxil merged pull request #16337: URL: https://github.com/apache/airflow/pull/16337 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[jira] [Commented] (AIRFLOW-5644) Simplify TriggerDagRunOperator usage

2021-06-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17359561#comment-17359561 ] ASF GitHub Bot commented on AIRFLOW-5644: - ksumanth commented on pull request #6317: URL:

[GitHub] [airflow] ksumanth commented on pull request #6317: [AIRFLOW-5644] Simplify TriggerDagRunOperator usage

2021-06-08 Thread GitBox
ksumanth commented on pull request #6317: URL: https://github.com/apache/airflow/pull/6317#issuecomment-857126194 @BasPH I am in same boat. We use the run_id to identify the runs and when there are so many runs, it is very useful. It is particularly useful in Tree View where

[GitHub] [airflow] jedcunningham closed issue #16332: Airflow scheduler memory continue to increase using docker image apache/airflow:2.1.0

2021-06-08 Thread GitBox
jedcunningham closed issue #16332: URL: https://github.com/apache/airflow/issues/16332 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [airflow] jedcunningham commented on issue #16332: Airflow scheduler memory continue to increase using docker image apache/airflow:2.1.0

2021-06-08 Thread GitBox
jedcunningham commented on issue #16332: URL: https://github.com/apache/airflow/issues/16332#issuecomment-857085389 Thanks for reporting this @MADJIYoucef. Duplicate of #14924 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [airflow] victorouttes commented on issue #13692: task failed with a null hostname

2021-06-08 Thread GitBox
victorouttes commented on issue #13692: URL: https://github.com/apache/airflow/issues/13692#issuecomment-857082866 Same issue here. Airflow 1.10.15 on kubernetes. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [airflow] jedcunningham closed pull request #16315: podAntiAffinity for scheduler, webserver, and workers

2021-06-08 Thread GitBox
jedcunningham closed pull request #16315: URL: https://github.com/apache/airflow/pull/16315 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this

[GitHub] [airflow] jedcunningham closed pull request #16305: Fix extrasecrets example

2021-06-08 Thread GitBox
jedcunningham closed pull request #16305: URL: https://github.com/apache/airflow/pull/16305 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this

[GitHub] [airflow] houqp commented on pull request #16089: [#16087]: Backfill shouldn't interfere with scheduled run fix

2021-06-08 Thread GitBox
houqp commented on pull request #16089: URL: https://github.com/apache/airflow/pull/16089#issuecomment-857044188 @dimonchik-suvorov you should be able to reproduce the CI failures locally using breeze. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] kaxil commented on issue #13853: Clearing of historic Task or DagRuns leads to failed DagRun

2021-06-08 Thread GitBox
kaxil commented on issue #13853: URL: https://github.com/apache/airflow/issues/13853#issuecomment-857024420 Looks like a bug, needs fixing - added to 2.1.1 milestone -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [airflow] jedcunningham commented on issue #16326: CeleryKubernetesExecutor is broken in 2.1.0

2021-06-08 Thread GitBox
jedcunningham commented on issue #16326: URL: https://github.com/apache/airflow/issues/16326#issuecomment-857017401 Cool. I was able to reproduce this with 2.1.0 also. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [airflow] jedcunningham commented on a change in pull request #16331: Support job level annotations; fix jobs scheduling config

2021-06-08 Thread GitBox
jedcunningham commented on a change in pull request #16331: URL: https://github.com/apache/airflow/pull/16331#discussion_r647714369 ## File path: chart/templates/jobs/create-user-job.yaml ## @@ -19,9 +19,9 @@ ## Airflow Create User Job # {{-

[GitHub] [airflow] github-actions[bot] commented on pull request #16337: Chart: Update the ``appVersion`` to 2.1.0 in ``Chart.yaml``

2021-06-08 Thread GitBox
github-actions[bot] commented on pull request #16337: URL: https://github.com/apache/airflow/pull/16337#issuecomment-857014784 The PR is likely OK to be merged with just subset of tests for default Python and Database versions without running the full matrix of tests, because it does not

[GitHub] [airflow] jpyen commented on a change in pull request #16318: Fix API List DAGs inconsistent with UI/CLI

2021-06-08 Thread GitBox
jpyen commented on a change in pull request #16318: URL: https://github.com/apache/airflow/pull/16318#discussion_r647713834 ## File path: tests/api_connexion/endpoints/test_dag_endpoint.py ## @@ -387,6 +396,7 @@ def test_should_raise_404_when_dag_is_not_found(self): class

[GitHub] [airflow] kaxil commented on pull request #14455: Fix running DagRuns immediately being transitioned into the failed state

2021-06-08 Thread GitBox
kaxil commented on pull request #14455: URL: https://github.com/apache/airflow/pull/14455#issuecomment-857010453 @RikHeijdens Can you please create the PR with the `main` branch -- we have renamed `master` to `main` -- This is an automated message from the Apache Git Service. To respond

[GitHub] [airflow] ephraimbuddy commented on a change in pull request #16318: Fix API List DAGs inconsistent with UI/CLI

2021-06-08 Thread GitBox
ephraimbuddy commented on a change in pull request #16318: URL: https://github.com/apache/airflow/pull/16318#discussion_r647706453 ## File path: tests/api_connexion/endpoints/test_dag_endpoint.py ## @@ -387,6 +396,7 @@ def test_should_raise_404_when_dag_is_not_found(self):

[GitHub] [airflow] hx-markterry opened a new pull request #16338: SFTP hook to prefer the SSH paramiko key over the key file path

2021-06-08 Thread GitBox
hx-markterry opened a new pull request #16338: URL: https://github.com/apache/airflow/pull/16338 Related: https://github.com/apache/airflow/issues/16323 The SFTP hook does not allow for a SSH private key string to be used, only a private key file path. As it is based on the SSH

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #16338: SFTP hook to prefer the SSH paramiko key over the key file path

2021-06-08 Thread GitBox
boring-cyborg[bot] commented on pull request #16338: URL: https://github.com/apache/airflow/pull/16338#issuecomment-857007418 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our

[airflow] branch main updated (4ea8f9c -> 5631093)

2021-06-08 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 4ea8f9c Bump pylint CI step to 60m timeout (#16335) add 5631093 Docs: Fix ``flask-ouathlib`` to

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #16320: fix flask-ouathlib to flask-oauthlib

2021-06-08 Thread GitBox
boring-cyborg[bot] commented on pull request #16320: URL: https://github.com/apache/airflow/pull/16320#issuecomment-857005496 Awesome work, congrats on your first merged pull request! -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [airflow] kaxil merged pull request #16320: fix flask-ouathlib to flask-oauthlib

2021-06-08 Thread GitBox
kaxil merged pull request #16320: URL: https://github.com/apache/airflow/pull/16320 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [airflow] dnskr commented on pull request #16331: Support job level annotations; fix jobs scheduling config

2021-06-08 Thread GitBox
dnskr commented on pull request #16331: URL: https://github.com/apache/airflow/pull/16331#issuecomment-857004828 It works!  I have tested your commit with Airflow application manifest ```yaml apiVersion: argoproj.io/v1alpha1 kind: Application metadata: name:

[GitHub] [airflow] kaxil commented on issue #16326: CeleryKubernetesExecutor is broken in 2.1.0

2021-06-08 Thread GitBox
kaxil commented on issue #16326: URL: https://github.com/apache/airflow/issues/16326#issuecomment-857003621 Oh interesting :( -- the code definitely exists in 2.1 but haven't tested it yet. Marking it for 2.1.1 if it is broken -- This is an automated message from the Apache Git

[GitHub] [airflow] kaxil edited a comment on pull request #16273: Chart: Update the default Airflow Version to ``2.1.0``

2021-06-08 Thread GitBox
kaxil edited a comment on pull request #16273: URL: https://github.com/apache/airflow/pull/16273#issuecomment-857000126 > @kaxil we forgot to update [Chart.yaml](https://github.com/apache/airflow/blob/main/chart/Chart.yaml#L23) with this PR. Whoops, doing it now, done:

[GitHub] [airflow] kaxil opened a new pull request #16337: Chart: Update the ``appVersion`` to 2.1.0 in ``Chart.yaml``

2021-06-08 Thread GitBox
kaxil opened a new pull request #16337: URL: https://github.com/apache/airflow/pull/16337 Missed it in https://github.com/apache/airflow/pull/16273 Thanks @lewismc --- **^ Add meaningful description above** Read the **[Pull Request

[GitHub] [airflow] kaxil commented on pull request #16273: Chart: Update the default Airflow Version to ``2.1.0``

2021-06-08 Thread GitBox
kaxil commented on pull request #16273: URL: https://github.com/apache/airflow/pull/16273#issuecomment-857000126 > @kaxil we forgot to update [Chart.yaml](https://github.com/apache/airflow/blob/main/chart/Chart.yaml#L23) with this PR. Whoops, doing it now -- This is an automated

[GitHub] [airflow] kaxil commented on a change in pull request #16331: Support job level annotations; fix jobs scheduling config

2021-06-08 Thread GitBox
kaxil commented on a change in pull request #16331: URL: https://github.com/apache/airflow/pull/16331#discussion_r647697406 ## File path: chart/templates/jobs/create-user-job.yaml ## @@ -19,9 +19,9 @@ ## Airflow Create User Job # {{- if

[GitHub] [airflow] potiuk edited a comment on issue #16336: Initialization issue when running docker-compose up airflow-init

2021-06-08 Thread GitBox
potiuk edited a comment on issue #16336: URL: https://github.com/apache/airflow/issues/16336#issuecomment-856988582 Closing for now - hoping that this was the issue. if it was no - please provide more info and details what you are doing that allow to reproduce it. -- This is an

[GitHub] [airflow] potiuk closed issue #16336: Initialization issue when running docker-compose up airflow-init

2021-06-08 Thread GitBox
potiuk closed issue #16336: URL: https://github.com/apache/airflow/issues/16336 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [airflow] potiuk commented on issue #16336: Initialization issue when running docker-compose up airflow-init

2021-06-08 Thread GitBox
potiuk commented on issue #16336: URL: https://github.com/apache/airflow/issues/16336#issuecomment-856988582 Closing for now - hoping that this was the issue. if you have more info and details what you are doing that allow to reproduce it. -- This is an automated message from the

[GitHub] [airflow] potiuk commented on issue #16336: Initialization issue when running docker-compose up airflow-init

2021-06-08 Thread GitBox
potiuk commented on issue #16336: URL: https://github.com/apache/airflow/issues/16336#issuecomment-856987954 I guess you did not run `docker-compose up airflow-init` - it should create all the tables. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] dstandish commented on issue #16326: CeleryKubernetes executor is broken in 2.0.2 and 2.1.0

2021-06-08 Thread GitBox
dstandish commented on issue #16326: URL: https://github.com/apache/airflow/issues/16326#issuecomment-856984617 > That is still only in v2-0-test, not stable. hmm so i think that would the issue in 2.0.2 (i forgot about that cherry pick issue) but, it does not explain 2.1...

[GitHub] [airflow] boring-cyborg[bot] commented on issue #16336: Initialization issue when running docker-compose up airflow-init

2021-06-08 Thread GitBox
boring-cyborg[bot] commented on issue #16336: URL: https://github.com/apache/airflow/issues/16336#issuecomment-856980365 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] echang0929 opened a new issue #16336: Initialization issue when running docker-compose up airflow-init

2021-06-08 Thread GitBox
echang0929 opened a new issue #16336: URL: https://github.com/apache/airflow/issues/16336 **Apache Airflow version**: 2.0.2 **Environment**: - **OS** (e.g. from /etc/os-release): macOS 11.4 - **Kernel** (e.g. `uname -a`): Darwin Timothys 20.5.0 Darwin

[airflow] branch main updated (a19cc0a -> 4ea8f9c)

2021-06-08 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from a19cc0a Use updated _get_all_non_dag_permissions method. (#16317) add 4ea8f9c Bump pylint CI step to 60m

[GitHub] [airflow] kaxil merged pull request #16335: Bump pylint CI step to 60m timeout

2021-06-08 Thread GitBox
kaxil merged pull request #16335: URL: https://github.com/apache/airflow/pull/16335 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [airflow] jedcunningham opened a new pull request #16335: Bump pylint CI step to 60m timeout

2021-06-08 Thread GitBox
jedcunningham opened a new pull request #16335: URL: https://github.com/apache/airflow/pull/16335 The pylint step has been pretty consistenly timing out for me lately, so bump the timeout higher. We can always reduce it later once things are running more smoothly. e.g:

[GitHub] [airflow] fhoda commented on issue #14592: Unreachable Secrets Backend Causes Web Server Crash

2021-06-08 Thread GitBox
fhoda commented on issue #14592: URL: https://github.com/apache/airflow/issues/14592#issuecomment-856965584 Since we are in agreement about the fail over being appropriate for Connections and Variables, I have started to work on those. I will address the inconsistency in behavior and

[GitHub] [airflow] lewismc commented on pull request #16273: Chart: Update the default Airflow Version to ``2.1.0``

2021-06-08 Thread GitBox
lewismc commented on pull request #16273: URL: https://github.com/apache/airflow/pull/16273#issuecomment-856954353 @kaxil we forgot to update [Chart.yaml](https://github.com/apache/airflow/blob/main/chart/Chart.yaml#L23) with this PR. -- This is an automated message from the Apache Git

[GitHub] [airflow] chrisrfu closed issue #15954: S3 remote logging which defaults to "falling back to local log"

2021-06-08 Thread GitBox
chrisrfu closed issue #15954: URL: https://github.com/apache/airflow/issues/15954 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [airflow] MADJIYoucef opened a new issue #16332: Airflow scheduler memory continue to increase using docker image apache/airflow:2.1.0

2021-06-08 Thread GitBox
MADJIYoucef opened a new issue #16332: URL: https://github.com/apache/airflow/issues/16332 I have a problem with scheduler memory that continue to increase when i am using docker image. I am using Celery Executor

[GitHub] [airflow] boring-cyborg[bot] commented on issue #16332: Airflow scheduler memory continue to increase using docker image apache/airflow:2.1.0

2021-06-08 Thread GitBox
boring-cyborg[bot] commented on issue #16332: URL: https://github.com/apache/airflow/issues/16332#issuecomment-856913951 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] jedcunningham commented on issue #16326: CeleryKubernetes executor is broken in 2.0.2 and 2.1.0

2021-06-08 Thread GitBox
jedcunningham commented on issue #16326: URL: https://github.com/apache/airflow/issues/16326#issuecomment-856907499 Might be related to https://github.com/apache/airflow/pull/13247? That is still only in v2-0-test, not stable. -- This is an automated message from the Apache Git Service.

[GitHub] [airflow] cchicote commented on issue #12136: KubernetesPodOperator breaks with active log-collection for long running tasks

2021-06-08 Thread GitBox
cchicote commented on issue #12136: URL: https://github.com/apache/airflow/issues/12136#issuecomment-856905748 I have the exact same issue than @ausiddiqui, running an MWAA environment with Airflow 1.10.12, along with an EKS cluster with Kubernetes 1.19 Anyone had such an issue and

[airflow-ci-infra] branch main updated: Fix syntax error in stop-runner-if-no-job.sh (#32)

2021-06-08 Thread ash
This is an automated email from the ASF dual-hosted git repository. ash pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow-ci-infra.git The following commit(s) were added to refs/heads/main by this push: new 37b3503 Fix syntax error in

[GitHub] [airflow-ci-infra] ashb merged pull request #32: Fix syntax error in stop-runner-if-no-job.sh

2021-06-08 Thread GitBox
ashb merged pull request #32: URL: https://github.com/apache/airflow-ci-infra/pull/32 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [airflow-ci-infra] ashb commented on pull request #32: Fix syntax error in stop-runner-if-no-job.sh

2021-06-08 Thread GitBox
ashb commented on pull request #32: URL: https://github.com/apache/airflow-ci-infra/pull/32#issuecomment-856893809 There's more cases actually, but this might help a bit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [airflow-ci-infra] ashb commented on pull request #32: Fix syntax error in stop-runner-if-no-job.sh

2021-06-08 Thread GitBox
ashb commented on pull request #32: URL: https://github.com/apache/airflow-ci-infra/pull/32#issuecomment-856890282 @jhtimmins This might be the issue with your builds (no logs) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [airflow-ci-infra] ashb opened a new pull request #32: Fix syntax error in stop-runner-if-no-job.sh

2021-06-08 Thread GitBox
ashb opened a new pull request #32: URL: https://github.com/apache/airflow-ci-infra/pull/32 This trailing `fi` on the end would likely cause the Runner.Listener to be terminated to early. -- This is an automated message from the Apache Git Service. To respond to the message, please

[airflow-ci-infra] branch fix-syntax-error created (now f2daa8b)

2021-06-08 Thread ash
This is an automated email from the ASF dual-hosted git repository. ash pushed a change to branch fix-syntax-error in repository https://gitbox.apache.org/repos/asf/airflow-ci-infra.git. at f2daa8b Fix syntax error in stop-runner-if-no-job.sh This branch includes the following new

[airflow-ci-infra] 01/01: Fix syntax error in stop-runner-if-no-job.sh

2021-06-08 Thread ash
This is an automated email from the ASF dual-hosted git repository. ash pushed a commit to branch fix-syntax-error in repository https://gitbox.apache.org/repos/asf/airflow-ci-infra.git commit f2daa8b35a07cb647f91b41df683df27dcb58ada Author: Ash Berlin-Taylor AuthorDate: Tue Jun 8 16:44:40 2021

[GitHub] [airflow] dstandish removed a comment on issue #16326: CeleryKubernetes executor is broken in 2.0.2 and 2.1

2021-06-08 Thread GitBox
dstandish removed a comment on issue #16326: URL: https://github.com/apache/airflow/issues/16326#issuecomment-856873032 In 2.1.0 the scheduler will run but every task fails like this: ``` 2021-06-08 15:30:17,167] {scheduler_job.py:1241} ERROR - Executor reports task instance

[GitHub] [airflow] jedcunningham commented on pull request #16331: Support job level annotations; fix jobs scheduling config

2021-06-08 Thread GitBox
jedcunningham commented on pull request #16331: URL: https://github.com/apache/airflow/pull/16331#issuecomment-856882226 cc @dnskr -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [airflow] jedcunningham opened a new pull request #16331: Support job level annotations; fix jobs scheduling config

2021-06-08 Thread GitBox
jedcunningham opened a new pull request #16331: URL: https://github.com/apache/airflow/pull/16331 Add job level annotations as some tooling needs to be able to add them. Also fix jobs to use their own nodeSelector, affinity, and tolerations. Related to #16291 -- This is

[GitHub] [airflow] jedcunningham closed pull request #16305: Fix extrasecrets example

2021-06-08 Thread GitBox
jedcunningham closed pull request #16305: URL: https://github.com/apache/airflow/pull/16305 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this

[GitHub] [airflow] ryanahamilton commented on pull request #15935: Show subdag code in subdag codeview

2021-06-08 Thread GitBox
ryanahamilton commented on pull request #15935: URL: https://github.com/apache/airflow/pull/15935#issuecomment-856878275 @Junnplus mind rebasing this and then we can get it merged? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [airflow] jedcunningham closed pull request #16315: podAntiAffinity for scheduler, webserver, and workers

2021-06-08 Thread GitBox
jedcunningham closed pull request #16315: URL: https://github.com/apache/airflow/pull/16315 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this

[airflow] branch main updated (ebc03c6 -> a19cc0a)

2021-06-08 Thread jhtimmins
This is an automated email from the ASF dual-hosted git repository. jhtimmins pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from ebc03c6 Fix Dag Details start date bug (#16206) add a19cc0a Use updated _get_all_non_dag_permissions

  1   2   >