[GitHub] [airflow] github-actions[bot] commented on pull request #16100: Avoid passing `aws_conn_id` as conn_args for `psycopg2.connect`

2021-06-07 Thread GitBox
github-actions[bot] commented on pull request #16100: URL: https://github.com/apache/airflow/pull/16100#issuecomment-856424036 The PR is likely OK to be merged with just subset of tests for default Python and Database versions without running the full matrix of tests, because it does not

[GitHub] [airflow] msumit commented on pull request #16233: Fix TI success/failure links

2021-06-07 Thread GitBox
msumit commented on pull request #16233: URL: https://github.com/apache/airflow/pull/16233#issuecomment-856404610 Thanks @kaxil -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [airflow] jhtimmins opened a new pull request #16317: Use updated _get_all_non_dag_permissions method.

2021-06-07 Thread GitBox
jhtimmins opened a new pull request #16317: URL: https://github.com/apache/airflow/pull/16317 Modifies `_get_all_non_dag_permissionviews` to `_get_all_non_dag_permissions` so the updated permission names are used. -- This is an automated message from the Apache Git Service. To respond

[GitHub] [airflow] mik-laj commented on pull request #14535: Fix: Mysql 5.7 id utf8mb3

2021-06-07 Thread GitBox
mik-laj commented on pull request #14535: URL: https://github.com/apache/airflow/pull/14535#issuecomment-856398136 It looks like a bug. I reopened this PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [airflow] hbrls opened a new pull request #14535: Fix: Mysql 5.7 id utf8mb3

2021-06-07 Thread GitBox
hbrls opened a new pull request #14535: URL: https://github.com/apache/airflow/pull/14535 This may not be a ready PR. The code diff best expresses my ideas. I'm initializing a mysql 5.7 db from empty using `hub.docker.com, apache/airflow:2.0.1-python3.8`. The migration scripts throw

[GitHub] [airflow] kevinbsilva commented on pull request #15947: Applied permissions to self._error_file

2021-06-07 Thread GitBox
kevinbsilva commented on pull request #15947: URL: https://github.com/apache/airflow/pull/15947#issuecomment-856397058 @ashb i've tested in our development cluster and it works fine. But it seems a check from GitHub actions did not succeed. It raised a 404 when trying to install the

[GitHub] [airflow] hbrls commented on pull request #14535: Fix: Mysql 5.7 id utf8mb3

2021-06-07 Thread GitBox
hbrls commented on pull request #14535: URL: https://github.com/apache/airflow/pull/14535#issuecomment-856386855 Is it closed? I've rebased the fixes. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [airflow] uranusjr commented on issue #15994: Use inclusive words in Apache Airflow project

2021-06-07 Thread GitBox
uranusjr commented on issue #15994: URL: https://github.com/apache/airflow/issues/15994#issuecomment-856366575 In my AIP-39 implementation I called a time table that never schedules (`schedule_interval=None`) a `NullTimeTable` so that's another possibility. It's probably a good idea to

[GitHub] [airflow] github-actions[bot] closed pull request #14535: Fix: Mysql 5.7 id utf8mb3

2021-06-07 Thread GitBox
github-actions[bot] closed pull request #14535: URL: https://github.com/apache/airflow/pull/14535 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this

[GitHub] [airflow] github-actions[bot] commented on issue #14412: STORE_DAG_CODE not displaying correct code for zipped dag files

2021-06-07 Thread GitBox
github-actions[bot] commented on issue #14412: URL: https://github.com/apache/airflow/issues/14412#issuecomment-856345568 This issue has been automatically marked as stale because it has been open for 30 days with no response from the author. It will be closed in next 7 days if no further

[GitHub] [airflow] github-actions[bot] closed issue #15503: airflow dag sucess , but task is no status and not working

2021-06-07 Thread GitBox
github-actions[bot] closed issue #15503: URL: https://github.com/apache/airflow/issues/15503 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this

[GitHub] [airflow] github-actions[bot] closed pull request #13405: KubernetesPodOperator Guide

2021-06-07 Thread GitBox
github-actions[bot] closed pull request #13405: URL: https://github.com/apache/airflow/pull/13405 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this

[GitHub] [airflow] github-actions[bot] commented on issue #15503: airflow dag sucess , but task is no status and not working

2021-06-07 Thread GitBox
github-actions[bot] commented on issue #15503: URL: https://github.com/apache/airflow/issues/15503#issuecomment-856345543 This issue has been closed because it has not received response from the issue author. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] ephraimbuddy commented on a change in pull request #16182: Do not queue tasks when the DAG file goes missing

2021-06-07 Thread GitBox
ephraimbuddy commented on a change in pull request #16182: URL: https://github.com/apache/airflow/pull/16182#discussion_r647021778 ## File path: airflow/jobs/scheduler_job.py ## @@ -1417,6 +1420,37 @@ def _clean_tis_without_dagrun(self, session): raise

[GitHub] [airflow] boring-cyborg[bot] commented on issue #16316: KubernetesPodOperator re-queue job on exceeded quota

2021-06-07 Thread GitBox
boring-cyborg[bot] commented on issue #16316: URL: https://github.com/apache/airflow/issues/16316#issuecomment-856341122 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] timgriffiths opened a new issue #16316: KubernetesPodOperator re-queue job on exceeded quota

2021-06-07 Thread GitBox
timgriffiths opened a new issue #16316: URL: https://github.com/apache/airflow/issues/16316 **Description** Some times we have more jobs than is able to be run in our k8s cluster, it would be super nice if airflow had a feature that could catch the below error and just re-queue the

[GitHub] [airflow-site] mik-laj commented on pull request #433: Publish .asf.yaml on asf-site branch

2021-06-07 Thread GitBox
mik-laj commented on pull request #433: URL: https://github.com/apache/airflow-site/pull/433#issuecomment-856314618 This didn't help as our CI is pushing changes to the `gh-pages` branch. I changed it last week, because it is required by asf infra. > The ghp_branch setting can ONLY

[airflow-site] branch asf-site updated (51287f4 -> 3d082e0)

2021-06-07 Thread kamilbregula
This is an automated email from the ASF dual-hosted git repository. kamilbregula pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/airflow-site.git. from 51287f4 Deploying to asf-site from @ 2bce1a1f98c599e0c6abd4f0975020cd9561da18  add e76fbac

[GitHub] [airflow] jedcunningham commented on issue #16298: Scheduler fails with BrokenPipeError

2021-06-07 Thread GitBox
jedcunningham commented on issue #16298: URL: https://github.com/apache/airflow/issues/16298#issuecomment-856312678 Looks like the scheduler is getting a sigterm signal. Any hints in the events for the pod (you'll want a recent pod)? ``` kubectl get event --field-selector

[GitHub] [airflow] jedcunningham commented on issue #16313: cryptography.fernet.InvalidToken when attempting to access connections

2021-06-07 Thread GitBox
jedcunningham commented on issue #16313: URL: https://github.com/apache/airflow/issues/16313#issuecomment-856310140 If you exec into the webserver pod and run `echo $AIRFLOW__CORE__FERNET_KEY`, does it match the "echo Fernet Key" command? -- This is an automated message from the Apache

[GitHub] [airflow] jedcunningham commented on issue #16313: cryptography.fernet.InvalidToken when attempting to access connections

2021-06-07 Thread GitBox
jedcunningham commented on issue #16313: URL: https://github.com/apache/airflow/issues/16313#issuecomment-856309532 I'm not able to reproduce this. Do you get a base64 string when you run the "echo Fernet Key" command `helm install` prints? e.g: ``` echo Fernet Key: $(kubectl get

[GitHub] [airflow] jedcunningham opened a new pull request #16315: podAntiAffinity for scheduler, webserver, and workers

2021-06-07 Thread GitBox
jedcunningham opened a new pull request #16315: URL: https://github.com/apache/airflow/pull/16315 Set default podAntiAffinity for the components that can scale, as in most cases you'd want them spread across available nodes. -- This is an automated message from the Apache Git Service.

[airflow-site] branch gh-pages updated: Deploying to gh-pages from @ 14ec0b97a8e4778442df0d53cadf5f712340c567 

2021-06-07 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch gh-pages in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/gh-pages by this push: new 3d082e0 Deploying to gh-pages

[airflow-site] branch main updated: Publish .asf.yaml on asf-site branch (#433)

2021-06-07 Thread kamilbregula
This is an automated email from the ASF dual-hosted git repository. kamilbregula pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/main by this push: new 14ec0b9 Publish .asf.yaml on asf-site

[GitHub] [airflow-site] mik-laj merged pull request #433: Publish .asf.yaml on asf-site branch

2021-06-07 Thread GitBox
mik-laj merged pull request #433: URL: https://github.com/apache/airflow-site/pull/433 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

Error while running github feature from .asf.yaml in airflow-site!

2021-06-07 Thread Apache Infrastructure
An error occurred while running github feature in .asf.yaml!: [GitHub] Request error with message: "Branch not found". (status code: 404)

[GitHub] [airflow] cvsekhar commented on issue #16254: Wasb connection to Azure Fileshareservice Hook not working

2021-06-07 Thread GitBox
cvsekhar commented on issue #16254: URL: https://github.com/apache/airflow/issues/16254#issuecomment-856286918 Sure will test the RC -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [airflow-site] mik-laj opened a new pull request #433: Publish .asf.yaml on asf-site branch

2021-06-07 Thread GitBox
mik-laj opened a new pull request #433: URL: https://github.com/apache/airflow-site/pull/433 Hello ASF Publishing tools can't detect his file. According to [asf infra report](https://infra-reports.apache.org/site-source/), we must have this file on the `asf-site` branch. >

[GitHub] [airflow] SamWheating commented on a change in pull request #12822: Removing redundant calls to session.commit()

2021-06-07 Thread GitBox
SamWheating commented on a change in pull request #12822: URL: https://github.com/apache/airflow/pull/12822#discussion_r646947662 ## File path: airflow/jobs/base_job.py ## @@ -246,7 +246,6 @@ def run(self): finally: self.end_date =

[GitHub] [airflow] malthe opened a new pull request #16314: Add support for non rsa type client host key

2021-06-07 Thread GitBox
malthe opened a new pull request #16314: URL: https://github.com/apache/airflow/pull/16314 This adds support for specifying an SSH client host key along with its type, e.g. ``` ssh-ed25519 C3NzaC1lZDI1NTE5IGTA+qK7VvFL3oZTgbVwFYcp5ZrPiRkPQd8YhVZDH946 ```

[GitHub] [airflow] potiuk commented on issue #16254: Wasb connection to Azure Fileshareservice Hook not working

2021-06-07 Thread GitBox
potiuk commented on issue #16254: URL: https://github.com/apache/airflow/issues/16254#issuecomment-856245357 OK. I see the problem @cvsekhar . It seems that the AzureFileServerHook was wrongly defined and the way extras were used there was wrong. Passing extras this way is not how airlfow

[GitHub] [airflow] cvsekhar edited a comment on issue #16254: Wasb connection to Azure Fileshareservice Hook not working

2021-06-07 Thread GitBox
cvsekhar edited a comment on issue #16254: URL: https://github.com/apache/airflow/issues/16254#issuecomment-856220634 I see from the commit list, this specific class has not be addressed and its giving an error.

[GitHub] [airflow] cvsekhar edited a comment on issue #16254: Wasb connection to Azure Fileshareservice Hook not working

2021-06-07 Thread GitBox
cvsekhar edited a comment on issue #16254: URL: https://github.com/apache/airflow/issues/16254#issuecomment-856220634 I see from the commit list, this specific class has not be addressed and its giving an error. -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [airflow] cvsekhar commented on issue #16254: Wasb connection to Azure Fileshareservice Hook not working

2021-06-07 Thread GitBox
cvsekhar commented on issue #16254: URL: https://github.com/apache/airflow/issues/16254#issuecomment-856220634 Can you help me as the wasb connection with those fields is not working for fileshare. -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [airflow] cvsekhar commented on issue #16254: Wasb connection to Azure Fileshareservice Hook not working

2021-06-07 Thread GitBox
cvsekhar commented on issue #16254: URL: https://github.com/apache/airflow/issues/16254#issuecomment-856219873 This has not addressed the issue, I was using those fields and getting an error when I try to use this hook.

[GitHub] [airflow] john-jac opened a new issue #14592: Unreachable Secrets Backend Causes Web Server Crash

2021-06-07 Thread GitBox
john-jac opened a new issue #14592: URL: https://github.com/apache/airflow/issues/14592 **Apache Airflow version**: 1.10.12 **Kubernetes version (if you are using kubernetes)** (use `kubectl version`): n/a **Environment**: - **Cloud provider or hardware

[GitHub] [airflow] potiuk edited a comment on issue #14592: Unreachable Secrets Backend Causes Web Server Crash

2021-06-07 Thread GitBox
potiuk edited a comment on issue #14592: URL: https://github.com/apache/airflow/issues/14592#issuecomment-856216348 Agree we have consistency issue here - Interestingly, the AWS secret manager crashed originally for @subashcanapathy and @john-jac but did not crash for you @fhoda. Not sure

[GitHub] [airflow] potiuk commented on issue #14592: Unreachable Secrets Backend Causes Web Server Crash

2021-06-07 Thread GitBox
potiuk commented on issue #14592: URL: https://github.com/apache/airflow/issues/14592#issuecomment-856216348 Agree we have consistency issue here - Interestingly, the AWS secret manager crashed originally for @subashcanapathy and @john-jac but did not crash for you @fhoda. Not sure what

[GitHub] [airflow] fhoda edited a comment on issue #14592: Unreachable Secrets Backend Causes Web Server Crash

2021-06-07 Thread GitBox
fhoda edited a comment on issue #14592: URL: https://github.com/apache/airflow/issues/14592#issuecomment-856125981 As of now it seems the expected behavior is not what is happening and is inconsistent across different secret backends. I have tried to reproduce this issue with

[GitHub] [airflow] jedcunningham commented on a change in pull request #16291: Support helm chart to be installed by Argo CD

2021-06-07 Thread GitBox
jedcunningham commented on a change in pull request #16291: URL: https://github.com/apache/airflow/pull/16291#discussion_r646891685 ## File path: chart/templates/jobs/migrate-database-job.yaml ## @@ -38,6 +38,9 @@ metadata: "helm.sh/hook": post-install,post-upgrade

[GitHub] [airflow] Stormhand commented on issue #9722: Airflow can't import DAG in UI and logs, but manual DAG trigger works

2021-06-07 Thread GitBox
Stormhand commented on issue #9722: URL: https://github.com/apache/airflow/issues/9722#issuecomment-856184838 I have the same issue on 2.1.0. If i add the libs in PYTHONPATH i can import them but the UI shows an error. Im using the community helm charts with git-sync enabled. -- This

[GitHub] [airflow] boring-cyborg[bot] commented on issue #16313: cryptography.fernet.InvalidToken when attempting to access connections

2021-06-07 Thread GitBox
boring-cyborg[bot] commented on issue #16313: URL: https://github.com/apache/airflow/issues/16313#issuecomment-856182930 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] lewismc opened a new issue #16313: cryptography.fernet.InvalidToken when attempting to access connections

2021-06-07 Thread GitBox
lewismc opened a new issue #16313: URL: https://github.com/apache/airflow/issues/16313 **Apache Airflow version**: 2.1.0 (Helm chart) from main branch 5c7d758e24595c485553b0449583ff238114d47d **Kubernetes version (if you are using kubernetes)** (use `kubectl version`):

[GitHub] [airflow] SamWheating commented on pull request #14306: Adding `only_active` parameter to /dags endpoint

2021-06-07 Thread GitBox
SamWheating commented on pull request #14306: URL: https://github.com/apache/airflow/pull/14306#issuecomment-856179712 Alright I've rebased on main and ran the tests locally - Happy to help update this if we change the wording or some field names later on. Could I get your reviews

[airflow] branch main updated (5c7d758 -> 29b7f79)

2021-06-07 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 5c7d758 Docs: Fix creating a connection docs (#16312) add 29b7f79 fix wasb remote logging when blob already

[GitHub] [airflow] potiuk closed issue #15907: Problem with Wasb v12 remote logging when blob already exists

2021-06-07 Thread GitBox
potiuk closed issue #15907: URL: https://github.com/apache/airflow/issues/15907 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [airflow] potiuk merged pull request #16280: fix wasb remote logging when blob already exists

2021-06-07 Thread GitBox
potiuk merged pull request #16280: URL: https://github.com/apache/airflow/pull/16280 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [airflow] XD-DENG commented on pull request #14306: Adding `only_active` parameter to /dags endpoint

2021-06-07 Thread GitBox
XD-DENG commented on pull request #14306: URL: https://github.com/apache/airflow/pull/14306#issuecomment-856148027 > Code looks fine, but I wonder if we want to rename this now to match the proposed new external names as mentioned in #14459 Hi @ashb , this issue

[GitHub] [airflow] ebdavison commented on issue #13853: Clearing of historic Task or DagRuns leads to failed DagRun

2021-06-07 Thread GitBox
ebdavison commented on issue #13853: URL: https://github.com/apache/airflow/issues/13853#issuecomment-856147738 I am on airflow 2.1.0 and this is definitely an issue on that version. Can someone comment on the status of this? I have had to update 400+ DAGs to remove the

[GitHub] [airflow] fhoda commented on issue #14592: Unreachable Secrets Backend Causes Web Server Crash

2021-06-07 Thread GitBox
fhoda commented on issue #14592: URL: https://github.com/apache/airflow/issues/14592#issuecomment-856125981 As of now it seems the expected behavior is not what is happening and is inconsistent across different secret backends. I have tried to reproduce this issue with Airflow 2.0

[GitHub] [airflow] leahecole commented on pull request #16034: Standardise dataproc location param to region

2021-06-07 Thread GitBox
leahecole commented on pull request #16034: URL: https://github.com/apache/airflow/pull/16034#issuecomment-856123635 > It looks like a breaking change. Can we avoid it and keep backward compatibility with warning? This change also requires an entry in changelog to facilitate migration.

[GitHub] [airflow] kaxil commented on pull request #16233: Fix TI success/failure links

2021-06-07 Thread GitBox
kaxil commented on pull request #16233: URL: https://github.com/apache/airflow/pull/16233#issuecomment-856116981 rebased your PR on latest Main, let's see if it solves some Build issues -- I know there was some bug few days back -- This is an automated message from the Apache Git

[airflow] branch main updated (9c94b72 -> 5c7d758)

2021-06-07 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 9c94b72 Updated documentation for June 2021 provider release (#16294) add 5c7d758 Docs: Fix creating a

[GitHub] [airflow] kaxil merged pull request #16312: Fix creating a connection documentation

2021-06-07 Thread GitBox
kaxil merged pull request #16312: URL: https://github.com/apache/airflow/pull/16312 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [airflow] lewismc commented on pull request #16230: Apache Flagon UserALE JS analytics backend

2021-06-07 Thread GitBox
lewismc commented on pull request #16230: URL: https://github.com/apache/airflow/pull/16230#issuecomment-856110439 Thanks for explaining @kaxil I'll have another look at the black checks. -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [airflow] dnskr commented on a change in pull request #16291: Support helm chart to be installed by Argo CD

2021-06-07 Thread GitBox
dnskr commented on a change in pull request #16291: URL: https://github.com/apache/airflow/pull/16291#discussion_r646783130 ## File path: chart/templates/jobs/migrate-database-job.yaml ## @@ -38,6 +38,9 @@ metadata: "helm.sh/hook": post-install,post-upgrade

[GitHub] [airflow] sunki-hong commented on a change in pull request #16241: Update copy command for s3 to redshift

2021-06-07 Thread GitBox
sunki-hong commented on a change in pull request #16241: URL: https://github.com/apache/airflow/pull/16241#discussion_r646774062 ## File path: tests/providers/amazon/aws/transfers/test_s3_to_redshift.py ## @@ -59,6 +59,61 @@ def test_execute(self, mock_run, mock_session):

[GitHub] [airflow] SamWheating commented on issue #16023: Running tasks marked as 'orphaned' and killed by scheduler

2021-06-07 Thread GitBox
SamWheating commented on issue #16023: URL: https://github.com/apache/airflow/issues/16023#issuecomment-856087959 We were experiencing a similar issue, but it turned out to be due to the SchedulerJob being marked as failed due to a slow heartbeat (due to adding a few thousand DAGs).

[GitHub] [airflow] Aakcht opened a new pull request #16312: Fix creating a connection documentation

2021-06-07 Thread GitBox
Aakcht opened a new pull request #16312: URL: https://github.com/apache/airflow/pull/16312 Minor fix for `Creating a Connection from the CLI` documentation -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [airflow] msumit commented on pull request #16233: Fix TI success/failure links

2021-06-07 Thread GitBox
msumit commented on pull request #16233: URL: https://github.com/apache/airflow/pull/16233#issuecomment-856080760 @ashb @uranusjr @kaxil @potiuk can you guys plz review this. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [airflow] fraciril closed issue #16307: [v2.1.0] Tree View "Refresh" uses Wrong Endpoint

2021-06-07 Thread GitBox
fraciril closed issue #16307: URL: https://github.com/apache/airflow/issues/16307 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [airflow] uranusjr commented on issue #16307: [v2.1.0] Tree View "Refresh" uses Wrong Endpoint

2021-06-07 Thread GitBox
uranusjr commented on issue #16307: URL: https://github.com/apache/airflow/issues/16307#issuecomment-856075261 Already fixed in #16018. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [airflow] bbovenzi commented on issue #16249: Fully functional DAG Dependencies Graph view

2021-06-07 Thread GitBox
bbovenzi commented on issue #16249: URL: https://github.com/apache/airflow/issues/16249#issuecomment-856070445 Got it. I think this makes most sense as adding dependency info to the Graph view to get all that detailed info per run. Dag Dependencies remains as an overview of all the

[GitHub] [airflow] kaxil commented on pull request #16230: Apache Flagon UserALE JS analytics backend

2021-06-07 Thread GitBox
kaxil commented on pull request #16230: URL: https://github.com/apache/airflow/pull/16230#issuecomment-856059512 > Does anyone know what this means? > > ``` > blackFailed > - hook id: black

[GitHub] [airflow] uranusjr commented on a change in pull request #16311: Prevent running `airflow db init` migrations and setup in parallel.

2021-06-07 Thread GitBox
uranusjr commented on a change in pull request #16311: URL: https://github.com/apache/airflow/pull/16311#discussion_r646723245 ## File path: airflow/utils/db.py ## @@ -561,10 +571,21 @@ def create_default_connections(session=None): ) -def initdb(): +@provide_session

[GitHub] [airflow] uranusjr commented on issue #16310: Enable running airflow db init in parallel

2021-06-07 Thread GitBox
uranusjr commented on issue #16310: URL: https://github.com/apache/airflow/issues/16310#issuecomment-856055387 I’m curious though, why would you want to run two `init`s side by side? There’s only one database, is it not? -- This is an automated message from the Apache Git Service. To

[GitHub] [airflow] ashb commented on pull request #15947: Applied permissions to self._error_file

2021-06-07 Thread GitBox
ashb commented on pull request #15947: URL: https://github.com/apache/airflow/pull/15947#issuecomment-856053821 @kevinbsilva Does it work now? I _think_ this should, but could you confirm? -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [airflow] eladkal commented on issue #15914: Problem with remote logging when using Azure file share for logs(webserver, scheduler and task logs)

2021-06-07 Thread GitBox
eladkal commented on issue #15914: URL: https://github.com/apache/airflow/issues/15914#issuecomment-856037993 sorry, it was for @akshay654 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [airflow] anitakar opened a new pull request #16311: Prevent running `airflow db init` migrations and setup in parallel.

2021-06-07 Thread GitBox
anitakar opened a new pull request #16311: URL: https://github.com/apache/airflow/pull/16311 Make sure that multiple db initialization processes on the same db are executed one after another. Tested manually by running airflow db init in 2 separate bash sessions. Made sure that

[GitHub] [airflow] dnskr commented on a change in pull request #16291: Support helm chart to be installed by Argo CD

2021-06-07 Thread GitBox
dnskr commented on a change in pull request #16291: URL: https://github.com/apache/airflow/pull/16291#discussion_r646682397 ## File path: chart/templates/jobs/migrate-database-job.yaml ## @@ -38,6 +38,9 @@ metadata: "helm.sh/hook": post-install,post-upgrade

[GitHub] [airflow] anitakar commented on issue #16310: Enable running airflow db init in parallel

2021-06-07 Thread GitBox
anitakar commented on issue #16310: URL: https://github.com/apache/airflow/issues/16310#issuecomment-856016574 About to submit PR for that bug. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] anitakar opened a new issue #16310: Enable running airflow db init in parallel

2021-06-07 Thread GitBox
anitakar opened a new issue #16310: URL: https://github.com/apache/airflow/issues/16310 **Apache Airflow version**: 2.0.1 **Kubernetes version (if you are using kubernetes)** (use `kubectl version`): Not applicable **Environment**: - **Cloud provider or hardware

[GitHub] [airflow] sshepel commented on issue #15914: Problem with remote logging when using Azure file share for logs(webserver, scheduler and task logs)

2021-06-07 Thread GitBox
sshepel commented on issue #15914: URL: https://github.com/apache/airflow/issues/15914#issuecomment-856014709 @eladkal if the above statement was for me then I'm using `2.1.0` already... and as I mentioned before the issue mentioned in ticket is just a warning right now. -- This is an

[GitHub] [airflow] griseau commented on issue #15803: Task Instance details can't be displayed when using special attribute json

2021-06-07 Thread GitBox
griseau commented on issue #15803: URL: https://github.com/apache/airflow/issues/15803#issuecomment-856011406 @FabianF92 crystal clear ! I'll test that everything is working fine with 2.1.x and think about migrating. Thanks for your feedback -- This is an automated message

[GitHub] [airflow] kaxil commented on a change in pull request #16291: Support helm chart to be installed by Argo CD

2021-06-07 Thread GitBox
kaxil commented on a change in pull request #16291: URL: https://github.com/apache/airflow/pull/16291#discussion_r646665237 ## File path: chart/templates/jobs/migrate-database-job.yaml ## @@ -38,6 +38,9 @@ metadata: "helm.sh/hook": post-install,post-upgrade

[GitHub] [airflow] jedcunningham commented on a change in pull request #16291: Support helm chart to be installed by Argo CD

2021-06-07 Thread GitBox
jedcunningham commented on a change in pull request #16291: URL: https://github.com/apache/airflow/pull/16291#discussion_r646660158 ## File path: chart/templates/jobs/migrate-database-job.yaml ## @@ -38,6 +38,9 @@ metadata: "helm.sh/hook": post-install,post-upgrade

[GitHub] [airflow] jedcunningham commented on a change in pull request #16291: Support helm chart to be installed by Argo CD

2021-06-07 Thread GitBox
jedcunningham commented on a change in pull request #16291: URL: https://github.com/apache/airflow/pull/16291#discussion_r646655643 ## File path: chart/templates/jobs/migrate-database-job.yaml ## @@ -38,6 +38,9 @@ metadata: "helm.sh/hook": post-install,post-upgrade

[GitHub] [airflow] github-actions[bot] commented on pull request #16305: Fix extrasecrets example

2021-06-07 Thread GitBox
github-actions[bot] commented on pull request #16305: URL: https://github.com/apache/airflow/pull/16305#issuecomment-855997474 The PR is likely OK to be merged with just subset of tests for default Python and Database versions without running the full matrix of tests, because it does not

[GitHub] [airflow] fraciril opened a new issue #16307: Tree View "Refresh" uses Wrong Endpoint

2021-06-07 Thread GitBox
fraciril opened a new issue #16307: URL: https://github.com/apache/airflow/issues/16307 **Apache Airflow version**: v2.1.0 **Environment**: - **Cloud provider or hardware configuration**: GCP - **OS** (e.g. from /etc/os-release): Ubuntu 20.04 - **Server**: nginx

[GitHub] [airflow] boring-cyborg[bot] commented on issue #16307: Tree View "Refresh" uses Wrong Endpoint

2021-06-07 Thread GitBox
boring-cyborg[bot] commented on issue #16307: URL: https://github.com/apache/airflow/issues/16307#issuecomment-855991275 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] mik-laj commented on a change in pull request #16241: Update copy command for s3 to redshift

2021-06-07 Thread GitBox
mik-laj commented on a change in pull request #16241: URL: https://github.com/apache/airflow/pull/16241#discussion_r646650620 ## File path: tests/providers/amazon/aws/transfers/test_s3_to_redshift.py ## @@ -59,6 +59,61 @@ def test_execute(self, mock_run, mock_session):

[GitHub] [airflow] sunki-hong commented on a change in pull request #16241: Update copy command for s3 to redshift

2021-06-07 Thread GitBox
sunki-hong commented on a change in pull request #16241: URL: https://github.com/apache/airflow/pull/16241#discussion_r646130343 ## File path: tests/providers/amazon/aws/transfers/test_s3_to_redshift.py ## @@ -59,6 +59,61 @@ def test_execute(self, mock_run, mock_session):

[GitHub] [airflow] dnskr commented on a change in pull request #16291: Support helm chart to be installed by Argo CD

2021-06-07 Thread GitBox
dnskr commented on a change in pull request #16291: URL: https://github.com/apache/airflow/pull/16291#discussion_r646645539 ## File path: chart/templates/jobs/migrate-database-job.yaml ## @@ -38,6 +38,9 @@ metadata: "helm.sh/hook": post-install,post-upgrade

[GitHub] [airflow] FabianF92 commented on issue #15803: Task Instance details can't be displayed when using special attribute json

2021-06-07 Thread GitBox
FabianF92 commented on issue #15803: URL: https://github.com/apache/airflow/issues/15803#issuecomment-855976402 @griseau I checked again: This is fixed in PR https://github.com/apache/airflow/pull/14024 for json attribute. It is included in versions >= 2.1.0 as I can see, I testet

[GitHub] [airflow] jjlyr commented on issue #16306: Tableau connection - Flag to disable SSL

2021-06-07 Thread GitBox
jjlyr commented on issue #16306: URL: https://github.com/apache/airflow/issues/16306#issuecomment-855957679 @ashb FYI -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [airflow] jjlyr opened a new issue #16306: Tableau connection - Flag to disable SSL

2021-06-07 Thread GitBox
jjlyr opened a new issue #16306: URL: https://github.com/apache/airflow/issues/16306 **Description** To add a new flag to be able to disable SSL in Tableau connection( {"verify": "False"}? ) as it is not present in the current version, apache-airflow-providers-tableau 1.0.0

[GitHub] [airflow] coolacid commented on issue #16271: MySQL Connection Warnings/Errors (Entrypoint, Celery Executor Dangling)

2021-06-07 Thread GitBox
coolacid commented on issue #16271: URL: https://github.com/apache/airflow/issues/16271#issuecomment-855956154 I'm not confident I could correctly get the PR for the connection check - it's what I use in other projects, but pulling out the correct connection details, and knowing the

[GitHub] [airflow] jedcunningham opened a new pull request #16305: Fix extrasecrets example

2021-06-07 Thread GitBox
jedcunningham opened a new pull request #16305: URL: https://github.com/apache/airflow/pull/16305 Found a couple places where we have incorrect examples of `extraSecrets`. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [airflow] kaxil opened a new issue #16304: Add data_interval_start and data_interval_end columns to DagRun table, and set them when creating DagRuns.

2021-06-07 Thread GitBox
kaxil opened a new issue #16304: URL: https://github.com/apache/airflow/issues/16304 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [airflow] jtommi commented on issue #14672: Tasks intermittently get terminated with SIGTERM on K8s executor

2021-06-07 Thread GitBox
jtommi commented on issue #14672: URL: https://github.com/apache/airflow/issues/14672#issuecomment-855945233 If it can help, for me it also solved the issue. I'm using a simple local executor with 2 docker containers (scheduler and webserver). The root cause is probably a rather slow

[GitHub] [airflow] kaxil opened a new issue #16303: Replace `execution_date` in `TI.generate_command` to send run_id instead

2021-06-07 Thread GitBox
kaxil opened a new issue #16303: URL: https://github.com/apache/airflow/issues/16303 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [airflow] ephraimbuddy commented on a change in pull request #16030: Update `airflow tasks *` commands to lookup TaskInstances from DagRun Table

2021-06-07 Thread GitBox
ephraimbuddy commented on a change in pull request #16030: URL: https://github.com/apache/airflow/pull/16030#discussion_r646595504 ## File path: airflow/cli/commands/task_command.py ## @@ -42,9 +45,27 @@ get_dags, suppress_logs_and_warning, ) +from

[GitHub] [airflow] jedcunningham commented on a change in pull request #16291: Support helm chart to be installed by Argo CD

2021-06-07 Thread GitBox
jedcunningham commented on a change in pull request #16291: URL: https://github.com/apache/airflow/pull/16291#discussion_r646597798 ## File path: chart/templates/jobs/migrate-database-job.yaml ## @@ -38,6 +38,9 @@ metadata: "helm.sh/hook": post-install,post-upgrade

[GitHub] [airflow] kaxil opened a new issue #16302: DB migration: TaskInstance table from execution_date to run_id

2021-06-07 Thread GitBox
kaxil opened a new issue #16302: URL: https://github.com/apache/airflow/issues/16302 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [airflow] potiuk commented on pull request #16233: Fix TI success/failure links

2021-06-07 Thread GitBox
potiuk commented on pull request #16233: URL: https://github.com/apache/airflow/pull/16233#issuecomment-855933229 Yeah. I believe this is something of the AWS infrastructure for runners which we are going to replace (I hope this week) with GCP one - simplified and improved. -- This is

[GitHub] [airflow] kevinbsilva commented on pull request #15947: Applied permissions to self._error_file

2021-06-07 Thread GitBox
kevinbsilva commented on pull request #15947: URL: https://github.com/apache/airflow/pull/15947#issuecomment-855932744 Thank you for the tip! So, instead of using os.chmod we would use os.chown, right? This would avoid every user having access to the file. I will change that. Many thanks!

[GitHub] [airflow] ephraimbuddy opened a new pull request #16301: Fix task retries when they receive sigkill and have retries

2021-06-07 Thread GitBox
ephraimbuddy opened a new pull request #16301: URL: https://github.com/apache/airflow/pull/16301 Currently tasks are not retried when they receive sigkill even if the task has retries. This change fixes it and added test for both sigterm and sigkill so we don't experience regression

[GitHub] [airflow] potiuk merged pull request #16294: Updated documentation for June 2021 provider release

2021-06-07 Thread GitBox
potiuk merged pull request #16294: URL: https://github.com/apache/airflow/pull/16294 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [airflow] kaxil commented on pull request #16284: Make TriggerDagRunOperator compatible with taskflow API

2021-06-07 Thread GitBox
kaxil commented on pull request #16284: URL: https://github.com/apache/airflow/pull/16284#issuecomment-855920447 > > We will need to find a better way for #13414 in that case :( > > Right, the issue was even then mentioned explicitly [#13414

[GitHub] [airflow] kaxil commented on pull request #16257: Move `UPDATING.md` to `updating` directory in `docs/apache-airflow`

2021-06-07 Thread GitBox
kaxil commented on pull request #16257: URL: https://github.com/apache/airflow/pull/16257#issuecomment-855913705 Just rebased this PR 爛 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

  1   2   >