AadarshBhalerao opened a new issue, #40917: URL: https://github.com/apache/airflow/issues/40917
### Apache Airflow version Other Airflow 2 version (please specify below) ### If "Other Airflow 2 version" selected, which one? 2.9.2 ### What happened? I am using airflow with docker. Below mentioned are my files docker-compose.yml ``` # Licensed to the Apache Software Foundation (ASF) under one # or more contributor license agreements. See the NOTICE file # distributed with this work for additional information # regarding copyright ownership. The ASF licenses this file # to you under the Apache License, Version 2.0 (the # "License"); you may not use this file except in compliance # with the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # --- version: '3' x-airflow-common: &airflow-common image: apache/airflow:2.9.3 environment: &airflow-common-env AIRFLOW__CORE__EXECUTOR: LocalExecutor AIRFLOW__DATABASE__SQL_ALCHEMY_CONN: postgresql+psycopg2://airflow:airflow@postgres/airflow AIRFLOW__CORE__FERNET_KEY: FB0o_zt4e3Ziq3LdUUO7F2Z95cvFFx16hU8jTeR1ASM= AIRFLOW__CORE__LOAD_EXAMPLES: 'false' AIRFLOW__API__AUTH_BACKENDS: 'airflow.api.auth.backend.basic_auth' AIRFLOW__SCHEDULER__ENABLE_HEALTH_CHECK: 'true' volumes: - ${AIRFLOW_PROJ_DIR:-.}/dags:/opt/airflow/dags - ${AIRFLOW_PROJ_DIR:-.}/logs:/opt/airflow/logs - ${AIRFLOW_PROJ_DIR:-.}/config:/opt/airflow/config - ${AIRFLOW_PROJ_DIR:-.}/plugins:/opt/airflow/plugins - ./requirements.txt:/requirements.txt # user: "${AIRFLOW_UID:-50000}:0" depends_on: &airflow-common-depends-on postgres: condition: service_healthy services: postgres: image: postgres:13 environment: POSTGRES_USER: airflow POSTGRES_PASSWORD: airflow POSTGRES_DB: airflow volumes: - postgres-db-volume:/var/lib/postgresql/data healthcheck: test: ["CMD", "pg_isready", "-U", "airflow"] interval: 10s retries: 5 start_period: 5s restart: always airflow-webserver: <<: *airflow-common command: bash -c "pip install -r /requirements.txt && airflow webserver" ports: - "8080:8080" healthcheck: test: ["CMD", "curl", "--fail", "http://localhost:8080/health";] interval: 30s timeout: 10s retries: 5 start_period: 30s restart: always depends_on: <<: *airflow-common-depends-on airflow-init: condition: service_completed_successfully airflow-scheduler: <<: *airflow-common command: scheduler healthcheck: test: ["CMD", "curl", "--fail", "http://localhost:8974/health";] interval: 30s timeout: 10s retries: 5 start_period: 30s restart: always depends_on: <<: *airflow-common-depends-on airflow-init: condition: service_completed_successfully airflow-init: <<: *airflow-common entrypoint: /bin/bash # yamllint disable rule:line-length command: - -c - airflow db init && airflow users create --role Admin --username airflow --password airflow --email [email protected] --firstname airflow --lastname airflow # yamllint enable rule:line-length restart: on-failure volumes: postgres-db-volume: ``` my dag.py ``` import logging from airflow import DAG from airflow.operators.python import PythonOperator from datetime import datetime def get_input(ti, **kwargs): logging.info("Fetching inputs from config") conf = kwargs['dag_run'].conf try: value_1 = float(conf.get('value_1')) value_2 = float(conf.get('value_2')) power_n = int(conf.get('power_n')) except (TypeError, ValueError) as e: logging.error(f"Invalid input values: {e}") raise ti.xcom_push(key="value_1", value=value_1) ti.xcom_push(key="value_2", value=value_2) ti.xcom_push(key="power_n", value=power_n) logging.info(f"Received values: {value_1}, {value_2}, and power {power_n}") def calculate_sum(ti, **kwargs): logging.info("Calculating sum") value_1 = ti.xcom_pull(key="value_1", task_ids="get_input") value_2 = ti.xcom_pull(key="value_2", task_ids="get_input") result = value_1 + value_2 ti.xcom_push(key='sum', value=result) logging.info(f'Sum of {value_1} and {value_2} is {result}') def calculate_subtraction(ti, **kwargs): logging.info("Calculating subtraction") value_1 = ti.xcom_pull(key="value_1", task_ids="get_input") value_2 = ti.xcom_pull(key="value_2", task_ids="get_input") result = value_1 - value_2 ti.xcom_push(key="subtract", value=result) logging.info(f'{value_1} - {value_2} is {result}') def calculate_multiplication_and_power(ti, **kwargs): logging.info("Calculating multiplication and power") sum_value = ti.xcom_pull(key="sum", task_ids="calculate_sum") subtract_value = ti.xcom_pull(key="subtract", task_ids="calculate_subtraction") power_n = ti.xcom_pull(key="power_n", task_ids="get_input") multiplication_result = sum_value * subtract_value power_result = multiplication_result ** power_n ti.xcom_push(key='power_result', value=power_result) logging.info(f'({sum_value} * {subtract_value}) ^ {power_n} is {power_result}') default_args = { 'start_date': datetime(2024, 1, 1), } with DAG( dag_id='parallel_pipeline_dag_with_power', default_args=default_args, schedule_interval=None ) as dag: task1 = PythonOperator( task_id='get_input', python_callable=get_input, ) task2 = PythonOperator( task_id='calculate_sum', python_callable=calculate_sum, ) task3 = PythonOperator( task_id='calculate_subtraction', python_callable=calculate_subtraction, ) task4 = PythonOperator( task_id='calculate_multiplication_and_power', python_callable=calculate_multiplication_and_power, ) task1 >> [task2, task3] >> task4 ``` once done. I entered docker-compose up -d Every container started properly. When I opened the webserver using localhost, I was able to login via my set creds in .yml file. My dag is also present in the listing page. but when I click on my dag, I get error ON UI: ``` Ooops! Something bad has happened. For security reasons detailed information about the error is not logged. * You should check your webserver logs and retrieve details of this error. * When you get the logs, it might explain the reasons, you should also Look for similar issues using: * [GitHub Discussions](https://github.com/apache/airflow/discussions) * [GitHub Issues](https://github.com/apache/airflow/issues) * [Stack Overflow](https://stackoverflow.com/questions/tagged/airflow) * the usual search engine you use on a daily basis All those resources might help you to find a solution to your problem. * if you run Airflow on a Managed Service, consider opening an issue using the service support channels * only after you tried it all, and have difficulty with diagnosing and fixing the problem yourself, get the logs with errors, describe results of your investigation so far, and consider creating a [bug report](https://github.com/apache/airflow/issues/new/choose) including this information. Python version: redacted Airflow version: redacted Node: redacted ------------------------------------------------------------------------------- Error! Please contact server admin. ``` And on airflow-webserver-1 (container) ``` 2024-07-21 23:56:52 [2024-07-21T18:26:52.251+0000] {app.py:1744} ERROR - Exception on /dags/parallel_pipeline_dag_with_power/grid [GET] 2024-07-21 23:56:52 Traceback (most recent call last): 2024-07-21 23:56:52 File "/home/airflow/.local/lib/python3.12/site-packages/flask/app.py", line 2529, in wsgi_app 2024-07-21 23:56:52 response = self.full_dispatch_request() 2024-07-21 23:56:52 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2024-07-21 23:56:52 File "/home/airflow/.local/lib/python3.12/site-packages/flask/app.py", line 1825, in full_dispatch_request 2024-07-21 23:56:52 rv = self.handle_user_exception(e) 2024-07-21 23:56:52 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2024-07-21 23:56:52 File "/home/airflow/.local/lib/python3.12/site-packages/flask/app.py", line 1823, in full_dispatch_request 2024-07-21 23:56:52 rv = self.dispatch_request() 2024-07-21 23:56:52 ^^^^^^^^^^^^^^^^^^^^^^^ 2024-07-21 23:56:52 File "/home/airflow/.local/lib/python3.12/site-packages/flask/app.py", line 1799, in dispatch_request 2024-07-21 23:56:52 return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) 2024-07-21 23:56:52 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2024-07-21 23:56:52 File "/home/airflow/.local/lib/python3.12/site-packages/airflow/www/auth.py", line 244, in decorated 2024-07-21 23:56:52 is_authorized = get_auth_manager().is_authorized_dag( 2024-07-21 23:56:52 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2024-07-21 23:56:52 File "/home/airflow/.local/lib/python3.12/site-packages/airflow/providers/fab/auth_manager/fab_auth_manager.py", line 238, in is_authorized_dag 2024-07-21 23:56:52 if (details and details.id) and not self._is_authorized_dag( 2024-07-21 23:56:52 ^^^^^^^^^^^^^^^^^^^^^^^^ 2024-07-21 23:56:52 File "/home/airflow/.local/lib/python3.12/site-packages/airflow/providers/fab/auth_manager/fab_auth_manager.py", line 409, in _is_authorized_dag 2024-07-21 23:56:52 is_global_authorized = self._is_authorized(method=method, resource_type=RESOURCE_DAG, user=user) 2024-07-21 23:56:52 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2024-07-21 23:56:52 File "/home/airflow/.local/lib/python3.12/site-packages/airflow/providers/fab/auth_manager/fab_auth_manager.py", line 390, in _is_authorized 2024-07-21 23:56:52 user_permissions = self._get_user_permissions(user) 2024-07-21 23:56:52 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2024-07-21 23:56:52 File "/home/airflow/.local/lib/python3.12/site-packages/airflow/providers/fab/auth_manager/fab_auth_manager.py", line 471, in _get_user_permissions 2024-07-21 23:56:52 return getattr(user, "perms") or [] 2024-07-21 23:56:52 ^^^^^^^^^^^^^^^^^^^^^^ 2024-07-21 23:56:52 File "/home/airflow/.local/lib/python3.12/site-packages/airflow/providers/fab/auth_manager/models/anonymous_user.py", line 48, in perms 2024-07-21 23:56:52 (perm.action.name, perm.resource.name) for role in self.roles for perm in role.permissions 2024-07-21 23:56:52 ^^^^^^^^^^^^^^^^ 2024-07-21 23:56:52 AttributeError: 'NoneType' object has no attribute 'permissions' 2024-07-21 23:56:52 172.20.0.1 - - [21/Jul/2024:18:26:52 +0000] "GET /dags/parallel_pipeline_dag_with_power/grid HTTP/1.1" 500 1592 "http://localhost:8080/home?status=active"; "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/126.0.0.0 Safari/537.36" ``` ### What you think should happen instead? I should be able to access the DAG to run/test it. ### How to reproduce folder |-dags |-simple-dag.py |-logs |-plugins |-docker-compose.yml |-requirements.txt content inside requirements.txt ``` apache-airflow==2.9.2 boto3==1.34.143 ``` ### Operating System WSL ### Versions of Apache Airflow Providers 2.9.2 ### Deployment Docker-Compose ### Deployment details _No response_ ### Anything else? _No response_ ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
