progressive-scaler opened a new issue, #42476: URL: https://github.com/apache/airflow/issues/42476
### Apache Airflow version Other Airflow 2 version (please specify below) ### If "Other Airflow 2 version" selected, which one? 2.10.2 ### What happened? After upgrading from 2.10.0 to 2.10.2 in order to correct the issue related to [#41699](https://github.com/apache/airflow/pull/41699), the airflow is not hiding my legacy pipelines. Inside `dags/` folder, i have a subfolder called `archived/`, in which i have pipelines that i do not use anymore. These pipelines have the suffix `_legacy`. Inside the `archived/` there is the `.airflowignore` file with the _legacy keyword, in order to ignore the pipelines in which the filename ends in `_legacy`. After the upgrade, it seems that this file is not working since no pipeline in which the filename ends in `_legacy` are hidden. I tested moving `.airflowignore` to the `dags/` folder, and appended the keyword `archived/`, in order to hide all the pipelines on that folder. Still no legacy pipelines were hidden. Can you help me check what is going on here? ### What you think should happen instead? The pipelines inside `archived/` folder or the pipelines that contains `_legacy.py` in the filename should not appear on airflow dags list. ### How to reproduce - Create .airflowignore file - add the keywords `_legacy.py` and `archived/` on separate lines - create a testing dag in which the name ends in `_legacy.py` - Verify if the pipelines appear in airflow UI DAG list ### Operating System Debian GNU/Linux 12 ### Versions of Apache Airflow Providers apache-airflow-providers-amazon==8.28.0 apache-airflow-providers-celery==3.8.1 apache-airflow-providers-cncf-kubernetes==8.4.1 apache-airflow-providers-common-compat==1.2.0 apache-airflow-providers-common-io==1.4.0 apache-airflow-providers-common-sql==1.16.0 apache-airflow-providers-docker==3.13.0 apache-airflow-providers-elasticsearch==5.5.0 apache-airflow-providers-fab==1.3.0 apache-airflow-providers-ftp==3.11.0 apache-airflow-providers-google==10.23.0 apache-airflow-providers-grpc==3.6.0 apache-airflow-providers-hashicorp==3.8.0 apache-airflow-providers-http==4.13.0 apache-airflow-providers-imap==3.7.0 apache-airflow-providers-microsoft-azure==10.4.0 apache-airflow-providers-mongo==4.2.1 apache-airflow-providers-mysql==5.7.0 apache-airflow-providers-odbc==4.7.0 apache-airflow-providers-openlineage==1.11.0 apache-airflow-providers-postgres==5.12.0 apache-airflow-providers-redis==3.8.0 apache-airflow-providers-sendgrid==3.6.0 apache-airflow-providers-sftp==4.11.0 apache-airflow-providers-slack==8.9.0 apache-airflow-providers-smtp==1.8.0 apache-airflow-providers-snowflake==5.7.0 apache-airflow-providers-sqlite==3.9.0 apache-airflow-providers-ssh==3.13.1 ### Deployment Official Apache Airflow Helm Chart ### Deployment details Docker used to create the image from the original: ``` FROM apache/airflow:2.10.2 RUN pip install --no-cache-dir --upgrade "pip" RUN pip install --no-cache-dir --upgrade \ "apache-airflow-providers-google" \ "apache-airflow-providers-mongo" \ "google-ads" \ "google-api-core" \ "google-api-python-client" \ "google-auth" \ "google-auth-httplib2" \ "google-auth-oauthlib" \ "google-cloud-aiplatform" \ "google-cloud-appengine-logging" \ "google-cloud-audit-log" \ "google-cloud-automl" \ "google-cloud-bigquery" \ "google-cloud-bigquery-datatransfer" \ "google-cloud-bigquery-storage" \ "google-cloud-bigtable" \ "google-cloud-build" \ "google-cloud-container" \ "google-cloud-core" \ "google-cloud-datacatalog" \ "google-cloud-dataform" \ "google-cloud-dataplex" \ "google-cloud-dataproc" \ "google-cloud-dataproc-metastore" \ "google-cloud-dlp" \ "google-cloud-kms" \ "google-cloud-language" \ "google-cloud-logging" \ "google-cloud-memcache" \ "google-cloud-monitoring" \ "google-cloud-orchestration-airflow" \ "google-cloud-os-login" \ "google-cloud-pubsub" \ "google-cloud-redis" \ "google-cloud-secret-manager" \ "google-cloud-spanner" \ "google-cloud-speech" \ "google-cloud-storage" \ "google-cloud-tasks" \ "google-cloud-texttospeech" \ "google-cloud-translate" \ "google-cloud-videointelligence" \ "google-cloud-vision" \ "google-cloud-workflows" \ "mailchimp-marketing" ``` ### Anything else? More context: Airflow is installed in a test and production environment. Test environment is with 2.10.2 version. Production environment is with 2.10.0 version. On test environment, the issue happens. On production environment, the issue does not happen, ### Are you willing to submit PR? - [X] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
