Taragolis commented on PR #36611: URL: https://github.com/apache/airflow/pull/36611#issuecomment-1879156230
I guess so because we have requirements for Docker Compose V2 now. My personal docker compose file for testing something internal on RC versions of Airflow/Providers also a bit out-date 🤣 BTW, I've tested on on docker compose which released with 2.5.3 and 2.8.0 and it works without any issues with specific this versions. **Airflow 2.5.3 from scratch** ```console ❯ curl -LfO 'https://airflow.apache.org/docs/apache-airflow/2.5.3/docker-compose.yaml' % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 100 11576 100 11576 0 0 54362 0 --:--:-- --:--:-- --:--:-- 54603 ❯ docker compose down --volumes --remove-orphans [+] Running 5/5 ✔ Container airflow-native-airflow-init-1 Removed 0.0s ✔ Container airflow-native-postgres-1 Removed 0.3s ✔ Container airflow-native-redis-1 Removed 0.3s ✔ Volume airflow-native_postgres-db-volume Removed 0.1s ✔ Network airflow-native_default Removed 0.1s ❯ docker compose up airflow-init [+] Building 0.0s (0/0) docker:desktop-linux [+] Running 5/4 ✔ Network airflow-native_default Created 0.0s ✔ Volume "airflow-native_postgres-db-volume" Created 0.0s ✔ Container airflow-native-redis-1 Created 0.0s ✔ Container airflow-native-postgres-1 Created 0.0s ✔ Container airflow-native-airflow-init-1 Created 0.0s Attaching to airflow-native-airflow-init-1 ... airflow-native-airflow-init-1 | [2024-01-05 19:17:11,067] {manager.py:562} INFO - Added Permission can delete on DAGs to role Admin airflow-native-airflow-init-1 | [2024-01-05 19:17:11,147] {manager.py:212} INFO - Added user airflow airflow-native-airflow-init-1 | User "airflow" created with role "Admin" airflow-native-airflow-init-1 | 2.5.3 airflow-native-airflow-init-1 exited with code 0 ``` **Upgrade from 2.5.3 to 2.8.0** ```console ❯ curl -LfO 'https://airflow.apache.org/docs/apache-airflow/2.8.0/docker-compose.yaml' % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 100 10940 100 10940 0 0 65989 0 --:--:-- --:--:-- --:--:-- 65903 ❯ docker compose up airflow-init [+] Building 0.0s (0/0) docker:desktop-linux [+] Running 3/3 ✔ Container airflow-native-redis-1 Running 0.0s ✔ Container airflow-native-postgres-1 Running 0.0s ✔ Container airflow-native-airflow-init-1 Recreated 0.5s Attaching to airflow-native-airflow-init-1 airflow-native-airflow-init-1 | The container is run as root user. For security, consider using a regular user account. airflow-native-airflow-init-1 | airflow-native-airflow-init-1 | DB: postgresql+psycopg2://airflow:***@postgres/airflow airflow-native-airflow-init-1 | Performing upgrade to the metadata database postgresql+psycopg2://airflow:***@postgres/airflow airflow-native-airflow-init-1 | [2024-01-05T19:18:36.404+0000] {migration.py:213} INFO - Context impl PostgresqlImpl. airflow-native-airflow-init-1 | [2024-01-05T19:18:36.405+0000] {migration.py:216} INFO - Will assume transactional DDL. airflow-native-airflow-init-1 | [2024-01-05T19:18:36.409+0000] {db.py:1615} INFO - Creating tables airflow-native-airflow-init-1 | INFO [alembic.runtime.migration] Context impl PostgresqlImpl. airflow-native-airflow-init-1 | INFO [alembic.runtime.migration] Will assume transactional DDL. airflow-native-airflow-init-1 | INFO [alembic.runtime.migration] Running upgrade 290244fb8b83 -> 6abdffdd4815, add dttm index on log table airflow-native-airflow-init-1 | INFO [alembic.runtime.migration] Running upgrade 6abdffdd4815 -> 98ae134e6fff, Increase length of user identifier columns in ``ab_user`` and ``ab_register_user`` tables airflow-native-airflow-init-1 | INFO [alembic.runtime.migration] Running upgrade 98ae134e6fff -> c804e5c76e3e, Add ``onupdate`` cascade to ``task_map`` table airflow-native-airflow-init-1 | INFO [alembic.runtime.migration] Running upgrade c804e5c76e3e -> 937cbd173ca1, Add index to task_instance table airflow-native-airflow-init-1 | INFO [alembic.runtime.migration] Running upgrade 937cbd173ca1 -> 788397e78828, Add custom_operator_name column airflow-native-airflow-init-1 | INFO [alembic.runtime.migration] Running upgrade 788397e78828 -> 405de8318b3a, add include_deferred column to pool airflow-native-airflow-init-1 | INFO [alembic.runtime.migration] Running upgrade 405de8318b3a -> 375a816bbbf4, add new field 'clear_number' to dagrun airflow-native-airflow-init-1 | INFO [alembic.runtime.migration] Running upgrade 375a816bbbf4 -> f7bf2a57d0a6, Add owner_display_name to (Audit) Log table airflow-native-airflow-init-1 | INFO [alembic.runtime.migration] Running upgrade f7bf2a57d0a6 -> bd5dfbe21f88, Make connection login/password TEXT airflow-native-airflow-init-1 | INFO [alembic.runtime.migration] Running upgrade bd5dfbe21f88 -> 10b52ebd31f7, Add processor_subdir to ImportError. airflow-native-airflow-init-1 | Database migrating done! airflow-native-airflow-init-1 | /home/airflow/.local/lib/python3.8/site-packages/flask_limiter/extension.py:336 UserWarning: Using the in-memory storage for tracking rate limits as no storage was explicitly specified. This is not recommended for production use. See: https://flask-limiter.readthedocs.io#configuring-a-storage-backend for documentation about configuring the storage backend. airflow-native-airflow-init-1 | airflow already exist in the db airflow-native-airflow-init-1 | 2.8.0 airflow-native-airflow-init-1 exited with code 0 ``` **Airflow 2.8.0 from scratch** ```console ❯ curl -LfO 'https://airflow.apache.org/docs/apache-airflow/2.8.0/docker-compose.yaml' % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 100 10940 100 10940 0 0 75015 0 --:--:-- --:--:-- --:--:-- 75448 ❯ docker compose down --volumes --remove-orphans [+] Running 5/5 ✔ Container airflow-native-airflow-init-1 Removed 0.0s ✔ Container airflow-native-redis-1 Removed 0.3s ✔ Container airflow-native-postgres-1 Removed 0.2s ✔ Volume airflow-native_postgres-db-volume Removed 0.1s ✔ Network airflow-native_default Removed 0.1s ❯ docker compose up airflow-init [+] Building 0.0s (0/0) docker:desktop-linux [+] Running 5/4 ✔ Network airflow-native_default Created 0.0s ✔ Volume "airflow-native_postgres-db-volume" Created 0.0s ✔ Container airflow-native-redis-1 Created 0.1s ✔ Container airflow-native-postgres-1 Created 0.1s ✔ Container airflow-native-airflow-init-1 Created 0.0s Attaching to airflow-native-airflow-init-1 ... airflow-native-airflow-init-1 | [2024-01-05T19:21:40.257+0000] {override.py:1820} INFO - Added Permission menu access on Permission Pairs to role Admin airflow-native-airflow-init-1 | [2024-01-05T19:21:40.852+0000] {override.py:1458} INFO - Added user airflow airflow-native-airflow-init-1 | User "airflow" created with role "Admin" airflow-native-airflow-init-1 | 2.8.0 airflow-native-airflow-init-1 exited with code 0 ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
