nitinkr0411 opened a new issue, #60915:
URL: https://github.com/apache/airflow/issues/60915

   ### Apache Airflow version
   
   3.1.6
   
   ### If "Other Airflow 3 version" selected, which one?
   
   and 3.1.0
   
   ### What happened?
   
   
   The DAG Processor fails to start when syncing DAG bundles to the database. 
The `signed_url_template` column in the `dag_bundle` table is defined as 
`VARCHAR(200)`, but the generated signed URL templates exceed this limit 
(approximately 204+ characters).
   
   The error occurs in `DagBundlesManager().sync_bundles_to_db()` when 
attempting to insert new DAG bundle records.
   
   **Error:**
   ```
   psycopg2.errors.StringDataRightTruncation: value too long for type character 
varying(200)
   ```
   
   **SQL Statement:**
   ```
   INSERT INTO dag_bundle (name, active, version, last_refreshed, 
signed_url_template, template_params) VALUES...
   ```
   
   **Example signed_url_template value that fails (204 characters):**
   ```
   
.eJwNzDEOglAMANC7dLZ2Z9YEV3VwM3ys0KS0pvSjCeHu8g7wVqih0MCY-ZkbokFyrOXY-0QhjimWTtf7A8-nG14sWVUGtp6xrYUymGldOGZx26iTeKt_4QCl2kv5ad3Eex75Q9lb2P6nISfp.GczPbaEw07T6VUeanLyePvIRTLA
   ```
   
   ### What you think should happen instead?
   
   
   The `signed_url_template` column should be large enough to accommodate the 
generated signed URLs. 
   
   Suggested fix: Change the column type from `VARCHAR(200)` to `TEXT` (or at 
minimum `VARCHAR(500)`).
   
   The model definition should be updated and an Alembic migration should be 
created to alter existing databases.
   
   
   ### How to reproduce
   
   
   1. Configure DAG bundles in Airflow configuration (e.g., multiple bundles 
like `example-dag-bundle-1`, `example-dag-bundle-2`, `example-dag-bundle-3`)
   2. Run `airflow db migrate` to initialize database
   3. Start the DAG Processor with `airflow dag-processor`
   4. The processor fails immediately with `StringDataRightTruncation` error
   
   **Workaround:**
   Manually alter the database column before starting the DAG processor:
   ```sql
   ALTER TABLE dag_bundle ALTER COLUMN signed_url_template TYPE TEXT;
   ```
   
   
   ### Operating System
   
   apache/airflow container
   
   ### Versions of Apache Airflow Providers
   
   apache-airflow-providers-amazon==9.20.0
   apache-airflow-providers-slack==9.6.2
   apache-airflow-providers-opensearch==1.8.3
   apache-airflow-providers-postgres==6.5.2
   apache-airflow-providers-smtp==2.4.2
   apache-airflow-providers-databricks==7.8.3
   apache-airflow-providers-microsoft-azure==12.10.2
   apache-airflow-providers-git==0.2.1
   
   ### Deployment
   
   Other Docker-based deployment
   
   ### Deployment details
   
   Airflow Deployed in Amazon ECS via Cloudformation. This happened during 
upgrade and airflow db migrate was done properly
   
   ### Anything else?
   
   **Frequency:** Every time - the DAG processor cannot start at all
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [x] I agree to follow this project's [Code of 
Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to