stablum commented on issue #19957:
URL: https://github.com/apache/airflow/issues/19957#issuecomment-1095093672
Hmm, actually the last recorded query starts with:
```
UPDATE serialized_dag SET data='{"__version": 1, "dag": {"_dag_id": "down
load_and_preprocess_sets", "schedule_interval": null, "_description":
"Downloads sets data from IATI.cloud", "_task_group": {"_group_id": null,
"prefix_ group_id": true, "tooltip": "", "ui_color": "CornflowerBlue",
"ui_fgcolor": "#000", "children": {"codelists": ["operator", "codelists"],
"clear_activity _ids": ["operator", "clear_activity_ids"],
"clear_activity_date": ["operator", "clear_activity_date"], "clear_budget":
["operator", "clear_budget"], "cl ear_result": ["operator", "clear_result"],
"clear_participating_org": ["operator", "clear_participating_org"],
"clear_contact_info": ["operator", "clear _contact_info"], "clear_location":
["operator", "clear_location"], "clear_sector": ["operator", "clear_sector"],
"clear_policy_marker": ["operator", "cl ear_policy_marker"],
"clear_default_aid_type": ["operator", "clear_default_aid_type"],
"clear_transaction": ["operator", "clear_transactio
n"], "clear_ac tivity_without_rels": ["operator",
"clear_activity_without_rels"], "download_0": ["operator", "download_0"],
"persist_activity_ids_0": ["operator", "per sist_activity_ids_0"],
"parse_0": ["operator", "parse_0"], "clear_page_0": ["operator",
"clear_page_0"], "persist_0_activity_date": ["operator", "persis
t_0_activity_date"], "persist_0_budget": ["operator", "persist_0_budget"],
"persist_0_result": ["operator", "persist_0_result"], "persist_0_participatin
g_org": ["operator", "persist_0_participating_org"], "persist_0_contact_info
...
```
So I'm wondering if storing the serialization of such a huge dag is creating
problems. Maybe deactivating the serialization would prevent the issue?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
