[
https://issues.apache.org/jira/browse/AIRFLOW-5948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kaxil Naik updated AIRFLOW-5948:
--------------------------------
Description:
Replace SimpleDag with serialized version (json over multiprocessing) in
SchedulerJob etc., no other change in scheduler behaviour. (This doesn't make
sense long term, but does tidy up the code)
Currently, we have 2 Serialized Representation:
SimpleDags (were created because SimpleDags were not pickleable)
Serialized DAG
We should remove SimpleDags
was:Replace SimpleDag with serialized version (json over multiprocessing) in
SchedulerJob etc., no other change in scheduler behaviour. (This doesn't make
sense long term, but does tidy up the code)
> Replace SimpleDag with serialized version
> -----------------------------------------
>
> Key: AIRFLOW-5948
> URL: https://issues.apache.org/jira/browse/AIRFLOW-5948
> Project: Apache Airflow
> Issue Type: Improvement
> Components: core, scheduler
> Affects Versions: 2.0.0, 1.10.7
> Reporter: Kaxil Naik
> Assignee: Kaxil Naik
> Priority: Critical
> Labels: dag-serialization
>
> Replace SimpleDag with serialized version (json over multiprocessing) in
> SchedulerJob etc., no other change in scheduler behaviour. (This doesn't make
> sense long term, but does tidy up the code)
> Currently, we have 2 Serialized Representation:
> SimpleDags (were created because SimpleDags were not pickleable)
> Serialized DAG
> We should remove SimpleDags
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
