kaxil opened a new issue, #45428:
URL: https://github.com/apache/airflow/issues/45428

   Currently the serialization and de-serialization logic lives in 
[`airflow/serialization`](https://github.com/apache/airflow/tree/f03b1d4d996cf2b3f62c21f8c6a38aa53ba1e3be/airflow/serialization)
 in the Core. With Airflow 3 and the separation of Task SDK, we will need to 
make serialization and its versioning much stricter.
   
   We should bump the current DAG serialization version to 2.
   
   The serialization code should live closer to language-specific Task SDK as 
it knows best how to serialize objects in a language to a JSON-formatted string.
   
   The Core/scheduler will contain the de-serialization code -- and it does 
need to be language specific as it contains only the info needed by the 
scheduler.
   
   The contract between those two is the 
[`schema.json`](https://github.com/apache/airflow/blob/main/airflow/serialization/schema.json)
 file that contains the serialization. Both the client and server could support 
multiple versions at a time. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to