kaxil edited a comment on issue #6714: [AIRFLOW-6153] Allow adding Custom 
Fields to Serialized Operators
URL: https://github.com/apache/airflow/pull/6714#issuecomment-560726423
 
 
   > @potiuk We once talked that DAG serialization can be done by serializing 
class arguments in the database. This PR brings us closer to implementing this 
idea.
   
   We discussed this initially, however that can easily become a pain as the 
Serialized Blob grows in sizes rapidly. We don't need all the information (of a 
task) for the Webserver and the Scheduler. Hence, the 1st task of DAG 
Serialization was to figure out what information is actually required by the 
Webserver.
   
   Increased JSON Blob size caused performance issues when we benchmarked it in 
#5743 so we reduced the blob size to as small as we could.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to