dstandish commented on PR #39257: URL: https://github.com/apache/airflow/pull/39257#issuecomment-2078641479
but like ... also... @uranusjr, using this example... there actually are some reasonable arguments for not serializing the complete task object. for one it's more efficient. why serialize the full task (taken to include the full dag and all other tasks) and send over the network just so that "needs expansion" can be evaluated on the server, when you can just determine locally whether it needs expansion and tell the server what to do and save the net traffic and processing time? further do we not run into recursion problem serializing at task that has the full dag when the dag also has all tasks each of which has the full dag and on and on..... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
