github-actions[bot] opened a new pull request, #72760:
URL: https://github.com/apache/airflow/pull/72760

   BaseOperations.execute_list built the merged multi-page result, then
   serialized it back to a dict with model_dump() and re-validated it as
   the same model with model_validate() before returning it. The object
   was already fully validated the moment it was constructed -- Pydantic
   validates on __init__, and every entry in the merged list had already
   gone through safe_validate() while parsing its page -- so the extra
   round trip re-checked data that was already known to be valid.
   
   Benchmarked with 20,000 entries 
(dev/benchmark_ctl_execute_list_roundtrip.py):
   the redundant dump+validate cost ~520ms and ~94 MiB of peak memory on
   top of an otherwise instant return.
   (cherry picked from commit f1f7b8c2ccea97bc7d68c9300d0546c29fa75722)
   
   Co-authored-by: Jyun-An Chen <[email protected]>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to