hussein-awala opened a new pull request, #76032: URL: https://github.com/apache/airflow/pull/76032
XCom lists return metadata, but currently also fetch and decode the stored values. Defer the value column for list requests to avoid transferring and processing data the response does not use. Individual value requests retain their existing behavior. For pages of 100 entries selected from 1,000 current-store rows, with 16 KiB native JSON values: | Database | Before | After | Time reduction | |---|---:|---:|---:| | PostgreSQL 14 | 19.85 ms | 14.73 ms | 25.78% | | MySQL 8 | 92.02 ms | 69.48 ms | 24.50% | | SQLite | 13.81 ms | 11.27 ms | 18.40% | These medians cover the list handler, response JSON serialization, and SQL-capture callbacks. They exclude HTTP and dependency setup. Additional benchmarks cover legacy storage, JSON-string values, and mixed storage with 1,000 visible entries backed by 1,500 physical rows. Small values and empty pages show little benefit. In the refreshed runs, the largest empty-page increase was 0.23 ms. Response content and query counts remain unchanged. The inner union can still process payloads—MySQL still materializes it—so the improvement does not eliminate all database work involving values. The regression test covers current, legacy, and mixed storage, including override precedence. It checks the actual columns returned by the database and fails against the original query. All 99 public XCom endpoint tests pass on each of PostgreSQL, MySQL, and SQLite. The selected core API and Always suites passed before rebasing (6,513 database tests passed, 15 skipped; 1,259 non-database tests passed, one expected failure). The refreshed base passed all 99 endpoint tests on each backend plus five targeted tests for the intervening retry-timestamp changes. Dependency lockfiles and selected test groups were unchanged; the fresh API selection adds the two new upstream tests included in that targeted run. Selected common.compat/fab provider suites also pass (415 database tests and 622 non-database tests; 17 skipped). The selected documentation builds and regular/manual static checks pass. --- ##### Was generative AI tooling used to co-author this PR? - [X] Yes — Codex (GPT-6) Generated-by: Codex (GPT-6) following [the guidelines](https://github.com/apache/airflow/blob/main/contributing-docs/05_pull_requests.rst#gen-ai-assisted-contributions) --- Drafted-by: Codex (GPT-6) (no human review before posting) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
