dilnazanlid opened a new pull request, #73727:
URL: https://github.com/apache/airflow/pull/73727
<!-- SPDX-License-Identifier: Apache-2.0
https://www.apache.org/licenses/LICENSE-2.0 -->
* **Project Board:** [AIP-85 Dag Importer (Project
#672)](https://github.com/orgs/apache/projects/672)
* 1st PR for rewiring the Dag processing process with `sdk/importers`
---
Two fixes to `ZipImporter`, part of AIP-85 (Dag importers):
- **Quadratic discovery.** In safe mode, reading each member reopened the
archive and re-parsed its central directory, so discovery grew quadratically
with the member count (1,000 members: ~80 s locally). Members are now read
through the archive already opened for listing (1,000 members: ~0.4 s).
- **Random file names.** `ZipMemberDagDefinition.as_file()` wrote members to
a randomly named temp file, so importers that derive identity from the file
name (e.g. a Dag id) produced ids like `tmp4fyq2b6r`. The temp file now keeps
the member's name.
---
##### Was generative AI tooling used to co-author this PR?
- [X] Yes (please specify the tool below)
Generated-by: Antigravity following [the
guidelines](https://github.com/apache/airflow/blob/main/contributing-docs/05_pull_requests.rst#gen-ai-assisted-contributions)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
