Yicong-Huang opened a new pull request, #6110: URL: https://github.com/apache/texera/pull/6110
### What changes were proposed in this PR? Audits the explicit transitive pins in `amber/requirements.txt` and removes the two that serve no purpose. Verified with the pip dependency graph (`Required-by`) and a full `pip install --dry-run --report` resolution: | Pin | Verdict | Why | | --- | --- | --- | | `python-dateutil==2.8.2` | **Drop** | Required by six installed packages (pandas, botocore, betterproto, pg8000, aiobotocore, strictyaml) — always installed regardless. A `pip freeze` leftover from the original requirements.txt (#1259); every dependent declares `>=2.8`, so the pin only held us on a 2021 release. Resolves to 2.9.0.post0 | | `aiobotocore==2.25.1` | **Drop** | Hard dependency of s3fs; its version is already uniquely constrained by the `botocore==1.40.53` pin (aiobotocore's per-release botocore window is very narrow). Removing it eliminates a manual pairing hazard when bumping the boto3/botocore pins. Resolves to 2.25.2 | | `s3fs`, `SQLAlchemy`, `pg8000` | Keep | Empty `Required-by` — pyiceberg only pulls them via extras, so dropping them would actually uninstall them (Iceberg S3 FileIO / SqlCatalog would break at runtime). pg8000 deliberately replaces LGPL psycopg2 (#3299) | | `setuptools==80.10.2` | Keep | Guards `fs`'s `pkg_resources` import against newer setuptools removing it (#4199); `fs` declares setuptools with no version bound | `amber/LICENSE-binary-python` is updated to the dry-run-resolved versions (aiobotocore 2.25.2, python-dateutil 2.9.0.post0) so the `check_binary_deps.py` gate stays green. Note: touches lines adjacent to #6103's edits in requirements.txt — whichever merges second needs a trivial rebase. ### Any related issues, documentation, discussions? Closes #6108. Follow-up to #6101 / #6103. ### How was this PR tested? Resolution check without the pins (versions unchanged except the two dropped ones): ``` pip install --dry-run --ignore-installed --report - -r amber/requirements.txt # resolves python-dateutil 2.9.0.post0, aiobotocore 2.25.2, botocore/boto3 1.40.53 (unchanged) ``` Upgraded the local venv to the newly resolved versions, then ran the existing suite: ``` pip install python-dateutil==2.9.0.post0 aiobotocore==2.25.2 cd amber && pytest -m "not integration" -q # 551 passed, 1 deselected in 60s ``` No new tests: dependency-manifest-only change; CI's pyamber leg re-resolves from scratch and `check_binary_deps.py` verifies the LICENSE-binary-python entries. ### Was this PR authored or co-authored using generative AI tooling? Generated-by: Claude Code (claude-fable-5) 🤖 Generated with [Claude Code](https://claude.com/claude-code) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
