narrowizard opened a new issue, #8776:
URL: https://github.com/apache/incubator-devlake/issues/8776
<!--
Licensed to the Apache Software Foundation (ASF) under one or more
contributor license agreements. See the NOTICE file distributed with
this work for additional information regarding copyright ownership.
The ASF licenses this file to You under the Apache License, Version 2.0
(the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
-->
## What and why to refactor
**Problem**: CI job "build image" fails when installing Poetry via the
official installer.
The issue occurs in `backend/Dockerfile` during the `base` stage build:
```dockerfile
RUN curl -sSL https://install.python-poetry.org | python3 -
```
which results in:
```
Installing Poetry (2.3.2): Creating environment
Installing Poetry (2.3.2): Installing Poetry
Installing Poetry (2.3.2): An error occurred. Removing partial environment.
Poetry installation failed.
```
**Why refactor now**:
- Poetry installer is unreliable in CI
- Alternative approach (pipx) also has issues
## Describe the solution you'd like
Replace poetry with [uv](https://github.com/astral-sh/uv), a Rust-based
Python package manager:
**Advantages:**
- 10-100x faster than poetry
- Compatible with pyproject.toml (no config changes needed)
- Minimal overhead in QEMU environments
- Actively maintained by Astral (ruff creators)
## Related issues
- Original issue: poetry timeout in CI arm64 builds
- Python 3.9 EOL concerns
## Additional context
**Root cause identified**: Poetry 2.3.x is incompatible with Python 3.9. The
installer silently fails because it cannot create a working environment.
**Attempted workarounds:**
1. **curl installer fails** - Original method using
`install.python-poetry.org`:
```
Installing Poetry (2.3.2): Creating environment
Installing Poetry (2.3.2): Installing Poetry
Installing Poetry (2.3.2): An error occurred. Removing partial
environment.
Poetry installation failed.
```
- **Root cause**: Poetry 2.3.x requires Python >= 3.10, but the devlake
base image uses Python 3.9
2. [**Version pinning to
2.2.1**](https://github.com/apache/incubator-devlake/pull/8775) - Locking to
last Python 3.9 compatible version:
```bash
curl -sSL https://install.python-poetry.org | python3 - --version 2.2.1
```
- Installation succeeds with Poetry 2.2.1
- However, `poetry install` still times out in CI arm64 builds:
```
Creating virtualenv azuredevops-ANnMAkq9-py3.9 in
/app/.cache/pypoetry/virtualenvs
failed to query /usr/local/bin/python3.9 with code -1 err: 'timed out'
```
- Timeout occurs during virtualenv creation when Poetry queries the
Python interpreter
- This is exacerbated by QEMU emulation in cross-platform CI builds
3.[ **pipx install
poetry**](https://github.com/apache/incubator-devlake/pull/8774) - Using pipx
with version pinning:
- Installation succeeded: `python3 -m pipx install poetry`
- But `poetry install` still fails in CI arm64 builds:
```
Creating virtualenv azuredevops-ANnMAkq9-py3.9 in
/app/.cache/pypoetry/virtualenvs
failed to query /usr/local/bin/python3.9 with code -1 err: 'timed out'
```
- Root cause: Poetry queries Python interpreter during virtualenv
creation, which times out in QEMU-emulated arm64 environments
- Local arm64 builds succeed because they run on native hardware
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
