mhyatt000 opened a new issue, #35343:
URL: https://github.com/apache/beam/issues/35343
### What happened?
Hello! I use `beam` with `tfds`. currently `apache-beam[gcp]==2.65.0`
I want to also use huggingface `datasets>=3.2.0`, but requires `dill==0.4.0`
while beam needs `dill>=0.3.1.1,<0.3.2`
I force the version of dill to 0.4.0 anyways with no issues. Can beam allow
dill 0.4.0 without override?
_(manually install `multiprocess` to satisfy `datasets` because of
compatibility issue with dill)_
```
uv add --optional data multiprocess==0.70.18
× No solution found when resolving dependencies for split
(python_full_version >= '3.13' and sys_platform == 'linux'):
╰─▶ Because multiprocess==0.70.18 depends on dill>=0.4.0 and
apache-beam==2.65.0 depends on dill>=0.3.1.1,<0.3.2, we can conclude that
multiprocess==0.70.18 and apache-beam[gcp]==2.65.0 are incompatible.
And because only apache-beam[gcp]<=2.65.0 is available and
shortcut-models[data] depends on apache-beam[gcp]>=2.65.0, we can conclude that
multiprocess==0.70.18 and shortcut-models[data] are incompatible.
And because shortcut-models[data] depends on multiprocess==0.70.18 and
your project requires shortcut-models[data], we can conclude that your
project's requirements are unsatisfiable.
help: If you want to add the package regardless of the failed resolution,
provide the --frozen flag to skip locking and syncing.
```
### Issue Priority
Priority: 3 (minor)
### Issue Components
- [x] Component: Python SDK
- [ ] Component: Java SDK
- [ ] Component: Go SDK
- [ ] Component: Typescript SDK
- [ ] Component: IO connector
- [ ] Component: Beam YAML
- [ ] Component: Beam examples
- [ ] Component: Beam playground
- [ ] Component: Beam katas
- [ ] Component: Website
- [ ] Component: Infrastructure
- [ ] Component: Spark Runner
- [ ] Component: Flink Runner
- [ ] Component: Samza Runner
- [ ] Component: Twister2 Runner
- [ ] Component: Hazelcast Jet Runner
- [ ] Component: Google Cloud Dataflow Runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscr...@beam.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
