dingo4dev opened a new issue, #2219:
URL: https://github.com/apache/iceberg-python/issues/2219
### Feature Request / Improvement
### Feature Request / Enhancement
I would like to propose adding a Trino Docker Compose configuration to the
development environment for testing purposes.
Inspired from
https://github.com/issues/created?issue=apache%7Ciceberg-python%7C2002. I've
noticed our integration tests rely heavily on Spark. In my case, I use
PyIceberg for writes and Trino/Athena for queries. I'm wondering if we could
add a Trino setup to our dev environment to help test this common interaction
and ensure compatibility. I would consider separating the pytest marker
`integration` and adding new marker `integration-trino` for the testcases
related to Trino.
### Benefits
- More diverse testing ecosystem beyond Spark
- Validate py-iceberg's write and update operations against a popular query
engine like Trino
- Make it easier to reproduce and debug issues that might be specific to the
Trino/Iceberg integration
- [x] I'm happy to contribute
Does anyone have thoughts on this, or perhaps suggestions on the best way to
implement it? Any information or guidance would be highly appreciated!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
