jorgecarleitao opened a new pull request #12407: URL: https://github.com/apache/arrow/pull/12407
This is a draft PR to gauge interest in splitting the build of integration tests into separate stages, so that a change in a language does not trigger a rebuild in all of them. The idea is to use docker multi-stage builds to build the integration test binaries for each of the language, which are then packed in the same docker image prior to running all the tests. This has 2 main consequences: 1. the build of each of the languages is done in parallel, since docker parallelizes independent stages 2. the build of a language is only done when something changed on it Overall, the hope is to significantly reduce the time it takes to build and run the tests, as we only need to build the language that changed in a given PR as opposed to all of them. There are some rough edges in the crossbow, but before handling them, I would like to gauge whether this is something that others would be interested in. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
