[
https://issues.apache.org/jira/browse/CASSANDRA-14985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16745246#comment-16745246
]
Stefan Podkowinski commented on CASSANDRA-14985:
------------------------------------------------
The maven dependencies should be pulled only once by the single CI "build" step
and persisted to the workspace, before spawning the parallel containers. But it
just does this for the version that is to be tested. I also get why github
would block us for downloading 200x cassandra distributions in parallel.
Can you create a separate Dockerfile with your added steps that is based on the
one we used so far (referred to by {{From}})? I'd like to avoid unintentionally
upgrading packages in the base image, in case you just want to update maven/ccm
deps. Also collapsing run commands, using multi-line arguments, should prevent
creating a new layer for every line and make them more readable.
On the long run, we should probably give the CircleCI [caching
feature|https://circleci.com/docs/2.0/caching/] a try, after CASSANDRA-14806
was merged.
> CircleCI docker image should bake in more dependencies
> --------------------------------------------------------
>
> Key: CASSANDRA-14985
> URL: https://issues.apache.org/jira/browse/CASSANDRA-14985
> Project: Cassandra
> Issue Type: Test
> Components: Test/dtest, Test/unit
> Reporter: Ariel Weisberg
> Assignee: Ariel Weisberg
> Priority: Major
> Fix For: 4.0
>
>
> It's pretty frequent especially in the upgrade tests for either maven or
> github to fail. I think they are detecting the thundering herd of containers
> all pulling stuff at the same time and opting out.
> We can reduce this especially for maven dependencies since most are hardly
> ever changing by downloading everything we can in advance and baking it into
> the image.
> When building the docker image Initialize the local maven repository by
> running ant maven-ant-tasks-retrieve-build for 2.1-trunk and do the same with
> CCM and the Apache repository.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org
