Re: What compression algorithm is used by the pipeline zip step, and is it tunable?

2019-12-04 Thread Tim Black
Thanks Björn. We're currently on a single master, and I definitely will take performance into consideration when we scale. We're looking into installing and ind integrating with Artifactory in the coming months, which should help with managing artifacts, but I suspect there will still be the

Re: What compression algorithm is used by the pipeline zip step, and is it tunable?

2019-12-02 Thread 'Björn Pedersen' via Jenkins Users
Hi, I would probably try to compress on the agent before even trying to transfer the large data to the master. This avoids load on the master a) due to transfer and b) due to compression. And if the artifacts get really huge, consider storing them independent from jenkins (S3, maven-style

What compression algorithm is used by the pipeline zip step, and is it tunable?

2019-12-02 Thread Tim Black
Our projects produce large artifacts that now need to be compressed, and I'm considering my alternatives. The zip step would be a nice non-plugin solution but I'm curious what compression technique this uses.