Re: [openstack-dev] [Fuel] Change diagnostic snapshot compression algoritm

Actually, we have some improvements with snapshots size and we are going to rethink our snapshots in upcoming releases. Miroslav, could you clarify the importance of this change in 6.1? On Thu, Jan 29, 2015 at 2:30 PM, Tomasz Napierala wrote: > Guys, > > We have requests for this improvement. It

Re: [openstack-dev] [Fuel] Change diagnostic snapshot compression algoritm

Guys, We have requests for this improvement. It will help with huge environments, we are talking about >5GiB of logs. Is it on the agenda? Regards, > On 22 Dec 2014, at 07:28, Bartlomiej Piotrowski > wrote: > > FYI, xz with multithreading support (5.2 release) has been marked as stable > y

Re: [openstack-dev] [Fuel] Change diagnostic snapshot compression algoritm

FYI, xz with multithreading support (5.2 release) has been marked as stable yesterday. Regards, Bartłomiej Piotrowski On Mon, Nov 24, 2014 at 12:32 PM, Bartłomiej Piotrowski < bpiotrow...@mirantis.com> wrote: > On 24 Nov 2014, at 12:25, Matthew Mosesohn wrote: > > I did this exercise over many

Re: [openstack-dev] [Fuel] Change diagnostic snapshot compression algoritm

I've moved the bug to 6.1. And I'm going to add it to our roadmap as a separate item. On Wed, Nov 26, 2014 at 1:31 PM, Mike Scherbakov wrote: > Can we put it as a work item for diagnostic snapshot improvements, so we > won't forget about this in 6.1? > > > On Tuesday, November 25, 2014, Dmitry P

Re: [openstack-dev] [Fuel] Change diagnostic snapshot compression algoritm

Can we put it as a work item for diagnostic snapshot improvements, so we won't forget about this in 6.1? On Tuesday, November 25, 2014, Dmitry Pyzhov wrote: > Thank you all for your feedback. Request postponed to the next release. We > will compare available solutions. > > On Mon, Nov 24, 2014 a

Re: [openstack-dev] [Fuel] Change diagnostic snapshot compression algoritm

Thank you all for your feedback. Request postponed to the next release. We will compare available solutions. On Mon, Nov 24, 2014 at 2:36 PM, Vladimir Kuklin wrote: > guys, there is already pxz utility in ubuntu repos. let's test it > > On Mon, Nov 24, 2014 at 2:32 PM, Bartłomiej Piotrowski < >

Re: [openstack-dev] [Fuel] Change diagnostic snapshot compression algoritm

guys, there is already pxz utility in ubuntu repos. let's test it On Mon, Nov 24, 2014 at 2:32 PM, Bartłomiej Piotrowski < bpiotrow...@mirantis.com> wrote: > On 24 Nov 2014, at 12:25, Matthew Mosesohn wrote: > > I did this exercise over many iterations during Docker container > > packing and fou

Re: [openstack-dev] [Fuel] Change diagnostic snapshot compression algoritm

Mattherw, Dmitry I would suggest to use: 1) multi-threaded utilities 2) use xz for small snapshots (<1gb) and lrzip for bigger snapshots On Mon, Nov 24, 2014 at 2:25 PM, Matthew Mosesohn wrote: > I did this exercise over many iterations during Docker container > packing and found that as long a

Re: [openstack-dev] [Fuel] Change diagnostic snapshot compression algoritm

On 24 Nov 2014, at 12:25, Matthew Mosesohn wrote: > I did this exercise over many iterations during Docker container > packing and found that as long as the data is under 1gb, it's going to > compress really well with xz. Over 1gb and lrzip looks more attractive > (but only on high memory systems)

Re: [openstack-dev] [Fuel] Change diagnostic snapshot compression algoritm

I did this exercise over many iterations during Docker container packing and found that as long as the data is under 1gb, it's going to compress really well with xz. Over 1gb and lrzip looks more attractive (but only on high memory systems). In reality, we're looking at log footprints from OpenStac

Re: [openstack-dev] [Fuel] Change diagnostic snapshot compression algoritm

IMO, we should get a bunch of snapshots and decide which compression to use according to the results of an experiment. XZ compression takes much longer, so you will need to use parallel xz compression utility. On Fri, Nov 21, 2014 at 9:09 PM, Tomasz Napierala wrote: > > > On 21 Nov 2014, at 16:5

Re: [openstack-dev] [Fuel] Change diagnostic snapshot compression algoritm

> On 21 Nov 2014, at 16:55, Dmitry Pyzhov wrote: > > We have a request for change compression from gz to xz. This simple change > halfs our snapshots. Does anyone has any objections? Otherwise we will > include this change in 6.0 release. I agree with the change, but it shouldn’t be high Reg

[openstack-dev] [Fuel] Change diagnostic snapshot compression algoritm

We have a request for change compression from gz to xz. This simple change halfs our snapshots. Does anyone has any objections? Otherwise we will include this change in 6.0 release. ___ OpenStack-dev mailing