Re: Any chance to get snapshot-aware defragmentation?

2018-05-31 Thread Zygo Blaxell
On Mon, May 21, 2018 at 11:38:28AM -0400, Austin S. Hemmelgarn wrote: > On 2018-05-21 09:42, Timofey Titovets wrote: > > пн, 21 мая 2018 г. в 16:16, Austin S. Hemmelgarn : > > > On 2018-05-19 04:54, Niccolò Belli wrote: > > > > On venerdì 18 maggio 2018 20:33:53 CEST, Austin S. Hemmelgarn wrote: >

Re: Any chance to get snapshot-aware defragmentation?

2018-05-21 Thread Austin S. Hemmelgarn
On 2018-05-21 13:43, David Sterba wrote: On Fri, May 18, 2018 at 01:10:02PM -0400, Austin S. Hemmelgarn wrote: On 2018-05-18 12:36, Niccolò Belli wrote: On venerdì 18 maggio 2018 18:20:51 CEST, David Sterba wrote: Josef started working on that in 2014 and did not finish it. The patches can be

Re: Any chance to get snapshot-aware defragmentation?

2018-05-21 Thread David Sterba
On Fri, May 18, 2018 at 01:10:02PM -0400, Austin S. Hemmelgarn wrote: > On 2018-05-18 12:36, Niccolò Belli wrote: > > On venerdì 18 maggio 2018 18:20:51 CEST, David Sterba wrote: > >> Josef started working on that in 2014 and did not finish it. The patches > >> can be still found in his tree. The

Re: Any chance to get snapshot-aware defragmentation?

2018-05-21 Thread Austin S. Hemmelgarn
On 2018-05-21 09:42, Timofey Titovets wrote: пн, 21 мая 2018 г. в 16:16, Austin S. Hemmelgarn : On 2018-05-19 04:54, Niccolò Belli wrote: On venerdì 18 maggio 2018 20:33:53 CEST, Austin S. Hemmelgarn wrote: With a bit of work, it's possible to handle things sanely. You

Re: Any chance to get snapshot-aware defragmentation?

2018-05-21 Thread Niccolò Belli
On domenica 20 maggio 2018 12:59:28 CEST, Tomasz Pala wrote: On Sat, May 19, 2018 at 10:56:32 +0200, Niccol? Belli wrote: snapper users with hourly snapshots will not have any use for it. Anyone with hourly snapshots anyone is doomed anyway. I do not agree: having hourly snapshots doesn't

Re: Any chance to get snapshot-aware defragmentation?

2018-05-21 Thread Timofey Titovets
пн, 21 мая 2018 г. в 16:16, Austin S. Hemmelgarn : > On 2018-05-19 04:54, Niccolò Belli wrote: > > On venerdì 18 maggio 2018 20:33:53 CEST, Austin S. Hemmelgarn wrote: > >> With a bit of work, it's possible to handle things sanely. You can > >> deduplicate data from

Re: Any chance to get snapshot-aware defragmentation?

2018-05-21 Thread Austin S. Hemmelgarn
On 2018-05-19 04:54, Niccolò Belli wrote: On venerdì 18 maggio 2018 20:33:53 CEST, Austin S. Hemmelgarn wrote: With a bit of work, it's possible to handle things sanely.  You can deduplicate data from snapshots, even if they are read-only (you need to pass the `-A` option to duperemove and run

Re: Any chance to get snapshot-aware defragmentation?

2018-05-19 Thread Niccolò Belli
On sabato 19 maggio 2018 01:55:30 CEST, Tomasz Pala wrote: The "defrag only not-snapshotted data" mode would be enough for many use cases and wouldn't require more RAM. One could run this before taking a snapshot and merge _at least_ the new data. snapper users with hourly snapshots will not

Re: Any chance to get snapshot-aware defragmentation?

2018-05-19 Thread Niccolò Belli
On venerdì 18 maggio 2018 20:33:53 CEST, Austin S. Hemmelgarn wrote: With a bit of work, it's possible to handle things sanely. You can deduplicate data from snapshots, even if they are read-only (you need to pass the `-A` option to duperemove and run it as root), so it's perfectly reasonable

Re: Any chance to get snapshot-aware defragmentation?

2018-05-18 Thread Tomasz Pala
On Fri, May 18, 2018 at 13:10:02 -0400, Austin S. Hemmelgarn wrote: > Personally though, I think the biggest issue with what was done was not > the memory consumption, but the fact that there was no switch to turn it > on or off. Making defrag unconditionally snapshot aware removes one of >

Re: Any chance to get snapshot-aware defragmentation?

2018-05-18 Thread Omar Sandoval
On Fri, May 18, 2018 at 04:26:16PM -0600, Chris Murphy wrote: > On Fri, May 18, 2018 at 12:33 PM, Austin S. Hemmelgarn > wrote: > > On 2018-05-18 13:18, Niccolò Belli wrote: > >> > >> On venerdì 18 maggio 2018 19:10:02 CEST, Austin S. Hemmelgarn wrote: > >>> > >>> and also

Re: Any chance to get snapshot-aware defragmentation?

2018-05-18 Thread Chris Murphy
On Fri, May 18, 2018 at 12:33 PM, Austin S. Hemmelgarn wrote: > On 2018-05-18 13:18, Niccolò Belli wrote: >> >> On venerdì 18 maggio 2018 19:10:02 CEST, Austin S. Hemmelgarn wrote: >>> >>> and also forces the people who have ridiculous numbers of snapshots to >>> deal with

Re: Any chance to get snapshot-aware defragmentation?

2018-05-18 Thread Austin S. Hemmelgarn
On 2018-05-18 13:18, Niccolò Belli wrote: On venerdì 18 maggio 2018 19:10:02 CEST, Austin S. Hemmelgarn wrote: and also forces the people who have ridiculous numbers of snapshots to deal with the memory usage or never defrag Whoever has at least one snapshot is never going to defrag anyway,

Re: Any chance to get snapshot-aware defragmentation?

2018-05-18 Thread Niccolò Belli
On venerdì 18 maggio 2018 19:10:02 CEST, Austin S. Hemmelgarn wrote: and also forces the people who have ridiculous numbers of snapshots to deal with the memory usage or never defrag Whoever has at least one snapshot is never going to defrag anyway, unless he is willing to double the used

Re: Any chance to get snapshot-aware defragmentation?

2018-05-18 Thread Austin S. Hemmelgarn
On 2018-05-18 12:36, Niccolò Belli wrote: On venerdì 18 maggio 2018 18:20:51 CEST, David Sterba wrote: Josef started working on that in 2014 and did not finish it. The patches can be still found in his tree. The problem is in excessive memory consumption when there are many snapshots that need

Re: Any chance to get snapshot-aware defragmentation?

2018-05-18 Thread Niccolò Belli
On venerdì 18 maggio 2018 18:20:51 CEST, David Sterba wrote: Josef started working on that in 2014 and did not finish it. The patches can be still found in his tree. The problem is in excessive memory consumption when there are many snapshots that need to be tracked during the defragmentation,

Re: Any chance to get snapshot-aware defragmentation?

2018-05-18 Thread David Sterba
On Fri, May 11, 2018 at 05:22:26PM +0200, Niccolò Belli wrote: > I'm waiting for this feature since years and initially it seemed like > something which would have been worked on, sooner or later. > A long time had passed without any progress on this, so I would like to > know if there is any

Any chance to get snapshot-aware defragmentation?

2018-05-11 Thread Niccolò Belli
Hi, I'm waiting for this feature since years and initially it seemed like something which would have been worked on, sooner or later. A long time had passed without any progress on this, so I would like to know if there is any technical limitation preventing this or if it's something which