>-----Original Message-----
>From: Johan Ehnberg <jo...@molnix.com>
>Sent: Friday, August 24, 2018 09:25
>To: backuppc-users@lists.sourceforge.net
>Subject: Re: [BackupPC-users] ver 4.x split using ssd and hdd storage - size
>requirements?
>
>On 08/24/2018 04:52 PM, Mike Hughes wrote:
>> I think I've discovered a new level of failure.
...
>> Can't write new host pool count file
>> /var/lib/BackupPC//pc/hostname/refCnt/poolCntNew.1.02
>>
>> My guess is that the /var/lib/BackupPC/pc partition is the problem.
...
>> https://molnix.com/backuppc-version-4-development-allows-better-scaling/
>>
>
>Hi Mike,
>
>Post author here, nice to hear it is of use!
Great! Nice to see you again John!
>Can you check the size of the files that trigger the errors? What does
>df -h tell you during backups? If the failed refcount files linger on
>your drive, how big do they grow?
That was a really good idea and I think you nailed it. Here's a one-second
update on used space for the /var partition during an incremental backup:
[Cent-7:root@hostname ~]# while printf '%s ' "$(df -P /var | awk 'NR==2 { print
$(NF-1) }')"; do sleep 1; done
28% 28% 28% 28% 28% 28% 28% 29% 29% 31% 31% 32% 34% 34% 35% 35% 35% 35% 35% 35%
36% 36% 36% 36% 36% 36% 36% 36% 36% 36% 36% 36% 38% 40% 42% 43% 43% 43% 44% 44%
44% 44% 44% 45% 45% 45% 45% 45% 45% 45% 45% 45% 45% 45% 46% 46% 46% 46% 46% 46%
46% 49% 52% 54% 54% 54% 54% 54% 54% 54% 54% 54% 54% 54% 54% 54% 54% 54% 54% 54%
54% 57% 59% 61% 61% 61% 62% 62% 62% 62% 62% 62% 62% 63% 63% 63% 63% 63% 63% 63%
63% 63% 63% 63% 63% 63% 63% 63% 63% 63% 63% 64% 67% 69% 70% 70% 71% 71% 71% 71%
71% 71% 71% 72% 72% 72% 72% 72% 72% 72% 72% 72% 72% 72% 72% 72% 72% 72% 72% 72%
72% 72% 72% 72% 76% 79% 80% 80% 80% 80% 80% 81% 81% 81% 81% 81% 81% 81% 81% 81%
81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81%
81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81%
81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81%
81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81%
81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81%
81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81%
81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81%
81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 29% 31% 31% 32% 33% 36% 36%
36% 36% 37% 37% 37% 37% 37% 37% 37% 37% 38% 38% 38% 38% 38% 38% 38% 38% 39% 39%
39% 39% 39% 39% 39% 39% 39% 39% 39% 39% 39% 39% 39% 41% 42% 43% 43% 44% 46% 48%
48% 48% 49% 49% 49% 49% 49% 49% 49% 49% 49% 49% 49% 49% 49% 49% 49% 49% 49% 49%
50% 53% 56% 57% 57% 57% 58% 58% 58% 58% 58% 58% 58% 59% 59% 59% 59% 59% 59% 59%
59% 59% 59% 59% 59% 59% 59% 59% 59% 59% 59% 59% 59% 59% 60% 63% 65% 67% 67% 68%
68% 68% 68% 68% 69% 69% 69% 69% 69% 69% 69% 70% 70% 70% 70% 70% 71% 71% 71% 71%
71% 71% 71% 71% 71% 71% 71% 71% 71% 71% 71% 71% 71% 71% 71% 71% 71% 72% 76% 79%
81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81%
84% 86% 89% 89% 89% 90% 90% 90% 91% 91% 91% 91% 91% 91% 91% 91% 91% 91% 91% 91%
91% 91% 91% 91% 91% 91% 92% 92% 92% 92% 92% 92% 92% 92% 92% 94% 96% 98% 99%
100% 100% 100% 100% 100% 100% 100% 93% 93% 28% 28%
If you're able to receive images:
[cid:image001.png@01D43B8F.5C49A780]
caption: NewRelic showing close to but not reaching 100% utilization
So it's definitely requiring more storage than I expected. I love the idea of
using an SSD to increase performance but I need to better understand the growth
potential during backups, especially during simultaneous backups.
>I will follow this thread with interest and hopefully I have the time to
>closely monitor what happens in the pc folder during reference counts.
>
>Best regards,
>Johan
>
>--
>Johan Ehnberg
>Founder, CEO
>jo...@molnix.com<mailto:jo...@molnix.com>
>+358503209688
>
>Molnix Oy
>molnix.com
Thank you!
Mike
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
