Re: [BackupPC-users] Troubleshooting assistance for Bad Transfer

2018-08-28 Thread Craig Barratt via BackupPC-users
Either use the CGI interface to display the XferLOG file, or use
BackupPC_zcat from the command line.

Craig

On Tue, Aug 28, 2018 at 9:25 PM Jaime Fenton 
wrote:

> Hi there,
>
>
>
> On advice from craigbarrett, I’m posting this query here.
>
>
>
> https://github.com/backuppc/backuppc/issues/218
>
>
>
> I’ve gone to the XferLog file and it’s gibberish. Is there a way to
> compile that file or advice on troubleshooting that file that can give me
> some insight as to why my backups are having fatal errors?
>
>
>
> Thanks in advance,
>
> Jaime
> --
> Jaime Fenton
> Support Engineer
>
> T: +1 604 398 4800 (main)
> D: +1 604 398 4813 (direct)
> E: jaime.fen...@animallogic.ca
>
> 840 Cambie Street
> Vancouver, BC V6B 2P6
> CANADA
>
>
>   [image: LinkedIn]   [image:
> Facebook]   [image:
> Twitter]   [image: Instagram]
> 
>
> [image: Animal Logic] 
>
> www.animallogic.com
>
> *CONFIDENTIALITY AND PRIVILEGE NOTICE*
> This email is intended only to be read or used by the addressee. It is
> confidential and may contain privileged information. If you are not the
> intended recipient, any use, distribution, disclosure or copying of this
> email is strictly prohibited. Confidentiality and legal privilege attached
> to this communication are not waived or lost by reason of the mistaken
> delivery to you. If you have received this email in error, please delete it
> and notify us immediately by telephone or email.
>
> --
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> ___
> BackupPC-users mailing list
> BackupPC-users@lists.sourceforge.net
> List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki:http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/
>
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


[BackupPC-users] Troubleshooting assistance for Bad Transfer

2018-08-28 Thread Jaime Fenton
Hi there,

On advice from craigbarrett, I'm posting this query here.

https://github.com/backuppc/backuppc/issues/218

I've gone to the XferLog file and it's gibberish. Is there a way to compile 
that file or advice on troubleshooting that file that can give me some insight 
as to why my backups are having fatal errors?

Thanks in advance,
Jaime
--
Jaime Fenton
Support Engineer

T: +1 604 398 4800 (main)
D: +1 604 398 4813 (direct)
E: jaime.fen...@animallogic.ca

840 Cambie Street
Vancouver, BC V6B 2P6
CANADA


  [LinkedIn]    [Facebook] 
   [Twitter] 
   [Instagram] 


[Animal Logic]

www.animallogic.com

CONFIDENTIALITY AND PRIVILEGE NOTICE
This email is intended only to be read or used by the addressee. It is 
confidential and may contain privileged information. If you are not the 
intended recipient, any use, distribution, disclosure or copying of this email 
is strictly prohibited. Confidentiality and legal privilege attached to this 
communication are not waived or lost by reason of the mistaken delivery to you. 
If you have received this email in error, please delete it and notify us 
immediately by telephone or email.
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] No admin privilege with SCGI method

2018-08-28 Thread Timmy Siu via BackupPC-users
Hello Christopher,
The full admin control panel finally works but with some strange thing!

Here is my file /etc/httpd/conf.d/BackupPC.conf content:
#
Alias    /BackupPC    /var/www/html/BackupPC
ScriptAlias    /BackupPC_Admin        /BackupPC_Admin
SCGIMount /BackupPC_Admin 127.0.0.1:4000


order deny,allow
deny from all
allow from 127.0.0.1
AuthType Basic
AuthUserFile /etc/BackupPC/BackupPC.users
AuthName "BackupPC Community Edition Administrative Interface"
require valid-user

##

I also set backuppc with a password in the file /etc/BackupPC/BackupPC.users

I also set $Conf{CgiAdminUsers}='backuppc' in the file config.pl.

However, when I browse to http://localhost/BackupPC_Admin , I will get
banned by "403 Forbidden".
After I've removed this line from the above file:
ScriptAlias /BackupPC_Admin /BackupPC_Admin
I will then get full admin access to the control panel with being asked
for authentication.

How do I repair the Apache authentication process?

Yours faithfully,
Timmy


> Hi Timmy,
>
> did the browser ask for authentication?
>
> You have to setup a correct htpasswd file.
>
> Also, set the correct user for $Conf{CgiAdminUsers} in your config file.
>
> It's also a good idea to check that backuppc gets the correct user
> name from the brower.
>
>
> Mit freundlichen Grüßen / Best regards
> i.A. Christopher Diekkamp
>
> Otto Schneider 
>
> Otto Schneider GmbH & Co. KG
> Raiffeisenstraße 5
> D-63303 Dreieich
>
> Am 28.08.2018 um 13:40 schrieb Timmy Siu via BackupPC-users:
>> Dear All BackupPC Users,
>>
>> I have finally installed BackupPC v4.2.1.  However, it does not show any
>> admin function after I have connected to its control panel (as shown in
>> the attachment).
>>
>> How do I correct it?
>> My system is: Oracle Linux 7.5 amd64 (RHEL 7.5 clone), Apache 2.4.6,
>> BackupPC v4.2.1.
>>
>> Thanks in advance.

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] ver 4.x split using ssd and hdd storage - size requirements?

2018-08-28 Thread Mike Hughes
The partition where the "pc" folder lives needs to be larger than the size of 
your largest backup target. It will grow to the size of whatever is being 
backed up at that moment. If you have simultaneous backups, I believe it could 
grow larger than your largest backup target.

Here is how I came to that conclusion: I have been monitoring changes in the 
size of the "pc" folder every second to learn how to anticipate disk usage and 
build a better server. These are the highs and lows experienced over a typical 
evening:

01:00:29   0G
01:04:30   2G
01:07:57   1G
01:11:36   6G
01:22:16   0G
01:27:13   1G
01:31:41   0G
01:53:22   25G
02:12:39   0G
02:31:10   23G
03:05:59   0G

This was measured while backing up seven RHEL web/mysql servers on a LAN; some 
with large database dumps. All backups triggered at 1:00a and most completed in 
20 minutes. The other two servers performed full backups and took about two 
hours each, and must be responsible for the 20GB spikes. I can confirm by 
looking at the "File Size/Count Reuse Summary" table that their sizes are 
20-25GB. Add to that the potential of simultaneous runs so be sure your "pc" 
folder is on a large enough partition.

From: Mike Hughes
Sent: Friday, August 24, 2018 09:56
To: backuppc-users@lists.sourceforge.net
Subject: RE: [BackupPC-users] ver 4.x split using ssd and hdd storage - size 
requirements?


>-Original Message-

>From: Johan Ehnberg mailto:jo...@molnix.com>>

>Sent: Friday, August 24, 2018 09:25

>To: 
>backuppc-users@lists.sourceforge.net

>Subject: Re: [BackupPC-users] ver 4.x split using ssd and hdd storage - size 
>requirements?

>

>On 08/24/2018 04:52 PM, Mike Hughes wrote:

>> I think I've discovered a new level of failure.

...

>> Can't write new host pool count file

>> /var/lib/BackupPC//pc/hostname/refCnt/poolCntNew.1.02

>>

>> My guess is that the /var/lib/BackupPC/pc partition is the problem.

...

>> https://molnix.com/backuppc-version-4-development-allows-better-scaling/

>>

>

>Hi Mike,

>

>Post author here, nice to hear it is of use!



Great! Nice to see you again John!



>Can you check the size of the files that trigger the errors? What does

>df -h tell you during backups? If the failed refcount files linger on

>your drive, how big do they grow?



That was a really good idea and I think you nailed it. Here's a one-second 
update on used space for the /var partition during an incremental backup:



[Cent-7:root@hostname ~]# while printf '%s ' "$(df -P /var | awk 'NR==2 { print 
$(NF-1) }')"; do sleep 1; done

28% 28% 28% 28% 28% 28% 28% 29% 29% 31% 31% 32% 34% 34% 35% 35% 35% 35% 35% 35% 
36% 36% 36% 36% 36% 36% 36% 36% 36% 36% 36% 36% 38% 40% 42% 43% 43% 43% 44% 44% 
44% 44% 44% 45% 45% 45% 45% 45% 45% 45% 45% 45% 45% 45% 46% 46% 46% 46% 46% 46% 
46% 49% 52% 54% 54% 54% 54% 54% 54% 54% 54% 54% 54% 54% 54% 54% 54% 54% 54% 54% 
54% 57% 59% 61% 61% 61% 62% 62% 62% 62% 62% 62% 62% 63% 63% 63% 63% 63% 63% 63% 
63% 63% 63% 63% 63% 63% 63% 63% 63% 63% 63% 64% 67% 69% 70% 70% 71% 71% 71% 71% 
71% 71% 71% 72% 72% 72% 72% 72% 72% 72% 72% 72% 72% 72% 72% 72% 72% 72% 72% 72% 
72% 72% 72% 72% 76% 79% 80% 80% 80% 80% 80% 81% 81% 81% 81% 81% 81% 81% 81% 81% 
81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 
81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 
81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 
81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 
81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 
81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 
81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 
81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 29% 31% 31% 32% 33% 36% 36% 
36% 36% 37% 37% 37% 37% 37% 37% 37% 37% 38% 38% 38% 38% 38% 38% 38% 38% 39% 39% 
39% 39% 39% 39% 39% 39% 39% 39% 39% 39% 39% 39% 39% 41% 42% 43% 43% 44% 46% 48% 
48% 48% 49% 49% 49% 49% 49% 49% 49% 49% 49% 49% 49% 49% 49% 49% 49% 49% 49% 49% 
50% 53% 56% 57% 57% 57% 58% 58% 58% 58% 58% 58% 58% 59% 59% 59% 59% 59% 59% 59% 
59% 59% 59% 59% 59% 59% 59% 59% 59% 59% 59% 59% 59% 59% 60% 63% 65% 67% 67% 68% 
68% 68% 68% 68% 69% 69% 69% 69% 69% 69% 69% 70% 70% 70% 70% 70% 71% 71% 71% 71% 
71% 71% 71% 71% 71% 71% 71% 71% 71% 71% 71% 71% 71% 71% 71% 71% 71% 72% 76% 79% 
81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 81% 
84% 86% 89% 89% 89% 90% 90% 90% 91% 91% 91% 91% 91% 91% 91% 91% 91% 91% 91% 91% 
91% 91% 91% 91% 91% 91% 92% 92% 92% 92% 92% 92% 92% 92% 92% 94% 96% 98% 99% 
100% 100% 100% 100% 100% 100% 100% 93% 93% 28% 28%



If you're able to receive images:

[cid:image001.png@01D43B8F.5C49A780]

caption: NewRelic showing close to but not reaching 100% utilization



So it's definitely requiring more storage than I expected. I love the idea of 
using an SSD to 

Re: [BackupPC-users] No admin privilege with SCGI method

2018-08-28 Thread Christopher Diekkamp
Hi Timmy,

did the browser ask for authentication?

You have to setup a correct htpasswd file.

Also, set the correct user for $Conf{CgiAdminUsers} in your config file.

It's also a good idea to check that backuppc gets the correct user name
from the brower.


Mit freundlichen Grüßen / Best regards
i.A. Christopher Diekkamp

Otto Schneider 

Otto Schneider GmbH & Co. KG
Raiffeisenstraße 5
D-63303 Dreieich

Am 28.08.2018 um 13:40 schrieb Timmy Siu via BackupPC-users:
> Dear All BackupPC Users,
>
> I have finally installed BackupPC v4.2.1.  However, it does not show any
> admin function after I have connected to its control panel (as shown in
> the attachment).
>
> How do I correct it?
> My system is: Oracle Linux 7.5 amd64 (RHEL 7.5 clone), Apache 2.4.6,
> BackupPC v4.2.1.
>
> Thanks in advance.
>
>
> --
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
>
>
> ___
> BackupPC-users mailing list
> BackupPC-users@lists.sourceforge.net
> List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki:http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


[BackupPC-users] No admin privilege with SCGI method

2018-08-28 Thread Timmy Siu via BackupPC-users
Dear All BackupPC Users,

I have finally installed BackupPC v4.2.1.  However, it does not show any
admin function after I have connected to its control panel (as shown in
the attachment).

How do I correct it?
My system is: Oracle Linux 7.5 amd64 (RHEL 7.5 clone), Apache 2.4.6,
BackupPC v4.2.1.

Thanks in advance.
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/