[bareos-users] Re: New release notification
Am Freitag, 14. Juli 2017 14:59:16 UTC+2 schrieb Chris Sheaves: > Is there a list or way to be notified when a new version has been released? > > Thanks You could use the release feed from GitHub: https://github.com/bareos/bareos/releases.atom, from bareos.org: https://www.bareos.org/share/bareos-project-feed.xml or from bareos.com: http://www.bareos.com/share/en_company_news.xml. -- You received this message because you are subscribed to the Google Groups "bareos-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to bareos-users+unsubscr...@googlegroups.com. To post to this group, send email to bareos-users@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[bareos-users] Big job with lots of users
I've got a mail server full of millions of tiny little files (messages) that I back up to my Bareos server at another location. It works, but it takes several days to complete, and I've had to use LVM snapshots to get steady, consistent backups, as the data changes fairly rapidly from hour to hour. In total I've got around 1.2 terabytes of data spread across 18-20 million files that needs to be backed up to eliminate any possible conflicts (uplink bandwidth on the switch during the day, for example). I'm trying to see if there is a way to configure Bareos so that there's more efficient use of the bandwidth, or just find ways to speed the whole process up. I've fiddled with setting the network buffer at the bareos-sd level, enabling compression, enabling/disabling spooling, etc. I'm getting10-15 MB/s at best, but looking uniquely at bandwidth alone, I should see even better transfer speeds (network bandwidth is at least 1 Gbps along the entire path). Bandwidth between locations isn't an issue. From what I can see, the excess overhead of transferring so many small files is what is causing the majority of the slowdowns. Read speed from the disk (snapshot I'm coping is riding off of an Areca RAID card) is 10-12 Mbps. The Bareos server is CentOS. The target system is a Ubuntu 12.04 LTS rig (yes, I know -- planning to upgrade the OS soon). What do you suggest I try to speed things up? Best Jason -- You received this message because you are subscribed to the Google Groups "bareos-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to bareos-users+unsubscr...@googlegroups.com. To post to this group, send email to bareos-users@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: [bareos-users] Re: Backup of clients in different network with long run before scripts terminate with connection reset
It works *most of the time* the way it is. It's not easy to reproduce
it. I can test with a simple batch but I don't think an escaping problem
can cause a"connection reset" once every 10 backups (just saying) :-)
Il 18/07/2017 14:37, Bruno Friedmann ha scritto:
On mardi, 18 juillet 2017 09.18:28 h CEST Cristian Mammoli wrote:
Tha was just an example script, it does work for the record ( i create a
systemstate backup Before and dump it after backup).
Anyway I get connection reset by peer even with a simle script such as:
Run Script {
Command = "del /Q \"C:\\Program Files\\MySQL\\MySQL Server
5.7\\Backup\\MySQL.bak\""
Runs When = after
Fail Job On Error = No
}
Considering the documentation (especially the Windows consideration)
http://doc.bareos.org/master/html/bareos-manual-main-reference.html#directiveDirJobRun%20Script
And by experience the nitpicking thing to correctly escaping and sending
command line what happen if you wrap this in a simple bat.
Command = "c:/testme.bat"
is it working ?
Il 17/07/2017 18:18, Bruno Friedmann ha scritto:
it seems you ask windows to delete the running vss state. l don't know if
this can work ?>
On July 17, 2017 9:50:02 AM GMT+02:00, Cristian Mammoli
wrote:
05-Jul 21:48 srvbkp-dir JobId 54311: Fatal error: Network error with
FD during Backup: ERR=Connection reset by peer
05-Jul 21:48 srvbkp-dir JobId 54311: Error: Bareos srvbkp-dir 16.2.4
(01Jul16):
I can confirm that the issue is with Client Run After Job such as:
Run Script {
Command = "wbadmin delete systemstatebackup -keepversions:0 -quiet"
Runs When = before
Fail Job On Error = No
}
I commented out all the script like this and had no issues so far.
Obviously this is not a solution...
I'm pretty sure this has nothing to do with routers since I noticed it
happens even in the same network.
So to recap these are the conditions:
It doesn't happen with Linux clients but only Windows (2008R2 to 2012R2
tested)
Windows firewall on/off doesn't matter
Heartbeat interval does not help
It happens with "normal" mode, passive clients, and client initiated
connections
It happens even if server and client are in the same network
It only happens if there is a "Client Run After Job" script
I tried updating vmware tools and nic drivers
--
You received this message because you are subscribed to the Google Groups
"bareos-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to bareos-users+unsubscr...@googlegroups.com.
To post to this group, send email to bareos-users@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Re: [bareos-users] Re: Backup of clients in different network with long run before scripts terminate with connection reset
On mardi, 18 juillet 2017 09.18:28 h CEST Cristian Mammoli wrote:
> Tha was just an example script, it does work for the record ( i create a
> systemstate backup Before and dump it after backup).
>
> Anyway I get connection reset by peer even with a simle script such as:
>
>Run Script {
> Command = "del /Q \"C:\\Program Files\\MySQL\\MySQL Server
> 5.7\\Backup\\MySQL.bak\""
> Runs When = after
> Fail Job On Error = No
>}
>
Considering the documentation (especially the Windows consideration)
http://doc.bareos.org/master/html/bareos-manual-main-reference.html#directiveDirJobRun%20Script
And by experience the nitpicking thing to correctly escaping and sending
command line what happen if you wrap this in a simple bat.
Command = "c:/testme.bat"
is it working ?
> Il 17/07/2017 18:18, Bruno Friedmann ha scritto:
> > it seems you ask windows to delete the running vss state. l don't know if
> > this can work ?>
> > On July 17, 2017 9:50:02 AM GMT+02:00, Cristian Mammoli
wrote:
> >>> 05-Jul 21:48 srvbkp-dir JobId 54311: Fatal error: Network error with
> >>
> >> FD during Backup: ERR=Connection reset by peer
> >>
> >>> 05-Jul 21:48 srvbkp-dir JobId 54311: Error: Bareos srvbkp-dir 16.2.4
> >>
> >> (01Jul16):
> >>
> >> I can confirm that the issue is with Client Run After Job such as:
> >> Run Script {
> >>
> >> Command = "wbadmin delete systemstatebackup -keepversions:0 -quiet"
> >> Runs When = before
> >> Fail Job On Error = No
> >>
> >> }
> >>
> >> I commented out all the script like this and had no issues so far.
> >> Obviously this is not a solution...
> >>
> >> I'm pretty sure this has nothing to do with routers since I noticed it
> >> happens even in the same network.
> >>
> >> So to recap these are the conditions:
> >> It doesn't happen with Linux clients but only Windows (2008R2 to 2012R2
> >> tested)
> >> Windows firewall on/off doesn't matter
> >> Heartbeat interval does not help
> >> It happens with "normal" mode, passive clients, and client initiated
> >> connections
> >> It happens even if server and client are in the same network
> >> It only happens if there is a "Client Run After Job" script
> >> I tried updating vmware tools and nic drivers
--
Bruno Friedmann
Ioda-Net Sàrl www.ioda-net.ch
Bareos Partner, openSUSE Member, fsfe fellowship
GPG KEY : D5C9B751C4653227
irc: tigerfoot
openSUSE Tumbleweed
Linux 4.11.8-1-default x86_64 GNU/Linux, nvidia: 375.66
Qt: 5.9.1, KDE Frameworks: 5.35.0, Plasma: 5.10.3, kmail2 5.5.2
--
You received this message because you are subscribed to the Google Groups
"bareos-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to bareos-users+unsubscr...@googlegroups.com.
To post to this group, send email to bareos-users@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
[bareos-users] Corrupt Backup after upgrading client side to debian9
Hi there,
I have a nice working bareos setup with bareos 15.2.2 on the backup
server side (debian 8 based). 20 filedaemons as clients (debian 7 / 8 /
windows 2008) all working fine for months.
A couple of weeks ago I upgraded a fileserver to debian 9 with the
included filedaemon 16.2.4-3.
All appeared to be working fine without changes in the config needed.
Today I had to figure that after a restore of the debian 9 (bareos
16.2.4 filedaemon) client all restored files are corrupt!
This seems to happen during backup, since restores to a 15.2.2
filedaemon gives me the same broken files (verified by checksum).
The filesize is the same as the orignial.
# ls -la /etc/mime.types /var/tmp/bareos-restores/etc/mime.types
-rw-r--r-- 1 root root 24301 Mai 1 2016 /etc/mime.types
-rw-r--r-- 1 root root 24301 Mai 1 2016
/var/tmp/bareos-restores/etc/mime.types
# md5sum /etc/mime.types /var/tmp/bareos-restores/etc/mime.types
4561fade4c4fc48e526e72871c470eec /etc/mime.types
c42310a18b08a91f41590c157f6caa3c /var/tmp/bareos-restores/etc/mime.types
# head /etc/mime.types | hd
23 23 23 23 23 23 23 23 23 23 23 23 23 23 23 23 ||
*
0040 23 23 23 23 23 23 23 23 23 23 23 23 23 23 23 0a |###.|
0050 23 0a 23 20 20 4d 49 4d 45 20 6d 65 64 69 61 20 |#.# MIME media |
0060 74 79 70 65 73 20 61 6e 64 20 74 68 65 20 65 78 |types and the ex|
0070 74 65 6e 73 69 6f 6e 73 20 74 68 61 74 20 72 65 |tensions that re|
0080 70 72 65 73 65 6e 74 20 74 68 65 6d 2e 0a 23 0a |present them..#.|
# head /var/tmp/bareos-restores/etc/mime.types | hd
23 23 23 23 23 23 23 23 23 23 23 23 23 23 23 23 ||
*
0040 47 4a 3e aa d7 0d b3 09 df 22 40 10 39 1e 28 7b |GJ>.."@.9.({|
0050 dc 25 f3 31 ea d7 04 f2 cb 43 46 f0 be f2 ad 1d |.%.1.CF.|
0060 54 ad 85 41 1d 93 cb 96 23 72 eb 3f 9a 55 ae f1 |T..A#r.?.U..|
0070 05 da 93 71 f1 97 ad 87 06 88 a6 78 a6 2f 41 a9 |...q...x./A.|
0080 b2 7d be a1 2d 4e 8e 1d 66 0a 41 ed 90 3d 37 dc |.}..-N..f.A..=7.|
I've got TLS enabled on all communication.
Is this a known problem?
Let me know if I can provide more info.
Regards,
Tom
--
You received this message because you are subscribed to the Google Groups
"bareos-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to bareos-users+unsubscr...@googlegroups.com.
To post to this group, send email to bareos-users@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Re: [bareos-users] Re: Backup of clients in different network with long run before scripts terminate with connection reset
Tha was just an example script, it does work for the record ( i create a
systemstate backup Before and dump it after backup).
Anyway I get connection reset by peer even with a simle script such as:
Run Script {
Command = "del /Q \"C:\\Program Files\\MySQL\\MySQL Server
5.7\\Backup\\MySQL.bak\""
Runs When = after
Fail Job On Error = No
}
Il 17/07/2017 18:18, Bruno Friedmann ha scritto:
it seems you ask windows to delete the running vss state. l don't know if this
can work ?
On July 17, 2017 9:50:02 AM GMT+02:00, Cristian Mammoli
wrote:
05-Jul 21:48 srvbkp-dir JobId 54311: Fatal error: Network error with
FD during Backup: ERR=Connection reset by peer
05-Jul 21:48 srvbkp-dir JobId 54311: Error: Bareos srvbkp-dir 16.2.4
(01Jul16):
I can confirm that the issue is with Client Run After Job such as:
Run Script {
Command = "wbadmin delete systemstatebackup -keepversions:0 -quiet"
Runs When = before
Fail Job On Error = No
}
I commented out all the script like this and had no issues so far.
Obviously this is not a solution...
I'm pretty sure this has nothing to do with routers since I noticed it
happens even in the same network.
So to recap these are the conditions:
It doesn't happen with Linux clients but only Windows (2008R2 to 2012R2
tested)
Windows firewall on/off doesn't matter
Heartbeat interval does not help
It happens with "normal" mode, passive clients, and client initiated
connections
It happens even if server and client are in the same network
It only happens if there is a "Client Run After Job" script
I tried updating vmware tools and nic drivers
--
You received this message because you are subscribed to the Google Groups
"bareos-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to bareos-users+unsubscr...@googlegroups.com.
To post to this group, send email to bareos-users@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
