Re: [Bacula-users] backup-sd JobId 36: Error: dev.c:130 Unable to stat device /mnt/s3/consi-it-backup/: ERR=Permission denied"

[parthi]

This is now fixed after addding allow_other in the fstab



--
View this message in context: 
http://bacula.10910.n7.nabble.com/backup-sd-JobId-36-Error-dev-c-130-Unable-to-stat-device-mnt-s3-consi-it-backup-ERR-Permission-denie-tp85594p85626.html
Sent from the Bacula - Users mailing list archive at Nabble.com.

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Restores very slow while selecting files

[Martin Simmons]

> On Wed, 12 Apr 2017 08:03:32 +0100 (BST), Tom Yates said:
> 
> I've got a fairly big filesystem (3TB, 15M files) of which I want to 
> (test) restore a part.  I know that if the backend DB is slow the 
> "Building file list" stage can take some time, but I have it striped over 
> a 5-SAS-disc RAID-0, and this step takes only about eight minutes.
> 
> The problems start once I navigate to the directory I want restored 
> (which admittedly contains the bulk of the files and about half the total 
> space), and do an "add home".
> 
> The current job has been stuck on this step for over 15 hours, now.  When 
> I strace bacula-dir I see a lot of:
> 
> [pid 26711] write(6, "P\0\0\0\3SELECT FilenameId FROM File"..., 84) = 84
> [pid 26711] read(6, "\1\0\0\1\1@\0\0\2\3def\6bacula\10Filename\10Fi"..., 
> 16384) = 102
> [pid 26711] poll([{fd=6, events=POLLIN|POLLPRI}], 1, 0) = 0 (Timeout)
> [pid 26711] write(6, "m\0\0\0\3SELECT FileId, LStat, MD5 F"..., 113) = 113
> [pid 26711] read(6, "\1\0\0\1\0030\0\0\2\3def\6bacula\4File\4File\6F"..., 
> 16384) = 249
> [pid 26711] poll([{fd=6, events=POLLIN|POLLPRI}], 1, 0) = 0 (Timeout)
> [pid 26711] write(6, "P\0\0\0\3SELECT FilenameId FROM File"..., 84) = 84
> [pid 26711] read(6, "\1\0\0\1\1@\0\0\2\3def\6bacula\10Filename\10Fi"..., 
> 16384) = 102
> [pid 26711] poll([{fd=6, events=POLLIN|POLLPRI}], 1, 0) = 0 (Timeout)
> [pid 26711] write(6, "m\0\0\0\3SELECT FileId, LStat, MD5 F"..., 113) = 113
> [pid 26711] read(6, "\1\0\0\1\0030\0\0\2\3def\6bacula\4File\4File\6F"..., 
> 16384) = 250
> [pid 26711] poll([{fd=6, events=POLLIN|POLLPRI}], 1, 0) = 0 (Timeout)
> 
> So I presume it's stepping through the built directory tree querying the 
> database about each of these files.  Problem is that any restore that 
> takes ~24 hours just to kick off is not making my clients happy.

Does that file tree have a lot of hard links (I think the add command only
makes those queries for hard links)?  If so, then using Bacula 7 might help
(see "restore optimizespeed" in
http://www.bacula.org/downloads/Bacula-7.4.0/ReleaseNotes).

__Martin

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Fatal error sql_create.c

[Petar Kozić]

Yes, I have.

I was upload on pasterbin:
http://pastebin.ca/3794414

Log is contionous with same error.


*—*

*Petar Kozić*
System Administrator


On April 12, 2017 at 11:03:51 AM, Josip Deanovic (djosip+n...@linuxpages.net)
wrote:

On Wednesday 2017-04-12 01:07:41 Petar Kozić wrote:
> @Josip Deanovic
> Are you using spooling?
> If yes, is your spool directory on the same file system as your database
> data?
>
> No, I don’t spooling Data, only Attributes
>
> My config:
> Spool Data = no
> Spool Attributes = yes
>
>
> I was increase innodb_timewait_lockout = 150 but error appears again.
>
> Some ideas ?

Do you have anything useful in your mysql logs?

-- 
Josip Deanovic

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Restores very slow while selecting files

[Tom Yates]

On Wed, 12 Apr 2017, Francisco Javier Funes Nieto wrote:


The missing question, which Database Catalog are you using ? 


The catalogue database is on MySQL, again using the version that comes 
with CentOS 6 (5.1.73).



--

  Tom Yates  -  http://www.teaparty.net--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Fatal error sql_create.c

[Josip Deanovic]

On Wednesday 2017-04-12 01:07:41 Petar Kozić wrote:
> @Josip Deanovic
> Are you using spooling?
> If yes, is your spool directory on the same file system as your database
> data?
> 
> No, I don’t spooling Data, only Attributes
> 
> My config:
> Spool Data = no
> Spool Attributes = yes
> 
> 
> I was increase innodb_timewait_lockout = 150 but error appears again.
> 
> Some ideas ?

Do you have anything useful in your mysql logs?

-- 
Josip Deanovic

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Fatal error sql_create.c

[Petar Kozić]

@Josip Deanovic
Are you using spooling?
If yes, is your spool directory on the same file system as your database
data?

No, I don’t spooling Data, only Attributes

My config:
Spool Data = no
Spool Attributes = yes


I was increase innodb_timewait_lockout = 150 but error appears again.

Some ideas ?



*—*

*Petar Kozić*
System Administrator


On April 10, 2017 at 9:06:36 AM, Petar Kozić (petar.ko...@mint.rs) wrote:

Are you using spooling?
If yes, is your spool directory on the same file system as your database
data?
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Restores very slow while selecting files

[Francisco Javier Funes Nieto]

The missing question, which Database Catalog are you using ?

El 12 abr. 2017 9:26 a. m., "Tom Yates"  escribió:

> I've got a fairly big filesystem (3TB, 15M files) of which I want to
> (test) restore a part.  I know that if the backend DB is slow the
> "Building file list" stage can take some time, but I have it striped over
> a 5-SAS-disc RAID-0, and this step takes only about eight minutes.
>
> The problems start once I navigate to the directory I want restored
> (which admittedly contains the bulk of the files and about half the total
> space), and do an "add home".
>
> The current job has been stuck on this step for over 15 hours, now.  When
> I strace bacula-dir I see a lot of:
>
> [pid 26711] write(6, "P\0\0\0\3SELECT FilenameId FROM File"..., 84) = 84
> [pid 26711] read(6, "\1\0\0\1\1@\0\0\2\3def\6bacula\10Filename\10Fi"...,
> 16384) = 102
> [pid 26711] poll([{fd=6, events=POLLIN|POLLPRI}], 1, 0) = 0 (Timeout)
> [pid 26711] write(6, "m\0\0\0\3SELECT FileId, LStat, MD5 F"..., 113) = 113
> [pid 26711] read(6, "\1\0\0\1\0030\0\0\2\3def\6bacula\4File\4File\6F"...,
> 16384) = 249
> [pid 26711] poll([{fd=6, events=POLLIN|POLLPRI}], 1, 0) = 0 (Timeout)
> [pid 26711] write(6, "P\0\0\0\3SELECT FilenameId FROM File"..., 84) = 84
> [pid 26711] read(6, "\1\0\0\1\1@\0\0\2\3def\6bacula\10Filename\10Fi"...,
> 16384) = 102
> [pid 26711] poll([{fd=6, events=POLLIN|POLLPRI}], 1, 0) = 0 (Timeout)
> [pid 26711] write(6, "m\0\0\0\3SELECT FileId, LStat, MD5 F"..., 113) = 113
> [pid 26711] read(6, "\1\0\0\1\0030\0\0\2\3def\6bacula\4File\4File\6F"...,
> 16384) = 250
> [pid 26711] poll([{fd=6, events=POLLIN|POLLPRI}], 1, 0) = 0 (Timeout)
>
> So I presume it's stepping through the built directory tree querying the
> database about each of these files.  Problem is that any restore that
> takes ~24 hours just to kick off is not making my clients happy.
>
> The CentOS 6 server has 16GB of memory and does not seem short of it
> (negligible swap usage).  We're currently using the CentOS 6 bacula
> packages, which are v5.0.0.  I tried building 5.2.13 from source,
> upgrading, and running that, but it wasn't noticeably better, so I
> downgraded again.  I'm happy to go to a still-later version if there is
> reason to think that this step is better optimised in that version.  If
> building custom indexes would help, I'm open to that, too.  If I'm doing
> something fundamentally stupid, it would be really useful to know!
>
> Apart from "don't restore your home area", does anyone have any advice?
> Thanks.
>
>
> --
>
> Tom Yates - Teaparty Network Central - +44/0 1223 704038
>
>
> 
> --
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Restores very slow while selecting files

[Tom Yates]

I've got a fairly big filesystem (3TB, 15M files) of which I want to 
(test) restore a part.  I know that if the backend DB is slow the 
"Building file list" stage can take some time, but I have it striped over 
a 5-SAS-disc RAID-0, and this step takes only about eight minutes.

The problems start once I navigate to the directory I want restored 
(which admittedly contains the bulk of the files and about half the total 
space), and do an "add home".

The current job has been stuck on this step for over 15 hours, now.  When 
I strace bacula-dir I see a lot of:

[pid 26711] write(6, "P\0\0\0\3SELECT FilenameId FROM File"..., 84) = 84
[pid 26711] read(6, "\1\0\0\1\1@\0\0\2\3def\6bacula\10Filename\10Fi"..., 16384) 
= 102
[pid 26711] poll([{fd=6, events=POLLIN|POLLPRI}], 1, 0) = 0 (Timeout)
[pid 26711] write(6, "m\0\0\0\3SELECT FileId, LStat, MD5 F"..., 113) = 113
[pid 26711] read(6, "\1\0\0\1\0030\0\0\2\3def\6bacula\4File\4File\6F"..., 
16384) = 249
[pid 26711] poll([{fd=6, events=POLLIN|POLLPRI}], 1, 0) = 0 (Timeout)
[pid 26711] write(6, "P\0\0\0\3SELECT FilenameId FROM File"..., 84) = 84
[pid 26711] read(6, "\1\0\0\1\1@\0\0\2\3def\6bacula\10Filename\10Fi"..., 16384) 
= 102
[pid 26711] poll([{fd=6, events=POLLIN|POLLPRI}], 1, 0) = 0 (Timeout)
[pid 26711] write(6, "m\0\0\0\3SELECT FileId, LStat, MD5 F"..., 113) = 113
[pid 26711] read(6, "\1\0\0\1\0030\0\0\2\3def\6bacula\4File\4File\6F"..., 
16384) = 250
[pid 26711] poll([{fd=6, events=POLLIN|POLLPRI}], 1, 0) = 0 (Timeout)

So I presume it's stepping through the built directory tree querying the 
database about each of these files.  Problem is that any restore that 
takes ~24 hours just to kick off is not making my clients happy.

The CentOS 6 server has 16GB of memory and does not seem short of it 
(negligible swap usage).  We're currently using the CentOS 6 bacula 
packages, which are v5.0.0.  I tried building 5.2.13 from source, 
upgrading, and running that, but it wasn't noticeably better, so I 
downgraded again.  I'm happy to go to a still-later version if there is 
reason to think that this step is better optimised in that version.  If 
building custom indexes would help, I'm open to that, too.  If I'm doing 
something fundamentally stupid, it would be really useful to know!

Apart from "don't restore your home area", does anyone have any advice? 
Thanks.


-- 

Tom Yates - Teaparty Network Central - +44/0 1223 704038


--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users