Re: [bareos-users] bareos and xtrabackup

[Praveen Varshney]

Hello Dan,

I am trying to do full and incremental backup using percona plugin but i am 
not sure about the process what are the plugins python file to be stored 
under /usr/lib64/bareos/plugins and what is the updated material on those 
files?

On Monday, 28 November 2016 at 22:50:54 UTC+5:30 Dan wrote:

> Denis -I'm able to backup successfully, both full and incremental. I am 
> also getting the "Error: No lsn information found in restore object for 
> file /tmp/bareos-restores/..." error on restore. I can actually restore 
> successfully if I individually retire the full and each incremental and 
> then follow the prepare procedure in xtrabackup. Can you post your .my.cnf 
> file (obviously with the password hidden)? I don't know what you meant by 
> "in .my.cnf i wass missing the part regarding mysql command".
>
> Thanks,
>

-- 
You received this message because you are subscribed to the Google Groups 
"bareos-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to bareos-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/bareos-users/92fe64dd-989f-4d80-9719-fb61f051a4aen%40googlegroups.com.

Re: [bareos-users] bareos and xtrabackup

[Dan Cushing]

Leon -

I did not resolve this problem.  I honestly decided not to spend any more time 
on it.  As I noted in my post, the workaround is to restore each of the backups 
(full and eat incremental since full) individually.  The Persona process 
doesn’t change, so the only added effort is in doing multiple retires from 
console of the UI.  I don’t expect to have to restore very often and I do a 
full backup weekly.  So worst case for me in the event of a system failure is 
to run 7 restore commands from Bareos.  A bit of a pain, but the critical part 
is that it works.

Dan

-- 
You received this message because you are subscribed to the Google Groups 
"bareos-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to bareos-users+unsubscr...@googlegroups.com.
To post to this group, send email to bareos-users@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [bareos-users] bareos and xtrabackup

[upandsafe]

On Monday, November 28, 2016 at 7:20:54 PM UTC+2, Dan wrote:
> Denis -I'm able to backup successfully, both full and incremental.  I am also 
> getting the "Error: No lsn information found in restore object for file 
> /tmp/bareos-restores/..." error on restore.  I can actually restore 
> successfully if I individually retire the full and each incremental and then 
> follow the prepare procedure in xtrabackup.  Can you post your .my.cnf file 
> (obviously with the password hidden)?  I don't know what you meant by "in 
> .my.cnf i wass missing the part regarding mysql command".
> 
> Thanks,

Hi Dan,

I seem to have run into the same problem as you.
Did you solve the problem eventually?
What was it?

Thanks,
Leon

-- 
You received this message because you are subscribed to the Google Groups 
"bareos-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to bareos-users+unsubscr...@googlegroups.com.
To post to this group, send email to bareos-users@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [bareos-users] bareos and xtrabackup

[Maik Aussendorf]

Hi Denis,

thanks for clarification!

You are right: the plugin needs better error-handling and
error-messages. I will keep this in mind for the next release.

Regards

Maik


Am 14.11.2016 um 11:01 schrieb Denis Barbazza:
> ok :( I found it, my mistake.
> in .my.cnf i wass missing the part regarding mysql command.
> Maybe you can add a test in BareosFDPercon to check if mysql command
> can login correctly without error.
>
> Hope that this thread can be useful for someone else in the future ;-)
>
> On Mon, Nov 14, 2016 at 10:50 AM, Denis Barbazza
> > wrote:
>
> Hello Maik,
> another update. I've tried the same setup in debian jessie with
> percona-xtrabackup-22 and it works.
> both incremental and full backup.
> I've tried also restore and it restores all the files.
> So now it seems an incompatibility of python or mysql version, in
> my setup i've this:
> jessie:
> mysqld  Ver 5.6.34-log
> Python 2.7.9
> stretch:
> mysqld  Ver 5.6.30-1-log
> Python 2.7.12+
>
> This is the error when i run incremental backup on stretch:
> 08-Nov 10:50 dragon-fd JobId 50: Fatal error: python-fd: Traceback
> (most recent call last):
>   File "/usr/lib/bareos/plugins/BareosFdWrapper.py", line 38, in
> handle_plugin_event
> return bareos_fd_plugin_object.handle_plugin_event(context, event)
>   File "/usr/lib/bareos/plugins/BareosFdPluginBaseclass.py", line
> 223, in handle_plugin_event
> return self.start_backup_job(context)
>   File "/usr/lib/bareos/plugins/BareosFdPercona.py", line 166, in
> start_backup_job
> last_lsn = int(os.popen(get_lsn_command).read())
> ValueError: invalid literal for int() with base 10: ''
>
>
> If there is any kind of tests that i can do let me know.
>
> thank you for your work
>
>
> On Thu, Nov 10, 2016 at 8:42 AM, Maik Aussendorf
> >
> wrote:
>
> Hi,
>
> both problem reports here refer to Debian / Ubuntu, while the
> development and (customer) production environment was
> RedHat/Centos (7).
> So I have to reproduce the behavior in a Debian / Ubuntu
> environment;
> which will take some time.
>
>
> > Hi all
> > I have same trouble, can't restore full backup.
> > "Error: No lsn information found in restore object for file
> /tmp/bareos-restores//_percona/xbstream.001874 from job 1874 "
> > my bareos version 15.2.2, xtrabackup 2.4.4, launched in
> Ubuntu 14.04. How I can troubleshooting this problem and
> resolve it? Pls help me. Thanks
> >
>
> --
> With kind regards // Mit freundlichen Grüßen
> --
>  Maik Außendorf   
>  maik.aussend...@bareos.com 
>  Bareos GmbH & Co. KG   Phone:
> +49221630693-93 
>  http://www.bareos.com  Fax:
> +49221630693-10 
> ** Visit us at Paris Open Source Summit 2016
> http://opensourcesummit.paris **
>
>  Sitz der Gesellschaft: Köln | Amtsgericht Köln: HRA 29646
>  Komplementär: Bareos Verwaltungs-GmbH
>  Geschäftsführer: Stephan Dühr, M. Außendorf,
>  J. Steffens, P. Storz
>
> --
> You received this message because you are subscribed to the
> Google Groups "bareos-users" group.
> To unsubscribe from this group and stop receiving emails from
> it, send an email to bareos-users+unsubscr...@googlegroups.com
> .
> To post to this group, send email to
> bareos-users@googlegroups.com
> .
> For more options, visit https://groups.google.com/d/optout
> .
>
>
>
>
> -- 
> Denis
>
>
>
>
> -- 
> Denis

-- 
With kind regards // Mit freundlichen Grüßen
--
 Maik Außendorf maik.aussend...@bareos.com
 Bareos GmbH & Co. KG   Phone: +49221630693-93
 http://www.bareos.com  Fax: +49221630693-10
** Visit us at Paris Open Source Summit 2016 http://opensourcesummit.paris **

 Sitz der Gesellschaft: Köln | Amtsgericht Köln: HRA 29646
 Komplementär: Bareos Verwaltungs-GmbH
 Geschäftsführer: Stephan Dühr, M. Außendorf, 
 J. Steffens, P. Storz

-- 
You received this message because you are subscribed to the Google Groups 
"bareos-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to bareos-users+unsubscr...@googlegroups.com.
To post to this group, send email to bareos-users@googlegroups.com.
For more options, visit 

Re: [bareos-users] bareos and xtrabackup

[Denis Barbazza]

ok :( I found it, my mistake.
in .my.cnf i wass missing the part regarding mysql command.
Maybe you can add a test in BareosFDPercon to check if mysql command can
login correctly without error.

Hope that this thread can be useful for someone else in the future ;-)

On Mon, Nov 14, 2016 at 10:50 AM, Denis Barbazza 
wrote:

> Hello Maik,
> another update. I've tried the same setup in debian jessie with
> percona-xtrabackup-22 and it works.
> both incremental and full backup.
> I've tried also restore and it restores all the files.
> So now it seems an incompatibility of python or mysql version, in my setup
> i've this:
> jessie:
> mysqld  Ver 5.6.34-log
> Python 2.7.9
> stretch:
> mysqld  Ver 5.6.30-1-log
> Python 2.7.12+
>
> This is the error when i run incremental backup on stretch:
> 08-Nov 10:50 dragon-fd JobId 50: Fatal error: python-fd: Traceback (most
> recent call last):
>   File "/usr/lib/bareos/plugins/BareosFdWrapper.py", line 38, in
> handle_plugin_event
> return bareos_fd_plugin_object.handle_plugin_event(context, event)
>   File "/usr/lib/bareos/plugins/BareosFdPluginBaseclass.py", line 223, in
> handle_plugin_event
> return self.start_backup_job(context)
>   File "/usr/lib/bareos/plugins/BareosFdPercona.py", line 166, in
> start_backup_job
> last_lsn = int(os.popen(get_lsn_command).read())
> ValueError: invalid literal for int() with base 10: ''
>
>
> If there is any kind of tests that i can do let me know.
>
> thank you for your work
>
>
> On Thu, Nov 10, 2016 at 8:42 AM, Maik Aussendorf <
> maik.aussend...@bareos.com> wrote:
>
>> Hi,
>>
>> both problem reports here refer to Debian / Ubuntu, while the
>> development and (customer) production environment was RedHat/Centos (7).
>> So I have to reproduce the behavior in a Debian / Ubuntu environment;
>> which will take some time.
>>
>>
>> > Hi all
>> > I have same trouble, can't restore full backup.
>> > "Error: No lsn information found in restore object for file
>> /tmp/bareos-restores//_percona/xbstream.001874 from job 1874 "
>> > my bareos version 15.2.2, xtrabackup 2.4.4, launched in Ubuntu 14.04.
>> How I can troubleshooting this problem and resolve it? Pls help me. Thanks
>> >
>>
>> --
>> With kind regards // Mit freundlichen Grüßen
>> --
>>  Maik Außendorf maik.aussend...@bareos.com
>>  Bareos GmbH & Co. KG   Phone: +49221630693-93
>>  http://www.bareos.com  Fax: +49221630693-10
>> ** Visit us at Paris Open Source Summit 2016
>> http://opensourcesummit.paris **
>>
>>  Sitz der Gesellschaft: Köln | Amtsgericht Köln: HRA 29646
>>  Komplementär: Bareos Verwaltungs-GmbH
>>  Geschäftsführer: Stephan Dühr, M. Außendorf,
>>  J. Steffens, P. Storz
>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "bareos-users" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to bareos-users+unsubscr...@googlegroups.com.
>> To post to this group, send email to bareos-users@googlegroups.com.
>> For more options, visit https://groups.google.com/d/optout.
>>
>
>
>
> --
> Denis
>



-- 
Denis

-- 
You received this message because you are subscribed to the Google Groups 
"bareos-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to bareos-users+unsubscr...@googlegroups.com.
To post to this group, send email to bareos-users@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [bareos-users] bareos and xtrabackup

[Denis Barbazza]

Hello Maik,
another update. I've tried the same setup in debian jessie with
percona-xtrabackup-22 and it works.
both incremental and full backup.
I've tried also restore and it restores all the files.
So now it seems an incompatibility of python or mysql version, in my setup
i've this:
jessie:
mysqld  Ver 5.6.34-log
Python 2.7.9
stretch:
mysqld  Ver 5.6.30-1-log
Python 2.7.12+

This is the error when i run incremental backup on stretch:
08-Nov 10:50 dragon-fd JobId 50: Fatal error: python-fd: Traceback (most
recent call last):
  File "/usr/lib/bareos/plugins/BareosFdWrapper.py", line 38, in
handle_plugin_event
return bareos_fd_plugin_object.handle_plugin_event(context, event)
  File "/usr/lib/bareos/plugins/BareosFdPluginBaseclass.py", line 223, in
handle_plugin_event
return self.start_backup_job(context)
  File "/usr/lib/bareos/plugins/BareosFdPercona.py", line 166, in
start_backup_job
last_lsn = int(os.popen(get_lsn_command).read())
ValueError: invalid literal for int() with base 10: ''


If there is any kind of tests that i can do let me know.

thank you for your work


On Thu, Nov 10, 2016 at 8:42 AM, Maik Aussendorf  wrote:

> Hi,
>
> both problem reports here refer to Debian / Ubuntu, while the
> development and (customer) production environment was RedHat/Centos (7).
> So I have to reproduce the behavior in a Debian / Ubuntu environment;
> which will take some time.
>
>
> > Hi all
> > I have same trouble, can't restore full backup.
> > "Error: No lsn information found in restore object for file
> /tmp/bareos-restores//_percona/xbstream.001874 from job 1874 "
> > my bareos version 15.2.2, xtrabackup 2.4.4, launched in Ubuntu 14.04.
> How I can troubleshooting this problem and resolve it? Pls help me. Thanks
> >
>
> --
> With kind regards // Mit freundlichen Grüßen
> --
>  Maik Außendorf maik.aussend...@bareos.com
>  Bareos GmbH & Co. KG   Phone: +49221630693-93
>  http://www.bareos.com  Fax: +49221630693-10
> ** Visit us at Paris Open Source Summit 2016 http://opensourcesummit.paris
> **
>
>  Sitz der Gesellschaft: Köln | Amtsgericht Köln: HRA 29646
>  Komplementär: Bareos Verwaltungs-GmbH
>  Geschäftsführer: Stephan Dühr, M. Außendorf,
>  J. Steffens, P. Storz
>
> --
> You received this message because you are subscribed to the Google Groups
> "bareos-users" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to bareos-users+unsubscr...@googlegroups.com.
> To post to this group, send email to bareos-users@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
>



-- 
Denis

-- 
You received this message because you are subscribed to the Google Groups 
"bareos-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to bareos-users+unsubscr...@googlegroups.com.
To post to this group, send email to bareos-users@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [bareos-users] bareos and xtrabackup

[Denis Barbazza]

Hello Maik,
if you need some test or more detailed debug let me know.
I will be happy to help you.

thank you for your work

On Thu, Nov 10, 2016 at 8:42 AM, Maik Aussendorf  wrote:

> Hi,
>
> both problem reports here refer to Debian / Ubuntu, while the
> development and (customer) production environment was RedHat/Centos (7).
> So I have to reproduce the behavior in a Debian / Ubuntu environment;
> which will take some time.
>
>
> > Hi all
> > I have same trouble, can't restore full backup.
> > "Error: No lsn information found in restore object for file
> /tmp/bareos-restores//_percona/xbstream.001874 from job 1874 "
> > my bareos version 15.2.2, xtrabackup 2.4.4, launched in Ubuntu 14.04.
> How I can troubleshooting this problem and resolve it? Pls help me. Thanks
> >
>
> --
> With kind regards // Mit freundlichen Grüßen
> --
>  Maik Außendorf maik.aussend...@bareos.com
>  Bareos GmbH & Co. KG   Phone: +49221630693-93
>  http://www.bareos.com  Fax: +49221630693-10
> ** Visit us at Paris Open Source Summit 2016 http://opensourcesummit.paris
> **
>
>  Sitz der Gesellschaft: Köln | Amtsgericht Köln: HRA 29646
>  Komplementär: Bareos Verwaltungs-GmbH
>  Geschäftsführer: Stephan Dühr, M. Außendorf,
>  J. Steffens, P. Storz
>
> --
> You received this message because you are subscribed to the Google Groups
> "bareos-users" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to bareos-users+unsubscr...@googlegroups.com.
> To post to this group, send email to bareos-users@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
>



-- 
Denis

-- 
You received this message because you are subscribed to the Google Groups 
"bareos-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to bareos-users+unsubscr...@googlegroups.com.
To post to this group, send email to bareos-users@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [bareos-users] bareos and xtrabackup

[Maik Aussendorf]

Hi,

both problem reports here refer to Debian / Ubuntu, while the
development and (customer) production environment was RedHat/Centos (7).
So I have to reproduce the behavior in a Debian / Ubuntu environment;
which will take some time.


> Hi all
> I have same trouble, can't restore full backup.
> "Error: No lsn information found in restore object for file 
> /tmp/bareos-restores//_percona/xbstream.001874 from job 1874 "
> my bareos version 15.2.2, xtrabackup 2.4.4, launched in Ubuntu 14.04. How I 
> can troubleshooting this problem and resolve it? Pls help me. Thanks
>

-- 
With kind regards // Mit freundlichen Grüßen
--
 Maik Außendorf maik.aussend...@bareos.com
 Bareos GmbH & Co. KG   Phone: +49221630693-93
 http://www.bareos.com  Fax: +49221630693-10
** Visit us at Paris Open Source Summit 2016 http://opensourcesummit.paris **

 Sitz der Gesellschaft: Köln | Amtsgericht Köln: HRA 29646
 Komplementär: Bareos Verwaltungs-GmbH
 Geschäftsführer: Stephan Dühr, M. Außendorf, 
 J. Steffens, P. Storz

-- 
You received this message because you are subscribed to the Google Groups 
"bareos-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to bareos-users+unsubscr...@googlegroups.com.
To post to this group, send email to bareos-users@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [bareos-users] bareos and xtrabackup

[Denis Barbazza]

>
> it seems that it can't recognize last lsn.
>
> Yes, that seems to be the problem.
>
> echo 'SHOW ENGINE INNODB STATUS' | mysql -r
> It should contain a line like
> Log sequence number 14882332
>
> Can you post that line (or the whole result)?
>


 Here the whole result:

# echo 'SHOW ENGINE INNODB STATUS' | mysql -r -p
Enter password:
TypeNameStatus
InnoDB
=
2016-11-08 14:02:51 7fa095cef700 INNODB MONITOR OUTPUT
=
Per second averages calculated from the last 51 seconds
-
BACKGROUND THREAD
-
srv_master_thread loops: 127728 srv_active, 0 srv_shutdown, 60676 srv_idle
srv_master_thread log flush and writes: 188366
--
SEMAPHORES
--
OS WAIT ARRAY INFO: reservation count 150086
OS WAIT ARRAY INFO: signal count 812322
Mutex spin waits 1175854, rounds 3675604, OS waits 89595
RW-shared spins 255778, rounds 1749256, OS waits 44144
RW-excl spins 124857, rounds 1522886, OS waits 15597
Spin rounds per wait: 3.13 mutex, 6.84 RW-shared, 12.20 RW-excl

TRANSACTIONS

Trx id counter 4253963
Purge done for trx's n:o < 4253963 undo n:o < 0 state: running but idle
History list length 2712
LIST OF TRANSACTIONS FOR EACH SESSION:
---TRANSACTION 0, not started
MySQL thread id 209451, OS thread handle 0x7fa095cef700, query id 29836067
localhost root init
SHOW ENGINE INNODB STATUS
---TRANSACTION 4253584, not started
MySQL thread id 180416, OS thread handle 0x7fa095b69700, query id 29832117
localhost 127.0.0.1 vlogger_user cleaning up

FILE I/O

I/O thread 0 state: waiting for completed aio requests (insert buffer
thread)
I/O thread 1 state: waiting for completed aio requests (log thread)
I/O thread 2 state: waiting for completed aio requests (read thread)
I/O thread 3 state: waiting for completed aio requests (read thread)
I/O thread 4 state: waiting for completed aio requests (read thread)
I/O thread 5 state: waiting for completed aio requests (read thread)
I/O thread 6 state: waiting for completed aio requests (read thread)
I/O thread 7 state: waiting for completed aio requests (read thread)
I/O thread 8 state: waiting for completed aio requests (read thread)
I/O thread 9 state: waiting for completed aio requests (read thread)
I/O thread 10 state: waiting for completed aio requests (read thread)
I/O thread 11 state: waiting for completed aio requests (read thread)
I/O thread 12 state: waiting for completed aio requests (read thread)
I/O thread 13 state: waiting for completed aio requests (read thread)
I/O thread 14 state: waiting for completed aio requests (read thread)
I/O thread 15 state: waiting for completed aio requests (read thread)
I/O thread 16 state: waiting for completed aio requests (read thread)
I/O thread 17 state: waiting for completed aio requests (read thread)
I/O thread 18 state: waiting for completed aio requests (read thread)
I/O thread 19 state: waiting for completed aio requests (read thread)
I/O thread 20 state: waiting for completed aio requests (read thread)
I/O thread 21 state: waiting for completed aio requests (read thread)
I/O thread 22 state: waiting for completed aio requests (read thread)
I/O thread 23 state: waiting for completed aio requests (read thread)
I/O thread 24 state: waiting for completed aio requests (read thread)
I/O thread 25 state: waiting for completed aio requests (read thread)
I/O thread 26 state: waiting for completed aio requests (read thread)
I/O thread 27 state: waiting for completed aio requests (read thread)
I/O thread 28 state: waiting for completed aio requests (read thread)
I/O thread 29 state: waiting for completed aio requests (read thread)
I/O thread 30 state: waiting for completed aio requests (read thread)
I/O thread 31 state: waiting for completed aio requests (read thread)
I/O thread 32 state: waiting for completed aio requests (read thread)
I/O thread 33 state: waiting for completed aio requests (read thread)
I/O thread 34 state: waiting for completed aio requests (read thread)
I/O thread 35 state: waiting for completed aio requests (read thread)
I/O thread 36 state: waiting for completed aio requests (read thread)
I/O thread 37 state: waiting for completed aio requests (read thread)
I/O thread 38 state: waiting for completed aio requests (read thread)
I/O thread 39 state: waiting for completed aio requests (read thread)
I/O thread 40 state: waiting for completed aio requests (read thread)
I/O thread 41 state: waiting for completed aio requests (read thread)
I/O thread 42 state: waiting for completed aio requests (read thread)
I/O thread 43 state: waiting for completed aio requests (read thread)
I/O thread 44 state: waiting for completed aio requests (read thread)
I/O thread 45 state: waiting for completed aio requests (read thread)
I/O thread 46 state: waiting for completed aio requests (read thread)
I/O thread 47 state: waiting for completed aio requests (read thread)
I/O thread 48 state: 

Re: [bareos-users] bareos and xtrabackup

[Maik Aussendorf]

Hello Denis,


Am 08.11.2016 um 10:57 schrieb Denis Barbazza:
> Hello Maik, thank you for your reply.
>
> I found the problem, it was so simple, damn :-( 
> the client cannot reach the storage daemon, I discovered it because
> when I run a file backup it simply told me :(
Good.
>
> But
>
> Now I was able to make a full backup, size is approsimately 1GB (it
> could be real).
> The problem is that if I try to run an incremental backup I obtain
> this error.
>
>
>
> 08-Nov 10:50 bareos-dir JobId 50: Start Backup JobId 50,
> Job=dragon-mysql.2016-11-08_10.50.55_55
> 08-Nov 10:50 bareos-dir JobId 50: Using Device "FileStorage" to write.
> 08-Nov 10:50 dragon-fd JobId 50: python-fd: Got to_lsn 10998506785
> from restore object of job 49
> 08-Nov 10:50 bareos-sd JobId 50: Volume "Incremental-0100" previously
> written, moving to end of data.
> 08-Nov 10:50 bareos-sd JobId 50: Ready to append to end of Volume
> "Incremental-0100" size=496585614
> 08-Nov 10:50 dragon-fd JobId 50: Fatal error: python-fd: Traceback
> (most recent call last):
>   File "/usr/lib/bareos/plugins/BareosFdWrapper.py", line 38, in
> handle_plugin_event
> return bareos_fd_plugin_object.handle_plugin_event(context, event)
>   File "/usr/lib/bareos/plugins/BareosFdPluginBaseclass.py", line 223,
> in handle_plugin_event
> return self.start_backup_job(context)
>   File "/usr/lib/bareos/plugins/BareosFdPercona.py", line 166, in
> start_backup_job
> last_lsn = int(os.popen(get_lsn_command).read())
> ValueError: invalid literal for int() with base 10: ''
>
> 08-Nov 10:50 dragon-fd JobId 50: Fatal error: fd_plugins.c:654 Command
> plugin
> "python:module_path=/usr/lib/bareos/plugins:module_name=bareos-fd-percona"
> requested, but is not loaded.
> 08-Nov 10:50 bareos-sd JobId 50: Elapsed time=00:00:01, Transfer
> rate=0  Bytes/second
> 08-Nov 10:50 bareos-dir JobId 50: Error: Bareos bareos-dir 16.2.4
> (01Jul16):
>   Build OS:   x86_64-pc-linux-gnu debian Debian GNU/Linux
> 8.0 (jessie)
>   JobId:  50
>   Job:dragon-mysql.2016-11-08_10.50.55_55
>   Backup Level:   Incremental, since=2016-11-08 10:44:49
>   Client: "dragon-fd" 16.2.4 (01Jul16)
> x86_64-pc-linux-gnu,debian,Debian GNU/Linux 8.0 (jessie),Debian_8.0,x86_64
>   FileSet:"mysql" 2016-11-04 11:14:29
>   Pool:   "Incremental" (From command line)
>   Catalog:"MyCatalog" (From Client resource)
>   Storage:"File" (From Job resource)
>   Scheduled time: 08-Nov-2016 10:50:55
>   Start time: 08-Nov-2016 10:50:57
>   End time:   08-Nov-2016 10:50:58
>   Elapsed time:   1 sec
>   Priority:   10
>   FD Files Written:   0
>   SD Files Written:   0
>   FD Bytes Written:   0 (0 B)
>   SD Bytes Written:   0 (0 B)
>   Rate:   0.0 KB/s
>   Software Compression:   None
>   VSS:no
>   Encryption: no
>   Accurate:   no
>   Volume name(s):
>   Volume Session Id:  48
>   Volume Session Time:1478171275
>   Last Volume Bytes:  0 (0 B)
>   Non-fatal FD errors:1
>   SD Errors:  0
>   FD termination status:  Fatal Error
>   SD termination status:  Canceled
>   Termination:*** Backup Error ***
>
> it seems that it can't recognize last lsn.
Yes, that seems to be the problem.

echo 'SHOW ENGINE INNODB STATUS' | mysql -r
It should contain a line like
Log sequence number 14882332

Can you post that line (or the whole result)?

>
> another strange thing is that the full mysql backup has 2 files and
> 1GB, but if I click on "show files" I can see only
> _percona/xbstream.0XX
> is this normal? I should have also xtrabackup_checkpoints I think...
> or I'm wrong?
This is normal. The LSN is stored in a so called 'restore object', in a
kind of virtual file, that's why Bareos reports 2 files (1 'virtual' for
the restore object, 1 for the xbstream).

Regards
Maik

>
> thank you
>
> -- 
> Denis

-- 
With kind regards // Mit freundlichen Grüßen
--
 Maik Außendorf maik.aussend...@bareos.com
 Bareos GmbH & Co. KG   Phone: +49221630693-93
 http://www.bareos.com  Fax: +49221630693-10
** Visit us at Paris Open Source Summit 2016 http://opensourcesummit.paris **

 Sitz der Gesellschaft: Köln | Amtsgericht Köln: HRA 29646
 Komplementär: Bareos Verwaltungs-GmbH
 Geschäftsführer: Stephan Dühr, M. Außendorf, 
 J. Steffens, P. Storz

-- 
You received this message because you are subscribed to the Google Groups 
"bareos-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to bareos-users+unsubscr...@googlegroups.com.
To post to this group, send email to bareos-users@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [bareos-users] bareos and xtrabackup

[Denis Barbazza]

Hello Maik, thank you for your reply.

I found the problem, it was so simple, damn :-(
the client cannot reach the storage daemon, I discovered it because when I
run a file backup it simply told me :(

But

Now I was able to make a full backup, size is approsimately 1GB (it could
be real).
The problem is that if I try to run an incremental backup I obtain this
error.



08-Nov 10:50 bareos-dir JobId 50: Start Backup JobId 50,
Job=dragon-mysql.2016-11-08_10.50.55_55
08-Nov 10:50 bareos-dir JobId 50: Using Device "FileStorage" to write.
08-Nov 10:50 dragon-fd JobId 50: python-fd: Got to_lsn 10998506785 from
restore object of job 49
08-Nov 10:50 bareos-sd JobId 50: Volume "Incremental-0100" previously
written, moving to end of data.
08-Nov 10:50 bareos-sd JobId 50: Ready to append to end of Volume
"Incremental-0100" size=496585614
08-Nov 10:50 dragon-fd JobId 50: Fatal error: python-fd: Traceback (most
recent call last):
  File "/usr/lib/bareos/plugins/BareosFdWrapper.py", line 38, in
handle_plugin_event
return bareos_fd_plugin_object.handle_plugin_event(context, event)
  File "/usr/lib/bareos/plugins/BareosFdPluginBaseclass.py", line 223, in
handle_plugin_event
return self.start_backup_job(context)
  File "/usr/lib/bareos/plugins/BareosFdPercona.py", line 166, in
start_backup_job
last_lsn = int(os.popen(get_lsn_command).read())
ValueError: invalid literal for int() with base 10: ''

08-Nov 10:50 dragon-fd JobId 50: Fatal error: fd_plugins.c:654 Command
plugin
"python:module_path=/usr/lib/bareos/plugins:module_name=bareos-fd-percona"
requested, but is not loaded.
08-Nov 10:50 bareos-sd JobId 50: Elapsed time=00:00:01, Transfer rate=0
 Bytes/second
08-Nov 10:50 bareos-dir JobId 50: Error: Bareos bareos-dir 16.2.4 (01Jul16):
  Build OS:   x86_64-pc-linux-gnu debian Debian GNU/Linux 8.0
(jessie)
  JobId:  50
  Job:dragon-mysql.2016-11-08_10.50.55_55
  Backup Level:   Incremental, since=2016-11-08 10:44:49
  Client: "dragon-fd" 16.2.4 (01Jul16)
x86_64-pc-linux-gnu,debian,Debian GNU/Linux 8.0 (jessie),Debian_8.0,x86_64
  FileSet:"mysql" 2016-11-04 11:14:29
  Pool:   "Incremental" (From command line)
  Catalog:"MyCatalog" (From Client resource)
  Storage:"File" (From Job resource)
  Scheduled time: 08-Nov-2016 10:50:55
  Start time: 08-Nov-2016 10:50:57
  End time:   08-Nov-2016 10:50:58
  Elapsed time:   1 sec
  Priority:   10
  FD Files Written:   0
  SD Files Written:   0
  FD Bytes Written:   0 (0 B)
  SD Bytes Written:   0 (0 B)
  Rate:   0.0 KB/s
  Software Compression:   None
  VSS:no
  Encryption: no
  Accurate:   no
  Volume name(s):
  Volume Session Id:  48
  Volume Session Time:1478171275
  Last Volume Bytes:  0 (0 B)
  Non-fatal FD errors:1
  SD Errors:  0
  FD termination status:  Fatal Error
  SD termination status:  Canceled
  Termination:*** Backup Error ***

it seems that it can't recognize last lsn.

another strange thing is that the full mysql backup has 2 files and 1GB,
but if I click on "show files" I can see only _percona/xbstream.0XX
is this normal? I should have also xtrabackup_checkpoints I think... or I'm
wrong?

thank you

-- 
Denis

-- 
You received this message because you are subscribed to the Google Groups 
"bareos-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to bareos-users+unsubscr...@googlegroups.com.
To post to this group, send email to bareos-users@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [bareos-users] bareos and xtrabackup

[Maik Aussendorf]

Hello Denis,


Am 04.11.2016 um 11:43 schrieb Denis Barbazza:
> Hello,
> I'm trying to setup a new backup server with bareos 16.2.4 and a
> client with same version and percona-xtrabackup plugin, but I run into
> trouble :(
>
> I'm running Debian Stretch and I followed the guide here:
> https://github.com/bareos/bareos-contrib/tree/master/fd-plugins/bareos_percona
> My percona xtrabackup is version 2.3.5 (I tried also with 2.2 with
> same result, with 2.4 I received a 11 signal (and I read in a forum
> that they suggest to downgrade).
Version 2.3.5 runs on my development machine, should work, while earlier
versions likely do not work.

>
> The problem is that if i manually run the backup command everything
> works ok:
> 'xtrabackup  --backup --datadir=/var/lib/mysql/ --stream=xbstream
> --extra-lsndir=/tmp/tmpYmkHJn '
> It creates the file with dump.
>
> If i run the job through bareos-director it return ok, but it only
> backups a file called:
> _percona/xbstream.00XX (where XX is a number that increments each
> time).
That is correct, the xbrstream file contains the output of the
xtrabackup command as dump in xbstream-format.


>
> The file as NaN size, and if I try to restore it, the restore fails with:
> Error: python-fd: No lsn information found in restore object for file
> /tmp/bareos-restores//_percona/xbstream.20 from job 20

This is not good.

Please do the following:
- run the xtrabackup manually as above.
send the file xtrabackup_checkpoints from your temp-directory:
/tmp/tmpYmkHJn

Run FD in Debug mode and send the output after running a backup and a
restore job.

To activate debug on your client-fd, do something like
*setdebug client=centos-fd trace=on level=200
...
you should get output like:
--
Connecting to Client centos-fd at centos:9102
2000 OK setdebug=150 trace=0 hangup=0 timestamp=0
tracefile=/var/lib/bareos/centos-fd.trace

bconsolse tells you where to look for the tracefile=/...
Attach that tracefile (after having removed eventual sensible information).

Regards
Maik



>
> Please tell me what I can try, if you need more information simply ask
> me and I'll provide everything.
>
>
> thank you all
>
> -- 
> Denis
> -- 
> You received this message because you are subscribed to the Google
> Groups "bareos-users" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to bareos-users+unsubscr...@googlegroups.com
> .
> To post to this group, send email to bareos-users@googlegroups.com
> .
> For more options, visit https://groups.google.com/d/optout.

-- 
With kind regards // Mit freundlichen Grüßen
--
 Maik Außendorf maik.aussend...@bareos.com
 Bareos GmbH & Co. KG   Phone: +49221630693-93
 http://www.bareos.com  Fax: +49221630693-10
** Visit us at Paris Open Source Summit 2016 http://opensourcesummit.paris **

 Sitz der Gesellschaft: Köln | Amtsgericht Köln: HRA 29646
 Komplementär: Bareos Verwaltungs-GmbH
 Geschäftsführer: Stephan Dühr, M. Außendorf, 
 J. Steffens, P. Storz

-- 
You received this message because you are subscribed to the Google Groups 
"bareos-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to bareos-users+unsubscr...@googlegroups.com.
To post to this group, send email to bareos-users@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.