Hello Ana
But this is a bug or not?
Atenciosamente
*Wanderlei Hüttel*
http://www.huttel.com.br
2016-03-30 0:26 GMT-03:00 Ana Emília M. Arruda <emiliaarr...@gmail.com>:
> Hello Ankush,
>
> There is a good explanation about the Options resource of FileSets in
> http://www.bacula.org/7.4.x-manuals/en/main/main.pdf on page 166. After
> reading it carefully I could understand why compression was not working for
> you (specifically, the FileSet you posted). I recommend you have a look at
> it :).
>
> Best regards,
> Ana
>
>
> On Wed, Mar 30, 2016 at 12:06 AM, Ana Emília M. Arruda <
> emiliaarr...@gmail.com> wrote:
>
>> Hello Ankush,
>>
>> You're welcome.
>>
>> compression = GZIP should work for Windows.
>>
>> Best regards,
>> Ana
>>
>> On Mon, Mar 28, 2016 at 7:06 AM, More, Ankush <ankush.m...@capgemini.com>
>> wrote:
>>
>>> Hello Ana,
>>>
>>>
>>>
>>> Thanks for your effort to resolve issue.
>>>
>>> FileSet which you have send work fine for software compress.
>>>
>>>
>>>
>>> What compression command (GZIP,LZO etc) use for windows client?
>>>
>>>
>>>
>>> compression = GZIP ( what for windows client)
>>>
>>>
>>>
>>>
>>>
>>> Thank you,
>>>
>>> Ankush More
>>>
>>>
>>>
>>> *From:* Ana Emília M. Arruda [mailto:emiliaarr...@gmail.com]
>>> *Sent:* Saturday, March 26, 2016 6:47 AM
>>> *To:* Randy Katz
>>> *Cc:* Bacula-users@lists.sourceforge.net
>>>
>>> *Subject:* Re: [Bacula-users] Client backup with compress
>>>
>>>
>>>
>>> Hello,
>>>
>>> I'm sorry, please disregard my last post (the two filesets are
>>> identical). Following is a more detailed test (and this is not a cosmetic
>>> error of the backup log):
>>>
>>> 1) compression works.
>>>
>>> FileSet {
>>> Name = "Full Set"
>>> Include {
>>> Options {
>>> exclude = yes
>>> wildfile = "*.data*"
>>> }
>>> Options {
>>> signature = MD5
>>> compression = GZIP
>>> }
>>> File = /opt/bacula/bin
>>> }
>>>
>>> Build OS: x86_64-unknown-linux-gnu ubuntu 14.04
>>> JobId: 62
>>> Job: BackupClient1.2016-03-26_01.37.17_04
>>> Backup Level: Full
>>> Client: "bacula-server-fd" 7.4.0 (16Jan16)
>>> x86_64-unknown-linux-gnu,ubuntu,14.04
>>> FileSet: "Full Set" 2016-02-19 23:35:17
>>> ...
>>> FD Files Written: 17
>>> SD Files Written: 17
>>> FD Bytes Written: 7,015,847 (7.015 MB)
>>> SD Bytes Written: 7,017,616 (7.017 MB)
>>> Rate: 3507.9 KB/s
>>> Software Compression: 58.0% 2.4:1
>>> ...
>>> Volume name(s): Vol-0001
>>> Volume Session Id: 1
>>> Volume Session Time: 1458952340
>>> Last Volume Bytes: 7,025,678 (7.025 MB)
>>> ...
>>> Termination: Backup OK
>>>
>>> -rw-r----- 1 root root 7025678 mar 26 01:37 Vol-0001
>>>
>>> 2) compression do not work:
>>>
>>> FileSet {
>>> Name = "Full Set"
>>> Include {
>>> Options {
>>> signature = MD5
>>> compression = GZIP
>>> }
>>> Options {
>>> exclude = yes
>>> wildfile = "*.data*"
>>> }
>>> File = /opt/bacula/bin
>>> }
>>>
>>> Build OS: x86_64-unknown-linux-gnu ubuntu 14.04
>>> JobId: 63
>>> Job: BackupClient1.2016-03-26_01.41.46_03
>>> Backup Level: Full
>>> Client: "bacula-server-fd" 7.4.0 (16Jan16)
>>> x86_64-unknown-linux-gnu,ubuntu,14.04
>>> FileSet: "Full Set" 2016-02-19 23:35:17
>>> ...
>>> FD Files Written: 17
>>> SD Files Written: 17
>>> FD Bytes Written: 16,691,953 (16.69 MB)
>>> SD Bytes Written: 16,693,466 (16.69 MB)
>>> Rate: 16692.0 KB/s
>>> Software Compression: None
>>> ...
>>> Volume name(s): Vol-0001
>>> Volume Session Id: 1
>>> Volume Session Time: 1458952842
>>> Last Volume Bytes: 16,706,736 (16.70 MB)
>>> ...
>>> Termination: Backup OK
>>>
>>> -rw-r----- 1 root root 16706736 mar 26 01:41 Vol-0001
>>>
>>> 3) compression works:
>>> FileSet {
>>> Name = "Full Set"
>>> Include {
>>> Options {
>>> signature = MD5
>>> compression = GZIP
>>> }
>>> Options {
>>> exclude = yes
>>> compression = GZIP
>>> wildfile = "*.data*"
>>> }
>>> File = /opt/bacula/bin
>>> }
>>>
>>> Build OS: x86_64-unknown-linux-gnu ubuntu 14.04
>>> JobId: 65
>>> Job: BackupClient1.2016-03-26_01.50.53_03
>>> Backup Level: Full
>>> Client: "bacula-server-fd" 7.4.0 (16Jan16)
>>> x86_64-unknown-linux-gnu,ubuntu,14.04
>>> FileSet: "Full Set" 2016-02-19 23:35:17
>>> ...
>>> FD Files Written: 17
>>> SD Files Written: 17
>>> FD Bytes Written: 7,015,847 (7.015 MB)
>>> SD Bytes Written: 7,017,360 (7.017 MB)
>>> Rate: 3507.9 KB/s
>>> Software Compression: 58.0% 2.4:1
>>> ...
>>> Volume name(s): Vol-0001
>>> Volume Session Id: 1
>>> Volume Session Time: 1458953395
>>> Last Volume Bytes: 7,025,230 (7.025 MB)
>>> ...
>>> Termination: Backup OK
>>>
>>> -rw-r----- 1 root root 7025230 mar 26 01:50 Vol-0001
>>>
>>> Notes:
>>>
>>> - I created some *.data* files in /opt/bacula/bin for testing purposes
>>>
>>> - all three Filesets correctly exclude the *.data* files
>>>
>>> - I cannot see the need of a compressed clause in the options with the
>>> exclude option set to yes. But as Heitor suggested, it works.
>>>
>>> Randy, I have not run tests with your Fileset configuration. We should
>>> have a close look in bacula client version, linux version, zlib devel
>>> version, maybe verify carefully if there is really no difference in Fileset
>>> configurations, check if without the exclude clause compression works and
>>> finally check if the selected files for this "compression not working
>>> client" can be compressed.
>>>
>>>
>>>
>>> Best regards,
>>>
>>> Ana
>>>
>>>
>>>
>>> On Sat, Mar 26, 2016 at 12:44 AM, Randy Katz <
>>> rk...@simplicityhosting.com> wrote:
>>>
>>> My expressions are default, here is mine:
>>>
>>> FileSet {
>>> Name = "client-28-filesetdefinition"
>>> Include {
>>> Options {
>>> signature = MD5
>>> compression = GZIP
>>> }
>>> File = /
>>> }
>>> Exclude {
>>> File = /tmp
>>> File = /proc
>>> File = /.journal
>>> File = /.fsck
>>> File = /home/virtfs
>>>
>>>
>>> }
>>> }
>>>
>>> On 3/25/2016 3:38 PM, Ana Emília M. Arruda wrote:
>>>
>>> Hello Ankush,
>>>
>>> The expression works correctly but for some reason, the following occurs:
>>>
>>> 1) Software compression none, FD and SD bytes written shows correct
>>> values with the bellow configuration:
>>>
>>> FileSet {
>>> Name = "chrome02 Set"
>>> Include {
>>> Options {
>>> exclude = yes
>>> wildfile = "*.data*"
>>> }
>>> Options {
>>> signature = MD5
>>> compression = GZIP
>>> }
>>> File = /rman
>>> }
>>>
>>>
>>> 2) Software compression shows correct value for compression, FD and SD
>>> bytes written shows incorrect values with the bellow configuration:
>>>
>>> FileSet {
>>> Name = "chrome02 Set"
>>> Include {
>>> Options {
>>> exclude = yes
>>> wildfile = "*.data*"
>>> }
>>> Options {
>>> signature = MD5
>>> compression = GZIP
>>> }
>>> File = /rman
>>> }
>>>
>>>
>>>
>>> The estimate listing command shows that both configurations
>>> work correctly. Maybe this is a cosmetic error.
>>>
>>>
>>>
>>> Best regards,
>>>
>>> Ana
>>>
>>>
>>>
>>>
>>>
>>> On Fri, Mar 25, 2016 at 6:21 PM, Ana Emília M. Arruda <
>>> emiliaarr...@gmail.com> wrote:
>>>
>>> Hello Ankush and Randy,
>>>
>>>
>>>
>>> It seems that there is a problem with the use of the wildfile
>>> expression. Regardless the "*.data*" is correct (tested with
>>> bwild utility), it seems that when this expression is used, the backup do
>>> not work correctly and the result shows a "none" software compression.
>>>
>>>
>>>
>>> bacula-fd: job.c:1646-0 Fileset: WF *.data*
>>>
>>> bacula-fd: job.c:1252-0 WF *.data*
>>>
>>> bacula-fd: job.c:1280-0 Set state=error or double code.
>>>
>>>
>>>
>>> Could you please try this filset without the exclude option that
>>> excludes "*.data*" (the same for Randy, I don't know if your client problem
>>> uses a fileset like this one).
>>>
>>>
>>>
>>> Best regards,
>>>
>>> Ana
>>>
>>>
>>>
>>> On Thu, Mar 24, 2016 at 9:18 PM, Randy Katz <rk...@simplicityhosting.com>
>>> wrote:
>>>
>>> Yes, her client compilation confirmed compression for gzip and lzo...so
>>> now I would think there is an issue here. I also have one client out of
>>> around 40 that is not compressing. Dir and fd compiled from source version
>>> 7.4.0.
>>>
>>> On March 25, 2016 5:29:20 AM GMT+07:00, "Ana Emília M. Arruda" <
>>> emiliaarr...@gmail.com> wrote:
>>>
>>> Hello Ankush,
>>>
>>>
>>>
>>> As Heitor said in a previous post, zlib development libraries must also
>>> be installed on clients. Have you checked this? Compression is working on
>>> your bacula server (and client) for your catalog backup because the zlib
>>> development libraries are installed on the bacula director host. Sorry if
>>> you have already answered this, but I did not found in previous posts.
>>>
>>>
>>>
>>> Best regards,
>>>
>>> Ana
>>>
>>>
>>>
>>> On Thu, Mar 24, 2016 at 5:45 PM, More, Ankush <ankush.m...@capgemini.com>
>>> wrote:
>>>
>>> Hello Randy,
>>>
>>> Bacula server(7.x) is installed with Linux RPM package.
>>>
>>> Catalog backup on bacula server work with compression = GZIP option.
>>>
>>> Job log:
>>>
>>> Software Compression: 84.9% 6.6:1
>>>
>>> But clients does not work
>>>
>>> Job log:
>>>
>>> Software Compression: None
>>>
>>>
>>>
>>>
>>>
>>> Thank you,
>>>
>>> Ankush More
>>>
>>>
>>>
>>> *From:* Randy Katz [mailto:rk...@simplicityhosting.com]
>>> *Sent:* Thursday, March 24, 2016 8:10 PM
>>> *To:* More, Ankush
>>> *Subject:* Re: [Bacula-users] Client backup with compress
>>>
>>>
>>>
>>> Then the only other thing I could think of is if the director is
>>> compiled with
>>> the gzip/lzo libraries, have you recompiled that? Should not be too
>>> hard, you don't
>>> need that long configure line, if using mysql all you need is:
>>>
>>> ./configure --with-mysql
>>>
>>> On 3/24/2016 6:54 AM, More, Ankush wrote:
>>>
>>> Hi Randy,
>>>
>>>
>>>
>>> Backing up are Database files which has very high compression ratio.
>>>
>>> I have check same files with linux command ‘gzip’ on client working
>>> fine with good compression ratio.
>>>
>>> But Bacula does not work.
>>>
>>>
>>>
>>> Thank you,
>>>
>>> Ankush More
>>>
>>>
>>>
>>> *From:* Randy Katz [mailto:rk...@simplicityhosting.com
>>> <rk...@simplicityhosting.com>]
>>> *Sent:* Thursday, March 24, 2016 1:18 PM
>>> *To:* bacula-users@lists.sourceforge.net
>>> *Subject:* Re: [Bacula-users] Client backup with compress
>>>
>>>
>>>
>>> Hi Ankush, are you sure the files you are backing up can be compressed?
>>> You might
>>> want to try a separate backup on the same client of something like
>>> /usr/local /etc
>>> just to test, these should definitely compress. Sometimes video, audio
>>> and other dense
>>> files do not compress.
>>>
>>> On 3/23/2016 11:44 AM, More, Ankush wrote:
>>>
>>> Hello,
>>>
>>>
>>>
>>> I re-compile client with LZO package.
>>>
>>> Compression does not work both GZIP or LZO.
>>>
>>>
>>>
>>> Large file support: yes
>>>
>>> Bacula conio support: yes -lncurses
>>>
>>> readline support: no
>>>
>>> TCP Wrappers support: no
>>>
>>> TLS support: yes
>>>
>>> Encryption support: yes
>>>
>>> ZLIB support: yes
>>>
>>> LZO support: yes
>>>
>>> enable-smartalloc: yes
>>>
>>> enable-lockmgr: no
>>>
>>> bat support: no
>>>
>>> client-only: yes
>>>
>>> build-dird: no
>>>
>>> build-stored: no
>>>
>>> Plugin support: yes
>>>
>>> AFS support: no
>>>
>>> ACL support: yes
>>>
>>> XATTR support: yes
>>>
>>> systemd support: no
>>>
>>> Batch insert enabled: None
>>>
>>>
>>>
>>> Thank you,
>>>
>>> Ankush More
>>>
>>>
>>>
>>> *From:* More, Ankush
>>> *Sent:* Wednesday, March 23, 2016 8:46 PM
>>> *To:* 'Heitor Faria'
>>> *Cc:* comp...@hotrodpc.com; bacula-users@lists.sourceforge.net
>>> *Subject:* RE: [Bacula-users] Client backup with compress
>>>
>>>
>>>
>>> Hello Faria,
>>>
>>>
>>>
>>> Sorry for confusion , please ignore previous mail. I have re-compile the
>>> client with source which version 7.x on Linux.
>>>
>>> Resending debug –d500 output for same.
>>>
>>>
>>>
>>> Which support ZLIB, but still compression is not working.
>>>
>>>
>>>
>>> ZLIB support: yes
>>>
>>>
>>>
>>>
>>>
>>> Thank you,
>>>
>>> Ankush More
>>>
>>>
>>>
>>> *From:* Heitor Faria [mailto:hei...@bacula.com.br <hei...@bacula.com.br>]
>>>
>>> *Sent:* Wednesday, March 23, 2016 8:31 PM
>>> *To:* More, Ankush
>>> *Cc:* comp...@hotrodpc.com; bacula-users@lists.sourceforge.net
>>> *Subject:* Re: [Bacula-users] Client backup with compress
>>>
>>>
>>>
>>> Hello, Akush: according to the debug you sent me this is the FileSet you
>>> are using for this job:
>>>
>>>
>>>
>>> bacula-fd: job.c:273-415 Executing fileset command.
>>> bacula-fd: job.c:753-415 I
>>> bacula-fd: job.c:753-415 O MZ6
>>> bacula-fd: job.c:753-415 N
>>> bacula-fd: job.c:753-415 O e
>>> bacula-fd: job.c:753-415 WF *.apm
>>> bacula-fd: job.c:781-415 Set state=error or double code.
>>> bacula-fd: job.c:753-415 N
>>> bacula-fd: job.c:753-415 F /oracle
>>> bacula-fd: job.c:753-415 N
>>> bacula-fd: job.c:753-415 N
>>> bacula-fd: job.c:753-415 E
>>> bacula-fd: job.c:753-415 F /var/spool/bacula
>>> bacula-fd: job.c:753-415 F /tmp
>>> bacula-fd: job.c:753-415 F /proc
>>> bacula-fd: job.c:753-415 F /tmp
>>> bacula-fd: job.c:753-415 F /sys
>>> bacula-fd: job.c:753-415 F /.journal
>>> bacula-fd: job.c:753-415 F /.fsck
>>> bacula-fd: job.c:753-415 N
>>>
>>>
>>> ------------------------------
>>>
>>> *From: *"More, Ankush" <ankush.m...@capgemini.com>
>>> *To: *"Heitor Faria" <hei...@bacula.com.br>
>>> *Cc: *comp...@hotrodpc.com, bacula-users@lists.sourceforge.net
>>> *Sent: *Wednesday, March 23, 2016 11:57:12 AM
>>> *Subject: *RE: [Bacula-users] Client backup with compress
>>>
>>> Hello Faria,
>>>
>>>
>>>
>>> Below is DIR config file.
>>>
>>>
>>>
>>> FileSet {
>>>
>>> Name = "chrome02 Set"
>>>
>>> Include {
>>>
>>> Options {
>>>
>>> signature = MD5
>>>
>>> compression = GZIP
>>>
>>> }
>>>
>>>
>>>
>>> Not sure what you mean Compression=gzip in all of them.
>>>
>>>
>>>
>>> Thank you,
>>>
>>> Ankush More
>>>
>>>
>>>
>>> *From:* Heitor Faria [mailto:hei...@bacula.com.br <hei...@bacula.com.br>]
>>>
>>> *Sent:* Wednesday, March 23, 2016 8:14 PM
>>> *To:* More, Ankush
>>> *Cc:* comp...@hotrodpc.com; bacula-users@lists.sourceforge.net
>>> *Subject:* Re: [Bacula-users] Client backup with compress
>>>
>>>
>>>
>>> Hello, Ankush: ZLIB support: yes
>>>
>>> Your client is fine. It must be a FileSet configuration thing, since you
>>> seems to have multiple Options sub-resources. Just put Compression=gzip in
>>> all of them.
>>>
>>>
>>>
>>> Regards,
>>> ------------------------------
>>>
>>> *From: *"More, Ankush" <ankush.m...@capgemini.com>
>>> *To: *comp...@hotrodpc.com, bacula-users@lists.sourceforge.net
>>> *Sent: *Wednesday, March 23, 2016 11:32:34 AM
>>> *Subject: *Re: [Bacula-users] Client backup with compress
>>>
>>> Hello,
>>>
>>>
>>>
>>> Please see below, this is build for bacula client.
>>>
>>>
>>>
>>> Configuration on Wed Mar 23 04:37:28 EDT 2016:
>>>
>>>
>>>
>>> Host: x86_64-unknown-linux-gnu -- redhat
>>> Enterprise release
>>>
>>> Bacula version: Bacula 7.0.4 (04 June 2014)
>>>
>>> Source code location: .
>>>
>>> Install binaries: /usr/sbin
>>>
>>> Install libraries: /usr/lib64
>>>
>>> Install config files: /etc/bacula
>>>
>>> Scripts directory: /usr/libexec/bacula/
>>>
>>> Archive directory: /tmp
>>>
>>> Working directory: /var/spool/bacula/
>>>
>>> PID directory: /var/run
>>>
>>> Subsys directory: /var/lock/subsys
>>>
>>> Man directory: ${datarootdir}/man
>>>
>>> Data directory: /usr/share
>>>
>>> Plugin directory: /usr/lib64
>>>
>>> C Compiler: gcc 4.1.2
>>>
>>> C++ Compiler: /usr/bin/g++ 4.1.2
>>>
>>> Compiler flags: -g -O2 -Wall -fno-strict-aliasing
>>> -fno-exceptions -fno-rtti
>>>
>>> Linker flags:
>>>
>>> Libraries: -lpthread -ldl -ldl
>>>
>>> Statically Linked Tools: no
>>>
>>> Statically Linked FD: no
>>>
>>> Statically Linked SD: no
>>>
>>> Statically Linked DIR: no
>>>
>>> Statically Linked CONS: no
>>>
>>> Database backends: None
>>>
>>> Database port:
>>>
>>> Database name: bacula
>>>
>>> Database user: bacula
>>>
>>>
>>>
>>> Job Output Email: root@localhost
>>>
>>> Traceback Email: root@localhost
>>>
>>> SMTP Host Address: localhost
>>>
>>>
>>>
>>> Director Port: 9101
>>>
>>> File daemon Port: 9102
>>>
>>> Storage daemon Port: 9103
>>>
>>>
>>>
>>> Director User:
>>>
>>> Director Group:
>>>
>>> Storage Daemon User:
>>>
>>> Storage DaemonGroup:
>>>
>>> File Daemon User:
>>>
>>> File Daemon Group:
>>>
>>>
>>>
>>> Large file support: yes
>>>
>>> Bacula conio support: yes -lncurses
>>>
>>> readline support: no
>>>
>>> TCP Wrappers support: no
>>>
>>> TLS support: yes
>>>
>>> Encryption support: yes
>>>
>>> ZLIB support: yes
>>>
>>> LZO support: no
>>>
>>> enable-smartalloc: yes
>>>
>>> enable-lockmgr: no
>>>
>>> bat support: no
>>>
>>> client-only: yes
>>>
>>> build-dird: no
>>>
>>> build-stored: no
>>>
>>> Plugin support: yes
>>>
>>> AFS support: no
>>>
>>> ACL support: yes
>>>
>>> XATTR support: yes
>>>
>>> systemd support: no
>>>
>>> Batch insert enabled: None
>>>
>>>
>>>
>>> Thank you,
>>>
>>> Ankush More
>>>
>>>
>>>
>>> *From:* compdoc [mailto:comp...@hotrodpc.com <comp...@hotrodpc.com>]
>>> *Sent:* Wednesday, March 23, 2016 7:48 PM
>>> *To:* bacula-users@lists.sourceforge.net
>>> *Subject:* Re: [Bacula-users] Client backup with compress
>>>
>>>
>>>
>>> >#./configure --enable-client-only --enable-build-dird=no
>>> --enable-build-stored=no --bindir=/usr/bin --sbindir=/usr/sbin
>>> --with-scriptdir=/usr/libexec/bacula/ --with-working-dir=/var/spool/bacula/
>>> --with-logdir=/var/log --enable-smartalloc
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> ...
>>>
>>> [Message clipped]
>>>
>>> ------------------------------------------------------------------------------
>>> Transform Data into Opportunity.
>>> Accelerate data analysis in your applications with
>>> Intel Data Analytics Acceleration Library.
>>> Click to learn more.
>>> http://pubads.g.doubleclick.net/gampad/clk?id=278785351&iu=/4140
>>> _______________________________________________
>>> Bacula-users mailing list
>>> Bacula-users@lists.sourceforge.net
>>> https://lists.sourceforge.net/lists/listinfo/bacula-users
>>>
>>>
>>> This message contains information that may be privileged or confidential
>>> and is the property of the Capgemini Group. It is intended only for the
>>> person to whom it is addressed. If you are not the intended recipient, you
>>> are not authorized to read, print, retain, copy, disseminate, distribute,
>>> or use this message or any part thereof. If you receive this message in
>>> error, please notify the sender immediately and delete all copies of this
>>> message.
>>>
>>
>>
>
>
> ------------------------------------------------------------------------------
> Transform Data into Opportunity.
> Accelerate data analysis in your applications with
> Intel Data Analytics Acceleration Library.
> Click to learn more.
> http://pubads.g.doubleclick.net/gampad/clk?id=278785471&iu=/4140
> _______________________________________________
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
>
------------------------------------------------------------------------------
Transform Data into Opportunity.
Accelerate data analysis in your applications with
Intel Data Analytics Acceleration Library.
Click to learn more.
http://pubads.g.doubleclick.net/gampad/clk?id=278785471&iu=/4140
_______________________________________________
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
