re: what works
I use the following, and it works well. I’m still on 3.3.9 and on RedHat
variants, fwiw.
define dumptype alphaTara {
dailyTarKRB5
include "./a*”
}
and IN my disk list, these variants
to use the above defined dumptype:
heimdall.fnal.gov homea /home {
alphaTara
estimate server
}
here’s one that is defined IN the disklist
mtamaster1.fnal.gov 17-Mod-rawTOP /data/mta/Run2017/ModularCavity/rawdata {
MTA-TarKRB5
exclude "./Agi80304B"
exclude append "./Lec625Zi"
exclude append "./Tek7104"
# still includes Agi7104A and Tek7254 # since it must have SOME
content
}
and one with RANGES, so it more close matches your case:
heimdall.fnal.gov homeOther /home {
dailyTarKRB5
exclude "./[a-pr-tv-z]*"
exclude append "./ROOT-5.34*"
estimate server
}
Just some examples of working set lists.
Deb Baddorf
Fermilab
> On Nov 8, 2018, at 12:24 PM, Chris Nighswonger <[email protected]>
> wrote:
>
> No question is stupid. I learned that beating my head against the wall for
> long hours. :-)
>
> /netdrives/CAMPUS/ is a path which contains users' network drives. The level
> below CAMPUS contains folders which follow the naming convention of the
> username of each account. ie. Chris Nighswonger would be cnighswonger and
> thus /netdrives/CAMPUS/cnighswonger/ would be my related network drive.
>
> There are somewhat less than 100 user directories. Prior to this I have been
> backing them all up with a DLE which looks like this:
>
> host "/netdrives/CAMPUS" {
> comp-tar
> estimate server
> }
>
> This works fine with the caveat that it results in a huge level 0 backup.
>
> In the supplied disklist file example in Amanda's documentation
> (/usr/share/doc/amanda-server/examples/disklist), I discovered the DLE form I
> am currently attempting. According to the example this should limit each DLE
> to backing up subdirectories of /netdrives/CAMPUS/ based on the regexp
> supplied in the "include" directive.
>
> It appears to me that something may have changed with the way Amanda handles
> this since that document was written.
>
> As Stefan points out, Amanda seems to thing that there is "nothing" to be
> backed up. Furthermore, it appears that the log excerpts I posted also show
> that the regexp is not being applied but that Amanda is actually looking for
> specific subdirectories like /netdrives/CAMPUS/af and the like.
>
> Maybe the DLE syntax is incorrect?
>
> On Thu, Nov 8, 2018 at 12:31 PM Cuttler, Brian R (HEALTH)
> <[email protected]> wrote:
>
>
>
>
> Stupid question, host fileserver, directories /netdrives/CAMPUS/s* to
> /netdrives/CAMPUS/z* exist and have some files in them?
>
>
>
> From: Chris Nighswonger <[email protected]>
> Sent: Thursday, November 8, 2018 12:11 PM
> To: Cuttler, Brian R (HEALTH) <[email protected]>
> Cc: [email protected]
> Subject: Re: Breaking DLEs up
>
>
>
> ATTENTION: This email came from an external source. Do not open attachments
> or click on links from unknown senders or unexpected emails.
>
> From the client:
>
>
>
> Thu Nov 8 05:27:11 2018: thd-0x1c8f200: sendbackup: pid 23692 ruid 10195
> euid 10195 version 3.3.1: start at Thu Nov 8 05:27:11 2018
> Thu Nov 8 05:27:11 2018: thd-0x1c8f200: sendbackup: Version 3.3.1
> Thu Nov 8 05:27:11 2018: thd-0x1c8f200: sendbackup: pid 23692 ruid 10195
> euid 10195 version 3.3.1: rename at Thu Nov 8 05:27:11 2018
> Thu Nov 8 05:27:11 2018: thd-0x1c8f200: sendbackup: Parsed request as:
> program `GNUTAR'
> Thu Nov 8 05:27:11 2018: thd-0x1c8f200: sendbackup:
> disk `/netdrives/CAMPUS/sz'
> Thu Nov 8 05:27:11 2018: thd-0x1c8f200: sendbackup:
> device `/netdrives/CAMPUS'
> Thu Nov 8 05:27:11 2018: thd-0x1c8f200: sendbackup:
> level 0
> Thu Nov 8 05:27:11 2018: thd-0x1c8f200: sendbackup:
> since NODATE
> Thu Nov 8 05:27:11 2018: thd-0x1c8f200: sendbackup:
> options `'
> Thu Nov 8 05:27:11 2018: thd-0x1c8f200: sendbackup:
> datapath `AMANDA'
> Thu Nov 8 05:27:11 2018: thd-0x1c8f200: sendbackup: start:
> host:/netdrives/CAMPUS/sz lev 0
> Thu Nov 8 05:27:11 2018: thd-0x1c8f200: sendbackup: Spawning "/bin/gzip
> /bin/gzip --fast" in pipeline
> Thu Nov 8 05:27:11 2018: thd-0x1c8f200: sendbackup: gnutar: pid 23694:
> /bin/gzipThu Nov 8 05:27:11 2018: thd-0x1c8f200: sendbackup: pid 23694:
> /bin/gzip --fast
> Thu Nov 8 05:27:11 2018: thd-0x1c8f200: sendbackup: doing level 0 dump as
> listed-incremental to
> '/var/lib/amanda/gnutar-lists/host_netdrives_CAMPUS_sz_0.new'
> Thu Nov 8 05:27:11 2018: thd-0x1c8f200: sendbackup: Nothing found to include
> for disk /netdrives/CAMPUS/sz
> Thu Nov 8 05:27:11 2018: thd-0x1c8f200: sendbackup: Spawning
> "/usr/libexec/amanda/runtar runtar campus /bin/tar --create --file -
> --directory /netdrives/CAMPUS --one-file-system --listed-incremental
> /var/lib/amanda/gnutar-lists/host_netdrives_CAMPUS_sz_0.new --sparse
> --ignore-failed-read --totals --files-from
> /tmp/amanda/sendbackup._netdrives_CAMPUS_sz.20181108052711.include" in
> pipeline
> Thu Nov 8 05:27:11 2018: thd-0x1c8f200: sendbackup: gnutar:
> /usr/libexec/amanda/runtar: pid 23696
> Thu Nov 8 05:27:11 2018: thd-0x1c8f200: sendbackup: Started backup
> Thu Nov 8 05:27:11 2018: thd-0x1c8f200: sendbackup: Started index creator:
> "/bin/tar -tf - 2>/dev/null | sed -e 's/^\.//'"
> Thu Nov 8 05:27:11 2018: thd-0x1c8f200: sendbackup: 46: size(|): Total
> bytes written: 10240 (10KiB, 78MiB/s)
> Thu Nov 8 05:27:11 2018: thd-0x1c8f200: sendbackup: Index created
> successfully
> Thu Nov 8 05:27:11 2018: thd-0x1c8f200: sendbackup: Parsed backup messages
> Thu Nov 8 05:27:11 2018: thd-0x1c8f200: sendbackup: pid 23692 finish time
> Thu Nov 8 05:27:11 2018
>
>
>
> From the server:
>
>
>
> /var/log/amanda/server/campus/dumper.20181108020002007.debug:165691:Thu Nov
> 8 05:27:11 2018: thd-0x5579048e2400: dumper: getcmd: PORT-DUMP 03-00023 50013
> 1 host ffffffff9efefbffffffffff1f /netdrives/CAMPUS/sz /netdrives/CAMPUS 0
> 1970:1:1:0:0:0 GNUTAR "" "" "" "" bsdtcp AMANDA 127.0.0.1:50014 20 |"
> <auth>bsdtcp</auth>\n <compress>FAST</compress>\n <record>YES</record>\n
> <index>YES</index>\n <datapath>AMANDA</datapath>\n <include>\n
> <file>./[s-z]*</file>\n </include>\n"
> /var/log/amanda/server/campus/dumper.20181108020002007.debug:165705:
> <disk>/netdrives/CAMPUS/sz</disk>
> /var/log/amanda/server/campus/dumper.20181108020002007.debug:165706:
> <diskdevice>/netdrives/CAMPUS</diskdevice>
> /var/log/amanda/server/campus/dumper.20181108020002007.debug:165740:
> <disk>/netdrives/CAMPUS/sz</disk>
> /var/log/amanda/server/campus/dumper.20181108020002007.debug:165741:
> <diskdevice>/netdrives/CAMPUS</diskdevice>
> /var/log/amanda/server/campus/dumper.20181108020002007.debug:165857:Thu Nov
> 8 05:27:11 2018: thd-0x5579048e2400: dumper: Building type FILE header of
> 32768-32768 bytes with name='host' disk='/netdrives/CAMPUS/sz' dumplevel=0
> and blocksize=32768
> /var/log/amanda/server/campus/dumper.20181108020002007.debug:165944:Thu Nov
> 8 05:27:11 2018: thd-0x5579048e2400: dumper: Building type FILE header of
> 32768-32768 bytes with name='host' disk='/netdrives/CAMPUS/sz' dumplevel=0
> and blocksize=32768
>
>
>
> On Thu, Nov 8, 2018 at 12:00 PM Cuttler, Brian R (HEALTH)
> <[email protected]> wrote:
>
> Client and server side?
>
> /var/log/amanda/ ?
>
>
>
>
>
> From: Chris Nighswonger <[email protected]>
> Sent: Thursday, November 8, 2018 11:43 AM
> To: Cuttler, Brian R (HEALTH) <[email protected]>
> Cc: [email protected]
> Subject: Re: Breaking DLEs up
>
>
>
> ATTENTION: This email came from an external source. Do not open attachments
> or click on links from unknown senders or unexpected emails.
>
> Oddly enough, /tmp/amanda is empty.
>
>
>
> On Thu, Nov 8, 2018 at 11:33 AM Cuttler, Brian R (HEALTH)
> <[email protected]> wrote:
>
> I have been using a very similar setup for years, though I did not have any
> quotes in the first line of each DLE. I do NOT believe the quotes are an
> issue.
>
>
>
> What do the /tmp/amanda files show for these attempted dumps?
>
>
>
> From: [email protected] <[email protected]> On Behalf
> Of Chris Nighswonger
> Sent: Thursday, November 8, 2018 11:12 AM
> To: [email protected]
> Subject: Breaking DLEs up
>
>
>
> ATTENTION: This email came from an external source. Do not open attachments
> or click on links from unknown senders or unexpected emails.
>
> I attempted this and it appears to not have worked. I'm not sure why.
>
>
>
> Here is the relevant portion of my DLEs:
>
>
>
> fileserver "/netdrives/CAMPUS/af" "/netdrives/CAMPUS" {
> comp-tar
> include "./[a-f]*"
> estimate server
> }
> fileserver "/netdrives/CAMPUS/gl" "/netdrives/CAMPUS" {
> comp-tar
> include "./[g-l]*"
> estimate server
> }
> fileserver "/netdrives/CAMPUS/mr" "/netdrives/CAMPUS" {
> comp-tar
> include "./[m-r]*"
> estimate server
> }
> fileserver "/netdrives/CAMPUS/sz" "/netdrives/CAMPUS" {
> comp-tar
> include "./[s-z]*"
> estimate server
> }
>
>
>
> Here are the corresponding lines from amreport for the last backup run:
>
>
>
> fileserver:/netdrives/CAMPUS/af
> 0 1k dump done (5:28:16), waiting for writing to tape
> fileserver:/netdrives/CAMPUS/gl
> 0 1k dump done (5:28:11), waiting for writing to tape
> fileserver:/netdrives/CAMPUS/mr
> 0 1k dump done (5:28:06), waiting for writing to tape
> fileserver:/netdrives/CAMPUS/sz
> 0 1k dump done (5:27:11), waiting for writing to tape
>
>
>
> Kind regards,
>
> Chris
>
