Re: [Veritas-bu] Backup Archive and Restore taking forever on DR server
Ed, Rusty, Have you noticed if the load on the DNS servers has gone down? I remember building an HPUX master server with thousands of clients. Our master server hammered the DNS server. We ended up configuring a DNS caching server on our own master. It didn't add a lot to the load on the master, and it severely reduced the network traffic to the DNS server and almost eliminated the load on the DNS server. I haven't run with 7.x yet and since we are in process of building out a 7.x Linux master server I was kind of curious to see if this was still an issue with 7. Thanks, Bryan Ed Wilts ewi...@ewilts.org Sent by: veritas-bu-boun...@mailman.eng.auburn.edu 02/09/2011 10:01 PM To rusty.ma...@sungard.com cc NetBackup Mailing List veritas-bu@mailman.eng.auburn.edu Subject Re: [Veritas-bu] Backup Archive and Restore taking forever on DR server On Wed, Feb 9, 2011 at 6:10 PM, rusty.ma...@sungard.com wrote: If this is version 7.0.1, there is a hostname caching 'feature' now in NetBackup (Which I do NOT like, Symantec!!!). It caches the IP for each host configured in NBU and sometimes this can result in the incorrect IP being tied to the hostname. The default TTL for this cached data is one hour, but you can refresh it by running the following command on the Master/Media server(s) and/or clients: bpclntcmd -clear_host_cache So, you could see that even though the name resolution may be fixed in DNS or hosts, NBU may still have it cached. I've heard there's a way to reduce the time this is refreshed, but I don't remember where it's at. The DNS caching behavior is controlled by the 2nd parameter of the master server's VNET_OPTIONS in bp.conf; units are in seconds. The default in 7.0.1 is 1 hour, but we've reduced this to 5 min in our environment without ill effect: VNET_OPTIONS = 120 300 200 40 3 1 30 5 1793 32 0 0 .../Ed ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu BR_ FONT size=2BR DTCC DISCLAIMER: This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error, please notify us immediately and delete the email and any attachments from your system. The recipient should check this email and any attachments for the presence of viruses. The company accepts no liability for any damage caused by any virus transmitted by this email./FONT___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Question about media server OS - Solaris on x86?
On an sidebar question, we are also planning on implementing Linux servers, but with VxVM and VxFS. Has anyone compared the relative performance of VxFS versus EXT3? Bryan SIBLEY, Ken R. - ACCOR-NA sibley_...@accor-na.com Sent by: veritas-bu-boun...@mailman.eng.auburn.edu 01/27/2011 10:28 AM To veritas-bu@mailman.eng.auburn.edu cc Subject Re: [Veritas-bu] Question about media server OS - Solaris on x86? We run a combination of Solaris x86, Sparc and Red Hat media servers. We use Sparc where our production servers are Sparc as it allows us to perform snapshots and mount them on the media servers for off-host backups. We use Solaris x86 on a Sun/Oracle X4500 server using ZFS (box has 48 SATA drives and 6 PCI buses); we tried RH on this box, but Solaris w/ ZFS is 3x faster – 220MB/sec+ sustained over trunked network ports. We then use RH where we either have less data or need less performance for backups as it helps keep costs down. Ken From: veritas-bu-boun...@mailman.eng.auburn.edu [mailto:veritas-bu-boun...@mailman.eng.auburn.edu] On Behalf Of William Brown Sent: Wednesday, January 26, 2011 9:49 PM To: veritas-bu@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Question about media server OS - Solaris on x86? We ‘engineered’ – as in wrote the required internal docs – for Solaris x86 a few years back. We found no internal users wanting it. If their s/w was ported to x86 it was to Windows or Linux, not Solaris. We dropped support. BUT I read on this group of people who converted their RHEL media servers to Solaris x86 just to use ZFS and got a big performance boost compared to staging to EXT3. So it does depend on what you need. What I would say since Ora¢le took over is to check carefully the ¢ost. It is emphatically not the same as Sun according to others on the Sun Managers group. Another aspect is your in-house knowledge; we have a number of staff with many years Solaris knowledge and a few staff with a few years RHEL knowledge; that delta has a cost. You have to weigh these up. I would also be interested to see what others on this forum who are Sun SPARC users think about the future. William D L Brown This e-mail was sent by GlaxoSmithKline Services Unlimited (registered in England and Wales No. 1047315), which is a member of the GlaxoSmithKline group of companies. The registered address of GlaxoSmithKline Services Unlimited is 980 Great West Road, Brentford, Middlesex TW8 9GS. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu BR_ FONT size=2BR DTCC DISCLAIMER: This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error, please notify us immediately and delete the email and any attachments from your system. The recipient should check this email and any attachments for the presence of viruses. The company accepts no liability for any damage caused by any virus transmitted by this email./FONT___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] expiring images
*** Body Not Included *** BR_ FONT size=2BR DTCC DISCLAIMER: This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error, please notify us immediately and delete the email and any attachments from your system. The recipient should check this email and any attachments for the presence of viruses. The company accepts no liability for any damage caused by any virus transmitted by this email./FONT ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] expiring images
I just checked my email logs from the media_deassign_notify script. (I need to label expired VTL tapes.) It appears they come out at random times at least once a day. The support site also states that nbpem will run the deassignempty every 24 hours -- it ain't on the dot. Or if nbpem finishes its cycle it will run deassignempty also. Bryan ps. Sorry, my earlier reply got stomped on by our email system... A Darren Dunham ddun...@taos.com Sent by: veritas-bu-boun...@mailman.eng.auburn.edu 11/10/2010 07:05 PM To Veritas-bu@mailman.eng.auburn.edu cc Subject Re: [Veritas-bu] expiring images On Wed, Nov 10, 2010 at 11:08:35PM +, judy_hinchcli...@administaff.com wrote: bpexpdate -deassignempty was the command I was looking for. Took care of all the tapes that needed to be expired (30 of them) will see if tomorrow I have the same issue. Yes, deassignempty doesn't appear to run with the cleanup. I've never found exactly when it runs, but it seems to happen asynchronously, at least once a day. -- Darren ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu BR_ FONT size=2BR DTCC DISCLAIMER: This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error, please notify us immediately and delete the email and any attachments from your system. The recipient should check this email and any attachments for the presence of viruses. The company accepts no liability for any damage caused by any virus transmitted by this email./FONT___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] None of the slected hosts could be contacted
Simon, One very handy tool Symantec has recently published is NetBackup Domain Network Analyzer (NB DNA.) Download is: http://www.symantec.com/business/support/index?page=contentid=TECH125454 It is delployed with 6.5.6, but can be used with 6.5.5. There is an additional patch you have to install with 6.5.5. I think the patch is a binary addition - you don't have to shutdown services to apply the patch. (I didn't anyway.) The tool will give you a very detailed list of any name resolution problems. It will also list any network problems it finds when trying to initiate client connections. I'll be using it at least once a week to figure out what my network and firewall teams are doing to the backups. Bryan WEAVER, Simon \(external\) simon.wea...@astrium.eads.net Sent by: veritas-bu-boun...@mailman.eng.auburn.edu 10/12/2010 12:49 AM To Lightner, Jeff jlight...@water.com, VERITAS-BU@mailman.eng.auburn.edu cc Subject Re: [Veritas-bu] None of the slected hosts could be contacted Kind of hoping the nbconsole log will show name resolution issues as well. Give us an update if you can. S. -Original Message- From: veritas-bu-boun...@mailman.eng.auburn.edu [mailto:veritas-bu-boun...@mailman.eng.auburn.edu] On Behalf Of Lightner, Jeff Sent: Monday, October 11, 2010 3:31 PM To: VERITAS-BU@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] None of the slected hosts could be contacted Try logging into the client host from the master then run who am i or who -r to see where it thinks you're coming from - sometimes it isn't what you expect. Also try the reverse. This will validate connections are being seen as the hostname you think they are. -Original Message- From: veritas-bu-boun...@mailman.eng.auburn.edu [mailto:veritas-bu-boun...@mailman.eng.auburn.edu] On Behalf Of fredsharky Sent: Monday, October 11, 2010 10:20 AM To: VERITAS-BU@MAILMAN.ENG.AUBURN.EDU Subject: [Veritas-bu] None of the slected hosts could be contacted @Len, we have checked everyplace we can think of for naming issues and all that we have seen so far are correct. @William, I am running both the jnbSA (from master) and the java windows gui from my pc and neither work - and yes when i highlight the master server it says connected - I can actually open up the master server under the media server and client properties, just not under the master server properties. @Simon, i can run the bpgetconfig just fine from the master. I have opened a case with Symantec since we upgraded to 6.5.5, so hopefully they can help.. Thanks for the suggestions.. +-- |This was sent by fwa...@acxiom.com via Backup Central. |Forward SPAM to ab...@backupcentral.com. +-- ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu Proud partner. Susan G. Komen for the Cure. Please consider our environment before printing this e-mail or attachments. -- CONFIDENTIALITY NOTICE: This e-mail may contain privileged or confidential information and is for the sole use of the intended recipient(s). If you are not the intended recipient, any disclosure, copying, distribution, or use of the contents of this information is prohibited and may be unlawful. If you have received this electronic transmission in error, please reply immediately to the sender that you have received the message in error, and delete it. Thank you. -- ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu This email (including any attachments) may contain confidential and/or privileged information or information otherwise protected from disclosure. If you are not the intended recipient, please notify the sender immediately, do not copy this message or any attachments and do not use it for any purpose or disclose its content to any person, but delete this message and any attachments from your system. Astrium disclaims any and all liability if this email transmission was virus corrupted, altered or falsified. -o- Astrium Limited, Registered in England and Wales No. 2449259 Registered Office: Gunnels Wood Road, Stevenage, Hertfordshire, SG1 2AS, England ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu BR_ FONT size=2BR DTCC DISCLAIMER: This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error, please notify us immediately and
Re: [Veritas-bu] NBU 6.5.6 client on FreeBSD 7.2 host
Nate, Any filesystem you have will start out quickly but then drop in speed as it starts drilling down into the directory structure. The more directory levels you have, the slower it is. Which makes sense, since you are sort of following a tree structure down to the lower directory levels. Every time you drop down in a tree structure, you are branching to how ever many directories you have in that particular branch... And when you finish one branch, you pop back up a level and branch down to the next one. So you are following index links to index links to until you hit the actual file being backed up. Simple testing showed me long ago that the fewer levels you have in the directory tree, the quicker the backups. And depending on the filesystem, it can be orders of magnitude difference in speed. Bryan Nate Sanders sande...@dmotorworks.com Sent by: veritas-bu-boun...@mailman.eng.auburn.edu 09/10/2010 02:02 PM To cc veritas-bu@mailman.eng.auburn.edu veritas-bu@mailman.eng.auburn.edu Subject Re: [Veritas-bu] NBU 6.5.6 client on FreeBSD 7.2 host Okay so that multiplex test was user error. Didn't have max streams per drive setup right. At 4 streams we saw 40MB/s, at 8 streams we see 50MB/s. But... we have a new problem. Within 1-2 minutes the I/O starts dropping. At 3:00 minutes into an 8 stream job, we're down to 38MB/s. Earlier when testing at 4 streams, we were 10 minutes in and I/O had slowly dropped from 40MB/s down to 12MB/s. What in the world is going on? On 09/10/2010 01:41 PM, Nate Sanders wrote: Yes we are well aware of the limitations of NDMP and small files, thus the reason we're looking at trying NFS w/ snapshots. Our NetApp 6040 is peaking around 40-50MB/s but what the issue is right now is that we're getting such low performance from this FBSD box via NFS. I turned on multiplexing to 4, and we're still seeing only 3-4MB/s. On 09/10/2010 01:03 PM, Martin, Jonathan wrote: I've tested NDMP on 6 differetnt arrays and it has never moved millions of small files well. We maxed out backup performance on our NetApp FAS 2xxx with 2 streams at approx 20MB/sec total. We're hoping to test SMTape, which purportedly does a bit level dump of the entire array. I haven't had a chance to test this yet, but according to NetApp it will get us our weekly full and drive LTO3. We'll then need to put some sort of forever incremental or snapshot backup in-between the SMTape dumps. -Jonathan -Original Message- From: veritas-bu-boun...@mailman.eng.auburn.edu [mailto:veritas-bu-boun...@mailman.eng.auburn.edu] On Behalf Of Nate Sanders Sent: Friday, September 10, 2010 12:22 PM To: veritas-bu@mailman.eng.auburn.edu Subject: [Veritas-bu] NBU 6.5.6 client on FreeBSD 7.2 host Now that we made it to 6.5.6 we're able to start testing NFS performance from our NetApp VS NDMP. For the longest time we've done the backup of some 1 billion small image files off the NetApp via NDMP. This job usually took 1-3 weeks to complete a full sweep via NDMP. Since we have support for FBSD we thought we would try doing NFS via that client as Linux NFS is not as powerful as the BSD/Solaris variety. Well on our initial test of a small volume from the NetApp, we're seeing 2-4MB/s performance. Confirmed via bptm log. This is going straight to LTO4 tape, which usually backs up around 150MB/s. Logs show that the previous NDMP jobs from the NetApp we're doing around 40MB/s direct to two dedicated NDMP LTO4 drives. Supposedly multiplexing for NDMP will come to NBU 7.x shortly and we will test again with that in the future. Right now I am not multiplexing this NFS job but while looking in bptm I don't see the usual waited for buffer errors that would tell me that I _should_ increase it. Is it still likely multiplexing would increase the overall performance here? Is this a known issue with FBSD clients? Is there something else I should be looking at? -- Nate SandersDigital Motorworks System Administrator (512) 692 - 1038 This message and any attachments are intended only for the use of the addressee and may contain information that is privileged and confidential. If the reader of the message is not the intended recipient or an authorized representative of the intended recipient, you are hereby notified that any dissemination of this communication is strictly prohibited. If you have received this communication in error, please notify us immediately by e-mail and delete the message and any attachments from your system. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu BR_ FONT size=2BR DTCC DISCLAIMER: This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are
Re: [Veritas-bu] OpsCenter
Nate, It is possible. I currently have OpsCenter (Windows 2008 64 bit) monitoring 6.5 Master servers. However, it does involve installing 6.5 media server in order to use the media server binaries to communicate with the master. I had Support help me in the install, I don't think I could do it from scratch myself again. You may want to open a case to get the right instructions. Also, to configure the ports to use, run INSTALL_PATH\Symantec\OpsCenter\gui\bin\goodies\configurePorts.cmd Bryan Nate Sanders sande...@dmotorworks.com Sent by: veritas-bu-boun...@mailman.eng.auburn.edu 09/01/2010 08:43 AM To judy_hinchcli...@administaff.com judy_hinchcli...@administaff.com cc Sanders, Nate sande...@digitalmotorworks.com, VERITAS-BU@MAILMAN.ENG.AUBURN.EDU VERITAS-BU@MAILMAN.ENG.AUBURN.EDU Subject Re: [Veritas-bu] OpsCenter A 6.5 Master works with 7.0 OpsCenter using an Agent. That's what I am trying to find, along with information on how to change the default port for the OpsCenter app. On 08/31/2010 05:12 PM, judy_hinchcli...@administaff.com wrote: 6.5 is NOM 7.0 is Opscenter -Original Message- From: veritas-bu-boun...@mailman.eng.auburn.edu [mailto:veritas-bu-boun...@mailman.eng.auburn.edu] On Behalf Of Nate Sanders Sent: Tuesday, August 31, 2010 5:05 PM To: VERITAS-BU@MAILMAN.ENG.AUBURN.EDU Subject: Re: [Veritas-bu] OpsCenter Also does anyone know where to get the 6.5 Agent? Documentation says it's in OpsCenter/Agent but all I see is OpsCenter/Server from the NB7.0 install file (NB_7.0_LinuxR_x86_64_GA). On 08/31/2010 04:59 PM, Nate Sanders wrote: So OpsCenter defaults to port 80 assuming nobody in their right mind would be running a webserer. How in the world do you change it to some other port without having access to the UI? I've been through the Admin guide and Google with no such luck. I'm all ready frustrated with the fact it ignored my install path and decided to throw everything where it wanted to despite what I told it. -- Nate SandersDigital Motorworks System Administrator (512) 692 - 1038 This message and any attachments are intended only for the use of the addressee and may contain information that is privileged and confidential. If the reader of the message is not the intended recipient or an authorized representative of the intended recipient, you are hereby notified that any dissemination of this communication is strictly prohibited. If you have received this communication in error, please notify us immediately by e-mail and delete the message and any attachments from your system. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu BR_ FONT size=2BR DTCC DISCLAIMER: This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error, please notify us immediately and delete the email and any attachments from your system. The recipient should check this email and any attachments for the presence of viruses. The company accepts no liability for any damage caused by any virus transmitted by this email./FONT___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Architectural question (staging)
Agreed. Also, be aware that you will typically not be able to stream data to a disk array as fast as you can to tape drives. (Assuming LTO3 or 4 type performance.) Unless you have a pretty beefy disk array with your RAID configured for streaming. The nice part is that since it is disk, small backups and slow backups won't have shoeshine problems like you would with tape. I like to set a high water mark on the disk to keep it at 85% or lower. Generally, 85% full is the point where disk performance starts getting hit hard. Fragmentation will also start hitting the performance hard at that point too. I've yet to see de-staging perform well no matter what the disk array used for the DSSU. Bryan Ed Wilts ewi...@ewilts.org Sent by: veritas-bu-boun...@mailman.eng.auburn.edu 05/05/2010 03:05 PM To Victor Engle victor.en...@gmail.com cc veritas-bu@mailman.eng.auburn.edu Subject Re: [Veritas-bu] Architectural question (staging) On Wed, May 5, 2010 at 2:57 PM, Victor Engle victor.en...@gmail.com wrote: So my question is how best to configure the DSSUs with the goal of optimized de-staging. I will have 6TB to configure as desired on the backup server. If I understand correctly, the more concurrent streams allowed to the DSSUs, the slower the de-staging because of interleaved backup streams. The DSSU consists of a set of files with each file being a backup image and you define the maximum size of each file within an image. There is no interleaving. When you destage, one image at a time goes to tape. Watch your fragment sizes and watch your disk file system fragmentation... .../Ed Ed Wilts, RHCE, BCFP, BCSD, SCSP, SCSE ewi...@ewilts.org Linkedin___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu BR_ FONT size=2BR DTCC DISCLAIMER: This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error, please notify us immediately and delete the email and any attachments from your system. The recipient should check this email and any attachments for the presence of viruses. The company accepts no liability for any damage caused by any virus transmitted by this email./FONT___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] 2 media servers under the same master?
Wayne, I'm assuming you are using the DD as VTL, not using OST. If so, yes, using SSO you can share the VTL drives with the other media server. I believe you have to have the SSO license on all media servers that share the drives. It used to be sold on a per drive basis, not sure how they sell it anymore. -- See your sales rep for details. :) Bryan BeDour, Wayne wbed...@lear.com Sent by: veritas-bu-boun...@mailman.eng.auburn.edu 04/01/2010 12:46 PM To veritas-bu@mailman.eng.auburn.edu cc Subject [Veritas-bu] 2 media servers under the same master? Our environment, NBU 6.5.4 Master and separate media server running on HP-UX 11-31 with a Data Domain VTL and MSL6060 tape library. Can I add another media server and use the data domain vtl along with the other media server? Do I have to use SSO to share the vtl or will the master take care of the sharing? Thanks in advance for any advice. Wayne BeDour Unix System Administrator PH: 248-447-1739 Internet: wbed...@lear.com ** ** LEGAL DISCLAIMER ** ** This E-mail message and any attachments may contain legally privileged, confidential or proprietary information. If you are not the intended recipient(s), or the employee or agent responsible for delivery of this message to the intended recipient(s), you are hereby notified that any dissemination, distribution or copying of this E-mail message is strictly prohibited. If you have received this message in error, please immediately notify the sender and delete this E-mail message from your computer. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu BR_ FONT size=2BR DTCC DISCLAIMER: This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error, please notify us immediately and delete the email and any attachments from your system. The recipient should check this email and any attachments for the presence of viruses. The company accepts no liability for any damage caused by any virus transmitted by this email./FONT___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Netbackup Drive
What I have done in the past is downed the drives I want to use with tar. You can then use robtest to move tapes in and out of the drives. You have to be careful with your mt and tar commands so as to not unload the tape. If you unload the tape, you will have to use robtest to move that tape back to a slot and then back into the drive. It's not without problems, but it can be done. I sure wouldn't try and do anything automated this way. Bryan Justin Piszcz jpis...@lucidpixels.com Sent by: veritas-bu-boun...@mailman.eng.auburn.edu 03/11/2010 09:03 AM To VERITAS-BU@MAILMAN.ENG.AUBURN.EDU cc Subject Re: [Veritas-bu] Netbackup Drive Hm, That's a tricky one, you can set it to only use 2 drives for write, but those drives will be 'any two drives' of the four. There may be a setting to make sure the drives don't get used-- I have not had to do that myself. Justin. On Thu, 11 Mar 2010, naymyotun wrote: Hi, Could you please help to find out for me if it is possible for Netbackup and Tape Library: If Master server manages 4 tape drive from the Tape Library, can we set it in such a way that 2 tape drives will be used for backups run using Netbackup while another 2 tape drives are used for the tar command triggered from OS level? Can you also check if to trigger tar command from OS level, can I use any user account, besides Administrator root account to handle it? +-- |This was sent by naymyo...@gmail.com via Backup Central. |Forward SPAM to ab...@backupcentral.com. +-- ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu BR_ FONT size=2BR DTCC DISCLAIMER: This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error, please notify us immediately and delete the email and any attachments from your system. The recipient should check this email and any attachments for the presence of viruses. The company accepts no liability for any damage caused by any virus transmitted by this email./FONT___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] MS SQL Agents
Don, It entirely depends on your priorities. If you can't afford the cost of the agent, well, that's one way to do it. Although you better be figuring in the total ownership cost of 3X the disk space of having your live db and 2 backup copies online. That is not cheap either. I've always heard the DBA argument that we always want to have fast access to the disk for restores. I can't rebut the argument that the disk is more highly available than the backup system. However, I can say a SQL server backup to local disk, or restore from local disk, using native SQLserver tools has never been as fast as the NetBackup agent backup - that I have ever seen. Not that it is impossible, but in my years I haven't seen it. Also, if you have to go further back for a restore than what you have on disk, it is going to take you several times longer with more potential for errors - restore backup to disk, then restore the db from the disk restore. One more thing I'll say for the NetBackup SQL agent (or Oracle too.) Once I have introduced DBA's to the agent, demonstrated how the agent works, how the DBA's can now completely manage their own backups and restores, they have never gone back. Bryan All, I am currently looking for info on backing up MS SQL boxes and wondered if the agent actually does any type of snapshotting or are there scripts that have to pause the database and then the backup begins? We currently have local scripts in place that put the database in a mainteneance mode and copies data to a data directory. Then the script starts up the database and our Netbackup server comes in and does a regular backup of the box, which includes the data directory. Why would I spend money for an agent when we get backups with this method? BR_ FONT size=2BR DTCC DISCLAIMER: This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error, please notify us immediately and delete the email and any attachments from your system. The recipient should check this email and any attachments for the presence of viruses. The company accepts no liability for any damage caused by any virus transmitted by this email./FONT___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
[Veritas-bu] NetBackup NDMP with EMC DL3D VTL?
Hi all, I'm getting prepared to deploy an EMC DL3D 3000 VTL with NetBackup 6.5.3.1. We also want to run NDMP backups to the VTL from NetApp filers. I can't find any matrix that shows that this combination is supported - from NetApp, EMC or Symantec. Or any documentation that tells you to run a specific tape library emulation on the VTL. Has anyone else tried to run this specific combination? I don't really want to attempt to bring this into production if I'm going to have to pull it out and re-configure it again. Thanks, Bryan BR_ FONT size=2BR DTCC DISCLAIMER: This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error, please notify us immediately and delete the email and any attachments from your system. The recipient should check this email and any attachments for the presence of viruses. The company accepts no liability for any damage caused by any virus transmitted by this email./FONT___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Making Expired Netbackup Tapes Unreadable
I've often wondered about requesting an enhancement for a NetBackup option - Expire with prejudice - just for these situations. Something you could set on a global, pool or retention level basis... Greetings, I am pretty sure that a lot of you who are working for big enterprises are aware of the legal holds and holding even the scratch tapes for the legal purposes. I have a question related to this. There is a possibility that legal might come back and ask to hold all tapes including the scratch tapes because Netbackup has a mechanism to read those tapes and import them. Is there a way we can make Netbackup tapes as unimportable easily with out rewriting the whole tape? Thanks ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] FYI - Symantec made a change to their FTP (no longerallows list)
When Symantec first changed their support site I complained too. Since I was with a small company, my input fell on deaf ears. In addition, I now have to support Storage Foundation. Try to get patches for Storage Foundation!!! Go search VxFS patches, filter out various versions and languages, see if it applies to your MP or not... Then go to VxVM, then VCS, VEA, maybe add in a search for LLT, GAB, CMCC, CSCM,,,. Bryan Unfortunately, Symantec isn't listening to anyone any more. We own and purchase a LOT of Netbackup, Legato, and Backup Express and we pushed all the way through our Netbackup Sales Rep and support rep about the lack of tech support response as well as how poor their website is to navigate to find ANYTHING worth while to include the awful way of hunting for a flippin patch for Netbackup. Needless to say...there's been zero response from them in about a year now. Thank You, Dennis Peacock EBCA Acxiom Corporation 501-342-6232 (office) From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of [EMAIL PROTECTED] Sent: Wednesday, May 28, 2008 9:32 PM To: Michael Graff Andersen Cc: [EMAIL PROTECTED]; veritas-bu@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] FYI - Symantec made a change to their FTP (no longerallows list) This is terrible, I have always used the FTP to get MPs, etc because I need them for multiple platforms and it is much easier to queue everything up in insert your ftp client here than using the website and getting each one individually. ALSO, I find the Symantec site EXTREMELY painful to use, the search function is almost unusable, nothing seems organized; this is terrible news. :'-( I have been using Google to find technotes for netbackup using the following url: (searches seer.entsupport.symantec.com for netbackup and anything within the past month) http://www.google.com/search?hl=enq=site%3Aseer.entsupport.symantec.com +netbackupas_qdr=m Jared M. Seaton Recovery Administrator Mylan Inc. 304-554-5926 304-685-1389 (Cell) Michael Graff Andersen [EMAIL PROTECTED] Sent by: [EMAIL PROTECTED] 05/28/2008 04:36 PM To Justin Piszcz [EMAIL PROTECTED] cc veritas-bu@mailman.eng.auburn.edu Subject Re: [Veritas-bu] FYI - Symantec made a change to their FTP (no longerallows list) Think we all should complain, especially as the java download dosn't really work for the big files. And they are refering to the ftp site in numerous technotes, makes absolutely no sense to have a pub(lic) area that can't be browsed. my 10 cent Michael 2008/5/28, Justin Piszcz [EMAIL PROTECTED]: On Wed, 28 May 2008, Curtis Preston wrote: Now THAT'S just ridiculous Curtis Preston | VP Data Protection GlassHouse Technologies, Inc. Agree and I asked if this change would be reversed-- it will not be, one must use the website for everything now FYI. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu == CONFIDENTIALITY NOTICE: This e-mail message and all attachments transmitted with it may contain legally privileged, proprietary and/or confidential information intended solely for the use of the addressee. If you are not the intended recipient, you are hereby notified that any review, dissemination, distribution, duplication or other use of this message and/or its attachments is strictly prohibited. If you are not the intended recipient, please contact the sender by reply e-mail and destroy all copies of the original message and its attachments. Thank you. == * The information contained in this communication is confidential, is intended only for the use of the recipient named above, and may be legally privileged. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this communication in error, please resend this communication to the sender and delete the original message or any copy of it from your computer system. Thank you. * ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu
Re: [Veritas-bu] Quarterly Backups and Calendar Schedule [NC]
This is one of those rare edge cases where I have to admit that the scheduling software is very nice to use. I had to do this previously, and we used Autosys to do these oddball schedules - first Monday of the month unless the 1st of the month falls on Saturday or Sunday, then use the second Monday of the Month Of course, if you don't have one of those available... -- Bryan Bahnmiller You can have it fast, cheap, reliable - pick any two. That's doing exactly what Randy wanted not to do: specifying specific days in a schedule. That means you will, eventually, have to go run that script again for another year. Randy: no, there's no better way to do this within NetBackup's scheduling mechanism. Automating the schedule updates with something along the lines of what Misha describes reduces the irritation, but you just can't say things like X day of a quarter or first Sunday after the last Friday in a month with what NBU gives you. -- gabriel rosenkoetter Radian Group Inc, Unix/Linux/VMware Sysadmin / Backup Recovery [EMAIL PROTECTED], 215 231 1556 -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] Sent: Friday, March 28, 2008 10:44 AM To: Randy Samora Cc: VERITAS-BU@mailman.eng.auburn.edu; [EMAIL PROTECTED] Subject: Re: [Veritas-bu] Quarterly Backups and Calendar Schedule [NC] Define the easier way, please. Scripting ? What's the stubmling block - figuring out last friday of the quarter ? - wouldn't that be last Friday of the last month of the quarter, which is actually known in advance. I.e. last last Fridays of Mar, Jun, Sep, Dec - correct ? Jan, Feb, Mar Apr, May, Jun Jul, Aug, Sep Oct, Nov, Dec In this case: for month in 3 6 9 12 ; do day=$(last_friday_of $month) /usr/openv/netbackup/bin/admincmd/bpplschedrep POLICY QUARTER_END_SCHEDULE -incl $day done Where last_friday_of is your script/function you have mentioned saying I can do last Friday of the month Or I am missing smthng ? -- Misha Pavlov This message uses only 100% recycled electrons. Randy Samora [EMAIL PROTECTED] Sent by: [EMAIL PROTECTED] 03/28/2008 10:00 AM To VERITAS-BU@mailman.eng.auburn.edu cc Subject [Veritas-bu] Quarterly Backups and Calendar Schedule Does anyone know of an easier way to configure a Quarterly backup schedule to run on the last Friday of the Quarter other than going in and manually selecting those 4 dates in the year for each policy? I can do last Friday of the month but not last Friday of the Quarter. Just wondering if there was an easier way. Thanks, Randy ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu * This message and any attachments (the message) are confidential and intended solely for the addressees. Any unauthorised use or dissemination is prohibited. E-mails are susceptible to alteration. Neither SOCIETE GENERALE nor any of its subsidiaries or affiliates shall be liable for the message if altered, changed or falsified. * ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Speaking of NTFS:
Adam, all, If your NTFS volume is over 80% full, the performance starts to degrade. I've tested this and verified that it does happen. I didn't do enough testing with controls to truly characterize performance, but it can be demonstrated. At 85% full, you will notice a significant performance decrease. From 85% to 90% the performance will drop in half! It seems to be geometric once you hit 85%. Defragmenting will help the NTFS filesystem performance. Be aware, that the NTFS defrag likes to have 25% freespace. If you get up to 85% full, the defrag may not even run. You can now set up scheduled NTFS defrags with Win2003 - it wasn't possible without a 3rd party product until Win2003. Don't let the Windows guys use disk compression. Backup performance will go straight to h***. And, guess what happens if you do a large restore on a volume that has compression turned on? That's really fun. Many, many small files will kill performance. So will directory depth. Once I had a 500 GB NTFS filesystem that was taking 3 days to backup! And, incrementals would actually take longer. I laid out the steps we needed to run through to get it backed up. First of all, it was over 90% full. I told them they needed to use 75% full as their goal, including growth. When we migrated the data, we defragged it too. If I recall correctly we could then run a backup in about 18 hours or so. Then I set up Flashbackup using VSS. After all was said and done the Flashbackup would run in about 3 - 4 hours. I considered 3 days to 3 hours a fairly decent performance increase. It really operates very similar to a Flashbackup of VxFS, if you've ever done that. And if you do defrag with Flashbackup, only defrag prior to the full backup. If you turn on multi-streaming with Windows and do All Local Drives, it creates one stream per drive - C:, D:, etc... If your drives are separate disks, separate luns, that's ok. However, say the local disk space is coming off of a locally attached SCSI array where the disks are setup in RAID 0+1 or RAID 5, then the RAID disk is split up to create different disks for the server. All multi-streaming will do for you in that case is increase disk contention. If your disk is coming off of a large array, like a DMX, Clariion, EVA or such, this is not as much an issue, although it can be if your various luns are coming off of the same set of spindles. Large Windows file servers rarely get good disk I/O performance. It has been steadily improving, but I have usually seen the network I/O exceed the disk I/O. DB servers are the exceptions to this. Large SQL or Oracle servers can usually generate a much faster I/O stream, everything else begin equal. SAN media servers? High cost that _may_ give you a performance increase. Make sure you can read from your disk faster than your network throughput. With tuning, a decent Windows server should be able to send out in excess of 60 MB/s over GigE. Make sure you can read from your disk(s) that fast before you spend the money on the SAN backup solution. Bryan My backup systems are Solaris, I have the luxury of vxfs filesystems for my staging database areas. I do however back up Windows file servers, Are there any guidelines to NTFS volumes that people would recommend ? I thinking along the lines: Defragmenting, Number of streams, LUN Virtulization tech, Volume Sizes, Maintaining free space, Snapshot methods, impact of ohh sooo many small files Performance improvements with Advanced client / Flashbackup, SAN Media server, (For the adventurous) SAN client ? For example, i currently have pain with about a dozen windows clients, from what i can tell we do not do defragmentaion their LUNS live on HP EVA's sharing spindles with hosts Free Space is minimum (~7%) Volumes are only ~500GB We backup with Multiple streams (Exceeds weekend (and daily) backup window if we don't (Windows are large) Currently backing up the windows dataservers is a pain point for me, I am interested in hearing peoples learnings / Golden rules when it comes to backing up large (over 500GB) NTFS Volumes. Adam Mellor Senior Unix Support Analyst CF IT TECHNOLOGY SERVICES Woodside Energy Ltd. From: Ed Wilts [mailto:[EMAIL PROTECTED] Sent: Thursday, 14 February 2008 1:17 PM To: Mellor, Adam A. Cc: VERITAS-BU@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Defrag DSU? On Feb 13, 2008 6:22 PM, Mellor, Adam A. [EMAIL PROTECTED] wrote: Although I am not currently defragmenting my current DSU volumes, I previously had ~4TB in a single DSU under NBU 5.1 . This volume was running vxfs vxfs says it all, you lucky guy. NTFS just sucks... try a 4TB DSSU on Windows and see how much fun you have. I do like your idea
Re: [Veritas-bu] Max Fragment Size for Disk and LTO4 Based Storage Units
Jamie, I did a lot of testing at one point trying to tune NetBackup for DSSU's, LTO2 and LTO3. I found that 1024 MB fragments would never even spin up the LTO3 drive. It would basically start to speed up, then it would slow down because it had to position for the next fragment. Total time - 6 seconds! After much experimentation, I found that 6GB fragments worked best for LTO2 and 10GB fragments best for LTO3. (Local FC attached high speed disk to FC attached tape drives.) LTO4's could probably even use larger fragments, I never tested them. And to confirm what Ed says, given the speed of the tape drives, restores are not an issue. At most, even with 20GB fragments like Ed uses, you may spend an extra minute or two pulling the file off the tape. Bryan -- Bryan Bahnmiller JAJA (Jamie Jamison) wrote: So I just got a SpectraLogic T950 tape library, and after some initial teething pains it's up and running and it's wicked fast, but being an impatient little monkey of a NetBackup administrator I'm wondering if I could make it wicked faster. My primary backups go to DataDomain restorers and then are duplicated to tape for offsite storage with Iron Mountain. When I set all of this up I used 2048 megabytes as the maximum fragment size in both the disk based and tape based storage units. This was based on my predecessor's experience with what was the best trade-off between backup speed and file restoration speed with LTO Gen 2 drives. But I'm wondering if I can improve backup performance even more by increasing the fragment size for my disk and LTO4 based storage units without degrading my current file restoration performance. I thought I would send this to the list to find out what people were using as the frag sizes on LTO4 and on disk based storage units such as the DataDomains. Also if I change the fragment size on my tape based storage units how does NetBackup handle tapes that have backups written to them with different fragment sizes. Can this cause problems? Any feedback will be greatly appreciated. Thank You, Jamie Jamison ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Max Fragment Size for Disk and LTO4 Based Storage Units
Ed, On Feb 1, 2008 9:11 AM, Bryan Bahnmiller [EMAIL PROTECTED] wrote: I did a lot of testing at one point trying to tune NetBackup for DSSU's, LTO2 and LTO3. I found that 1024 MB fragments would never even spin up the LTO3 drive. It would basically start to speed up, then it would slow down because it had to position for the next fragment. Total time - 6 seconds! After much experimentation, I found that 6GB fragments worked best for LTO2 and 10GB fragments best for LTO3. (Local FC attached high speed disk to FC attached tape drives.) LTO4's could probably even use larger fragments, I never tested them. Hi Bryan, How did you determine that 10GB fragments were optimum? Out of curiosity, why not 20? We picked 20 as a rough number and not because of any serious benchmarking. Did you just discover that it wouldn't write any faster than if you picked 10 so you stuck with that? I guessed. I tried, within reason, almost everything. I was using multiples of 2 and that didn't seem to make a difference. Then I just started picking numbers. 1, 2, 3, 4, 5, 6,,, I even tried some things like 10.5 and such. It was really strange. If you tried to plot it, it would probably be a fairly steady linear increase until I hit the peak number. Then it would bounce around a bit when I increased further, down, back up... Yep, you're right. I kind of hit the peak at 10, so I stuck with that. It might be one of those things that if you really got into it, you could probably start tweaking kernel parameters related to fibrechannel and SCSI and you might get a bit more, but I didn't have that kind of time. What sort of destaging performance are you getting? We've found, in general, destaging performance is pretty poor but we've never been able to identify the bottlenecks and all the help we've gotten from NetBackup support and engineering hasn't made it any better. We can write fast but we can't destage fast. The destaging performance never approached what I saw with backing up disk to tape. It seemed to help if you had the same fragment sizes with tape and disk, but if I recall correctly, it was in the range of 60% - 70% the backup performance. Also, we were doing 2 tape copies in production - 1 for local recovery and 1 for DR. That slowed things down even further. For some reason when you do 2 copies, the synchronization hits you for about a 20% decrease in performance too. BTW, all of the testing was done with IBM p550's, AIX 5.3 and NetBackup 6.0 MP1. Another interesting side note I learned from the testing was that once you start burying files down several directory levels, your disk read performance starts to really stink. So using the staging directories with big files at the top of your directory hierarchy is the way to go. Thanks, .../Ed Bryan ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
