Re: [EXTERNAL] Re: Win BA client GUI shows empty drive for PIT restore view

2019-04-30 Thread Rhodes, Richard L.
I ran a dirsonly selective backup of the F drive:  selective f:\ -subdir=yes 
-dirsonly
I figured this would allow the PIT restore to have the dirs. it needed.
It backed up:
  Total number of objects inspected:  183,714
  Total number of objects backed up:  183,714

But, when I now fire up the gui, the F: drive is still completely empty.

Here is one of the top level dirs CR-ENG.
\\wnjcr03p\f$   2   ACTIVE_VERSION  DIR \   CR-ENG  2019-04-29 
02:43:25.00


Rick




-Original Message-
From: Rhodes, Richard L. 
Sent: Tuesday, April 30, 2019 1:23 PM
To: ADSM: Dist Stor Manager 
Cc: Schillinger, Christopher M 
Subject: RE: [EXTERNAL] Re: Win BA client GUI shows empty drive for PIT restore 
view

Yea, I think this hits our problem exactly!

This server holds Windows shares.  It doesn't change much - in the past 32 days 
only 18k files/dirs have changed out of over 2.3m.  

Now, a year or so ago we made a big change on all our win server backups.  
Prior to this change, we had a default (and only) mgt class policies of 
32,2,90,365, so dirs would have been bound to the RETONLY 365.A year or so 
ago we changed to 32,32,32,32. All dirs that hadn't changed forever were 
dropped, and thus not there for this GUI PIT restore attempt.

>From the select I of the backups table, I searched for the top level DIR of 
>the path we wanted, F:/Cr-ENG, and it doesn't exist.  I believe this is true 
>for all top level dirs.  And thus, no PIT GUI display.


A Question:  When we changed the policies and all the long held dirs were 
deleted out of TSM, why didn't TSM backup them up as new files during the next 
normal incremental backup?  Wouldn't TSM see there was no backup of the dir and 
back it up?

Rick




-Original Message-
From: ADSM: Dist Stor Manager  On Behalf Of Andrew Raibeck
Sent: Tuesday, April 30, 2019 12:28 PM
To: ADSM-L@VM.MARIST.EDU
Subject: [EXTERNAL] Re: Win BA client GUI shows empty drive for PIT restore view

Hi Richard,

Check the management class to which the directories are bound, and see what
the RETEXTRA and VEREXISTS settings are.

Off the top of my head, this sounds like a topic covered in an older post:

https://www.mail-archive.com/adsm-l@vm.marist.edu/msg07963.html

As an alternative, the command line client can be used to do the PIT
restore.

Best regards,

Andy



Andrew Raibeck | IBM Spectrum Protect Level 3 | stor...@us.ibm.com

"ADSM: Dist Stor Manager"  wrote on 2019-04-30
12:07:38:

> From: "Rhodes, Richard L." 
> To: ADSM-L@VM.MARIST.EDU
> Date: 2019-04-30 12:16
> Subject: Win BA client GUI shows empty drive for PIT restore view
> Sent by: "ADSM: Dist Stor Manager" 
>
> Hi,
>
> TSM server  7.1.5
> Win Server 2012R2 with  BA client 7.1.6.2, then upgraded to 7.1.8.4
>
> We're trying to do a Point-In-Time restore of a directory on a Win
> server F drive. (Just one sub dir, not the whole drive.) The mgt
> class is 32 32 32 32 - one month PIT restorable.
>
> When we bring up the Win BA gui client and just look at the F drive
> we see the active files.
> When we switch to active+inactive files, we see all versions of files.
> When we switch to PIT restore and take the default date/time (right
> "now") we see files as of last nights backup.
> But ...
> When we switch the PIT back to any point prior to last nights backup
> we see NOTHING on the F drive.  No files ... No dirs ... nothing.
> The GUI shows just an empty  F drive.  (and the F drive has 2.3m files on
it)
>
> Ran a SELECT from the BACKUPS table for the node and clearly see all
> the files (active+inactive).
> Stopped/started BA client - didn't help.
> Rebooted server - didn't help.
> upgraded from 7.1.6.2 to 7.1.8.4 - didn't help.
>
> We're going after the restore via the active+inactive view.  But we
> don't understand why PIT restore shows absolutely nothing.
>
> Any thought are more than welcome!
>
> Rick
>
>
>
>
>
--

>
> The information contained in this message is intended only for the
> personal and confidential use of the recipient(s) named above. If
> the reader of this message is not the intended recipient or an agent
> responsible for delivering it to the intended recipient, you are
> hereby notified that you have received this document in error and
> that any review, dissemination, distribution, or copying of this
> message is strictly prohibited. If you have received this
> communication in error, please notify us immediately, and delete the
> original message.
>
--

The information contained in this message is intended only for the personal and 
confi

Re: [EXTERNAL] Re: Win BA client GUI shows empty drive for PIT restore view

2019-04-30 Thread Rhodes, Richard L.
Yea, I think this hits our problem exactly!

This server holds Windows shares.  It doesn't change much - in the past 32 days 
only 18k files/dirs have changed out of over 2.3m.  

Now, a year or so ago we made a big change on all our win server backups.  
Prior to this change, we had a default (and only) mgt class policies of 
32,2,90,365, so dirs would have been bound to the RETONLY 365.A year or so 
ago we changed to 32,32,32,32. All dirs that hadn't changed forever were 
dropped, and thus not there for this GUI PIT restore attempt.

>From the select I of the backups table, I searched for the top level DIR of 
>the path we wanted, F:/Cr-ENG, and it doesn't exist.  I believe this is true 
>for all top level dirs.  And thus, no PIT GUI display.


A Question:  When we changed the policies and all the long held dirs were 
deleted out of TSM, why didn't TSM backup them up as new files during the next 
normal incremental backup?  Wouldn't TSM see there was no backup of the dir and 
back it up?

Rick




-Original Message-
From: ADSM: Dist Stor Manager  On Behalf Of Andrew Raibeck
Sent: Tuesday, April 30, 2019 12:28 PM
To: ADSM-L@VM.MARIST.EDU
Subject: [EXTERNAL] Re: Win BA client GUI shows empty drive for PIT restore view

Hi Richard,

Check the management class to which the directories are bound, and see what
the RETEXTRA and VEREXISTS settings are.

Off the top of my head, this sounds like a topic covered in an older post:

https://www.mail-archive.com/adsm-l@vm.marist.edu/msg07963.html

As an alternative, the command line client can be used to do the PIT
restore.

Best regards,

Andy



Andrew Raibeck | IBM Spectrum Protect Level 3 | stor...@us.ibm.com

"ADSM: Dist Stor Manager"  wrote on 2019-04-30
12:07:38:

> From: "Rhodes, Richard L." 
> To: ADSM-L@VM.MARIST.EDU
> Date: 2019-04-30 12:16
> Subject: Win BA client GUI shows empty drive for PIT restore view
> Sent by: "ADSM: Dist Stor Manager" 
>
> Hi,
>
> TSM server  7.1.5
> Win Server 2012R2 with  BA client 7.1.6.2, then upgraded to 7.1.8.4
>
> We're trying to do a Point-In-Time restore of a directory on a Win
> server F drive. (Just one sub dir, not the whole drive.) The mgt
> class is 32 32 32 32 - one month PIT restorable.
>
> When we bring up the Win BA gui client and just look at the F drive
> we see the active files.
> When we switch to active+inactive files, we see all versions of files.
> When we switch to PIT restore and take the default date/time (right
> "now") we see files as of last nights backup.
> But ...
> When we switch the PIT back to any point prior to last nights backup
> we see NOTHING on the F drive.  No files ... No dirs ... nothing.
> The GUI shows just an empty  F drive.  (and the F drive has 2.3m files on
it)
>
> Ran a SELECT from the BACKUPS table for the node and clearly see all
> the files (active+inactive).
> Stopped/started BA client - didn't help.
> Rebooted server - didn't help.
> upgraded from 7.1.6.2 to 7.1.8.4 - didn't help.
>
> We're going after the restore via the active+inactive view.  But we
> don't understand why PIT restore shows absolutely nothing.
>
> Any thought are more than welcome!
>
> Rick
>
>
>
>
>
--

>
> The information contained in this message is intended only for the
> personal and confidential use of the recipient(s) named above. If
> the reader of this message is not the intended recipient or an agent
> responsible for delivering it to the intended recipient, you are
> hereby notified that you have received this document in error and
> that any review, dissemination, distribution, or copying of this
> message is strictly prohibited. If you have received this
> communication in error, please notify us immediately, and delete the
> original message.
>
--

The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Win BA client GUI shows empty drive for PIT restore view

2019-04-30 Thread Rhodes, Richard L.
Hi,

TSM server  7.1.5
Win Server 2012R2 with  BA client 7.1.6.2, then upgraded to 7.1.8.4

We're trying to do a Point-In-Time restore of a directory on a Win server F 
drive. (Just one sub dir, not the whole drive.) The mgt class is 32 32 32 32 - 
one month PIT restorable.

When we bring up the Win BA gui client and just look at the F drive we see the 
active files.
When we switch to active+inactive files, we see all versions of files.
When we switch to PIT restore and take the default date/time (right "now") we 
see files as of last nights backup.
But ...
When we switch the PIT back to any point prior to last nights backup we see 
NOTHING on the F drive.  No files ... No dirs ... nothing.  The GUI shows just 
an empty  F drive.  (and the F drive has 2.3m files on it)

Ran a SELECT from the BACKUPS table for the node and clearly see all the files 
(active+inactive).
Stopped/started BA client - didn't help.
Rebooted server - didn't help.
upgraded from 7.1.6.2 to 7.1.8.4 - didn't help.

We're going after the restore via the active+inactive view.  But we don't 
understand why PIT restore shows absolutely nothing.

Any thought are more than welcome!

Rick




--

The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


What client version do you keep for long term

2019-03-14 Thread Rhodes, Richard L.
Hi Everyone!

Curious what others do for holding onto BA client versions.
For the long term, what versions of clients do you hang onto?
  All maintenance levels?   ie:  7.1.8.0
  All patch levels?  ie:  7.1.8.x
  Just highest patch levels?  ie:  7.1.8.4 (just highest last digit)


Rick





--

The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


dsm.sys question

2019-02-27 Thread Rhodes, Richard L.
Hello,

Our Unix team in implementing a management application named Puppet. 
They are running into a problem using Puppet to setup/maintain the 
TSM client dsm.sys files.  They create/maintain the dsm.sys as 
per a template of some kind.  If you change a dsm.sys with a unique 
option, it gets overwritten by the standard template when Puppet 
refreshes/checks the file.  The inclexcl option pulls include/excludes 
from a separate local file so this works fine for local specific needs.  
But some systems need other settings or whole servername stanzas that 
are unique.  I've looked through the BA client manual and see no way to 
include arbitrary lines from some other file into dsm.sys.

Q) Is there a way to source options from another file into the dsm.sys, kind of 
like the inclexcl option does?


Thanks

Rick
--

The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Re: [EXTERNAL] Re: nfstimeout on server ISILON storage

2018-09-06 Thread Rhodes, Richard L.
I'm not sure of the specifics, and our isilon person is out on vacation this 
week.  Sorry.



-Original Message-
From: ADSM: Dist Stor Manager  On Behalf Of Zoltan Forray
Sent: Wednesday, September 5, 2018 3:07 PM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: [EXTERNAL] Re: nfstimeout on server ISILON storage

Rick,

Thanks for the reply.  I passed your comments to my SAN guy and he said:

*Earth is connected to HHIsilon and it is running 8.1.0.4  **All the others
are connected to ISPIsilon and it is running 8.0.0.4*

*I'm pretty sure all the Cisco switchports are LACP and Isilon networking
is configured for LACP. Can that person elaborate on that bug?*

On Wed, Sep 5, 2018 at 12:00 PM Rhodes, Richard L. <
rrho...@firstenergycorp.com> wrote:

> We run our Isilon systems (OneFS 8.0.0.6) with active/passive failover.
> When we put them in OneFS had a bug with LACP and wouldn't work, forcing us
> to go active/passive.  Due to other problems, we just discussed with them
> converting from active/passive to LACP, but EMC said there is still a bug
> in LACP support.
>
> Rick
>
>
>
> -Original Message-
> From: ADSM: Dist Stor Manager  On Behalf Of Zoltan
> Forray
> Sent: Wednesday, September 5, 2018 9:03 AM
> To: ADSM-L@VM.MARIST.EDU
> Subject: [EXTERNAL] Re: nfstimeout on server ISILON storage
>
> A pair of 10G links bonded - CISCO switches.
>
> On Tue, Sep 4, 2018 at 7:54 PM Skylar Thompson  wrote:
>
> > Quick question - what's the data link protocol (Ethernet, IB, etc.) and
> > link rate
> > that you're using?
> >
> > On Tue, Sep 04, 2018 at 02:05:33PM -0400, Zoltan Forray wrote:
> > > We are still fighting issues with ISILON storage. Our current issue is
> > with
> > > NFS timeouts for the storage a server is using.  We see message like
> > these
> > > in the server /var/log
> > >
> > > Sep  4 13:21:49 earth kernel: nfs: server
> hhisilonnfs23.rams.adp.vcu.edu
> > > not responding, still trying
> > > Sep  4 13:21:49 earth kernel: nfs: server
> hhisilonnfs23.rams.adp.vcu.edu
> > > not responding, still trying
> > > Sep  4 13:21:49 earth kernel: nfs: server
> hhisilonnfs23.rams.adp.vcu.edu
> > > not responding, still trying
> > > Sep  4 13:21:49 earth kernel: nfs: server
> hhisilonnfs23.rams.adp.vcu.edu
> > > not responding, still trying
> > > Sep  4 13:22:14 earth kernel: nfs: server
> hhisilonnfs23.rams.adp.vcu.edu
> > > not responding, still trying
> > > Sep  4 13:22:15 earth kernel: nfs: server
> hhisilonnfs23.rams.adp.vcu.edu
> > > not responding, still trying
> > > Sep  4 13:22:16 earth kernel: nfs: server
> hhisilonnfs23.rams.adp.vcu.edu
> > OK
> > > Sep  4 13:22:16 earth kernel: nfs: server
> hhisilonnfs23.rams.adp.vcu.edu
> > OK
> > > Sep  4 13:22:16 earth kernel: nfs: server
> hhisilonnfs23.rams.adp.vcu.edu
> > OK
> > >
> > > OS folks say the NFS mount is setup as IBM recommends in various
> > documents.
> > > So they asked us to implement the nfstimeout option from this document
> (
> > >
> >
> https://www.ibm.com/support/knowledgecenter/en/SSGSG7_7.1.0/com.ibm.itsm.client.doc/r_opt_nfstimeout.html
> > ).
> > > Yes I realize it is primarily for a client backup of an NFS mount, but
> > the
> > > statement:
> > >
> > > Supported Clients This option is for all UNIX and Linux clients. *The
> > > server can also define this option*.
> > >
> > > throws us - kind-of implying I can use this from the server
> perspective?
> > > But I can't find any documentation to support using it from the server.
> > >
> > > For you Linux guru's - this is what the mount says:
> > >
> > > hhisilonnfs23.rams.adp.vcu.edu:/ifs/NFS/TSM on /tsmnfs type nfs
> > >
> >
> (rw,relatime,sync,vers=3,rsize=131072,wsize=524288,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=192.168.19.12,mountvers=3,mountport=300,mountproto=udp,local_lock=none,addr=192.168.19.12)
> > >
> > > Any thoughts?  Suggestion?   Are we simply expecting too much from NFS?
> > >
> > > My OS person also asks why ISP is so slow to write to NFS?  When they
> > did a
> > > test copy of a large file to the NFS mount, they were getting upwards
> of
> > 8G/s
> > > vs 1.5-3G/s when TSM/ISP writes to it (via EMC monitoring tools).
> > >
> > > --
> > > *Zoltan Forray*
> > > Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator
> > > Xymon Monitor Administrator
> > > VMware Administrator
> > > V

Re: [EXTERNAL] Re: nfstimeout on server ISILON storage

2018-09-05 Thread Rhodes, Richard L.
We run our Isilon systems (OneFS 8.0.0.6) with active/passive failover.  When 
we put them in OneFS had a bug with LACP and wouldn't work, forcing us to go 
active/passive.  Due to other problems, we just discussed with them converting 
from active/passive to LACP, but EMC said there is still a bug in LACP support. 
 

Rick



-Original Message-
From: ADSM: Dist Stor Manager  On Behalf Of Zoltan Forray
Sent: Wednesday, September 5, 2018 9:03 AM
To: ADSM-L@VM.MARIST.EDU
Subject: [EXTERNAL] Re: nfstimeout on server ISILON storage

A pair of 10G links bonded - CISCO switches.

On Tue, Sep 4, 2018 at 7:54 PM Skylar Thompson  wrote:

> Quick question - what's the data link protocol (Ethernet, IB, etc.) and
> link rate
> that you're using?
>
> On Tue, Sep 04, 2018 at 02:05:33PM -0400, Zoltan Forray wrote:
> > We are still fighting issues with ISILON storage. Our current issue is
> with
> > NFS timeouts for the storage a server is using.  We see message like
> these
> > in the server /var/log
> >
> > Sep  4 13:21:49 earth kernel: nfs: server hhisilonnfs23.rams.adp.vcu.edu
> > not responding, still trying
> > Sep  4 13:21:49 earth kernel: nfs: server hhisilonnfs23.rams.adp.vcu.edu
> > not responding, still trying
> > Sep  4 13:21:49 earth kernel: nfs: server hhisilonnfs23.rams.adp.vcu.edu
> > not responding, still trying
> > Sep  4 13:21:49 earth kernel: nfs: server hhisilonnfs23.rams.adp.vcu.edu
> > not responding, still trying
> > Sep  4 13:22:14 earth kernel: nfs: server hhisilonnfs23.rams.adp.vcu.edu
> > not responding, still trying
> > Sep  4 13:22:15 earth kernel: nfs: server hhisilonnfs23.rams.adp.vcu.edu
> > not responding, still trying
> > Sep  4 13:22:16 earth kernel: nfs: server hhisilonnfs23.rams.adp.vcu.edu
> OK
> > Sep  4 13:22:16 earth kernel: nfs: server hhisilonnfs23.rams.adp.vcu.edu
> OK
> > Sep  4 13:22:16 earth kernel: nfs: server hhisilonnfs23.rams.adp.vcu.edu
> OK
> >
> > OS folks say the NFS mount is setup as IBM recommends in various
> documents.
> > So they asked us to implement the nfstimeout option from this document (
> >
> https://www.ibm.com/support/knowledgecenter/en/SSGSG7_7.1.0/com.ibm.itsm.client.doc/r_opt_nfstimeout.html
> ).
> > Yes I realize it is primarily for a client backup of an NFS mount, but
> the
> > statement:
> >
> > Supported Clients This option is for all UNIX and Linux clients. *The
> > server can also define this option*.
> >
> > throws us - kind-of implying I can use this from the server perspective?
> > But I can't find any documentation to support using it from the server.
> >
> > For you Linux guru's - this is what the mount says:
> >
> > hhisilonnfs23.rams.adp.vcu.edu:/ifs/NFS/TSM on /tsmnfs type nfs
> >
> (rw,relatime,sync,vers=3,rsize=131072,wsize=524288,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=192.168.19.12,mountvers=3,mountport=300,mountproto=udp,local_lock=none,addr=192.168.19.12)
> >
> > Any thoughts?  Suggestion?   Are we simply expecting too much from NFS?
> >
> > My OS person also asks why ISP is so slow to write to NFS?  When they
> did a
> > test copy of a large file to the NFS mount, they were getting upwards of
> 8G/s
> > vs 1.5-3G/s when TSM/ISP writes to it (via EMC monitoring tools).
> >
> > --
> > *Zoltan Forray*
> > Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator
> > Xymon Monitor Administrator
> > VMware Administrator
> > Virginia Commonwealth University
> > UCC/Office of Technology Services
> > www.ucc.vcu.edu
> > zfor...@vcu.edu - 804-828-4807
> > Don't be a phishing victim - VCU and other reputable organizations will
> > never use email to request that you reply with your password, social
> > security number or confidential personal information. For more details
> > visit http://phishing.vcu.edu/
>
> --
> -- Skylar Thompson (skyl...@u.washington.edu)
> -- Genome Sciences Department, System Administrator
> -- Foege Building S046, (206)-685-7354
> -- University of Washington School of Medicine
>


--
*Zoltan Forray*
Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator
Xymon Monitor Administrator
VMware Administrator
Virginia Commonwealth University
UCC/Office of Technology Services
www.ucc.vcu.edu
zfor...@vcu.edu - 804-828-4807
Don't be a phishing victim - VCU and other reputable organizations will
never use email to request that you reply with your password, social
security number or confidential personal information. For more details
visit http://phishing.vcu.edu/
--

The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have 

hadoop cluster

2018-08-28 Thread Rhodes, Richard L.
Hello!

Someone purchased a 12 node Hadoop cluster.  The BA client was installed on 
each node and it's flooding TSM with TB of backups per night.  I don't know 
who's Hadoop implementation we have, but it runs on RH Linux.

The unix admin is working with the users of the cluster on excluding unneeded 
files.  Currently he is going to add these excludes to each node:
   exclude /cld*/impala/.../*  
   exclude /cld*/yarn/.../*
(the dirs on each node are cld1 thru cld12)

Any thoughts/comments/experiences/recommendations on backing up a Hadoop 
cluster are appreciated!


Thanks!

rick
--

The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Re: [EXTERNAL] Looking for suggestions to deal with large backups not completing in 24-hours

2018-07-06 Thread Rhodes, Richard L.
A couple years ago we decided to replace dozens and dozens of big
Windows servers with a centralize Isilon NAS.  The Windows servers, 
being tons of little files, were an ongoing pain to backup with TSM.  
Our decision was to NOT backup the Isilon to TSM or any other external 
program.  Instead, we decided to use snapshots and replication to a DR 
Isilon.  In other words, we made a conscience decision to stop using
TSM to backup this data when we moved to Isilon. We took the opportunity
to standardize backup policies to a single snapshot retention
of just 32 days to help keep the snapshot disk space down.  
Other than watching free disk space and a periodic check of
replication and snapshots, backup of this data is out of sight
and out of mind. 


Rick


 



-Original Message-
From: ADSM: Dist Stor Manager  On Behalf Of Zoltan Forray
Sent: Thursday, July 5, 2018 2:52 PM
To: ADSM-L@VM.MARIST.EDU
Subject: [EXTERNAL] Looking for suggestions to deal with large backups not 
completing in 24-hours

As I have mentioned in the past, we have gone through large migrations to
DFS based storage on EMC ISILON hardware.  As you may recall, we backup
these DFS mounts (about 90 at last count) using multiple Windows servers
that run multiple ISP nodes (about 30-each) and they access each DFS
mount/filesystem via -object=\\rams.adp.vcu.edu\departmentname.

This has lead to lots of performance issue with backups and some
departments are now complain that their backups are running into
multiple-days in some cases.

One such case in a department with 2-nodes with over 30-million objects for
each node.  In the past, their backups were able to finish quicker since
they were accessed via dedicated servers and were able to use Journaling to
reduce the scan times.  Unless things have changed, I believe Journling is
not an option due to how the files are accessed.

FWIW, average backups are usually <50k files and <200GB once it finished
scanning.

Also, the idea of HSM/SPACEMANAGEMENT has reared its ugly head since many
of these objects haven't been accessed in many years old. But as I
understand it, that won't work either given our current configuration.

Given the current DFS configuration (previously CIFS), what can we do to
improve backup performance?

So, any-and-all ideas are up for discussion.  There is even discussion on
replacing ISP/TSM due to these issues/limitations.

--
*Zoltan Forray*
Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator
Xymon Monitor Administrator
VMware Administrator
Virginia Commonwealth University
UCC/Office of Technology Services
www.ucc.vcu.edu
zfor...@vcu.edu - 804-828-4807
Don't be a phishing victim - VCU and other reputable organizations will
never use email to request that you reply with your password, social
security number or confidential personal information. For more details
visit http://phishing.vcu.edu/
--

The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Re: [EXTERNAL] Re: ISILON storage/FILE DEVCLASS performance issues

2018-05-14 Thread Rhodes, Richard L.
AIX does supported NFSv4.  I'd love to get the time to try it out, but 
DataDomains only support NVSv4 with the newest release and we are several 
levels back.
https://www.redbooks.ibm.com/redbooks/pdfs/sg246657.pdf

When our admins found that multiple/concurrent mount points helped for 
Oracle/RMAN backups, I converted out DataDomain mounts from single mounts to 
multiple mounts.  I then changed the file pool devclass to use multiple 
directories (one per new mount).  I pulled the original directory out of the 
file pool definition, marked all it's volumes R/O, and movedata all vols.  TSM 
put the vols across the multiple mount points.  Lets just say this took quite 
some time!  The scary things was convincing myself (via testing) that I could 
remove a directory from the devclass and still access those volumes.


original single mount:  
  dd-10g:/data/col1/tsm1  1274748715008 323228344320   75%   103091 1% 
/DD/tsm1
file pool was at /DD/tsm1/backup-pri-dd

changed to these mounts
  dd-10g:/data/col1/tsm1  1274748715008 323228344320   75%   103091 1% 
/DD/tsm1
  dd-10g:/data/col1/tsm1/backup-pri-dd-1  1274748715008 323228344320   75%  
 103091 1% /DD/backup-pri-dd-1
  dd-10g:/data/col1/tsm1/backup-pri-dd-2  1274748715008 323228344320   75%  
 103091 1% /DD/backup-pri-dd-2
  dd-10g:/data/col1/tsm1/backup-pri-dd-3  1274748715008 323228344320   75%  
 103091 1% /DD/backup-pri-dd-3
  dd-10g:/data/col1/tsm1/backup-pri-dd-4  1274748715008 323228344320   75%  
 103091 1% /DD/backup-pri-dd-4
 
  Note, this did not require any additional exports from the DataDomain, just 
creating some directories in it.

This is the devclass for the Datadomain mount

 Device Class Name: BACKUP-PRI-DD
Storage Pool Count: 1
   Device Type: FILE
 Directory: 
/DD/backup-pri-dd-1,/DD/backup-pri-dd-2,/DD/backup-pri-dd-3,/DD/backup-pri-dd-4

Note - prior to this change the devclass only hadDirectory: 
/DD/tsm1/backup-pri-dd





-Original Message-
From: ADSM: Dist Stor Manager  On Behalf Of Harris, Steven
Sent: Sunday, May 13, 2018 8:39 PM
To: ADSM-L@VM.MARIST.EDU
Subject: [EXTERNAL] Re: ISILON storage/FILE DEVCLASS performance issues

Zoltan

I have a similar issue TSM 7.1.1.300 AIX -> Data Domain.  Have dual 10Gb links, 
but can only get ~4000 writes/sec and 120MB/sec throughput. AIX only supports 
NFS3, and as others have pointed out in this forum recently, the stack does not 
have a good reputation.

I'm finding that the heavy NFS load has other knock on effects, e.g. TSMManager 
keeps reporting the instance offline when it's very busy as it gets a network 
error on some of its regular queries, but these work ok when load is light.  
Also getting a lot of Severed/reconnected sessions.  CPU/IO/Paging are not a 
problem.

Cheers

Steve

Steven Harris
TSM Admin/Consultant
Canberra Australia

-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Zoltan 
Forray
Sent: Saturday, 12 May 2018 1:39 AM
To: ADSM-L@VM.MARIST.EDU
Subject: [ADSM-L] ISILON storage/FILE DEVCLASS performance issues

Folks,

ISP 7.1.7.300 on RHEL 6   10G connectivity

We need some guidance on trying to figure out why ISP/TSM write perform to 
ISILON storage (via FILE DEVCLASS) is so horrible.

We recently attached 200TB of ISILON storage to this server so we could empty 
the 36TB of onboard disk drives to move this server to new hardware.

However, per my OS and SAN folks, we are only seeing 1Gbs level of data 
movement from the ISP server.  Doing a regular file copy to this same storage 
peaks at 10Gbs speeds.

So what, if anything, are we doing wrong when it comes to configuring the 
storage for ISP to use?  Are there some secret controls/settings/options to 
tell it to use the storage at max-speeds?

We tried changing the Est/Max capacity thinking larger files would reduce the 
overhead of allocating new pieces constantly.  Changed the Mount Limit to a 
bigger number.  Nothing has helped.

Only thing uses the storage right now is migrations from the original disk 
stgpool.



--
*Zoltan Forray*
Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator Xymon Monitor 
Administrator VMware Administrator Virginia Commonwealth University UCC/Office 
of Technology Services www.ucc.vcu.edu zfor...@vcu.edu - 804-828-4807 Don't be 
a phishing victim - VCU and other reputable organizations will never use email 
to request that you reply with your password, social security number or 
confidential personal information. For more details visit 
http://phishing.vcu.edu/


This message and any attachment is confidential and may be privileged or 
otherwise protected from disclosure. You should immediately delete the message 
if you are not the intended recipient. If you have received this email by 
mistake please delete it from your system; you should not copy the message 

Re: [EXTERNAL] Improving Replication performance

2018-04-27 Thread Rhodes, Richard L.
So the pools are on Isilon via NFS.  I assume the OS is Linux.

We've use DataDomain as a NFS target for file pools over 10G ethernet.  We've 
fought performance issues with this for years.  The AIX NFs stack is really 
bad/slow - about 100mb/s through a single mount point, and even then it varies 
all over the place.  Our admins have tested Linux to DD and it's better, but I 
don't remember the numbers.  It's not something we actually use with TSM.  Now, 
Oracle writing directly to DataDomain via NFS via Oracle's internal DNFS stack 
is fast - 600-700MB/s! The Oracle processing shows it's not the DD that's the 
bottleneck.

You might want to test NFS performance.  

Rick




-Original Message-
From: ADSM: Dist Stor Manager  On Behalf Of Zoltan Forray
Sent: Thursday, April 26, 2018 2:46 PM
To: ADSM-L@VM.MARIST.EDU
Subject: [EXTERNAL] Improving Replication performance

As we get deeper into Replication and my boss wants to use it more and more
as an offsite recovery platform.

As we try to reach "best practices" of replicating everything, we are
finding this desire to be difficult if not impossible to achieve due to the
resource demands.

Total we want to eventually replicate is around 700TB from 5-source servers
to 1-target server which is dedicated to replication.

So the big question is, can this be done?

We recently rebuilt the offsite target server to as big as we could afford
($38K).  It has 256GB of RAM.  64-threads of CPU. Storage is primarily
500TB of ISILON/NFS. Connectivity is via quad 10G (2-for IP traffic from
source servers and 2-for ISILON/NFS).

Yet we can only replicate around 3TB daily when we backup around 7TB.

Looking for suggestions/thoughts/experiences?

All boxes are RHEL Linux and 7.1.7.300

--
*Zoltan Forray*
Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator
Xymon Monitor Administrator
VMware Administrator
Virginia Commonwealth University
UCC/Office of Technology Services
www.ucc.vcu.edu
zfor...@vcu.edu - 804-828-4807
Don't be a phishing victim - VCU and other reputable organizations will
never use email to request that you reply with your password, social
security number or confidential personal information. For more details
visit http://phishing.vcu.edu/
--

The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Crashing TSM instances at 17:0x:xx

2018-04-21 Thread Rhodes, Richard L.
Hi Everyone . . .

Very strange things happening!

All TSM's are v7.1.5.

Friday, shortly after 17:00, two tsm instances crashed.
  tsm7 at 17:00:52
  tsmsap2 at 17:03:01

Saturday, shortly after 17:00, three instances crashed.
  tsm8 at 17:01:39
  tsm9 at 17:02:38
  tsm6 at 17:03:02

no core dump
nothing in the AIX errpt
the actlog just stops - no indication of any problem
  (although one instance handles storage agents and complained about com 
problems to them before dying)
next msgs in actlog is the startup msgs
all instances have been up for a long time, but not sure now long
they come back up just fine

Any thoughts are appreciated!
We will get a case opened with IBM, but thought I'd ask here also.


Thanks!

Rick




--

The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Docker

2018-04-19 Thread Rhodes, Richard L.
Hi,

Yesterday I was doing some TSM cleanup.  I found that we had >8000 orphaned 
filesystems for Linux clients that are all of a form like these:

("Days" is days since last backup)
TSM   Node  DaysFSID Filesystem
tsm2LITSMA4D100 633 
/opt/kubernetes/data/docker/devicemapper/mnt/8659aedb3538a83019159cdb3d00842a4ace85adcd102be4147fa75c0957be60
tsm2LITSMA4D100 634 
/opt/kubernetes/data/docker/devicemapper/mnt/4905b5fb2e596d39f08b6ffc4a8a884a329f98df0b16938b866c31708a7ebe55
tsm2LITSMA4D100 635 
/opt/kubernetes/data/docker/devicemapper/mnt/c40c9bec3b01f0b839778ea2fa06b6b1eb07d9657fe9b41d9d9ecdbded07df32
tsm2LITSMA5D100 707 
/opt/kubernetes/data/docker/devicemapper/mnt/fdf32a2dc0048f7b7e9727afecc94d96504632365da88f71cf6509bfd8b08166
tsm2LITSMA5D100 708 
/opt/kubernetes/data/docker/devicemapper/mnt/4e17d69255758d1a09f79ee2c9cff06e3c73a852d51d144d28018ebbce9a38dc
tsm2LITSMA5D100 709 
/opt/kubernetes/data/docker/devicemapper/mnt/d7b497e5ee74a180f3a2a99c33a2af4ef3dbb57cd02b62b1dfd5cc6544c557d7

I think this is from an installed application, and we have no inhouse knowledge 
about Docker.  My guess is that these are container filesystems that the dsmc 
client swept up

Questions:

Should these be backed up?
How would you exclude them since the filesystem name changes all the time?


Thanks!

Rick



--

The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Re: [EXTERNAL] v7.1.8/8.1.2 SSL Upgrade: Rethinking servers first or clients first

2018-03-02 Thread Rhodes, Richard L.
>Then once the operation of these clients was stabilized, upgrade 
>our 4 servers one at a time. As each server is upgraded, 
>the already-updated client would cause certificates to be 
>exchanged and that Admin ID to be switched to STRICT, which 
>would be OK since all of the client nodes where that Admin 
>ID might log in from would already be at V7.1.8/8.1.2+. 

Do your servers talk to each other?  

Our servers are all setup with server-to-server communications for a 
library sharing environment and moving node data between servers.  
Are there issues upgrading servers one at a time when the 
servers talk to each other?


Rick




-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of 
Deschner, Roger Douglas
Sent: Thursday, March 1, 2018 8:00 PM
To: ADSM-L@VM.MARIST.EDU
Subject: [EXTERNAL] v7.1.8/8.1.2 SSL Upgrade: Rethinking servers first or 
clients first

I've been using our test setup for further testing, and I'm thinking of 
reversing my strategy. I may want to upgrade clients first, and then servers.

The basic issue is still how to overcome the roadblock of having an 
Administrator ID automatically switched from TRANSITIONAL to STRICT upon first 
login from a 7.1.8/8.1.2+ dsmadmc client. IBM seems to think we can upgrade all 
servers and all clients to 7.1.8/8.1.2+ simultaneously. That is not practical.

In the worst case, this automatic switching could cause the System 
Administrator's worst nightmare - to lose control over a running system. 

I am still considering the (very ugly) bypass of an administrative schedule 
that sets it back to TRANSITIONAL for all Admin IDs every 5 minutes. There will 
still be some failures.

But I am also considering reversing the strategy I had considered earlier, to a 
different strategy of upgrading all of the clients involved (about 7 of them, I 
think, but I'm not sure) to 7.1.8 or 8.1.4 first, while the servers are all 
still running older versions. So far, everything would be working.

Then doublecheck that there are not any left behind by scanning activity logs, 
the summary file, etc. 

Then once the operation of these clients was stabilized, upgrade our 4 servers 
one at a time. As each server is upgraded, the already-updated client would 
cause certificates to be exchanged and that Admin ID to be switched to STRICT, 
which would be OK since all of the client nodes where that Admin ID might log 
in from would already be at V7.1.8/8.1.2+. (At least we hope. This may expose 
those we forgot.)

Unless I'm overlooking something big here, I think this would allow us to 
upgrade each client and each server independently, and iron out any issues one 
at a time. Any comments on this client-first strategy?

Roger Deschner
University of Illinois at Chicago
"I have not lost my mind; it is backed up on tape somewhere."
--

The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Re: [EXTERNAL] Re: How to backup ISILON storage

2018-02-08 Thread Rhodes, Richard L.
> I would seriously look into some form of async replication native to ISILON, 
> something like netapp's snapvault, first.

We are just just finishing the first phase of implementing a Isilon NAS, which 
consolidated dozens of Windows servers.  One of the reasons (by no means all of 
them) of going to the NAS was backups and getting out from under TSM.  We setup 
to use Isilon SyncIQ (replication) and SnapIQ (snapshots) for backups. So far 
it's worked very well.  These features cost $$$ in terms of licensing, disk 
space and network bandwidth. Besides getting the money, the snapshots require 
you to guestimate the change rate and retention of your data.  
Right-click-restore-previous-version is wonderful!

We also have a document management system that has multiple databases with 
corresponding CIFS shares.  Originally the CIFS shares were just Win servers.  
We used TSM to back it all up.  Again, it hit TSM right at its worst - many 
millions of little files. We were struggling to get 1 good backup of the CIFS 
shares per day.  When the user required 4 backups per day (and other reasons), 
we converted the whole thing to NetApp NAS/SAN and used snapshots and 
replication for backups and DR.



Rick






-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Remco 
Post
Sent: Thursday, February 8, 2018 4:17 AM
To: ADSM-L@VM.MARIST.EDU
Subject: [EXTERNAL] Re: How to backup ISILON storage

> On 7 Feb 2018, at 21:26, Zoltan Forray  wrote:
> 
> As you recall, we have been trying to figure out an alternative method to
> backing up DFS mounted ISILON storage since the current method of 80+
> separate nodes accessed via the Web interface of the BA client is going
> away.  Plus the backups are taking soo long, we have to determine a
> better way.
> 
> So, doing some digging, one solution that seems to be touted is using
> NDMP.
> 
> We have absolutely zero experience with NDMP  and are looking for some
> guidance / cookbook / real-world experiences on how we would use NDMP to
> backup ISILON storage (>400TB and hundreds of millions of files) and make
> it accessible so someone from a help-desk like environment could handle
> file-level restores!

I don’t like TSM NDMP one bit, and I guess it’s no worse than any of the other 
backup vendors’ implementations, because NDMP is just what it is, and that is 
not much. I would seriously look into some form of async replication native to 
ISILON, something like netapp's snapvault, first. Yes that requires a a huge 
pile of disk just for backup, but it will probably be worth it. Even if the 
investment is quite high. Don’t forget with TSM terabyte licenses you’ll be 
paying a lot (a huge lot!) to IBM for your NDMP backups.

You can basically NDMP via LAN and via SAN. The latter has the disadvantage 
that the TSM server running the backups must be the library manager for those 
tape drives. I would have loved to see that IBM would make NDMP and Library 
Managers play nice, but alas… NDMP via LAN allows you to use normal disk and 
tape based storage pools, via SAN you’ll need to create a separate tape pool in 
the right format (ndmpdump). Also, you can’t run copy storage pool on those is 
you use SAN. On 8.1.2 and higher (if you dare go there) you could even use 
directory containers.

The current customer has NAS systems which share directories (called virtual 
volumes) rather than separate file systems. To be able to make a more granular 
backup/restore they use virtualfsmappings in TSM. This works surprisingly well. 
Now a huge NAS file system becomes (usually) a far more manageable directory. 
So not 200 TB in one huge lump to backup, but mostly directories of under 1 TB. 
The backups are slow, but on average manageable. We have a few exceptions that 
we backup via the share because they are just too big to manage via NDMP. 
Problem with NDMP is that if (with TSM 8.1) a single transaction spans more 
than 90% of the active log, the transaction gets killed by TSM. This is on 
average a good thing, but that makes the combination of a busy TSM server with 
loads of files and NDMP not a happy one, at least not for those few huge 
virtual volumes.

So basically:

- look at other solutions (snapvault or whatever it’s called for your NAS)
- then again look at those solutions
- virtualfsmappings might make things more manageable if you decide to go with 
TSM anyway
- SAN and LAN both have disadvantages, neither one is perfect
- maybe a dedicated TSM instance to avoid issues with long running ndmp dumps

> 
> Or if NDMP is the wrong direction, please tell us so.
> --
> *Zoltan Forray*
> Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator
> Xymon Monitor Administrator
> VMware Administrator
> Virginia Commonwealth University
> UCC/Office of Technology Services
> www.ucc.vcu.edu
> zfor...@vcu.edu - 804-828-4807
> Don't be a phishing victim - VCU and other reputable organizations will
> never use email 

Re: rebinding objects for API client archives

2017-09-20 Thread Rhodes, Richard L.
I think I'm confused (not unusual!).

Rebinding is CHANGING the MgtClass an object is bound to, NOT changing the 
policies within a MgtClass.

If we just change the policies of the MgtClass to retain the archive for 12 
years, that WILL work.  What WON'T work is creating a NEW MgtClass with 12 year 
retention and trying to rebind to that.

The Archive table in db2 has CLASS_NAME, that's what can't change.  But the 
policies in the CLASS_NAME can change.

Of course, changing the policies effect everyone using that MgtClass, but we 
can live with that . . . . I think.


Ok, is that right?


Thanks!

Rick





-Original Message-
From: Rhodes, Richard L. 
Sent: Wednesday, September 20, 2017 8:19 AM
To: ADSM-L@VM.MARIST.EDU
Cc: Ake, Elizabeth K. <a...@firstenergycorp.com>
Subject: rebinding objects for API client archives

We have a TSM instance that is dedicated to "applications".  These are 
applications that use the API client to store some kind of object in TSM.  An 
example is IBM Content Manager.  Nodes are in domains with a default Mgt Class 
with 7 years retention, and store their data as Archives, although one 
application uses Backups.  

We received a legal hold request to keep some of this data for 12 years.

It's my understanding that you cannot rebind archive data.  That is, changing 
the MgtClass will do nothing to keep this data longer.  

Do we have to change the Mgt Class and have the users retrieve/re-archive the 
data?


Is this correct?  Thoughts?

Thoughts?

Rick
--

The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


rebinding objects for API client archives

2017-09-20 Thread Rhodes, Richard L.
We have a TSM instance that is dedicated to "applications".  These are 
applications that use the API client to store some kind of object in TSM.  An 
example is IBM Content Manager.  Nodes are in domains with a default Mgt Class 
with 7 years retention, and store their data as Archives, although one 
application uses Backups.  

We received a legal hold request to keep some of this data for 12 years.

It's my understanding that you cannot rebind archive data.  That is, changing 
the MgtClass will do nothing to keep this data longer.  

Do we have to change the Mgt Class and have the users retrieve/re-archive the 
data?


Is this correct?  Thoughts?

Thoughts?

Rick
--

The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Re: *EXTERNAL* Re: Spectrum Protect for VE - how to get started

2017-09-07 Thread Rhodes, Richard L.
I did read about this announcement.  We are setting up a meeting with local IBM 
folks around VE.  When we talked with him he immediately mentioned this new 
product.  The IBM storage blogger Tony Pearson made it sound like this new 
product is a low end and simpler tool to backup VM's.  I guess the real 
question is whether this new product is a long term replacement for VE.  
Another issue is whether this new product will fall under our capacity license, 
which VE does.  

Rick



-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Stefan 
Folkerts
Sent: Monday, September 4, 2017 5:58 AM
To: ADSM-L@VM.MARIST.EDU
Subject: *EXTERNAL* Re: Spectrum Protect for VE - how to get started

Eric,

Yes, I've seen that information, I'm not saying it can't integrate, I'm
saying that if you have Spectrum Protect running for an enterprise
environment that I wouldn't wait for Spectrum Protect Plus before
implementing Virtual Environments based on what I know. Based on what I
know it seems easier to deploy and is based on a totally different server
and storage architecture, we shouldn't expect things from it that aren't
document just because it shares the Spectrum Protect name.

It seems spectrum Protect Plus has it's own storage solution but can
*also *send
the data to Spectrum Protect.
We don't know much about application support within VM's other technical
requirements or limitations.
It's not Spectrum Protect as we know it so I'm careful advising somebody
about it until more information becomes available.
I'm not saying it's not a better solution for Rick, I'm saying that we know
too little to say that it might be. :-)




On Mon, Sep 4, 2017 at 10:50 AM, Loon, Eric van (ITOPT3) - KLM <
eric-van.l...@klm.com> wrote:

> Hi Stefan,
> From what I have been reading SP Plus will be a software appliance,
> delivered as an OVA file, which can be used as a stand-alone solution, but
> which also should fit into an existing TSM/SP environment. From
> https://www.ibm.com/us-en/marketplace/ibm-spectrum-protect-plus: "It can
> be implemented as a stand-alone solution or integrate with your IBM
> Spectrum Protect environment to off-load copies for long term storage and
> data governance with scale and efficiency".
> Kind regards,
> Eric van Loon
> Air France/KLM Storage Engineering
>
> -Original Message-
> From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of
> Stefan Folkerts
> Sent: zondag 3 september 2017 8:04
> To: ADSM-L@VM.MARIST.EDU
> Subject: Re: Spectrum Protect for VE - how to get started
>
> Steve,
>
> I don't think you should look at Spectrum Protect Plus as an improved
> Spectrum Protect.
> It's a totally different solution for a, for the most part, different
> environment.
> Spectrum Protect is an enterprise class catch-all backup & recovery
> solution, Spectrum Protect Plus looks more to me like an entry-level
> vSphere/Hyper-V point solution.
>
> That doesn't mean it doesn't have its place in the market, it does, but
> that does mean that if you have a Spectrum Protect solution in place it
> would seem a bit silly maybe, but then again, there are very few details
> released at this point.
>
>
>
> On Sat, Sep 2, 2017 at 6:59 PM, Schaub, Steve <steve_sch...@bcbst.com>
> wrote:
>
> > Just got back from VMWorld where IBM announced their new & improved SP
> > product, I would hold off until you can check it out, much easier to
> > deploy & manage.
> >
> > -Original Message-
> > From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf
> > Of Stefan Folkerts
> > Sent: Thursday, August 31, 2017 1:06 PM
> > To: ADSM-L@VM.MARIST.EDU
> > Subject: Re: [ADSM-L] Spectrum Protect for VE - how to get started
> >
> > Rick,
> >
> > I would run the 8.1.1 VE version if your vSphere stack supports it,
> > the biggest improvements in my eyes above the 7.1 version are the
> > restore performance that can go 5x in the right configuration (in my
> > experience) and the tagging support (if you vShpere folder structure
> > will work with it, but if not, you can always go for the classic
> scheduling method.
> > The improved restore performance of 8.1.0+ has proven very important
> > and it was good it came when it did because in previous versions it
> > became a pretty big issue.
> > 8.1+ VE on a 7.1 server should not be a problem in my experience.
> >
> >
> > On Thu, Aug 31, 2017 at 5:52 PM, Ehresman,David E. <
> > david.ehres...@louisville.edu> wrote:
> >
> > > It's been reported here that the restore time in the v8.1 CLIENT is
> > > much improved over v7 so I would recommend that one for the client.
> >

Re: *EXTERNAL* Re: TSM clients with 1 and 10 GB adapters

2017-08-31 Thread Rhodes, Richard L.
I'm in no way even close to understanding networking, that said, I've have 
fought some issues with this kind of setup.

On the client you may need to specify a route to get the client to send over 
the 10g adapter.  Some duel homed unix systems will default to sending out the 
adapter with the lowest IP address (FreeBSD in a DataDomain does this, cough, 
cough). The solution was to specify a route so the client system knows what 
adapter to use to reach a particular IP addr.  

I've also had backup "loops" where the a client system would send packets on 
one adapter to the TSM server, while packets from the TSM server would come in 
on the clients other adapter.  This was a long time ago and I don't remember 
what we did to fix it, but I think routes came into it again.


Rick




-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of 
Schneider, Jim
Sent: Thursday, August 31, 2017 2:16 PM
To: ADSM-L@VM.MARIST.EDU
Subject: *EXTERNAL* Re: TSM clients with 1 and 10 GB adapters

If you have a distinct IP for the 10 Gb connection you can use that name/IP 
address in the client's TCPServeraddress value in the dsm.opt or dsm.sys file.  
Use 'q n f=d' to verify that the IP is being used.

Jim Schneider
Essendant

-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Loon, 
Eric van (ITOPT3) - KLM
Sent: Thursday, August 31, 2017 9:47 AM
To: ADSM-L@VM.MARIST.EDU
Subject: [ADSM-L] TSM clients with 1 and 10 GB adapters

Hi guys!
I have tested in the past with 10 Gb attached Linux clients and everything 
worked fine, but now we will add a 10 Gb card to a host which is already 
connected to 1 Gb. So this host has two possible paths to the server. How can I 
make sure the TSM client uses the 10 Gb adapter only? I read something about 
the TCPClientAddress parameter, but according to the manual that is only for 
the server to the client (restore), not for the client to the server (backup).
Thanks for your help in advance!
Kind regards,
Eric van Loon
Air France/KLM Storage Engineering


For information, services and offers, please visit our web site: 
https://secure-web.cisco.com/1OWZzEqZRsUIHuSBytNQh4PDMEZAWCizb1y9XMoxv9eikN-MbMpF9YDWWSzJ1qRttbpnOU-RbqrDvNJ6kyWmPgw4KGbTOZKBjhOeu3OvNj_mIjnTN_Aiz9FpXbKXEEsPclx-gIC0Hpbx-DbZ4R9_OntH7uDTqfr-mIqWekaNofEW04jVkuOYz2wCe_QFyVezdwhoom9vw0nDg6A6rRJHjyHgb8rs-CX8eRDMjixabYWjmgRh689Sed7geptHwMoLIkMZtBY7DplkM-2cYUZ2IWXF4VMdKaZ7I3IoXS38EDLYbAsRLBXWkiZS8q9H-ij5dBkPG8yC3CNg1l6yIUfG4r99R9iVG_sRw35beG2dRBVAYhorFT6u2NzFoHHgw4rlUH8z_M-rpND8DLWcKxJfZfg/https%3A%2F%2Furldefense.proofpoint.com%2Fv2%2Furl%3Fu%3Dhttp-3A__www.klm.com%26d%3DDwIFAg%26c%3DMqzcmAKsw3j3xTQl5efyrz6ChwH9_xFQsqxq8hPjflw%26r%3DoC06_8Fv3bsc_6MYFkLOVjvWvgE-JVnMc6qtesQ14R0%26m%3DW2Q4IqLOWmny4BVBBlNjMUj0vnsQI9AsE2MQxO0guzI%26s%3Dg8rvtWyUJAQIDX_yO4BbpuwFXnMHpKToy9fATnlFmQg%26e%3D
 . This e-mail and any attachment may contain confidential and privileged 
material intended for the addressee only. If you are not the addressee, you are 
notified that no part of the e-mail or any attachment may be disclosed, copied 
or distributed, and that any other action related to this e-mail or attachment 
is strictly prohibited, and may be unlawful. If you have received this e-mail 
by error, please notify the sender immediately by return e-mail, and delete 
this message.

Koninklijke Luchtvaart Maatschappij NV (KLM), its subsidiaries and/or its 
employees shall not be liable for the incorrect or incomplete transmission of 
this e-mail or any attachments, nor responsible for any delay in receipt.
Koninklijke Luchtvaart Maatschappij N.V. (also known as KLM Royal Dutch 
Airlines) is registered in Amstelveen, The Netherlands, with registered number 
33014286


**
Information contained in this e-mail message and in any attachments thereto is 
confidential. If you are not the intended recipient, please destroy this 
message, delete any copies held on your systems, notify the sender immediately, 
and refrain from using or disclosing all or any part of its content to any 
other person.

--

The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Spectrum Protect for VE - how to get started

2017-08-31 Thread Rhodes, Richard L.
Hello,

Up till now we have used BA clients in VM's.  We would like to look into 
implementing VE.  I would appreciate any wisdom on bringing it up first time.  
A specific question would be which version.  Our current TSM servers are 
v7.1.5, but I'm wondering if bringing up a v8.1 server and VE would be best.


Rick


--

The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Oracle archive log backups and resourceutilization

2017-02-22 Thread Rhodes, Richard L.
Our DBA's have scripts that backup their Oracle archive logs.
It causes us pain.

(AIX 7.1 with BA clients 6.4 and up)

Their scripts run from cron every few minutes.
If it finds archive logs, it processes as below:

  For each archive log (individual log file)
run dsmc on the log file
check dsmc output for whether it worked or failed
delete the log file if backup worked

So they process the log files one at a time on separate dsmc cmds.

Now, if there are a bunch of files (30, 40, 100, or multiple 100's), it kicks 
into high
gear and runs up to 8 dsmc cmds in parallel.

What I'd like to know is, if they were to put all
the log file names into a filelist, and run ONE dsmc cmd
specifying the filelist along with -resourceutilization=10,
will dsmc parallel some number of files concurrently back to
the TSM server?


The DBA's really, really want to get the archive logs
off the server and into TSM ASAP!  We have big Oracle
servers that do several thousand TSM session per day
with this processing.


Note:  all log files are in the same filesystem



-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Re: *EXTERNAL* Re: Multiple NFS mounts to same DataDomain

2017-02-14 Thread Rhodes, Richard L.
I see.

You can remove the dir from the devclass, but TSM will still access existing 
volumes on that dir.  And then a procedure to movedata them.

My assumption was that you wouldn't be able to remove the dir from the devclass 
until while there were vols on it, and I couldn't think of how to get rid of 
the vols on the dir since it was in use.

Great Info!

Thanks!

Rick



-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Thomas 
Denier
Sent: Tuesday, February 14, 2017 11:47 AM
To: ADSM-L@VM.MARIST.EDU
Subject: *EXTERNAL* Re: Multiple NFS mounts to same DataDomain

I have successfully removed directories from file device classes a number of 
times. The sequence of events was as follows:
1.Remove the directory from the list in the device class definition to prevent 
allocation of new scratch volumes on the directory.
2.List filling volumes on the directory and make them read only, preventing 
appends to existing volumes on the directory.
3.Run "move data" commands to relocate the contents of volumes to other 
directories.
4.Wait for database backups and pending volumes to age off.

The Linux administrator thought step 3 would have better overall throughput 
with multiple streams of "move data" commands. I used the "-P" option of 
"xargs" to manage the multiple streams.

Thomas Denier,
Thomas Jefferson University

-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of 
Rhodes, Richard L.
Sent: Tuesday, February 14, 2017 08:35
To: ADSM-L@VM.MARIST.EDU
Subject: [ADSM-L] Multiple NFS mounts to same DataDomain

Arnaud's discussion on the another thread is SO interesting (Availability for 
Spectrum Protect 8.1 server software for Linux on power system).

It got me thinking of our problems . . .

> NFS, whose performance is not that good on AIX systems

Agreed!!!  After getting DataDomain system and using NFS we were/are VERY 
unhappy with the NFS performance.

Our Unix admins worked with IBM/AIX support, and finally got an admission that 
the problem is AIX/NFS using a single TCP socket for all writes.  The 
workaround was to use multiple mount point to the same NFS share and spread  
writes (somehow) across them.  He did this and got higher throughput.

So now I'm wondering if we could use multiple NFS mounts to the same DD for our 
file device pools.

  aix:  /DD/tsm1/mnt1dd: /data/col1/tsm1/mnt1
/DD/tsm1/mnt2/data/col1/tsm1/mnt2
/DD/tsm1/mnt3/data/col1/tsm1/mnt2

Then use multiple dir's for the file device devclass:
   define devclass DDFILEDEV devtype=file 
dir=/DD/tsm1/mnt1,/DD/tsm1/mnt2,/DD/tsm1/mnt3

According to the link to dsmISI again, TSM will roughly balance across the 
multiple mount points, hopefully giving better write throughput.  I've been 
VERY reluctant to try this since it appears once you add a dir to a file device 
devclass, it's there forever!


I'm curious if anyone is doing this.

Rick
The information contained in this transmission contains privileged and 
confidential information. It is intended only for the use of the person named 
above. If you are not the intended recipient, you are hereby notified that any 
review, dissemination, distribution or duplication of this communication is 
strictly prohibited. If you are not the intended recipient, please contact the 
sender by reply email and destroy all copies of the original message.

CAUTION: Intended recipients should NOT use email communication for emergent or 
urgent health care matters.



-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Multiple NFS mounts to same DataDomain

2017-02-14 Thread Rhodes, Richard L.
Arnaud's discussion on the another thread is SO interesting (Availability for 
Spectrum Protect 8.1 server software for Linux on power system).

It got me thinking of our problems . . . 

> NFS, whose performance is not that good on AIX systems

Agreed!!!  After getting DataDomain system and using NFS we were/are VERY 
unhappy with the NFS performance.  

Our Unix admins worked with IBM/AIX support, and finally got an admission that 
the problem is AIX/NFS using a single TCP socket for all writes.  The 
workaround was to use multiple mount point to the same NFS share and spread  
writes (somehow) across them.  He did this and got higher throughput.   

So now I'm wondering if we could use multiple NFS mounts to the same DD for our 
file device pools.

  aix:  /DD/tsm1/mnt1dd: /data/col1/tsm1/mnt1
/DD/tsm1/mnt2/data/col1/tsm1/mnt2
/DD/tsm1/mnt3/data/col1/tsm1/mnt2

Then use multiple dir's for the file device devclass:  
   define devclass DDFILEDEV devtype=file 
dir=/DD/tsm1/mnt1,/DD/tsm1/mnt2,/DD/tsm1/mnt3

According to the link to dsmISI again, TSM will roughly balance across the 
multiple mount points, hopefully giving better write throughput.  I've been 
VERY reluctant to try this since it appears once you add a dir to a file device 
devclass, it's there forever! 


I'm curious if anyone is doing this.

Rick



 

-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of PAC 
Brion Arnaud
Sent: Tuesday, February 14, 2017 5:57 AM
To: ADSM-L@VM.MARIST.EDU
Subject: *EXTERNAL* Re: Availability for Spectrum Protect 8.1 server software 
for Linux on power system

Hi Zoltan,

Many reasons for it, which I'll try to shortly summarize :

1) Isilon makes use of NFS, whose performance is not that good on AIX systems. 
We are an AIX shop, and are forced to move to Power Linux machines to get 
sufficient performance to cover our backup needs.
Our first experience with Power Linux machines revealed serious lacks in the 
functionalities we are accustomed to : no easy HMC setup, thus lack of call 
home capabilities so far. In addition to this we needed to setup a RedHat 
satellite server to allow for installation on remote servers, and so far are 
unable to boot our machines from it ... This will probably work sooner or 
later, but requires lots of involvement and time from our sys-admins.

2) Isilon is not perfectly fitting in a big TSM environment. In order to get 
decent performance, a third party tool will be needed, whose name is dsmISI. 
See following : 
http://stefanradtke.blogspot.ch/2015/06/how-to-optimize-tsm-operations-with.html
 This means another layer of complexity in the setup, and another vendor to 
talk to, if facing performance issues. I had more than my lot of "ping-pong" 
games during my career as TSM administrator, between IBM and other vendors, to 
reject the responsibility on each other in case of issues. Having 3 parties 
involved in our setup will make such games even more frequent ...

3) User base for such a combination in Switzerland is inexistent, at least in 
the same order of size than ours. EMC has not been able to provide any customer 
reference in this country, with whom we could talk to about their setup. There 
must be a good reason for it ...

4) Compatibility issues : this was more kind of a guts feeling I had, but as 
usually, it revealed to be true : see the problems I will now be facing with 
Little/Big endian versions of TSM/Spectrum Protect (without to mention that 
Spectrum Protect 8.1 is not even available for Power Linux so far). I'm 
currently facing another one : the Isilon we got is running OneFS 8, and 
there's so far no official statement that it is supported, whether by TSM or by 
dsmISI. A downgrade to OneFS 7.x revealed to be impossible, due to the fact 
that the 8 TB disks installed in the machine are not supporting it ...

5) Support by EMC : revealed to be less efficient than the one offered by IBM. 
Since EMC merged with Dell, it became even worse (for a non-native English 
speaking person, having a call with support based in India is a nightmare). 
Also our storage administrator informed me that from his experience, upgrade 
procedures on EMC devices where much more complicated than the ones for IBM 
hardware, and almost always required intervention of the vendor to be conducted 
properly (lots of dependencies in microcodes, switch versions and so on ...)

6) Costs ...

Of course, your mileage may vary, but in our case I'm pretty sure that 
management made the wrong choice (I would have gone IBM Spectrum Scale in 
conjunction with an AIX based server : one vendor, blueprints provided, and 
guaranteed performance).

Cheers.

Arnaud


-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Zoltan 
Forray
Sent: Monday, February 13, 2017 4:38 PM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: Availability for Spectrum Protect 8.1 server 

AIX BAclient hung spinning cpu

2017-02-07 Thread Rhodes, Richard L.
AIX TSM server 7.1.5
AIX BA client 7.1.6 on AIX 7100-03

One of our servers is having the BA client hang.
They are doing a Oracle archive backup:
   /usr/bin/dsmc incremental -subdir=yes -se=oracle-bkup //arch_.log

They process the archive logs individually - one dsmc per log  file, then 
delete the archive log after a good backup.  

Every couple of days a dsmc will hang.  The TSM server shows the session 
started and in idleW state.  On the client the dsmc is running one processor 
mostly flat out.  There is nothing in dsmerror.log.  The dsminstr.log shows the 
process starting, but nothing else.

I googled and searched IBM, but not finding anything.

We just added -enableinstrumation=yes to the cmd to see if that gives any 
better info.


Any thought are welcome!

Rick




-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Re: *EXTERNAL* Re: internal server error detected

2017-01-31 Thread Rhodes, Richard L.
When I've had bad tape problems, sometimes I've deleted all the tape devices 
out if the os (AIX in our case) and re-created them.  I've found that sometimes 
the Atape driver can mask san problems, and they show up on a discover scan 
(cfgmgr in AIX).

Rick



-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Loon, 
Eric van (ITOPT3) - KLM
Sent: Tuesday, January 31, 2017 9:48 AM
To: ADSM-L@VM.MARIST.EDU
Subject: *EXTERNAL* Re: internal server error detected

Hi Sasa (and all others who responded)!
The issue seems to be on the Storage Agent side, all other clients and the 
server itself operate normally. So no errors are seen in the DB2 log.
The STA was stopped and started, but to no avail. Everything was working fine 
on this client until this morning...
On the server all drives and paths are online. The paths defined for the STA 
are also online. We have 1300 scratch tapes available in the library... I'm 
lost.
Kind regards,
Eric van Loon
Air France/KLM Storage Engineering

-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Sasa 
Drnjevic
Sent: dinsdag 31 januari 2017 14:03
To: ADSM-L@VM.MARIST.EDU
Subject: Re: internal server error detected

This log is almost always helpful:

/home/instance_owner/sqllib/db2dump/db2diag.0.log

Or it could be rotated into db2diag.n.log in the same directory.

Regards,

--
Sasa Drnjevic
www.srce.unizg.hr




On 31.1.2017. 13:56, Loon, Eric van (ITOPT3) - KLM wrote:
> Hi guys!
> I have an Oracle client which backup failed with the following error in the 
> tdpoerror.log:
>
> 01/31/2017 09:08:35 ANS0278S The transaction will be aborted.
> 01/31/2017 09:08:35 ANS0278S The transaction will be aborted.
> 01/31/2017 09:08:35 TID<19506> ==> ANS0278S (RC157)  The transaction will be 
> aborted.
> 01/31/2017 09:08:35 ANS1312E Server media mount not possible
> 01/31/2017 09:08:35 ANS1312E Server media mount not possible
> 1/31/2017 09:08:35 TID<19506> ==> ANS1312E (RC12)   Server media mount not 
> possible
>
> The TSM server shows the following error:
>
> 01/31/2017 09:08:32 ANR0530W Transaction failed for session 9302740 for node 
> QVIPNBDORA01_02-ORC (TDPO Linux86-64) - internal server error detected. 
> (SESSION: 9302740)
> 01/31/2017 09:08:35 ANR0525W (Session: 7358241, Origin: QVIPNBDORA01)  
> Transaction failed for session 277695 for node QVIPNBDORA01_02-ORC (TDPO 
> Linux86-64) - storage media inaccessible. (SESSION: 7358241)
>
> The Oracle client is backing up through a storage agent and the 'internal 
> server error' seems to cause the scratch tape mount to fail which results in 
> the 'storage media inaccessible' message. Does anybody have an idea where to 
> look for the cause of the 'internal server error'?
> Thanks for any help in advance!
> Kind regards,
> Eric van Loon
> Air France/KLM Storage Engineering
> 
> For information, services and offers, please visit our web site: 
> http://www.klm.com. This e-mail and any attachment may contain confidential 
> and privileged material intended for the addressee only. If you are not the 
> addressee, you are notified that no part of the e-mail or any attachment may 
> be disclosed, copied or distributed, and that any other action related to 
> this e-mail or attachment is strictly prohibited, and may be unlawful. If you 
> have received this e-mail by error, please notify the sender immediately by 
> return e-mail, and delete this message.
>
> Koninklijke Luchtvaart Maatschappij NV (KLM), its subsidiaries and/or its 
> employees shall not be liable for the incorrect or incomplete transmission of 
> this e-mail or any attachments, nor responsible for any delay in receipt.
> Koninklijke Luchtvaart Maatschappij N.V. (also known as KLM Royal Dutch 
> Airlines) is registered in Amstelveen, The Netherlands, with registered 
> number 33014286
> 
>

For information, services and offers, please visit our web site: 
http://www.klm.com. This e-mail and any attachment may contain confidential and 
privileged material intended for the addressee only. If you are not the 
addressee, you are notified that no part of the e-mail or any attachment may be 
disclosed, copied or distributed, and that any other action related to this 
e-mail or attachment is strictly prohibited, and may be unlawful. If you have 
received this e-mail by error, please notify the sender immediately by return 
e-mail, and delete this message. 

Koninklijke Luchtvaart Maatschappij NV (KLM), its subsidiaries and/or its 
employees shall not be liable for the incorrect or incomplete transmission of 
this e-mail or any attachments, nor responsible for any delay in receipt. 
Koninklijke Luchtvaart Maatschappij N.V. (also known as KLM Royal Dutch 
Airlines) is registered in Amstelveen, The Netherlands, with 

Re: *EXTERNAL* Re: internal server error detected

2017-01-31 Thread Rhodes, Richard L.
Also check that the paths for the library manager and storage agent line up to 
the same drives.  

Rick



-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Efim
Sent: Tuesday, January 31, 2017 8:17 AM
To: ADSM-L@VM.MARIST.EDU
Subject: *EXTERNAL* Re: internal server error detected

Hi,
1. check that all drives and the paths are defined and online.
q drive
q path

2. if all is online check drives serial numbers and names in the paths (if you 
don't use persistent naming  for drives)

Efim


> 31 янв. 2017 г., в 15:56, Loon, Eric van (ITOPT3) - KLM 
>  написал(а):
> 
> Hi guys!
> I have an Oracle client which backup failed with the following error in the 
> tdpoerror.log:
> 
> 01/31/2017 09:08:35 ANS0278S The transaction will be aborted.
> 01/31/2017 09:08:35 ANS0278S The transaction will be aborted.
> 01/31/2017 09:08:35 TID<19506> ==> ANS0278S (RC157)  The transaction will be 
> aborted.
> 01/31/2017 09:08:35 ANS1312E Server media mount not possible
> 01/31/2017 09:08:35 ANS1312E Server media mount not possible
> 1/31/2017 09:08:35 TID<19506> ==> ANS1312E (RC12)   Server media mount not 
> possible
> 
> The TSM server shows the following error:
> 
> 01/31/2017 09:08:32 ANR0530W Transaction failed for session 9302740 for node 
> QVIPNBDORA01_02-ORC (TDPO Linux86-64) - internal server error detected. 
> (SESSION: 9302740)
> 01/31/2017 09:08:35 ANR0525W (Session: 7358241, Origin: QVIPNBDORA01)  
> Transaction failed for session 277695 for node QVIPNBDORA01_02-ORC (TDPO 
> Linux86-64) - storage media inaccessible. (SESSION: 7358241)
> 
> The Oracle client is backing up through a storage agent and the 'internal 
> server error' seems to cause the scratch tape mount to fail which results in 
> the 'storage media inaccessible' message. Does anybody have an idea where to 
> look for the cause of the 'internal server error'?
> Thanks for any help in advance!
> Kind regards,
> Eric van Loon
> Air France/KLM Storage Engineering
> 
> For information, services and offers, please visit our web site: 
> http://www.klm.com. This e-mail and any attachment may contain confidential 
> and privileged material intended for the addressee only. If you are not the 
> addressee, you are notified that no part of the e-mail or any attachment may 
> be disclosed, copied or distributed, and that any other action related to 
> this e-mail or attachment is strictly prohibited, and may be unlawful. If you 
> have received this e-mail by error, please notify the sender immediately by 
> return e-mail, and delete this message.
> 
> Koninklijke Luchtvaart Maatschappij NV (KLM), its subsidiaries and/or its 
> employees shall not be liable for the incorrect or incomplete transmission of 
> this e-mail or any attachments, nor responsible for any delay in receipt.
> Koninklijke Luchtvaart Maatschappij N.V. (also known as KLM Royal Dutch 
> Airlines) is registered in Amstelveen, The Netherlands, with registered 
> number 33014286
> 


-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Re: *EXTERNAL* Re: client restore got ANS4035W - files unavailable

2017-01-13 Thread Rhodes, Richard L.
Yea, it is.

I should have said:  client=6.2.5 server=7.1.5

I upgraded the client to v7.1.6 and the problem went away.

I'll look into the apars ya'll have mentioned.

Rick



-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of 
Billaudeau, Pierre
Sent: Friday, January 13, 2017 9:28 AM
To: ADSM-L@VM.MARIST.EDU
Subject: *EXTERNAL* Re: client restore got ANS4035W - files unavailable

Hi Rick,
This could be caused by a client-server version problem :
http://www-01.ibm.com/support/docview.wss?uid=swg1IT15117

Pierre Billaudeau
Administrateur de stockage
Livraison des infra serveurs




-Message d'origine-
De : ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] De la part de 
Rhodes, Richard L.
Envoyé : 13 janvier 2017 09:17
À : ADSM-L@VM.MARIST.EDU
Objet : [ADSM-L] client restore got ANS4035W - files unavailable

Hi,

Last night a DBA tried to do a restore of some files.  He get returned

  01/12/17   22:01:07 ANS4035W File 'xxx' currently unavailable on server.

The client data is on tape.
The tape drives and library are handled by a separate dedicated library manager 
instance.

I see:
  on tsm server
 the client restore session
 the sessions to the library mgr instance (I think)
  on lib mgr
 the session which I believe would be for the mount (I think)  on tsm server
 ANS4025 errors for all files for the restore

Nowhere is there any indication of WHY the files are unavailable.
Nowhere is there any indication of what volume(s) were trying to be used.

I checked:
  there were tape drives free in the library
  all tape volumes are read/write or read-only
  no tape errors or hdwr errors


Q)  Any thoughts on why the files would be unavailable?
Q)  How can you tell specific volumes are needed for a client restore?

The only thing I can think of is that the volumes are unavailable, but I can't 
figure out what volumes it wanted to use.

Rick



-The information contained in this 
message is intended only for the personal and confidential use of the 
recipient(s) named above. If the reader of this message is not the intended 
recipient or an agent responsible for delivering it to the intended recipient, 
you are hereby notified that you have received this document in error and that 
any review, dissemination, distribution, or copying of this message is strictly 
prohibited. If you have received this communication in error, please notify us 
immediately, and delete the original message.

--


Information confidentielle : Le présent message, ainsi que tout fichier qui y 
est joint, est envoyé à l'intention exclusive de son ou de ses destinataires; 
il est de nature confidentielle et peut constituer une information privilégiée. 
Nous avertissons toute personne autre que le destinataire prévu que tout 
examen, réacheminement, impression, copie, distribution ou autre utilisation de 
ce message et de tout fichier qui y est joint est strictement interdit, à moins 
d'avoir obtenu le consentement du destinataire. Si vous n'êtes pas le 
destinataire prévu, veuillez en aviser immédiatement l'expéditeur par retour de 
courriel et supprimer ce message et tout document joint de votre système. Merci.


-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


client restore got ANS4035W - files unavailable

2017-01-13 Thread Rhodes, Richard L.
Hi,

Last night a DBA tried to do a restore of some files.  He get returned

  01/12/17   22:01:07 ANS4035W File 'xxx' currently unavailable on server.

The client data is on tape.
The tape drives and library are handled by a separate dedicated library manager 
instance.

I see:
  on tsm server
 the client restore session
 the sessions to the library mgr instance (I think)
  on lib mgr
 the session which I believe would be for the mount (I think)
 on tsm server
 ANS4025 errors for all files for the restore

Nowhere is there any indication of WHY the files are unavailable.
Nowhere is there any indication of what volume(s) were trying to be used.

I checked:
  there were tape drives free in the library
  all tape volumes are read/write or read-only
  no tape errors or hdwr errors


Q)  Any thoughts on why the files would be unavailable?
Q)  How can you tell specific volumes are needed for a client restore?

The only thing I can think of is that the volumes are unavailable, but I can't 
figure out what volumes it wanted to use.

Rick



-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Re: *EXTERNAL* Re: TSM DB spaces

2017-01-09 Thread Rhodes, Richard L.
Another consideration is the number if AIX hdisks the DB2 filespaces are using. 
 AIX uses I/O queues for each hdisk, and not having enough hdisks can cause I/O 
problems.

Our biggest DB2 db (600GB) (non-dudup'ed) currently uses 4 db2 filespaces.  
These reside on 8 hdisks which are pooled into one vg.  Filespace logical 
volumes are spread across the vg hdisks using a 32mb PP size.  They run through 
two FCS adapters that are set to round-robin.

https://www-03.ibm.com/support/techdocs/atsmastr.nsf/5cb5ed706d254a8186256c71006d2e0a/d1f54f4cd1431d5a8625785000529663/$FILE/AIX-VIOS_DiskAndAdapterQueueTuningV1.2.pdf


In other words:
  DB2 will spread I'O's across filespaces
  AIX/LVM will spread I/O's across hdisks
  MPIO will spread I/O's across FCS adapters
  hdisks should have paths to multiple storage front end ports
  storage will spread I/O's across all the backend physical disks

All of these spots can become bottlenecks.

This is how we setup all our Oracle databases, from the tiny to the +30TB. The 
details vary, but the idea is the same.  


Isn't storage such fun!!

Rick

 



-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Sasa 
Drnjevic
Sent: Friday, January 06, 2017 11:16 AM
To: ADSM-L@VM.MARIST.EDU
Subject: *EXTERNAL* Re: TSM DB spaces

On 2017-01-06 16:54, David Ehresman wrote:
> I am running TSM 7.1.5 on AIX 7.1.  My TSM DB is currently made up of
> five 120GB filespaces.  I need to dramatically increase the size of
> the DB as we prepare for dedup.  I know I can have 128 DB filespaces.
> What, if any, are the performance implications of just adding more
> filespaces vs staying with a smaller number of much larger
> filespaces?  The filespaces are SAN attached XIV with the data spread
> over 180 drives.
>
> David Ehresman
>

From experience, I believe it all comes down to IOPS.

So, it all depends on how are your TSM DBspaces distributed over as many
as possible drives, SAS or SATA HDDs, or SDDs, RAID type and of course
the type and throughput of (Fibre Channel?) SAN.

Your case with 180 drives sounds very good to me...

I've never had more than four TSM DB spaces, but I always distributed
them well over FC SAN, some on HDDs, and some on pure SSDs (Storwize
V7000), some only on RAID6, some only on RAID10. The sizes at the moment
are 400 GB, 200 GB and 800 GB TSM DBs.

Hope it helps...

--
Sasa Drnjevic


-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Re: Antwort: [ADSM-L] problem after 7.1.5 upgrade: ANS1708E ... Only root can do this operation

2016-12-07 Thread Rhodes, Richard L.
I see.

I just found the option and set it live via "setopt backupinitiationroot off".  
That fixed the problem live, and from your comment I checked the dsmserv.opt 
and it now has a "BACKUPINITIATIONROOT OFF" in it, so TSM stuck it in.

Thanks!

Rick



-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Rainer 
Holzinger
Sent: Wednesday, December 07, 2016 9:53 AM
To: ADSM-L@VM.MARIST.EDU
Subject: *EXTERNAL* Antwort: [ADSM-L] problem after 7.1.5 upgrade: ANS1708E ... 
Only root can do this operation

Hi Richard,

option 'backupinitiation   off' in dsmserv.opt and recycle of the instance
die help at my site
some months ago.

HTH,
Rainer



Von:    "Rhodes, Richard L." <rrho...@firstenergycorp.com>
An: ADSM-L@VM.MARIST.EDU
Datum:  07.12.2016 15:47
Betreff:[ADSM-L] problem after 7.1.5 upgrade:  ANS1708E ... Only
root can do this operation
Gesendet von:   "ADSM: Dist Stor Manager" <ADSM-L@VM.MARIST.EDU>



Just upgrade a TSM server from 6.3.5 to 7.1.5 on AIX.

This morning our Oracle DBA's are reporting this error:
ANS1708E Backup operation failed.  Only a root user can do this operation<
http://www-01.ibm.com/support/docview.wss?uid=swg21651108>

And on the TSM server we see:
ANR1890W Backup operation for session 8549 node  failed due to
root-only restriction<
http://www-01.ibm.com/support/docview.wss?uid=swg21651108>

The Oracle DBA's run Oracle backups to disk, then call dsmc to push the
backup to TSM.  They do this AS THE ORACLE USER, not root.

I found a IBM doc that said to set the node parm "Users allowed to back <
http://www-01.ibm.com/support/docview.wss?uid=swg21651108> up" from root
to ALL.  I checked, and all the nodes that had this problem _ARE_ set to
ALL.
  doc:  http://www-01.ibm.com/support/docview.wss?uid=swg21651108

Any thougts are welcome!



cat z.ksh
for i in <http://www-01.ibm.com/support/docview.wss?uid=swg21651108> 
do<http://www-01.ibm.com/support/docview.wss?uid=swg21651108>
./run_cmd.ksh -l tsm1 "q node $i f=d" | grep -i "Users allowed to back
up"<http://www-01.ibm.com/support/docview.wss?uid=swg21651108>
done<http://www-01.ibm.com/support/docview.wss?uid=swg21651108>

./z.ksh<http://www-01.ibm.com/support/docview.wss?uid=swg21651108>
Users allowed to back up: All<
http://www-01.ibm.com/support/docview.wss?uid=swg21651108>
Users allowed to back up: All<
http://www-01.ibm.com/support/docview.wss?uid=swg21651108>
Users allowed to back up: All<
http://www-01.ibm.com/support/docview.wss?uid=swg21651108>
Users allowed to back up: All<
http://www-01.ibm.com/support/docview.wss?uid=swg21651108>
Users allowed to back up: All<
http://www-01.ibm.com/support/docview.wss?uid=swg21651108>
Users allowed to back up: All<
http://www-01.ibm.com/support/docview.wss?uid=swg21651108>
Users allowed to back up: All<
http://www-01.ibm.com/support/docview.wss?uid=swg21651108>
Users allowed to back up: All<
http://www-01.ibm.com/support/docview.wss?uid=swg21651108>
Users allowed to back up: All<
http://www-01.ibm.com/support/docview.wss?uid=swg21651108>
Users allowed to back up: All<
http://www-01.ibm.com/support/docview.wss?uid=swg21651108>
Users allowed to back up: All<
http://www-01.ibm.com/support/docview.wss?uid=swg21651108>
Users allowed to back up: All<
http://www-01.ibm.com/support/docview.wss?uid=swg21651108>
Users allowed to back up: All<
http://www-01.ibm.com/support/docview.wss?uid=swg21651108>




-

The information contained in this message is intended only for the
personal and confidential use of the recipient(s) named above. If the
reader of this message is not the intended recipient or an agent
responsible for delivering it to the intended recipient, you are hereby
notified that you have received this document in error and that any
review, dissemination, distribution, or copying of this message is
strictly prohibited. If you have received this communication in error,
please notify us immediately, and delete the original message.


-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


problem after 7.1.5 upgrade: ANS1708E ... Only root can do this operation

2016-12-07 Thread Rhodes, Richard L.
Just upgrade a TSM server from 6.3.5 to 7.1.5 on AIX.

This morning our Oracle DBA's are reporting this error:
ANS1708E Backup operation failed.  Only a root user can do this 
operation

And on the TSM server we see:
ANR1890W Backup operation for session 8549 node  failed due to root-only 
restriction

The Oracle DBA's run Oracle backups to disk, then call dsmc to push the backup 
to TSM.  They do this AS THE ORACLE USER, not root.

I found a IBM doc that said to set the node parm "Users allowed to back 
 up" from root to 
ALL.  I checked, and all the nodes that had this problem _ARE_ set to ALL.
  doc:  http://www-01.ibm.com/support/docview.wss?uid=swg21651108

Any thougts are welcome!



cat z.ksh
for i in  
do
./run_cmd.ksh -l tsm1 "q node $i f=d" | grep -i "Users allowed to back 
up"
done

./z.ksh
Users allowed to back up: 
All
Users allowed to back up: 
All
Users allowed to back up: 
All
Users allowed to back up: 
All
Users allowed to back up: 
All
Users allowed to back up: 
All
Users allowed to back up: 
All
Users allowed to back up: 
All
Users allowed to back up: 
All
Users allowed to back up: 
All
Users allowed to back up: 
All
Users allowed to back up: 
All
Users allowed to back up: 
All




-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Re: *EXTERNAL* TDP Oracle best practice

2016-11-11 Thread Rhodes, Richard L.
What's the connection between the Oracle server and the TSM server?  Whether 
multiple channels not multiplexed, or, one channel with multiplexing (or some 
other combination) may not speed up the backup/restore depending on the weakest 
link (source disks, lan, disk pool target disks, tape).  Our DBA's performed 
multiple tests to figure out the best speed.  Once you hit a throughput limit, 
I don't think the number of channels or multiplexing would matter.   

I agree, if you stage to a disk and migrate, then I know of no way to control 
what tapes multiple TDP files would be placed on.  Since we TDPO direct to tape 
via storage agents, we can always give a restore the same channels the backup 
used.  I don't know how the number of backup channels would effect a  restore  
if all the files were on the same tape.  This is confusing to me.


Rick



-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Shawn 
Drew
Sent: Friday, November 11, 2016 9:01 AM
To: ADSM-L@VM.MARIST.EDU
Subject: *EXTERNAL* TDP Oracle best practice

I’m looking for best practice advice for TDP for Oracle with regards to # of 
channels.

If you have a classic TSM environment with a disk pool that migrates to tape, 
it would seem that using one-channel for TDPO backups makes the most sense to 
prevent the case where multi-channel files get migrated to the same tape.  Our 
DBAs are quite opposed to using only one channel (particularly large multi-TB 
databases) but I can’t find any official best practice statement from IBM that 
I can use as a response. 
Unfortunately IBM support worded it “you might want to only use one-channel” 
which didn’t sound strong enough for our DBAs.

There is no “reverse-collocation” to ensure the data ends up on different 
tapes, as far as I know, so what is the best practice for backing up Oracle 
data in an environment with data migrations?

-Thanks
Shawn


-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


FW: Rolling a TSM instance to a new server/lpar

2016-09-29 Thread Rhodes, Richard L.
I want to thank those who helped figure this out.

I now have a procedure for rolling the TSM/DB2 disks to a new LPAR.
I thought I'd share it with you.  Like a lot of things, it's fairly easy once 
you know how.

==
= procedure
==

Situation:

All disks to be swung to new lpar contain ALL of TSM/DB2 pieces/parts.  This 
includes: db2 filesystems, db2 logs, db2 archive logs, sqllib dir, tsm config 
(dsmserv.opt, etc).  What is not being swung is rootvg filesystems (/, /usr, 
/var, /opt, /home).  The DB2 owner's home dir is on the disks being swung.



To swing TSM instance to new lpar:


==> On New LPAR:

  AIX up and running

  SET AIX to use IOCP
smitty iocp
change to "enable"
REBOOT - REQUIRES REBOOT to take effect (really??)

  TAPE
install Atape
zone tape drives to new lpar
cfgmgr
change rmt device names to new scheme
stage cmds to alter drive paths on library managers

  ADD user/group for tsm/db2 owners
mkgroup id=1000 tsmdb2group
mkuser id=1000 pgrp=tsmdb2group home=/tsmdata/tsmX/config tsmdb2userid
set pwd to xxx (as root:  passwd tsmdb2userid)
make tsmdb2userid a NON-LOGIN account

  SETUP Datadomain 10g adapter and mount
(DD contains TSM/DB2 backup, file devices, TSM config files)
mkdir -p /DD/tsmX
chmod -R 755 /DD
chown tsmdb2userid:tsmdb2group /DD/tsmX
add mount to /etc/filesystems
DD: set share to mount to new lpar
mount /DD/tsmX

  ADD db2 lines to /etc/services
  (port number MUST be  consecutive, but value doesn't matter)
  DB2_tsmdb2userid 6/tcp
  DB2_tsmdb2userid_1   60001/tcp
  DB2_tsmdb2userid_2   60002/tcp
  DB2_tsmdb2userid_END 60003/tcp

  INSTALL TSM license from base release

  IMSTALL TSM at same level as old lpar

  INSTALL TSM BA client
copy BA client config files from old lpar
dsm.sys, dsm.opt, inclexcl, other

  ADD DB2 api stanza to /opt/tivoli/tsm/server/bin/dbbkapi/dsm.sys
  (this is new in TSM v7.1)
  (remove same from BA client dsm.sys)
SERVERNAME   TSMDBMGR_tsmdb2userid
* --- *
* This stanza was added by the TSM Instance Configuration Utility *
* --- *
COMMMETHOD   SHAREDMEM
SHMPORT  1510
NODENAME $$_TSMDBMGR_$$
ERRORLOGNAME /tsmdata/tsmX/config/tsmdbmgr.log
(^CHANGE THAT tsmX!!!)

  ADD to /etc/inittab
tsm:2:once:/etc/rc.tsm # start tsm client
tsmX:2:once:/tsmdata/tsmX/config/rc.start_tsm_in_background.ksh 
>/dev/console 2>&1
fmc:2:respawn:/opt/tivoli/tsm/db2/bin/db2fmcd #DB2 Fault Monitor Coordinator
  (probably already there from TSM install)

  FUDGE /etc/hosts
block communications to other TSM instances during testing
  9.9.9.9 
add entries to /etc/hosts on the hostname IP for this TSM instance
  tsmX tsmX..com

==> Swing storage to new lpar

  OLD lpar:
backup db
stop activity
shutdown tsm
umount
varyoffvg
exportvg
rmdev hdisks

  REZONE/MASK to new lpar

  NEW lpar:
cfgmgr
set hdisk bits
importvg
varyonvg
mount
  check mount order in /etc/filesystems


==> Fix/Config/Test #1

  CHANGE/CHECK /tsmdata/tsmX/config/sqllib/db2nodes.cfg
new lpar has hostname with "-new"
change file to have new hostname

  CHECK instance known to db2
/opt/tivoli/tsm/db2/instance/db2ilist
(returns nothing - this is correct!!!)

  TEST db2 start:
su - tsmdb2userid
db2start
db2stop

  CHECK instance known to db2
/opt/tivoli/tsm/db2/instance/db2ilist
tsmdb2userid
(returns one line with "tsmdb2userid")

  TEST TSM start:
/tsmdata/tsmX/config/rc.start_tsm_in_forground.ksh


==> Rename server (UNIX team)

  CHANGE server hostnames
smitty hostname
old lpar:  servernameX servernameX-old
new lpar:  servernameX-new servernameX

  CHANGE DNS accordingly
  MOVE tsmX alias to new lpar DNS entry

  CHANGE /tsmdata/tsmX/config/sqllib/db2nodes.cfg
change to new server name

  CHECK that /etc/hosts entry for server has hostname on it


==> Fix/Config/Test #2

  TEST db2 start:
su - tsmdb2userid
db2start
db2stop

  TEST TSM start:
  /tsmdata/tsmX/config/rc.start_tsm_in_forground.ksh

  TEST TSM db backup

  UNFUDGE /etc/hosts
remove
  9.9.9.9 tsm1 tsm2 tsm3 tsm4 tsm5 tsm6 tsm7 tsm8 tsm9 tsmsap1 tsmsap2 
tsmlm1 tsmlm2 tsmapp
  tsmX tsmX.fenetwork.COM

  ON LIBRARY MANAGERS - run cmds to set drive paths to tape drives


==> START TSM

  TSM start:
/tsmdata/tsmX/config/rc.start_tsm_in_background.ksh

  CHECK TSM server-to-server communications
ping server tsmX
update server tsmX forcesync=yes

  TEST tape mount/unmount











From: Rhodes, Richard L.
Sent: Friday, May 06, 2016 12:56 PM
To: ADSM: Dis

Re: *EXTERNAL* Re: tsm/db2 won't start after boot drive crash/recovery

2016-09-14 Thread Rhodes, Richard L.
We only have one instance per AIX lpar.
The instance/user name is "tsmuser"  (real creative).

I did have to add user "tsmuser" with group "tsmgroup" to AIX with the right 
values, since those were lost.  

Rick



-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Paul 
van Dongen
Sent: Wednesday, September 14, 2016 9:58 AM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: *EXTERNAL* Re: tsm/db2 won't start after boot drive crash/recovery

tsmdb1 is the database name; the instance name should be the username under 
which the TSM server instance runs. When there are multiple TSM server 
instances on the same AIX box, all databases are named "tsmdb1", each under his 
own DB2 instance.


Met vriendelijke groet / With kind regards,
Paul van Dongen
System Expert


Vancis BV
Science Park 408
1098 XH Amsterdam
W: www.vancis.nl




-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of David 
Ehresman
Sent: 14 September 2016 15:25
To: ADSM-L@VM.MARIST.EDU
Subject: Re: [ADSM-L] *EXTERNAL* Re: tsm/db2 won't start after boot drive 
crash/recovery

Which leads me to ask.  Where (on AIX) does the tsmdb1 instance reside?

David

-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of 
Rhodes, Richard L.
Sent: Wednesday, September 14, 2016 9:00 AM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: [ADSM-L] *EXTERNAL* Re: tsm/db2 won't start after boot drive 
crash/recovery

Thanks!

I added the lines to /etc/services, and tried db2start, and db2 came up.


When I run db2iupdt I get:

  rssymapi2p:/home/root==>/opt/tivoli/tsm/db2/instance/db2iupdt tsmdb1
  DBI1446I  The db2iupdt command is running.
  DB2 installation is being initialized.
  The specified instance "tsmdb1" does not exist. Specify an existing instance 
name.


Thanks!

Rick




-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Paul 
van Dongen
Sent: Wednesday, September 14, 2016 8:30 AM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: *EXTERNAL* Re: tsm/db2 won't start after boot drive crash/recovery

Richard, 

I have recently moved several TSM servers between AIX systems (without 
restoring the DBs). Some points of attention:

On a system without TSM, you must first install TSM software. You will also 
need some tweaking of the DB registry.

1. correct hostname in /sqllib/db2nodes.cfg 2. /etc/services 
must contain:

DB2_  60016/tcp
DB2__160017/tcp
DB2__260018/tcp
DB2__END  60019/tcp

Ports can vary, but must be in sequence

3. Instance "update": /opt/tivoli/tsm/db2/instance/db2iupdt  4. 
As instance owner: ~/sqllib/adm/db2set -g DB2SYSTEM= 5. dsm.sys for 
DBbackups has to be present (location depends on the TSM server version)

If you need more details please PM me.

Met vriendelijke groet / With kind regards, Paul van Dongen System Expert


Vancis BV
Science Park 408
1098 XH Amsterdam
W: www.vancis.nl

T:  020 560 6600
M:  06 4181 4446
E:  paul.vandon...@vancis.nl



-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of 
Rhodes, Richard L.
Sent: 14 September 2016 13:48
To: ADSM-L@VM.MARIST.EDU
Subject: Re: [ADSM-L] *EXTERNAL* Re: tsm/db2 won't start after boot drive 
crash/recovery

No, DB2 won't start at all.

rssymapi2p:/tsmdata/tsmoc/config==>db2start
SQL6031N  Error in the db2nodes.cfg file at line number "0".  Reason code "11".

I'm not sure how to state this, but I think there is some configuration in DB2 
(that would be in on the boot drive) that points to the TSM database TSMDB1.  I 
think that configuration is missing.

For example, I found out about this cmd fighting a db2 problem some time ago.  
Run on a working TSM system:
   ./db2ilist
   tsmuser  (our db2 owner)
Run on this recovered system:
   ./db2ilist(no output)


Rick




-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Lee, 
Gary
Sent: Tuesday, September 13, 2016 3:42 PM
To: ADSM-L@VM.MARIST.EDU
Subject: *EXTERNAL* Re: tsm/db2 won't start after boot drive crash/recovery

Was db2 running for sure? 
In previous installs I had to modify the startup script to do a db2start then 
sleep for 10 secs to get tsm to start correctly fron reboot of the system.  
This was under redhat linux 6.

That was the message I would get.


-Original Message-----
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of 
Rhodes, Richard L.
Sent: Tuesday, September 13, 2016 3:29 PM
To: ADSM-L@VM.MARIST.EDU
Subject: [ADSM-L] tsm/db2 won't start after boot drive crash/recovery

Hello,

We have a TSM v7.1.4 instance called TSMOC.  Its sole purpose in life is to run 
Operations Center.  It runs on an AIX lpar that's used for some other things.

Last Friday the AIX rootvg was lost during a live migration to a new storage

Re: *EXTERNAL* Re: tsm/db2 won't start after boot drive crash/recovery

2016-09-14 Thread Rhodes, Richard L.
Our TSM instance resides on a separate lun from AIX.   We try not to add 
filesystems to rootvg, for the most part.  I keep all our TSM and db2 setup in 
a filesystem tree called /tsmdata.  Here is what it looks like for this system:

  /dev/tsmdata0.06  0.061%6 1% /tsmdata
  /dev/tsmscripts 0.34  0.23   34% 1499 3% 
/tsmdata/tsm_scripts
  /dev/tsmoc 10.16 10.012%  759 1% /tsmdata/tsmoc
  /dev/db2activelog1  9.59  1.59   84%   23 1% 
/tsmdata/tsmoc/db2activelog1
  /dev/db2activelog2  9.59  1.59   84%   23 1% 
/tsmdata/tsmoc/db2activelog2
  /dev/db2archivelog 38.22 33.84   12%   18 1% 
/tsmdata/tsmoc/db2archivelog
  /dev/db2data1   4.00  1.95   52%  104 1% 
/tsmdata/tsmoc/db2data1
  /dev/db2data2   4.00  1.95   52%  104 1% 
/tsmdata/tsmoc/db2data2
  /dev/tsmocinstall  12.50  8.74   31% 3146 1% 
/tsmdata/tsmoc/install

The TSM config (dsmserv.opt and other stuff) is in /tsmdata/tsmoc/config.  
The DB2 home dir sqllib is at /tsmdata/tsmoc/config/sqllib.

All these filesystems are on a separate lun in a separate vg on separate lun.

  rsp:/tsmdata/tsmoc/config==>lsvg
rootvg
vgtsmoc

  rsp:/tsmdata/tsmoc/config==>lsvg -l rootvg
  rootvg:
  LV NAME TYPE   LPs PPs PVs  LV STATE  MOUNT POINT
  hd5 boot   1   1   1closed/syncd  N/A
  hd6 paging 64  64  1open/syncdN/A
  hd8 jfs2log1   1   1open/syncdN/A
  hd4 jfs2   1   1   1open/syncd/
  hd2 jfs2   22  22  1open/syncd/usr
  hd9var  jfs2   6   6   1open/syncd/var
  hd3 jfs2   12  12  1open/syncd/tmp
  hd1 jfs2   1   1   1open/syncd/home
  hd10opt jfs2   39  39  1open/syncd/opt
  lg_dumplv   sysdump6   6   1open/syncdN/A
  scripts jfs2   1   1   1open/syncd/scripts
  usremc  jfs2   8   8   1open/syncd/usr/emc

  rsp:/tsmdata/tsmoc/config==>lsvg -l vgtsmoc
  vgtsmoc:
  LV NAME TYPE   LPs PPs PVs  LV STATE  MOUNT POINT
  tsmdata jfs2   2   2   1open/syncd/tsmdata
  tsmscripts  jfs2   11  11  1open/syncd
/tsmdata/tsm_scripts
  tsmoc   jfs2   325 325 1open/syncd
/tsmdata/tsmoc
  db2activelog1   jfs2   307 307 2open/syncd
/tsmdata/tsmoc/db2activelog1
  db2activelog2   jfs2   307 307 2open/syncd
/tsmdata/tsmoc/db2activelog2
  db2archivelog   jfs2   122312232open/syncd
/tsmdata/tsmoc/db2archivelog
  db2data1jfs2   128 128 1open/syncd
/tsmdata/tsmoc/db2data1
  db2data2jfs2   128 128 1open/syncd
/tsmdata/tsmoc/db2data2
  tsmocinstalljfs2   400 400 2open/syncd
/tsmdata/tsmoc/install
  loglv00 jfs2log1   1   1open/syncdN/A


When we lost the rootvg disk, all the TSM/DB2 config was just fine.

Interestingly, this was a good exercise.  Shortly, we are moving all our TSM 
instances to a new chassis - all new lpars with AIX7.  I can swing the luns 
with the TSM/DB2 filesystems to the new lpar, but I will have an entirely new 
rootvg that doesn't have TSM/DB2 installed.  What we just did to recover tsmoc 
is exactly what we will need to do on the new lpars.  We just got there a 
different way!

Now, we just have to install OC . . . . (not that we actually use it for much).

Thanks!


Rick



-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of David 
Ehresman
Sent: Wednesday, September 14, 2016 9:25 AM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: *EXTERNAL* Re: tsm/db2 won't start after boot drive crash/recovery

Which leads me to ask.  Where (on AIX) does the tsmdb1 instance reside?

David

-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of 
Rhodes, Richard L.
Sent: Wednesday, September 14, 2016 9:00 AM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: [ADSM-L] *EXTERNAL* Re: tsm/db2 won't start after boot drive 
crash/recovery

Thanks!

I added the lines to /etc/services, and tried db2start, and db2 came up.


When I run db2iupdt I get:

  rssymapi2p:/home/root==>/opt/tivoli/tsm/db2/instance/db2iupdt tsmdb1
  DBI1446I  The db2iupdt command is running.
  DB2 installation is being initialized.
  The specified instance "tsmdb1" does not exist. Specify an existing instance 
name.


Thanks!

Rick




-Original Message-
From: ADSM: Dist Stor 

Re: *EXTERNAL* Re: tsm/db2 won't start after boot drive crash/recovery

2016-09-14 Thread Rhodes, Richard L.
n 9 started for server TSM8 (AIX) (Tcp/Ip) for remote monitoring.
ANR1990I Remote monitoring started for server TSM8.
ANR0408I Session 10 started for server TSM4 (AIX) (Tcp/Ip) for remote 
monitoring.
ANR1990I Remote monitoring started for server TSM4.
ANR0408I Session 11 started for server TSM7 (AIX) (Tcp/Ip) for remote 
monitoring.
ANR1990I Remote monitoring started for server TSM7.
ANR0408I Session 12 started for server TSM6 (AIX) (Tcp/Ip) for remote 
monitoring.
ANR1990I Remote monitoring started for server TSM6.
ANR0408I Session 13 started for server TSMAPP (AIX) (Tcp/Ip) for remote 
monitoring.
ANR1990I Remote monitoring started for server TSMAPP.

ANR0098W This system does not meet the minimum memory requirements.
ANR0993I Server initialization complete.
ANR0916I TIVOLI STORAGE MANAGER distributed by Tivoli is now ready for use.
TSM:TSMOC>
Storage Management Server for AIX - Version 7, Release 1, Level 4.100

TSM:TSMOC>
ANR2812W License Audit completed - ATTENTION: Server is NOT in compliance with 
license terms.
ANR1959I Status monitor collecting current data at 09:03:57.
ANR1960I Status monitor finished collecting data at 09:04:01 and will sleep for 
60 minutes.

Storage Management Server for AIX - Version 7, Release 1, Level 4.100

TSM:TSMOC>








-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Paul 
van Dongen
Sent: Wednesday, September 14, 2016 8:30 AM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: *EXTERNAL* Re: tsm/db2 won't start after boot drive crash/recovery

Richard, 

I have recently moved several TSM servers between AIX systems (without 
restoring the DBs). Some points of attention:

On a system without TSM, you must first install TSM software. You will also 
need some tweaking of the DB registry.

1. correct hostname in /sqllib/db2nodes.cfg 
2. /etc/services must contain:

DB2_  60016/tcp
DB2__160017/tcp
DB2__260018/tcp
DB2__END  60019/tcp

Ports can vary, but must be in sequence

3. Instance "update": /opt/tivoli/tsm/db2/instance/db2iupdt 
4. As instance owner: ~/sqllib/adm/db2set -g DB2SYSTEM=
5. dsm.sys for DBbackups has to be present (location depends on the TSM server 
version)

If you need more details please PM me.

Met vriendelijke groet / With kind regards,
Paul van Dongen
System Expert


Vancis BV
Science Park 408
1098 XH Amsterdam
W: www.vancis.nl

T:  020 560 6600
M:  06 4181 4446
E:  paul.vandon...@vancis.nl



-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of 
Rhodes, Richard L.
Sent: 14 September 2016 13:48
To: ADSM-L@VM.MARIST.EDU
Subject: Re: [ADSM-L] *EXTERNAL* Re: tsm/db2 won't start after boot drive 
crash/recovery

No, DB2 won't start at all.

rssymapi2p:/tsmdata/tsmoc/config==>db2start
SQL6031N  Error in the db2nodes.cfg file at line number "0".  Reason code "11".

I'm not sure how to state this, but I think there is some configuration in DB2 
(that would be in on the boot drive) that points to the TSM database TSMDB1.  I 
think that configuration is missing.

For example, I found out about this cmd fighting a db2 problem some time ago.  
Run on a working TSM system:
   ./db2ilist
   tsmuser  (our db2 owner)
Run on this recovered system:
   ./db2ilist(no output)


Rick




-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Lee, 
Gary
Sent: Tuesday, September 13, 2016 3:42 PM
To: ADSM-L@VM.MARIST.EDU
Subject: *EXTERNAL* Re: tsm/db2 won't start after boot drive crash/recovery

Was db2 running for sure? 
In previous installs I had to modify the startup script to do a db2start then 
sleep for 10 secs to get tsm to start correctly fron reboot of the system.  
This was under redhat linux 6.

That was the message I would get.


-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of 
Rhodes, Richard L.
Sent: Tuesday, September 13, 2016 3:29 PM
To: ADSM-L@VM.MARIST.EDU
Subject: [ADSM-L] tsm/db2 won't start after boot drive crash/recovery

Hello,

We have a TSM v7.1.4 instance called TSMOC.  Its sole purpose in life is to run 
Operations Center.  It runs on an AIX lpar that's used for some other things.

Last Friday the AIX rootvg was lost during a live migration to a new storage 
system.  We decided to recover by installing a mksysb from a partner lpar which 
had the same AIX version and application version, but NOT TSM.  So the lpar got 
back up and running quickly - only took an hour, but it's missing the TSM 
install.  All the TSM instance files (dsmserv.opt, etc) and DB2 filesystems 
(data, logs, sqllib, etc) exist with all their data.  They weren't lost since 
they were on a different lun and volume group.

We installed TSM v7.1.4 and I then created the AIX db2 instance owner and 
group.  We then tried to start TSM.  We got msgs below.

ANR7801I Subsystem process ID is 16056324.
ANR0900I Processing o

Re: *EXTERNAL* Re: tsm/db2 won't start after boot drive crash/recovery

2016-09-14 Thread Rhodes, Richard L.
Thanks!

I added the lines to /etc/services, and tried db2start, and db2 came up.


When I run db2iupdt I get:

  rssymapi2p:/home/root==>/opt/tivoli/tsm/db2/instance/db2iupdt tsmdb1
  DBI1446I  The db2iupdt command is running.
  DB2 installation is being initialized.
  The specified instance "tsmdb1" does not exist. Specify an existing instance 
name.


Thanks!

Rick




-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Paul 
van Dongen
Sent: Wednesday, September 14, 2016 8:30 AM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: *EXTERNAL* Re: tsm/db2 won't start after boot drive crash/recovery

Richard, 

I have recently moved several TSM servers between AIX systems (without 
restoring the DBs). Some points of attention:

On a system without TSM, you must first install TSM software. You will also 
need some tweaking of the DB registry.

1. correct hostname in /sqllib/db2nodes.cfg 
2. /etc/services must contain:

DB2_  60016/tcp
DB2__160017/tcp
DB2__260018/tcp
DB2__END  60019/tcp

Ports can vary, but must be in sequence

3. Instance "update": /opt/tivoli/tsm/db2/instance/db2iupdt 
4. As instance owner: ~/sqllib/adm/db2set -g DB2SYSTEM=
5. dsm.sys for DBbackups has to be present (location depends on the TSM server 
version)

If you need more details please PM me.

Met vriendelijke groet / With kind regards,
Paul van Dongen
System Expert


Vancis BV
Science Park 408
1098 XH Amsterdam
W: www.vancis.nl

T:  020 560 6600
M:  06 4181 4446
E:  paul.vandon...@vancis.nl



-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of 
Rhodes, Richard L.
Sent: 14 September 2016 13:48
To: ADSM-L@VM.MARIST.EDU
Subject: Re: [ADSM-L] *EXTERNAL* Re: tsm/db2 won't start after boot drive 
crash/recovery

No, DB2 won't start at all.

rssymapi2p:/tsmdata/tsmoc/config==>db2start
SQL6031N  Error in the db2nodes.cfg file at line number "0".  Reason code "11".

I'm not sure how to state this, but I think there is some configuration in DB2 
(that would be in on the boot drive) that points to the TSM database TSMDB1.  I 
think that configuration is missing.

For example, I found out about this cmd fighting a db2 problem some time ago.  
Run on a working TSM system:
   ./db2ilist
   tsmuser  (our db2 owner)
Run on this recovered system:
   ./db2ilist(no output)


Rick




-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Lee, 
Gary
Sent: Tuesday, September 13, 2016 3:42 PM
To: ADSM-L@VM.MARIST.EDU
Subject: *EXTERNAL* Re: tsm/db2 won't start after boot drive crash/recovery

Was db2 running for sure? 
In previous installs I had to modify the startup script to do a db2start then 
sleep for 10 secs to get tsm to start correctly fron reboot of the system.  
This was under redhat linux 6.

That was the message I would get.


-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of 
Rhodes, Richard L.
Sent: Tuesday, September 13, 2016 3:29 PM
To: ADSM-L@VM.MARIST.EDU
Subject: [ADSM-L] tsm/db2 won't start after boot drive crash/recovery

Hello,

We have a TSM v7.1.4 instance called TSMOC.  Its sole purpose in life is to run 
Operations Center.  It runs on an AIX lpar that's used for some other things.

Last Friday the AIX rootvg was lost during a live migration to a new storage 
system.  We decided to recover by installing a mksysb from a partner lpar which 
had the same AIX version and application version, but NOT TSM.  So the lpar got 
back up and running quickly - only took an hour, but it's missing the TSM 
install.  All the TSM instance files (dsmserv.opt, etc) and DB2 filesystems 
(data, logs, sqllib, etc) exist with all their data.  They weren't lost since 
they were on a different lun and volume group.

We installed TSM v7.1.4 and I then created the AIX db2 instance owner and 
group.  We then tried to start TSM.  We got msgs below.

ANR7801I Subsystem process ID is 16056324.
ANR0900I Processing options file /tsmdata/tsmoc/config/dsmserv.opt.
ANR7811I Using instance directory /tsmdata/tsmoc/config.
ANR4726I The ICC support module has been loaded.
ANR0990I Server restart-recovery in progress.
ANR0172I rdbinst.c(3942): Error encountered performing action UPDATE DBM CFG.
ANR0162W Supplemental database diagnostic information:  -6031:**No State 
Information Available
(-2)**:-6031 (SQL6031N  Error in the db2nodes.cfg file at line number "0".  
Reason code "11".
).
ANR0171I dbiconn.c(1844): Error detected on 0:1, database in evaluation mode.
ANR0162W Supplemental database diagnostic information:  -1:08001:-1032 
([IBM][CLI Driver] SQL1032N  No start database manager command was issued.  
SQLSTATE=57019


I think I've got to tell db2 about the database that exists on disk.
We are going to call support, but figure

Re: *EXTERNAL* Re: tsm/db2 won't start after boot drive crash/recovery

2016-09-14 Thread Rhodes, Richard L.
I found a db2nodes.cfg in the sqllib dir.  
The sqllib dir is NOT on rootvg so it wasn't lost.

  rssymapi2p:/tsmdata/tsmoc/config/sqllib==>cat db2nodes.cfg
  0 rssymapi2p 0

The instance was a fully good/running TSM/DB2 system, although all it ever did 
was run the OC hub.

For example, I found out about this cmd fighting a db2 problem some time ago.  

Running db2ilist returns nothing.
   ./db2ilist(no output)
On other TSM instances db2ilist returns our DB2 owner. 


The doc you mentioned says to check /etc/services.
On a good/running TSM I find these:
  DB2_tsmuser 6/tcp
  DB2_tsmuser_1   60001/tcp
  DB2_tsmuser_2   60002/tcp
  DB2_tsmuser_END 60003/tcp
They are missing on this system we recovered rootvg.  Will try adding them back 
in.



Rick





-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Loon, 
Eric van (ITOPT3) - KLM
Sent: Wednesday, September 14, 2016 7:42 AM
To: ADSM-L@VM.MARIST.EDU
Subject: *EXTERNAL* Re: tsm/db2 won't start after boot drive crash/recovery

Hi Richard!
Did you check the contents of the db2nodes.cfg file? It should contain the 
local host name of the TSM server.
You should also check if the instance is created successfully using the 
db2ilist command and also take a look at the following technote: 
http://www-01.ibm.com/support/docview.wss?uid=swg1IC67141
Kind regards,
Eric van Loon
Air France/KLM Storage Engineering

-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of 
Rhodes, Richard L.
Sent: dinsdag 13 september 2016 21:29
To: ADSM-L@VM.MARIST.EDU
Subject: tsm/db2 won't start after boot drive crash/recovery

Hello,

We have a TSM v7.1.4 instance called TSMOC.  Its sole purpose in life is to run 
Operations Center.  It runs on an AIX lpar that's used for some other things.

Last Friday the AIX rootvg was lost during a live migration to a new storage 
system.  We decided to recover by installing a mksysb from a partner lpar which 
had the same AIX version and application version, but NOT TSM.  So the lpar got 
back up and running quickly - only took an hour, but it's missing the TSM 
install.  All the TSM instance files (dsmserv.opt, etc) and DB2 filesystems 
(data, logs, sqllib, etc) exist with all their data.  They weren't lost since 
they were on a different lun and volume group.

We installed TSM v7.1.4 and I then created the AIX db2 instance owner and 
group.  We then tried to start TSM.  We got msgs below.

ANR7801I Subsystem process ID is 16056324.
ANR0900I Processing options file /tsmdata/tsmoc/config/dsmserv.opt.
ANR7811I Using instance directory /tsmdata/tsmoc/config.
ANR4726I The ICC support module has been loaded.
ANR0990I Server restart-recovery in progress.
ANR0172I rdbinst.c(3942): Error encountered performing action UPDATE DBM CFG.
ANR0162W Supplemental database diagnostic information:  -6031:**No State 
Information Available
(-2)**:-6031 (SQL6031N  Error in the db2nodes.cfg file at line number "0".  
Reason code "11".
).
ANR0171I dbiconn.c(1844): Error detected on 0:1, database in evaluation mode.
ANR0162W Supplemental database diagnostic information:  -1:08001:-1032 
([IBM][CLI Driver] SQL1032N  No start database manager command was issued.  
SQLSTATE=57019


I think I've got to tell db2 about the database that exists on disk.
We are going to call support, but figured I'd ask here first!

Any thought/comments are appreciated!

Rick


-The information contained in this 
message is intended only for the personal and confidential use of the 
recipient(s) named above. If the reader of this message is not the intended 
recipient or an agent responsible for delivering it to the intended recipient, 
you are hereby notified that you have received this document in error and that 
any review, dissemination, distribution, or copying of this message is strictly 
prohibited. If you have received this communication in error, please notify us 
immediately, and delete the original message.

For information, services and offers, please visit our web site: 
http://www.klm.com. This e-mail and any attachment may contain confidential and 
privileged material intended for the addressee only. If you are not the 
addressee, you are notified that no part of the e-mail or any attachment may be 
disclosed, copied or distributed, and that any other action related to this 
e-mail or attachment is strictly prohibited, and may be unlawful. If you have 
received this e-mail by error, please notify the sender immediately by return 
e-mail, and delete this message. 

Koninklijke Luchtvaart Maatschappij NV (KLM), its subsidiaries and/or its 
employees shall not be liable for the incorrect or incomplete transmission of 
this e-mail or any attachments, nor responsible for any delay in receipt. 
Koninklijke Luchtvaart Maatschappij N.V. (also known as KL

Re: *EXTERNAL* Re: tsm/db2 won't start after boot drive crash/recovery

2016-09-14 Thread Rhodes, Richard L.
No, DB2 won't start at all.

rssymapi2p:/tsmdata/tsmoc/config==>db2start
SQL6031N  Error in the db2nodes.cfg file at line number "0".  Reason code "11".

I'm not sure how to state this, but I think there is some configuration in DB2 
(that would be in on the boot drive) that points to the TSM database TSMDB1.  I 
think that configuration is missing.

For example, I found out about this cmd fighting a db2 problem some time ago.  
Run on a working TSM system:
   ./db2ilist
   tsmuser  (our db2 owner)
Run on this recovered system:
   ./db2ilist(no output)


Rick




-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Lee, 
Gary
Sent: Tuesday, September 13, 2016 3:42 PM
To: ADSM-L@VM.MARIST.EDU
Subject: *EXTERNAL* Re: tsm/db2 won't start after boot drive crash/recovery

Was db2 running for sure? 
In previous installs I had to modify the startup script to do a db2start then 
sleep for 10 secs to get tsm to start correctly fron reboot of the system.  
This was under redhat linux 6.

That was the message I would get.


-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of 
Rhodes, Richard L.
Sent: Tuesday, September 13, 2016 3:29 PM
To: ADSM-L@VM.MARIST.EDU
Subject: [ADSM-L] tsm/db2 won't start after boot drive crash/recovery

Hello,

We have a TSM v7.1.4 instance called TSMOC.  Its sole purpose in life is to run 
Operations Center.  It runs on an AIX lpar that's used for some other things.

Last Friday the AIX rootvg was lost during a live migration to a new storage 
system.  We decided to recover by installing a mksysb from a partner lpar which 
had the same AIX version and application version, but NOT TSM.  So the lpar got 
back up and running quickly - only took an hour, but it's missing the TSM 
install.  All the TSM instance files (dsmserv.opt, etc) and DB2 filesystems 
(data, logs, sqllib, etc) exist with all their data.  They weren't lost since 
they were on a different lun and volume group.

We installed TSM v7.1.4 and I then created the AIX db2 instance owner and 
group.  We then tried to start TSM.  We got msgs below.

ANR7801I Subsystem process ID is 16056324.
ANR0900I Processing options file /tsmdata/tsmoc/config/dsmserv.opt.
ANR7811I Using instance directory /tsmdata/tsmoc/config.
ANR4726I The ICC support module has been loaded.
ANR0990I Server restart-recovery in progress.
ANR0172I rdbinst.c(3942): Error encountered performing action UPDATE DBM CFG.
ANR0162W Supplemental database diagnostic information:  -6031:**No State 
Information Available
(-2)**:-6031 (SQL6031N  Error in the db2nodes.cfg file at line number "0".  
Reason code "11".
).
ANR0171I dbiconn.c(1844): Error detected on 0:1, database in evaluation mode.
ANR0162W Supplemental database diagnostic information:  -1:08001:-1032 
([IBM][CLI Driver] SQL1032N  No
start database manager command was issued.  SQLSTATE=57019


I think I've got to tell db2 about the database that exists on disk.
We are going to call support, but figured I'd ask here first!

Any thought/comments are appreciated!

Rick


-

The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


tsm/db2 won't start after boot drive crash/recovery

2016-09-13 Thread Rhodes, Richard L.
Hello,

We have a TSM v7.1.4 instance called TSMOC.  Its sole purpose in life is to run 
Operations Center.  It runs on an AIX lpar that's used for some other things.

Last Friday the AIX rootvg was lost during a live migration to a new storage 
system.  We decided to recover by installing a mksysb from a partner lpar which 
had the same AIX version and application version, but NOT TSM.  So the lpar got 
back up and running quickly - only took an hour, but it's missing the TSM 
install.  All the TSM instance files (dsmserv.opt, etc) and DB2 filesystems 
(data, logs, sqllib, etc) exist with all their data.  They weren't lost since 
they were on a different lun and volume group.

We installed TSM v7.1.4 and I then created the AIX db2 instance owner and 
group.  We then tried to start TSM.  We got msgs below.

ANR7801I Subsystem process ID is 16056324.
ANR0900I Processing options file /tsmdata/tsmoc/config/dsmserv.opt.
ANR7811I Using instance directory /tsmdata/tsmoc/config.
ANR4726I The ICC support module has been loaded.
ANR0990I Server restart-recovery in progress.
ANR0172I rdbinst.c(3942): Error encountered performing action UPDATE DBM CFG.
ANR0162W Supplemental database diagnostic information:  -6031:**No State 
Information Available
(-2)**:-6031 (SQL6031N  Error in the db2nodes.cfg file at line number "0".  
Reason code "11".
).
ANR0171I dbiconn.c(1844): Error detected on 0:1, database in evaluation mode.
ANR0162W Supplemental database diagnostic information:  -1:08001:-1032 
([IBM][CLI Driver] SQL1032N  No
start database manager command was issued.  SQLSTATE=57019


I think I've got to tell db2 about the database that exists on disk.
We are going to call support, but figured I'd ask here first!

Any thought/comments are appreciated!

Rick


-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Re: TSM on Veritas Cluster (performance tuning)

2016-09-08 Thread Rhodes, Richard L.
I can't help with TSM/DB2 on Linux, but we run vcs/vxvm/vxfs on AIX for our big 
oracle databases.  I asked one of the admins what they did and here is his 
response.


>The biggest issue we ran into was vxvm doing so many read-aheads it was 
>overloading the disks. 
>We set /dev/vx/dsk/dgdw1/oradwarch read_nstream=1,read_pref_io=16384
>For each of our file systems to vx won't read so much
>That goes in /etc/vx/tunefstab or you can use the vxtunefs to set them on the 
>fly.
>Mike



Rick



-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Loon, 
Eric van (ITOPT3) - KLM
Sent: Thursday, September 08, 2016 8:34 AM
To: ADSM-L@VM.MARIST.EDU
Subject: *EXTERNAL* TSM on Veritas Cluster (performance tuning)

Hi guys!
Veritas Cluster Services is the standard clustering software in our company for 
physical Linux servers. Our new TSM design is also based on VCS with a mirrored 
containerpool on IBM v5010 storage.
Does anybody have experience with performance tuning on VCS or the VxFS 
filesystem in combination with TSM? Any tips you like to share?
Thank you very much for your help in advance!
Kind regards,
Eric van Loon
Air France/KLM Storage Engineering

For information, services and offers, please visit our web site: 
http://www.klm.com. This e-mail and any attachment may contain confidential and 
privileged material intended for the addressee only. If you are not the 
addressee, you are notified that no part of the e-mail or any attachment may be 
disclosed, copied or distributed, and that any other action related to this 
e-mail or attachment is strictly prohibited, and may be unlawful. If you have 
received this e-mail by error, please notify the sender immediately by return 
e-mail, and delete this message.

Koninklijke Luchtvaart Maatschappij NV (KLM), its subsidiaries and/or its 
employees shall not be liable for the incorrect or incomplete transmission of 
this e-mail or any attachments, nor responsible for any delay in receipt.
Koninklijke Luchtvaart Maatschappij N.V. (also known as KLM Royal Dutch 
Airlines) is registered in Amstelveen, The Netherlands, with registered number 
33014286



-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Win silent install by MSI files

2016-09-08 Thread Rhodes, Richard L.
One of our Win admins asked:

>Do you know if IBM offers or has available a configuration wizard
>that we can use to setup custom MSI files to install Tivoli 7.1.4 remote to all
>our servers?

I didn't find anything from some quick googling.
I know a silent install is supported, but I'm not sure how that relates to MSI 
files.


Any thoughts are welcome!

Thanks

Rick






-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


jbb buffer errors

2016-09-07 Thread Rhodes, Richard L.
This one is strange.

One of our Win 2008 server with v6.3 client that is getting jbb buffer errors:

==> jbberror.log
07/01/2016 13:35:17 ANS0361I DIAG: ReadFsChangesThread(tid 7340): 
ReadDirectoryChangesW: Unable to process change notification buffer,  the 
buffer size may be need to be adjusted to avoid this problem in the future.
07/01/2016 13:35:17 ANS0361I DIAG: ReadFsChangesThread(tid 7340): exiting 
thread.
07/01/2016 13:35:17 ANS0361I DIAG: psFsMonitorThread(tid 6440): Notification 
buffer overrun for monitored FS 'G:\', journal will be reset.
07/01/2016 13:35:17 ANS0361I DIAG: jnlDbCntrl(): Resetting journal for fs 'G:'.
07/26/2016 10:52:30 ANS0361I DIAG: ReadFsChangesThread(tid 3768): 
ReadDirectoryChangesW: Unable to process change notification buffer,  the 
buffer size may be need to be adjusted to avoid this problem in the future.
07/26/2016 10:52:30 ANS0361I DIAG: ReadFsChangesThread(tid 3768): exiting 
thread.
07/26/2016 10:52:30 ANS0361I DIAG: psFsMonitorThread(tid 3776): Notification 
buffer overrun for monitored FS 'F:\', journal will be reset.
07/26/2016 10:52:30 ANS0361I DIAG: jnlDbCntrl(): Resetting journal for fs 'F:'.


In googling we find this article:
http://www-01.ibm.com/support/docview.wss?uid=swg21620688
>Even though the "Tivoli Storage Manager (TSM) Journal Based Backup FAQ"
>recommends to increase the notification buffer size, it is not applicable in 
>all cases.
>Therefore the recommendation of the Tivoli Storage Manager support is to 
>adjust the
>notification buffer so that the buffer overflow does not occur, increasing or 
>(in most cases)
>DECREASING the notification buffer size.

I don't understand decreasing a buffer to prevent an overflow.



Any thoughts about this are welcome!


Rick


-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Re: NDMP backups Restore

2016-09-06 Thread Rhodes, Richard L.
I found this comment from NetApp:

>Dump Format:
>Before we begin, it is important to realize that NetApp dump 
>(whether initiated using NDMP or using the filer console) adheres to 
>the ufsdump (Solaris dump) format. 

So it sounds line the NetApp data format is Solaris dump format.


Rick



-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Skylar 
Thompson
Sent: Tuesday, September 06, 2016 11:28 AM
To: ADSM-L@VM.MARIST.EDU
Subject: *EXTERNAL* Re: NDMP backups Restore

Yep, this is correct. It is one of the reasons I have avoided NDMP backups
in favor of NFS/CIFS backups.

On Tue, Sep 06, 2016 at 03:23:58PM +, Huebner, Andy wrote:
> My understanding is NDMP is a standard for the transport of data, not the 
> format of the data.  I would not expect an NDMP backup from one vendor to 
> work on the next vendor.
>
> As an example: NetApp supports compression and does not decompress for the 
> backup.  They next system would have to understand NetApp compression.
>
> Andy Huebner
> SME - Storage and Backups GDC - Fort Worth
>
> -Original Message-
> From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of 
> Remco Post
> Sent: Tuesday, September 06, 2016 2:47 AM
> To: ADSM-L@VM.MARIST.EDU
> Subject: Re: [ADSM-L] NDMP backups Restore
>
> > On 05 Sep 2016, at 14:55, Nick Marouf  wrote:
> >
> > Hello ADSM,
> >
> > We are currently migrating away from Netapps, (NDMP to tape) to a new
> > store subsystem ( Infinidat)
> >
> > My belief is that since NDMP is a common protocol, we should be able
> > to restore those via TSM to volumes on to the Infinidats or any other
> > alternate storage destination.
> >
>
> I think you find that ???computer says no???. I???m guessing that your 
> current NDMP dumps are in NetApp format, so you can possibly restore those to 
> every NetApp you wish, but nothing else.
>
> > Does anyone have any experience or tips? I feel that I'm only
> > scratching the surface with this topics.
> >
> >
> > Thank you
> > -Nick
> >
> >
> >
> > --
> >
> > PGP PUBLIC KEY
> >
> > https://keybase.io/marouf/key.asc
>
> --
>
>  Met vriendelijke groeten/Kind Regards,
>
> Remco Post
> r.p...@plcs.nl
> +31 6 248 21 622

--
-- Skylar Thompson (skyl...@u.washington.edu)
-- Genome Sciences Department, System Administrator
-- Foege Building S046, (206)-685-7354
-- University of Washington School of Medicine


Re: Extra client sessions

2016-09-01 Thread Rhodes, Richard L.
We see this behavior.  It happens once per week or so, usually with Windows 
servers, but not exclusively.  I've seen servers with 20-30-40 sessions. It 
happens with enough regularity that I put in a script that kills all sessions 
to a server with has more than 10 sessions.  The only cause we've ever 
identified for some of these situations (and the worse occurrences of this 
situation) is firewall setup problems.  



-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Thomas 
Denier
Sent: Wednesday, August 31, 2016 3:41 PM
To: ADSM-L@VM.MARIST.EDU
Subject: *EXTERNAL* Extra client sessions

We are occasionally seeing some odd behavior in our TSM environment.

We write incoming client files to sequential disk storage pools. Almost all of 
our client nodes use the default maxnummp value of 1.

When the odd behavior occurs, a number of clients will go through the following 
sequence of events:
1.The TSM server will send a request to start a backup.
2.The client will almost immediately open a TCP connection to be used as a 
producer session (a session used to obtain information from the TSM database).
3.Somewhere between tens of seconds and a few minutes later the client will 
open a TCP connection to be used as a consumer session (a session used to send 
copies of new and changed files).
4.Sometime later the client will open a third TCP connection and start using it 
as a consumer session.
5.The TSM server will report large numbers of transaction failures because it 
considers the original consumer session to be tying up the one mount point 
allowed for the node and hence has no way of storing files arriving on the new 
consumer session.

In most cases, all of the affected clients will hit step four within an 
interval of a couple of minutes.

My current theory is that step four occurs when the client system detects a 
condition that is viewed as a fatal error in the original consumer session, 
triggering the opening of a replacement consumer session. In most cases the TSM 
server never detects a problem with the original consumer session, and 
eventually terminates the session after five hours of inactivity (we have 
database backups that can legitimately go through long periods with no data 
transfer). More rarely the TSM server eventually reports that the original 
consumer session was severed.

We occasionally see cases where the replacement consumer session is in turn 
replaced by another new session, and even cases where the latter session is 
replaced by yet another session.

Our client population is a bit over half Windows, but almost all instances of 
the odd behavior involve only Windows client systems.

The affected systems are frequently split between two data centers, each with 
its own TSM server.

We have usually not found any correlation between the odd TSM behavior and 
issues with other applications. The most recent case was an exception. There 
were some e-mail delivery failures at about the same time as step four of the 
odd TSM behavior. The failures occurred when e-mail servers were unable to 
perform LDAP queries.

When we have asked our Network Operations group to check on previous 
occurrences of the odd behavior they have consistently reported that they found 
no evidence of a network problem.

Each of our TSM servers runs under zSeries Linux on a z10 BC. Each server has a 
VIPA address with two associated network interfaces on different subnets.

I would welcome any suggestions for finding the underlying cause of the odd 
behavior.

Thomas Denier,
Thomas Jefferson University
The information contained in this transmission contains privileged and 
confidential information. It is intended only for the use of the person named 
above. If you are not the intended recipient, you are hereby notified that any 
review, dissemination, distribution or duplication of this communication is 
strictly prohibited. If you are not the intended recipient, please contact the 
sender by reply email and destroy all copies of the original message.

CAUTION: Intended recipients should NOT use email communication for emergent or 
urgent health care matters.


Re: *EXTERNAL* Re: deleing data from a containerpool

2016-08-24 Thread Rhodes, Richard L.
I'm curious, what kind of storage system do ya'll use for your container pools?



-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of David 
Ehresman
Sent: Tuesday, August 23, 2016 8:56 AM
To: ADSM-L@VM.MARIST.EDU
Subject: *EXTERNAL* Re: deleing data from a containerpool

We are getting a 78% savings on a mixed workload (BA, Oracle, VM, Exchange, 
SQL) with about 350 nodes moving around 10TB of data a night.

David

-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Stefan 
Folkerts
Sent: Tuesday, August 23, 2016 8:43 AM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: [ADSM-L] deleing data from a containerpool

This inline deduplication and compression thing really is amazing;

excerpt from q stgpool f=d

Deduplication Savings: 153,840 G (90.83%)
  Compression Savings: 8,711 G (56.07%)
Total Space Saved: 162,550 G (95.97%)

So on top of the 90.83% deduplication saving (that dont' require any
reclaiming) this customer saves another 56.07% of the stored data due to
compression making it a total of 95.97% space saved.
These figures require a lot of duplicate data of course but still,
containerpools FTW!
We call it the "cool pool" btw. :-)



On Mon, Aug 22, 2016 at 4:01 PM, Del Hoobler <hoob...@us.ibm.com> wrote:

> Minor correction.
>
> Inline compression for container pools was added in March in 7.1.5.
>
>
> IBM Spectrum Protect 7.1.5 - Inline compression:
> - Performed in-line after deduplication to provide additional storage
> savings
> - Negligible impact on resources – uses latest and most efficient
> compression algorithms
> - Can potentially double (or more) your storage savings after
> deduplication
>
>
> Del
>
> 
>
>
> "ADSM: Dist Stor Manager" <ADSM-L@VM.MARIST.EDU> wrote on 08/22/2016
> 09:53:08 AM:
>
> > From: "Loon, Eric van (ITOPT3) - KLM" <eric-van.l...@klm.com>
> > To: ADSM-L@VM.MARIST.EDU
> > Date: 08/22/2016 09:53 AM
> > Subject: Re: deleing data from a containerpool
> > Sent by: "ADSM: Dist Stor Manager" <ADSM-L@VM.MARIST.EDU>
> >
> > Indeed, TSM 7.1.0 to 7.1.5 only supported deduplication, additional
> > compression was introduced in 7.1.6.
> > Kind regards,
> > Eric van Loon
> > Air France/KLM Storage Engineering
> >
> > -Original Message-
> > From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On
> > Behalf Of David Ehresman
> > Sent: maandag 22 augustus 2016 15:12
> > To: ADSM-L@VM.MARIST.EDU
> > Subject: Re: deleing data from a containerpool
> >
> > At the most recent levels of TSM, it both dedups and compresses but
> > make sure you are at a level that does both.  There was a level that
> > only did dedup but not compression.
> >
> > David
> >
> > -Original Message-
> > From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On
> > Behalf Of Rhodes, Richard L.
> > Sent: Monday, August 22, 2016 9:07 AM
> > To: ADSM-L@VM.MARIST.EDU
> > Subject: Re: [ADSM-L] deleing data from a containerpool
> >
> > >But I totally agree, everyone who is using file device
> >
> > >classes or expensive backend deduplication (like Data Domain or
> Protectier)
> >
> > >should seriously consider switching to container pools.
> >
> >
> >
> >
> >
> > We currently use DataDomains.
> >
> > With a DD it dedups what it can, then compresses the rest.
> >
> > Does TSM also try and compress what is leftover after dedup?
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> > -Original Message-
> >
> > From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On
> > Behalf Of Loon, Eric van (ITOPT3) - KLM
> >
> > Sent: Tuesday, August 16, 2016 3:39 AM
> >
> > To: ADSM-L@VM.MARIST.EDU
> >
> > Subject: Re: deleing data from a containerpool
> >
> >
> >
> > Hi Stefan!
> >
> > Our database is on SSD in an IBM V3700, but the time needed for a
> > del filespace can be significant though. But I totally agree,
> > everyone who is using file device classes or expensive backend
> > deduplication (like Data Domain or Protectier) should seriously
> > consider switching to container pools. We are working on a design
> > for our next TSM servers and we are able to lower our costs per TB
> > by 75% compared to the old design based on the Data Domain!
> >
> > Kind

Re: deleing data from a containerpool

2016-08-22 Thread Rhodes, Richard L.
>But I totally agree, everyone who is using file device 
>classes or expensive backend deduplication (like Data Domain or Protectier) 
>should seriously consider switching to container pools.


We currently use DataDomains.
With a DD it dedups what it can, then compresses the rest.  
Does TSM also try and compress what is leftover after dedup?






-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Loon, 
Eric van (ITOPT3) - KLM
Sent: Tuesday, August 16, 2016 3:39 AM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: deleing data from a containerpool

Hi Stefan!
Our database is on SSD in an IBM V3700, but the time needed for a del filespace 
can be significant though. But I totally agree, everyone who is using file 
device classes or expensive backend deduplication (like Data Domain or 
Protectier) should seriously consider switching to container pools. We are 
working on a design for our next TSM servers and we are able to lower our costs 
per TB by 75% compared to the old design based on the Data Domain!
Kind regards,
Eric van Loon
Air France/KLM Storage Engineering

-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Stefan 
Folkerts
Sent: dinsdag 16 augustus 2016 8:33
To: ADSM-L@VM.MARIST.EDU
Subject: Re: deleing data from a containerpool

Yes, I too have noticed this and it is something to keep in mind.
At the same time, I think almost everybody using this pool will be using SSD's 
for the database the impact will be overseeable.
But the directory containerpool is still the best thing to happen to Spectrum 
Protect since replication came along if you ask me. great performance increase 
over fileclass restores, no more stopping reclaims during the day to increase 
restore performance, no more messing with numopenvolsallowed and reclaim values 
and number of  processes to optimize daily operations and restore speed...oh, 
and compression that saves an easy 30-50% storage and license cost on top of 
the deduplication!




On Mon, Aug 15, 2016 at 11:20 AM, Loon, Eric van (ITOPT3) - KLM < 
eric-van.l...@klm.com> wrote:

> Hi all!
> After doing some extensive testing with a directory container 
> storagepool I noticed a significant change compared to the old 
> traditional storage pools.
> In a traditional storage pool TSM stores a file like an object. In 
> most cases one file is one object as far as I could see. Deleting this 
> data is very fast: a delete filespace runs rather fast because TSM 
> only has to delete the objects. So deleting a large database client 
> with multiple TBs takes a few seconds or maybe a few minutes.
> When you are using a container storage pool everything changes. Files 
> are still stored as objects, but objects are split into chunks. The 
> average size of a chuck is approx. 100 KB and TSM performs dedup on 
> this chuck level. So if you now delete a large file, TSM has to 
> inspect every chunk to see if it is unique or not. When it is unique 
> it will be deleted, otherwise not. If you delete a file which is for 
> instance 40 GB in size, TSM has to inspect around 420,000 chucks 
> before the object can be deleted. I noticed that this takes several 
> seconds to complete, so one has to take into consideration that the 
> deletion of large clients requires significant more time to complete than one 
> is used to.
> Deleing a client with little more than 1 TB of Oracle data was running 
> for more than 20 minutes. So a delete filespace for really large 
> database clients can run for hours! Has anyone else noticed this behavior too?
> Kind regards,
> Eric van Loon
> Air France/KLM Storage Engineering
> 
> For information, services and offers, please visit our web site:
> http://www.klm.com. This e-mail and any attachment may contain 
> confidential and privileged material intended for the addressee only. 
> If you are not the addressee, you are notified that no part of the 
> e-mail or any attachment may be disclosed, copied or distributed, and 
> that any other action related to this e-mail or attachment is strictly 
> prohibited, and may be unlawful. If you have received this e-mail by 
> error, please notify the sender immediately by return e-mail, and delete this 
> message.
>
> Koninklijke Luchtvaart Maatschappij NV (KLM), its subsidiaries and/or 
> its employees shall not be liable for the incorrect or incomplete 
> transmission of this e-mail or any attachments, nor responsible for any delay 
> in receipt.
> Koninklijke Luchtvaart Maatschappij N.V. (also known as KLM Royal 
> Dutch
> Airlines) is registered in Amstelveen, The Netherlands, with 
> registered number 33014286
> 
>

For information, services and offers, please visit our web site: 
http://www.klm.com. This e-mail and any attachment may contain confidential 

TSM Schema - what is a MB

2016-08-03 Thread Rhodes, Richard L.
This is probably a dumb question, but I can't seem to find the answer.

In the TSM DB2 schema, where fields are labeled _MB, does MB mean 
units of 1,000,000 or 1,048,576?

For example,

field:  TSMDB1 OCCUPANCY PHYSICAL_MB  DECIMAL 14

If I get a value of 123, is that 123 units of 1,000,000, or is it 123456 units 
of 1048576?


Thanks

Rick


AIX rmt devices in a library sharing environment - how do you handle them

2016-07-08 Thread Rhodes, Richard L.
Hi Everyone,

I'm wondering how others handle lining up tape paths of multiple TSM servers in 
a library sharing environment.

We have a TSM library sharing environment across our TSM instances for sharing 
our two 3584 libraries.  One 3584 at each datacenter with a dedicate TSm 
instance for the library manager.

Currently I have a script that crawls through all TSM instances, gets the wwn 
of each rmt device (lsattr -El rmtX), lines up all the wwn/rmt# for a drive and 
creates TSM path commands.  Kind of brute force, but has worked very well over 
the years.  I can create path cmds for everything in about 15m.  But, this 
means that a particular drive can have many different rmtX devices across our 
TSM servers.

A while ago I learned that you can rename a rmtX device (rendev -l rmtX -n 
rmtY).  I've been thinking about a new system where I rename the rmtX devices 
on each AIX lpar to a common name.

For example:  If a particular lpar has rmt1 which is our "a" 3584, and the 
drive is frame 1 drive 1, then I could call it rmta11.  There is atape involved 
with multi paths, so there  would also be -pri and -alt versions of the name 
somehow.  So this particular drive would have the same AIX device name across 
all AIX lpars.

So, I'm curious . . . What do you do to line up rmt devices?
Do you rename rmt devices to a common name, or, line up the many different rmt 
devices?
If you rename rmt devices, what issues/problems have you worked through?


Thanks

Rick




-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Re: FW: v7 upgrade woes

2016-07-06 Thread Rhodes, Richard L.
We got some good folks from IBM support to help out after getting our local IBM 
folks involved.  And now we appear to have an answer to our TSM v7 upgrades 
hanging.

We use DataDomain via NFS for file devices, tsm db backups, recplans, stuff 
(reports, etc) and (. . drum roll . .) archfailoverlogdir.

Starting in DB2 v10, db2 acquires a flock lock on it's files, and it appears 
that the DataDomain does not support this.  If DB2 can't acquire the lock, it 
just blocks forever.  This behavior appears to be preventable in AIX by 
specifying the NFS "llocl" mount option.  Or, we could just ditch the 
archfailoverlogdir.

This behavior can be tested by a small perl script found here:   
http://www-01.ibm.com/support/docview.wss?uid=swg21641535


+3 months to find out we needed an extra NFS mount option.
 
(All this is subject to more testing.)

Rick





> >
> >
> >
> > From: Rhodes, Richard L.
> > Sent: Tuesday, June 07, 2016 3:32 PM
> > To: 'ADSM: Dist Stor Manager' <ADSM-L@VM.MARIST.EDU>
> > Cc: Ake, Elizabeth K. <a...@firstenergycorp.com>
> > Subject: v7 upgrade woes
> >
> > This is half plea for help and half rant (grr).
> >
> > For the past two months we've been trying to test a TSM v6.3.5 to
> > v7.1.4/v7.1.5 upgrade . . . . and have completely failed!
> >
> > TSM v6.3.5
> > AIX 6100-09
> > upgrade to TSM v7.1.4 and/or v7.1.5
> >
> > When we run the upgrade it runs to this status message:
> > Installing: [(99%) com.tivoli.dsm.server.db2.DB2PostInstall ]
> > Then it sits, doing nothing.  AIX sees no db2 activity, no java activity,
> > no nothing.  It sits for hours!  We've let it sit once for 13 hours
> > (overnight) and the above message was still there.  Eventually we kill
> it.
> >
> > We've tried:
> >   two separate AIX systems
> >   two separate TSM's (one 400gb db and one 100gb db)
> >   probably tried 8-10 upgrades, all failed
> >
> > Support had us try a DB2 standalone upgrade and it also never finished.
> >
> > We've worked with support and got nowhere.  They have no idea what is
> > happening, let alone any idea of how to figure out what is happening.
> They
> > did find one issue - we have to install a base XLC runtime v13.1.0.0
> before
> > the v7 upgrade.
> >
> > Any thoughts are welcome.
> >
> > Rick
> >
> >
> >
> >


-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Re: ANR2174E - admin script failed

2016-07-06 Thread Rhodes, Richard L.
That worked.

I ran a "update schedule" cmd as the "admin" user, which changed the " Last 
Update by" to "admin".   Last night the script ran just fine.

So, don't create/update a admin schedule as a user they may get deleted in the 
future.

Thanks Gary!

Rick




-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Lee, 
Gary
Sent: Tuesday, July 05, 2016 9:38 AM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: ANR2174E - admin script failed

I believe that the id who last updated the administrative schedule is its owner.
Just update the sched with the same starttime for instance, and it should take 
off.


-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of 
Rhodes, Richard L.
Sent: Tuesday, July 05, 2016 9:16 AM
To: ADSM-L@VM.MARIST.EDU
Subject: [ADSM-L] ANR2174E - admin script failed

Q)  Now do you set the TSM Admin ID that an administrative script runs as?


Our team lead retired last week and we deleted her TSM admin id
from all our TSM servers.  The next day, one of our tsm servers
started failing our admin script that performs the db backup
and prepare.

  ANR2174E Administrator x is not registered.
Schedule P_ADMINPROCESSES is not processed and
is marked as failed.

The error manual says this:

  User response: Update the command schedule with a
valid administrator ID which has the proper authority
to execute the scheduled command.

So I pull up the "update sched" cmd and look for some kind of parm
to set the id the script runs as.  But, I don't see one.  I see no
way to tie a schedule to a admin ID, whether when the schedule is
created or updated.  I don't see anything in a admin schedule that
specifies the ID to run as.

  ./run_cmd.ksh  -l tsmX q schedule P_ADMINPROCESSES type=admin f=d
 Schedule Name: P_ADMINPROCESSES
   Description: Backup DB /devconfig / volhist
   Command: run p_adminprocesses
  Priority: 5
   Start Date/Time: 04/19/06   19:36:00
  Duration: 1 Hour(s)
Schedule Style: Classic
Period: 1 Day(s)
   Day of Week: Any
 Month:
  Day of Month:
 Week of Month:
Expiration:
   Active?: Yes
  Last Update by (administrator): xx
 Last Update Date/Time: 03/28/13   11:34:48
  Managing profile:

Other than "Last Update by", nothing specifies an admin id to run the script as.


-

The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Re: ANR2174E - admin script failed

2016-07-05 Thread Rhodes, Richard L.
I updated the schedule while logged in as "admin".  
It now has "admin" as the "Last Update by". 

   Last Update by (administrator): ADMIN

Will see what happens this evening.

If this IS how it works, that says you should ONLY create/update a admin 
schedule while logged in as an ID that will never be deleted.

btw:  this is TSM v6.3.5

Rick



-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Lee, 
Gary
Sent: Tuesday, July 05, 2016 9:38 AM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: ANR2174E - admin script failed

I believe that the id who last updated the administrative schedule is its owner.
Just update the sched with the same starttime for instance, and it should take 
off.


-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of 
Rhodes, Richard L.
Sent: Tuesday, July 05, 2016 9:16 AM
To: ADSM-L@VM.MARIST.EDU
Subject: [ADSM-L] ANR2174E - admin script failed

Q)  Now do you set the TSM Admin ID that an administrative script runs as?


Our team lead retired last week and we deleted her TSM admin id
from all our TSM servers.  The next day, one of our tsm servers
started failing our admin script that performs the db backup
and prepare.

  ANR2174E Administrator x is not registered.
Schedule P_ADMINPROCESSES is not processed and
is marked as failed.

The error manual says this:

  User response: Update the command schedule with a
valid administrator ID which has the proper authority
to execute the scheduled command.

So I pull up the "update sched" cmd and look for some kind of parm
to set the id the script runs as.  But, I don't see one.  I see no
way to tie a schedule to a admin ID, whether when the schedule is
created or updated.  I don't see anything in a admin schedule that
specifies the ID to run as.

  ./run_cmd.ksh  -l tsmX q schedule P_ADMINPROCESSES type=admin f=d
 Schedule Name: P_ADMINPROCESSES
   Description: Backup DB /devconfig / volhist
   Command: run p_adminprocesses
  Priority: 5
   Start Date/Time: 04/19/06   19:36:00
  Duration: 1 Hour(s)
Schedule Style: Classic
Period: 1 Day(s)
   Day of Week: Any
 Month:
  Day of Month:
 Week of Month:
Expiration:
   Active?: Yes
  Last Update by (administrator): xx
 Last Update Date/Time: 03/28/13   11:34:48
  Managing profile:

Other than "Last Update by", nothing specifies an admin id to run the script as.


-

The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


ANR2174E - admin script failed

2016-07-05 Thread Rhodes, Richard L.
Q)  Now do you set the TSM Admin ID that an administrative script runs as?


Our team lead retired last week and we deleted her TSM admin id
from all our TSM servers.  The next day, one of our tsm servers
started failing our admin script that performs the db backup
and prepare.

  ANR2174E Administrator x is not registered.
Schedule P_ADMINPROCESSES is not processed and
is marked as failed.

The error manual says this:

  User response: Update the command schedule with a
valid administrator ID which has the proper authority
to execute the scheduled command.

So I pull up the "update sched" cmd and look for some kind of parm
to set the id the script runs as.  But, I don't see one.  I see no
way to tie a schedule to a admin ID, whether when the schedule is
created or updated.  I don't see anything in a admin schedule that
specifies the ID to run as.

  ./run_cmd.ksh  -l tsmX q schedule P_ADMINPROCESSES type=admin f=d
 Schedule Name: P_ADMINPROCESSES
   Description: Backup DB /devconfig / volhist
   Command: run p_adminprocesses
  Priority: 5
   Start Date/Time: 04/19/06   19:36:00
  Duration: 1 Hour(s)
Schedule Style: Classic
Period: 1 Day(s)
   Day of Week: Any
 Month:
  Day of Month:
 Week of Month:
Expiration:
   Active?: Yes
  Last Update by (administrator): xx
 Last Update Date/Time: 03/28/13   11:34:48
  Managing profile:

Other than "Last Update by", nothing specifies an admin id to run the script as.


-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Re: OnTap read block size?

2016-07-01 Thread Rhodes, Richard L.
I forgot to say this is all Fibrechannel based luns on this NetApp head.  The 
partner head handles CIFS.

The aggregate is less than a third full:  9tb available, 2.6tb used.
It is comprised of 22x600gb HDD built as 2x(9d+2p).

  Aggregate 'aggrfcp'

Total spaceWAFL reserveSnap reserveUsable space   BSR NVLOG 
  A-SIS  Smtape
  10321542144KB1032154212KB 0KB9289387932KB 0KB 
0KB 0KB

  

  Aggregate   AllocatedUsed   Avail
  Total space  2655868604KB2616289680KB6519196976KB
  Snap reserve  0KB 0KB 0KB
  WAFL reserve 1032154212KB 114641872KB 917512340KB


All volumes (63 of them) hold only luns are are THIN.
All volumes have 32 snaps.
All volumes are snapmirrored to a 2nd datacenter.
All volumes are snapvaulted to another local NetApp/nSeries system.

Both lpars use VIO based virtual Fibrechannel adapters.
I'm going to test sequential I/O to another vendors storage system to rule (or 
point to) AIX/VIO as the problem.






From: Steiner, Jeffrey [mailto:jeffrey.stei...@netapp.com]
Sent: Thursday, June 30, 2016 7:05 AM
To: Sebastian Goetze <spgoe...@gmail.com>; Rhodes, Richard L. 
<rrho...@firstenergycorp.com>; toast...@teaparty.net
Subject: RE: OnTap read block size?

In theory, if read_realloc was off and the aggregate was close to 100% full you 
could get this kind of IO pattern. I doubt that's happening, but I can't rule 
it out.

I did a test with an all-Flash system where I pretty much puréed an aggregate. 
In a healthy environment, everything should be nicely allocated and a 
sequential read operation should result in huge read chains, like 64x4K blocks 
read as a unit. I took an aggregate and filled it up to 100% and then ran about 
72 hours of random overwrites. The end result was an array nothing was 
contiguous. All the 8K blocks were distributed randomly across all the disks. 
The read chains during sequential IO's were just 2. That would destroy 
performance on a system with spinning disk, but surprisingly it had no impact 
on my all-Flash system. Not a whit. That's why part of why there is no 
read_realloc on AFF systems at this time. It doesn't do anything useful.

I had to deliberately misconfigure the system to make that happen, though. I 
wouldn't expect a real-world environment to get into that situation.

From: Sebastian Goetze [mailto:spgoe...@gmail.com]
Sent: Thursday, June 30, 2016 12:34 PM
To: Steiner, Jeffrey 
<jeffrey.stei...@netapp.com<mailto:jeffrey.stei...@netapp.com>>; Rhodes, 
Richard L. <rrho...@firstenergycorp.com<mailto:rrho...@firstenergycorp.com>>; 
toast...@teaparty.net<mailto:toast...@teaparty.net>
Subject: Re: OnTap read block size?


Hi Rick,



in addition to what Jeff said:

What's going on with the GREADs? Is there a RAID-rebuild in progress?

That column should be 0 in normal circumstances and having this load in 
parallel to your DB load completely messes up the performance picture IMHO...



Oh, and the 'read_realloc' option on a volume with a "random write/sequential 
read" load often leads to nice performance improvements over time, dynamically 
optimizing the DB layout on disk and keeping the volume/file 'defragmented'.





Sebastian

On 6/30/2016 7:33 AM, Steiner, Jeffrey wrote:
NFS behavior depends on the OS. For example, on Linux if the application tries 
to do a 1MB read and you have an rsize set to 65536 what happens is the OS 
issues 8 parallel 64KB requests. The ONTAP system will pick up what's happening 
and start doing read requests.

You are indeed showing 16KB IO requests here. The read chain is about 4, which 
means 4 times 4K blocks.

Are you certain that you don't just have a database with a 16KB block size and 
you're doing 16KB random reads? If this was sequential IO, the read chain 
should be a lot larger. I can't think of a realistic scenario where AIX would 
break a sequential IO operation into a series of 16KB reads by itself.

Here's a theory - is someone misreading Oracle IO stats? If you see activity 
that is primarily db_file_sequential_read, then everything is doing exactly 
what it's supposed to do because db_file_sequential_read is random IO. 
Depending on who you ask, it's either a random reads of an index sequence or a 
sequence of random IO operations. Either way, it's random IO, so if you see a 
database doing db_file_sequential_io and it has a 16KB block size, that would 
explain this.

Sequential IO is performed as either direct_path_read or db_file_scattered 
read. Yes, that means random is sequential and sequential is scattered. 
Everyone confused yet? Specifically, db_file_scattered_read is a large-block 
sequential IO operation that is loaded into scattered memory buffers.

I can't tell you how many times this has caused confusion for DBA's wh

Re: OnTap read block size?

2016-07-01 Thread Rhodes, Richard L.
The dba tested on the two systems using NetApp/nSeries storage.
Both are AIX lpars

The QA system is AIX 7100-03
Host Utilities 6.0.0.0


  QA Mounts for one of 25 databases - all mounts are the same
 /dev/fslv148 /oracle/fnce20p/dbfiles jfs2   Jun 14 10:25 
rw,cio,log=/dev/loglv50
 /dev/fslv149 /oracle/fnce20p/temp jfs2  Jun 14 10:25 
rw,cio,log=/dev/loglv50
 /dev/fslv144 /oracle/fnce20p/logs1 jfs2 Jun 14 10:25 
rw,cio,log=/dev/loglv49
 /dev/fslv145 /oracle/fnce20p/logs2 jfs2 Jun 14 10:25 
rw,cio,log=/dev/loglv49
 /dev/fslv146 /oracle/fnce20p/archive jfs2   Jun 14 10:25 
rw,log=/dev/loglv49
 /dev/fslv147 /oracle/fnce20p/dump jfs2  Jun 14 10:25 
rw,log=/dev/loglv49
 /dev/ramdisk0/oracle/fnce20p/tempram jfs2   Jun 22 06:05 
rw,cio,log=INLINE
  One /etc/filesystems entry - all are the same
/oracle/fnce20p/dbfiles:
dev = /dev/fslv148
vfs = jfs2
log = /dev/loglv50
mount   = true
check   = false
options = rw,cio
account = false


The Prod system is AIX 6100-08
Host Utilities 6.0.0.0

  Prod Mounts for one of 25 databases - all mounts are the same
 /dev/fslv148 /oracle/fnce20p/dbfiles jfs2   Jun 28 20:30 
rw,cio,log=/dev/loglv50
 /dev/fslv147 /oracle/fnce20p/dump jfs2  Jun 28 20:30 
rw,log=/dev/loglv49
 /dev/fslv149 /oracle/fnce20p/temp jfs2  Jun 28 20:30 
rw,cio,log=/dev/loglv50
 /dev/fslv145 /oracle/fnce20p/logs2 jfs2 Jun 28 20:30 
rw,cio,log=/dev/loglv49
 /dev/fslv146 /oracle/fnce20p/archive jfs2   Jun 28 20:30 
rw,log=/dev/loglv49
 /dev/fslv144 /oracle/fnce20p/logs1 jfs2 Jun 28 20:30 
rw,cio,log=/dev/loglv49
  One /etc/filesystems entry - all are the same.
  Mount is "false" due to this being a Veritas VCS cluster.
 /oracle/fnce20p/dbfiles:
dev = /dev/fslv148
vfs = jfs2
log = /dev/loglv50
mount   = false
check   = false
options = rw,cio
account = false




From: jordan slingerland [mailto:jordan.slingerl...@gmail.com]
Sent: Wednesday, June 29, 2016 8:30 PM
To: Rhodes, Richard L. <rrho...@firstenergycorp.com>
Cc: toast...@teaparty.net
Subject: Re: OnTap read block size?


Please post the mount line from /etc/fstab or /etc/filesystems etc along with 
client os version
On Jun 29, 2016 10:44 AM, "Rhodes, Richard L." 
<rrho...@firstenergycorp.com<mailto:rrho...@firstenergycorp.com>> wrote:
OnTap 8.1.2p1

Our DBA's are complaining that our nSeries (N3220/FAS2240) is reading really 
slow due to it only returning small 16k blocks.  The DBA's are saying the 
Oracle multi-block read ahead should be reading 128 x 16k blocks = 2m read, but 
it's only seems to be reading/returning 16k at a time.

On a AIX filesystem mounted CIO, if I run
"dd if=/dev/zero of=z bs=1m count="
I see writes of 500k.

In the same filesystem mounted CIO, if I read an existing db file
  "dd if= of=/dev/null bs=1m"
I see reads of up to 30k.


Q) Is there a limit in OnTap on read size?


Thanks

Rick




The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.

___
Toasters mailing list
toast...@teaparty.net<mailto:toast...@teaparty.net>
http://www.teaparty.net/mailman/listinfo/toasters


-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


FW: v7 upgrade woes

2016-06-21 Thread Rhodes, Richard L.
Ahhh, the joy of IBM support!

We are stuck in between the narrow IBM support silos.

TSM support sees that the db2 database isn't working after an upgrade test and 
sent the case to DB2 support.
DB2 support says the database got a "already in use" error of some kind and 
wants to know what else is running. DB2 support has no idea what TSM is or that 
a TSM upgrade does.

We need someone who knows TSM, the upgrade process, DB2 and all this on AIX.  
But IBM support is incapable of having someone who crosses their narrow 
boundaries.  It seems our only way out is to either up this case to a Sev 1 or 
declare a CRITSIT and force IBM to get multiple areas involved.

We are SO frustrated.  Sometimes I wonder if the people inside IBM who use TSM 
have to use the same TSM support we do.

Rick




From: Rhodes, Richard L.
Sent: Friday, June 10, 2016 10:59 AM
To: 'ADSM: Dist Stor Manager' <ADSM-L@VM.MARIST.EDU>
Subject: FW: v7 upgrade woes

We've been testing . . . we tried walking all the upgrades:

- brought up a 6.3.5 tsm db
- tried upgrade to 7.1.4, it failed/hung (yup, responds like all our tests)
- restored snapshots back to the 6.3.5 setup
- tried upgrade v7.1- WORKED, TSM comes up fine
- tried upgrade to v7.1.1.1 - upg utility said there was nothing to upgrade!
- tried upgrade to v7.3 - Upgrade worked, but TSM hangs on startup

The v7.3 upgrade installed just fine and the upgrade utility ended.  But when 
we try to start TSM it just sits there hung.  While TSM is sitting there "hung" 
trying to come up, we do a "ps -ef | grep db2" and found that DB2 was NOT UP. 
(should have checked that sooner!)

  ps -ef | egrep -i "db2|dsm"
tsmuser 12910806 14221316   0 10:26:23  pts/4  0:00 
/opt/tivoli/tsm/server/bin/dsmserv -i /tsmdata/tsmsap1/config
tsmuser 17432632 12910806   0 10:26:24  pts/4  0:00 db2set -i tsmuser 
DB2_PMODEL_SETTINGS
   root 199885461   0 09:55:59  -  0:00 
/opt/tivoli/tsm/db2/bin/db2fmcd


You can leave the TSM startup "hung" like this for hours and it never goes any 
further.

We keep digging.  Support sent us to the DB2 team, hopefully they can help.

Rick





From: Rhodes, Richard L.
Sent: Tuesday, June 07, 2016 3:32 PM
To: 'ADSM: Dist Stor Manager' 
<ADSM-L@VM.MARIST.EDU<mailto:ADSM-L@VM.MARIST.EDU>>
Cc: Ake, Elizabeth K. 
<a...@firstenergycorp.com<mailto:a...@firstenergycorp.com>>
Subject: v7 upgrade woes

This is half plea for help and half rant (grr).

For the past two months we've been trying to test a TSM v6.3.5 to v7.1.4/v7.1.5 
upgrade . . . . and have completely failed!

TSM v6.3.5
AIX 6100-09
upgrade to TSM v7.1.4 and/or v7.1.5

When we run the upgrade it runs to this status message:
Installing: [(99%) com.tivoli.dsm.server.db2.DB2PostInstall ]
Then it sits, doing nothing.  AIX sees no db2 activity, no java activity, no 
nothing.  It sits for hours!  We've let it sit once for 13 hours (overnight) 
and the above message was still there.  Eventually we kill it.

We've tried:
  two separate AIX systems
  two separate TSM's (one 400gb db and one 100gb db)
  probably tried 8-10 upgrades, all failed

Support had us try a DB2 standalone upgrade and it also never finished.

We've worked with support and got nowhere.  They have no idea what is 
happening, let alone any idea of how to figure out what is happening.  They did 
find one issue - we have to install a base XLC runtime v13.1.0.0 before the v7 
upgrade.

Any thoughts are welcome.

Rick





-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Re: FW: v7 upgrade woes

2016-06-10 Thread Rhodes, Richard L.
We just brought up new pSeries chassis to rollover our existing pSeries 
chassis.  The new lpars will be AIX v7.  The plan is to get up to TSM v7, then 
swing the storage to new lpars on the new chassis.  Of course, testing all this 
swing is yet to occur.  We’ve got stuck just on the TSM v6-v7 upgrade.

Rick



-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Nick 
Marouf
Sent: Friday, June 10, 2016 2:37 PM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: FW: v7 upgrade woes

Fyi,
 When I upgraded on AIX I had went from 6.3.4.0 to 7.1.3.0 and then to
7.1.5.100 with no issues.

Date (GMT)   Version  Pre-release Driver
  
2016/06/01 18:29:52  7.1.3.0
2016/06/07 17:11:31  7.1.5.0


AIX 6100-09

next two upgrade are on AIX 7100-04

On Fri, Jun 10, 2016 at 12:28 PM, Zoltan Forray <zfor...@vcu.edu> wrote:

> Since I need to upgrade 6-TSM servers (2-of them at the same time since
> they are Library Managers) to 7.1.5.200, I am closely following this
> thread/discussion about upgrade issues.
>
> Have all these woes only been on AIX system?
>
> I tested an old decommissioned server (all user data had been exported to
> another TSM server) and upgraded from 6.3.5.100 to 7.1.3.00 base (Passport
> downloaded with license keys) and then to 7.1.5.100 with no issues.  Of
> course, mine are all RedHat 6 Linux.
>
> On Fri, Jun 10, 2016 at 10:59 AM, Rhodes, Richard L. <
> rrho...@firstenergycorp.com> wrote:
>
> > We've been testing . . . we tried walking all the upgrades:
> >
> > - brought up a 6.3.5 tsm db
> > - tried upgrade to 7.1.4, it failed/hung (yup, responds like all our
> tests)
> > - restored snapshots back to the 6.3.5 setup
> > - tried upgrade v7.1- WORKED, TSM comes up fine
> > - tried upgrade to v7.1.1.1 - upg utility said there was nothing to
> > upgrade!
> > - tried upgrade to v7.3 - Upgrade worked, but TSM hangs on startup
> >
> > The v7.3 upgrade installed just fine and the upgrade utility ended.  But
> > when we try to start TSM it just sits there hung.  While TSM is sitting
> > there "hung" trying to come up, we do a "ps -ef | grep db2" and found
> that
> > DB2 was NOT UP. (should have checked that sooner!)
> >
> >   ps -ef | egrep -i "db2|dsm"
> > tsmuser 12910806 14221316   0 10:26:23  pts/4  0:00
> > /opt/tivoli/tsm/server/bin/dsmserv -i /tsmdata/tsmsap1/config
> > tsmuser 17432632 12910806   0 10:26:24  pts/4  0:00 db2set -i tsmuser
> > DB2_PMODEL_SETTINGS
> >root 199885461   0 09:55:59  -  0:00
> > /opt/tivoli/tsm/db2/bin/db2fmcd
> >
> >
> > You can leave the TSM startup "hung" like this for hours and it never
> goes
> > any further.
> >
> > We keep digging.  Support sent us to the DB2 team, hopefully they can
> help.
> >
> > Rick
> >
> >
> >
> >
> >
> > From: Rhodes, Richard L.
> > Sent: Tuesday, June 07, 2016 3:32 PM
> > To: 'ADSM: Dist Stor Manager' <ADSM-L@VM.MARIST.EDU>
> > Cc: Ake, Elizabeth K. <a...@firstenergycorp.com>
> > Subject: v7 upgrade woes
> >
> > This is half plea for help and half rant (grr).
> >
> > For the past two months we've been trying to test a TSM v6.3.5 to
> > v7.1.4/v7.1.5 upgrade . . . . and have completely failed!
> >
> > TSM v6.3.5
> > AIX 6100-09
> > upgrade to TSM v7.1.4 and/or v7.1.5
> >
> > When we run the upgrade it runs to this status message:
> > Installing: [(99%) com.tivoli.dsm.server.db2.DB2PostInstall ]
> > Then it sits, doing nothing.  AIX sees no db2 activity, no java activity,
> > no nothing.  It sits for hours!  We've let it sit once for 13 hours
> > (overnight) and the above message was still there.  Eventually we kill
> it.
> >
> > We've tried:
> >   two separate AIX systems
> >   two separate TSM's (one 400gb db and one 100gb db)
> >   probably tried 8-10 upgrades, all failed
> >
> > Support had us try a DB2 standalone upgrade and it also never finished.
> >
> > We've worked with support and got nowhere.  They have no idea what is
> > happening, let alone any idea of how to figure out what is happening.
> They
> > did find one issue - we have to install a base XLC runtime v13.1.0.0
> before
> > the v7 upgrade.
> >
> > Any thoughts are welcome.
> >
> > Rick
> >
> >
> >
> >
> >
> > -
> >
> > The information contained in thi

Re: FW: v7 upgrade woes

2016-06-10 Thread Rhodes, Richard L.
Yes, they are all AIX 6100-09.

We have DR lpars for each PROD lpar.
When we upgrade we test by bringing up the appropriate TSM instance on it's DR 
server, perform the upgrade to test, leave the DR aix at the new TSM version, 
then upgrade the PROD lpar/TSM.  We've tested two TSM instances on their DR 
lpars and both have this problem. 

Given how others have no problem with v7 upgrade, I think it's something about 
our systems (AIX?), but we have no idea.  It's up to support . . .

Rick



-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Zoltan 
Forray
Sent: Friday, June 10, 2016 2:29 PM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: FW: v7 upgrade woes

Since I need to upgrade 6-TSM servers (2-of them at the same time since
they are Library Managers) to 7.1.5.200, I am closely following this
thread/discussion about upgrade issues.

Have all these woes only been on AIX system?

I tested an old decommissioned server (all user data had been exported to
another TSM server) and upgraded from 6.3.5.100 to 7.1.3.00 base (Passport
downloaded with license keys) and then to 7.1.5.100 with no issues.  Of
course, mine are all RedHat 6 Linux.

On Fri, Jun 10, 2016 at 10:59 AM, Rhodes, Richard L. <
rrho...@firstenergycorp.com> wrote:

> We've been testing . . . we tried walking all the upgrades:
>
> - brought up a 6.3.5 tsm db
> - tried upgrade to 7.1.4, it failed/hung (yup, responds like all our tests)
> - restored snapshots back to the 6.3.5 setup
> - tried upgrade v7.1- WORKED, TSM comes up fine
> - tried upgrade to v7.1.1.1 - upg utility said there was nothing to
> upgrade!
> - tried upgrade to v7.3 - Upgrade worked, but TSM hangs on startup
>
> The v7.3 upgrade installed just fine and the upgrade utility ended.  But
> when we try to start TSM it just sits there hung.  While TSM is sitting
> there "hung" trying to come up, we do a "ps -ef | grep db2" and found that
> DB2 was NOT UP. (should have checked that sooner!)
>
>   ps -ef | egrep -i "db2|dsm"
> tsmuser 12910806 14221316   0 10:26:23  pts/4  0:00
> /opt/tivoli/tsm/server/bin/dsmserv -i /tsmdata/tsmsap1/config
> tsmuser 17432632 12910806   0 10:26:24  pts/4  0:00 db2set -i tsmuser
> DB2_PMODEL_SETTINGS
>root 199885461   0 09:55:59  -  0:00
> /opt/tivoli/tsm/db2/bin/db2fmcd
>
>
> You can leave the TSM startup "hung" like this for hours and it never goes
> any further.
>
> We keep digging.  Support sent us to the DB2 team, hopefully they can help.
>
> Rick
>
>
>
>
>
> From: Rhodes, Richard L.
> Sent: Tuesday, June 07, 2016 3:32 PM
> To: 'ADSM: Dist Stor Manager' <ADSM-L@VM.MARIST.EDU>
> Cc: Ake, Elizabeth K. <a...@firstenergycorp.com>
> Subject: v7 upgrade woes
>
> This is half plea for help and half rant (grr).
>
> For the past two months we've been trying to test a TSM v6.3.5 to
> v7.1.4/v7.1.5 upgrade . . . . and have completely failed!
>
> TSM v6.3.5
> AIX 6100-09
> upgrade to TSM v7.1.4 and/or v7.1.5
>
> When we run the upgrade it runs to this status message:
> Installing: [(99%) com.tivoli.dsm.server.db2.DB2PostInstall ]
> Then it sits, doing nothing.  AIX sees no db2 activity, no java activity,
> no nothing.  It sits for hours!  We've let it sit once for 13 hours
> (overnight) and the above message was still there.  Eventually we kill it.
>
> We've tried:
>   two separate AIX systems
>   two separate TSM's (one 400gb db and one 100gb db)
>   probably tried 8-10 upgrades, all failed
>
> Support had us try a DB2 standalone upgrade and it also never finished.
>
> We've worked with support and got nowhere.  They have no idea what is
> happening, let alone any idea of how to figure out what is happening.  They
> did find one issue - we have to install a base XLC runtime v13.1.0.0 before
> the v7 upgrade.
>
> Any thoughts are welcome.
>
> Rick
>
>
>
>
>
> -
>
> The information contained in this message is intended only for the
> personal and confidential use of the recipient(s) named above. If the
> reader of this message is not the intended recipient or an agent
> responsible for delivering it to the intended recipient, you are hereby
> notified that you have received this document in error and that any review,
> dissemination, distribution, or copying of this message is strictly
> prohibited. If you have received this communication in error, please notify
> us immediately, and delete the original message.
>



--
*Zoltan Forray*
TSM Software & Hardware Administrator
Xymon Monitor Administrator
VMware Administrator (in training)
Virginia Commonwealth University
UCC/Office of Tec

FW: v7 upgrade woes

2016-06-10 Thread Rhodes, Richard L.
We've been testing . . . we tried walking all the upgrades:

- brought up a 6.3.5 tsm db
- tried upgrade to 7.1.4, it failed/hung (yup, responds like all our tests)
- restored snapshots back to the 6.3.5 setup
- tried upgrade v7.1- WORKED, TSM comes up fine
- tried upgrade to v7.1.1.1 - upg utility said there was nothing to upgrade!
- tried upgrade to v7.3 - Upgrade worked, but TSM hangs on startup

The v7.3 upgrade installed just fine and the upgrade utility ended.  But when 
we try to start TSM it just sits there hung.  While TSM is sitting there "hung" 
trying to come up, we do a "ps -ef | grep db2" and found that DB2 was NOT UP. 
(should have checked that sooner!)

  ps -ef | egrep -i "db2|dsm"
tsmuser 12910806 14221316   0 10:26:23  pts/4  0:00 
/opt/tivoli/tsm/server/bin/dsmserv -i /tsmdata/tsmsap1/config
tsmuser 17432632 12910806   0 10:26:24  pts/4  0:00 db2set -i tsmuser 
DB2_PMODEL_SETTINGS
   root 199885461   0 09:55:59  -  0:00 
/opt/tivoli/tsm/db2/bin/db2fmcd


You can leave the TSM startup "hung" like this for hours and it never goes any 
further.

We keep digging.  Support sent us to the DB2 team, hopefully they can help.

Rick





From: Rhodes, Richard L.
Sent: Tuesday, June 07, 2016 3:32 PM
To: 'ADSM: Dist Stor Manager' <ADSM-L@VM.MARIST.EDU>
Cc: Ake, Elizabeth K. <a...@firstenergycorp.com>
Subject: v7 upgrade woes

This is half plea for help and half rant (grr).

For the past two months we've been trying to test a TSM v6.3.5 to v7.1.4/v7.1.5 
upgrade . . . . and have completely failed!

TSM v6.3.5
AIX 6100-09
upgrade to TSM v7.1.4 and/or v7.1.5

When we run the upgrade it runs to this status message:
Installing: [(99%) com.tivoli.dsm.server.db2.DB2PostInstall ]
Then it sits, doing nothing.  AIX sees no db2 activity, no java activity, no 
nothing.  It sits for hours!  We've let it sit once for 13 hours (overnight) 
and the above message was still there.  Eventually we kill it.

We've tried:
  two separate AIX systems
  two separate TSM's (one 400gb db and one 100gb db)
  probably tried 8-10 upgrades, all failed

Support had us try a DB2 standalone upgrade and it also never finished.

We've worked with support and got nowhere.  They have no idea what is 
happening, let alone any idea of how to figure out what is happening.  They did 
find one issue - we have to install a base XLC runtime v13.1.0.0 before the v7 
upgrade.

Any thoughts are welcome.

Rick





-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


v7 upgrade woes

2016-06-07 Thread Rhodes, Richard L.
This is half plea for help and half rant (grr).

For the past two months we've been trying to test a TSM v6.3.5 to v7.1.4/v7.1.5 
upgrade . . . . and have completely failed!

TSM v6.3.5
AIX 6100-09
upgrade to TSM v7.1.4 and/or v7.1.5

When we run the upgrade it runs to this status message:
Installing: [(99%) com.tivoli.dsm.server.db2.DB2PostInstall ]
Then it sits, doing nothing.  AIX sees no db2 activity, no java activity, no 
nothing.  It sits for hours!  We've let it sit once for 13 hours (overnight) 
and the above message was still there.  Eventually we kill it.

We've tried:
  two separate AIX systems
  two separate TSM's (one 400gb db and one 100gb db)
  probably tried 8-10 upgrades, all failed

Support had us try a DB2 standalone upgrade and it also never finished.

We've worked with support and got nowhere.  They have no idea what is 
happening, let alone any idea of how to figure out what is happening.  They did 
find one issue - we have to install a base XLC runtime v13.1.0.0 before the v7 
upgrade.

Any thoughts are welcome.

Rick





-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Re: v6.3.5 backup/restore question

2016-05-12 Thread Rhodes, Richard L.
We got it working.  We were getting a sql error 2033 with a return code of 50.  
To resolve I did exactly what I list below.  

I'd be curious about about how others setup a DR server.
A DR server being a AIX system at a 2nd datacenter configured ready to have a 
restore run.
In our case, the db backup, recplan, and other pieces/parts is saved to a 
DataDomain that replicates to the 2nd datacenter.

Here is how I've been setting up a DR server:
- config AIX just like prod (storage, users, sftw(tsm, other))
- create a NEW/Clean TSM instance via dsmicftgx that is just like the prod 
instance
- run a "dsmserv removed tsmdb1"
- run a /opt/Tivoli/tsm/db2/instance/db2iset -d 
It's all ready now to unpack the recplan and perform a restore.
(I call this "priming" the DR server.)

I'd be interested in thoughts/comments and what you  do.

Thanks

Rick


 


-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of 
Sheridan, Peter T.
Sent: Thursday, May 12, 2016 10:57 AM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: v6.3.5 backup/restore question

I have successfully restored a 6.3.5 server with BA client version 7.1.0 ? Are 
u sure the BA client matches between prod server and DR server ? What error 
messages you getting ?  

Peter Sheridan
CUNA Mutual Group 
608-577-0539
peter.sheri...@cunamutual.com

-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of 
Rhodes, Richard L.
Sent: Thursday, May 12, 2016 9:37 AM
To: ADSM-L@VM.MARIST.EDU
Subject: [ADSM-L] v6.3.5 backup/restore question

We've been trying to restore a v6.3.5 TSM server onto a DR server with no 
success.

The PROD server is TSM v6.3.5 but the BA client is v7.1.4.
The DR serve is the same, TSM v6.3.5 with BA client v7.1.4.
Is this allowed?  Doesn't the API client have to match the TSM server level?

Thanks

Rick







-

The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


v6.3.5 backup/restore question

2016-05-12 Thread Rhodes, Richard L.
We've been trying to restore a v6.3.5 TSM server onto a DR server with no 
success.

The PROD server is TSM v6.3.5 but the BA client is v7.1.4.
The DR serve is the same, TSM v6.3.5 with BA client v7.1.4.
Is this allowed?  Doesn't the API client have to match the TSM server level?

Thanks

Rick







-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Re: Rolling a TSM instance to a new server/lpar

2016-05-09 Thread Rhodes, Richard L.
Thanks for the help.

I am somewhat familiar with db2ilist (and db2iset, db2idrop) from a 
"Inconsistent Home Directory" problem when we upgraded to TSM v6.   

Will have to test. . . .

Thanks!

Rick



-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of 
Michael Prix
Sent: Friday, May 06, 2016 2:52 PM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: Rolling a TSM instance to a new server/lpar

Hello Richard,

  gererally yes, it's that easy, but some more steps:

- on the old server do a "db2ilist" and for each instance reported do a 
"db2icrt " on the new server.

- be sure to have the same TSM-Server levels on old and new server, otherwise
you have to perform a "db2iupdt " for each instance. Naturally,
you can only upgrade, and the instance has to be mounted when performing the
command.

To find the full paths to the programs mentioned is left as an exercise for
the reader.

-- 
Michael Prix On Fr, 2016-05-06 at 16:55 +, Rhodes, Richard L. wrote:
> Hello,
> 
> Current:  TSM v6.3.5 on AIX 6100-09
> New:  TSM v6.3.5 on AIX 7something
> 
> Well, it's time to rollover our TSM AIX servers.  We're purchases new
> pSeries chassis that are getting lpar'ed up to replace the existing systems.
> 
> New lpars will be AIX v7.
> All storage is SAN based on either IBM or EMC storage arrays.
> All TSM/DB2 pieces/parts are on separate luns from AIX/rootvg.
>   In rootvg lun:
>  Whatever TSM/DB2 puts in /opt, /var/, /usr
>  (tsm client stuff is in here)
>   In non-rootvg luns:
>  db2 vols
>  db2 log vols (active/mirror/archive)
>  db2 sqllib dir
>  tsm stuff (dsmserv.opt, volhist, etc)
>  tsm disk pools
> 
> We would like to
>   - setup new/clean lpars with AIX v7 on the new chassis
>   - install TSM/DB2 binaries
>   - SWING THE non-rootvg luns from the old lpar to the new lpar
>   - bring up TSM . . .
> Is it really that easy
> 
> 
> PROBLEM - I can't find anything on how to swing a DB2 database from one AIX
> lpar to a new/clean lpar.  We're a Oracle shop - no one knows DB2 around
> here.
> 
> 
> Q)  Has anyone done a TSM storage swing like this?
> 
> 
> We are planning a TSM v7.1 upgrade.  We may need to do this to get to AIX
> v7.  I have to check this out.
> 
> Thanks
> 
> Rick
> 
> 
> 
> 
> 
> -
> The information contained in this message is intended only for the personal
> and confidential use of the recipient(s) named above. If the reader of this
> message is not the intended recipient or an agent responsible for delivering
> it to the intended recipient, you are hereby notified that you have received
> this document in error and that any review, dissemination, distribution, or
> copying of this message is strictly prohibited. If you have received this
> communication in error, please notify us immediately, and delete the
> original message.


-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Rolling a TSM instance to a new server/lpar

2016-05-06 Thread Rhodes, Richard L.
Hello,

Current:  TSM v6.3.5 on AIX 6100-09
New:  TSM v6.3.5 on AIX 7something

Well, it's time to rollover our TSM AIX servers.  We're purchases new pSeries 
chassis that are getting lpar'ed up to replace the existing systems.

New lpars will be AIX v7.
All storage is SAN based on either IBM or EMC storage arrays.
All TSM/DB2 pieces/parts are on separate luns from AIX/rootvg.
  In rootvg lun:
 Whatever TSM/DB2 puts in /opt, /var/, /usr
 (tsm client stuff is in here)
  In non-rootvg luns:
 db2 vols
 db2 log vols (active/mirror/archive)
 db2 sqllib dir
 tsm stuff (dsmserv.opt, volhist, etc)
 tsm disk pools

We would like to
  - setup new/clean lpars with AIX v7 on the new chassis
  - install TSM/DB2 binaries
  - SWING THE non-rootvg luns from the old lpar to the new lpar
  - bring up TSM . . .
Is it really that easy


PROBLEM - I can't find anything on how to swing a DB2 database from one AIX 
lpar to a new/clean lpar.  We're a Oracle shop - no one knows DB2 around here.


Q)  Has anyone done a TSM storage swing like this?


We are planning a TSM v7.1 upgrade.  We may need to do this to get to AIX v7.  
I have to check this out.

Thanks

Rick





-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Re: TSM Server 7.1.4 woes

2016-04-26 Thread Rhodes, Richard L.
Were you able to restore files after upgrading a client to a supported version?

Rick


-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of 
Michael Prix
Sent: Tuesday, April 26, 2016 7:04 AM
To: ADSM-L@VM.MARIST.EDU
Subject: TSM Server 7.1.4 woes

Hello all,

  it is well known that older clients are out of support, but still continue
to work with the capabilities they were designed for.
Now I and some colleagues of mine upgraded customers to TSM 7.1.4 and 7.1.5,
with client-versions ranging from 5.5 to 7.1, and all of a sudden all clients
<=6.1 can still backup to the server, but aren't any longer able to
restore/retrieve files. ANR4035W is reported.
While this might not be a situation where one could get support from IBM, it
is still a new situation as we as old *SMers are used to the fact that old
clients remain useable after an upgrade.

-- 
Michael Prix


-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Re: upgrading 6.3 to 7.1.x

2016-04-19 Thread Rhodes, Richard L.
Yes, that's my understanding.  The LM in a library sharing environment has to 
be upgraded first.
This is where we are - planning our LM instances upgrade to v7.1, then the 
clients.

Rick



-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Zoltan 
Forray
Sent: Tuesday, April 19, 2016 1:11 PM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: upgrading 6.3 to 7.1.x

Well, I did my first 6.3.5 to 7.1.3 (plan to jump to 7.1.5.100 next)
upgrade on a discontinued but still functioning server.  After correcting a
problem in the startup script, it seems to be running - mostly.

I am getting a strange error on my TS3500 Library Manager server.

4/19/2016 12:01:12 PM ANR0443W Protocol error on session 93137 for node
FIREBALL (Linux/x86_64) - invalid "driveList" field found in "MountVolume"
verb (offset 21).

FIREBALL is the name of the server just upgraded. I can't find anything via
Google.

I suspect it has to do with the LM server still being at 6.3.5.1 and needs
to be upgraded first?


On Mon, Apr 18, 2016 at 1:14 PM, Lee, Gary  wrote:

> When I  did it it was backup db, run install of 7.1.x then start server.
>
> However, one caveat, make sure you have sufficient empty space in your
> active log.  Recommendation is double the space you need for the log.
> Had this problem, it will not run the upgrade step if you have
> insufficient log space.
>



--
*Zoltan Forray*
TSM Software & Hardware Administrator
Xymon Monitor Administrator
VMware Administrator (in training)
Virginia Commonwealth University
UCC/Office of Technology Services
www.ucc.vcu.edu
zfor...@vcu.edu - 804-828-4807
Don't be a phishing victim - VCU and other reputable organizations will
never use email to request that you reply with your password, social
security number or confidential personal information. For more details
visit http://infosecurity.vcu.edu/phishing.html


-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Re: missing dsmlicense

2016-04-07 Thread Rhodes, Richard L.
It's interesting to think about . . . just what is special about what is on 
Passport Advantage.

From what I can see, the ONLY thing Passport Advantage provides is a protected 
download of the license file.  The TSM server itself is fully available from 
FixCentral.  So, why not just do that, make the Passport Advantage nothing more 
than a download of the license file and have all the rest downloaded from 
FixCentral.  

Rick



-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Nixon, 
Charles D. (David)
Sent: Thursday, April 07, 2016 9:36 AM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: missing dsmlicense

I'm super interested in seeing how this turns out.  Obviously, it's a pain 
point for many customers and IBM has seen this to be true based on the size of 
this thread.  Furthermore, it's a relatively simple fix.  Either update the new 
code to have the license or provide detailed directions in the documentation as 
to how one should set up a new server, as a few options have been presented 
thus far.

Will there be a change made or will this still be a problem with the release of 
the next version.  Is the Spectrum team actually agile, or are they just 
pumping out code every three months and calling it agile development?


---
David Nixon
Storage Engineer II
Technology Services Group
Carilion Clinic
451 Kimball Ave.
Roanoke, VA 24015
Phone: 540-224-3903
cdni...@carilionclinic.org

Our mission: Improve the health of the communities we serve.




Notice: The information and attachment(s) contained in this communication are 
intended for the addressee only, and may be confidential and/or legally 
privileged. If you have received this communication in error, please contact 
the sender immediately, and delete this communication from any computer or 
network system. Any interception, review, printing, copying, re-transmission, 
dissemination, or other use of, or taking of any action upon this information 
by persons or entities other than the intended recipient is strictly prohibited 
by law and may subject them to criminal or civil liability. Carilion Clinic 
shall not be liable for the improper and/or incomplete transmission of the 
information contained in this communication or for any delay in its receipt.


-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Re: missing dsmlicense

2016-04-07 Thread Rhodes, Richard L.
The installation guide makes the single comment "Passport Advantage is the only 
site that you can download a licensed package file from."That really 
doesn't explain the behavior, especially since you can do a full install from 
the package on FixCentral except for the license file.  The reality is that you 
must install at least the license file from the Passport Advantage file, then 
install/upgrade with what FixCentral has.  Maybe a few more words are in order.

Rick



-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of 
Maurice van 't Loo
Sent: Wednesday, April 06, 2016 4:14 PM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: missing dsmlicense

Hello Ben,

The license files are only included in the "protected area" of Passport
Advantage.
The "open" FTP area contains software without the licenses. Except for the
BA client.

@Andy,
It would help a lot if -only- the license pack was available at Passport
Advantage.
Now we need to download over 2GB of software for only a few kB's code.
Especially if you have a slow connection to the customers network, you have
double pain in case of installs.

Regards,
Maurice van 't Loo


2016-04-06 21:21 GMT+02:00 Alford, Ben <balf...@utk.edu>:

> Andi,
> It seems it would make this easier for the customers if IBM included the
> license with the newer levels (which are recommended for download), so that
> IBM's base level issue becomes irrelevant.It would simplify this for
> our users for sure!
>
> Ben Alford
> University of Tennessee
>
> -Original Message-
> From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of
> Andrew Raibeck
> Sent: Wednesday, April 6, 2016 11:40 AM
> To: ADSM-L@VM.MARIST.EDU
> Subject: Re: [ADSM-L] missing dsmlicense
>
> Hi all,
>
> The IBM Spectrum Protect server package is updated with a new license when
> the code is "re-based", i..e, that new level is being established as a new
> base level of the software (not necessarily an x.x.0.0 level). It is the
> re-based server packages that are put on Passport Advantage. 7.1.3.0 was
> the most recent re-base of the server.
>
> Best regards,
>
> Andy
>
>
> 
>
> Andrew Raibeck | IBM Spectrum Protect Level 3 | stor...@us.ibm.com
>
> IBM Tivoli Storage Manager links:
> Product support:
>
> https://www.ibm.com/support/entry/portal/product/tivoli/tivoli_storage_manager
>
> Online documentation:
>
> http://www.ibm.com/support/knowledgecenter/SSGSG7/landing/welcome_ssgsg7.html
>
> Product Wiki:
>
> https://www.ibm.com/developerworks/community/wikis/home/wiki/Tivoli%20Storage%20Manager
>
> "ADSM: Dist Stor Manager" <ADSM-L@VM.MARIST.EDU> wrote on 2016-04-06
> 11:21:23:
>
> > From: Robert Talda <r...@cornell.edu>
> > To: ADSM-L@VM.MARIST.EDU
> > Date: 2016-04-06 11:23
> > Subject: Re: missing dsmlicense
> > Sent by: "ADSM: Dist Stor Manager" <ADSM-L@VM.MARIST.EDU>
> >
> > Charles, et al:
> >   Been dealing with this type of issue on the various TDP software
> > packages for years.  Best I can tell, the licensing people had their
> > own sense of version/release/level/sub-level, and so we would often
> > have to install older versions of the TDP software then upgrade to the
> > version we wanted OR extract the license file from the old installer
> > and apply it post-new install.
> >
> >   Now that IBM has discarded the version/release/level/sub-level
> > model, I only expect this incongruency to only get worse.  Until, of
> > course, it gets better ;-)
> >
> >
> >
> > Robert Talda
> > EZ-Backup Systems Engineer
> > Cornell University
> > +1 607-255-8280
> > r...@cornell.edu
> >
> >
> > > On Apr 6, 2016, at 10:37 AM, Nixon, Charles D. (David)
> > <cdni...@carilionclinic.org> wrote:
> > >
> > > I second this question.  So the answer we got from our storage
> > software sales team is to download 7.1.3, extract the license file.
> > Then, download the version you want to want to use, extract and
> > install that, then copy the file over.  Seems like way more work than
> > it should be.  Do we only get new license files included once a
> year?
> > >
> > >
> > >
> > > 
> > > From: ADSM: Dist Stor Manager [ADSM-L@VM.MARIST.EDU] on behalf of
> > Matthew McGeary [matthew.mcge...@potashcorp.com]
> > > Sent: Wednesday, April 06, 2016 9:23 AM
> > > To: ADSM-L@VM.MARIST.EDU
> > > Subject: Re: [ADSM-L] missing dsml

Re: missing dsmlicense

2016-04-06 Thread Rhodes, Richard L.
I actually tried this.  I looked in the 7.1.3 install tree, but couldn't figure 
out where dsmlicense was hidden.  When TSM used AIX native installp filesets it 
was easy to hunt down something.

Rick







-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Nixon, 
Charles D. (David)
Sent: Wednesday, April 06, 2016 10:38 AM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: missing dsmlicense

I second this question.  So the answer we got from our storage software sales 
team is to download 7.1.3, extract the license file.  Then, download the 
version you want to want to use, extract and install that, then copy the file 
over.  Seems like way more work than it should be.  Do we only get new license 
files included once a year?



---
David Nixon
Storage Engineer II
Technology Services Group
Carilion Clinic
451 Kimball Ave.
Roanoke, VA 24015
Phone: 540-224-3903
cdni...@carilionclinic.org

Our mission: Improve the health of the communities we serve.



From: ADSM: Dist Stor Manager [ADSM-L@VM.MARIST.EDU] on behalf of Matthew 
McGeary [matthew.mcge...@potashcorp.com]
Sent: Wednesday, April 06, 2016 9:23 AM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: [ADSM-L] missing dsmlicense

Hello Rick,

Last time I checked Passport Advantage, I only had 7.1.3 available for download 
and the license file from 7.1.3 works fine in 7.1.4 and 7.1.5.  If you check 
your 7.1.3 files, you'll find the license there.

Can anyone from IBM tell me why 7.1.4 or 7.1.5 is not available on the Passport 
site?
__

Matthew McGeary
Senior Technical Specialist - Infrastructure
PotashCorp
T: (306) 933-8921
www.potashcorp.com<http://www.potashcorp.com>





From:    "Rhodes, Richard L." <rrho...@firstenergycorp.com>
To:ADSM-L@VM.MARIST.EDU
Date:04/06/2016 06:33 AM
Subject:[ADSM-L] missing dsmlicense
Sent by:"ADSM: Dist Stor Manager" <ADSM-L@VM.MARIST.EDU>





Hello,

We did a new install of TSM 7.1.4 just to check it out.
(ok, we screwed up a upgrade on a test instance and decided to do a new/clean 
install.)

After doing this install, it comes up with these messages:

 03/17/16   08:27:06 ANR9649I An EVALUATION LICENSE for IBM System Storage
 Archive Manager will expire on 04/15/16. (PROCESS: 6)

When you try and run reg lic, it throws this:

 ANR9613W Error loading /opt/tivoli/tsm/server/bin/dsmlicense for Licensing 
function.

That file does NOT exist.  It DOES exist on our existing TSM 6.4 systems.

IBM support thinks we have a mixed 64bit(dsmserv)/32bit(dsmlicense) problem,
but the file simply does not exist.


Q)  Where do you get the dsmlicense file for v7.1.4?

Thanks

Rick







-

The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.




Notice: The information and attachment(s) contained in this communication are 
intended for the addressee only, and may be confidential and/or legally 
privileged. If you have received this communication in error, please contact 
the sender immediately, and delete this communication from any computer or 
network system. Any interception, review, printing, copying, re-transmission, 
dissemination, or other use of, or taking of any action upon this information 
by persons or entities other than the intended recipient is strictly prohibited 
by law and may subject them to criminal or civil liability. Carilion Clinic 
shall not be liable for the improper and/or incomplete transmission of the 
information contained in this communication or for any delay in its receipt.


-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


FW: missing dsmlicense

2016-04-06 Thread Rhodes, Richard L.
Trying to remember things is getting harder and harder . . . .

I agree, on Passport Advantage there is no 7.1.4 or 7.1.5 for AIX.
(There IS a 7.1.4 server for Linux and S390.)

So, where did I get AIX 7.1.4 . . . Looks like from Fix Central.
AIX 7.1.4 and 7.1.5 are available on Fix Central.
(Why don't I remember downloading from there . . . . )

We did a new install from the Fix Central 7.1.4 which
doesn't include the license files.  The 7.1.3 from
Passport Advantage DOES include the license files
which we've now installed.

I guess this makes sense.

Rick



-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


missing dsmlicense

2016-04-06 Thread Rhodes, Richard L.
Hello,

We did a new install of TSM 7.1.4 just to check it out.
(ok, we screwed up a upgrade on a test instance and decided to do a new/clean 
install.)

After doing this install, it comes up with these messages:

  03/17/16   08:27:06 ANR9649I An EVALUATION LICENSE for IBM System Storage
  Archive Manager will expire on 04/15/16. (PROCESS: 6)

When you try and run reg lic, it throws this:

  ANR9613W Error loading /opt/tivoli/tsm/server/bin/dsmlicense for Licensing 
function.

That file does NOT exist.  It DOES exist on our existing TSM 6.4 systems.

IBM support thinks we have a mixed 64bit(dsmserv)/32bit(dsmlicense) problem,
but the file simply does not exist.


Q)  Where do you get the dsmlicense file for v7.1.4?

Thanks

Rick







-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Re: Migration should preempt reclamation

2016-02-18 Thread Rhodes, Richard L.
This is a tough one.  On the one hand we want Reclamation to use as many tape 
drives as possible, but not consume them all.  We also have multiple TSM 
instances wanting library resources.  The TSM instances are blind to each 
others needs.  This _IS_ difficult to control.

The _current_ solution controls reclamation completely manually from a set of 
scripts. 
It works something like this:

- we run a library sharing environment across a bunch of TSM instances
- reclamation is set to never run automatically - all stgpools are set 
to not run reclamation automatically (reclamation pct = 100)
- define the max number of drives reclamation can use in a library
   (reclamation can use up to this number)
- define the number unused drives in a library that MUST be UNUSED before 
   another reclamation is started
   (there are always some number of unused drives available for non-reclamation 
jobs to start)
- define on stgpools the number of reclamation process allowed - we set it to 1 
   (one reclamation process equals 2 tape drives)

Late morning we kick in the script

- Crawls through all our TSM instances and gets a count of tapes per stgpool
that could be reclaimed (above some rec pct).
- Sorts the list of stgpools/counts by the count
- Scripts loops.  
On each loop it will start a new stgpool reclamation if:
  - max number of drives allowed for reclamation hasn't been hit 
  - required number of unused drives are still unused

Later in the day we kill this script, letting running reclamation jobs run to 
completion.
If buy the next morning (when migrations want to run) we still have 
reclamations running, they get nuked!

. . .repeat each day . . . .



The result, at a gross level we keep some number of drives open for other 
sessions/jobs to use, and yet allow reclamation to use up to the defined limit 
of drives if no one other processes are using them.  

It has major flaws, but has really smoothed out our tape drive contention and 
resources used for reclamation.  The one thing I really like is that it lets 
the stgpool with the most reclaimable tapes in whatever TSm instance to run the 
longest.

One core overall issue - no amount of playing around like this can make up for 
not having the resources you need to drive TSM.  If you don't have the drives 
to process the work, nothing will really help. 

Rick





-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Roger 
Deschner
Sent: Wednesday, February 17, 2016 8:43 PM
To: ADSM-L@VM.MARIST.EDU
Subject: Migration should preempt reclamation

I was under the impression that higher priority tasks could preempt
lower priority tasks. That is, migration should be able to preempt
reclamation. But it doesn't. A very careful reading of Administrator's
Guide tells me that it does not.

We're having a problem with a large client backup that fails, due to a
disk stgpool filling. (It's a new client, and this is its initial large
backup.) It fills up because the migration process can not get a tape
drive, due to their all being used for reclamation. This also prevents
the client backup from getting a tape drive directly. Does anybody have
a way for migration to get resources (drives, volumes, etc) when a
storage pool reaches its high migration threshold, and reclamation is
using those resources? "Careful scheduling" is the usual answer, but you
can't always schedule what client nodes do. Back on TSM 5.4 I built a
Unix cron job to look for this condition and cancel reclamation
processes, but it was a real Rube Goldberg contraption, so I'm reluctant
to revive it now in the TSM 6+ era. Anybody have a better way?

BTW, I thought I'd give the 7.1.4 Information center a try to answer
this. I searched on "preemption". 10 hits none of which were the answer.
So I went to the PDF of the old Administrator's Guide and found it right
away. We need that book!

Roger Deschner  University of Illinois at Chicago rog...@uic.edu
==I have not lost my mind -- it is backed up on tape somewhere.=


-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Re: Bring back TSM Administrator's Guide

2016-02-04 Thread Rhodes, Richard L.
>  Maybe it's an "age thing."


Yea . . . I resemble that.

I find online documentation like the Info Centers to be ok for finding a single 
piece of information when you mostly know what you are looking for.  They are 
not good for trying to figure out any kind of a broader topic.  So I also 
download the PDF's and use them almost exclusively.  

Rick




-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of 
Richard Cowen
Sent: Wednesday, February 03, 2016 10:28 PM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: Bring back TSM Administrator's Guide

I could not have expressed my own opinions better- thank you Roger.
I still remember being skeptical going from the IBM Red Books (real paper) to 
PDF's.
But it's not the same leap going to online "information centers".  With each 
new release, I try again, but I am always disappointed.  Maybe it's an "age 
thing."

Richard

-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Roger 
Deschner
Sent: Wednesday, February 03, 2016 9:28 PM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: [ADSM-L] Bring back TSM Administrator's Guide

I'm glad that the last PDFs of this valuable book at Version 7.1.1 are being 
made more widely available. I have already downloaded that PDF to the USB thumb 
drive I carry around everywhere, for access regardless of the network 
condition. This could be in a disaster recovery scenario, or at a client node 
site where I might need to create a new account and password just to access the 
net and read the doc. The fact that it was deemed necessary to make this PDF 
more widely available, points out the problem.

If you are hinting that you are considering publishing an updated 7.1.5 
Administrator's Guide, that would be great! An important thing to update would 
be container storage pools. When to use them, how they compare to other types 
of storage pools (disk, file, tape, VTL...), and how to set them up and manage 
them. Perhaps include them in a new column in Table 5 on Page 77 of the 7.1.1 
Admin Guide. Another would be deduplication, which has a lot of new powerful 
features in 7.1.4, which will make it attractive to users who have not 
deduplicated before.

I rarely use the online Information Center. I find its hierarchical 
micro-partitioning of information to be way too narrowly focused, leading me to 
overlook obvious solutions to the problem at hand.
Especially new solutions such as container storage pools and the new features 
of deduplication. The Information Center is also especially poor in the client 
area. I always go to the PDFs first, even when online with fast network access. 
Therefore I can't give feedback in the way you suggest.

I tried the Custom PDF file creation facility, and I found it disappointing. 
The resulting PDF has only topics I could think of, and omits the ones I really 
need to solve a problem. It requires clairvoyance to make a useful PDF 
containing the answer to a problem that I haven't had yet, and it has no index.

So I am going to reiterate what I said before: Update the Administrator's Guide 
for 7.1.5, and keep it up-to-date going forward as a single book. This book is 
a key asset for the entire Spectrum Protect product, especially as existing 
customers seek to utilize features they haven't used before, and as new 
customers explore the incredible depth of features in the product.

Roger Deschner  University of Illinois at Chicago rog...@uic.edu
==I have not lost my mind -- it is backed up on tape somewhere.=


On Wed, 27 Jan 2016, Clare Byrne wrote:

>Following up on this thread, the 7.1.1 Administrator's Guide PDFs are 
>now available in IBM Knowledge Center at 
>http://www.ibm.com/support/knowledgecenter/SSGSG7_7.1.1/com.ibm.itsm.ts
>m.doc/r_pdfs_tsm.html This is in addition to where they were available 
>before, in the .zip file and on the Tivoli Storage Manager wiki. We 
>hope this makes it easier to find and access the 7.1.1 guides.
>
>A reminder: We are still very much interested in hearing about what the 
>most important subjects from the 7.1.1 Administrator's Guide are for us 
>to consider for updates. Knowing more specifics about your priorities 
>is very important to us to set priorities.
>
>One way to give such feedback privately: Go to any topic (in any 
>version) for Tivoli Storage Manager in IBM Knowledge Center and click 
>the Feedback link in the menu bar at the very bottom. If your comments 
>exceed the 1000-character limit in the feedback form, you can include 
>your email address in the feedback and ask us to contact you.
>
>Clare Byrne
>Information Development for IBM Spectrum Protect Tucson, AZ  US
>
>
>__
>
>Please be assured that we in IBM development are listening and are 
>discussing future actions regarding the Administrator's Guide content 
>since the feedback about the 7.1.3 release that did not include that book.
>I gave some information in a response to 

Re: SQL statement

2016-01-29 Thread Rhodes, Richard L.
If you get to a definitive sql statement, would love to see it!

Rick



-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Skylar 
Thompson
Sent: Friday, January 29, 2016 10:14 AM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: SQL statement

You could get a bit more complicated in the archive case, and exclude
filespaces where o.type='Arch'

On Fri, Jan 29, 2016 at 03:09:22PM +, Loon, EJ van (ITOPT3) - KLM wrote:
> Hi Erwann!
> As a matter of fact this one requires a little more care. Null can be the 
> result of a filespace backup which is interrupted and never restarted (i.e. 
> because it has been excluded from the backup) but you will also see null when 
> the filespace is only used for archiving. Creating an archive will not set 
> the "Last Backup Completion Date/Time" field.
> In the first case you can delete the filespace, in the second case you most 
> likely don't want to...
> Kind regards,
> Eric van Loon
> AF/KLM Storage Engineering
> 
> -Original Message-
> From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of 
> Erwann SIMON
> Sent: donderdag 28 januari 2016 16:46
> To: ADSM-L@VM.MARIST.EDU
> Subject: Re: SQL statement
> 
> Hi Eric,
> 
> You maybe should add a condition if backup_end is null
> 
> --
> Best regards / Cordialement /  
> Erwann SIMON
> 
> - Mail original -
> De: "EJ van Loon (ITOPT3) - KLM" 
> À: ADSM-L@VM.MARIST.EDU
> Envoyé: Jeudi 28 Janvier 2016 16:20:57
> Objet: Re: [ADSM-L] SQL statement
> 
> Hi Skylar!
> This is exactly what I was looking for. Thank you very much for your help!!!
> Kind regards,
> Eric van Loon
> AF/KLM Storage Engineering
> 
> -Original Message-
> From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of 
> Skylar Thompson
> Sent: donderdag 28 januari 2016 15:59
> To: ADSM-L@VM.MARIST.EDU
> Subject: Re: SQL statement
> 
> Hi EJ,
> 
> I think this will do the trick:
> 
> SELECT -
>f.node_name, -
>f.filespace_name, -
>f.backup_end, -
>CAST(ROUND(o.physical_mb/1024) as int) as "GB Stored" - FROM -
>filespaces f, -
>occupancy o -
> WHERE -
>o.node_name=f.node_name -
>AND o.filespace_name=f.filespace_name -
>AND days(f.backup_end)<(days(current_date)-30) - ORDER BY o.physical_mb 
> DESC
> 
> On Thu, Jan 28, 2016 at 02:43:54PM +, Loon, EJ van (ITOPT3) - KLM wrote:
> > Hi guys!
> > I'm trying to join the filespaces and occupancy tables in one SQL 
> > statement, but I get stuck on the point where I want to calculate with the 
> > amount of days...
> > I would like to create a list of filespaces (node_name, 
> > filespace_name,backup_end) which are not backed up for more than 30 days, 
> > along with the amount of data stored for them in GB 
> > (cast(round(physical_mb/1024) as int) as "GB Stored"), sorted on size, the 
> > largest first.
> > Can anybody help me out here? Thank you very much for your help in advance!
> > Kind regards,
> > Eric van Loon
> > AF/KLM Storage Engineering
> > 
> > For information, services and offers, please visit our web site: 
> > http://www.klm.com. This e-mail and any attachment may contain confidential 
> > and privileged material intended for the addressee only. If you are not the 
> > addressee, you are notified that no part of the e-mail or any attachment 
> > may be disclosed, copied or distributed, and that any other action related 
> > to this e-mail or attachment is strictly prohibited, and may be unlawful. 
> > If you have received this e-mail by error, please notify the sender 
> > immediately by return e-mail, and delete this message.
> >
> > Koninklijke Luchtvaart Maatschappij NV (KLM), its subsidiaries and/or its 
> > employees shall not be liable for the incorrect or incomplete transmission 
> > of this e-mail or any attachments, nor responsible for any delay in receipt.
> > Koninklijke Luchtvaart Maatschappij N.V. (also known as KLM Royal 
> > Dutch Airlines) is registered in Amstelveen, The Netherlands, with 
> > registered number 33014286
> > 
> 
> --
> -- Skylar Thompson (skyl...@u.washington.edu)
> -- Genome Sciences Department, System Administrator
> -- Foege Building S046, (206)-685-7354
> -- University of Washington School of Medicine
> 
> For information, services and offers, please visit our web site: 
> http://www.klm.com. This e-mail and any attachment may contain confidential 
> and privileged material intended for the addressee only. If you are not the 
> addressee, you are notified that no part of the e-mail or any attachment may 
> be disclosed, copied or distributed, and that any other action related to 
> this e-mail or attachment is strictly prohibited, and may be unlawful. If you 
> have received this e-mail by error, please notify the sender immediately 

DB2 active and mirror logs

2016-01-25 Thread Rhodes, Richard L.
Hello,

I just noticed something weird about "q log f=d" on all of our TSM systems.

(TSM v6.3.5.0)

==> dsmserv.opt log entries

   ACTIVELOGSize25000
   MIRRORLOGDirectory/tsmdata/tsmsap2/db2activelog2
   ACTIVELOGDirectory/tsmdata/tsmsap2/db2activelog1
   ARCHLOGDirectory  /tsmdata/tsmsap2/db2archivelog
   archfailoverlogdir/DD/tsmsap2/db2failoverlog


==> Filesystem info for DB2 logs:

  df -g
  Filesystem GB blocks  Free %UsedIused %Iused Mounted on
  /dev/db2activelog1 31.25  6.74   79%   55 1% 
/tsmdata/tsmsap2/db2activelog1  (active log)
  /dev/db2activelog2 31.25  6.74   79%   55 1% 
/tsmdata/tsmsap2/db2activelog2  (mirror log)
  /dev/db2archivelog 93.75 90.983%   23 1% 
/tsmdata/tsmsap2/db2archivelog  (archive log)

  Note how both the active/mirror logs are exactly the same - as expected.



==> Now a "q log f=d" for what TSM/DB2 thinks:

  tsm=tsmsap2 cmd=q log f=d
Active Log Directory: /tsmdata/tsmsap2/db2activelog1
 Total Space(MB): 24,576
  Used Space(MB): 157
  Free Space(MB): 24,419

   Archive Log Directory: /tsmdata/tsmsap2/db2archivelog
  Total Size of File System (MB): 96,000.00
  Space Used on File System (MB): 2,834.08
  Free Space(MB): 93,165.92

Mirror Log Directory: /tsmdata/tsmsap2/db2activelog2
  Total Size of File System (MB): 32,000.00
  Space Used on File System (MB): 25,093.63
  Free Space(MB): 6,906.37

  Archive Failover Log Directory: /DD/tsmsap2/db2failoverlog
  Total Size of File System (MB): 401,935,639.50
  Space Used on File System (MB): 317,544,655.50
  Free Space(MB): 84,390,984.00


==> Question

Note how the MIRROR LOG shows filesystem totals for total/used/free space.
But the ACTIVE LOG is the space in the actual log files allocated with the 
used/free space.

Anyone have an idea why the difference in display between ACTIVE and MIRROR 
output?


Thanks

Rick



-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Re: LTO-5 Compression ratio

2016-01-07 Thread Rhodes, Richard L.
>Compression ratio is up to 5.8:1,
>Stored data are Oracle/DB2/SAP Oracle, full backups and logs.

We generally see about 4x compression for our Oracle db backups.

Rick





-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Re: Bring back TSM Administrator's Guide

2015-12-17 Thread Rhodes, Richard L.
Great Comments!

I've often wondered if IBM appreciates just how complicated TSM is.

We had a big discussion the other day about would we recommend TSM to other 
possible customers.
The answer we a very qualified "yes".  We really like TSM for its core feature 
- incremental forever backup system.  It saved our posteriors years ago when we 
were drowning in periodic full backups, especially from remote sites.  But the 
tradeoff is learning/maintaining a very complicated program that requires lots 
of resources.  Roger below mentions policies.  To this day, after working with 
TSM for many years (since TSM v3.7), if the topic of policies comes up I have 
to look up and refresh my memory of what they are and how they interact.  And 
then, try and explain them to a user/manager/auditor/whomever.

The Admin Guide is the best document I know of for how TSM fits together - how 
to get your head around TSM.  No other documentation comes close.  Losing it 
would be a big loss.

Sometimes when we talk we wonder if the folks who develop and support TSM (and 
most products today from all vendors) actually use their own products like we 
use them.  If all they had to learn/use TSM was the standard documentation, I 
wonder how far they would get.  This is why this mailing list is SO great!

Rick



-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Roger 
Deschner
Sent: Wednesday, December 16, 2015 11:06 PM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: Bring back TSM Administrator's Guide

Thank you for your response Clare. It's good to know these comments are
being read.

There are a large number of areas that cannot be covered separately. A
very large topic is Policy, which is one of Spectrum Protect's hardest
to understand areas, yet it affects and is affected by everything else.
For instance, it has been essential to understand Policy in crafting our
hybrid D2D2D2T solution. Or when the auditor came and said we needed to
keep just a certain set of files for five years. The Admin Guide covered
Policy well enough that you could make your way through its many
complexities and get it to work for you. But to cover Policy adequately,
it had to refer to many other areas of the book.

Policy is just one example, which really needs everything else in the
book, in order to explain it well enough. But it needs to all be in one
place. I carry 4 PDFs (Admin Guide, Admin Ref, Windows Client, Unix
Client) around on a USB stick so I can refer to them wherever I am and
whatever the network is there.

Another topic that the solution guides simply do not cover, is the
complex interrelationships between storage pools of different kinds -
tape, VTL, disk, file, optical, etc, and how to structure migration,
reclamation, collocation, and storage pool backup to make the data flow
among them the way you want.

There's sveral other topics of similar complexity, such as managing the
client scheduler, and how to build a daily schedule of server
activities.

There are of course specialized topics that shouldn't be in there. You
mentioned NDMP. Another is V5 to V6/7 migration. Virtual Machines could
be its own book.

The basic issue here is that, as the sophisticated and fully evolved
"best of breed", Spectrum Protect has a rather steep learning curve. It
always has, since it was WDSF. After 20 years with WDSF/ADSM/TSM/SP I am
still learning things, and I still refer to the Admin Guide frequently.

Doing away with its best documentation can only hurt this highly
sophisticated product. Coherent how-to knowledge is the essential weapon
in the face of complexity. Without the Administrator's Guide, more will
simply declare Spectrum Protect to be "too complicated to understand",
and settle for an inferior solution that is easier to understand. It's a
battle that those of us who know the product well, constantly fight,
which is why this book is so essential to the product.

Roger Deschner  University of Illinois at Chicago rog...@uic.edu
==I have not lost my mind -- it is backed up on tape somewhere.=


On Tue, 15 Dec 2015, J. Pohlmann wrote:

>Hi Clare. The Admin Guide provided a one-stop shopping approach to all
>functional areas of Spectrum Protect. I think this is what's missing from
>the current documentation. Clearly the Admin Guide was aimed at an
>experienced person as opposed to a novice. In an initial Spectrum Protect
>implementation, the Solutions Guides are of value. However they fall short
>in supplying guidance and "how-to" or "setup" information to an existing
>installation. So, even though the Admin Guide became bigger over the
>releases, the topics are still of extreme value. For example tape is still
>aa viable media, especially in the light of LTO 7 technology. It fits into
>large to very large enterprises, yet when it comes to media management of
>disaster protection implementation, we have no guidance in the new
>publications. So, I would vote for the return of the 

Re: Does a DB2 db ever shrink?

2015-11-18 Thread Rhodes, Richard L.
Thanks!

What is weird is that there doesn't seem to be anything to release.  
TSM is reporting that it has only 12,944 free blocks.  

After deleting 12% of the files (65m) and expiration completing,
we were expecting the free blocks to be in the millions.  

I don't need the space back, I just want to know that TSM/DB2 
will reuse the space.  Instead, overall db size just keeps 
increasing!!!  As you can see below, the db keeps
growing some number of MB per day. 

(from a q db)
 tsm  FileSysMB UsedMB  FreeMB   date
 tsm8  1126400  700615  425785  201501
 tsm8  1126400  700709  425691  201502
 tsm8  1126400  701544  424856  201503
 tsm8  1126400  701675  424725  201504
 tsm8  1126400  701669  424731  201505
 tsm8  1126400  701669  424731  201506
 tsm8  1126400  701669  424731  201507 
 tsm8  1126400  701676  424724  201508 <= 65m files gone
 tsm8  1126400  701678  424722  201509
 tsm8  1126400  701678  424722  201510
 tsm8  1126400  701742  424658  201511
 tsm8  1126400  701804  424596  201512
 tsm8  1126400  701797  424603  201513
 tsm8  1126400  701797  424603  201514
 tsm8  1126400  702151  424249  201515
 tsm8  1126400  702149  424251  201516
 tsm8  1126400  702185  424215  201517
 tsm8  1126400  702248  424152  201518

(from occupancy)
date  #FilesInDbDbGB
 11/01/2015504786214701785
 11/08/2015436723183701676 <= -65m files gone!
 11/17/2015436456172702185





-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Loon, 
EJ van (ITOPT3) - KLM
Sent: Tuesday, November 17, 2015 11:00 AM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: Does a DB2 db ever shrink?

Hi Rick!
Here is the procedure to release space to the operating system on a 6.3 server:
http://www-01.ibm.com/support/docview.wss?uid=swg21452146#Release_spaceDB297
Kind regards,
Eric van Loon
AF/KLM Storage Engineering


-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of 
Rhodes, Richard L.
Sent: dinsdag 17 november 2015 16:55
To: ADSM-L@VM.MARIST.EDU
Subject: Does a DB2 db ever shrink?

Hi,

On one of our TSM v6.3.5 databases we deleted two nodes which totaled 65m 
files.  After doing this we haven't seen any shrinkage in the database size.

 date  #FilesInDbDbGB
  11/01/2015504786214701785
  11/08/2015436723183701676 <= -65m files gone!
  11/17/2015436456172702185

The free db2 blocks (today) is 12,944.

By deleting the two nodes we dropped the number files by 65m files.  But the 
database itself hasn't changed in size (filesystem size) or free blocks inside 
the db.  The db2 is set to auto-reorg (the default).

Q)  Why wouldn't our db2 db shrink, or, have gobs of free db2 blocks?


Thanks

Rick


-

The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.

For information, services and offers, please visit our web site: 
http://www.klm.com. This e-mail and any attachment may contain confidential and 
privileged material intended for the addressee only. If you are not the 
addressee, you are notified that no part of the e-mail or any attachment may be 
disclosed, copied or distributed, and that any other action related to this 
e-mail or attachment is strictly prohibited, and may be unlawful. If you have 
received this e-mail by error, please notify the sender immediately by return 
e-mail, and delete this message. 

Koninklijke Luchtvaart Maatschappij NV (KLM), its subsidiaries and/or its 
employees shall not be liable for the incorrect or incomplete transmission of 
this e-mail or any attachments, nor responsible for any delay in receipt. 
Koninklijke Luchtvaart Maatschappij N.V. (also known as KLM Royal Dutch 
Airlines) is registered in Amstelveen, The Netherlands, with registered number 
33014286




-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in erro

Does a DB2 db ever shrink?

2015-11-17 Thread Rhodes, Richard L.
Hi,

On one of our TSM v6.3.5 databases we deleted two nodes which totaled 65m 
files.  After doing this we haven't seen any shrinkage in the database size.

 date  #FilesInDbDbGB
  11/01/2015504786214701785
  11/08/2015436723183701676 <= -65m files gone!
  11/17/2015436456172702185

The free db2 blocks (today) is 12,944.

By deleting the two nodes we dropped the number files by 65m files.  But the 
database itself hasn't changed in size (filesystem size) or free blocks inside 
the db.  The db2 is set to auto-reorg (the default).

Q)  Why wouldn't our db2 db shrink, or, have gobs of free db2 blocks?


Thanks

Rick


-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


AIX VIO based tape drives

2015-10-29 Thread Rhodes, Richard L.
Hi Everyone,

Currently our AIX TSM servers are lpars with all physical adapters (separate 
physical HBAs for disk and tape, and physical NICs networking).  Next year we 
will be rolling over a couple chassis to new ones, and upgrading to AIX v7.

Is anyone using VIO based tape drives on your TSM servers?
What is your experience?
How do VIO based tape drives interact with Atape load balancing in the lpar?

When we used VIO based tape drives for some storage agents, we hit a 64 target 
limit on a virtual HBA.  Seeing that we have two libraries with a total of 68 
tape drives, this seems like it will force us to stay with physical HBA's for 
tape.


Rick






-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Re: Script question

2015-09-08 Thread Rhodes, Richard L.
You didn't indicate which operating system.
Here is a AIX/KSH script to prompt for and change a node password.

#!/usr/bin/ksh

print ""
print "Dialog to change a NODE password."
print ""
print "Please enter a node name, or partial node name.  I'll do a lookup on it 
for you!"
read Inode
print ""
print "You entered $Inode , performing lookukp . . . "
/tsmdata/tsm_scripts/q_node.ksh $Inode
print ""
print "There, it should be one of the above. "
print "Please enter the FULL NODE NAME from above."
Inode=""
read Inode
print ""
print "The node we are going to change is $Inode"
print ""
print "Please enter the TSM instance of the node."
read Itsm
print ""
print "The node is in  $Itsm"
print ""
print "Please enter the new password."
read Ipwd
print ""
print "TODO: chg pwd for  node= $Inode  tsm= $Itsm  newpwd= $Ipwd"
print "type \"ok\" to proceed"
read Iok
if [[ $Iok == 'ok' ]]; then
print ""
print "performing change . . . "
/tsmdata/tsm_scripts/run_cmd.ksh $Itsm "update node $Inode $Ipwd"
print ""
print "all done"
else
print ""
print "terminating"
fi




-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Robert 
Ouzen
Sent: Monday, September 07, 2015 9:48 PM
To: ADSM-L@VM.MARIST.EDU
Subject: Script question

Hi to all

Anybody have an example for during a script , asking for a parameter. Waiting 
for the input and after pass the parameter to a command

For example something like this:

"Please enter the process number   $1 "
Waiting ...
can pr   $1

Best Regards

Robert


-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Re: nfs mounted tsm storage becoming unavailable

2015-09-08 Thread Rhodes, Richard L.
It sounds like you are pre-defining the file vols on the NFS share.
If you pre-define vols I believe TSM writes the entire vol 
to initialize it.  That would be a very heavy write load.  It sounds 
like maybe the NFS server is overloaded and maybe causing I/O errors to 
the other TSM's.  

Are you seeing ANR errors in the actlog of any of the TSM servers
when this problem occurs?

I'd check the network stats for your TSM server and NFS server.  
Possibly getting  lan errors under heavy load is causing problems.

Are your NFS shares mounted hard?  I believe they should be.

Run around - don't pre-define vols, let TSM to create scratch vols as needed.  
That's what we do for our NFS DataDomain shares.

Just some thoughts!

Rick



-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Lee, 
Gary
Sent: Tuesday, September 08, 2015 10:38 AM
To: ADSM-L@VM.MARIST.EDU
Subject: nfs mounted tsm storage becoming unavailable

We are trying to troubleshoot a problem with our tsm disk storage.

Tsm server 6.3.4 running on RHEL 6.5.
Our storage is a set of subdirectories on a file system mounted via nfs v3 to 
all three of our tsm servers.

All goes fine until an attempt is made to define one or more volumes to a 
storage pool.
At that time, if other tsm servers are writing to the storage, those volumes 
will become red-only when the volume define is in process.

Other operations, such as reclamation, and normal writing do not cause problems.

Our storage provider, (nexenta) is asking what tsm does when creating a storage 
volume.
So, I am coming to the list for information.  Just what does tsm do under the 
covers when defining a storage volume?

Thanks for any help.


-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


MAGS for parallel NSA backup

2015-08-14 Thread Rhodes, Richard L.
Hello,

In the near future we may be replacing our Windows server CIFS shares with a 
NAS appliance.  In doing some reading I came across a blog post about a 3rd 
party tool, MAG (Massive Attack General Storage), that will automatically 
create parallel TSM backup sessions for a share.  I was just wondering if 
anyone has heard of this and any experience with it.

http://stefanradtke.blogspot.com/2015/01/backup-onefs-data-over-nfscifs-with-tsm.html


Thanks

Rick


-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Re: script to get library drive Serial Nos from OS level

2015-08-07 Thread Rhodes, Richard L.
For AIX the info comes from a lscfg cmd.

lscfg -vl rmt2 
  rmt2 U5802.001.008C845-P1-C1-T2-W500507630F433527-L0  IBM 3592 
Tape Drive (FCP)

ManufacturerIBM
Machine Type and Model..03592E07
Serial Number...078DFE07
Device Specific.(FW)390E
Loadable Microcode LevelA1700D78

lscfg -vl smc0
  smc0 U5802.001.008C845-P1-C1-T2-W500507630F433501-L1  
IBM 3584 Library Medium Changer (FCP)

ManufacturerIBM
Machine Type and Model..03584L22
Serial Number...078A02900401
Device Specific.(FW)C460

On AIX you can use the rendev cmd to rename a rmt devices.  You can make all 
rmt's for a specific drive the same name across all AIX servers.  I don't do 
this now, but want to implement this in the near future.

Rick





-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of 
Srikanth Kola23
Sent: Thursday, August 06, 2015 3:51 PM
To: ADSM-L@VM.MARIST.EDU
Subject: Reg: script to get library  drive Serial Nos from OS level

Hi Team,

I am in the need of collecting drive  library serial numbers for 50
servers from os level for lanfree setup

any scripts for me to fetch data

I have AIX , Linux boxes

library 3573 scsi ( linux  AIX )

Emc data domain(VTL) (linux)

Thanks  Regards,

Srikanth kola
Backup  Recovery
IBM India Pvt Ltd, Chennai
Mobile: +91 9885473450


-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Re: help with designing a backup system for Teradata

2015-07-31 Thread Rhodes, Richard L.
 What type of storeage system are you using? Does it have the necessary I/O 
 capability to allow the throughput you are going to require?

The I/O is coming from the Teradata box.

Teradata is a dedicated Database system that is highly
optimized and uses very high parallelism.  We are told
it can pump the backup out really fast, as long as it's
tuned correctly.  The DBA's are responsible for this side
of things.

Teradata has a backup program called Bar which runs on
dedicated servers (one or more)(Windows or Linux) that interfaces
to the Teradata database engine.  From or understanding, this
program does not handle any media, including writing to
disk.  It expects to interface with another program
(TSM, NetBackup, etc).
They have written a interface to the TSM API client.

Rick






-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Re: help with designing a backup system for Teradata

2015-07-30 Thread Rhodes, Richard L.
Anything we do for this has to be purchased, so current licensing is not a 
problem.

I'm not sure what using DDBoost would look like.
Where would the plugin run?  I don't think there is a DDboost plugin for TSM or 
Teradata's program.  I know there are plugins for Networker, NetBackup, 
Oracle/RMAN and others, but I don't think for Teradata.  Yea, it would really 
be nice to just bypass TSM altogether, but the Teradata backup program doesn't 
support backup-to-disk.  It want's to feed an API interface, like TSM's API 
client.

Rick



-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Mike 
De Gasperis
Sent: Thursday, July 30, 2015 2:16 PM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: help with designing a backup system for Teradata

Do you have DDboost licensed?  Could always use the boost plugin and go right 
to the DD and skip the TSM server. 



 On Jul 30, 2015, at 1:00 PM, Rhodes, Richard L. rrho...@firstenergycorp.com 
 wrote:
 
 We purchased a Teredata database system.
 It currently is in test/dev stage with little data.
 We don't really know the ultimate backup requirements.
 To get things started we setup a simple backup system:
 
   Teradata
- to Bar server (Win) with TSM interface sftw
- to TSM server (AIX)
- to filepool on DataDomain (getting ~5x dedup)
 
   From the Bar server to TSM server is a standard 1GB ethernet.
 
 Now we need to scale up/out!
 
 The consultants are saying we will need to backup 30TB in a 6hr window,
 but maybe has high as 50TB in 6hr.
 That is (roughly):
 30TB in 6hr = 1,400 MB/sec
 50TB in 6hr = 2,300 MB/sec
 
 So we need to design a TSM backup system to support this.
 
 My thoughts:
 
 1) Put a storage agent on the Bar server (Win server)
 and feed a VTL via 4x8gb san connections via a bunch of virtual tape.
 
 2) Put the TSM server directly on the Bar server for just
 local tape and still feed a VTL as above.
 No library sharing.
 
 3) I'd really like to not use tape (even virtual tape),
 but I can't think of any way to feed file devices
 with that throughput.
 
 I'd appreciate any thought/comments anyone might have!
 
 Thanks
 
 Rick
 
 
 
 
 -
 The information contained in this message is intended only for the personal 
 and confidential use of the recipient(s) named above. If the reader of this 
 message is not the intended recipient or an agent responsible for delivering 
 it to the intended recipient, you are hereby notified that you have received 
 this document in error and that any review, dissemination, distribution, or 
 copying of this message is strictly prohibited. If you have received this 
 communication in error, please notify us immediately, and delete the original 
 message.


-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


help with designing a backup system for Teradata

2015-07-30 Thread Rhodes, Richard L.
We purchased a Teredata database system.
It currently is in test/dev stage with little data.
We don't really know the ultimate backup requirements.
To get things started we setup a simple backup system:

   Teradata
- to Bar server (Win) with TSM interface sftw
- to TSM server (AIX)
- to filepool on DataDomain (getting ~5x dedup)

   From the Bar server to TSM server is a standard 1GB ethernet.

Now we need to scale up/out!

The consultants are saying we will need to backup 30TB in a 6hr window,
but maybe has high as 50TB in 6hr.
That is (roughly):
 30TB in 6hr = 1,400 MB/sec
 50TB in 6hr = 2,300 MB/sec

So we need to design a TSM backup system to support this.

My thoughts:

1) Put a storage agent on the Bar server (Win server)
 and feed a VTL via 4x8gb san connections via a bunch of virtual tape.

2) Put the TSM server directly on the Bar server for just
 local tape and still feed a VTL as above.
 No library sharing.

3) I'd really like to not use tape (even virtual tape),
 but I can't think of any way to feed file devices
 with that throughput.

I'd appreciate any thought/comments anyone might have!

Thanks

Rick




-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


OnCommand System Manager 2.2 or 3.0

2015-07-23 Thread Rhodes, Richard L.
IBM N3220 - 2857-A22  (NetApp FAS2240-2)
Data ONTAP Release 8.1.2P1 7-Mode

We currently use OnCommand System manager 2.2.
It has quit working because SSL in browsers has been deactivated on all Windows 
systems.  This originally occurred on Win7 systems (my laptop), and now on 
servers.  This means that we can no longer use this gui.

I am at a loss as to what to do.

Any thoughts are appreciated.

Rick






-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Re: can't access share with nested AD groups

2015-07-22 Thread Rhodes, Richard L.
We found the problem.

The 2012 AD uses compressed SID's which OnTap 8.1.2P1 doesn't support.  Support 
was added in 8.1.2P2.  A work-around we found on MS website works good, but 
requires the Windows use to log out and back in.

Rick



From: Rhodes, Richard L.
Sent: Tuesday, July 21, 2015 1:18 PM
To: 'ADSM: Dist Stor Manager'
Subject: can't access share with nested AD groups


IBM N3220 - 2857-A22  (NetApp FAS2240-2)

Data ONTAP Release 8.1.2P1 7-Mode

We are in the process of upgrading our AD system from Win 2008 to Win 2012R2.
After doing this, some CIFS shares cannot be accessed.  We've narrowed it down 
to AD groups that have nested groups.  Folks in the nested groups do not 
authenticate.  If we move someone from a nested group the top group, they are 
able to access files.

Any thought are appreciated!

(I'm opening a case with IBM support right after this!)


Thanks

Rick




-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


can't access share with nested AD groups

2015-07-21 Thread Rhodes, Richard L.
IBM N3220 - 2857-A22  (NetApp FAS2240-2)

Data ONTAP Release 8.1.2P1 7-Mode

We are in the process of upgrading our AD system from Win 2008 to Win 2012R2.
After doing this, some CIFS shares cannot be accessed.  We've narrowed it down 
to AD groups that have nested groups.  Folks in the nested groups do not 
authenticate.  If we move someone from a nested group the top group, they are 
able to access files.

Any thought are appreciated!

(I'm opening a case with IBM support right after this!)


Thanks

Rick




-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Re: Disk layout for AIX

2015-07-15 Thread Rhodes, Richard L.
What seems like not that long ago we ran our databases on JBOD disks (disks if 
250m to 1gb).  We setup oracle per design - logs on one disk, db files on 
another, redo logs on another, archive logs on others (aix mirrored pairs).  
Then indexes would pound it's disk, but other disk sat there not being hit 
hard, so we added another disk for the indexes.  We kept at this until we 
finally realized all we were really doing was setting ceilings on the 
operations.  We would have a couple dozen disks with some getting hit hard 
while other doing little.  That's when we first started stripping across the 
spindles.  The only place we segregate on I/O type is random vs sequential.  
When we moved onto EMC Symmetric storage, we continued this - stripping across 
all luns which were across all the backend disks in the Symm. This created a 
plaid! EMC told us to NOT do this - it was a mistake, even though they spouted 
that hot spindles were the number 1 performance problem.   Then they would 
produce a heat map and see our backend spindles were all evenly used - no hot 
spots.  Several years later they were standing up at EMC World spouting wide 
stripping.  Now it seems most disk systems wide stripe by default.  Our view is 
an I/O is an I/O, unless it's of a different nature (random vs sequential).  So 
our default practice is lots of luns in few vg's with LV's set to MAXIMUN to 
spread PP's across all luns in the vg.  This is especially true as multiple 
hosts share the same disk systems and vmware has multiple clients sharing disk 
systems (I/O blender they call it).

The resources in AIX are per LV/filesystem, FCS adapter and HDISK/LUN.  There 
are no I/O resources per VG that we are aware of.  We're getting ready to move 
our big SAP system from AIX/VXVM to AIX/LVM.  We will probably have multiple 
vg's, but it will be by I/O type.  We will use stripped logical vols for the 
Oracle redo log filesystems, and, separate vg's for the RMAN area (sequential 
I/O) and some other stuff.  But in general, if's it's random I/O at disk system 
then we use very few VG's with LV's spread across the luns.




Rick




-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of David 
Bronder
Sent: Wednesday, July 15, 2015 10:24 AM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: Re: Disk layout for AIX

Same number of LUNs in fewer VGs, or fewer LUNs, too?  The queuing concern
makes it sound like fewer LUNs.  If so, as Rick says, that's also where your
I/O concurrency would suffer.

If it's the same number of LUNs, using one VG per LUN makes it easier to
isolate each LV to each PV rather than potentially mixing them all together,
possibly having multiple LVs share the same PV, which could result in
database I/O to different DB2 volumes hitting the same PV and causing extra
contention.  (To be fair, in modern SAN arrays, the consumer host has no idea
where any of the blocks really live in the back end, so that kind of
contention can and probably often does happen anyway.)

My gut reaction with DB2 on TSM 6 and up is that nothing with the database
layout is as easily fixed as it was with the embedded database in TSM 5 and
earlier...  :-/  There's always trade-offs...

=Dave


On 07/15/2015 09:15 AM, Rhodes, Richard L. wrote:
 The concurrency I'm aware of is at the hdisk/lun level.  There's a 
 num_cmd_elems at on the fcs adapter which we set to 2k, and then queue_depth 
 on the hdisk.  That's why spreading I/O across as many hdisks/luns as 
 possible is advantageous.

 Rick



 -Original Message-
 From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of 
 Huebner, Andy
 Sent: Wednesday, July 15, 2015 9:33 AM
 To: ADSM-L@VM.MARIST.EDU
 Subject: Re: Disk layout for AIX

 He claims there is a queuing issue with too many at the HBA.  I guess I 
 missed that the last 12 years of being a storage/TSM admin.
 I told him the theory of using many was to allow more concurrency.  Before we 
 build I just want make sure this is not a mistake that cannot be easily fixed.

 Thanks,

 Andy Huebner

 -Original Message-
 From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of 
 David Ehresman
 Sent: Wednesday, July 15, 2015 8:12 AM
 To: ADSM-L@VM.MARIST.EDU
 Subject: Re: [ADSM-L] Disk layout for AIX

 VGs are cheap.  Why does your AIX admin want to reduce the number of VGs?

 David Ehresman

 -Original Message-
 From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of 
 Huebner, Andy
 Sent: Wednesday, July 15, 2015 9:03 AM
 To: ADSM-L@VM.MARIST.EDU
 Subject: [ADSM-L] Disk layout for AIX

 I have an AIX admin that wants to build my new TSM server using two VGs for 
 the database (6 file systems) and one VG for the various logs.
 We currently have 6 VGs for the DB and 3 VGs for the logs.  Each VG contains 
 1 file system.

 The DB is about 375GB and the new hardware is a P8.

 No TSM de-dup.

 Should I be concerned about the DB setup?


 Andy

Re: Disk layout for AIX

2015-07-15 Thread Rhodes, Richard L.
The concurrency I'm aware of is at the hdisk/lun level.  There's a 
num_cmd_elems at on the fcs adapter which we set to 2k, and then queue_depth on 
the hdisk.  That's why spreading I/O across as many hdisks/luns as possible is 
advantageous. 

Rick



-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of 
Huebner, Andy
Sent: Wednesday, July 15, 2015 9:33 AM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: Disk layout for AIX

He claims there is a queuing issue with too many at the HBA.  I guess I missed 
that the last 12 years of being a storage/TSM admin.
I told him the theory of using many was to allow more concurrency.  Before we 
build I just want make sure this is not a mistake that cannot be easily fixed.

Thanks,

Andy Huebner

-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of David 
Ehresman
Sent: Wednesday, July 15, 2015 8:12 AM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: [ADSM-L] Disk layout for AIX

VGs are cheap.  Why does your AIX admin want to reduce the number of VGs?

David Ehresman

-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of 
Huebner, Andy
Sent: Wednesday, July 15, 2015 9:03 AM
To: ADSM-L@VM.MARIST.EDU
Subject: [ADSM-L] Disk layout for AIX

I have an AIX admin that wants to build my new TSM server using two VGs for the 
database (6 file systems) and one VG for the various logs.
We currently have 6 VGs for the DB and 3 VGs for the logs.  Each VG contains 1 
file system.

The DB is about 375GB and the new hardware is a P8.

No TSM de-dup.

Should I be concerned about the DB setup?


Andy Huebner


-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Re: Disk layout for AIX

2015-07-15 Thread Rhodes, Richard L.
With your current vg setup you are dedicating one or more luns to each vg.  
The good is dedicated resources of that lun (iops+capacity) in each vg.   
But the converse is also true, you _only_ have the dedicated resources of that 
lun in the vg.
If you max out the resources of a vg and others are sitting with spare 
resources, then resources get wasted.

We like to mostly pool our luns into a few vg's.  
The lv's in a vg are all spread across the vg luns.

Here is how our TSm servers are setup.  Nothing special, but it seems to work 
for us.
Each TSm server has 2 vg's.  One for the database and stuff, and another for 
disk pools.



== vgtsm9 - database and stuff


This vg has all the database.

Note the 4 filesystems for the db2 data, 2 filesystems for 
active logs, and one filesystem for archive logs.
The filesystems are all spread across 6 x 200gb luns.

lsvg -l vgtsm9
vgtsm9:
LV NAME TYPE   LPs PPs PVs  LV STATE  MOUNT POINT
tsmdata jfs2   2   2   2open/syncd/tsmdata
loglv00 jfs2log1   1   1open/syncdN/A
tsm9jfs2   960 960 6open/syncd/tsmdata/tsm9 
  
tsmscripts  jfs2   16  16  6open/syncd
/tsmdata/tsm_scripts
db2activelog1   jfs2   300030006open/syncd
/tsmdata/tsm9/db2activelog1
db2activelog2   jfs2   300030006open/syncd
/tsmdata/tsm9/db2activelog2
db2archivelog   jfs2   900090006open/syncd
/tsmdata/tsm9/db2archivelog
db2data1jfs2   460046006open/syncd
/tsmdata/tsm9/db2data1
db2data2jfs2   460046006open/syncd
/tsmdata/tsm9/db2data2
db2data3jfs2   460046006open/syncd
/tsmdata/tsm9/db2data3
db2data4jfs2   460046006open/syncd
/tsmdata/tsm9/db2data4
tsm9install jfs2   400 400 6open/syncd
/tsmdata/tsm9/install



== vgtsm9stg - disk pools


We use raw logical vols for our disk pool.
These raw vols are all spread across 5 x 200gb luns.

lsvg -l vgtsm9stg
vgtsm9stg:
LV NAME TYPE   LPs PPs PVs  LV STATE  MOUNT POINT
tsm9stg01   jfs2   800 800 5open/syncdN/A
tsm9stg02   jfs2   800 800 5open/syncdN/A
tsm9stg03   jfs2   800 800 5open/syncdN/A
tsm9stg04   jfs2   800 800 5open/syncdN/A
tsm9stg05   jfs2   800 800 5open/syncdN/A
tsm9stg06   jfs2   800 800 5open/syncdN/A
tsm9stg07   jfs2   800 800 5open/syncdN/A
tsm9stg08   jfs2   800 800 5open/syncdN/A
tsm9stg09   jfs2   800 800 5open/syncdN/A



Rick



-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of 
Huebner, Andy
Sent: Wednesday, July 15, 2015 9:03 AM
To: ADSM-L@VM.MARIST.EDU
Subject: Disk layout for AIX

I have an AIX admin that wants to build my new TSM server using two VGs for the 
database (6 file systems) and one VG for the various logs.
We currently have 6 VGs for the DB and 3 VGs for the logs.  Each VG contains 1 
file system.

The DB is about 375GB and the new hardware is a P8.

No TSM de-dup.

Should I be concerned about the DB setup?


Andy Huebner


-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Re: finding possible values for a particular column

2015-04-09 Thread Rhodes, Richard L.
Hi Cameron,

I'd be interested how you get the value for var ${yesterday} in your script?  
(assuming you compute it off of ${today} ?)

I've wanted to derive an earlier date (like the date of a week ago) in a script 
a number of times and couldn't come up with a simple way to do it.  

Rick


-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of 
Hanover, Cameron
Sent: Thursday, April 09, 2015 1:15 PM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: finding possible values for a particular column

Rather than figure out all the possible conditions, I just scripted for the 
ones I cared about and warned on the rest:

for STATUS in `tsm_run_command_as_admin $INSTANCE -tab select status from 
events where domain_name like upper('${PREFIX}%') and 
scheduled_start'${yesterday} 09:00' and scheduled_start'${today} 09:00'`; do
if [[ $STATUS == Failed* ]]; then
NODESFAILED=YES
elif [ $STATUS = Missed ]; then
NODESMISSED=YES
# Some unknown exception will produce a WARNING
elif [ ! $STATUS = Completed ]  [ ! $STATUS = In Progress ] 
 [ ! $STATUS = Started ]  [ ! $STATUS = Pending ]; then
EXCEPTIONFOUND=YES
fi
done
…
if [ $NODESFAILED = YES ]; then
SUBJECT=[TSMCLIENT] NODES FAILED: $LABEL Daily Report
elif [ $NODESMISSED = YES ]; then
SUBJECT=[TSMCLIENT] NODES MISSED: $LABEL Daily Report
elif [ $EXCEPTIONFOUND = YES ]; then
SUBJECT=[TSMCLIENT] WARNING: $LABEL Daily Report
else
SUBJECT=[TSMCLIENT] $LABEL Daily Report
fi


Hopefully the variable names are obvious.  Might have been better with `case`, 
but this works.

--
Cameron Hanover
chano...@umich.edu

A computer once beat me at chess, but it was no match for me at kick boxing.
--Emo Philips

 On Apr 8, 2015, at 2:55 PM, Lee, Gary g...@bsu.edu wrote:
 
 Is there a list somewhere of the possible values for different columns in the 
 tsm database?
 
 What I am particularly looking for are all the possible values of the status 
 column in the events table.
 
 Writing a script to notify backup schedules which have gone amiss.
 
 Don't care about restarted, in progress, etc.  just error conditions.
 
 Thanks for any pointers.


-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Re: NAS storage

2015-03-19 Thread Rhodes, Richard L.
Yup,

We use a couple DataDomain dedup systems via NFS - they are basically a NAS 
systems.  And in a punch I've mounted our NSeries (NetApp) systems via NFS 
also.  It's not local/san disk, so don't expect local/san disk performance.  We 
use it for FILE dev pools, not DISK dev pools.  

Rick




-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of 
McWilliams, Eric
Sent: Thursday, March 19, 2015 12:39 PM
To: ADSM-L@VM.MARIST.EDU
Subject: NAS storage

Can NAS storage be used to back up data?  Can I set up a storage pool on the 
TSM server to back up to NAS like I do SAN?

Thanks,
Eric

**
*** CONFIDENTIALITY NOTICE *** 

 This message and any included attachments are from MedSynergies, Inc. and are 
intended only for the addressee. The contents of this message contain 
confidential information belonging to the sender that is legally protected. 
Unauthorized forwarding, printing, copying, distribution, or use of such 
information is strictly prohibited and may be unlawful. If you are not the 
addressee, please promptly delete this message and notify the sender of the 
delivery error by e-mail or contact MedSynergies, Inc. at 
postmas...@medsynergies.com.


-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Re: AIX large pages with TSM

2015-03-18 Thread Rhodes, Richard L.
I've been experimenting with LARGE PAGES.  At this time I've just been trying 
to get a TSM instance to come up with 64k pages.  I'll play with 16mb pages 
later.  

This WORKS - manual startup after changing to the db2 owner.
  
Su - tsmuser   (db2 owner)
LDR_CNTRL=TEXTPSIZE=64K@STACKPSIZE=64K@SHMPSIZE=64K@DATAPSIZE=64K ./dsmserv -i 
/tsmdata/tsmoc/config  

This DOESN'T work - starting it via the rc.dsmserv script.

become root
LDR_CNTRL=TEXTPSIZE=64K@STACKPSIZE=64K@SHMPSIZE=64K@DATAPSIZE=64K 
/opt/tivoli/tsm/server/bin/rc.dsmserv -u tsmuser -i /tsmdata/${tsm}/config -q

I understand why - the rc.dsmserv script performs a su - to the db2 instance 
owner.  This creates a new login environment for the instance owner, and thus 
doesn't pass the LDR_CNTRL env var.  I could use a custom script to start 
dsmserv, but I'm wondering how you are starting it.

Q)  How are you starting up dsmserv to enable LARGE PAGES?

Thanks

Rick


-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


migrating from a old DataDomain to a new one

2015-03-12 Thread Rhodes, Richard L.
We just purchased two new DataDomain systems to replace old ones.  The two old 
DD's are a bi-directional replication pair using MTree replication.  I need to 
migrate the data to the new DD's.   I could perform this at the TSM level with 
new storage pools and perform migration between old/new pools, but this would 
move tons of data and take weeks.

Has anyone performed a migration like this using DD replication?  A description 
of how you performed this would be greatly welcomed!

Thanks

Rick


-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Re: AIX large pages with TSM

2015-03-12 Thread Rhodes, Richard L.
Later versions of AIX have two larger page sizes available and so the
number of locks to be taken and released drops dramatically for the
typical 256KB tape transfer.

This is what I'm really confused about, and our AIX admins don't have an answer.
Our Power systems with AIX supports 4k, 64k and 16mb pages.  The IBM 
presentation makes the case about minimizing lock contation b using 16mb 
non-pagable pages.  But it also notes that using 64k pages can greatly minimize 
the contention.  When I check svmon, most of our BSS heap segments are already  
using both small(4k) and medium(64k) pages  (the sm in the listing below).

  svmon -P 10944554 | grep -i bss heap
d811d812 work text data BSS heap  sm  57518 00   
57518
ab892b13 work text data BSS heap  sm  48006 00   
48006
f8317a14 work text data BSS heap  sm  37204 00   
37204
bc0f3c11 work text data BSS heap  sm  34200 00   
34200
f50e7510 clnt text data BSS heap,  s  28667 0-  
 -
991d9b15 work text data BSS heap  sm  26213 00   
26213
9e279c16 work text data BSS heap  sm   9023 00
9023
92d01317 work text data BSS heap  sm   3652 00
3652

I don't see any way to tell if the I/O is locking 4k pages, 64k pages, or a 
mix.  The presentation gave 2 different LDR_CNTRL variables depending upon if 
you want 16mb pages or 64k pages.  

  16mb pages:   
LDR_CNTRL=TEXTPSIZE=64K@STACKPSIZE=64K@SHMPSIZE=64K@LARGE_PAGE_DATA=Y 
dsmserv
  64k pages:
LDR_CNTRL=TEXTPSIZE=64K@STACKPSIZE=64K@SHMPSIZE=64K@DATAPSIZE=64K 
dsmserv

My assumption is that the 64k LDR_CNTRL will make all the BSS heaps use only 
64k pages.  
I'm tempted to try this first since it doesn't require an AIX reboot, just a 
TSM shutdown/startup.


Rick


-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


AIX large pages with TSM

2015-03-11 Thread Rhodes, Richard L.
I've been in meetings/training this week about AIX LPM and other stuff related 
with LPARS.  We got talking about our TSM servers, and the IBM leader mentioned 
a presentation given a while ago at a IBM conference about using LARGE PAGES 
(16MB) with TSM to prevent lock contention.  This is supposed to help if you 
drive some large number of tape drives concurrently. He mentioned one company 
that implemented this and saw a 20% increase in tape throughput.

http://www-01.ibm.com/support/docview.wss?uid=swg21649823aid=1

I'm curious if anyone out there has heard of this and possibly implemented 
large pages for TSM.

Thanks!

Rick






-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


Re: select * from backups + file size

2015-03-09 Thread Rhodes, Richard L.
Bummer . . .I didn't save it!

I once wrote a sql cmd to join backups and contents (v6.2.5).  I don't think I 
ever waited long enough to let it actually return a result, so I threw it away.

Rick



-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Remco 
Post
Sent: Monday, March 09, 2015 1:37 PM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: select * from backups + file size

 Op 9 mrt. 2015, om 17:43 heeft Karel Bos tsm@gmail.com het volgende 
 geschreven:
 
 Hi,
 
 Customer wants to get report on DB2 backups containing NODE_NAME
 FILESPACE_NAME HL_NAME LL_NAME BACKUP_DATE and Size.
 
 Select * from backup where node_name='' shows all but the requested object
 SIZE. Does anyone has a select I can use to get the object size into this?


the object size in the contents table is for the bigfile (aggregate), which can 
be many files. I don’t think there is any select that can give you what you 
want from the server side.

 
 
 Kind regards,
 
 Karel

-- 

 Met vriendelijke groeten/Kind Regards,

Remco Post
r.p...@plcs.nl
+31 6 248 21 622


-
The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.


  1   2   >