Re: Debian and web client

[David L.A. De Leeuw]

It used to work here as well, but stopped working when the SERVER was upgraded.
So, if you keep running an old server, you can install Ubuntu WebGui as well, 
but this is probably not recommended.
David


-Original Message-
From: ADSM: Dist Stor Manager  On Behalf Of Dmitry Dukhov
Sent: Friday, April 12, 2024 12:27 PM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: [ADSM-L] Debian and web client

David,I’m confused.  I have already installed last client 8.1.22 for windows 
and web client works well Perhaps this means the old Java web client.

> On 11 Apr 2024, at 19:45, David L.A. De Leeuw  wrote:
> 
> Dimitri,
> Webgui is no longer supported.
> Read:
> 
> 
> "IBM Storage Protect"
> https://imsva91-ctp.trendmicro.com:443/wis/clicktime/v1/query?url=http
> s%3a%2f%2fwww.ibm.com%2fdocs%2fen%2fstorage%2dprotect%2f8.1.22%3ftopic
> %3dcspc%2dconfiguring%2dstorage%2dprotect%2dclientserver%2dcommunicati
> on%2dsecure%2dsockets%2dlayer%23%3a%7e%3atext%3dConfiguring%2d%2cIBM%2
> c%2dStorage%2520Protect%2520client=3CD08F73-15E2-E406-846F-25CB09
> 52541F=701951cf8dfb7cd99762e0f5be252082d875f1cf-7bbe0beb5e500bacf
> 6157050015cf3671950bd26
> 
> I tried on windows, installed fine, but not work withour 8.1.19 server...
> 
> David
> 
> -Original Message-
> From: ADSM: Dist Stor Manager  On Behalf Of 
> Dmitry Dukhov
> Sent: Thursday, April 11, 2024 6:02 PM
> To: ADSM-L@VM.MARIST.EDU
> Subject: Re: [ADSM-L] Debian and web client
> 
> No no no
> these are standard deb packages without   tivsm-webgui_8.1.22-1_amd64. 
> 
> 
> 
>> On 11 Apr 2024, at 17:57, David L.A. De Leeuw  wrote:
>> 
>> The instructions are on the Spectrum Protect website.
>> 
>> https://imsva91-ctp.trendmicro.com:443/wis/clicktime/v1/query?url=htt
>> ps%3a%2f%2fwww.ibm.com%2fdocs%2fen%2fstorage%2dprotect%2f8.1.22%3ftop
>> ic%3dclients%2dinstalling%2dubuntu%2dlinux%2dx86%2d64%2dclient=3
>> CD08F73-15E2-E406-846F-25CB0952541F=701951cf8dfb7cd99762e0f5be25
>> 2082d875f1cf-e64172d1746ecfdc7f0e261ef6f188ff12bb03c6
>> 
>> Success
>> 
>> David de Leeuw
>> Ben Gurion University of the Negev
>> Beer Sheva
>> Israel
>> 
>> 
>> -Original Message-
>> From: ADSM: Dist Stor Manager  On Behalf Of 
>> maurizio.teru...@bluewin.ch
>> Sent: Thursday, April 11, 2024 4:56 PM
>> To: ADSM-L@VM.MARIST.EDU
>> Subject: Re: [ADSM-L] Debian and web client
>> 
>> HEllo, few years ago I made this operation on client tsm v7.x, I don't 
>> remember exactly but I had to resolve some kernel module dependency (lsmod, 
>> ...) because some was not linked on the current path I used softlink to get 
>> the needed livraries.
>> 
>> I doesn't help to much but maybe a new Idea :) .
>> 
>> Good luck
>> 
>> Ciao
>> Maurizio
>> 
>>  Messaggio originale 
>> Da : dem...@gmail.com
>> Data : 11/04/2024 - 15:24 (CEST)
>> A : ADSM-L@VM.MARIST.EDU
>> Oggetto : [ADSM-L] Debian and web client
>> 
>> Hi everyone
>> 
>> I noticed that there is a  client package for linux with web client but not  
>> for Debian.
>> How to install web client for Debian , Ubuntu ?
>> p.s
>> using the alien converts didn't help me
>> 
>> Dmitry Dukhov
> 

Re: Debian and web client

[David L.A. De Leeuw]

Dimitri,
Webgui is no longer supported.
Read:


"IBM Storage Protect"
https://www.ibm.com/docs/en/storage-protect/8.1.22?topic=cspc-configuring-storage-protect-clientserver-communication-secure-sockets-layer#:~:text=Configuring-,IBM,-Storage%20Protect%20client

I tried on windows, installed fine, but not work withour 8.1.19 server...

David

-Original Message-
From: ADSM: Dist Stor Manager  On Behalf Of Dmitry Dukhov
Sent: Thursday, April 11, 2024 6:02 PM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: [ADSM-L] Debian and web client

No no no
these are standard deb packages without   tivsm-webgui_8.1.22-1_amd64. 



> On 11 Apr 2024, at 17:57, David L.A. De Leeuw  wrote:
> 
> The instructions are on the Spectrum Protect website.
> 
> https://imsva91-ctp.trendmicro.com:443/wis/clicktime/v1/query?url=https%3a%2f%2fwww.ibm.com%2fdocs%2fen%2fstorage%2dprotect%2f8.1.22%3ftopic%3dclients%2dinstalling%2dubuntu%2dlinux%2dx86%2d64%2dclient=2D987E73-15D3-7306-95A8-5242B6655B09=701951cf8dfb7cd99762e0f5be252082d875f1cf-55d6b3e667affebbe23d1b5c79c2b0825fe07b52
> 
> Success
> 
> David de Leeuw
> Ben Gurion University of the Negev
> Beer Sheva
> Israel
> 
> 
> -Original Message-
> From: ADSM: Dist Stor Manager  On Behalf Of 
> maurizio.teru...@bluewin.ch
> Sent: Thursday, April 11, 2024 4:56 PM
> To: ADSM-L@VM.MARIST.EDU
> Subject: Re: [ADSM-L] Debian and web client
> 
> HEllo, few years ago I made this operation on client tsm v7.x, I don't 
> remember exactly but I had to resolve some kernel module dependency (lsmod, 
> ...) because some was not linked on the current path I used softlink to get 
> the needed livraries.
> 
> I doesn't help to much but maybe a new Idea :) .
> 
> Good luck
> 
> Ciao
> Maurizio
> 
>  Messaggio originale 
> Da : dem...@gmail.com
> Data : 11/04/2024 - 15:24 (CEST)
> A : ADSM-L@VM.MARIST.EDU
> Oggetto : [ADSM-L] Debian and web client
> 
> Hi everyone
> 
> I noticed that there is a  client package for linux with web client but not  
> for Debian.
> How to install web client for Debian , Ubuntu ?
> p.s
> using the alien converts didn't help me
> 
> Dmitry Dukhov

Re: Debian and web client

[David L.A. De Leeuw]

The instructions are on the Spectrum Protect website.

https://www.ibm.com/docs/en/storage-protect/8.1.22?topic=clients-installing-ubuntu-linux-x86-64-client

Success

David de Leeuw
Ben Gurion University of the Negev
Beer Sheva
Israel


-Original Message-
From: ADSM: Dist Stor Manager  On Behalf Of 
maurizio.teru...@bluewin.ch
Sent: Thursday, April 11, 2024 4:56 PM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: [ADSM-L] Debian and web client

HEllo, few years ago I made this operation on client tsm v7.x, I don't remember 
exactly but I had to resolve some kernel module dependency (lsmod, ...) because 
some was not linked on the current path I used softlink to get the needed 
livraries.

I doesn't help to much but maybe a new Idea :) .

Good luck

Ciao
Maurizio

 Messaggio originale 
Da : dem...@gmail.com
Data : 11/04/2024 - 15:24 (CEST)
A : ADSM-L@VM.MARIST.EDU
Oggetto : [ADSM-L] Debian and web client

Hi everyone

I noticed that there is a  client package for linux with web client but not  
for Debian.
How to install web client for Debian , Ubuntu ?
p.s
using the alien converts didn't help me

Dmitry Dukhov

Disaster recovery - I would like to hear your thoughts.

[David L.A. De Leeuw]

Hi Forum,

Living in an area with sirens warning for incoming rockets about daily, I got 
somewhat pressured reviewing our Disaster Recovery procedures.

Our setup:

We have a single server center that is backed up on TSM Spectrum Protect on 
daily basis. The backup is container based with 100 TB disk, of which about 70 
% is used.
Compression savings: 7 %, deduplication savings: 36 %.
The container dirs are backed up daily to two tape storage pool with "Protect 
stgpool" .
The server room is in one building, the container storage in a near building in 
the cellar.
The tapes system about 800 m. away, one of the tape sets is stored about once a 
month with a database tape in a fire resistant safe at the other side of town.

Normally I think this is reasonable, but now I consider a hit to the server 
room and the container disks simultaneously.

Recovery would come from tape. 
My problem: restoring from tape would be extremely slow as we first should 
restore all of the containers before thinking about restoring clients.

I came across the "hydrated tape" option, and we also may consider a protect 
stgpool to disk.
Our system manager tells me that the hydrated tape is cumbersome, as it would 
take a lot of time, a lot of tapes, and restore would again need to bring a lot 
of tapes online.

So here is my question, what option makes more sense:
1. Hydrated tape, store after completion in vault, update maybe once a month
2. Disk storage online, at the other side of town, but not in a vault
3. Disk storage in the cloud, probably AWS S3 deep freeze, as the need to 
really recover is quite low

Consider price, convenience, speed of backup and restore.
Did you set up such system, what is your experience ?
All comments are welcome.

David de Leeuw
Ben Gurion University of the Negev
Beer Sheva 
Israel

Re: INCR backups fail ! TSM 8.1.17 Windows Server and client

[David L.A. De Leeuw]

Good morning, TSM'ers.

My explanation of the problem, as I wrote yesterday, was wrong.
It appears some of our disks on the backup system were defined as "thin 
provisioned".
When these fill up, and cannot expand anymore, Windows will still show empty 
space on them.
I focused my attention on the disks with zero space left. But these were 
working fine.

Once I declared the "thin provisioned" disks as read-only in "update stgpooldir 
XXX access=readonly" on TSM everything works fine.
I will remove them ASAP.

Conclusion:

1. TSM works fine, but could be more tolerant if one of the stgpooldirs 
encounters a problem.
2. Windows Server works fine
3. VMWare works fine, but blocks the service without timely information to the 
end user. Only analysis of the logs point to the solution.
4. System manager (me) is too multifunctional and misses deeper understanding 
of some systems he works with.

Have a nice day

David

-Original Message-
From: דוד דה ליאו 
Sent: Wednesday, August 23, 2023 2:35 PM
To: ADSM: Dist Stor Manager 
Cc: סער קליין - Saar Klein 
Subject: RE: [ADSM-L] INCR backups fail ! TSM 8.1.17 Windows Server and client

Dear Chavdar, Michall and others,

Just an update on the issue I raised a few days ago concerning the failed 
backups.

Our ISP server uses a separate windows server with about 100 TB of containers, 
divided over 28 disks.
Backups started crashing about a week ago.
At some point the system would get stuck for five minutes or so.

Of course, a lot of different issues happened at the same time:

-The problem started after windows server updates, which forced us to reboot 
most of our systems.
-One user dumped about a terabyte of mostly small files on our system.
- Our Spectrum Protect system manager was on holidays.
-As always there are other usual suspects: antivirus etc.

Our container server runs on Vmware ESXI infrastructure. We opened a call to 
VMWARE, sent them the logs of the ESXI server.
They found a very simple cause to the problem: disks were filled up, and the 
system froze.

When checking the logs, I found that the backup containers opened in write mode 
were on disks without any space left, while other disks were less than half 
full.
So here is my solution: set the containerdirs that are full on read-only, move 
containers, wait till the containers are deleted. 

My question is: why is this process not managed automatically by ISP? Why are 
disks with a lot of space not prioritized for writing?

Thanks for your help !

David de Leeuw

-Original Message-
From: ADSM: Dist Stor Manager  On Behalf Of Chavdar Cholev
Sent: Monday, August 21, 2023 6:11 PM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: [ADSM-L] INCR backups fail ! TSM 8.1.17 Windows Server and client

Hi David,
Just make sure that containers are excluded from anti-virus scan.

On Sunday, August 20, 2023, David L.A. De Leeuw  wrote:

> Hi all,
>
> Apparently, this has nothing to do with SP at all !
>
> The (Windows server 2019 on ESXI) system holding the containers just 
> disconnects for 5 minutes !
>
> No pings to the server.
>
> When access is restored, later on, a message appears in the events:
> "The system time has changed to 2023-08-20T19:05:05 from
> 2023-08-20T19:01:04  "
> This is no warning even, just "information".
>
> I have no idea why this should happen, but we will find it.
> Thanks for your support !
>
> David
>
>
>
> -Original Message-
> From: דוד דה ליאו
> Sent: Sunday, August 20, 2023 9:37 PM
> To: ADSM: Dist Stor Manager 
> Subject: RE: [ADSM-L] INCR backups fail ! TSM 8.1.17 Windows Server 
> and client
>
> Hi Michael,
>
> Thanks a lot.
>
> The SP Server is not on VM, just the storage. I am not the manager to 
> the server.
> Just got a lot of backup storage if we provide the space for the 
> containers.
>
> Sure we run a lot of sessions in parallel as you said. I will try a 
> run according to your recommendations.
> One other thought I am testing, is that over a year ago we also had 
> crashes. The 10 Gb optical network had hickups. Our 1 Gb line worked fine.
> I just switched back to the 1 Gb and see what happens.
>
> Will keep you posted !
>
> David
>
>
> -Original Message-
> From: ADSM: Dist Stor Manager  On Behalf Of 
> Michael Prix
> Sent: Sunday, August 20, 2023 9:04 PM
> To: ADSM-L@VM.MARIST.EDU
> Subject: Re: [ADSM-L] INCR backups fail ! TSM 8.1.17 Windows Server 
> and client
>
> Hello David,
>
>   an *SP-Server in a VM is not the best setup, but nevertheless it 
> should work - and has proven so for the past.
>
> For the client: Please show the dsm.opt. I suspect you are trunning 
> several sessions from this client in parallel during a backup-> stop 
> it for the moment.
> Start with a basic dsm.opt, disable the o

Re: INCR backups fail ! TSM 8.1.17 Windows Server and client

[David L.A. De Leeuw]

Dear Chavdar, Michall and others,

Just an update on the issue I raised a few days ago concerning the failed 
backups.

Our ISP server uses a separate windows server with about 100 TB of containers, 
divided over 28 disks.
Backups started crashing about a week ago.
At some point the system would get stuck for five minutes or so.

Of course, a lot of different issues happened at the same time:

-The problem started after windows server updates, which forced us to reboot 
most of our systems.
-One user dumped about a terabyte of mostly small files on our system.
- Our Spectrum Protect system manager was on holidays.
-As always there are other usual suspects: antivirus etc.

Our container server runs on Vmware ESXI infrastructure. We opened a call to 
VMWARE, sent them the logs of the ESXI server.
They found a very simple cause to the problem: disks were filled up, and the 
system froze.

When checking the logs, I found that the backup containers opened in write mode 
were on disks without any space left, while other disks were less than half 
full.
So here is my solution: set the containerdirs that are full on read-only, move 
containers, wait till the containers are deleted. 

My question is: why is this process not managed automatically by ISP? Why are 
disks with a lot of space not prioritized for writing?

Thanks for your help !

David de Leeuw

-Original Message-
From: ADSM: Dist Stor Manager  On Behalf Of Chavdar Cholev
Sent: Monday, August 21, 2023 6:11 PM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: [ADSM-L] INCR backups fail ! TSM 8.1.17 Windows Server and client

Hi David,
Just make sure that containers are excluded from anti-virus scan.

On Sunday, August 20, 2023, David L.A. De Leeuw  wrote:

> Hi all,
>
> Apparently, this has nothing to do with SP at all !
>
> The (Windows server 2019 on ESXI) system holding the containers just 
> disconnects for 5 minutes !
>
> No pings to the server.
>
> When access is restored, later on, a message appears in the events:
> "The system time has changed to 2023-08-20T19:05:05 from
> 2023-08-20T19:01:04  "
> This is no warning even, just "information".
>
> I have no idea why this should happen, but we will find it.
> Thanks for your support !
>
> David
>
>
>
> -Original Message-
> From: דוד דה ליאו
> Sent: Sunday, August 20, 2023 9:37 PM
> To: ADSM: Dist Stor Manager 
> Subject: RE: [ADSM-L] INCR backups fail ! TSM 8.1.17 Windows Server 
> and client
>
> Hi Michael,
>
> Thanks a lot.
>
> The SP Server is not on VM, just the storage. I am not the manager to 
> the server.
> Just got a lot of backup storage if we provide the space for the 
> containers.
>
> Sure we run a lot of sessions in parallel as you said. I will try a 
> run according to your recommendations.
> One other thought I am testing, is that over a year ago we also had 
> crashes. The 10 Gb optical network had hickups. Our 1 Gb line worked fine.
> I just switched back to the 1 Gb and see what happens.
>
> Will keep you posted !
>
> David
>
>
> -Original Message-
> From: ADSM: Dist Stor Manager  On Behalf Of 
> Michael Prix
> Sent: Sunday, August 20, 2023 9:04 PM
> To: ADSM-L@VM.MARIST.EDU
> Subject: Re: [ADSM-L] INCR backups fail ! TSM 8.1.17 Windows Server 
> and client
>
> Hello David,
>
>   an *SP-Server in a VM is not the best setup, but nevertheless it 
> should work - and has proven so for the past.
>
> For the client: Please show the dsm.opt. I suspect you are trunning 
> several sessions from this client in parallel during a backup-> stop 
> it for the moment.
> Start with a basic dsm.opt, disable the option "resourceutilization", 
> if set,  and set "memoryefficient yes" (or "diskcachem" if you like). 
> I'f it still crashes with a plain dsm.opt, you should open a ticket with IBM.
>
> --
> Michael Prix
>
>
>
>
> August 20, 2023 at 7:25 PM, "David L.A. De Leeuw"  wrote:
>
>
> >
> > Hi Chavdar and Michael,
> >
> > Thanks for your thoughts and help.
> >
> > I added "memoryefficientbackup".
> >
> > But still the sessions keep crashing. Once the session crashes, I 
> > get a
> whole bit of errors for storage pool directories, and in fact the 
> whole pool becomes unavailable.
> > I run "update stgpooldir ... access=readwrite" and all is accessible
> again.
> > Some of the containers are in unavailable state and need audit.
> >
> > Our container storage is on a Dell PowerEdge R730xd, has 24 CPU's
> allocated, 64 GB memory, 110 TB disk. The disks are declared as VMDKs.
> Network is on a 10Gb Intel 82588 card.
> > Nothing I can see points to a lack of resources.
> >

Re: INCR backups fail ! TSM 8.1.17 Windows Server and client

[David L.A. De Leeuw]

Hi all,

Apparently, this has nothing to do with SP at all !

The (Windows server 2019 on ESXI) system holding the containers just 
disconnects for 5 minutes ! 

No pings to the server. 

When access is restored, later on, a message appears in the events:
"The system time has changed to 2023-08-20T19:05:05 from 2023-08-20T19:01:04  "
This is no warning even, just "information". 

I have no idea why this should happen, but we will find it.
Thanks for your support !

David



-Original Message-
From: דוד דה ליאו 
Sent: Sunday, August 20, 2023 9:37 PM
To: ADSM: Dist Stor Manager 
Subject: RE: [ADSM-L] INCR backups fail ! TSM 8.1.17 Windows Server and client

Hi Michael,

Thanks a lot.

The SP Server is not on VM, just the storage. I am not the manager to the 
server. 
Just got a lot of backup storage if we provide the space for the containers.

Sure we run a lot of sessions in parallel as you said. I will try a run 
according to your recommendations.
One other thought I am testing, is that over a year ago we also had crashes. 
The 10 Gb optical network had hickups. Our 1 Gb line worked fine.
I just switched back to the 1 Gb and see what happens. 

Will keep you posted !

David


-Original Message-
From: ADSM: Dist Stor Manager  On Behalf Of Michael Prix
Sent: Sunday, August 20, 2023 9:04 PM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: [ADSM-L] INCR backups fail ! TSM 8.1.17 Windows Server and client

Hello David,

  an *SP-Server in a VM is not the best setup, but nevertheless it should work 
- and has proven so for the past.

For the client: Please show the dsm.opt. I suspect you are trunning several 
sessions from this client in parallel during a backup-> stop it for the moment.
Start with a basic dsm.opt, disable the option "resourceutilization", if set,  
and set "memoryefficient yes" (or "diskcachem" if you like). I'f it still 
crashes with a plain dsm.opt, you should open a ticket with IBM.

-- 
Michael Prix




August 20, 2023 at 7:25 PM, "David L.A. De Leeuw"  wrote:


> 
> Hi Chavdar and Michael,
> 
> Thanks for your thoughts and help.
> 
> I added "memoryefficientbackup". 
> 
> But still the sessions keep crashing. Once the session crashes, I get a whole 
> bit of errors for storage pool directories, and in fact the whole pool 
> becomes unavailable. 
> I run "update stgpooldir ... access=readwrite" and all is accessible again.
> Some of the containers are in unavailable state and need audit. 
> 
> Our container storage is on a Dell PowerEdge R730xd, has 24 CPU's allocated, 
> 64 GB memory, 110 TB disk. The disks are declared as VMDKs. Network is on a 
> 10Gb Intel 82588 card.
> Nothing I can see points to a lack of resources.
> 
> Everything worked fine till 4 days ago. That is why I thought of a problem 
> with Windows updates, but as I rolled them back, that does not make sense.
> 
> I am quite at a loss where to look next ...
> 
> Thanks
> 
> David
> 
> [Server Side] .
> 20-08-2023 19:47:22 ANR0839I Session 197902 started for node MEDFS2 (WinNT)
>  (SSL medspice.bgu.ac.il[132.72.73.246]:53184) on
>  STOREWARE13.auth.ad.bgu.ac.il:1502. (SESSION: 197902)
> 20-08-2023 19:47:26 ANR8592I Session 197903 connection is using protocol
>  TLSV13, cipher specification TLS_AES_256_GCM_SHA384,
>  certificate TSM Self-Signed Certificate. (SESSION:
>  197903)
> 20-08-2023 19:47:26 ANR0839I Session 197903 started for node MEDFS2 (WinNT)
>  (SSL medspice.bgu.ac.il[132.72.73.246]:53185) on
>  STOREWARE13.auth.ad.bgu.ac.il:1502. (SESSION: 197903)
> 20-08-2023 19:47:55 ANR2012W Error encountered for storage pool directory:
>  \\medbackup.med.ad.bgu.ac.il\tsmc20 in storage pool:
>  CPOOL. (SESSION: 197881)
> 20-08-2023 19:47:55 ANR1181E sdtxn.c(1404): Data storage transaction
>  0:83236375 was aborted. (SESSION: 197881)
> 20-08-2023 19:47:55 ANR0204I The container state for
>  \\medbackup.med.ad.bgu.ac.il\tsmc17\18\1853.-
>  ncf is updated from AVAILABLE to UNAVAILABLE. (SESSION:
>  197883)
> 20-08-2023 19:47:55 ANR3660E An unexpected error occurred while opening or
>  writing to the container. Container
>  \\medbackup.med.ad.bgu.ac.il\tsmc17\18\1853.-
>  ncf in stgpool CPOOL has been marked as UNAVAILABLE and
>  should be audited to validate accessibility and content.
>  (SESSION: 197883)
> 
> [From the client side:]
> 
> During the incr of a large filespace:
> 
> Normal File--> 7.132.827 \\medfs2\e$\medusers14\angel\17.8.23 BU - 
> E\MyDocs(E)-PrevOLD-D\MyDocs (D)\PERSON-CRITER\FAMILY\OMRI's folder 
> 313843070\OMRI 1-16 medical issue\MRIs - CTs - OMRI\MY PROCESSING of MRI and 
> general MRI data\For-Crop-T2W - coronal Copy.pptx ** Unsuccessful **
> ANS1228E Sending of object '\\medfs2\e$\medusers14\angel\17

Re: INCR backups fail ! TSM 8.1.17 Windows Server and client

[David L.A. De Leeuw]

Hi Michael,

Thanks a lot.

The SP Server is not on VM, just the storage. I am not the manager to the 
server. 
Just got a lot of backup storage if we provide the space for the containers.

Sure we run a lot of sessions in parallel as you said. I will try a run 
according to your recommendations.
One other thought I am testing, is that over a year ago we also had crashes. 
The 10 Gb optical network had hickups. Our 1 Gb line worked fine.
I just switched back to the 1 Gb and see what happens. 

Will keep you posted !

David


-Original Message-
From: ADSM: Dist Stor Manager  On Behalf Of Michael Prix
Sent: Sunday, August 20, 2023 9:04 PM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: [ADSM-L] INCR backups fail ! TSM 8.1.17 Windows Server and client

Hello David,

  an *SP-Server in a VM is not the best setup, but nevertheless it should work 
- and has proven so for the past.

For the client: Please show the dsm.opt. I suspect you are trunning several 
sessions from this client in parallel during a backup-> stop it for the moment.
Start with a basic dsm.opt, disable the option "resourceutilization", if set,  
and set "memoryefficient yes" (or "diskcachem" if you like). I'f it still 
crashes with a plain dsm.opt, you should open a ticket with IBM.

-- 
Michael Prix




August 20, 2023 at 7:25 PM, "David L.A. De Leeuw"  wrote:


> 
> Hi Chavdar and Michael,
> 
> Thanks for your thoughts and help.
> 
> I added "memoryefficientbackup". 
> 
> But still the sessions keep crashing. Once the session crashes, I get a whole 
> bit of errors for storage pool directories, and in fact the whole pool 
> becomes unavailable. 
> I run "update stgpooldir ... access=readwrite" and all is accessible again.
> Some of the containers are in unavailable state and need audit. 
> 
> Our container storage is on a Dell PowerEdge R730xd, has 24 CPU's allocated, 
> 64 GB memory, 110 TB disk. The disks are declared as VMDKs. Network is on a 
> 10Gb Intel 82588 card.
> Nothing I can see points to a lack of resources.
> 
> Everything worked fine till 4 days ago. That is why I thought of a problem 
> with Windows updates, but as I rolled them back, that does not make sense.
> 
> I am quite at a loss where to look next ...
> 
> Thanks
> 
> David
> 
> [Server Side] .
> 20-08-2023 19:47:22 ANR0839I Session 197902 started for node MEDFS2 (WinNT)
>  (SSL medspice.bgu.ac.il[132.72.73.246]:53184) on
>  STOREWARE13.auth.ad.bgu.ac.il:1502. (SESSION: 197902)
> 20-08-2023 19:47:26 ANR8592I Session 197903 connection is using protocol
>  TLSV13, cipher specification TLS_AES_256_GCM_SHA384,
>  certificate TSM Self-Signed Certificate. (SESSION:
>  197903)
> 20-08-2023 19:47:26 ANR0839I Session 197903 started for node MEDFS2 (WinNT)
>  (SSL medspice.bgu.ac.il[132.72.73.246]:53185) on
>  STOREWARE13.auth.ad.bgu.ac.il:1502. (SESSION: 197903)
> 20-08-2023 19:47:55 ANR2012W Error encountered for storage pool directory:
>  \\medbackup.med.ad.bgu.ac.il\tsmc20 in storage pool:
>  CPOOL. (SESSION: 197881)
> 20-08-2023 19:47:55 ANR1181E sdtxn.c(1404): Data storage transaction
>  0:83236375 was aborted. (SESSION: 197881)
> 20-08-2023 19:47:55 ANR0204I The container state for
>  \\medbackup.med.ad.bgu.ac.il\tsmc17\18\1853.-
>  ncf is updated from AVAILABLE to UNAVAILABLE. (SESSION:
>  197883)
> 20-08-2023 19:47:55 ANR3660E An unexpected error occurred while opening or
>  writing to the container. Container
>  \\medbackup.med.ad.bgu.ac.il\tsmc17\18\1853.-
>  ncf in stgpool CPOOL has been marked as UNAVAILABLE and
>  should be audited to validate accessibility and content.
>  (SESSION: 197883)
> 
> [From the client side:]
> 
> During the incr of a large filespace:
> 
> Normal File--> 7.132.827 \\medfs2\e$\medusers14\angel\17.8.23 BU - 
> E\MyDocs(E)-PrevOLD-D\MyDocs (D)\PERSON-CRITER\FAMILY\OMRI's folder 
> 313843070\OMRI 1-16 medical issue\MRIs - CTs - OMRI\MY PROCESSING of MRI and 
> general MRI data\For-Crop-T2W - coronal Copy.pptx ** Unsuccessful **
> ANS1228E Sending of object '\\medfs2\e$\medusers14\angel\17.8.23 BU - 
> E\MyDocs(E)-PrevOLD-D\MyDocs (D)\PERSON-CRITER\FAMILY\OMRI's folder 
> 313843070\OMRI 1-16 medical issue\MRIs - CTs - OMRI\MY PROCESSING of MRI and 
> general MRI data\For-Crop-T2W - coronal Copy.pptx' failed.
> ANS1311E Server out of data storage space
> 
> [I ran sel of the latest file. It failed because all containerdirs were 
> unavailable.]
> 
> ANS1804E Selective Backup processing of '\\medfs2\e$\medusers14\angel\17.8.23 
> BU - E\MyDocs(E)-PrevOLD-D\MyDocs (D)\PERSON-CRITER\FAMILY\OMRI's folder 
> 313843070\OMRI 1-16 medical issue\MRIs - CTs - OMRI\MY PROCESSING of MRI and 
> general MRI data\For-Crop-T2W - coronal Copy.ppt

Re: INCR backups fail ! TSM 8.1.17 Windows Server and client

[David L.A. De Leeuw]

\angel\17.8.23 BU - 
E\MyDocs(E)-PrevOLD-D\MyDocs (D)\PERSON-CRITER\FAMILY\OMRI's folder 
313843070\OMRI 1-16 medical issue\MRIs - CTs - OMRI\MY PROCESSING of MRI and 
general MRI data\For-Crop-T2W - coronal Copy.pptx [Sent]
Selective Backup processing of '\\medfs2\e$\medusers14\angel\17.8.23 BU - 
E\MyDocs(E)-PrevOLD-D\MyDocs (D)\PERSON-CRITER\FAMILY\OMRI's folder 
313843070\OMRI 1-16 medical issue\MRIs - CTs - OMRI\MY PROCESSING of MRI and 
general MRI data\For-Crop-T2W - coronal Copy.pptx' finished without failure.


-Original Message-
From: ADSM: Dist Stor Manager  On Behalf Of Chavdar Cholev
Sent: Sunday, August 20, 2023 3:43 PM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: [ADSM-L] INCR backups fail ! TSM 8.1.17 Windows Server and client

Just to make sure that we are on the same page...
You have TSM installed on VM running on VMware. This VM has few LUNs presented 
and those LUN are used for containers?

Short in the dark:
1. Check VM resources if they are as IBM TSM blue print.
2. Check LUNs/HDDs response time in perf. monitor. The response time should 
around 20-30 Ms during the backup operating.
3. Do you know if those HDDd for LUNs are .vmdk or RDM (raw device map)?

Thank you!
Chavdar

On Saturday, August 19, 2023, David L.A. De Leeuw  wrote:

> Hi TSM experts,
>
> Our incr backup fails consistently in the last few days. It starts 
> alright but after a few gigabyte on the client we get the error:
>
> ANS1301E This operation cannot continue due to an error on the IBM 
> Spectrum Protect server. See your IBM Spectrum Protect server 
> administrator for assistance.
>
> On the server side we see:
>
> 18-08-2023 22:57:25 ANR2012W Error encountered for storage pool directory:
> \\medbackup.med.ad.bgu.ac.il\tsmc1 in storage pool:
> CPOOL. (SESSION: 194578)
> 18-08-2023 22:57:25 ANR0530W Transaction failed for session 194578 for 
> node
> MEDFS2 (WinNT) - internal server error detected.
> (SESSION: 194578)
> 18-08-2023 22:57:26 ANR2012W Error encountered for storage pool directory:
> \\medbackup.med.ad.bgu.ac.il\tsmc1 in storage pool:
> CPOOL. (SESSION: 194578)
>
>
> Then we find one or more containers unavailable. We fix the containers 
> with "audit container ... action=scanall"
> No errors are found. But the next backup will fail again.
>
> The server is on 8.1.17, the client as well.
> The containers are on a number of disks on a shared windows server 2019.
> There have been some updates on the windows server recently.
> (KB5029247,KB5029647)
>
> The audits are fine, data is accessible, but backups fail.
> Any ideas ?
>
> David de Leeuw
> Ben-Gurion University of the Negev
> Beer Sheva Israel
>
>

Re: INCR backups fail ! TSM 8.1.17 Windows Server and client

[David L.A. De Leeuw]

Hi Chavdar,

For the containers we use a dedicated Windows Server, (on VMWare EsxI), with 
just a bunch of disks on NTFS. Each disk about 4 TB.
INCR of one specific client crashes since a few days every time. There are 
about 25 million files there (40 TB).
If I try incremental backup on a part of the disk, it works fine.

On the server with the containers, I checked events, antivirus, uninstalled 
Windows updates of August. Did not find any problems.
The only similar case I found was here:
https://adsm.org/forum/index.php?threads/storagepool-containers-going-unavailable.32858/

That points to a problem of memory on the Spectrum Protect server.
Our system manager is on holidays this week, so cannot check that further.

Thanks

David


-Original Message-
From: ADSM: Dist Stor Manager  On Behalf Of Chavdar Cholev
Sent: Sunday, August 20, 2023 11:16 AM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: [ADSM-L] INCR backups fail ! TSM 8.1.17 Windows Server and client

Hi David,
What kind of storage do you use for containers (SAN, NAS...)?

On Saturday, August 19, 2023, David L.A. De Leeuw  wrote:

> Hi TSM experts,
>
> Our incr backup fails consistently in the last few days. It starts 
> alright but after a few gigabyte on the client we get the error:
>
> ANS1301E This operation cannot continue due to an error on the IBM 
> Spectrum Protect server. See your IBM Spectrum Protect server 
> administrator for assistance.
>
> On the server side we see:
>
> 18-08-2023 22:57:25 ANR2012W Error encountered for storage pool directory:
> \\medbackup.med.ad.bgu.ac.il\tsmc1 in storage pool:
> CPOOL. (SESSION: 194578)
> 18-08-2023 22:57:25 ANR0530W Transaction failed for session 194578 for 
> node
> MEDFS2 (WinNT) - internal server error detected.
> (SESSION: 194578)
> 18-08-2023 22:57:26 ANR2012W Error encountered for storage pool directory:
> \\medbackup.med.ad.bgu.ac.il\tsmc1 in storage pool:
> CPOOL. (SESSION: 194578)
>
>
> Then we find one or more containers unavailable. We fix the containers 
> with "audit container ... action=scanall"
> No errors are found. But the next backup will fail again.
>
> The server is on 8.1.17, the client as well.
> The containers are on a number of disks on a shared windows server 2019.
> There have been some updates on the windows server recently.
> (KB5029247,KB5029647)
>
> The audits are fine, data is accessible, but backups fail.
> Any ideas ?
>
> David de Leeuw
> Ben-Gurion University of the Negev
> Beer Sheva Israel
>
>

INCR backups fail ! TSM 8.1.17 Windows Server and client

[David L.A. De Leeuw]

Hi TSM experts,
 
Our incr backup fails consistently in the last few days. It starts alright but 
after a few gigabyte on the client we get the error:

ANS1301E This operation cannot continue due to an error on the IBM Spectrum 
Protect server. See your IBM Spectrum Protect server administrator for 
assistance.

On the server side we see:

18-08-2023 22:57:25 ANR2012W Error encountered for storage pool directory:
\\medbackup.med.ad.bgu.ac.il\tsmc1 in storage pool:
CPOOL. (SESSION: 194578)
18-08-2023 22:57:25 ANR0530W Transaction failed for session 194578 for node
MEDFS2 (WinNT) - internal server error detected.
(SESSION: 194578)
18-08-2023 22:57:26 ANR2012W Error encountered for storage pool directory:
\\medbackup.med.ad.bgu.ac.il\tsmc1 in storage pool:
CPOOL. (SESSION: 194578)
 

Then we find one or more containers unavailable. We fix the containers with 
"audit container ... action=scanall"
No errors are found. But the next backup will fail again.

The server is on 8.1.17, the client as well.
The containers are on a number of disks on a shared windows server 2019. There 
have been some updates on the windows server recently. (KB5029247,KB5029647)

The audits are fine, data is accessible, but backups fail.
Any ideas ?

David de Leeuw
Ben-Gurion University of the Negev
Beer Sheva Israel

Re: TSM db backup delayed or hung for more than few hours

[David L.A. De Leeuw]

Hi Sarav

We had a similar case, just yesterday. I noticed the daily full database backup 
schedule was missed a number of days. 
Then I found that five days ago the daily full backup just hanged.
Canceling the process hung as well on "pending".

I contacted our system administrator and she reported that db2 got "stuck".
She rebooted the server, and the next backup ran as usual.
If this repeats, we will open a PMR as well. 

Our version: 8.1.17

Best wishes

David de Leeuw

-Original Message-
From: ADSM: Dist Stor Manager  On Behalf Of Saravanan 
Palanisamy
Sent: Monday, May 29, 2023 12:17 AM
To: ADSM-L@VM.MARIST.EDU
Subject: [ADSM-L] TSM db backup delayed or hung for more than few hours

V8.1.18 

We have noticed tsm backup started at tsm level but  didn’t issue any message 
to db2 and tsm level db backup appears hung 

db2 list utilities show details - No process db2diag.log - didn’t see any 
message like ( Starting an online db backup ) 

Tried to restart tsm server to clear db2 hung process but no luck and db backup 
again hung. 

Main issue here : 

When we start tsm db backup it’s not able start and archive log became full. 
Tried to increase archive log few times. 

We tried almost 3 times ( we waited more than 1 hour ) but no luck. 

we always run db backup to clear archive log so that server will up and 
running. 

Same issue observed on last week in different server and today one more server. 

We have raised PMR to check this issue. 

Did anyone face this issue in v8.1.18 ? 

We have never seen this issue earlier but noticed after upgrade to v8.1.18 


Usually when we issue db backup command it will immediately start and we will 
see tsmdbmgr sessions in tsm server.  It looks like strange issue and causing 
outage for production jobs. 


Regards
Sarav 
+65 9857 8665

Re: Audit container

[David L.A. De Leeuw]

Hi Andy

Great proposal !
I already submitted the idea.
Folks, just spend a minute and vote for my idea here:

https://ibm-sys-storage.ideas.ibm.com/ideas/SPF-I-3144

Thanks

David de Leeuw
Ben Gurion university of the Negev
Beer Sheva
Israel

-Original Message-
From: ADSM: Dist Stor Manager  On Behalf Of Andrew Raibeck
Sent: Wednesday, August 24, 2022 7:36 PM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: [ADSM-L] Audit container

Hello David,

It is a nice suggestion. Maybe an additional ACTION=xxx argument, like 
SCANUNAVAILABLE? Unfortunately my powers are insufficient to drive new feature 
requests through this forum. I recommend going to the following URL to enter 
the formal request:

https://ibm-sys-storage.ideas.ibm.com/ideas

Others can also vote on it.

Best regards,

Andy

Andrew Raibeck
IBM Spectrum Protect Level 3
IBM Systems, Storage
stor...@us.ibm.com

IBM

-Original Message-
From: ADSM: Dist Stor Manager  On Behalf Of David L.A. De 
Leeuw
Sent: Monday, 22 August, 2022 04:24
To: ADSM-L@VM.MARIST.EDU
Subject: [EXTERNAL] Audit container

Wonderful that Andy is on this list !

I hope that he can be a smart interface between us, simple users, and the 
mighty IBM...

Today I found that a number of vm's did not backup snapshots to the (container 
based) storage pool.
This happened before and points to the error:

  ANS9351E Data was not available on server and was skipped. Processing snapshot
--
When checking the server I try:

  Query container state=unavailable
---
And found 26 unavailable containers. 

Usually this happens because of some communications failure between the server 
and the container storage, which are in different buildings/vlans. 
Now I have to run on each container:

  Audit container 
--
Wait some minute or two and run the next one.
To "automate" this, make a script, copy the list of bad containers to 
notepad++, edit the file, so  it looks like:

  update script auditfix "audit container XXXYYY001.dcf wait=yes" line=011
  update script auditfix "audit container XXXYYY002.dcf wait=yes" line=021

run this in the tsm admin window and then run:

  run auditfix

Here my proposal:
Fix "audit container" to allow:

  Audit container state=unavailable wait=yes


Or:

  Query container state=unavailable audit=yes


Thanks 

David de Leeuw
Ben Gurion university of the Negev
Beer Sheva
Israel

 

Audit container

[David L.A. De Leeuw]

Wonderful that Andy is on this list !

I hope that he can be a smart interface between us, simple users, and the 
mighty IBM...

Today I found that a number of vm's did not backup snapshots to the (container 
based) storage pool.
This happened before and points to the error:

  ANS9351E Data was not available on server and was skipped. Processing snapshot
--
When checking the server I try:

  Query container state=unavailable
---
And found 26 unavailable containers. 

Usually this happens because of some communications failure between the server 
and the container storage, which are in different buildings/vlans. 
Now I have to run on each container:

  Audit container 
--
Wait some minute or two and run the next one.
To "automate" this, make a script, copy the list of bad containers to 
notepad++, edit the file, so  it looks like:

  update script auditfix "audit container XXXYYY001.dcf wait=yes" line=011
  update script auditfix "audit container XXXYYY002.dcf wait=yes" line=021

run this in the tsm admin window and then run:

  run auditfix

Here my proposal:
Fix "audit container" to allow:

  Audit container state=unavailable wait=yes


Or:

  Query container state=unavailable audit=yes


Thanks 

David de Leeuw
Ben Gurion university of the Negev
Beer Sheva
Israel

 

Re: Link to current Spectrum Protect BMR process for Server 2016/2019

[David L.A. De Leeuw]

Hi Andrew

Wouldn't it be "best practice" to avoid the need to restore Windows systems ?
I am in charge of some 800 systems, and they could be knocked out some day by 
disaster.

We wouldn't be able to start restoring them one by one with WinPE and IBM 
Spectrum Protect. 
Did you time how much effort that would take ?

Our approach: all servers on virtual infrastructure, all clients with a 
standard image, we assembled according to our needs.
All users' stuff should be on the servers.
Server OS disks and snapshot disks are backup up with ISP VE.
Larger file systems (> 2 TB) are backed up with regular file based client 
backup.

Restore after disaster:

1. Windows systems: reimage standard from external disks.
2. Server systems: Restore image from ISP / VE
3. File systems: Restore files from ISP Backup

Isn't that a better "best practice" if you have large systems ?

David


David de Leeuw
Consultant,
Medical Computing Unit
Faculty of Health Sciences
Support: send message to
mcuh...@post.bgu.ac.il




-Original Message-
From: ADSM: Dist Stor Manager  On Behalf Of Andrew Raibeck
Sent: Friday, August 12, 2022 5:36 PM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: [ADSM-L] Link to current Spectrum Protect BMR process for Server 
2016/2019

This is a good "launchpad" page for the topic:

https://www.ibm.com/support/pages/recovering-microsoft-windows-systems-using-ibm-spectrum-protect-backup-archive-client

The same guidelines apply for all supported Windows OSes, up to, and including, 
Windows Server 2022.

Andrew Raibeck
IBM Spectrum Protect Level 3
IBM Systems, Storage
stor...@us.ibm.com

IBM

-Original Message-
From: ADSM: Dist Stor Manager  On Behalf Of Tom Alverson
Sent: Friday, 12 August, 2022 10:29
To: ADSM-L@VM.MARIST.EDU
Subject: [EXTERNAL] Link to current Spectrum Protect BMR process for Server 
2016/2019

The old links are broken and just go to a generic help page, and google search 
mostly finds info about Chri$tie BMR.  Is there a new BMR process posted 
somewhere??

Re: AW: [ADSM-L] AW: [ADSM-L] Moving archives into containers

[David L.A. De Leeuw]

Hi Zoltan,

I am not the expert on ISP as other writers here. But still will give you my 
opinion:

Building a test system which is so constricted that it doesn't resemble real 
life doesn't make sense to me.

The container based production system is much much easier to handle than the 
old file based, tape copy pool etc.
If you have enough disk space to contain your present primary disk and tape 
holdings (not including copypools) just take the jump.

As the others pointed out you can stop and start the conversion. Don't 
differentiate between backups, archives, nodes. That defeats the whole point of 
the system.
 Once you complete it you don't understand how you managed without it.

Just read some of the IBM docs such as 
https://www.ibm.com/support/pages/best-practices-ibm-spectrum-protect-storage-pool-conversion

We put all our ISP system on the containers (which are on JBOD disks) . Make 
daily scheduled "protect stgpool" copies to tape. Store one set in a safe and 
that is it.
Once the system is running, the daily turnover is low, because of dedup and 
compression. 
Success !
David



-Original Message-
From: ADSM: Dist Stor Manager  On Behalf Of Zoltan Forray
Sent: Monday, June 27, 2022 10:03 PM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: [ADSM-L] AW: [ADSM-L] AW: [ADSM-L] Moving archives into containers

My production ISP servers have 3TB SSD for the DB/logs, 150TB internal disks 
and multiple NFS/ISILON and other disks as needed as well as tape.
 These are test ISP servers, thus the small amount of disk.

I am thinking of converting the production systems (if we stay with ISP - we 
might move to a different "Enterprise Protection" platform which makes this 
moot) to directory-containers and want to get experienced with the conversion 
processes, first.

On Mon, Jun 27, 2022 at 2:29 PM David L.A. De Leeuw  wrote:

> Zoltan,
>
> Difficult to imagine working with tsm with such small disks.
>
> You can mount any disk system, anywhere in your environment and 
> declare as the filespaces, for containers, or for FILE systems.
>
> We have 100 TB mounted on a system, some 2 km away from the server for 
> containers, and 1 TB for database backups.
>
> TSM is extremely flexible concerning containerdirs, or filespaces. 
> Just make sure to share the disks, make sure that the user running the 
> server has full read/write access on the remote system and go.
>
> Using a mini filesystem for this operation, copying and deleting,  is 
> asking for trouble IMHO.
>
> David.
>
> -Original Message-
> From: ADSM: Dist Stor Manager  On Behalf Of 
> Zoltan Forray
> Sent: Monday, June 27, 2022 9:01 PM
> To: ADSM-L@VM.MARIST.EDU
> Subject: Re: [ADSM-L] AW: [ADSM-L] AW: [ADSM-L] Moving archives into 
> containers
>
> Since I did the RESET CONVERSION against the stgpool I "converted" to 
> container, I assume there won't be any collisions if I use the same 
> disk filesystem/mount as both FILE and CONTAINER since I only have 
> 1-10GB internal disk storage available?
>
> On Mon, Jun 27, 2022 at 1:50 PM Uwe Schreiber 
>  >
> wrote:
>
> > Hi Zoltan,
> >
> > DB Backup to Virtual Volumes ist not working with Container Pools.
> > You have to use sequential Tape or sequential File Volumes.
> >
> > Regards, Uwe
> >
> > -Ursprüngliche Nachricht-
> > Von: ADSM: Dist Stor Manager  Im Auftrag von 
> > Zoltan Forray
> > Gesendet: Montag, 27. Juni 2022 19:43
> > An: ADSM-L@VM.MARIST.EDU
> > Betreff: Re: [ADSM-L] AW: [ADSM-L] Moving archives into containers
> >
> > Next question - how do you perform a DB Backup via Virtual Volume if 
> > you can't use a container and have converted the only stgpool you 
> > have to container?
> >
> > We have 2-test ISP servers - 1-physical and 1-VM.  The VM test ISP 
> > server performs DBBackups to the physical one.  After I converted 
> > the stgpool on the physical test ISP and updated the managementclass 
> > to point to the container, now the VM test DBBackup fails with:
> >
> > 6/27/2022 1:25:02 PM ANR2776W Transaction failed for session 6688 
> > for node TSMTESTVM (Linux/x86_64) - A storage pool for the target 
> > destination is associated with a container or cloud storage pool.
> >
> > Am I missing some setting required to do this or is this simply not 
> > allowed?
> >
> > On Mon, Jun 27, 2022 at 10:43 AM Uwe Schreiber < 
> > uwe.h.schrei...@t-online.de>
> > wrote:
> >
> > > HI Zoltan,
> > >
> > > yes, as soon as the "convert stgpool" is getting started, the ISP 
> > > server prevents any further ingest of data in the source.
> > > Normally before a "convert stgpool&quo

Re: AW: [ADSM-L] AW: [ADSM-L] Moving archives into containers

[David L.A. De Leeuw]

Zoltan, 

Difficult to imagine working with tsm with such small disks.

You can mount any disk system, anywhere in your environment and declare as the 
filespaces, for containers, or for FILE systems.

We have 100 TB mounted on a system, some 2 km away from the server for 
containers, and 1 TB for database backups.

TSM is extremely flexible concerning containerdirs, or filespaces. Just make 
sure to share the disks, make sure that the user running the server has full 
read/write access on the remote system and go.

Using a mini filesystem for this operation, copying and deleting,  is asking 
for trouble IMHO.

David. 

-Original Message-
From: ADSM: Dist Stor Manager  On Behalf Of Zoltan Forray
Sent: Monday, June 27, 2022 9:01 PM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: [ADSM-L] AW: [ADSM-L] AW: [ADSM-L] Moving archives into containers

Since I did the RESET CONVERSION against the stgpool I "converted" to 
container, I assume there won't be any collisions if I use the same disk 
filesystem/mount as both FILE and CONTAINER since I only have 1-10GB internal 
disk storage available?

On Mon, Jun 27, 2022 at 1:50 PM Uwe Schreiber 
wrote:

> Hi Zoltan,
>
> DB Backup to Virtual Volumes ist not working with Container Pools.
> You have to use sequential Tape or sequential File Volumes.
>
> Regards, Uwe
>
> -Ursprüngliche Nachricht-
> Von: ADSM: Dist Stor Manager  Im Auftrag von 
> Zoltan Forray
> Gesendet: Montag, 27. Juni 2022 19:43
> An: ADSM-L@VM.MARIST.EDU
> Betreff: Re: [ADSM-L] AW: [ADSM-L] Moving archives into containers
>
> Next question - how do you perform a DB Backup via Virtual Volume if 
> you can't use a container and have converted the only stgpool you have 
> to container?
>
> We have 2-test ISP servers - 1-physical and 1-VM.  The VM test ISP 
> server performs DBBackups to the physical one.  After I converted the 
> stgpool on the physical test ISP and updated the managementclass to 
> point to the container, now the VM test DBBackup fails with:
>
> 6/27/2022 1:25:02 PM ANR2776W Transaction failed for session 6688 for 
> node TSMTESTVM (Linux/x86_64) - A storage pool for the target 
> destination is associated with a container or cloud storage pool.
>
> Am I missing some setting required to do this or is this simply not 
> allowed?
>
> On Mon, Jun 27, 2022 at 10:43 AM Uwe Schreiber < 
> uwe.h.schrei...@t-online.de>
> wrote:
>
> > HI Zoltan,
> >
> > yes, as soon as the "convert stgpool" is getting started, the ISP 
> > server prevents any further ingest of data in the source.
> > Normally before a "convert stgpool" the management class is adjusted 
> > accordingly, so that the clients don't have to wait until the 
> > convert is done.
> > The "reset convertion" will "open" the pool for further ingest of 
> > data (or another convert).
> >
> > Regards, Uwe
> >
> >
> > -Ursprüngliche Nachricht-
> > Von: ADSM: Dist Stor Manager  Im Auftrag von 
> > Zoltan Forray
> > Gesendet: Montag, 27. Juni 2022 16:05
> > An: ADSM-L@VM.MARIST.EDU
> > Betreff: Re: [ADSM-L] Moving archives into containers
> >
> > Thanks for the details/info.  So, performing the "*RESET CONVERSION*"
> > makes the source stgpool accessible/reusable. At this point, I 
> > assume the source stgpool is empty?  I am guessing IBM did this to 
> > prevent client backups from landing in the source stgpool until you 
> > have the chance to change the managementclass to point client 
> > backups to the directory-container stgpool?
> >
> > On Mon, Jun 27, 2022 at 9:10 AM MM  wrote:
> >
> > > Hallo Zoltan,
> > >
> > > more infos about the undocumented (and very useful) "*RESET
> CONVERSION*"
> > > cmd:
> > >
> > > After a successful conversion the *Access:* status
> > >
> > > (see: q stg  f=d) will be shown as "*Converted*" 
> > > and you can NOT backup new data into that pool any more.
> > >
> > > *BUT*, if you say/enter   *RESET CONVERSION" *,
> > >
> > > you change that *Access:*  status to the original *Access:* status "
> > > *Read/Write*" again.
> > >
> > > Thats all.
> > >
> > > rgds and good look  Michael M.
> > >
> > > Zoltan Forray  hat am 27.06.2022 13:47 geschrieben:
> > >
> > >
> > > Thanks for the suggestions and I would like more info on the 
> > > undocumented "reset conversion" command and what it does.
> > >
> > > Unfortunately, since archives are <0.1% of total occupancy, we 
> >

Re: Moving archives into containers

[David L.A. De Leeuw]

Hi Eric and Zoltan

Maybe I missed something. Why not directly convert stgpool from the tape 
storage pool.
We did this a year ago, took with us the archives and backups (Spectrum Protect 
doesn't care) and finished the convert in a few weeks (using pretty slow 
equipment).
Why the manual work ?

David de Leeuw
Medical Computing Unit
Ben-Gurion University of the Negev
Beer Sheva
Israel

-Original Message-
From: ADSM: Dist Stor Manager  On Behalf Of Loon, Eric 
van (ITOP DI) - KLM
Sent: Friday, June 24, 2022 6:22 PM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: [ADSM-L] Moving archives into containers

Hi Zoltan,

I think it's an undocumented command. It's not in the manuals, nor in the help, 
but I have used in in the past, at least in earlier 8.1 versions.
Since you're constrained on disk space, moving relatively small amount of 
clients at once to your small filepool would be an option. The convert will 
move the data to your container pool and the reset command will allow you to 
move the next batch of clients to your filepool.
I know, it's a lot of manual work, but I have moved all out long-term archives 
from our old servers into our new (container-based) servers this way.

Kind regards,
Eric van Loon
Core Infra


-Original Message-
From: ADSM: Dist Stor Manager  On Behalf Of Zoltan Forray
Sent: vrijdag 24 juni 2022 16:15
To: ADSM-L@VM.MARIST.EDU
Subject: Re: Moving archives into containers

Hi Eric,

Thanks for the recommendations. I always thought the conversion process 
required the target to be empty.  Unfortunately, we simply do not have 
sufficient free disk space to perform complete conversions to containers since 
everything existing stgpools are either on NFS/ISILON (yes I know IBM says this 
is not-recommended) or server internal disk.  Right now I created my first 
directory/container pool since we had a(nother) hard drive failure in our 5+ 
year old Powervault so we took this opportunity to learn directory-containers 
and their limitations.

Not sure what you mean by "reset conversion command".  I couldn't find anything 
like that in the latest 8.1.14 manual?

On Fri, Jun 24, 2022 at 9:20 AM Loon, Eric van (ITOP DI) - KLM < 
eric-van.l...@klm.com> wrote:

> Hi Zoltan,
>
> What you could do is create a file device class and move the files 
> from tape to this file device class. As soon as the files are there, 
> you can use the convert stgpool command to move the data into the 
> directory container stgpool.
> If you do this in batches, you don't need a very large filepool. After 
> emptying your filepool, you can use the reset conversion command to 
> make the filepool available for new data.
>
> Kind regards,
> Eric van Loon
> Air France/KLM
>
> -Original Message-
> From: ADSM: Dist Stor Manager  On Behalf Of 
> Zoltan Forray
> Sent: vrijdag 24 juni 2022 14:39
> To: ADSM-L@VM.MARIST.EDU
> Subject: Moving archives into containers
>
> We are currently in the midst of a big project to relocate our 
> datacenter, by the end of 2023, to a new, smaller building.
>
> At the same time, we are actively pursuing redesigning/replacing our 
> "Enterprise Data Protection" solution which may likely move us 
> completely away from Spectrum Protect. FWIW, this project started 
> before we were told we had to move out of our existing location.
>
> As an absolute minimum, we need to get everything off old magnetic 
> tape
> (3592) that we need to retain beyond 2023 (archives), since the new 
> datacenter will not have the physical space to accommodate tapes.
>
> Now that we have upgraded all ISP servers to 8.1.14.100/eFix 102, we 
> have started playing with directory-containers, since there is now 
> support for "protecting" containers to magnetic tape (for offsite backups).
>
> With the additional directory-container support/tools, we were 
> wondering if there is a way to get backups/archives into a 
> directory-container stgpool other than during ingestion from a client?
>
> If we do move away from Spectrum Protect, is the only way to retain 
> long-term archives is to recover them to the original platform/server 
> and then move them to whatever long-term storage platform we choose (i.e.
> object, cloud)?
>
> --
> *Zoltan Forray*
> Backup & VMware Systems Administrator
> Enterprise Compute & Storage Platforms VCU Infrastructure Services 
> www.ucc.vcu.edu zfor...@vcu.edu - 804-828-4807 Don't be a phishing 
> victim - VCU and other reputable organizations will never use email to 
> request that you reply with your password, social security number or 
> confidential personal information. For more details visit 
> http://phishing.vcu.edu/ 
>  ps%3a%2f%2fadminmicro2.questionpro.com=1CBA4B97-E233-2405-850A-A3
> 4E51B31D92=701951cf8dfb7cd99762e0f5be252082d875f1cf-9ffb57bc37088
> ff312b2517c52a2ea9888470669>
> 
> For information, services and offers, please visit