Re: automated SMS Storage pool management
Dave, HSM has 2 methods to dynamically address volumes going over threshold: Interval Migration and On Demand Migration. Interval Migration runs hourly and processes volumes that went over threshold during the previous hour. The preferred method is the On Demand Migration technique. With ODM, as soon as a volume goes over threshold, SMS throws an ENF that HSM listens to and immediately space manages the volume. Windows can be defined to quiesce this activity during specific times, such as when critical production workloads are running. It's time to add more storage when the HSM space management runs to completion and a volume still doesn't get under threshold. If you're new to DFSMS, we have a series of recorded DFSMS Academy sessions: https://ibm.ent.box.com/s/w2jpq95ydynpztbjwdplw3l0hoipl0i8 If you're new to DFSMShsm, we have an entire series of recorded DFSMShsm Academy sessions: https://ibm.ent.box.com/v/DFSMS-Academ-DFSMShsm2021 -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN
Re: automated SMS Storage pool management
Don't forget about Quiesced volumes. They aren't used except when datasets CAN"T be allocated on all the ENABLED volumes. (Large space amounts). Some people then check volumes and rotate which ones are Quiesced. On Thu, Nov 4, 2021 at 2:34 PM Dave Jousma <01a0403c5dc1-dmarc-requ...@listserv.ua.edu> wrote: > > On Thu, 4 Nov 2021 13:08:01 +, kekronbekron > wrote: > > >Hi Dave, > > > >What you've mentioned will work. > >A cyclic automation rule that runs a REXX which does the following: > >1. D SMS,SG(ALL) and parse its output (or maybe individual commands for just > >the SGs you're interested in, to simplify parsing) > >2. Check for availability of DISNEW volumes > >3. V SMS command to ENABLE the volume > >https://www.ibm.com/docs/en/zos/2.4.0?topic=command-changing-sms-status-storage-group-volume > >4. Email about the performed action and maintain a simple status file > > > > > > Thank-you! > > -- > For IBM-MAIN subscribe / signoff / archive access instructions, > send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN -- Mike A Schwab, Springfield IL USA Where do Forest Rangers go to get away from it all? -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN
Re: automated SMS Storage pool management
On Thu, 4 Nov 2021 09:22:11 -0700, Lizette Koehler wrote: >Do you have Chicago Software Quick Ref tool? > >We actually have several part process > >The MIG setting on the Pool for auto migration when the pool reaches a certain >Percentage > >We use QW to create a Storage listing, then run a CA OPS/MVS process to parse >the output and see if the pool needs to be migrated. If yes, then we have >OPS/MVS issue the migration commands > >We also have CA Vantage to monitor the pools > >If you want further details, just send me off list > >Lizette We do. Thanks for that suggestion as well. We also have Rocket HSM reporter. That along with some of the suggestions others have given have given us plenty of food for thought. -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN
Re: automated SMS Storage pool management
Do you have Chicago Software Quick Ref tool? We actually have several part process The MIG setting on the Pool for auto migration when the pool reaches a certain Percentage We use QW to create a Storage listing, then run a CA OPS/MVS process to parse the output and see if the pool needs to be migrated. If yes, then we have OPS/MVS issue the migration commands We also have CA Vantage to monitor the pools If you want further details, just send me off list Lizette -Original Message- From: IBM Mainframe Discussion List On Behalf Of Dave Jousma Sent: Thursday, November 4, 2021 4:36 AM To: IBM-MAIN@LISTSERV.UA.EDU Subject: Re: automated SMS Storage pool management >Dave, > >Do you have DFSMShsm? If so, turn on Interval Migration and it manage the % >threshold of freespace for you. > >If you do not have DFSMShsm, what do you have? > >Bob Thanks Bob, we do have HSM. Sorry, I'm not well-versed in this area. Are there tools to know when you need to add capacity vs thrashing and continually migrating? -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN
Re: automated SMS Storage pool management
Hi Dave, Yeah, no disrespect of course. It's just a reflection of how I read the situation. - KB ‐‐‐ Original Message ‐‐‐ On Thursday, November 4th, 2021 at 8:02 PM, Dave Jousma <01a0403c5dc1-dmarc-requ...@listserv.ua.edu> wrote: > On Thu, 4 Nov 2021 13:01:07 +, kekronbekron kekronbek...@protonmail.com > wrote: > > > Please do ignore this mail/thread if it seems derailing. > > > > It hurts to see that someone just gets to manage storage at a shop like > > this. > > > > While at the same time, there's unnecessary gatekeeping on the hiring side, > > asking stupid questions and completely ignoring a person's "prior art" and > > capability to get $hit done. > > > > Being on the other side of the gate, it's like skills have no respect > > anymore. > > > > Just need to be 'from somewhere' or get a job via referral. > > > > Of course, not to mention the fact that the knowing what API stands for is > > enough qualification these days somehow (compared to people with actual XP). > > > > - KB > > KB, > > Just to be clear. I'm not the hands on the keyboard guy. I have talented > staff to handle. Sometimes though its hard to see new ways of doing things, > when at it for so long. That's why I ask questions. > > > > For IBM-MAIN subscribe / signoff / archive access instructions, > > send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN
Re: automated SMS Storage pool management
Dave, Feel free to contact me directly: robert.richa...@opm.gov Bob -Original Message- From: IBM Mainframe Discussion List On Behalf Of Dave Jousma Sent: Thursday, November 4, 2021 10:33 AM To: IBM-MAIN@LISTSERV.UA.EDU Subject: Re: automated SMS Storage pool management On Thu, 4 Nov 2021 13:01:07 +, kekronbekron wrote: >Please do ignore this mail/thread if it seems derailing. > >It hurts to see that someone just gets to manage storage at a shop like this. >While at the same time, there's unnecessary gatekeeping on the hiring side, >asking stupid questions and completely ignoring a person's "prior art" and >capability to get $hit done. >Being on the other side of the gate, it's like skills have no respect anymore. >Just need to be 'from somewhere' or get a job via referral. >Of course, not to mention the fact that the knowing what API stands for is >enough qualification these days somehow (compared to people with actual XP). > >- KB KB, Just to be clear. I'm not the hands on the keyboard guy. I have talented staff to handle. Sometimes though its hard to see new ways of doing things, when at it for so long. That's why I ask questions. -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN
Re: automated SMS Storage pool management
On Thu, 4 Nov 2021 13:08:01 +, kekronbekron wrote: >Hi Dave, > >What you've mentioned will work. >A cyclic automation rule that runs a REXX which does the following: >1. D SMS,SG(ALL) and parse its output (or maybe individual commands for just >the SGs you're interested in, to simplify parsing) >2. Check for availability of DISNEW volumes >3. V SMS command to ENABLE the volume >https://www.ibm.com/docs/en/zos/2.4.0?topic=command-changing-sms-status-storage-group-volume >4. Email about the performed action and maintain a simple status file > > Thank-you! -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN
Re: automated SMS Storage pool management
On Thu, 4 Nov 2021 13:01:07 +, kekronbekron wrote: >Please do ignore this mail/thread if it seems derailing. > >It hurts to see that someone just gets to manage storage at a shop like this. >While at the same time, there's unnecessary gatekeeping on the hiring side, >asking stupid questions and completely ignoring a person's "prior art" and >capability to get $hit done. >Being on the other side of the gate, it's like skills have no respect anymore. >Just need to be 'from somewhere' or get a job via referral. >Of course, not to mention the fact that the knowing what API stands for is >enough qualification these days somehow (compared to people with actual XP). > >- KB KB, Just to be clear. I'm not the hands on the keyboard guy. I have talented staff to handle. Sometimes though its hard to see new ways of doing things, when at it for so long. That's why I ask questions. -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN
Re: automated SMS Storage pool management
On second thought.. sorry, I don't mean gatekeeping. But rather, a huge disconnect between what the technical team(s) need and the hiring process/teams & filtering criteria in certain stages. - KB ‐‐‐ Original Message ‐‐‐ On Thursday, November 4th, 2021 at 6:31 PM, kekronbekron wrote: > Please do ignore this mail/thread if it seems derailing. > > It hurts to see that someone just gets to manage storage at a shop like this. > > While at the same time, there's unnecessary gatekeeping on the hiring side, > asking stupid questions and completely ignoring a person's "prior art" and > capability to get $hit done. > > Being on the other side of the gate, it's like skills have no respect anymore. > > Just need to be 'from somewhere' or get a job via referral. > > Of course, not to mention the fact that the knowing what API stands for is > enough qualification these days somehow (compared to people with actual XP). > > - KB > > ‐‐‐ Original Message ‐‐‐ > > On Thursday, November 4th, 2021 at 5:05 PM, Dave Jousma > 01a0403c5dc1-dmarc-requ...@listserv.ua.edu wrote: > > > > Dave, > > > > > > Do you have DFSMShsm? If so, turn on Interval Migration and it manage the > > > % threshold of freespace for you. > > > > > > If you do not have DFSMShsm, what do you have? > > > > > > Bob > > > > Thanks Bob, we do have HSM. Sorry, I'm not well-versed in this area. Are > > there tools to know when you need to add capacity vs thrashing and > > continually migrating? > > > > For IBM-MAIN subscribe / signoff / archive access instructions, > > > > send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN
Re: automated SMS Storage pool management
Years ago, before HSM, I wrote some code to deal with issues like this. IIRC, it went something like this. - About 4 times a day a job would run to identify problem packs (volumes) by relative ranking, noting the 4 worst of each. IIRC, it used the LSPACE(?) macro. - Low free space. - Many high extent datasets. - Many over allocated datasets. - High fragmentation. (Probably not needed today at most sites.) - etc. - The collected statistics and problem flags were stored in ISPF tables, one per volume. An ISPF dialog allowed review of the chronological movement of the state of each volume. The information allowed day and shift when a problem began. A DASD manager could manually flag additional volumes for specific mitigation(s). - At about 3 AM, a second job would run to process the list of "problem children" and submit various DFDSS jobs to address the specific problems identified on the specific packs. - Defrag fragmented packs. - Compress high extent PDSs. - Free unused space on over allocated datasets. - Migrate dataset high extent datasets from fullis packs to high free space packs. - etc. This was before the SCHEDULE JCL statement, ISPF LMDINIT/LMDLIST, and REXX on z/OS, so it should be a piece of cake to do something like this today today. OREXXMan Would you rather pass data in move mode (*nix piping) or locate mode (Pipes) or via disk (JCL)? Why do you think you rarely see *nix commands with more than a dozen filters, while Pipelines specifications are commonly over 100s of stages, and 1000s of stages are not uncommon. REXX is the new C. On Thu, Nov 4, 2021 at 8:08 AM kekronbekron < 02dee3fcae33-dmarc-requ...@listserv.ua.edu> wrote: > Hi Dave, > > What you've mentioned will work. > A cyclic automation rule that runs a REXX which does the following: > 1. D SMS,SG(ALL) and parse its output (or maybe individual commands for > just the SGs you're interested in, to simplify parsing) > 2. Check for availability of DISNEW volumes > 3. V SMS command to ENABLE the volume > https://www.ibm.com/docs/en/zos/2.4.0?topic=command-changing-sms-status-storage-group-volume > 4. Email about the performed action and maintain a simple status file > > > - KB > > ‐‐‐ Original Message ‐‐‐ > > On Thursday, November 4th, 2021 at 4:30 PM, Dave Jousma < > 01a0403c5dc1-dmarc-requ...@listserv.ua.edu> wrote: > > > All, > > > > I'm sure someone has solved this. I'm now managing DASD management at my > shop. One thing that bothers me is my guys getting off-shift calls because > some active storage pools fall below a % threshold of freespace. We arent > skimpy on provisioning, but dont want to over-provision either. We are IBM > system automation shop, and I asked IBM if there was any "out-of-the-box" > automation for SMS we could start with and tailor to our needs. Nothing. > Not looking to fully automate storage pool management, but something along > the lines of having some number of volumes in DISNEW status, that could be > enabled via automation - saving that middle of the night call-out, but to > follow-up on next business day. > > > > Anyone doing anything like this, case to share? > > > > Thanks in advance, Dave > > > > > > > > > For IBM-MAIN subscribe / signoff / archive access instructions, > > > > send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN > > -- > For IBM-MAIN subscribe / signoff / archive access instructions, > send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN > -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN
Re: automated SMS Storage pool management
Hi Dave, What you've mentioned will work. A cyclic automation rule that runs a REXX which does the following: 1. D SMS,SG(ALL) and parse its output (or maybe individual commands for just the SGs you're interested in, to simplify parsing) 2. Check for availability of DISNEW volumes 3. V SMS command to ENABLE the volume https://www.ibm.com/docs/en/zos/2.4.0?topic=command-changing-sms-status-storage-group-volume 4. Email about the performed action and maintain a simple status file - KB ‐‐‐ Original Message ‐‐‐ On Thursday, November 4th, 2021 at 4:30 PM, Dave Jousma <01a0403c5dc1-dmarc-requ...@listserv.ua.edu> wrote: > All, > > I'm sure someone has solved this. I'm now managing DASD management at my > shop. One thing that bothers me is my guys getting off-shift calls because > some active storage pools fall below a % threshold of freespace. We arent > skimpy on provisioning, but dont want to over-provision either. We are IBM > system automation shop, and I asked IBM if there was any "out-of-the-box" > automation for SMS we could start with and tailor to our needs. Nothing. Not > looking to fully automate storage pool management, but something along the > lines of having some number of volumes in DISNEW status, that could be > enabled via automation - saving that middle of the night call-out, but to > follow-up on next business day. > > Anyone doing anything like this, case to share? > > Thanks in advance, Dave > > > > For IBM-MAIN subscribe / signoff / archive access instructions, > > send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN
Re: automated SMS Storage pool management
Please do ignore this mail/thread if it seems derailing. It hurts to see that someone just gets to manage storage at a shop like this. While at the same time, there's unnecessary gatekeeping on the hiring side, asking stupid questions and completely ignoring a person's "prior art" and capability to get $hit done. Being on the other side of the gate, it's like skills have no respect anymore. Just need to be 'from somewhere' or get a job via referral. Of course, not to mention the fact that the knowing what API stands for is enough qualification these days somehow (compared to people with actual XP). - KB ‐‐‐ Original Message ‐‐‐ On Thursday, November 4th, 2021 at 5:05 PM, Dave Jousma <01a0403c5dc1-dmarc-requ...@listserv.ua.edu> wrote: > > Dave, > > > > Do you have DFSMShsm? If so, turn on Interval Migration and it manage the % > > threshold of freespace for you. > > > > If you do not have DFSMShsm, what do you have? > > > > Bob > > Thanks Bob, we do have HSM. Sorry, I'm not well-versed in this area. Are > there tools to know when you need to add capacity vs thrashing and > continually migrating? > > - > > For IBM-MAIN subscribe / signoff / archive access instructions, > > send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN
Re: automated SMS Storage pool management
I'm sure there are tools, but I never had the luxury of acquiring any of them. I simply managed the SMS environment. You need to understand your DFSMS and DFSMShsm environments *and* the current rules/values your predecessors set up. Big questions: Do you have enough ENABLED capacity in your pools? What are the threshold settings? What are your various criteria for migrating datasets in the first place? Are your management classes for the various datasets/pools meeting your needs? And several dozen other questions that, once the answers are known, will dictate the best setup of dataset migration and freespace management values in your environment. Simply migrating datasets to bring volume freespace up satisfies available volume freespace temporarily, but understanding the activity of the datasets and their migration values will allow you to identify and address the thrashing issue(s). Or just throw more enabled volumes into the various pools until the thrashing stops. But that is the lazy way out and does nothing about your understanding of your environment and is a short term fix at best. Bob -Original Message- From: IBM Mainframe Discussion List On Behalf Of Dave Jousma Sent: Thursday, November 4, 2021 7:36 AM To: IBM-MAIN@LISTSERV.UA.EDU Subject: Re: automated SMS Storage pool management >Dave, > >Do you have DFSMShsm? If so, turn on Interval Migration and it manage the % >threshold of freespace for you. > >If you do not have DFSMShsm, what do you have? > >Bob Thanks Bob, we do have HSM. Sorry, I'm not well-versed in this area. Are there tools to know when you need to add capacity vs thrashing and continually migrating? -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN
Re: automated SMS Storage pool management
>You may want to pose the question at the official unofficial SA user group >found here: https://groups.io/g/SAUsers Thanks Steve! -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN
Re: automated SMS Storage pool management
You may want to pose the question at the official unofficial SA user group found here: https://groups.io/g/SAUsers On Thu, Nov 4, 2021 at 6:01 AM Dave Jousma < 01a0403c5dc1-dmarc-requ...@listserv.ua.edu> wrote: > All, > > I'm sure someone has solved this. I'm now managing DASD management at my > shop. One thing that bothers me is my guys getting off-shift calls > because some active storage pools fall below a % threshold of freespace. > We arent skimpy on provisioning, but dont want to over-provision either. > We are IBM system automation shop, and I asked IBM if there was any > "out-of-the-box" automation for SMS we could start with and tailor to our > needs. Nothing.Not looking to fully automate storage pool management, > but something along the lines of having some number of volumes in DISNEW > status, that could be enabled via automation - saving that middle of the > night call-out, but to follow-up on next business day. > > Anyone doing anything like this, case to share? > > Thanks in advance, Dave > > -- > For IBM-MAIN subscribe / signoff / archive access instructions, > send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN > -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN
Re: automated SMS Storage pool management
>Dave, > >Do you have DFSMShsm? If so, turn on Interval Migration and it manage the % >threshold of freespace for you. > >If you do not have DFSMShsm, what do you have? > >Bob Thanks Bob, we do have HSM. Sorry, I'm not well-versed in this area. Are there tools to know when you need to add capacity vs thrashing and continually migrating? -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN
Re: automated SMS Storage pool management
Dave, Do you have DFSMShsm? If so, turn on Interval Migration and it manage the % threshold of freespace for you. If you do not have DFSMShsm, what do you have? Bob -Original Message- From: IBM Mainframe Discussion List On Behalf Of Dave Jousma Sent: Thursday, November 4, 2021 7:00 AM To: IBM-MAIN@LISTSERV.UA.EDU Subject: automated SMS Storage pool management All, I'm sure someone has solved this. I'm now managing DASD management at my shop. One thing that bothers me is my guys getting off-shift calls because some active storage pools fall below a % threshold of freespace. We arent skimpy on provisioning, but dont want to over-provision either. We are IBM system automation shop, and I asked IBM if there was any "out-of-the-box" automation for SMS we could start with and tailor to our needs. Nothing. Not looking to fully automate storage pool management, but something along the lines of having some number of volumes in DISNEW status, that could be enabled via automation - saving that middle of the night call-out, but to follow-up on next business day. Anyone doing anything like this, case to share? Thanks in advance, Dave -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN
