Re: AWS and IDRC/compression

2022-10-29 Thread Paul Gorlinsky
As an aside, my z/Appliance VTA/VTS has its own format that compresses then encrypts data for images at rest and in flight across TCP networks. We also provide tools to convert from several well known format to our format and back. We also added 128 bits of CRC on each block to ensure data

Re: AWS and IDRC/compression

2022-10-29 Thread Paul Gorlinsky
IBM zPDT and all of its variants added compression as an option to the AWS tape format like the HET format did. The problem is what compression mechanism did they use. IBM has recently switch from LZ4 to zSTD compression in various mainframe components like DDR. So I would guess that it is

Re: AWS and IDRC/compression

2022-08-01 Thread Tony Thigpen
...@vse2pdf.com] Sent: Saturday, July 30, 2022 12:45 PM To: IBM-MAIN@LISTSERV.UA.EDU Subject: Re: AWS and IDRC/compression I am working with my VTA vendor to reduce storage usage on the appliance. Currently, they can compress after the unmount and uncompress before the mount. But, this takes time, especially

Re: AWS and IDRC/compression

2022-08-01 Thread Jay Maynard
om: IBM Mainframe Discussion List [IBM-MAIN@LISTSERV.UA.EDU] on behalf > > of Tony Thigpen [t...@vse2pdf.com] > > Sent: Saturday, July 30, 2022 12:45 PM > > To: IBM-MAIN@LISTSERV.UA.EDU > > Subject: Re: AWS and IDRC/compression > > > > I am working wit

Re: AWS and IDRC/compression

2022-08-01 Thread Joe Monk
[t...@vse2pdf.com] > Sent: Saturday, July 30, 2022 12:45 PM > To: IBM-MAIN@LISTSERV.UA.EDU > Subject: Re: AWS and IDRC/compression > > I am working with my VTA vendor to reduce storage usage on the > appliance. Currently, they can compress after the unmount and uncompress >

Re: AWS and IDRC/compression

2022-08-01 Thread Seymour J Metz
From: IBM Mainframe Discussion List [IBM-MAIN@LISTSERV.UA.EDU] on behalf of Tony Thigpen [t...@vse2pdf.com] Sent: Saturday, July 30, 2022 12:45 PM To: IBM-MAIN@LISTSERV.UA.EDU Subject: Re: AWS and IDRC/compression I am working with my VTA vendor to reduce storage usage

Re: AWS and IDRC/compression

2022-07-30 Thread Tony Thigpen
y Thigpen Sent: Saturday, July 30, 2022 12:45 PM To: IBM-MAIN@LISTSERV.UA.EDU Subject: Re: AWS and IDRC/compression I am working with my VTA vendor to reduce storage usage on the appliance. Currently, they can compress after the unmount and uncompress before the mount. But, this takes time, espec

Re: AWS and IDRC/compression

2022-07-30 Thread Harry Wahl
oiting its optimal physical block size. Harry From: IBM Mainframe Discussion List on behalf of Tony Thigpen Sent: Saturday, July 30, 2022 12:45 PM To: IBM-MAIN@LISTSERV.UA.EDU Subject: Re: AWS and IDRC/compression I am working with my VTA vendor to reduce sto

Re: AWS and IDRC/compression

2022-07-30 Thread Jay Maynard
Yeah, there is no compression at all in the native AWS format. If your VTA won't do HET or something similar, then you're stuck with AWS and then compressing after the fact. On Sat, Jul 30, 2022 at 11:45 AM Tony Thigpen wrote: > I am working with my VTA vendor to reduce storage usage on the >

Re: AWS and IDRC/compression

2022-07-30 Thread Tony Thigpen
I am working with my VTA vendor to reduce storage usage on the appliance. Currently, they can compress after the unmount and uncompress before the mount. But, this takes time, especially when servicing the mount request if the tape is large. I was thinking that doing an IDRC implementation,

Re: AWS and IDRC/compression

2022-07-29 Thread Brian Westerman
One of the vendors that uses AWS is Optica, their z/VT uses AWS format. It can also compress internally, but you don't have to. Brian On Fri, 29 Jul 2022 21:44:25 -0500, Jay Maynard wrote: >I'm curious. What are you trying to accomplish with it? If it's just a >matter of faster transmission

Re: AWS and IDRC/compression

2022-07-29 Thread Jay Maynard
I'm curious. What are you trying to accomplish with it? If it's just a matter of faster transmission of entire tape images, AWS tapes compress very well. On Fri, Jul 29, 2022 at 8:38 PM Tony Thigpen wrote: > Yes. But, it sounds like nobody else will support it as a data > interchange, so it may

Re: AWS and IDRC/compression

2022-07-29 Thread Gibney, Dave
understanding, but no viable proposals. > -Original Message- > From: IBM Mainframe Discussion List On > Behalf Of Tony Thigpen > Sent: Friday, July 29, 2022 6:38 PM > To: IBM-MAIN@LISTSERV.UA.EDU > Subject: Re: AWS and IDRC/compression > > [EXTERNAL EMAIL] > > Yes. B

Re: AWS and IDRC/compression

2022-07-29 Thread Tony Thigpen
Yes. But, it sounds like nobody else will support it as a data interchange, so it may be unusable for us. I will go look at it. Tony Thigpen Jay Maynard wrote on 7/29/22 06:38: Are you talking about the tape data being compressed inside the AWS image? Hercules has a format that does this,

Re: AWS and IDRC/compression

2022-07-29 Thread Jay Maynard
Are you talking about the tape data being compressed inside the AWS image? Hercules has a format that does this, upwardly compatible with AWS, called HET (Hercules Emulated Tape), but I don't know of any other implementations of it. Each block is compressed after being received from the program

AWS and IDRC/compression

2022-07-29 Thread Tony Thigpen
Does anyone know of any 'standard' for stream based (during file creation) compression of AWS tapes? Tony Thigpen -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with