Re: Syncsort to DFSORT - my time has come.

2020-10-29 Thread Gibney, Dave
Apparently, the specification of format (or at least CH) on Syncsort JOINKEYS is optional. I don't have it specified in another job that has been working for some time. > -Original Message- > From: IBM Mainframe Discussion List On > Behalf Of Sri h Kolusu > Sent: Thursday, October 29,

Re: How best to copy all UNIX files one z/OS to another

2020-10-29 Thread kekronbekron
True, don't know what I was thinking :) Shouldn't have started w/ pax. Wanted to say, unmount, DFDSS, etc. Anyway, if there are easier ways.. - KB ‐‐‐ Original Message ‐‐‐ On Thursday, October 29, 2020 7:21 PM, Paul Gilmartin <000433f07816-dmarc-requ...@listserv.ua.edu> wrote: >

Re: UNIX fork() performance (was: SMF to capture ... )

2020-10-29 Thread David Crayford
Good work! On 30/10/2020 10:40 am, Andrew Rowley wrote: On 30/10/2020 2:32 am, Kirk Wolf wrote: Your performance work in this area is very interesting to me.  I would love to hear more if you ever write up your findings, even informally. I have been looking at SMF data and trying to build a

Re: UNIX fork() performance (was: SMF to capture ... )

2020-10-29 Thread Andrew Rowley
On 30/10/2020 2:32 am, Kirk Wolf wrote: Your performance work in this area is very interesting to me. I would love to hear more if you ever write up your findings, even informally. I have been looking at SMF data and trying to build a picture of the work that was running from the SMF

Re: Another DFSORT Question

2020-10-29 Thread Sri h Kolusu
> The control statements below work fine. They do what I wanted. > Today my question is if these SORT Control statements can be optimized? > This is not urgent. Cameron, Your job definitely can be optimized. But I want to make a observation that you might be skipping some results. You are

Re: UNIX fork() performance (was: SMF to capture ... )

2020-10-29 Thread Andrew Rowley
On 30/10/2020 12:58 am, Paul Gilmartin wrote: I suspect he's confusing "address space" with "execution environment": https://pubs.opengroup.org/onlinepubs/9699919799/utilities/V3_chap02.html#tag_18_12 If you're referring to me: it's possible, but I don't think so. Referring to the

Re: UNIX fork() performance (was: SMF to capture ... )

2020-10-29 Thread Paul Gilmartin
On Thu, 29 Oct 2020 16:21:00 -0500, Kirk Wolf wrote: >/bin/sh always uses spawn except in cases where it uses fork. Most of the >latter cases are pretty obvious: command &, `command` / $(command), etc. > I would expect one case requiring fork() is "( list )" because "list" inherits

Another DFSORT Question

2020-10-29 Thread Cameron Conacher
Hello , I have put together this set of SORT control statements to scan through an IEBPTPCH dump of a JCL or PROC PDS. The DFSORT statements will look for any JOB Steps that execute program DMBATCH (this is an NDM Program). The statements will gather up some DD Statement information related to the

Re: UNIX fork() performance (was: SMF to capture ... )

2020-10-29 Thread Kirk Wolf
/bin/sh always uses spawn except in cases where it uses fork. Most of the latter cases are pretty obvious: command &, `command` / $(command), etc. To have the spawns be local (same address space), you simply need to set _BPX_SHAREAS=YES before the command. In my example, /etc/profile is the

Re: Modify UNIX File Format

2020-10-29 Thread Paul Gilmartin
On Thu, 29 Oct 2020 19:17:50 +, Frank Swarbrick wrote: >That worked. I never in a million years would have found it. How did you >know? > Several years ago, I asked the same question on MVS-OE and WJS answered. >Your URL pointed to the binder instruction, though, not the UNIX command,

Re: Modify UNIX File Format

2020-10-29 Thread Frank Swarbrick
That worked. I never in a million years would have found it. How did you know? Your URL pointed to the binder instruction, though, not the UNIX command, which is https://www.ibm.com/support/knowledgecenter/en/SSLTBW_2.1.0/com.ibm.zos.v2r1.bpxa500/xattr.htm DVFJS:/u/dvfjs:>touch attrtest

Re: Modify UNIX File Format

2020-10-29 Thread Paul Gilmartin
On Thu, 29 Oct 2020 14:08:12 -0500, Paul Gilmartin wrote: >On Thu, 29 Oct 2020 18:31:03 +, Frank Swarbrick wrote: > >>Using the z/OS UNIX Directory List Utility (ISPF 3.17) command MF (Modify >>Format) you are able to change the file format. It prompts you with a panel >>looking something

Re: Modify UNIX File Format

2020-10-29 Thread Paul Gilmartin
On Thu, 29 Oct 2020 18:31:03 +, Frank Swarbrick wrote: >Using the z/OS UNIX Directory List Utility (ISPF 3.17) command MF (Modify >Format) you are able to change the file format. It prompts you with a panel >looking something like this: >... >Is there a corresponding UNIX command to

Modify UNIX File Format

2020-10-29 Thread Frank Swarbrick
Using the z/OS UNIX Directory List Utility (ISPF 3.17) command MF (Modify Format) you are able to change the file format. It prompts you with a panel looking something like this: Modify z/OS UNIX File Format Command ===> Pathname . : /u/dvfjs/cics_headers.txt Type . . .

GSE 2020 Virtual event - November 2nd - 12th

2020-10-29 Thread Keith Banham
Hi everyone, You may already be aware that the GSE UK Virtual Conference for 2020, will take place between 2nd and 12th November and will in place of the annual physical conference that will return in 2021. One of the big differences between this virtual and the physical conference is that

Re: How best to copy all UNIX files one z/OS to another

2020-10-29 Thread Paul Gilmartin
On Thu, 29 Oct 2020 11:52:35 -0400, Ken Smith wrote: > >But - are there FTP command parms that would copy the Unix files directly >and retain all attributes? (no intermediate pax/dss file). > Not FTP, but ssh: ( cd $HOME & pax -w . ) | ssh user@other-lpar 'cd & pax -vr' I do it routinely. --

Re: UNIX fork() performance (was: SMF to capture ... )

2020-10-29 Thread Paul Gilmartin
On Thu, 29 Oct 2020 10:32:35 -0500, Kirk Wolf wrote: > >//SHELL EXEC PGM=COZBATCH >//IN DD DSN=SYS1.MACLIB(ACB),DISP=SHR >//OUTDD SYSOUT=* >//STDIN DD * ># run the user's login shell in the same address space >fromdsn //DD:IN | grep IBM | todsn //DD:OUT >// I'm astonished that

Re: Syncsort to DFSORT - my time has come.

2020-10-29 Thread Sri h Kolusu
>>For compatibility and migration purposes, is there a way for DFSORT to accept this specification? Unfortunately NO. The other product had to introduce the formats for compensating the rich functionality of JNF1CNTL and JNF2CNTL in DFSORT. DFSORT gives you the entire INREC formatting with JNF1

Re: How best to copy all UNIX files one z/OS to another

2020-10-29 Thread Ken Smith
I've used pax to archive (aka zip/tar) => transmit => unpax and for a whole File System dfDSS copy of FS to archive => transmit => restore FS Transmit can mean FTP of the intermediate file or using a shared volume For routine copies, one could include a job routed (via jes) to the other system to

Re: Syncsort to DFSORT - my time has come.

2020-10-29 Thread Gibney, Dave
Thank you. Mos of our "fancy" sort stuff is mine, so I can make these changes. But, and this is just asking, not really expecting. For compatibility and migration purposes, is there a way for DFSORT to accept this specification? I have 4 LPARs. This job runs in 3 of them. 2 still run Syncsort.

Re: UNIX fork() performance (was: SMF to capture ... )

2020-10-29 Thread Kirk Wolf
Andrew, Your performance work in this area is very interesting to me. I would love to hear more if you ever write up your findings, even informally. We had a customer a few years ago who seem to have performance problems with fork/execs related to BPXAS address space startups. IBM worked on

Re: How best to copy all UNIX files one z/OS to another

2020-10-29 Thread Lloyd Fuller
And nobody has mentioned that pax will write or read an MVS file so you are not restricted to Open MVS for the intermediate files. Regards. Lloyd Sent from my iPad > On Oct 29, 2020, at 10:01 AM, Charles Mills wrote: > > *Size* (disk space) might be a constraint so compression is good. >

Re: How best to copy all UNIX files one z/OS to another

2020-10-29 Thread Paul Gilmartin
On Thu, 29 Oct 2020 07:01:31 -0700, Charles Mills wrote: >*Size* (disk space) might be a constraint so compression is good. > A pipe is your friend. Why should you need disk space other than for the source and the target, which I suspect you don't intend to compress? >From: Paul Gilmartin

Re: How best to copy all UNIX files one z/OS to another

2020-10-29 Thread Charles Mills
*Size* (disk space) might be a constraint so compression is good. Charles -Original Message- From: IBM Mainframe Discussion List [mailto:IBM-MAIN@LISTSERV.UA.EDU] On Behalf Of Paul Gilmartin Sent: Thursday, October 29, 2020 6:51 AM To: IBM-MAIN@LISTSERV.UA.EDU Subject: Re: How best to

Re: UNIX fork() performance (was: SMF to capture ... )

2020-10-29 Thread Paul Gilmartin
On Wed, 28 Oct 2020 16:40:23 -0500, Kirk Wolf wrote: >On Tue, Oct 27, 2020 at 5:37 PM Andrew Rowley wrote: > >> /bin/sh is executing the commands in a separate address space but >> without the sub-step created by fork-exec (I guess this is the spawn >> method that Kirk Wolf described). >>

Re: How best to copy all UNIX files one z/OS to another

2020-10-29 Thread Paul Gilmartin
On Wed, 28 Oct 2020 18:49:46 +, Michael Brennan wrote: >After the pax, unmount your new ZFS/HFS file. DFDSS dump it, terse the dump >then FTP the tersed file. At the receiving site, unterse and restore. > That seems to be an exercise in seeing how many needless utilities you can exploit.

Re: How best to copy all UNIX files one z/OS to another

2020-10-29 Thread Paul Gilmartin
On Thu, 29 Oct 2020 03:34:19 +, kekronbekron wrote: >Wondering why no one has suggested the all new USS file/directory dumping >capability in DFDSS. >... >the output will probably be huge. > I believe you've answered your own question. >See if Co:Z SFTP can help in any way w.r.t managing

Re: DFSORT wizard help

2020-10-29 Thread Ray Pearce
Could this be done quite easily using sed? Create a sed script file # split.sed s/},{/}\ {/g And then run sed -f split.sed input.file > output.records Your file looks like it is json. You will also need to remove the square brackets that surround the array of records. I'll leave this as an

Re: DFSORT wizard help

2020-10-29 Thread Ituriel do Neto
Gentlemen, The logical record i want starts with a "{" and ends with "}" Thanks Ituriel Em quarta-feira, 28 de outubro de 2020 19:13:58 BRT, Paul Gilmartin <000433f07816-dmarc-requ...@listserv.ua.edu> escreveu: On Wed, 28 Oct 2020 20:40:54 +, Ituriel do Neto wrote: >Hi, >I have

Re: How best to copy all UNIX files one z/OS to another

2020-10-29 Thread Ron Wells
Always in support of the OLD flat file system..seen the need to help roll into the MVS--z/OS fold. But over the years it has become reversed .Problem dealing with the OLD style MS/Unix style systems. And the problem dealing with the OMVS systems locking up and causing the z/OS to fail.

Re: Syncsort to DFSORT - my time has come.

2020-10-29 Thread Sri h Kolusu
Dave, DFSORT Joinkeys does not require the FORMAT of the key field as a binary match is done implicitly. So change your control cards to the following(Just removed the CH on the Fields statement) JOINKEYS FILE=F1,FIELDS=(1,9,A),TYPE=F JOINKEYS FILE=F2,FIELDS=(6,9,A),