Re: TIOT filling up: too many dynamic concatenations

2008-04-20 Thread Jack Schudel
] Newsgroups: bit.listserv.ibm-main To: IBM-MAIN@BAMA.UA.EDU Sent: Wednesday, April 09, 2008 2:35 PM Subject: Re: TIOT filling up: too many dynamic concatenations Ed, Field S99ERROR (after the dynamic concatenation request to DYNALLOC) is coming back with a value of X'0238': Space unavailable

Re: TIOT filling up: too many dynamic concatenations

2008-04-16 Thread Paul Gilmartin
On Tue, 15 Apr 2008 21:45:34 -0300, Shmuel Metz (Seymour J.) wrote: But this provokes an interesting question: If (as I believe) HFS data sets are dynamically allocated in the OMVS address space (that's what's cited when I try to delete one), isn't OMVS at extreme hazard of impacting DVC etc.

Re: TIOT filling up: too many dynamic concatenations

2008-04-16 Thread Edward Jaffe
Paul Gilmartin wrote: Ah! colony address spaces; plural. Will OMVS create additional colony address spaces as hundreds of filesystems are mounted, as needed to avoid system limits on TIOT size, etc.? This should not be an issue. Authorized programs are not constrained by traditional

Re: TIOT filling up: too many dynamic concatenations

2008-04-16 Thread (IBM Mainframe Discussion List)
In a message dated 4/16/2008 12:28:54 P.M. Central Daylight Time, [EMAIL PROTECTED] writes: Authorized programs are not constrained by traditional limits on TIOT size and 24-bit virtual storage. ... Such programs can support literally hundreds of thousands of simultaneous allocations.

Re: TIOT filling up: too many dynamic concatenations

2008-04-16 Thread Edward Jaffe
(IBM Mainframe Discussion List) wrote: They can also do I/O without any allocation, TIOT entry, DD statement, enqueue, open, etc. All they need is a UCB address, some CCWs somewhere, and about 150 bytes of ECSA. Of course ... using the low-level STARTIO interface. But, dynamic data set

Re: TIOT filling up: too many dynamic concatenations

2008-04-16 Thread Mark Zelden
On Wed, 16 Apr 2008 10:28:00 -0700, Edward Jaffe [EMAIL PROTECTED] wrote: Paul Gilmartin wrote: Ah! colony address spaces; plural. Will OMVS create additional colony address spaces as hundreds of filesystems are mounted, as needed to avoid system limits on TIOT size, etc.? This should not

Re: TIOT filling up: too many dynamic concatenations

2008-04-15 Thread Shmuel Metz (Seymour J.)
In [EMAIL PROTECTED], on 04/09/2008 at 10:03 PM, McKown, John [EMAIL PROTECTED] said: And doing QSAM I/O does avoid some problems with the LF or CRLF at the end of the logical records. Or NL if it's EBCDIC. -- Shmuel (Seymour J.) Metz, SysProg and JOAT ISO position; see

Re: TIOT filling up: too many dynamic concatenations

2008-04-15 Thread Shmuel Metz (Seymour J.)
In [EMAIL PROTECTED], on 04/09/2008 at 05:52 PM, Paul Gilmartin [EMAIL PROTECTED] said: But this provokes an interesting question: If (as I believe) HFS data sets are dynamically allocated in the OMVS address space (that's what's cited when I try to delete one), isn't OMVS at extreme hazard of

Re: TIOT filling up: too many dynamic concatenations

2008-04-10 Thread Hunkeler Peter (KIUK 3)
Why do you concatenate them that way? Why not just find/open/process each independently? Or if you prefer, find all of them, then in a loop (allocate, open, process, deallocate) each individually? Yes, it is a bit more difficult to program, but it is infinitely scalable. If this hasn't changed

Re: TIOT filling up: too many dynamic concatenations

2008-04-10 Thread Hunkeler Peter (KIUK 3)
Remember, z/OS emulates UNIX -- a CAT/READ/de-allocate is still just as expensive. It may quack like a duck; walk like a duck; it is an emulated duck. There is no such thing as allocation and deallocation in UNIX, incluiding z/OS UNIX. The z/OS UNIX kernel, more specifically, the physical

Re: TIOT filling up: too many dynamic concatenations

2008-04-10 Thread McKown, John
-Original Message- From: IBM Mainframe Discussion List [mailto:[EMAIL PROTECTED] On Behalf Of Hunkeler Peter (KIUK 3) Sent: Thursday, April 10, 2008 1:14 AM To: IBM-MAIN@BAMA.UA.EDU Subject: Re: TIOT filling up: too many dynamic concatenations Why do you concatenate them

Re: TIOT filling up: too many dynamic concatenations

2008-04-10 Thread J R
are not being reused by the concatenation but just used for the information that they contain. Date: Wed, 9 Apr 2008 13:35:28 -0500 From: [EMAIL PROTECTED] Subject: Re: TIOT filling up: too many dynamic concatenations To: IBM-MAIN@BAMA.UA.EDU Ed, Field S99ERROR (after the dynamic

Re: TIOT filling up: too many dynamic concatenations

2008-04-10 Thread Edward Jaffe
Hunkeler Peter (KIUK 3) wrote: Why do you concatenate them that way? Why not just find/open/process each independently? Or if you prefer, find all of them, then in a loop (allocate, open, process, deallocate) each individually? Yes, it is a bit more difficult to program, but it is infinitely

Re: TIOT filling up: too many dynamic concatenations

2008-04-10 Thread David Eisenberg
My apologies if this has already been answered but I haven't seen it. No apologies necessary! The entry that was filling up was actually not MYFILE; that entry remained at 20 bytes. The ever-growing entry seemed to contain all of the history of the concatenated DDs. With each new allocation

Re: TIOT filling up: too many dynamic concatenations

2008-04-10 Thread Tom Schmidt
David, Could you clarify whether you perform the concatenation just once per run, or am I understanding that you perform multiple concatenations during each run? -- Tom Schmidt On Thu, 10 Apr 2008 15:13:58 -0500, David Eisenberg wrote: The entry that was filling up was actually not

Re: TIOT filling up: too many dynamic concatenations

2008-04-10 Thread Wayne Driscoll
: IBM Mainframe Discussion List [mailto:[EMAIL PROTECTED] On Behalf Of David Eisenberg Sent: Thursday, April 10, 2008 3:14 PM To: IBM-MAIN@BAMA.UA.EDU Subject: Re: TIOT filling up: too many dynamic concatenations My apologies if this has already been answered but I haven't seen it. No apologies

Re: TIOT filling up: too many dynamic concatenations

2008-04-10 Thread Paul Gilmartin
On Thu, 10 Apr 2008 15:34:29 -0500, Wayne Driscoll wrote: David, I would have to agree with the posters that felt that the best way to handle this would be to use the z/OS UNIX services to read the files. While this does mean that you will need 2 code paths, one for UNIX files and a second one

TIOT filling up: too many dynamic concatenations

2008-04-09 Thread David Eisenberg
Anyone, I have a mainframe assembler application which is invoking Unix system services to get the names of all of the files in an NFS-mounted folder. The application dynamically allocates and logically concatenates these files into one giant dataset, then uses QSAM macros to read it. The

Re: TIOT filling up: too many dynamic concatenations

2008-04-09 Thread Edward Jaffe
David Eisenberg wrote: The problem is that I have reached a practical limit of approximately 540 files in the folder, because when I reach that point, I get a dynamic concatenation ABEND due to the TIOT filling up. I am told that our TIOT size is the default of 32K, which would allow for a

Re: TIOT filling up: too many dynamic concatenations

2008-04-09 Thread McKown, John
-Original Message- From: IBM Mainframe Discussion List [mailto:[EMAIL PROTECTED] On Behalf Of David Eisenberg Sent: Wednesday, April 09, 2008 1:17 PM To: IBM-MAIN@BAMA.UA.EDU Subject: TIOT filling up: too many dynamic concatenations Anyone, I have a mainframe assembler

Re: TIOT filling up: too many dynamic concatenations

2008-04-09 Thread David Eisenberg
Ed, Field S99ERROR (after the dynamic concatenation request to DYNALLOC) is coming back with a value of X'0238': Space unavailable in task input output table (TIOT). The manual says that the application should Reduce the total number of allocated DDs and devices. Deallocate data sets that are

Re: TIOT filling up: too many dynamic concatenations

2008-04-09 Thread David Eisenberg
Yes, it is a bit more difficult to program, but it is infinitely scalable. Of course, you are correct. I took this approach because I have inherited a pre-existing application that used to read a single mainframe dataset. It's only recently that the capability to read multiple files via NFS

Re: TIOT filling up: too many dynamic concatenations

2008-04-09 Thread Thompson, Steve
-Original Message- From: IBM Mainframe Discussion List [mailto:[EMAIL PROTECTED] On Behalf Of David Eisenberg Sent: Wednesday, April 09, 2008 1:17 PM To: IBM-MAIN@BAMA.UA.EDU Subject: TIOT filling up: too many dynamic concatenations Anyone, I have a mainframe assembler application which

Re: TIOT filling up: too many dynamic concatenations

2008-04-09 Thread Gene Hudders
Hi Ed: Maybe not the best solution but you can increase the size of the TIOT in the ALLOCxx parmlib member in the z/OS MVS Initialization and Tuning Reference _http://publibz.boulder.ibm.com/epubs/pdf/iea2e261.pdf_ (http://publibz.boulder.ibm.com/epubs/pdf/iea2e261.pdf) page 73. The

Re: TIOT filling up: too many dynamic concatenations

2008-04-09 Thread David Eisenberg
Try putting DYNAMNBR=1024 on your EXEC card. Just tried it; no good. Same result as before. Thanks, though. David -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the

Re: TIOT filling up: too many dynamic concatenations

2008-04-09 Thread McKown, John
-Original Message- From: IBM Mainframe Discussion List [mailto:[EMAIL PROTECTED] On Behalf Of David Eisenberg Sent: Wednesday, April 09, 2008 1:42 PM To: IBM-MAIN@BAMA.UA.EDU Subject: Re: TIOT filling up: too many dynamic concatenations Yes, it is a bit more difficult

Re: TIOT filling up: too many dynamic concatenations

2008-04-09 Thread David Eisenberg
You didn't say what language you are writing in. Mainframe assembler. Your suggestion would work, but then I would have to get into an argument with the network guys when I tell them that I need twice as much disk just so that I can do a physical concatenation of all of the files. I don't

Re: TIOT filling up: too many dynamic concatenations

2008-04-09 Thread Ted MacNEIL
Try putting DYNAMNBR=1024 on your EXEC card. Just tried it; no good. Same result as before. That's because your TIOT size is still 32K. As somebody stated, the short term solution is to bump it up to 64K. The long term would be (imo) re-write the programme to open one file at a time. - Too

Re: TIOT filling up: too many dynamic concatenations

2008-04-09 Thread McKown, John
-Original Message- From: IBM Mainframe Discussion List [mailto:[EMAIL PROTECTED] On Behalf Of David Eisenberg Sent: Wednesday, April 09, 2008 2:19 PM To: IBM-MAIN@BAMA.UA.EDU Subject: Re: TIOT filling up: too many dynamic concatenations You didn't say what language you

Re: TIOT filling up: too many dynamic concatenations

2008-04-09 Thread Paul Gilmartin
On Wed, 9 Apr 2008 13:16:58 -0500, David Eisenberg wrote: I have a mainframe assembler application which is invoking Unix system services to get the names of all of the files in an NFS-mounted folder. The application dynamically allocates and logically concatenates these files into one giant

Re: TIOT filling up: too many dynamic concatenations

2008-04-09 Thread Paul Gilmartin
On Wed, 9 Apr 2008 13:16:58 -0500, David Eisenberg wrote: I have a mainframe assembler application which is invoking Unix system services to get the names of all of the files in an NFS-mounted folder. The application dynamically allocates and logically concatenates these files into one giant

Re: TIOT filling up: too many dynamic concatenations

2008-04-09 Thread Paul Gilmartin
On Wed, 9 Apr 2008 14:54:53 -0500, McKown, John wrote: I think that is the best idea. Hopefully it won't be too difficult. I can think of some other methods, but they are very UNIXy and weird. Such as creating a named pipe, fork()'ing then exec()'ing /bin/cat in the child to write to the pipe

Re: TIOT filling up: too many dynamic concatenations

2008-04-09 Thread Traylor, Terry
The dataclass Dynamic Volume Count (DVC) is (DSN DD + DVC amount) for each dataset allocated. If the DVC is 20, the that would equate to 21 DDs in TIOT times however many datasets allocated. Terry Traylor -- For IBM-MAIN

Re: TIOT filling up: too many dynamic concatenations

2008-04-09 Thread McKown, John
-Original Message- From: IBM Mainframe Discussion List [mailto:[EMAIL PROTECTED] On Behalf Of Traylor, Terry Sent: Wednesday, April 09, 2008 4:11 PM To: IBM-MAIN@BAMA.UA.EDU Subject: Re: TIOT filling up: too many dynamic concatenations The dataclass Dynamic Volume Count (DVC

Re: TIOT filling up: too many dynamic concatenations

2008-04-09 Thread Paul Gilmartin
On Wed, 9 Apr 2008 16:15:26 -0500, McKown, John wrote: -Original Message- [mailto:[EMAIL PROTECTED] On Behalf Of Traylor, Terry Sent: Wednesday, April 09, 2008 4:11 PM The dataclass Dynamic Volume Count (DVC) is (DSN DD + DVC amount) for each dataset allocated. If the DVC is 20,

Re: TIOT filling up: too many dynamic concatenations

2008-04-09 Thread Jim Mulder
IBM Mainframe Discussion List IBM-MAIN@BAMA.UA.EDU wrote on 04/09/2008 02:16:58 PM: I have a mainframe assembler application which is invoking Unix system services to get the names of all of the files in an NFS-mounted folder. The application dynamically allocates and logically

Re: TIOT filling up: too many dynamic concatenations

2008-04-09 Thread Mark Zelden
On Wed, 9 Apr 2008 17:52:47 -0500, Paul Gilmartin [EMAIL PROTECTED] wrote: But this provokes an interesting question: If (as I believe) HFS data sets are dynamically allocated in the OMVS address space (that's what's cited when I try to delete one), isn't OMVS at extreme hazard of impacting DVC

Re: TIOT filling up: too many dynamic concatenations

2008-04-09 Thread Paul Gilmartin
On Wed, 9 Apr 2008 19:13:19 -0400, Jim Mulder wrote: Is it necessary to concatenate all of the files? Could you restructure the program so that it allocates, opens, reads, closes, and unallocates each file sequentially? If the purpose is simply to read and process all of the records in all of

Re: TIOT filling up: too many dynamic concatenations

2008-04-09 Thread Ted MacNEIL
How would the performance of a scheme that allocates, opens, reads, closes, and unallocates each file sequentially (or concatenated, which still does most of the same work) compare with allocating a single POSIX pipe and using BPX1* system calls to copy the various NFS files into it? My gut

Re: TIOT filling up: too many dynamic concatenations

2008-04-09 Thread McKown, John
-Original Message- From: IBM Mainframe Discussion List [mailto:[EMAIL PROTECTED] On Behalf Of Paul Gilmartin Sent: Wednesday, April 09, 2008 7:47 PM To: IBM-MAIN@BAMA.UA.EDU Subject: Re: TIOT filling up: too many dynamic concatenations On Wed, 9 Apr 2008 19:13:19 -0400, Jim