Hi Richard - Not sure what you use but I FTP my large files back from mvs rather than pull them from the reader. For some reason that was never fully explained that was faster than reading them even from vm minidisk. And of course I use the ftp stage so it flows direct into my pipeline.
i ------ Original Message ------ Received: 11:43 AM COT, 12/07/2010 From: "Schuh, Richard" <[email protected]> To: [email protected] Subject: Re: The Missing Stages (was: Reblocking a binary file, and VMARC) > I would not be too hasty about that. We sometimes have MVS jobs that return 10s of millions of lines to VM so that we can use Pipelines to filter the results, adjusting the filter as we go. The largest single file was over 128,000,000 lines. Does that qualify as huge? We did exceed this with an early z/TPF dump; however, the TPF folks found ways to drastically reduce the dumps before we went live with z, so that was a one-time thing. > > > Regards, > Richard Schuh > > > > > > > > Worse yet, if it's in the spool in NETDATA format (well, then > > it's likely not so huge): > >
